Google Analytics

Pipeline Concepts

Before setting up the pipeline, learn about pipeline concepts here

Step by Step Guide

STEP-1: Configure Connection

To learn about Connection, refer here

Log into Sprinkle application
Navigate to Ingest -> Connections Tab -> New Connection ->
Select Google Analytics
Provide all the mandatory details
- Name: Name to identify this connection
- Connect to Google
- Advance Settings : Refer here
After pressing Connect to Google, you will see authorise screen to allow permissions required for sprinkle to read data. Press Allow
Test Connection
Create

STEP-2: Configure Pipeline

To learn about datasource, refer here

Navigate to Ingest -> Pipeline Tab -> Add ->
Select Google Analytics
Provide the name -> Create
Connection Tab:
- From the drop-down, select the name of connection created in STEP-2
- Update

STEP-3: Create Dataset

Datasets Tab: To learn about Dataset, refer here. Add Dataset for each report/dataset that you want to integrate, providing following details

Account Id (Required) : GA Account
Properties/Apps (Required) : Select Property/Apps available in this account
View Id (Required) : Select Project/View available in this account
Metrics (Required) : Select upto 10 metrics
Dimensions (Optional) : Select upto 7 dimensions to aggregate your metrics on
Ingestion Mode (Required)
- Snapshot: Every run will pull data from the start date
- Incremental: Every run will pull data from the last successful run onwards
Start Date (Required) : Pull the data from this date: Format is YYYY-MM-DD
Destination Schema (Required) : Data warehouse schema where the table will be ingested into
Destination Table name (Required) : It is the table name to be created on the warehouse. If not given, sprinkle will create like ds_<pipelinename>_<tablename>
Destination Create Table Clause: Provide additional clauses to warehouse-create table queries such as clustering, partitioning, and more, useful for optimizing DML statements. Learn more on how to use this field.
Create

STEP-4: Run and schedule Ingestion

In the Ingestion Jobs tab:

Trigger the Job, using Run button
To schedule, enable Auto-Run. Change the frequency if required

Advanced Connection Settings

API Read Timeout (In seconds) : Maximum time of inactivity between two data packets when waiting for the server’s response. The default value is 30 seconds.
API Connection Timeout (In seconds) : Time period within which a connection between a client and a server must be established.
Retry Limit : Number of retries allowed when an API call fails. For example if an API call fails and retry limit is 5 then it will check 5 times for that API call and if it succeeded then it will stop checking.
Retry Sleep Time (In milliseconds) : Given time, after which retry should happen in case an API call fails.
Incremental Batch Size (In days) : No. of days in one batch for which data is being downloaded during incremental ingestion.
Version : It gives information about the version of Google Analytics core reporting API being used.
Max Records : Field sets the max limit on the number of records that can be downloaded during each API call.

Dataset Fields

User can pick following fields in datasets

GA_Users
GA_New_Users
GA___New_Sessions
GA_1_Day_Active_Users
GA_7_Day_Active_Users
GA_14_Day_Active_Users
GA_28_Day_Active_Users
GA_30_Day_Active_Users
GA_Sessions
GA_Bounces
GA_Bounce_Rate
GA_Session_Duration
GA_Avg__Session_Duration
GA_Organic_Searches
GA_Impressions
GA_Clicks
GA_Cost
GA_CPM
GA_CPC
GA_CTR
GA_Cost_per_Transaction
GA_Cost_per_Goal_Conversion
GA_Cost_per_Conversion
GA_RPC
GA_ROI
GA_Margin
GA_ROAS
GA_Goal_1_Starts
GA_Goal_2_Starts
GA_Goal_3_Starts
GA_Goal_4_Starts
GA_Goal_5_Starts
GA_Goal_6_Starts
GA_Goal_7_Starts
GA_Goal_8_Starts
GA_Goal_9_Starts
GA_Goal_10_Starts
GA_Goal_11_Starts
GA_Goal_12_Starts
GA_Goal_13_Starts
GA_Goal_14_Starts
GA_Goal_15_Starts
GA_Goal_16_Starts
GA_Goal_17_Starts
GA_Goal_18_Starts
GA_Goal_19_Starts
GA_Goal_20_Starts
GA_Goal_Starts
GA_Goal_1_Completions
GA_Goal_2_Completions
GA_Goal_3_Completions
GA_Goal_4_Completions
GA_Goal_5_Completions
GA_Goal_6_Completions
GA_Goal_7_Completions
GA_Goal_8_Completions
GA_Goal_9_Completions
GA_Goal_10_Completions
GA_Goal_11_Completions
GA_Goal_12_Completions
GA_Goal_13_Completions
GA_Goal_14_Completions
GA_Goal_15_Completions
GA_Goal_16_Completions
GA_Goal_17_Completions
GA_Goal_18_Completions
GA_Goal_19_Completions
GA_Goal_20_Completions
GA_Goal_Completions
GA_Goal_1_Value
GA_Goal_2_Value
GA_Goal_3_Value
GA_Goal_4_Value
GA_Goal_5_Value
GA_Goal_6_Value
GA_Goal_7_Value
GA_Goal_8_Value
GA_Goal_9_Value
GA_Goal_10_Value
GA_Goal_11_Value
GA_Goal_12_Value
GA_Goal_13_Value
GA_Goal_14_Value
GA_Goal_15_Value
GA_Goal_16_Value
GA_Goal_17_Value
GA_Goal_18_Value
GA_Goal_19_Value
GA_Goal_20_Value
GA_Goal_Value
GA_Per_Session_Goal_Value
GA_Goal_1_Conversion_Rate
GA_Goal_2_Conversion_Rate
GA_Goal_3_Conversion_Rate
GA_Goal_4_Conversion_Rate
GA_Goal_5_Conversion_Rate
GA_Goal_6_Conversion_Rate
GA_Goal_7_Conversion_Rate
GA_Goal_8_Conversion_Rate
GA_Goal_9_Conversion_Rate
GA_Goal_10_Conversion_Rate
GA_Goal_11_Conversion_Rate
GA_Goal_12_Conversion_Rate
GA_Goal_13_Conversion_Rate
GA_Goal_14_Conversion_Rate
GA_Goal_15_Conversion_Rate
GA_Goal_16_Conversion_Rate
GA_Goal_17_Conversion_Rate
GA_Goal_18_Conversion_Rate
GA_Goal_19_Conversion_Rate
GA_Goal_20_Conversion_Rate
GA_Goal_Conversion_Rate
GA_Goal_1_Abandoned_Funnels
GA_Goal_2_Abandoned_Funnels
GA_Goal_3_Abandoned_Funnels
GA_Goal_4_Abandoned_Funnels
GA_Goal_5_Abandoned_Funnels
GA_Goal_6_Abandoned_Funnels
GA_Goal_7_Abandoned_Funnels
GA_Goal_8_Abandoned_Funnels
GA_Goal_9_Abandoned_Funnels
GA_Goal_10_Abandoned_Funnels
GA_Goal_11_Abandoned_Funnels
GA_Goal_12_Abandoned_Funnels
GA_Goal_13_Abandoned_Funnels
GA_Goal_14_Abandoned_Funnels
GA_Goal_15_Abandoned_Funnels
GA_Goal_16_Abandoned_Funnels
GA_Goal_17_Abandoned_Funnels
GA_Goal_18_Abandoned_Funnels
GA_Goal_19_Abandoned_Funnels
GA_Goal_20_Abandoned_Funnels
GA_Abandoned_Funnels
GA_Goal_1_Abandonment_Rate
GA_Goal_2_Abandonment_Rate
GA_Goal_3_Abandonment_Rate
GA_Goal_4_Abandonment_Rate
GA_Goal_5_Abandonment_Rate
GA_Goal_6_Abandonment_Rate
GA_Goal_7_Abandonment_Rate
GA_Goal_8_Abandonment_Rate
GA_Goal_9_Abandonment_Rate
GA_Goal_10_Abandonment_Rate
GA_Goal_11_Abandonment_Rate
GA_Goal_12_Abandonment_Rate
GA_Goal_13_Abandonment_Rate
GA_Goal_14_Abandonment_Rate
GA_Goal_15_Abandonment_Rate
GA_Goal_16_Abandonment_Rate
GA_Goal_17_Abandonment_Rate
GA_Goal_18_Abandonment_Rate
GA_Goal_19_Abandonment_Rate
GA_Goal_20_Abandonment_Rate
GA_Total_Abandonment_Rate
GA_Page_Value
GA_Entrances
GA_Entrances___Pageviews
GA_Pageviews
GA_Pages___Session
GA_Unique_Views_1
GA_Unique_Views_2
GA_Unique_Views_3
GA_Unique_Views_4
GA_Unique_Views_5
GA_Unique_Pageviews
GA_Time_on_Page
GA_Avg__Time_on_Page
GA_Exits
GA___Exit
GA_Results_Pageviews
GA_Total_Unique_Searches
GA_Results_Pageviews___Search
GA_Sessions_with_Search
GA___Sessions_with_Search
GA_Search_Depth
GA_Avg__Search_Depth
GA_Search_Refinements
GA___Search_Refinements
GA_Time_after_Search
GA_Search_Exits
GA___Search_Exits
GA_Site_Search_Goal_1_Conversion_Rate
GA_Site_Search_Goal_2_Conversion_Rate
GA_Site_Search_Goal_3_Conversion_Rate
GA_Site_Search_Goal_4_Conversion_Rate
GA_Site_Search_Goal_5_Conversion_Rate
GA_Site_Search_Goal_6_Conversion_Rate
GA_Site_Search_Goal_7_Conversion_Rate
GA_Site_Search_Goal_8_Conversion_Rate
GA_Site_Search_Goal_9_Conversion_Rate
GA_Site_Search_Goal_10_Conversion_Rate
GA_Site_Search_Goal_11_Conversion_Rate
GA_Site_Search_Goal_12_Conversion_Rate
GA_Site_Search_Goal_13_Conversion_Rate
GA_Site_Search_Goal_14_Conversion_Rate
GA_Site_Search_Goal_15_Conversion_Rate
GA_Site_Search_Goal_16_Conversion_Rate
GA_Site_Search_Goal_17_Conversion_Rate
GA_Site_Search_Goal_18_Conversion_Rate
GA_Site_Search_Goal_19_Conversion_Rate
GA_Site_Search_Goal_20_Conversion_Rate
GA_Site_Search_Goal_Conversion_Rate
GA_Per_Search_Goal_Value
GA_Page_Load_Time__ms_
GA_Page_Load_Sample
GA_Avg__Page_Load_Time__sec_
GA_Domain_Lookup_Time__ms_
GA_Avg__Domain_Lookup_Time__sec_
GA_Page_Download_Time__ms_
GA_Avg__Page_Download_Time__sec_
GA_Redirection_Time__ms_
GA_Avg__Redirection_Time__sec_
GA_Server_Connection_Time__ms_
GA_Avg__Server_Connection_Time__sec_
GA_Server_Response_Time__ms_
GA_Avg__Server_Response_Time__sec_
GA_Speed_Metrics_Sample
GA_Document_Interactive_Time__ms_
GA_Avg__Document_Interactive_Time__sec_
GA_Document_Content_Loaded_Time__ms_
GA_Avg__Document_Content_Loaded_Time__sec_
GA_DOM_Latency_Metrics_Sample
GA_Screen_Views
GA_Unique_Screen_Views
GA_Screens___Session
GA_Time_on_Screen
GA_Avg__Time_on_Screen
GA_Total_Events
GA_Unique_Dimension_Combinations
GA_Unique_Events
GA_Event_Value
GA_Avg__Value
GA_Sessions_with_Event
GA_Events___Session_with_Event
GA_Transactions
GA_Ecommerce_Conversion_Rate
GA_Revenue
GA_Avg__Order_Value
GA_Per_Session_Value
GA_Shipping
GA_Tax
GA_Total_Value
GA_Quantity
GA_Unique_Purchases
GA_Avg__Price
GA_Product_Revenue
GA_Avg__QTY
GA_Local_Revenue
GA_Local_Shipping
GA_Local_Tax
GA_Local_Product_Revenue
GA_Social_Actions
GA_Unique_Social_Actions
GA_Actions_Per_Social_Session
GA_User_Timing__ms_
GA_User_Timing_Sample
GA_Avg__User_Timing__sec_
GA_Exceptions
GA_Exceptions___Screen
GA_Crashes
GA_Crashes___Screen
GA_Custom_Metric_1_Value
GA_Custom_Metric_2_Value
GA_Custom_Metric_3_Value
GA_Custom_Metric_4_Value
GA_Custom_Metric_5_Value
GA_Custom_Metric_6_Value
GA_Custom_Metric_7_Value
GA_Custom_Metric_8_Value
GA_Custom_Metric_9Value
GA_Custom_Metric_10_Value
GA_Custom_Metric_11_Value
GA_Custom_Metric_12_Value
GA_Custom_Metric_13_Value
GA_Custom_Metric_14_Value
GA_Custom_Metric_15_Value
GA_Custom_Metric_16_Value
GA_Custom_Metric_17_Value
GA_Custom_Metric_18_Value
GA_Custom_Metric_19_Value
GA_Custom_Metric_20_Value
GA_CM_Conversions
GA_CM_Revenue
GA_AdSense_Revenue
GA_AdSense_Ad_Units_Viewed
GA_AdSense_Impressions
GA_AdSense_Ads_Clicked
GA_AdSense_Page_Impressions
GA_AdSense_CTR
GA_AdSense_eCPM
GA_AdSense_Exits
GA_AdSense_Viewable_Impression__
GA_AdSense_Coverage
GA_Publisher_Impressions
GA_Publisher_Coverage
GA_Publisher_Monetized_Pageviews
GA_Publisher_Impressions___Session
GA_Publisher_Viewable_Impressions__
GA_Publisher_Clicks
GA_Publisher_CTR
GA_Publisher_Revenue
GA_Publisher_Revenue___1000_Sessions
GA_Publisher_eCPM
GA_AdX_Impressions
GA_AdX_Coverage
GA_AdX_Monetized_Pageviews
GA_AdX_Impressions___Session
GA_AdX_Viewable_Impressions__
GA_AdX_Clicks
GA_AdX_CTR
GA_AdX_Revenue
GA_AdX_Revenue___1000_Sessions
GA_AdX_eCPM
GA_GAM_Impressions
GA_GAM_Coverage
GA_GAM_Monetized_Pageviews
GA_GAM_Impressions___Session
GA_GAM_Viewable_Impressions__
GA_GAM_Clicks
GA_GAM_CTR
GA_GAM_Revenue
GA_GAM_Revenue___1000_Sessions
GA_GAM_eCPM
GA_GAM_Backfill_Impressions
GA_GAM_Backfill_Coverage
GA_GAM_Backfill_Monetized_Pageviews
GA_GAM_Backfill_Impressions___Session
GA_GAM_Backfill_Viewable_Impressions__
GA_GAM_Backfill_Clicks
GA_GAM_Backfill_CTR
GA_GAM_Backfill_Revenue
GA_GAM_Backfill_Revenue___1000_Sessions
GA_GAM_Backfill_eCPM
GA_Buy-to-Detail_Rate
GA_Cart-to-Detail_Rate
GA_Appviews_per_User
GA_Appviews_Per_User__LTV_
GA_Goal_Completions_per_User
GA_Goal_Completions_Per_User__LTV_
GA_Pageviews_per_User
GA_Pageviews_Per_User__LTV_
GA_User_Retention
GA_Revenue_per_User
GA_Revenue_Per_User__LTV_
GA_Session_Duration_per_User
GA_Session_Duration_Per_User__LTV_
GA_Sessions_per_User
GA_Sessions_Per_User__LTV_
GA_Total_Users
GA_DV360_eCPA
GA_DV360_eCPC
GA_DV360_eCPM
GA_DV360_CTR
GA_DV360_Clicks
GA_DV360_Conversions
GA_DV360_Cost
GA_DV360_Impressions
GA_DV360_ROAS
GA_CM_CPC
GA_CM_CTR
GA_CM_Clicks
GA_CM_Cost
GA_CM_Impressions
GA_CM_Margin
GA_CM_ROAS
GA_CM_RPC
GA_SA360_CPC
GA_SA360_CTR
GA_SA360_Clicks
GA_SA360_Cost
GA_SA360_Impressions
GA_SA360_Profit
GA_SA360_ROAS
GA_SA360_RPC
GA_Hits
GA_Internal_Promotion_CTR
GA_Internal_Promotion_Clicks
GA_Internal_Promotion_Views
GA_Local_Product_Refund_Amount
GA_Local_Refund_Amount
GA_Product_Adds_To_Cart
GA_Product_Checkouts
GA_Product_Detail_Views
GA_Product_List_CTR
GA_Product_List_Clicks
GA_Product_List_Views
GA_Product_Refund_Amount
GA_Product_Refunds
GA_Product_Removes_From_Cart
GA_Product_Revenue_per_Purchase
GA_Quantity_Added_To_Cart
GA_Quantity_Checked_Out
GA_Quantity_Refunded
GA_Quantity_Removed_From_Cart
GA_Refund_Amount
GA_Number_of_Sessions_per_User
GA_Refunds
GA_Transactions_per_User
event_date