Azure Table Storage
Guide to integrate your Azure Table with Sprinkle
Last updated
Guide to integrate your Azure Table with Sprinkle
Last updated
Before setting up the datasource, learn about datasource concepts
To learn about Connection, refer
Log into Sprinkle application
Navigate to Datasources -> Connections Tab -> New Connection ->
Select Azure Table Storage
Provide all the mandatory details
Name: Name to identify this connection
Connection String : Provide the in the format:
DefaultEndpointsProtocol=https;AccountName=XXXXXX;AccountKey=XXXXXXXXXXXXXXXXX;EndpointSuffix=core.windows.net
Table Type: Select the Table API Type
Azure Table
Azure Cosmos Table
Test Connection
Create
Navigate to Datasources -> Datasources Tab -> Add ->
Select Azure Table Storage
Provide the name -> Create
Connection Tab:
From the drop-down, select the name of connection created in STEP-2
Update
Azure Table (Required): To choose from dropdown.
Ingestion Mode: (Required)
Complete: Ingest full data from the source table in every ingestion job run. Choose this option if your table size is small (<1 million rows) and you want to ingest it infrequently (few times a day)
Incremental: Ingest only the changed or inserted rows in every ingestion job run. Choose this option if your table size is large and you want to ingest in realtime mode.
Date Type: Ingestion runs from this start date/days. If Incremental, then only first run pulls from this date, further runs only pulls changes/new rows.
Start Date: Provide in the Format:YYYY-MM-DD
No of days
Destination Schema (Required) : Data warehouse schema where the table will be ingested into
Destination Table name (Required) : It is the table name to be created on the warehouse. If not given, sprinkle will create like ds_<datasourcename>_<tablename>
Create
In the Ingestion Jobs tab:
Trigger the Job, using Run button
To schedule, enable Auto-Run. Change the frequency if needed
To learn about datasource, refer
Datasets Tab: To learn about Dataset, refer . Add Dataset for each table that you want to replicate, providing following details
To Know more about Ingestion Modes, refer
Destination Create Table Clause: Provide additional clauses to warehouse-create table queries such as clustering, partitioning, and more, useful for optimizing DML statements. on how to use this field.