File Uploads

You can ingest CSV or Excel files into Sprinkle. Sprinkle will create a table in the warehouse for the uploaded file.

File Uploads

The File Uploads feature allows you to upload files and ingest their data into a warehouse table. You can configure how the file is processed, validate headers, skip rows, and exclude specific columns before starting the upload.

Upload a File

1. Navigate to Ingest → File Uploads.

2. In the top-right corner, click Add File.

3. Enter a Name for the file upload.

4. Enter the Destination Name. This is the warehouse table name that will be created or updated and can be used to refer to the table.

5. Destination Table Schema - Select the schema in which you want to create the table.

6. Upload your file.

Once the file is uploaded, a file preview will be displayed.

Configure File Upload

The configuration options are available in the left panel of the file preview.

Mode

Select how the uploaded file should be loaded into the warehouse table.

• Append: Adds the new records to the existing warehouse table.
• Overwrite: Replaces the existing data in the warehouse table with the uploaded file data.

Strict Header Validation

Enable Strict Header Validation to ensure that re-uploaded files have exactly the same headers as the original file.

When enabled, the upload will validate the file headers before processing the data.

Skip Before Header

Specify the number of rows to skip from the beginning of the CSV file.

The next available row after the skipped rows is used to extract the column names.

Example: If you set Skip Before Header to 2, the first two rows are skipped and the third row is used as the header.

Exclude Column

Use Exclude Column to select columns that should not be included when reading the CSV file.

Excluded columns will not be ingested into the destination warehouse table.

Edit Column Datatype

Just below the column name you can see the column Datatype, click on it and select from required datatype from the dropdown.

Edit Column Headers

You can modify a column header before uploading the data.

Click the pencil icon next to the column name to edit the header.

Note: Make sure the column names are correctly defined before proceeding with the upload, especially when Strict Header Validation is enabled.

Ingest the File

Once you have configured the file and verified the preview, click Proceed.

The file will be processed and the data will be ingested into the destination warehouse table.

Note: There are a few validation checks that Sprinkle does to ensure the quality of the data being ingested.

Empty Column Headers: No column header should be empty. Use Skip before headers if you want to skip a few rows at the top. In that case, the next row available is used to extract column names.

Invalid Column Headers: Remove special characters or white spaces. Make sure each column name is unique and begins with an alphabet or underscore.

To guide you through the errors and fix them, in-place error markings are shown on the Preview table.

Upload History

After a file is uploaded, a dedicated File Upload History screen is displayed. This screen provides a centralized view of uploaded files and their ingestion history.

Whenever you re-upload or update a file, a new upload record is added to the history, allowing you to track previous uploads and their processing status.

The upload history table includes the following information:

Column	Description
Batch ID	Unique identifier assigned to each file upload batch.
File Name	Name of the uploaded file.
Status	Current status of the file upload and ingestion process.
Error Message	Displays the error details when the file upload or ingestion fails.
Actions	Provides actions such as Preview and Download for the uploaded file.

Note: Each re-upload is recorded as a separate entry in the upload history, allowing you to track individual upload batches and their statuses.

Actions

In the top-right corner of the File Upload History screen, you can find the following actions:

Download

Click Download to download the warehouse table created from the file upload.

Upload

Click Upload to upload an updated version of the file.

When uploading an updated file, ensure that it follows the same format as the previously uploaded file. This helps the system correctly map the file columns to the existing warehouse table.