Using Reference Data

This article helps you understand how to begin Using Reference Data in your data pipelines

Prerequisite:

• Data Studio Overview

Using Reference Data

Reference Data in Syncari allows you to store and manage lookup tables that can be used across your data pipelines. Common examples include country codes, currency codes, state abbreviations, and other standardized datasets.

Accessing Reference Data

To access Reference Data, click on the Entity dropdown at the top of Data Studio and look for the Reference Data section. You will see a list of all available reference datasets with their record counts.

Click on any reference dataset to view its data. When you select a reference dataset, it opens just like a regular entity in Data Studio. You can view all records, filter the data, sort by any column, and export the data.

File Upload

When uploading a file to create or update reference data, please note the following limitations:

• File format: Only CSV files are supported
• File size: Maximum file size is 10 MB
• Number of rows: Maximum 50,000 rows per file
• Column headers: First row must contain column headers that match your attribute names
• Character encoding: UTF-8 encoding is recommended

Updating a Dataset

To update an existing reference dataset:

1. Open the reference dataset you want to update
2. Click the three-dot menu at the top right
3. Select Update from the menu
4. The Update Dataset dialog will open

In the Update Dataset dialog:

1. The dataset name is shown at the top
2. Select Upload CSV as the Source Type
3. Click the Upload button to select your CSV file
4. Click Update to upload the file and update the dataset

The new data will replace the existing data in the reference dataset.

Deleting a Dataset

To delete a reference dataset:

1. Open the reference dataset you want to delete
2. Click the three-dot menu at the top right
3. Select Delete from the menu
4. A confirmation dialog will appear
5. Type DELETE to confirm
6. Click OK to permanently delete the dataset

Exporting Reference Data

To export reference data to a CSV file:

1. Open the reference dataset
2. Click the Export button at the top right
3. The data will be downloaded as a CSV file

The exported file will contain all records in the reference dataset.

Using Reference Data in Pipelines

Using Reference Data and the Lookup Reference Data function in Pipeline Studio, you can incorporate your Reference Data into your unified data model. See this article to learn more about the Lookup Reference Data function.

What's Next?

• Data Quality Studio Overview