Skip to content

Lineage Explorer

Lineage Explorer provides a visual representation of data relationships and dependencies across Sprinkle. It enables users to trace how data flows between tables and entities, identify upstream data sources, explore downstream dependencies, and understand the impact of changes across connected data components.

With interactive lineage visualization, flexible viewing modes, and configurable highlighting options, users can explore complex data relationships through a single interface.

Lineage Explorer allows users to search for a table or entity and visualize its associated data lineage as an interconnected graph.

The visualization represents data relationships through nodes and connections:

  • Nodes: Represent tables or entities within the data ecosystem. If an enitity is sheduled the frequency is also shown in the node
  • Connections: Represent the relationships and dependencies between nodes.
  • Selected Node: Represents the table or entity being explored.

Users can navigate through the graph to understand how data originates, how it moves between connected components, and which downstream components depend on a particular data element.

Lineage Explorer is available from the left navigation panel in Sprinkle.

To access and explore data lineage:

  1. Navigate to Lineage Explorer from the left navigation panel.
  2. Select the object type you want to explore: Entity or Table.
  3. Select the required entity or table from the dropdown.
  4. Alternatively, enter the object name in the search field to filter the available options.
  5. Click the Refer/Open icon to open the selected objectโ€™s lineage.

The corresponding lineage graph is displayed on the canvas.

Lineage Explorer provides two viewing modes to control the level of detail displayed in the graph.

Collapsed View displays the immediate lineage connections of the selected node, including its direct parent and child nodes.

Users can progressively expand individual nodes to explore additional levels of dependencies.

How it works:

  1. Select a table or entity to load its lineage graph.
  2. Switch to Collapsed View.
  3. Review the immediate upstream and downstream connections.
  4. Click the relevant parent or child nodes to expand their associated connections.
  5. Continue expanding nodes to explore additional levels of the lineage graph.

Use this view when:

  • Investigating a specific table or entity.
  • Exploring dependencies progressively.
  • Working with large lineage graphs where displaying every connection simultaneously may reduce readability.

Expanded View displays the complete available lineage graph associated with the selected node, including its connected upstream and downstream dependencies.

It provides a comprehensive view of the data relationships surrounding the selected object.

How it works:

  1. Select a table or entity.
  2. Switch to Expanded View.
  3. Review the complete connected lineage graph displayed on the canvas.
  4. Use the available highlight modes and canvas controls to navigate the visualization.

Use this view when:

  • Understanding end-to-end data flow.
  • Analyzing complex data relationships.
  • Performing dependency and impact analysis.

Highlight Modes allow users to focus on specific relationships within the lineage graph. Users can select a highlighting option based on the direction and depth of lineage they want to investigate.

The following modes are available:

Highlights the complete direct path of data flow associated with the selected node, including both upstream and downstream connections.

This mode provides visibility into the data relationships surrounding the selected object in both directions.

Highlights the upstream lineage of the selected node.

Upstream nodes represent the source tables, datasets, or entities that contribute data to the selected object.

Use this mode to:

  • Identify the origin of data.
  • Trace dependencies towards source components.
  • Investigate issues related to upstream data sources.

Highlights the downstream lineage of the selected node.

Downstream nodes represent the tables, datasets, reports, or entities that consume or depend on the selected object.

Use this mode to:

  • Identify components that depend on a particular table or entity.
  • Understand the potential impact of changes.
  • Trace how data is consumed across connected components.

Highlights only the immediate parent and child nodes directly connected to the selected object.

It excludes additional levels of upstream and downstream dependencies.

Use this mode to:

  • Identify direct dependencies.
  • Understand immediate data relationships.
  • Focus on first-level connections without displaying the complete lineage path.

Highlights the entire lineage graph (DAG) associated with the selected node, including all available upstream and downstream relationships.

This mode provides a comprehensive view of the connected dependency structure.

Use this mode to:

  • Examine the complete lineage structure.
  • Understand relationships across multiple dependency levels.
  • Perform comprehensive data dependency analysis.

The lineage canvas provides controls to help users navigate, reposition, and customize the graph visualization.

Control Description
Fit graph Re-centers the canvas and brings the whole lineage graph back into view.
Zoom in Increases the magnification of the graph to inspect nodes and connections more closely.
Zoom out Decreases the magnification to display a broader view of the lineage graph.
Download graph as PDF Saves the current lineage visualization as a PDF, for documentation, sharing, or further analysis.
Reset layout Discards any manual repositioning and lays the graph out again from scratch.
Show horizontal graph Arranges the lineage graph in a horizontal layout.
Show vertical graph Arranges the lineage graph in a vertical layout.

Lineage Explorer supports data discovery, dependency analysis, and troubleshooting through the following scenarios.

Explore the relationships between tables and entities to understand how different data components are connected within Sprinkle.

Before modifying a table or entity, use Downstream highlighting to identify dependent components and evaluate the potential impact of the change.

Use Upstream highlighting to trace a data element back to its contributing sources and understand where the data originates.

Explore upstream and downstream relationships to identify connected components that may be involved in a data issue and narrow down potential sources of the problem.

Use Expanded View and All highlighting to examine the complete available lineage graph and understand the relationships between connected data components.

1. Where can I access Lineage Explorer?

Lineage Explorer is available as a dedicated module in the left navigation panel of Sprinkle.

2. What is the difference between Collapsed View and Expanded View?

Collapsed View displays only the immediate parent and child connections of the selected node, allowing users to expand additional levels as needed. Expanded View displays the complete available lineage graph associated with the selected node.

3. What is the difference between Upstream and Downstream lineage?

Upstream lineage identifies the source components that contribute data to the selected node. Downstream lineage identifies the components that consume or depend on the selected node.

4. When should I use Direct highlighting?

Use Direct highlighting when you want to inspect only the immediate parent and child connections of a selected table or entity without exploring additional dependency levels.

5. What does the All highlighting mode display?

All highlighting displays the entire available lineage graph (DAG), including upstream and downstream relationships across multiple levels.

6. Can I download the lineage graph?

Yes. Use the Download graph as PDF control on the lineage canvas to save the visualization as a PDF, for documentation, sharing, or further analysis.

  • Tables: Explore the underlying data structures and their relationships.
  • Entities: Discover and navigate connected data entities.
  • Reports and Dashboards: Understand downstream dependencies and data consumption relationships.