Sources

  • Sources Overview

    A Source represents a single schema of data. Sources are the logical grouping for Inputs, Relations, and Rules...

  • Source Settings

    The Settings tab for a Source allows a user to specify key information about the Source including input types ...

  • Raw Schema

    The Raw Schema tab for Sources allows users to view the raw database attributes as well as raw metadata. Viewi...

  • Dependencies

    Dependencies allow configurators to modify the workflow engine to introduce waits to the processing queuesIntr...

  • Relations

    Relations define intra-source connections and enable users to configure lookups and cross-source aggregates.Cr...

  • Rules

    Rules allow DataForge to modify and transform data.Rules TabThe Rules tab allows users to select, edit, remove...

  • Complex Data Types

    DataForge supports the use of complex data types such as array and struct, common in semi-structured datasets ...

  • Sub-Sources

    OverviewThe sub-source feature in DataForge enables developers to easily work with and transform complex neste...

  • Inputs

    The Source Inputs screen shows the status of an individual Source's processing and allows users to restart pro...

  • Process

    The Process page provides an operational dashboard of the processes completed or currently active for this sou...

  • Viewing Source Data

    Every source has a hub table behind the scenes that represents all of the input data brought into the source. ...

  • Custom Refresh

    Overview and BenefitsDataForge provides users the flexibility to define a Custom Refresh process that determin...

  • Unmanaged External Source

    DataForge allows users to connect to external tables that are set up elsewhere in your data platform (Databric...

  • SQL Server Streaming

    DataForge supports CDC-based streaming ingestion for SQL Server tables, allowing row-level changes to land in ...