The Process page provides an operational dashboard of the processes completed or currently active for this source
A process is DataForge's atomic unit of data processing. Each process corresponds to a distinct unit of work with its own set of parameters, logs, and action steps.
This tab provides a quick view into the Processing page, pre-filtered for this Source and/or a specific Input ID to assist with debugging and monitoring
Source Process Tab
The Source Process tab allows users to monitor the status of their Source processes. The Process tab provides insight into the processing of all stages for a given Source. The top of the page has a variety of filters, which allow filtering based on the input id of the process, the operation type, the status, and/or the date of the process run.
Expand the process records to view sub-process details. Review the logs for comprehensive information about the job, export the logs if necessary, and open support tickets as required.
Click the Job Run ID hyperlink to access a job run in Databricks, review job run details, or cancel a job that is either launching or currently running.
To easily see a specific Input's process records, navigate to the Inputs tab and select the Status Icon on the Input row. This opens a filtered view of the input processes and results. Each process contains a log file that can be used for troubleshooting or monitoring.
Process-specific hyperlinks can be shared with others by clicking on the Process ID and copying the URL.
Sub-Source Processes
The Process tab is not available in sub-sources. All processes are managed within the parent source where the sub-source rule is calculated.
For full documentation, visit Sub-Sources.
Updated