Overview
DataForge collects limited information to better understand customer usage and adoption as well as billing support to correctly calculate Processing Units being used.
This collection occurs through two steps:
1. Usage agent installation in your environment as part of deployment. There is service added to the ECS cluster in AWS and a new container instance added to the Resource Group in Azure, called usage-agent. This service will be used to collect information from the Postgres metastore database and send to DataForge.
2. Environment information shared with the team for each environment
Note: None of the information accessible to the usage-agent contains identifiable information.
Environment
The information below is required to be shared with support for each environment that you run that is running version 2.5.0 or greater:
- Environment name (“environment” variable value in Terraform)
- Client name (“client” variable value in Terraform)
- Postgres host name and port
- AWS: found in RDS as the “endpoint” value
- Azure: found in Key Vault in the private secret in the database-connection key/vault
- Usage username (only if specified in Terraform, if not then it will be a default value of “usageuser”)
- Usage password
- AWS: found in the private secret in Secrets Manager in the “usage-password” key/value
- Azure: found in Key Vault in the private secret in the usage-password key/vault
Data Collection
Through the usage agent and environment information has access to the views and fields from your environment located in the table. We have also annotated which views and fields we are pulling along with schedules.
You will find these views and fields by viewing the usage schema in Postgres.
The data that we are collecting falls into a few different data types: object IDs or codes, datetimes, configuration parameter selections, boolean flags, and processing statuses. This allows us to pull the information we need without any identifiable information to your environment.
| View | Field | Included in Usage Pulls | Schedule |
| usage.agent | agent_code | Yes | Daily |
| usage.agent | default_flag | Yes | Daily |
| usage.agent | active_flag | Yes | Daily |
| usage.agent | create_datetime | Yes | Daily |
| usage.agent | update_datetime | Yes | Daily |
| usage.agent_history | agent_code | - | - |
| usage.agent_history | default_flag | - | - |
| usage.agent_history | active_flag | - | - |
| usage.agent_history | create_datetime | - | - |
| usage.agent_history | update_datetime | - | - |
| usage.agent_history | insert_datetime | - | - |
| usage.cluster_configuration | cluster_configuration_id | - | - |
| usage.cluster_configuration | scale | - | - |
| usage.cluster_configuration | task_type | - | - |
| usage.cluster_configuration | cluster_type | - | - |
| usage.cluster_configuration | job_id | - | - |
| usage.cluster_configuration | scale_parameters | - | - |
| usage.cluster_configuration | cluster_parameters->>'spark_version' spark_version | - | - |
| usage.cluster_configuration | cluster_parameters->>'node_type_id' node_type_id | - | - |
| usage.cluster_configuration | ido_parameters | - | - |
| usage.cluster_configuration | default_flag | - | - |
| usage.cluster_configuration | create_datetime | - | - |
| usage.cluster_configuration | update_datetime | - | - |
| usage.cluster_configuration_history | cluster_configuration_id | - | - |
| usage.cluster_configuration_history | scale | - | - |
| usage.cluster_configuration_history | task_type | - | - |
| usage.cluster_configuration_history | cluster_type | - | - |
| usage.cluster_configuration_history | job_id | - | - |
| usage.cluster_configuration_history | scale_parameters | - | - |
| usage.cluster_configuration_history | cluster_parameters->>'spark_version' spark_version | - | - |
| usage.cluster_configuration_history | cluster_parameters->>'node_type_id' node_type_id | - | - |
| usage.cluster_configuration_history | ido_parameters | - | - |
| usage.cluster_configuration_history | default_flag | - | - |
| usage.cluster_configuration_history | create_datetime | - | - |
| usage.cluster_configuration_history | update_datetime | - | - |
| usage.cluster_configuration_history | insert_datetime | - | - |
| usage.connection | connection_id | Yes | Daily |
| usage.connection | connection_type | Yes | Daily |
| usage.connection | connection_sub_type | Yes | Daily |
| usage.connection | connection_direction | Yes | Daily |
| usage.connection | active_flag | Yes | Daily |
| usage.connection | agent_code | Yes | Daily |
| usage.connection | cloud_credentials | Yes | Daily |
| usage.connection | create_datetime | Yes | Daily |
| usage.connection | update_datetime | Yes | Daily |
| usage.data_profile | data_profile_id | - | - |
| usage.data_profile | source_id | - | - |
| usage.data_profile | input_id | - | - |
| usage.data_profile | process_id | - | - |
| usage.data_profile | scope | - | - |
| usage.data_profile | record_counts | - | - |
| usage.data_profile | create_datetime | - | - |
| usage.enrichment | enrichment_id | Yes | Daily |
| usage.enrichment | parent_enrichment_id | Yes | Daily |
| usage.enrichment | source_id | Yes | Daily |
| usage.enrichment | priority | Yes | Daily |
| usage.enrichment | datatype | Yes | Daily |
| usage.enrichment | cast_datatype | Yes | Daily |
| usage.enrichment | length(expression) expression_length | Yes | Daily |
| usage.enrichment | rule_type_code | Yes | Daily |
| usage.enrichment | validation_action_code | Yes | Daily |
| usage.enrichment | validation_type_code | Yes | Daily |
| usage.enrichment | keep_current_flag | Yes | Daily |
| usage.enrichment | window_function_flag | Yes | Daily |
| usage.enrichment | unique_flag | Yes | Daily |
| usage.enrichment | active_flag | Yes | Daily |
| usage.enrichment | rule_template_id | Yes | Daily |
| usage.enrichment | create_datetime | Yes | Daily |
| usage.enrichment | update_datetime | Yes | Daily |
| usage.enrichment_history | enrichment_id | - | - |
| usage.enrichment_history | parent_enrichment_id | - | - |
| usage.enrichment_history | source_id | - | - |
| usage.enrichment_history | priority | - | - |
| usage.enrichment_history | datatype | - | - |
| usage.enrichment_history | cast_datatype | - | - |
| usage.enrichment_history | length(expression) expression_length | - | - |
| usage.enrichment_history | rule_type_code | - | - |
| usage.enrichment_history | validation_action_code | - | - |
| usage.enrichment_history | validation_type_code | - | - |
| usage.enrichment_history | keep_current_flag | - | - |
| usage.enrichment_history | window_function_flag | - | - |
| usage.enrichment_history | unique_flag | - | - |
| usage.enrichment_history | active_flag | - | - |
| usage.enrichment_history | rule_template_id | - | - |
| usage.enrichment_history | create_datetime | - | - |
| usage.enrichment_history | update_datetime | - | - |
| usage.enrichment_history | insert_datetime | - | - |
| usage.enrichment_aggregation | enrichment_aggregation_id | Yes | Daily |
| usage.enrichment_aggregation | enrichment_id | Yes | Daily |
| usage.enrichment_aggregation | expression | Yes | Daily |
| usage.enrichment_aggregation | function | Yes | Daily |
| usage.enrichment_aggregation | relation_ids | Yes | Daily |
| usage.enrichment_aggregation | create_datetime | Yes | Daily |
| usage.enrichment_aggregation_history | enrichment_aggregation_id | - | - |
| usage.enrichment_aggregation_history | enrichment_id | - | - |
| usage.enrichment_aggregation_history | expression | - | - |
| usage.enrichment_aggregation_history | function | - | - |
| usage.enrichment_aggregation_history | relation_ids | - | - |
| usage.enrichment_aggregation_history | create_datetime | - | - |
| usage.enrichment_aggregation_history | insert_datetime | - | - |
| usage.enrichment_parameter | enrichment_parameter_id | - | - |
| usage.enrichment_parameter | aggregation_id | - | - |
| usage.enrichment_parameter | parent_enrichment_id | - | - |
| usage.enrichment_parameter | type | - | - |
| usage.enrichment_parameter | enrichment_id | - | - |
| usage.enrichment_parameter | raw_attribute_id | - | - |
| usage.enrichment_parameter | system_attribute_id | - | - |
| usage.enrichment_parameter | source_id | - | - |
| usage.enrichment_parameter | source_relation_ids | - | - |
| usage.enrichment_parameter | self_relation_container | - | - |
| usage.enrichment_parameter | create_datetime | - | - |
| usage.enrichment_parameter_history | enrichment_parameter_id | - | - |
| usage.enrichment_parameter_history | aggregation_id | - | - |
| usage.enrichment_parameter_history | parent_enrichment_id | - | - |
| usage.enrichment_parameter_history | type | - | - |
| usage.enrichment_parameter_history | enrichment_id | - | - |
| usage.enrichment_parameter_history | raw_attribute_id | - | - |
| usage.enrichment_parameter_history | system_attribute_id | - | - |
| usage.enrichment_parameter_history | source_id | - | - |
| usage.enrichment_parameter_history | source_relation_ids | - | - |
| usage.enrichment_parameter_history | self_relation_container | - | - |
| usage.enrichment_parameter_history | create_datetime | - | - |
| usage.enrichment_parameter_history | insert_datetime | - | - |
| usage.group | group_id | - | - |
| usage.group | create_datetime | - | - |
| usage.group | update_datetime | - | - |
| usage.group_history | group_id | - | - |
| usage.group_history | create_datetime | - | - |
| usage.group_history | update_datetime | - | - |
| usage.group_history | insert_datetime | - | - |
| usage.import_history | import_id | - | - |
| usage.import_history | type | - | - |
| usage.import_history | status | - | - |
| usage.import_history | update_datetime | - | - |
| usage.input | input_id | Yes | Hourly |
| usage.input | source_id | Yes | Hourly |
| usage.input | schedule_run_id | Yes | Hourly |
| usage.input | ingestion_status_code | Yes | Hourly |
| usage.input | extract_datetime | Yes | Hourly |
| usage.input | file_size | Yes | Hourly |
| usage.input | record_count | Yes | Hourly |
| usage.input | effective_record_count | Yes | Hourly |
| usage.input | status_code | Yes | Hourly |
| usage.input | last_completed_process_type | Yes | Hourly |
| usage.input | current_process_type | Yes | Hourly |
| usage.input | last_suceeded_process_type | Yes | Hourly |
| usage.input | create_datetime | Yes | Hourly |
| usage.input_history | input_id | - | - |
| usage.input_history | source_id | - | - |
| usage.input_history | schedule_run_id | - | - |
| usage.input_history | ingestion_status_code | - | - |
| usage.input_history | extract_datetime | - | - |
| usage.input_history | file_size | - | - |
| usage.input_history | record_count | - | - |
| usage.input_history | effective_record_count | - | - |
| usage.input_history | status_code | - | - |
| usage.input_history | last_completed_process_type | - | - |
| usage.input_history | current_process_type | - | - |
| usage.input_history | last_suceeded_process_type | - | - |
| usage.input_history | create_datetime | - | - |
| usage.input_history | insert_datetime | - | - |
| usage.job_run | job_run_id | - | - |
| usage.job_run | run_id | - | - |
| usage.job_run | cluster_configuration_id | - | - |
| usage.job_run | job_id | - | - |
| usage.job_run | state | - | - |
| usage.job_run | launch_timestamp | - | - |
| usage.job_run | start_timestamp | - | - |
| usage.job_run | last_heartbeat_datetime | - | - |
| usage.job_run | last_process_complete_datetime | - | - |
| usage.job_run | last_dbr_update_datetime | - | - |
| usage.job_run | current_process_id | - | - |
| usage.job_run | current_source_id | - | - |
| usage.job_run | stop_reason | - | - |
| usage.job_run_history | job_run_id | - | - |
| usage.job_run_history | run_id | - | - |
| usage.job_run_history | cluster_configuration_id | - | - |
| usage.job_run_history | job_id | - | - |
| usage.job_run_history | state | - | - |
| usage.job_run_history | launch_timestamp | - | - |
| usage.job_run_history | start_timestamp | - | - |
| usage.job_run_history | last_heartbeat_datetime | - | - |
| usage.job_run_history | last_process_complete_datetime | - | - |
| usage.job_run_history | last_dbr_update_datetime | - | - |
| usage.job_run_history | current_process_id | - | - |
| usage.job_run_history | current_source_id | - | - |
| usage.job_run_history | stop_reason | - | - |
| usage.job_run_history | insert_datetime | - | - |
| usage.output | output_id | Yes | Daily |
| usage.output | output_type | Yes | Daily |
| usage.output | active_flag | Yes | Daily |
| usage.output | output_sub_type | Yes | Daily |
| usage.output | connection_id | Yes | Daily |
| usage.output | output_success_topics | Yes | Daily |
| usage.output | output_failure_topics | Yes | Daily |
| usage.output | post_output_type | Yes | Daily |
| usage.output | custom_post_output_cluster_configuration_id | Yes | Daily |
| usage.output | create_datetime | Yes | Daily |
| usage.output | update_datetime | Yes | Daily |
| usage.output_history | output_id | - | - |
| usage.output_history | output_type | - | - |
| usage.output_history | active_flag | - | - |
| usage.output_history | output_sub_type | - | - |
| usage.output_history | connection_id | - | - |
| usage.output_history | output_success_topics | - | - |
| usage.output_history | output_failure_topics | - | - |
| usage.output_history | post_output_type | - | - |
| usage.output_history | custom_post_output_cluster_configuration_id | - | - |
| usage.output_history | create_datetime | - | - |
| usage.output_history | update_datetime | - | - |
| usage.output_history | insert_datetime | - | - |
| usage.output_column | output_column_id | Yes | Daily |
| usage.output_column | output_id | Yes | Daily |
| usage.output_column | position | Yes | Daily |
| usage.output_column | datatype | Yes | Daily |
| usage.output_column | precision | Yes | Daily |
| usage.output_column | scale | Yes | Daily |
| usage.output_column | max_length | Yes | Daily |
| usage.output_column | partition_ordinal | Yes | Daily |
| usage.output_column | zorder_ordinal | Yes | Daily |
| usage.output_column | create_datetime | Yes | Daily |
| usage.output_column | update_datetime | Yes | Daily |
| usage.output_column_history | output_column_id | - | - |
| usage.output_column_history | output_id | - | - |
| usage.output_column_history | position | - | - |
| usage.output_column_history | datatype | - | - |
| usage.output_column_history | precision | - | - |
| usage.output_column_history | scale | - | - |
| usage.output_column_history | max_length | - | - |
| usage.output_column_history | partition_ordinal | - | - |
| usage.output_column_history | zorder_ordinal | - | - |
| usage.output_column_history | create_datetime | - | - |
| usage.output_column_history | update_datetime | - | - |
| usage.output_column_history | insert_timestamp | - | - |
| usage.output_source | output_source_id | Yes | Daily |
| usage.output_source | source_id | Yes | Daily |
| usage.output_source | output_id | Yes | Daily |
| usage.output_source | length(filter) filter_length | Yes | Daily |
| usage.output_source | operation_type | Yes | Daily |
| usage.output_source | array_length(unpivot_list,1) unpivot_list_length | Yes | Daily |
| usage.output_source | union_output_position | Yes | Daily |
| usage.output_source | active_flag | Yes | Daily |
| usage.output_source | create_datetime | Yes | Daily |
| usage.output_source | update_datetime | Yes | Daily |
| usage.output_source | length(output_package_parameters->>'custom_parameters') custom_parameters_length | Yes | Daily |
| usage.output_source | include_pass_flag | Yes | Daily |
| usage.output_source | include_fail_flag | Yes | Daily |
| usage.output_source_column | output_source_column_id | Yes | Daily |
| usage.output_source_column | output_source_id | Yes | Daily |
| usage.output_source_column | output_column_id | Yes | Daily |
| usage.output_source_column | datatype | Yes | Daily |
| usage.output_source_column | precision | Yes | Daily |
| usage.output_source_column | scale | Yes | Daily |
| usage.output_source_column | type | Yes | Daily |
| usage.output_source_column | enrichment_id | Yes | Daily |
| usage.output_source_column | raw_attribute_id | Yes | Daily |
| usage.output_source_column | system_attribute_id | Yes | Daily |
| usage.output_source_column | source_relation_ids | Yes | Daily |
| usage.output_source_column | create_datetime | Yes | Daily |
| usage.output_source_column | update_datetime | Yes | Daily |
| usage.output_source_column | aggregate | Yes | Daily |
| usage.output_source_column | aggregate_distinct_flag | Yes | Daily |
| usage.output_source_column_history | output_source_column_id | - | - |
| usage.output_source_column_history | output_source_id | - | - |
| usage.output_source_column_history | output_column_id | - | - |
| usage.output_source_column_history | datatype | - | - |
| usage.output_source_column_history | precision | - | - |
| usage.output_source_column_history | scale | - | - |
| usage.output_source_column_history | type | - | - |
| usage.output_source_column_history | enrichment_id | - | - |
| usage.output_source_column_history | raw_attribute_id | - | - |
| usage.output_source_column_history | system_attribute_id | - | - |
| usage.output_source_column_history | source_relation_ids | - | - |
| usage.output_source_column_history | create_datetime | - | - |
| usage.output_source_column_history | update_datetime | - | - |
| usage.output_source_column_history | aggregate | - | - |
| usage.output_source_column_history | aggregate_distinct_flag | - | - |
| usage.output_source_column_history | insert_datetime | - | - |
| usage.process_history | process_id | Yes | Hourly |
| usage.process_history | source_id | Yes | Hourly |
| usage.process_history | output_id | Yes | Hourly |
| usage.process_history | output_source_id | Yes | Hourly |
| usage.process_history | scope | Yes | Hourly |
| usage.process_history | input_id | Yes | Hourly |
| usage.process_history | queue_datetime | Yes | Hourly |
| usage.process_history | scheduled_datetime | Yes | Hourly |
| usage.process_history | start_datetime | Yes | Hourly |
| usage.process_history | end_datetime | Yes | Hourly |
| usage.process_history | priority | Yes | Hourly |
| usage.process_history | operation_type | Yes | Hourly |
| usage.process_history | status_code | Yes | Hourly |
| usage.process_history | log_id | Yes | Hourly |
| usage.process_history | workflow_queue_id | Yes | Hourly |
| usage.process_history | previous_process_id | Yes | Hourly |
| usage.process_history | head_process_id | Yes | Hourly |
| usage.process_history | record_counts | Yes | Hourly |
| usage.process_history | cluster_configuration_id | Yes | Hourly |
| usage.process_history | job_run_id | Yes | Hourly |
| usage.process_history | insert_datetime | Yes | Hourly |
| usage.process_cluster_override | process_configuration_id | - | - |
| usage.process_cluster_override | cluster_configuration_id | - | - |
| usage.process_cluster_override | process_name | - | - |
| usage.process_configuration | process_configuration_id | - | - |
| usage.process_configuration | cluster_configuration_id | - | - |
| usage.process_configuration | default_flag | - | - |
| usage.process_configuration | create_datetime | - | - |
| usage.process_configuration | update_datetime | - | - |
| usage.process_configuration_history | process_configuration_id | - | - |
| usage.process_configuration_history | cluster_configuration_id | - | - |
| usage.process_configuration_history | default_flag | - | - |
| usage.process_configuration_history | create_datetime | - | - |
| usage.process_configuration_history | update_datetime | - | - |
| usage.process_configuration_history | insert_datetime | - | - |
| usage.raw_attribute | raw_attribute_id | - | - |
| usage.raw_attribute | source_id | - | - |
| usage.raw_attribute | last_input_id | - | - |
| usage.raw_attribute | data_type | - | - |
| usage.raw_attribute | version_number | - | - |
| usage.raw_attribute | unique_flag | - | - |
| usage.raw_attribute | update_datetime | - | - |
| usage.raw_attribute_history | raw_attribute_id | - | - |
| usage.raw_attribute_history | source_id | - | - |
| usage.raw_attribute_history | last_input_id | - | - |
| usage.raw_attribute_history | data_type | - | - |
| usage.raw_attribute_history | version_number | - | - |
| usage.raw_attribute_history | unique_flag | - | - |
| usage.raw_attribute_history | update_datetime | - | - |
| usage.raw_attribute_history | insert_datetime | - | - |
| usage.relation_template | relation_template_id | - | - |
| usage.relation_template | length(expression) expression_length | - | - |
| usage.relation_template | related_source_id | - | - |
| usage.relation_template | related_source_template_id | - | - |
| usage.relation_template | primary_flag | - | - |
| usage.relation_template | source_cardinality | - | - |
| usage.relation_template | related_source_cardinality | - | - |
| usage.relation_template | tokens | - | - |
| usage.relation_template | active_flag | - | - |
| usage.relation_template | create_datetime | - | - |
| usage.relation_template | update_datetime | - | - |
| usage.relation_template_history | relation_template_id | - | - |
| usage.relation_template_history | length(expression) expression_length | - | - |
| usage.relation_template_history | related_source_id | - | - |
| usage.relation_template_history | related_source_template_id | - | - |
| usage.relation_template_history | primary_flag | - | - |
| usage.relation_template_history | source_cardinality | - | - |
| usage.relation_template_history | related_source_cardinality | - | - |
| usage.relation_template_history | tokens | - | - |
| usage.relation_template_history | active_flag | - | - |
| usage.relation_template_history | create_datetime | - | - |
| usage.relation_template_history | update_datetime | - | - |
| usage.relation_template_history | insert_datetime | - | - |
| usage.rule_template | rule_template_id | - | - |
| usage.rule_template | parent_rule_template_id | - | - |
| usage.rule_template | tokens | - | - |
| usage.rule_template | datatype | - | - |
| usage.rule_template | cast_datatype | - | - |
| usage.rule_template | length(expression) expression_length | - | - |
| usage.rule_template | rule_type_code | - | - |
| usage.rule_template | validation_action_code | - | - |
| usage.rule_template | validation_type_code | - | - |
| usage.rule_template | keep_current_flag | - | - |
| usage.rule_template | window_function_flag | - | - |
| usage.rule_template | unique_flag | - | - |
| usage.rule_template | active_flag | - | - |
| usage.rule_template | create_datetime | - | - |
| usage.rule_template | update_datetime | - | - |
| usage.rule_template_history | rule_template_id | - | - |
| usage.rule_template_history | parent_rule_template_id | - | - |
| usage.rule_template_history | tokens | - | - |
| usage.rule_template_history | datatype | - | - |
| usage.rule_template_history | cast_datatype | - | - |
| usage.rule_template_history | length(expression) expression_length | - | - |
| usage.rule_template_history | rule_type_code | - | - |
| usage.rule_template_history | validation_action_code | - | - |
| usage.rule_template_history | validation_type_code | - | - |
| usage.rule_template_history | keep_current_flag | - | - |
| usage.rule_template_history | window_function_flag | - | - |
| usage.rule_template_history | unique_flag | - | - |
| usage.rule_template_history | active_flag | - | - |
| usage.rule_template_history | create_datetime | - | - |
| usage.rule_template_history | update_datetime | - | - |
| usage.rule_template_history | insert_datetime | - | - |
| usage.schedule | schedule_id | - | - |
| usage.schedule | seconds | - | - |
| usage.schedule | minutes | - | - |
| usage.schedule | hours | - | - |
| usage.schedule | day_of_month | - | - |
| usage.schedule | month | - | - |
| usage.schedule | day_of_week | - | - |
| usage.schedule | error_retry_count | - | - |
| usage.schedule | error_retry_wait | - | - |
| usage.schedule | create_datetime | - | - |
| usage.schedule | update_datetime | - | - |
| usage.schedule_history | schedule_id | - | - |
| usage.schedule_history | seconds | - | - |
| usage.schedule_history | minutes | - | - |
| usage.schedule_history | hours | - | - |
| usage.schedule_history | day_of_month | - | - |
| usage.schedule_history | month | - | - |
| usage.schedule_history | day_of_week | - | - |
| usage.schedule_history | error_retry_count | - | - |
| usage.schedule_history | error_retry_wait | - | - |
| usage.schedule_history | create_datetime | - | - |
| usage.schedule_history | update_datetime | - | - |
| usage.schedule_history | insert_datetime | - | - |
| usage.schedule_run | schedule_run_id | - | - |
| usage.schedule_run | source_id | - | - |
| usage.schedule_run | scheduled_start_datetime | - | - |
| usage.schedule_run | error_retry_count | - | - |
| usage.schedule_run | run_count | - | - |
| usage.schedule_run | report_start_date | - | - |
| usage.schedule_run | report_end_date | - | - |
| usage.schedule_run | actual_last_start_datetime | - | - |
| usage.schedule_run | last_log_id | - | - |
| usage.schedule_run | last_run_status_code | - | - |
| usage.schedule_run | agent_code | - | - |
| usage.source | source_id | Yes | Daily |
| usage.source | active_flag | Yes | Daily |
| usage.source | ignore_failed_validations_flag | Yes | Daily |
| usage.source | create_datetime | Yes | Daily |
| usage.source | update_datetime | Yes | Daily |
| usage.source | schedule_id | Yes | Daily |
| usage.source | alert_parameters | Yes | Daily |
| usage.source | file_type | Yes | Daily |
| usage.source | refresh_type | Yes | Daily |
| usage.source | connection_id | Yes | Daily |
| usage.source | connection_type | Yes | Daily |
| usage.source | initiation_type | Yes | Daily |
| usage.source | loopback_output_id | Yes | Daily |
| usage.source | parser | Yes | Daily |
| usage.source | source_template_id | Yes | Daily |
| usage.source | group_id | Yes | Daily |
| usage.source | hub_table_size | Yes | Daily |
| usage.source | hub_current_flag | Yes | Daily |
| usage.source | process_configuration_id | Yes | Daily |
| usage.source | custom_ingest_cluster_configuration_id | Yes | Daily |
| usage.source | custom_parse_cluster_configuration_id | Yes | Daily |
| usage.source_dependency | source_dependency_id | - | - |
| usage.source_dependency | source_id | - | - |
| usage.source_dependency | dependency_source_id | - | - |
| usage.source_dependency | hard_dependency_flag | - | - |
| usage.source_dependency | dependency_interval | - | - |
| usage.source_dependency | active_flag | - | - |
| usage.source_dependency | create_datetime | - | - |
| usage.source_dependency | update_datetime | - | - |
| usage.source_relation | source_relation_id | - | - |
| usage.source_relation | source_id | - | - |
| usage.source_relation | related_source_id | - | - |
| usage.source_relation | length(expression) | - | - |
| usage.source_relation | source_cardinality | - | - |
| usage.source_relation | related_source_cardinality | - | - |
| usage.source_relation | expression_parsed | - | - |
| usage.source_relation | active_flag | - | - |
| usage.source_relation | create_datetime | - | - |
| usage.source_relation | update_datetime | - | - |
| usage.source_relation | primary_flag | - | - |
| usage.source_relation | relation_template_id | - | - |
| usage.source_relation_history | source_relation_id | - | - |
| usage.source_relation_history | source_id | - | - |
| usage.source_relation_history | related_source_id | - | - |
| usage.source_relation_history | length(expression) | - | - |
| usage.source_relation_history | source_cardinality | - | - |
| usage.source_relation_history | related_source_cardinality | - | - |
| usage.source_relation_history | expression_parsed | - | - |
| usage.source_relation_history | active_flag | - | - |
| usage.source_relation_history | create_datetime | - | - |
| usage.source_relation_history | update_datetime | - | - |
| usage.source_relation_history | primary_flag | - | - |
| usage.source_relation_history | relation_template_id | - | - |
| usage.source_relation_history | insert_datetime | - | - |
| usage.source_relation_parameter | source_relation_parameter_id | - | - |
| usage.source_relation_parameter | source_relation_id | - | - |
| usage.source_relation_parameter | type | - | - |
| usage.source_relation_parameter | enrichment_id | - | - |
| usage.source_relation_parameter | raw_attribute_id | - | - |
| usage.source_relation_parameter | system_attribute_id | - | - |
| usage.source_relation_parameter | source_id | - | - |
| usage.source_relation_parameter | self_relation_container | - | - |
| usage.source_relation_parameter_history | source_relation_parameter_id | - | - |
| usage.source_relation_parameter_history | source_relation_id | - | - |
| usage.source_relation_parameter_history | type | - | - |
| usage.source_relation_parameter_history | enrichment_id | - | - |
| usage.source_relation_parameter_history | raw_attribute_id | - | - |
| usage.source_relation_parameter_history | system_attribute_id | - | - |
| usage.source_relation_parameter_history | source_id | - | - |
| usage.source_relation_parameter_history | self_relation_container | - | - |
| usage.source_relation_parameter_history | insert_datetime | - | - |
| usage.source_schema | source_id | - | - |
| usage.source_schema | update_start_datetime | - | - |
| usage.source_schema | completed_update_start_datetime | - | - |
| usage.source_schema | process_id | - | - |
| usage.source_schema | status_code | - | - |
| usage.source_schema | jsonb_array_length(hub_schema) | - | - |
| usage.source_schema_history | source_id | - | - |
| usage.source_schema_history | update_start_datetime | - | - |
| usage.source_schema_history | completed_update_start_datetime | - | - |
| usage.source_schema_history | process_id | - | - |
| usage.source_schema_history | status_code | - | - |
| usage.source_schema_history | jsonb_array_length(hub_schema) | - | - |
| usage.source_schema_history | insert_datetime | - | - |
| usage.source_status | source_id | - | - |
| usage.source_status | update_datetime | - | - |
| usage.source_status | status_code | - | - |
| usage.source_status | input_update_datetime | - | - |
| usage.source_template | source_template_id | - | - |
| usage.source_template | length(source_name) source_name_length | - | - |
| usage.source_template | create_datetime | - | - |
| usage.source_template | update_datetime | - | - |
| usage.object_template | object_template_id | - | - |
| usage.object_template | length(object_name) object_name_length | - | - |
| usage.object_template | create_datetime | - | - |
| usage.object_template | update_datetime | - | - |
| usage.source_template_history | source_template_id | - | - |
| usage.source_template_history | length(source_name) source_name_length | - | - |
| usage.source_template_history | create_datetime | - | - |
| usage.source_template_history | update_datetime | - | - |
| usage.source_template_history | insert_datetime | - | - |
| usage.object_template_history | object_template_id | - | - |
| usage.object_template_history | length(object_name) object_name_length | - | - |
| usage.object_template_history | create_datetime | - | - |
| usage.object_template_history | update_datetime | - | - |
| usage.object_template_history | insert_datetime | - | - |
| usage.token | token_id | - | - |
| usage.token | create_datetime | - | - |
| usage.token | update_datetime | - | - |
| usage.token_history | token_id | - | - |
| usage.token_history | create_datetime | - | - |
| usage.token_history | update_datetime | - | - |
| usage.token_history | insert_datetime | - | - |
| usage.token_value | token_id | - | - |
| usage.token_value | source_id | - | - |
| usage.token_value | create_datetime | - | - |
| usage.token_value | update_datetime | - | - |
| usage.token_value_history | token_id | - | - |
| usage.token_value_history | source_id | - | - |
| usage.token_value_history | create_datetime | - | - |
| usage.token_value_history | update_datetime | - | - |
| usage.token_value_history | insert_datetime | - | - |
| usage.workflow_queue | workflow_queue_id | - | - |
| usage.workflow_queue | input_id | - | - |
| usage.workflow_queue | source_id | - | - |
| usage.workflow_queue | process_type | - | - |
| usage.workflow_queue | wait_reasons | - | - |
| usage.workflow_queue | created_datetime | - | - |
| usage.workflow_queue_history | workflow_queue_id | - | - |
| usage.workflow_queue_history | input_id | - | - |
| usage.workflow_queue_history | source_id | - | - |
| usage.workflow_queue_history | process_type | - | - |
| usage.workflow_queue_history | wait_reasons | - | - |
| usage.workflow_queue_history | original_created_datetime created_datetime | - | - |
| usage.workflow_queue_history | insert_datetime | - | - |
Updated