Overview
Metadata monitoring dataset exists in databricks in the meta database. It replicates data from postgres tables and provides a real-time read-only view of the data in the underlying postgres database. The purpose of this dataset is to provide data for customized DataForge operations monitoring reports and dashboards and avoiding additional load and contention on the postgres metadata database.
External tables
Through the Meta Monitor process, many of the tables in Postgres are available in Databricks as well. To find a full list of the latest tables available, navigate to Databricks and open the Data tab from the menu. Select the hive_metastore catalog and the meta database to see a list of all tables available.
Updated