October 2, 2023
Repairing metadata unity catalog
I’ve been subscribed to https://www.dataengineeringweekly.com/p/data-engineering-weekly-148 for years. This last number included several on-call posts on Medium. I found these quite useful.
Today, I got an alert from Metaplane that a cost monitor dashboard was out of date. I checked the processes, and everything was fine. I ran a query to check the freshness of the data and it was ok too.
Metaplane checks our delta table freshness by querying the table information available in the Unity Catalog.
Read more