April brings multiple new metadata collection capabilities to data.world, including Collector enhancements for Snowflake and Databricks, and a new Collector for Amazon Managed Streaming for Kafka.
Read on to learn about these exciting new features!
Catalog Snowflake Streamlit Apps, Databricks Tags, and Amazon Managed Streaming for Kafka (MSK) assets
We’re excited to announce updates to the Snowflake and Databricks collectors to harvest more metadata and collector support for Amazon Managed Stream for Kafka. These updates gather more metadata from these systems and seamlessly bring it into our data.world platform. This metadata helps both technical and non-technical users discover and understand their data quickly, govern their data with greater context, and increase trust in data by providing information about data health and transformations.
All new features are generally available.
The Snowflake Collector harvests metadata from Streamlit in Snowflake
The Snowflake Collector now catalogs metadata from Streamlit in Snowflake, facilitating better governance, discovery, and utilization of Streamlit apps across your organization.
The metadata harvested for Streamlit apps includes comments, owners, creation date, and root location. From data.world, users can discover apps and navigate directly to the app in Snowflake.
An example of a Streamlit app
Databricks Collector harvests Databricks tags
The Databricks Collector now catalogs tags from Databricks catalogs, schemas, tables, and columns. Tags are used in Databricks to simplify the search and discovery of data assets. With these tags now in data.world, users can quickly discover data assets in Databricks. For instance, product teams can now build their data products in Databricks and identify them in data.world.
An example of Databricks Tags
Amazon Managed Streaming for Kafka (MSK) Collector
The new Amazon Managed Streaming for Kafka (MSK) Collector catalogs metadata from Amazon MSK, helping maintain a comprehensive inventory of MSK assets, facilitating better governance, discovery, and utilization of data across your organization.
This collector harvests metadata for clusters, brokers, topics, consumers, and producers.
An example collection from Amazon MSK
Start exploring today
These new collector updates help users understand where data in these reports are sourced from, facilitating troubleshooting for analysts and increasing trust for business end users. Learn more in our product documentation: