The November 18, 2025 monthly launch delivers major usability upgrades across the platform — including the brand-new navigation experience, streamlined access requests, and powerful integration and workflow improvements.

🔥 What’s New?

🧭 New data.world Navigation and Marketplace (GA)

The redesigned data.world interface and marketplace feature set is now generally available!

As mentioned in past monthly launch posts, this new navigation streamlines how you explore, organize, and access data by aligning with daily workflows. The result: faster navigation, fewer clicks, and a more intuitive, modern experience.

Who benefits: Every data.world user looking for a cleaner, smarter, more efficient way to get work done.

Learn more about our new Marketplace experience as well as our new navigation and layout. 

📊 Dashboards Link in New Navigation

Dashboards are now just one click away!

A new persistent “Dashboards” link in the main navigation bar makes it effortless to access usage and governance dashboard views from anywhere in the platform—boosting discoverability and reducing navigation friction for frequent dashboard users.

Who benefits: Governance teams and administrators who rely on our built-in dashboards for platform and program insights.

Learn more in our documentation.

🛒 Bulk Request Access

Need access to multiple resources? Do it all at once.

The new bulk request access feature introduces a shopping-cart-style workflow that lets you request access to multiple resources in one go. Related requests are automatically grouped by workflow and submitted together with shared justification—saving time and clicks.

Who benefits: Analysts, business users, and researchers who often request access to several related datasets or projects.

Learn more in our documentation. This functionality is part of premium governance automations.

💫 What’s Improved?

📥 Import Spreadsheet Review Step

See exactly what will change before you commit.

A new review and validation step in the bulk import workflow lets you preview suggested edits, compare before/after metadata, and view warnings or unsupported resource types — helping you confidently apply bulk changes.

Who benefits: Anyone managing metadata updates through bulk import/export.

✏️ Edit Users Can Suggest Changes

Edit users can now collaborate through suggestions.

With the Suggest Changes automation, users who have edit access can choose to propose metadata changes for review instead of applying them directly—perfect for cases that need oversight or cross-team validation.

Who benefits: Editors and stewards who want governance-friendly collaboration options.

This functionality is part of premium governance automations.

🧩 ServiceNow Integration Enhancements for Request Access

Our ServiceNow access request integration just got a major upgrade.

Admins can now customize access request forms, variable names, and configurations for how data.world communicates with ServiceNow workflows. This provides more control and flexibility for organizations aligning access management with ITSM standards.

Who benefits: ServiceNow administrators, governance, and IT operations teams managing access workflows.

This functionality is part of premium governance automations.

🔤 Glossary Tiles

Get a quick overview of the resource types in your glossary.

Users now have a quicker way to see the types of resources in their glossary! Available now on the glossary page, users will see tiles for each of the resource types available in their glossary and can quickly filter to view those glossary types with a simple click.

Who benefits: Business users and anyone looking to quickly navigate through their glossary.

The October 21st monthly launch brings powerful improvements to make enriching, governing, and navigating your data.world experience even smoother. From bulk metadata actions to navigation upgrades, here’s everything new this month 👇

🔥 What’s New?

📝 Bulk Suggest via Import/Export

You can now suggest edits to multiple resources at once using the familiar export/import flow. This works for both users with edit access and those with read-only access, making large-scale metadata enrichment easier for everyone. Learn more in our documentation.

✅ Bulk Approval and Reject for Suggestions

Governance approvers now have a centralized page to review and approve or reject multiple metadata change suggestions in one place. No more clicking into each resource individually—managing high volumes of suggestions is now much more efficient. Learn more in our documentation.

🧭 New Navigation: Opt-Out Phase

Reminder: As previously communicated and coordinated, new navigation defaults to 'on' (opt in -> opt out) at end of day on Thursday, October 16.

The new navigation experience is rolling out to all users. Everyone will automatically see the updated interface, with the option to opt out temporarily through a banner. This is the next step toward a simpler, more intuitive navigation experience. Learn more about our new Marketplace experience as well as our new navigation and layout. 

💫 What’s Improved?

🦉 Hoots: Updated Browser Extension (v1.5.0)

Edit: Microsoft Edge doesn't allow us to hold back the browser extension release, so it automatically rolled out on Wednesday, October 15, however Chrome allows to hold it back, so it will be available on the monthly launch date of Tuesday, October 21.

Hoots v1.5.0 is here for Chrome and Edge. The update improves URL tracking, customization options for Stewards, and fixes redirect issues. It also makes it easier to preview lineage and definitions right in your browser, streamlining Hoot management and making it more flexible. Learn more in our documentation.

👥 User Management Filters in Instance Admin

Instance admins can now filter users by account status, role, and permissions. This makes it faster to find and manage specific user groups at scale.

🔍 Search Facet Count Limit Raised

The search facet (filter items) limit has increased from 50 to 250 across the platform, giving you more visibility and control when filtering and exploring metadata.

🗓️ Coming Soon

The new navigation opt-out banner will be hidden on October 30, though users can still opt out through settings until November 12. After that, the new navigation will become the default experience for everyone.

We're excited to announce our September product updates designed to transform your data governance and management experience. These new features provide a preview of the upcoming major changes to the user experience of data.world as well as provide an enhanced view license usage.

🔥 Coming Soon!

New Marketplace & Navigation Experience (Public Preview)

Finding and sharing the right data and data products is about to get a lot easier with our redesigned navigation experience and new Marketplace portal. This intuitive interface helps your organization:

• Navigate with clarity across our core and new Marketplace product offerings (Catalog, Marketplace, Glossary, Workbench), enabling faster onboarding and clearer understanding of available resources
• Build and organize data products with streamlined workflows for creating, managing, and publishing data products and domains
• Expand data accessibility to business users who can now easily discover high-value data products and request access with ease.

The new layout is currently available in Public Preview. Soon users will see an announcement about the upcoming opt-out preview, scheduled for early October. The new navigation experience is scheduled to become the standard experience on the platform in late October.  We encourage you to opt in, explore the experience, and share your feedback as we continue to refine this feature. Learn more about our new Marketplace experience as well as our new navigation and layout preview. 

💫 What’s Improved?

Enhanced Users Dashboard for Optimized License Management

Following our April transition to measuring license consumption based on Activated Users (those who have logged in at least once) we've now launched a more comprehensive Users dashboard that provides:

• Detailed license usage reporting that breaks down users by license type (Full users, Read-only users, etc.)
• User-level visibility to identify exactly who your active users are
• Flexible filtering options to exclude specific roles (like administrators) from your reports

This enhancement is particularly valuable as it shows how we've aligned license costs with actual usage, ensuring you only pay for users who are actively engaging with the platform. Learn more about the enhanced Users dashboard here.

We're committed to continuously improving your data governance experience. Stay tuned for more updates in the coming months, and please share your feedback on these new features.

Stay tuned for more exciting updates in the months ahead!

This month’s release is all about making data discovery, collaboration, and governance even more seamless. From expanding how teams can access and interact with data, to improving visibility into adoption and governance, these updates continue to bring the data.world platform closer to where you work.

🔥 What’s New?

Archie Chat for Slack (General Availability)

Meet Archie where your team collaborates most. With Archie Chat for Slack, you can:

• Chat with your metadata and data.world product documentation (DocsBot) directly in Slack
• Get answers to data questions without leaving your workspace
• Enable teams to discover and use trusted data in the flow of work

Now in General Availability, this makes Slack a powerful extension of your data.world experience. Learn more in our documentation.

Governance Dashboards (General Availability)

Governance just became more accessible. With Governance Dashboards now available within your Data Catalog Team analytics org, you can:

• Provide visibility without requiring instance admin permissions
• Empower governance admins (and anyone else) with insights
• Strengthen trust and transparency across your data ecosystem

This update ensures governance insights are both easy to access and safely shared. Learn more in our documentation.

OpenAPI 3 Collector (Public Preview)

The OpenAPI 3 collector adds support for API specifications defined in versions 3.x of the OpenAPI standard. It also adds support for specifications defined in json or yaml format, support for harvesting metadata from multiple specification files at once (including from a directory of files), and support for obtaining specifications from a Github repository. Learn more in our documentation.

Revamped Sensitive Data Discovery (Public Preview)

For owners of data.world's Sensitive Data Discovery or Governance Premium add-ons, our revamped classification capability and architecture has arrived. This update applies to data.world relational database collectors (Postgres, MySQL, Microsoft SQL Server, Snowflake, Databricks, Teradata, Oracle, Redshift, Denodo, DB2, and Netezza) supporting classification of a sample of data from each table's columns into "sensitive data" categories. The classification functionality is powered by machine learning capabilities from our partner PrivateAI, and is built in to data.world's hosted metadata collection service, or you can run the PrivateAI service in your own environment. This is all part of making data.world simpler and smarter for data governance and compliance. Learn more in our documentation.

Marketplace & Navigation Expanded Preview (Private Preview)

Finding and sharing the right data products just got easier. The new Marketplace & Navigation experience enables you to:

• Build and publish Data Products and Domains
• Explore and request access through a unified Marketplace
• Organize data products by Domains and Marketplace Sections
• Expand your reach beyond technical users to business consumers

This feature is currently in Private Preview (with approval) and will open to Public Preview on August 31. Learn more in our documentation.

Open Data Quality API (Private Preview)

This new API provides ability to integrate real-time data quality metadata, metrics, and incidents with data.world in partnership with leading data quality and observability solutions, as well as custom data quality tools. Learn more in our documentation.

💫 What’s Improved?

Bulk Editing: Edit Table Columns with Ease

Introducing a column-cart: easily select the columns across multiple tables, apply bulk metadata updates, move them between collections, and complete mass edits fast and efficiently. Learn more in our documentation.

🔮 What’s Next?

Marketplace (Public Preview)

Coming on August 31: a sleek, ecommerce-style Data Marketplace for business users to search, discover, and request access to key data products. Want early access to this preview? Contact your customer success team! Learn more in our documentation.

With this August release, data.world continues to push forward on our mission to make data discovery, collaboration, and governance more inclusive and impactful. Whether you’re exploring new Data Products in the Marketplace, chatting with Archie in Slack, or keeping closer tabs on adoption and governance, these updates are designed to meet you where you work.

Stay tuned for more exciting updates in the months ahead!

We’re excited to share two updates – one available today and one coming soon – that improve how users access and manage metadata in data.world. 

new Now Available: Microsoft Edge Extension for Hoots

Our catalog is now even more accessible with the launch of the data.world Edge Extension, now officially available via the Microsoft Add-on Store!

Just like our Chrome extension, the Edge extension lets users:

    •    Instantly view catalog context while browsing BI tools, applications, and analytics platforms.

    •    Surface lineage, descriptions, and stewardship details for cataloged assets.

    •    Stay in the flow of analysis without switching tabs.

🔧 For IT teams: The Edge extension supports centralized deployment and management using Microsoft’s configuration tools making it easier to roll out across teams. Get started with installation and setup instructions

 Get the Edge extension now

coming soon June 10: A Simpler Resource Edit Mode

Editing metadata is about to get easier.

We’re introducing a new unified editing experience that brings all editable fields into a single scrollable modal. No more flipping through tabs or guessing where a field lives, the new design mirrors the layout of the Resource Page itself, making it more intuitive and efficient.

What’s improved:

    •    All fields visible at once, organized just like the live resource view.

    •    No more memorizing tab names or bouncing between sections.

    •    Faster editing with a cleaner, more focused interface.

📅 Launch Date: June 10, 2025

This month, we’re excited to launch powerful updates across the platform—highlighted by the general availability of our completely redesigned Resource Pages that makes data curation and understanding faster and easier. We’ve also introduced a new Microsoft Fabric integration, launched a Knowledge Token Dashboard to support catalog user insight, and enhanced Archie Chat’s contextual capabilities. From UX refinements to upcoming automation and collector improvements, our updates aim to make managing and understanding your data smoother and smarter.

🔥 What’s New?

Newly redesigned Resource Page goes live!

Our redesigned Resource Page has graduated to general availability! These changes serve as a powerful curation and exploration workspace. With inline editing, enhanced bulk operations, and rich previews, it’s now easier than ever to manage and explore your metadata. This release turns the Resource Page into a dynamic hub for both discovery and governance. Learn more.

New Microsoft Fabric Collector

We now support Microsoft Fabric! Our new collector automatically harvests metadata across Fabric’s unified data and analytics environment—capturing workspaces, semantic models, lakehouses, warehouses, and pipelines. This ensures broader visibility into your Microsoft data ecosystem and improves discoverability across hybrid environments. Learn more.

New Knowledge Token Dashboard 

Exclusively for Archie and AICE customers, the new Knowledge Token Dashboard provides clear, real-time visibility into your Knowledge Token usage. Gain actionable insights to manage consumption proactively and optimize how generative AI features are used across your organization. Learn more.

💫 What’s Improved?

Archie Chat improvements

Archie Chat now accepts in-app feedback so you can guide its continuous improvement. It also understands more of your current context—like the page you’re on—so you can ask questions like “Summarize this resource” and get more relevant responses instantly.

Chrome Extension v. 1.0.2

Our latest Chrome Extension update includes:

1. Fixes for navigation tracking issues in single-page apps, ensuring the correct Hoot always appears.
2. User-specific controls for sticky positioning and badge expand/collapse states.
3. Easier deployment with centralized admin configuration of URLs during installation—streamlining setup across teams.

🔮 What’s Coming Next?

Microsoft Edge Extension

We’re bringing all the power of our Chrome Extension to Microsoft Edge! The new extension will offer identical functionality and will be available through the official Microsoft Add-on marketplace.

Premium Automation: Suggest New Resource 

Soon, users will be able to suggest new resources directly within the catalog via a guided interface and configurable approval workflow. Admins can tailor suggestions by resource type and target approvers, unlocking a scalable way to keep your catalog growing and governed.

Test Configurations for Cloud Collectors

Avoid trial-and-error collector setups. Admins will soon be able to validate cloud collector configurations before they run—catching permission issues or misconfigurations early and saving time on debugging long-running jobs.

We’re thrilled to share this month’s updates. Whether you’re governing metadata at scale, filling gaps in lineage, or looking for a more intuitive user experience, these enhancements are built to help your team move faster and collaborate better. Here’s what’s new, what’s improved, and what’s just around the corner.

🔥 What’s New?

New Premium Workflow Automation: Suggest Changes

Say hello to smarter, scalable governance workflows. Our new Suggest Change Workflow is an automation designed to help our Governance Premium customers with more complex workflows. It  allows users to propose metadata changes that route through configurable approval groups. Once approved, updates are either instantly applied or, for source-owned fields, sent as ServiceNow tickets—ensuring updates are made at the system of origin. This is a game-changer for teams who want to empower metadata contributors without compromising control or compliance. Find out more in the product documentation.

📊 New Dashboards – Clarity and Insight at Your Fingertips

In March, we rolled out Governance Dashboards in the Admin Portal—an interactive, visual way for instance administrators to monitor platform activity, analyze engagement trends, and surface meaningful insights across their data.world environment. These dashboards were built to address the growing need for visibility into how users are interacting with data, what they’re searching for, and which resources are being used (or overlooked). You can read more about these dashboards here.

SAP HANA Collector with Lineage

We’ve expanded our enterprise-grade coverage with a brand-new, native SAP HANA collector—now with lineage! Previously, customers had to rely on the Generic JDBC collector. With this upgrade, teams can now trace data movement to where it originated in their MDM pipeline, supporting better impact analysis, governance, and audit-readiness. Enterprise teams using SAP HANA will get a more complete picture of the entire data pipeline with this new collector.

Marquez/OpenLineage Collector

We’re supercharging our support for OpenLineage via Marquez. This collector lets customers easily send lineage metadata to data.world using the OpenLineage standard, which is increasingly supported by tools like Airflow, dbt, and Spark. It’s perfect for teams with complex, fast-moving stacks who need lineage coverage now—no custom integration or roadmap waiting required. Visit our documentation here.

💫 What’s Improved?

New updates to the Resource Page redesign (in Public Preview)

Our redesigned Resource Page continues to evolve—and it’s looking better than ever. We’ve rolled out a sleek new relationship preview component, enhanced collapse/expand behavior, and squashed bugs to improve polish and performance. It’s a smoother experience that makes exploring resources and their relationships feel quick and easy. To take advantage of the new layout, some customers might consider moving their metadata fields to different sections. We plan to fully release this redesign in May. Read here to understand more about the rollout plan and consult the documentation if you’d like to understand which sections moved.

currentUser keyword added to advanced search syntax

Finding “your stuff” just got easier. The new currentUser search syntax lets users instantly surface resources they own, favorited, or are connected to—without needing to remember complex filters. Catalog Admins can use the new keyword in the Browse Card to link end users to personalized search results. It’s a small feature with big impact for day-to-day navigation and catalog engagement. Read more to find out how to use this syntax to find resources to which you are attributed or responsible.

Example: `metadata:”Steward:currentUser” AND NOT has:description`
Returns personalized results where the current user is listed as the steward and are missing descriptions.

🔮 What’s Coming Next?

📥 Microsoft Fabric Collector: We’re adding a new collector for Microsoft Fabric workspaces, including Power BI artifacts—expanding coverage for customers in the Microsoft ecosystem.

🎯 GA Launch of the New Resource Page: The redesigned Resource Page and relationship grids will move from public preview to general availability (GA) on May 20th, no longer requiring users to opt-in to the new experience.

This month’s release is packed with powerful updates designed to unlock more from your catalog. From the launch of Archie Chat, your AI-powered assistant for instant answers, to a new design and functionality for our Resource pages, we’re bringing faster workflows and deeper insights to every user. We’ve also rolled out new and enhanced collectors—from Amazon DMS to AWS Glue, ADF, and beyond—giving data teams the visibility they need to govern modern, complex data stacks. And coming soon: new Governance Dashboards that bring actionable insights, helping you measure engagement and optimize your data strategy.

🔥 What’s New?

💬 Archie Chat – Your AI-Powered Data Assistant is Live

Say hello to Archie Chat, the intelligent assistant that turns your data catalog into an interactive knowledge hub. Now available in Public Preview, Archie delivers instant, context-aware answers. Archie Chat answers questions and helps you navigate the catalog instantly, using context from your own data resources, glossary terms, and our product documentation to help you get answers faster.

Data consumers can use natural language to ask questions like “Tell me what you know about marketing campaign attribution” or “What does ACV mean?”, and get quick, reliable answers from your catalog. Stewards and admins can ask things like, “What’s the fastest way to add lots of relationships at once?” and get immediate, actionable guidance—no digging through docs required. 

Quick Tip: Archie is now in Public Preview and free to try. Reach out to your Customer Success representative to get started today!

✨ Resource Page Redesign – Usability Reimagined

The Resource Page redesign and new functionality is here. We've overhauled the resource page experience, creating a more intuitive layout, providing edit history, and other new powerful features that put speed and insight at your fingertips:

• Streamlined layout and design for faster understanding and navigation
• Rich activity feed that capture your data's story
• Inline editing capabilities
• New preview options
• Enhanced filtering options

The new Activity feed is now generally available and you can read more about it here. The redesigned Resource Overview page and tabs are in Public Preview and users can read more about that here. You can read more about it here. One click is all it takes to transform your workflow.

🔄 Amazon Data Migration Service Collector – Lineage Through the Cloud Migration Journey

Our new Amazon DMS Collector brings visibility into your cloud migration pipelines by capturing lineage from AWS Data Migration Service (DMS) jobs. Whether you’re migrating on-prem databases to the cloud or using DMS for change data capture (CDC), this collector gives you line-of-sight traceability into how data moves across systems. Now, you can govern these migration flows with confidence, maintain compliance, and ensure your catalog reflects your evolving data architecture.

💫 What’s Improved?

🧬 AWS Glue Collector – Deeper Metadata, Stronger Lineage

We’ve supercharged the AWS Glue Collector to bring in even richer metadata and more complete lineage. The collector now captures detailed metadata from Glue Data Catalog tables—including file types, sizes, serializers, and deserializers—as well as improved job metadata. Even better, it now builds lineage to S3 objects, providing full traceability back to the ultimate source. This enhancement empowers more robust impact analysis and stronger governance across your AWS data landscape.

🔗 Azure Data Factory Collector – Smarter Lineage for Parameterized Pipelines

The ADF Collector just got an upgrade: it now captures lineage from parameterized datasets, surfacing both upstream and downstream references in complex, dynamic pipelines. This gives data teams clearer visibility into data movement across ADF workflows—especially in cases where pipeline logic changes based on parameters—resulting in more accurate lineage, improved trust, and tighter control over your data flows.

🔧 Public API Enhancements – Create & Manage Discussions Programmatically

Now you can create and manage discussions directly through the public API, making it easier to capture critical conversations wherever they happen. Whether integrating with ticketing systems, BI tools, or custom workflows, this enhancement turns your catalog into a true collaboration hub—bridging the gap between data context and team communication. By embedding conversations directly into the metadata layer, you unlock smarter decision-making and greater operational efficiency.

🔮 What’s Next?

📊 Coming Soon - New Governance Dashboards

Later this week, we’re launching a new suite of Governance Dashboards in the Admin Portal—your command center for understanding how your data catalog is being used. These interactive, visual dashboards give instance administrators the tools they need to monitor platform activity, analyze user engagement, and uncover trends across your data.world environment. From search behavior to resource metrics and usage, and daily active users, you now have the clarity to spot what’s working, what’s being overlooked, and where to invest next.

Built with ready-to-use views and flexible filters, these dashboards empower teams to make faster, smarter decisions about content strategy, user enablement, and platform optimization. This feature is exclusively available to users with Instance Administrator permissions in private instances and single-tenant deployments.

🔄 Coming Soon – New Marquez / OpenLineage Collector

Our upcoming Marquez Collector brings support for the OpenLineage standard, enabling teams to capture lineage from custom pipelines built with Python, PySpark, SQL, and more. By pulling lineage directly from the Marquez metadata store, this collector helps you document and govern bespoke or proprietary data pipelines—even when no native connector exists.

🏢 Coming Soon – New SAP HANA Collector

We’re expanding our enterprise coverage with a new SAP HANA Collector, designed to harvest standard database metadata—and even some lineage—from SAP’s powerful data warehousing platform. This collector will help customers bring critical SAP assets into the catalog for better visibility, governance, and reuse.

Ready to unlock more from your data? Contact your Customer Success representative to explore these groundbreaking updates and unlock the full potential of data.world, the simpler and smarter catalog.

This month, we’re rolling out enhancements designed to streamline data management, improve usability, and boost productivity. From AI-powered bulk descriptions to a smoother access request experience—and two exciting launches on the horizon—there’s a lot to explore!

🔥 What’s New?

Archie Bulk Describe – Now in Private Preview (Beta)

Say goodbye to manual descriptions and hello to AI-powered enrichment at scale! Archie Bulk Describe lets you generate high-quality descriptions for multiple resources in just a few clicks, making it an essential tool for curators and data product owners. With this feature, you can quickly generate AI-suggested descriptions, ensuring your catalog remains accurate and insightful—without the tedious manual work.

If you’re not yet part of the Archie Private Preview, reach out to your Customer Success Manager today! Need help getting started? Check out our product documentation for details on how to enable Archie Private Preview features and how to run Archie Bulk Describe in your catalog.

💫 What’s Improved?

A Smoother, Smarter Way to Request Access

We’ve made a series of improvements to access request workflows, making them faster and more intuitive. With auto-filled titles and smart auto-skipping, requesting access to resources—or creating new ones—has never been easier. These updates reduce friction, minimize manual steps, and ensure a seamless, consumer-grade experience for enterprise users.

This is part of our ongoing commitment to refining the user experience to feel simple and intuitive.

🔮 What’s Next?

✨ Resource Page Redesign – A New Era of Usability

We’ve completely reimagined the Resource Details Page to make navigating and understanding data assets easier than ever. With an intuitive new layout, edit history, improved summaries and layout, finding the information you need will feel effortless. We’ve also made everything quicker—quicker access to lineage, quicker metadata edits with inline editing, and quicker ways to explore related data with more configuration, filtering and sorting options. The result? A night-and-day improvement in user experience that will feel simple yet smart.

Very soon, this redesign will be available in Public Preview, giving end-users the opportunity to opt-in and experience the new workflow before full rollout.

💬 Meet Archie Chat – Your AI-Powered Data Assistant

Navigating your data catalog just got smarter. Archie Chat (soon in Public Preview Beta) brings an AI-powered, business-context-aware chat experience to your platform, answering questions instantly, reducing friction, and improving adoption. Instead of digging through documentation, catalog admins can now ask “How do I bulk edit metadata?” and get an immediate, actionable response. Data consumers can type natural language questions like “Is ‘Occupation’ a sensitive data type?” or “What does TMA stand for?” and get more precise answers sourced from the context of your data catalog.

Archie Chat is launching in beta, free for a limited-time, so be among the first of our customers to explore this game-changing feature! If you aren't already an Archie-enabled customer, reach out to your customer service manager to find out how you can be ready to try Archie Chat when it releases.

January Releases: Expanding Connectivity, Simplifying Setup, and Enhancing Lineage Exploration

This month, we’re delivering powerful updates to enhance metadata collection, streamline setup, and improve lineage exploration. We’re expanding our connectivity with new on-premise collectors for Apache Airflow and Qlik Talend, enabling deeper metadata harvesting and lineage tracking for critical ETL and workflow automation tools. People field configuration is now more intuitive, allowing user accounts to be dynamically selected for ownership and stewardship, reducing manual setup and improving governance. Finally, our new public API endpoint for lineage querying makes it easier for customers to customize lineage exploration with flexible queries and standardized outputs. These updates help teams work smarter, get to insights faster, and build on top of our platform with greater ease. 🚀

Support for Airflow and Talend on-premise Collection

By the end of January, the data.world collector integrations will include new collectors for Apache Airflow and Qlik Talend Data Integration (the on-premise version of Qlik’s Talend product). Airflow is an open source workflow automation tool that many enterprises use to schedule and manage data engineering and analytical tasks. The new collector will harvest metadata about these workflows–called Directed Acyclic Graphs–and the tasks contained within them. Qlik Talend is a data integration product that facilitates extract, transform, and load (ETL) processes; the new collector will identify sources and targets of these processes and harvest lineage relationships representing the flow of data between them.

These collectors will initially be available as on-premise collectors only, but will also be available as cloud collectors in early February.

Streamlined Setup of People Fields

Configuring ownership and stewardship just got easier! In addition to supporting people as collected resources, customers can now utilize their user accounts to populate people fields. This update streamlines setup, providing an intuitive approach that helps teams quickly setup, ensuring seamless attribution and governance from the start and helping end-users connect with the right people. You can read the documentation for this feature here.

Resource Lineage Support in Public API

We’re making it easier than ever to programmatically explore lineage with our new Catalog Lineage Public API endpoint! This update provides flexible query options, allowing customers to tailor lineage exploration to their needs to build lineage based tooling, automations, and integrations. This is a win for all lineage customers looking for deeper insights and more intuitive ways to navigate their data relationships. 

UX Changes Coming Soon

Activity feed for Resources

Soon, we’ll be introducing a new Activity tab on Resources, Glossary and Collection objects that show edit history and other activity in the UI. This will make it easier for users to quickly understand how the resources have been updated and changed. Announcement of the release will soon follow.

Resource page redesign

Along with a new activity feed, we'll be introducing a newly designed details page that offers more intuitive navigation, better use of whitespace, configurable relationship tabs, inline editing, and other features that will make the resources both easier to understand and scan but also easier to enrich and edit. Announcement of this release will follow in this quarter.