The July release of data.world is here, with starter kits to get AI Context Engine™ up and running quickly, enhancements to collect more metadata for popular collectors, the first release of Databricks Publisher to keep metadata in sync between data.world and Databricks, and an opt-in preview of an improved search experience within data.world.
Read on to learn about these exciting new capabilities, available now!
AI Context Engine™ Starter Kits
To help customers quickly utilize the AI Context Engine, we now offer three starter kits:
Key Benefits
- Quick Start: Each starter kit provides all necessary components to get up and running quickly.
- Customization: Clients can modify the source code to suit their specific needs.
- Ongoing Updates: Access the latest features and improvements by updating from GitHub.
- No Custom LLM Required: The starter kits enable direct AICE API calls for basic Q&A on structured data.
Availability and Support
The starter kits are available to all AICE customers at the links above. While they are provided as-is and unsupported, they offer a robust foundation for developing custom applications.
Enhancements to Power BI, dbt, and Denodo Collectors
This month, we’re excited to announce enhancements to our top collectors to harvest more metadata and lineage relationships.
Power BI Collectors enhancements
The Power BI Service and Power BI Gov Collectors have been updated to harvest preview images for Power BI reports allowing users to preview reports in data.world before they navigate to them in Power BI.
dbt Collector enhancements
The dbt Core Collector has been updated to streamline the setup of multiple dbt Core Collector instances allowing users to specify multiple run_results.json files in a single run. Additionally, the dbt Core and dbt Cloud Collectors now support Azure Synapse as a target database.
Denodo Collector enhancements
The Denodo Collector has been updated to harvest lineage between Denodo resources and cross-system lineage between Denodo and Power BI are now supported.
Announcing the Beta Release of Databricks Publisher!
We are excited to introduce the first version of the Databricks Publisher, launching in Beta on July 23. This new feature allows you to write back Databricks column and table metadata for individual resources with just the push of a button, streamlining your metadata governance processes.
What’s New?
The Databricks Publisher enables seamless synchronization of metadata, ensuring that annotations by subject matter experts and data stewards in data.world are reflected back in Databricks. This enhancement benefits analysts and data scientists by providing well-governed, meaningful metadata directly within their Databricks environment.
But that’s not all! We have more exciting features in the pipeline:
- Real-Time Updates: Soon, you won’t need to manually sync changes. Any saved changes will automatically update in Databricks.
- Tag Writeback: This upcoming feature will extend the functionality to include tags, further enhancing your governance capabilities.
Why This Matters
Synchronizing metadata between data.world and Databricks creates a seamless governance workflow. This integration supports a broader persona model where end users and governance professionals utilize data.world directly, while technical analysts and engineers use platforms like Databricks for discovery and data work. By bridging these environments, we’re making it easier for your teams to collaborate and access the data they need.
To get access to this Beta feature, reach out to your Customer Success Manager. We can’t wait for you to experience the benefits of this new feature and look forward to your feedback as we continue to enhance our offerings.
Stay tuned for more updates, and thank you for being a valued customer!
Public preview of new search experience now available
We're happy to announce the public preview of our new search experience! As part of our continuous effort to improve your experience with our platform, we've made some significant upgrades and introductions to the way you search data on our product. For the next month, we invite you to opt-in to the new preview where you can interact with these new features before they go live.
Our enhanced search function now offers a preview of key resource elements, allowing you to quickly differentiate results and jump to related resources or explore resource lineage without steering away from your search experience. Some much-loved additions include refined and streamlined filters to help you find exactly what you need, more efficiently. You can now enjoy a search for filters, select more than one, and delve into advanced filter operations (ANY, ALL, NONE). Organization scoping has never been smoother – stay within your org scope, and sort regardless of your scope.
We’ve made the experience cleaner and more user-friendly, cutting down on overwhelming filter options and obscure filter values, and enabling a customizable order of filters – pin your favorite or most-used ones to the top for ease. Plus, you can also build and save your own filters for future and repeated use.
These changes root from the invaluable feedback we received from you, our valued customers and users. You asked for a simpler, more manageable experience, the ability to preview more types, as well as personal customizations like saved searches and re-ordered facets – and we listened! We’re incredibly excited for you to experience these advancements. You can read more about what we’ve changed in our documentation portal.
The interface invites you to share your feedback directly within the app, or you can reach out to your Customer Success Manager to voice your thoughts. We look forward to hearing from you!
