Search support added to public API

We recently added search as a feature of our public API.

These new endpoints support searching for datasets, projects, insights, queries, tables, collections, files, glossary terms, and analysis resources.

We offer two options:

  • Simple Search: Simple text search with filtering support by owner and resource type
  • Advanced Search: Supports complex searches including date ranges, tags, and custom resource types


Metadata management public APIs

We've added a full suite of metadata management endpoints to our public API!

If you need to build custom workflows, integrate with existing tool chains, or require additional flexibility in managing your catalog, head over to our API docs. We've added endpoints to manage glossary terms, analysis resources, data sources, tables, columns, and relationships.

Coming soon: Collection management APIs


Windowed aggregations now live

Windowed aggregations partition the results from a SQL query into groups in order to perform calculations across adjacent rows of the query result. You can read more about windowed aggregations and see examples of their usage on data.world in our SQL documentation.

Here is a list of all the new windowed functions with links to their reference pages:




New metadata collectors in private beta: Power BI and DBT

We're proud to announce that two new metadata collectors are now available for enterprise customer use in private beta -- Power BI (business intelligence and data visualization) and DBT (next-gen data transformation). Let us know if you'd like to get your hands on the early versions of these collectors.

As we get closer to general availability, we'll be releasing more information on these exciting expanded metadata and discovery capabilities!

Easily edit which collections a resource belongs to

Did you know a resource on data.world, like a table, business term, or dashboard, can belong to multiple collections?

We've now made it easy to pick which collections a resource belongs to: simply click "Edit" on the resource page, then pick & choose which collections the resource should appear in and save those changes.

For example, if you had a business term in a "Sales" collection, you can now easily add that same business term to your "Finance" and "Customer Service" collections with only a few clicks. 

Likewise, if you wanted to move a resource from one collection to another, you can click "Edit" on the resource page, select the new collection, de-select the existing collection, and save that change. 

Customers who use Open collections can create a resource in a private collection, and only when it's ready for global consumption, add it to the Open collection.

We've also recently added the ability to create collections in the UI - read more about that here.

Stay tuned for editing collections in the API, and allow collections to be edited in bulk!

Metadata, queries, & more in recently viewed menu

Jump back to what you were working on most recently with these enhancements to our navigation and search experience. The recently viewed menu previously surfaced the datasets, projects, and profiles that you last visited. This menu now includes all of the pages where you do work in the application including queries, glossary terms, workspace tables, analysis pages, and more.

Supported pages in the recently viewed menu:

  • User and organization profiles
  • Datasets
  • Projects
  • Insights
  • Dataset and project tables
  • Dataset and project files
  • Queries
  • Glossary terms
  • Analysis resources
  • Metadata tables
  • Collections

Lineage panel moved closer to technical details

For customers leveraging data artifact lineage, it was a little counterintuitive that the high-level business lineage diagram would show up below your dataset relationships but above all your other relationships. So, we've moved it to just above the Technical details section.

Metrics update: Nov 18, 2020

First of all, this update includes a couple fixes:

  • Visits - New Users By Month was based off of pageviews, which can be affected by ad blockers or restrictive browser settings. It has been switched to use a more robust source of events. This may slightly increase this metric going forward.
  • Visits - Unique Visitors to Date was based off of pageviews, which can be affected by ad blockers or restrictive browser settings. It has been switched to use a more robust source of events. This may slightly increase this metric going forward.

Next, we've added an additional table/report:

  • Users love leveraging our built-in query workbench and federated query capabilities, however often it could be challenging for administrators to easily troubleshoot when queries go wrong or audit what queries are being executed.
  • The new Events - Queries report in your ddw-metrics dataset now provides quick access to audit level details on what queries are being run, by whom, including what the query text is, for fast troubleshooting and effective auditing.
  • This report is currently only available for multi-tenant enterprise customers -- it will be rolled out to single-tenant customers in the next few business days.


Show Previous EntriesShow Previous Entries