data.world September Product Launch

The September release of data.world is live, and is jam-packed with features and improvements that will make catalog teams and users more effective! We’ve got a major improvement to the Search UX, support for SCIM to improve access management, and new collectors to continue making your data.world catalog the center of your organization’s data ecosystem.

Read on to learn about these and other exciting new features!


Simplified Search Experience

We’re excited to announce that our new and improved search experience is now generally available! Our new experience has been in public preview since mid July. Through the preview feedback as well as months of user research, we’ve made significant updates to ensure a more intuitive and streamlined search experience.

With a cleaner interface and new features, users can now find what they need faster and with fewer clicks. Enjoy faster discovery through quick organization scoping; build, save, and share custom filters; pin and order your own top facets; preview the resource without leaving search; view important context like resource hierarchy and custom metadata; and utilize inline advanced features without leaving your current search.

Why the change? We listened to your input and designed a new search experience that eliminates noise and complexity, making it easier for all users—from new users to experienced catalog pros to enjoy faster, more efficient searching. 

You can learn more about these improvements in our product documentation and our Searching and Exploring Data course in data.world University.


Notable UI and UX improvements

Relating Resources: Resource relationships are important. We’ve made small but meaningful improvements to the user experience for relating resources to one another. Users will now have more room and more context as they search and relate resources. 

Providing Feedback: We want to hear directly from end-users so that we can provide an even better product. We’ve built a simple in-app feedback form that allows us to get direct feedback from users.

Look and Feel: We’ve updated our typography, modernized actions and components, and provided more space to absorb information. This is the first in a series of user interface improvements we’ll be rolling out over the coming months.


SCIM - Microsoft Entra (Private Preview)

Imagine never worrying about managing user access again! We are excited to introduce support for SCIM in data.world, to streamline the process of managing catalog, organization and resource access and permissions.

SCIM (System for Cross-domain Identity Management) makes user management automatic, ensuring the users in your enterprise always have the right access at the right time, by syncing user details and group membership between your identity provider and data.world. From onboarding to offboarding, every detail – job title, email, and permissions – stays perfectly synced. Why does this matter? Because separate data entry and manual errors can lead to security risks, manual effort, and frustration. With SCIM, you’re not just saving time; you're enhancing security and efficiency, protecting your business, and making sure nothing slips through the cracks. It’s peace of mind, effortlessly.

This Private Preview release of SCIM functionality supports Microsoft Entra (a.k.a. Azure Active Directory) as an identity provider. We will be adding Okta support in the near future.

If you’re interested in learning more about SCIM support in data.world, or accessing the Private Preview, reach out to your Customer Service Director.


Qlik Sense Cloud Collector (Private Preview)

The Qlik Sense Cloud Collector catalogs metadata from Qlik Sense Cloud, helping maintain a comprehensive inventory of Qlik Sense Cloud assets, facilitating better governance, discovery, and utilization of data across your organization.

This collector harvests metadata for apps, visualizations, sheets, fields, measures and more. For more information, see the product documentation.

An example collection from Qlik Sense


Informatica Cloud Data Integration (CDI) Collector (Private Preview)

The Informatica Cloud Data Integration (CDI) Collector catalogs metadata from CDI, helping maintain a comprehensive inventory of CDI assets, facilitating better governance, discovery, and utilization of data across your organization.

This collector harvests metadata for jobs, mappings, mapping tasks, and more. For more information, see the product documentation.

An example collection from Informatica Cloud Data Integration


Amazon QuickSight Collector (GA)

The Amazon QuickSight Collector, previously in Private Preview, is now generally available! The QuickSight Collector catalogs metadata from QuickSight, helping maintain a comprehensive inventory of QuickSight assets, facilitating better governance, discovery, and utilization of data across your organization.

This collector harvests metadata for Analyses, Dashboards, Datasets, Data Sources, and Folders. Additionally, lineage metadata is harvested between QuickSight Analyses, Datasets, and Data Sources when the data source is a relational database, S3, or Athena. For more information, see the product documentation.

An example of a QuickSight Dashboard

Search API + Syntax improvements

Public search API endpoints and all UI search interfaces now support advanced syntax to target specific metadata fields when constructing complex searches. The following keywords and partial match syntax is now supported:

title:”Sales Order"
Searches for exact matches on the title field for the value “Sales Order”

title:”*sales”
Searches for matches with titles containing the term “sales”.
The leading '*' character is used to specify partial or fuzzy match.

“description” and  “summary” can also be used as keywords to target specific fields.

Custom metadata can be searched in this manner with the following syntax:

metadata:”Submitted by:Tim Gasper”
Searches for exact matches on the “Submitted by” field with the value “Tim Gasper”

metadata:”Steward:*Juan”
Searches for matches on the “Steward” field that contain the term “Juan”

When using the public search APIs, specific fields can be targeted for exact and partial matching using the property object and the desired field IRI:

{
    "owner": "democorp",
    "property": {
        "https://democorp.linked.data.world/d/ddw-catalogs/steward": "*Gasper"
    }
}