For customers leveraging data artifact lineage, the resource items are now interactive. You can click through the icons to view the respective resource pages.
For customers leveraging data artifact lineage, the resource items are now interactive. You can click through the icons to view the respective resource pages.
The data.world public API supports several options for programmatically making updates to resources on the platform. PATCH
is a method for making partial updates to individual records, such as adding tags, changing a description, or modifying a title.
In the next two weeks, we will be making a change to the way PATCH
endpoints modify list values. We outline these changes below.
tag A
, tag B
] PATCH
request is sent to /datasets/democorp/my-example-dataset
with body: { "tags": [ "tag C", "tag D" ] }
tag A
, tag B
, tag C
,tag D
]PATCH
request is sent to /datasets/democorp/my-example-dataset
with payload: { "tags": [] }
tag A
, tag B
, tag C
,tag D
]tag A
, tag B
] PATCH
request is sent to /datasets/democorp/my-example-dataset
with body: { "tags": [ "tag C", "tag D" ] }
tag C
,tag D
]. tag A
and tag B
have been removed.PATCH
request to /datasets/democorp/my-example-dataset
with body: { "tags": [] }
Today, PATCH
can be used to add, modify, or remove fields for all non-list values. With the current merge logic, items can only be appended to list values using PATCH
. As a consequence, if you want to remove or reorder the items in a list, you must use the PUT
method, which does not support partial updates and requires a full overwrite of the existing record. The new logic to overwrite list values will allow users to make partial updates to records that remove or modify the order of items in the list without needing to modify the entire record.
This new logic primarily impacts tags, file labels, collections, and multi-select custom metadata fields.
Explore data.world's rich advanced search syntax with the Search Builder tool on our main search page. This friendly form helps you construct more complex searches with multiple filters, logical operators, categories, and custom metadata fields. The Search Builder can be accessed by selecting the "Advanced" option above the filters list on the main search page.
This release also includes changes to our main search page. You'll notice a new layout on the All Results tab that shows the top 3 search hits by type for your term. This tab now shows more results per page and gives users a high level overview of the types of resources they can find on the platform. Hover over the circular "i" icon for more details about the result. More targeted results can be viewed on the Resources tab. You'll also notice changes to the category tabs at the top of the page. Resources, Organizations & People, Comments, and Columns each have their own tailored search experience.
The new search experience is available today for select users and will be available for all users early next week.
We're happy to announce the beta release of our new Postgres Proxy support. Our goal is to allow any BI and data science tools which support PostgreSQL, to connect to directly with data.world. No 3rd party integration support required!
data.world provides a federated engine to query data from multiple data systems simultaneously, at the source. By using Postgres Proxy, it’s now easier than ever to extend these capabilities to your favorite analysis tools for quickly accessing and creating value from data.
To connect to data.world using the proxy, simply create a new PostgreSQL connection, configured as follows:
host: postgres.data.world
port: 5432
user: {your data.world user id}
pass: {read/write token}
db: agentid/datasetid
You can find your read/write token in the user settings. If you have any issues or questions, don't hesitate to reach out.
Note: for single tenant customers, set host to postgres.{site}.data.world
.
In August, we plan to release a series of improvements to our search page including:
We're investing in navigation enhancements across the site for community and enterprise users. This week, we plan to roll out a beta breadcrumbs feature to help you get back to your list views from your resource pages. This first beta release will include easy access to your organization page from metadata catalog resources, quick filters to navigate back to similar items in your catalog, and basic hierarchical navigation for things like tables and columns. Additional hierarchical navigation support is planned for the coming months.
Recently announced in a coming soon post, the new resource type search filter is now available on the search page for all users of the platform. This filter allows users to drill down to any supported resource type, including custom configured catalog types.
We're thrilled to announce the release of our brand new documentation portal. We've remastered all our platform documentation content to make it easier to read, search, and navigate. You can now get all the answers you need in just one place!
These are some of the improvements and new navigation experiences you'll see in our new portal:
- Home page menus
Use the top menus to navigate the documentation for specific product versions: Community docs for data.world community members and Enterprise docs, specifically written for our enterprise customers who have needs and use cases outside of the scope of our community users.
- Search improvements
Search is one of the most important ways to find the information you need. So we’ve introduced a new search experience. When you enter a query, you’ll immediately see some suggestions.
- Easier access to everything you need
Easy access to integrations gallery, API docs, and Grafo documentation.
Check it out at https://docs.data.world/.
Next week, we will be releasing an update to the Search UI to include a new standard filter for Resource Type. This has been a much requested filter option to help users drill down into the specific resource types returned from search. This filter includes our common types like datasets, projects, and queries as well as custom types that are configured for your organization's catalog.
This change will also update the presentation order of the search filters as:
1. Resource Type
2. Owner
3. Status
4. Tag
5. Collection
6... Custom configured facets
Our metadata collector (dwcc, aka the data.world Catalog Collector) is now available on DockerHub! Simply run docker pull datadotworld/dwcc:x.xx
where x.xx is your desired version, and you're in business. It's that easy.
Other enhancements to the metadata collector:
--config-file
option for metadata collector (Beta): We've heard your feedback on wanting a simplified way to manage the configurations for your metadata collectors. The config file will become the default way in the near future to set your parameters going forward. Lots more info on this coming soon!