Repository navigation
Request for comment: Metadata enrichments in practice #236
Replies: 2 comments 2 replies
|
(For credit's sake, I wrote this in collaboration with my colleague John Aspler who is not on GitHub) This is very exciting -- I see a lot of potential in this work (in particular having so many new ROR affiliations in place could make a big difference to Canadian data discovery in Lunaris). That said, to use these enrichments, I need to be able to systematically access the ones that are relevant to my use case, and ideally I would have some way to assess their correctness. As far as I can tell, using the DataCite API to query across the content of these enrichments is somewhere between fiddly and impossible right now (short of working with the datasets COMET has published on Hugging Face). On the one hand, it would be nice to have the Ideally, there would be a pathway for enrichments to be applied to original/canonical DOIs when they are correct, but I am not sure if there is a practical model for making those assessments or involving DOI stewards in that decision making. A clear vision for how metadata stewards, metadata consumers, and related infrastructure providers (e.g. ORCID) are meant to use these enrichments in practice would be very helpful! Finally, I'm curious if these enrichments are intended to always come from relatively trusted projects (presumably DataCite was involved or at least reviewed the COMET projects before deploying the enrichments). Will community projects be possible? Will there be mechanisms in place to control who can submit what kinds of enrichments - or to indicate the source of an enrichment? What role might LLM-powered systems play? |
|
Responsive to community feedback, we've continued to iterate on metadata enrichment services:
We continue to welcome community feedback on metadata enrichment as we work to improve the quality and utility of the DataCite metadata store and enhance discovery, reuse, and reporting across the research ecosystem. Reply to the linked release notes, start a new discussion, or reach out to support@datacite.org for support with metadata enrichment or other DataCite services. Many thanks to all who have contributed already, and we look forward to continuing the discussion! |
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
DataCite is developing community-driven DOI metadata enrichment processes as part of an ongoing, multi-faceted effort to improve the quality and utility of the DataCite metadata store and enhance discovery, reuse, and reporting across the research ecosystem. You can learn more about our previous explorations in this space, including our high-level goals and priorities, in our earlier request for comment. Below, we share our latest work on enrichments and invite ongoing community feedback as we continue to iterate on our approach.
Sharing an initial set of enrichments
We are excited to release our first set of enrichment records produced through a collaboration with COMET (Collaborative Metadata) and available at a new enrichments endpoint of the DataCite REST API: https://api.datacite.org/enrichments. At this time, we have ingested 26.9 million enrichment records derived from two COMET enrichment projects. The first project maps affiliation strings to Research Organization Registry (ROR) identifiers, establishing 26.1 million new connections between creators/contributors and ROR ID affiliations. The second links arXiv preprints to their published versions, creating 855,764 new connections between previously unlinked resources. In combination, these two projects enrich over 6.3 million unique DOI records.
Each individual enrichment record includes provenance metadata connecting the record to both its contributors and the resources that the enrichment was derived from, such as project documentation and related datasets. You can learn more about our approach to provenance and the overall structure of enrichment records in our previous request for comment.
REST API tools are also available for exploring enrichments by DataCite repository and by DOI. Retrieve enrichments for a specific repository’s DOIs by entering a Repository ID in the
client-id=parameter of the enrichments endpoint, e.g., https://api.datacite.org/enrichments?client-id=arxiv.content. Explore enrichments for a specific DOI by entering the DOI name in thedoi=parameter of the enrichments endpoint, e.g., https://api.datacite.org/enrichments?doi=10.60692/44wdx-8kd18.Previewing enriched DataCite DOI records
Enrichment records act as a non-destructive layer over original DOI records. When combined with original DOI records, they can be used to generate separate, enriched DOI records. We’re excited to share a preview of enriched DOI metadata records, enhanced with the ingested enrichments described above.
Enriched DOI metadata records can be accessed with a new
enriched=trueflag in the REST API for single DOI records with associated enrichments. For example, try: https://api.datacite.org/dois/10.60692/44wdx-8kd18?affiliation=true&publisher=true&enriched=true. This DOI (10.60692/44wdx-8kd18) has 60 associated enrichment records, each listed in therelationshipssection of the API response. Whenenriched=true, the associated enrichment records are applied non-destructively to the original record, producing an enriched DOI record with 67 affiliation connections to ROR IDs where there were none originally. The original DOI metadata record is stored separately from the enriched record and can always be accessed by omitting theenriched=trueparameter; e.g., https://api.datacite.org/dois/10.60692/44wdx-8kd18?affiliation=true&publisher=true.The process of applying enrichment records is responsive to changes in the original record and prioritizes metadata validity. For example, enrichment records are not applied if targeted metadata fields are changed by the original depositor, and the original DOI record is displayed in place of the enriched record if the enriched record is in any way invalid according to the DataCite Metadata Schema.
Tip
Learn more about working with these initial metadata enrichment features in our Support documentation: https://support.datacite.org/docs/metadata-enrichments
Next steps
We are collecting community feedback as we expand our work on enrichments and explore enrichment curation tools and workflows for the metadata creator community. We invite you to share input via our new enrichments survey, by responding to this post, or by sending us an email at support@datacite.org. Input is welcome any time, and we will continue to keep this discussion updated as we continue development. Thank you for participating!
All reactions