RO-Crate Metadata Harvesting Toolkit

Although OAI-PMH is a well-established protocol for collecting large volumes of metadata records from data providers, it works only with a limited set of metadata schemas, and it is mostly used with oai_dc, a variant of Dublin Core. With the progress towards FAIR data and RO-Crate, the scientific world moves towards multiple, dynamically changing metadata schemas. For this reason, we have built a harvesting tool strongly coupled with a schema registry, capable of converting RO-Crate and other metadata into RDF triples.

With this Metadata Harvesting Toolkit, we collect metadata via OAI-PMH or custom API calls, where the links to schema descriptions are extracted from the harvested metadata, then these schemas are downloaded and converted from JSON to RDF, and finally all schemas and metadata become available as RDF for further exploitation, such as graph building.

Sample output: https://search.researchdata.hu/schemas