Cynthia US Department of Agriculture National Agricultural Library 30 September 2015 Ag Data Commons Adding value to open agricultural research data

Federal directives: Public access to open, machine-readable data

The problems in agricultural data Broad subject areas Journals not integrated with repositories like Dryad Too many existing databases & web distribution points Lack of infrastructure for long-tail data Lack of a neutral, sustainable solution for long- term multi-institutional projects 3

Supports Public Access mandates Holds agricultural research data Primary audience: researchers Holds metadata for data held elsewhere Starting with USDA data but will broaden Both human and machine access Can include unpublished data that is ready for release Ag Data Commons Prototyping FY 2015 A proposed solution

Search & Knowledge Discovery Thesaurus & Indexing Thesaurus & Indexing Ag Data Commons Repository Ag Data Commons Repository Organization & Curation Grant management systems INGESTIONDISSEMINATION PubAg Dataset Submissio n Dataset Submissio n Analytics & Tools Data.gov Ag Data Commons Catalog Legend Building Adapting Existing Legend Building Adapting Existing Distributed repositories Forest Service Geospatial

Adding value 6 Metadata + data package DOI Links Thesaurus tags Idiosyncratic data dictionary Search, services, compliance checking

DKAN PRO Open source community Drupal modules for basic CMS functions Integrated CKAN catalog Feeds Data.gov Basic metadata already supported CON Not designed for scientific data or scientists No links to literature No Digital Object Identifiers Doesn’t handle dataset relationships Metadata inadequate for compliance checking & re-use 7

Metadata Standards Core Metadata Schema POD 1.1 (Project Open Data) Related Scientific Metadata & Data Standards (e.g.) ISO (GIS Data, FGDC) Darwin Core (Biodiversity standards) EML (Ecological Metadata Language) MiXS GSC (Genomic Standards Consortium)

Controlled Vocabularies NALT – National Agricultural Library Thesaurus  GACS Global Agricultural Concept Scheme Taxonomy Gene Ontology (GO) ENVO, ecological, economic, etc. Relevant for Agriculture Help create a semantic web SKOS (Simple Knowledge Organization System): W3C recommendation, or RDF Credit: AIMS--FAO

Launching next week

Adding even more value 12 Structured methods metadata Shared data dictionary Semantic data dictionary

Adding even more value 13 Assist application launch Find related data Integrate/link related data = help build the knowledge graph

Acknowledgements Susan McCarthy, NAL – KSD Ursula Pieper, NAL – ISD Qing Qu, NAL – KSD contractor Jeff Campbell – NAL – KSD Jaylen Nathwani, NAL – student intern NüCivic, Angry Cactus Team Jocelyn McNamara -- NAL – KSD contractor Kerry Huller – UMD graduate fellow Erin Antognoli – UMD graduate fellow