Data Discovery Boulder, CO May 15, 2006 Scott Ritz

Slides:

Advertisements

Similar presentations

Putting the Pieces Together Grace Agnew Slide User Description Rights Holder Authentication Rights Video Object Permission Administration.

Advertisements

Technical Highlights 25th August 2011 Sebastian Peters German National Library of Science and Technology.

Schedule of Releases (since Tromso meeting) and New Access Interfaces.

1 NASA CEOP Status & Demo CEOS WGISS-25 Sanya, China February 27, 2008 Yonsook Enloe.

Planned Title: Review of Evaluation of Geospatial Search Allan Doyle.

Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.

Metadata (for the data users downstream) RFC GIS Workshop July 2007 NOAA/NESDIS/NGDC Documentation.

Edging Toward Interoperability Mélanie F. Meaux GO-ESSP: June 6-8, 2005 The Global Change Master Directory: A Directory of Earth Science Data & Earth.

Connecting to Ensemble: AlgoViz. AlgoViz Community  Sharing educational resources Visualizations for data structure and algorithms  Sharing experience.

Status of the Antarctic Master Directory SCADM Meeting, August 22, 2014.

GCMD/IDN STATUS AND PLANS Stephen Wharton CWIC Meeting February19, 2015.

Guten Tag Michael Morahan CEOS-WGISS 29 May 17-21, 2010 Bonn, Germany.

Indo-US Workshop, June23-25, 2003 Building Digital Libraries for Communities using Kepler Framework M. Zubair Old Dominion University.

19/10/20151 Semantic WEB Scientific Data Integration Vladimir Serebryakov Computing Centre of the Russian Academy of Science Proposal: SkTech.RC/IT/Madnick.

1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.

ILDG Middleware Status Chip Watson ILDG-6 Workshop May 12, 2005.

Design of a Search Engine for Metadata Search Based on Metalogy Ing-Xiang Chen, Che-Min Chen,and Cheng-Zen Yang Dept. of Computer Engineering and Science.

Introduction to Web Services Eric Lease Morgan University Libraries of Notre Dame June 24, 2005.

International Directory Network (IDN) Scalability, Security and Interoperability WGISS, 2006 Tom Northcutt Systems Administrator: GCMD September 13, 2006.

WDC-MARE – World Data Center for Marine Environmental Sciences Data portal based on Open Archives Initiative Protocols and Apache Lucene Uwe Schindler,

Metadata harvesting in regional digital libraries in PIONIER Network Cezary Mazurek, Maciej Stroiński, Marcin Werla, Jan Węglarz.

TPAC Tasmanian Partnership for Advanced Computing Partner in APAC (Australian Partnership for Advanced Computing) Expertise centre for Earth Systems Science.

Recent developments with the THREDDS Data Server (TDS) and related Tools: covering TDS, NCML, WCS, forecast aggregation and not including stuff covered.

Using the Global Change Master Directory (GCMD) to Promote and Discover ESIP Data, Services, and Climate Visualizations Presented by GCMD Staff January.

Web Portal Design Workshop, Boulder (CO), Jan 2003 Luca Cinquini (NCAR, ESG) The ESG and NCAR Web Portals Luca Cinquini NCAR, ESG Outline: 1.ESG Data Services.

OAI Overview DLESE OAI Workshop April 29-30, 2002 John Weatherley

ICalendar Compatible Collaborative Calendar- Server (CCS) Web Services Ahmet Fatih Mustacoglu Indiana University Computer Science Department Community.

Mercury – A Service Oriented Web-based system for finding and retrieving Biogeochemical, Ecological and other land- based data National Aeronautics and.

Registering Earth Science Data and Data Related Services Using NASA’s Global Change Master Directory (GCMD) Tyler Stevens (GIS/Services Coordinator) ESIP.

Metadata and OAI DLESE OAI Workshop April 29-30, 2002 Katy Ginger Presentation available at:

Hussein Suleman University of Cape Town Department of Computer Science Digital Libraries Laboratory February 2008 Data Curation Repositories:

1 Registry Services Overview J. Steven Hughes (Deputy Chair) Principal Computer Scientist NASA/JPL 17 December 2015.

Metadata and OAI DLESE OAI Workshop June 29 to July 2, 2002 Katy Ginger Presentation available at:

GEOSS Global Earth Observation System of Systems.

The Open Archives Initiative Marshall Breeding Director for Innovative Technologies and Research Vanderbilt University

, GCMD: DIF to ISO Translation and CSW Support Scott Ritz WYLE Information Systems NASA Global Change Master Directory Science Team Leader

H. Widmann (M&D) Data Discovery and Processing within C3Grid GO-ESSP/LLNL / June, 19 th 2006 / 1 Data Discovery and Basic Processing within the German.

The Research Data Archive at NCAR: A System Designed to Handle Diverse Datasets Bob Dattore and Steven Worley National Center for Atmospheric Research.

The Proliferation of Metadata Standards and the Evolution of NASA’s Global Change Master Directory (GCMD) Standard for Uses in Earth Science Data Discovery.

NSDL STEM Exchange: Technical Overview and Implications for Active Dissemination of Federally Funded Resources Across Implementation Systems.

Global Change Master Directory (GCMD) Mission “To assist the scientific community in the discovery of Earth science data, related services, and ancillary.

2/22/2016J Ammerman1 Open Archives Initiative What is it? What’s it good for?

1 CS 430: Information Discovery Lecture 26 Architecture of Information Retrieval Systems 1.

Introduction What purpose does a data archive center serve if users can’t find or access the holdings they might need to facilitate their research discoveries?

Grid Services for Digital Archive Tao-Sheng Chen Academia Sinica Computing Centre

1 Lola M. Olsen CEOS IDN Task Team Lead Technology and Services Subgroup Challenges/Actions for the IDN May 2006.

TRIG: Truckee River Info Gateway Dave Waetjen Graduate Student in Geography Information Center for the Environement (ICE) University of California, Davis.

Java Web Services Orca Knowledge Center – Web Service key concepts.

Software & Technologies: an overview

GeoNetwork OpenSource: Geographic data sharing for everyone

Michael Morahan CEOS WGISS-43 Meeting

Tyler Stevens GIS/Services Coordinator

The GCW Data Portal Status and next steps Øystein Godøy

Session 3A: Catalog Services and Metadata Models

CAP-378 and “Conhecer para não ignorar”

Donna J. Scott, Julia Collins, Peter Pulsifer

Middleware independent Information Service

Common Framework for Earth Observation Data

Distributed Marine Data System:

HydroDesktop: A Key Component of the CUAHSI/CZO HIS for Hydrologic Data Discovery, Visualization, and Analysis Daniel P. Ames, Ph.D. P.E. Idaho State University.

OAI and Metadata Harvesting

WGISS Connected Data Assets April 9, 2018 Yonsook Enloe

NASA's Earth Science Gateway ESIP Meeting at College Park, Nov

WGISS Connected Data Assets Oct 24, 2018 Yonsook Enloe

HAO/SCD: VO, metadata, catalogs, ontologies, querying

The Fedora Project April 28-29, 2003 CNI, Washington DC

Web Servers (IIS and Apache)

How to Implement an Institutional Repository: Part II

Robert Dattore and Steven Worley

Presentation transcript:

Data Discovery Boulder, CO May 15, 2006 Scott Ritz Atmospheric Science Coordinator NASA Global Change Master Directory

Outline OAI-PMH (Open Archives Initiative Protocol for Metadata Harvesting) Mapserver Open API (Application Program Interface) SOAP Portals DIF Format

Computer running harvester software OAI-PMH Architecture OAI-PMH Repository Computer running harvester software Why OAI-PMH? OAI Server independent of main database Administrator controls metadata availability Queries standardized Software is open source Metadata Compatibility Dublin Core, FGDC, DIF, ISO-19115 XSLT or XML Schema II. Harvesting Process Metadata subset transferred from a database to a repository Metadata is harvested from the repository I. Database

Harvest THREDDS Metadata using OAI/PMH DLESE OAI/PMH Harvester 2. Monitor Harvest Status 3. Upload XML to a database 1. Automatic/Manual Harvest

Harvest THREDDS Metadata using OAI/PMH 4. View harvested metadata in the GCMD Titles Display DIF Display Access THREDDS Data

Access mapserver through GCMD GIS Server Portal or directly from mapserver.

Prototype Mapserver Interoperability Access GCMD’s Web Mapping Service (WMS) through an OGC WMS GET Capabilities Request. OGC WMS compatible clients can access GCMD’s map services. User Friendly Desktop Internet GIS (WMS Client) GCMD Mapserver

Open API DODS/OPeNDAP uses the GCMD open API and servlets to query the GCMD directly The “Search” frame provides interfaces to the GCMD’s MDServer through APIs HTTP Protocol

SOAP Initiative Initial SOAP Server and Client were created by Viktor Pusztai. Documentation, JUnit tests, and Web GUI to test the Client were later added. Future: Modify to follow security standards for web services (ex. user authentication, encrypted passwords ) Modify to offer different web services to serve specific needs. (ex. MetadataWebService, ValidsWebService, ServicesWebService, SubscriptionWebService, MetricsWebService, etc.)

Operations Available in Current Server Valid Operations getValids getPersonnel createValid removeValid Document Operations createDocument getDocument getDocumentList removeDocument convertDocument validateDocument Access valids or request documents from the database

Operations Available in Current Server Personnel Operations createPerson findPerson getClosePersons getPersons mergePerson removePerson Other Operations getCoordList getDateTime getDocumentList getNodeName getWebServerName getWebServerPort isAlive supportsSERF

Portals

Portals

DIF/SERF

Questions? ritz@gcmd.nasa.gov 301-867-2082