Data Management Planning Session Kevin Gomes Michael Meisinger Arcot Rajasekar Michael Wan October 19, 2007.

Slides:

Advertisements

Similar presentations

Data Publishing Service Indiana University Stacy Kowalczyk April 9, 2010.

Advertisements

National Partnership for Advanced Computational Infrastructure San Diego Supercomputer Center Data Grids for Collection Federation Reagan W. Moore University.

GFS OGF-22 Global Resource Naming Developers: Reagan Moore Arcot Mike.

OGF-23 iRODS Metadata Grid File System Reagan Moore San Diego Supercomputer Center.

1 NASA CEOP Status & Demo CEOS WGISS-25 Sanya, China February 27, 2008 Yonsook Enloe.

Breakout Group 3: Distribution, Replication and Interfacing with Specialized Repositories.

DuraSpace: Digital Information All Ways, Always Pretoria, South Africa May 14 th, 2009.

NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE SAN DIEGO SUPERCOMPUTER CENTER Particle Physics Data Grid PPDG Data Handling System Reagan.

Components of a Dynamics Ecommerce Solution The Situation Today for Many Organizations Retail Headquarters Financials Warehouse Management Stores.

Brief Overview of Major Enhancements to PAWN. Producer – Archive Workflow Network (PAWN) Distributed and secure ingestion of digital objects into the.

UMIACS PAWN, LPE, and GRASP data grids Mike Smorul.

Web Content Management Using the OASIS ebXML Registry Standard Farrukh Najmi XML Standards Architect Sun Microsystems

Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.

Metadata: Its Functions in Knowledge Representation for Digital Collections 1 Summary.

Context and Prosopography: Putting the 'Archives' Into LOD-LAM Corey A Harper SAA MDOR

National Partnership for Advanced Computational Infrastructure Digital Library Architecture Reagan Moore Chaitan Baru Amarnath Gupta George Kremenek Bertram.

Bringing it All Together: NODC’s Geoportal Server as an Integration Tool for Interoperable Data Services Kenneth S. Casey, Ph.D. YuanJie Li NOAA National.

OASIS ebXML Registry Standard Open Forum 2003 on Metadata Registries 10:30 – 11:15 January 20, 2003 Kathryn Breininger The Boeing Company Chair, OASIS.

Fedora Commons Overview and Future Plans Sandy Payette, Executive Director Cornell University Library Metadata Working Group June 13, 2008.

Rule-Based Data Management Systems Reagan W. Moore Wayne Schroeder Mike Wan Arcot Rajasekar {moore, schroede, mwan, {moore, schroede, mwan,

Cyberinfrastructure - Collaborative Portal for the IOOS Super-Regional Modeling Testbed Sara Graves, Manil Maskey, Ken Keiser Information Technology &

Production Data Grids SRB - iRODS Storage Resource Broker Reagan W. Moore

19/10/20151 Semantic WEB Scientific Data Integration Vladimir Serebryakov Computing Centre of the Russian Academy of Science Proposal: SkTech.RC/IT/Madnick.

ASI-Eumetsat Meeting Matera, 4-5 Feb CNM Context Matera, February 4-5, 20092ASI-Eumetsat Meeting.

1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.

Ocean Observatories Initiative Data Management (DM) Subsystem Overview Michael Meisinger September 29, 2009.

{Fez} a Hatrack for your Metadata Sam Wilson & Nathan Denny HUBbub – Sep. 30, 2014.

San Diego Supercomputer Center National Partnership for Advanced Computational Infrastructure SRB + Web Services = Datagrid Management System (DGMS) Arcot.

Rule-Based Preservation Systems Reagan W. Moore Wayne Schroeder Mike Wan Arcot Rajasekar Richard Marciano {moore, schroede, mwan, sekar,

National Partnership for Advanced Computational Infrastructure San Diego Supercomputer Center Persistent Management of Distributed Data Reagan W. Moore.

SRB 1 & iRODS 2 Arcot Rajasekar Reagan Moore Mike Wan SDSC/UCSD Pathways to OOI-CI CyberData Architecture 1 Storage Resource Broker 2 integrated Rule Oriented.

Antoine Isaac 1 st PRELIDA Workshop Pisa, June 26, 2013.

OOI CyberInfrastructure: Data Management Architecture Specification Workshop June 30-July 1, 2008 Matthew Arrott, Ingolf Krueger, Claudiu Farcas, Emilia.

Kevin Gomes and John Graybeal, MBARI MBARI’s SSDS OOI Cyberinfrastructure: San Diego June 30, 2008.

PRACE-2IP WP10 - iRODS workshop iRODS CINES Gerard GIL (CINES) – (Linkoping September 2012)

Technical Update 2008 Sandy Payette, Executive Director Eddie Shin, Senior Developer April 3, 2008 Open Repositories 2008, Fedora User Group.

Create Content Capture Content Review Content Edit Content Version Content Version Content Translate Content Translate Content Format Content Transform.

Ocean Observatories Initiative OOI Cyberinfrastructure Data Management Michael Meisinger & David Stuebe OOI Cyberinfrastructure Life Cycle Objectives Milestone.

1 Registry Services Overview J. Steven Hughes (Deputy Chair) Principal Computer Scientist NASA/JPL 17 December 2015.

SEEK Science Environment for Ecological Knowledge l EcoGrid l Ecological, biodiversity and environmental data l Computational access l Standardized, open.

System/SDWG Update Management Council Face-to-Face Flagstaff, AZ August 22-23, 2011 Sean Hardman.

Collaborative Portal for the IOOS Super-Regional Modeling Testbed Sara Graves, Manil Maskey, Ken Keiser Information Technology & Systems Center University.

Kevin Gomes, MBARI MBARI Data Architecture OOI Cyberinfrastructure: Data Product Generation Workshop San Diego May 20-21, 2008.

OOI Cyberinfrastructure and Semantics OOI CI Architecture & Design Team UCSD/Calit2 Ocean Observing Systems Semantic Interoperability Workshop, November.

EGI-Engage Data Services and Solutions Part 1: Data in the Grid Vincenzo Spinoso EGI.eu/INFN Data Services.

National Archives and Records Administration1 Integrated Rules Ordered Data System (“IRODS”) Technology Research: Digital Preservation Technology in a.

Renovation of Eurostat dissemination chain

OASIS ebXML Registry Standard Open Forum 2003 on Metadata Registries 10:30 – 11:15 January 20, 2003 Kathryn Breininger The Boeing Company Chair, OASIS.

Rights Management for Shared Collections Storage Resource Broker Reagan W. Moore

Repository for Archiving, Managing and Accessing Diverse DAta Thiru.

LEAD Project Discussion Presented by: Emma Buneci for CPS 296.2: Self-Managing Systems Source for many slides: Kelvin Droegemeier, Year 2 site visit presentation.

EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI OpenSource GeoSpatial Catalogue Platform-as-a-Service Salvatore Pinto Cloud.

Collection-Based Persistent Archives Arcot Rajasekar, Richard Marciano, Reagan Moore San Diego Supercomputer Center Presented by: Preetham A Gowda.

Preservation Data Services Persistent Archive Research Group Reagan W. Moore October 1, 2003.

International Planetary Data Alliance Registry Project Update September 16, 2011.

The Earth System Curator Metadata Infrastructure for Climate Modeling Rocky Dunlap Georgia Tech.

Data Grids, Digital Libraries and Persistent Archives: An Integrated Approach to Publishing, Sharing and Archiving Data. Written By: R. Moore, A. Rajasekar,

Vincenzo Spinoso EGI.eu/INFN

An Overview of Data-PASS Shared Catalog

Collection Based Persistent Archives

Policy-Based Data Management integrated Rule Oriented Data System

Integrating Data for Archaeology

Overview: Fedora Architecture and Software Features

Flexible Extensible Digital Object Repository Architecture

Flexible Extensible Digital Object Repository Architecture

VI-SEEM Data Repository

Data catalogues and the data repository ADMIRe JISC MRD

Arcot Rajasekar Michael Wan Reagan Moore (sekar, mwan,

HAO/SCD: VO, metadata, catalogs, ontologies, querying

Presentation transcript:

Data Management Planning Session Kevin Gomes Michael Meisinger Arcot Rajasekar Michael Wan October 19, 2007

Data Network Federation and Preservation of data and metadata via data streams, repositories and catalogs Two Co-operating/Complimentary Systems SSDS iRODS

List of Services Online Data Repository –Data and Metadata Persistent Archive Service –Cataloging,Preservation & Curation Asset Validation Service –Integrity and Authenticity Aggregation Service –Classification, Categorization, Grouping Attribution Service –Associate Attributes, Semantic Ontology Metadata Search & Navigation Services –Query & Browse by context Dynamic Data Distribution Services –Publish, Subscribe and Query for dynamic data resources Data Access Services –Suite of External Interfaces – OPeNDAP, THREDDS, LAS,…

Release 1 Services for Data Repository, Archive, Dynamic Data Distribution iRODS Resource: Archives, Unix File Systems API: Ingest/Access, Register, Metadata Form: Hierarchical (POSIX) Access: C,Java,PHP Protocol: Native Bin/XML Metadata Extraction: Link DataProcessing/Extraction Micro- Services, Rules Replication: supported Metadata Catalog: RDB System: Owner,ACL,Chksum,Audit,… User defined: KVU-Triplets SSDS Resource: RDB (File System for Backup) API: Ingest/Access, Register, Metadata Form: URI Access: Java,REST, WS Protocol: HTTP Metadata Extraction: API/XML and Services Replication: not supported Metadata Catalog: RDB System Ownership,provenance) User-defined: No

Main Components File Ingest Stream Ingest MD Extraction and Storage MD API for Input and Output Data Access Search/Navigation

Data Ingest/Access SSDS DP DataStreams File HTTP Ingest RDB BkUp WAN Registration File RDB DATA META DATA API HTTP/REST JMS URI ESB

Data Ingest iRODS DP File Register APIAPI Put Posix Web File System RDB APIAPI Get Web OPeNDAP THREDDS LAS DataStreams Distributed/ Replicated ESB SSDS WS HDF

iRODS/SSDS Services

Data Ingest