Please Describe Data ingestion. This includes support for real-time sensor data (object ring buffers) as well as simulation output (grid portals) –We have.

Slides:



Advertisements
Similar presentations
Adding OAI-ORE Support to Repository Platforms Alexey Maslov, Adam Mikeal, Scott Phillips, John Leggett, Mark McFarland Texas Digital Library TCDL09.
Advertisements

Putting the Pieces Together Grace Agnew Slide User Description Rights Holder Authentication Rights Video Object Permission Administration.
Panel 2 – Promoting Re-Use of Scientific Collections John Harrison SHAMAN Project University of Liverpool
National Partnership for Advanced Computational Infrastructure San Diego Supercomputer Center Data Grids for Collection Federation Reagan W. Moore University.
Using the Collaborative Tools in NEESgrid Charles Severance University of Michigan.
Goals for RUcore o Flexible, extensible cyberinfrastructure for Rutgers University o Integrating platform for legacy information systems o Support preservation.
This product includes material developed by the Globus Project ( Introduction to Grid Services and GT3.
DSpace Devika P. Madalli DRTC, ISI Bangalore.
Future Software Architectures Combining the Web 2.0 with the Semantic Web to realize future Web Communities Maarten Visser
Metadata: An Introduction By Wendy Duff October 13, 2001 ECURE.
Question n How will interoperability with other repositories be addressed, given that many other repositories are using a common tool suite (OWL, RDF,
Data Grids: Globus vs SRB. Maturity SRB  Older code base  Widely accepted across multiple communities  Core components are tightly integrated Globus.
1 CS 502: Computing Methods for Digital Libraries Lecture 22 Repositories.
Robust Tools for Archiving and Preserving Digital Data Joseph JaJa, Mike Smorul, and Mike McGann Institute for Advanced Computer Studies Department of.
NEES Grid Data Overview Comments to Charles Severance
NEESGrid Data and MetaData Technology Kincho Law, Jun Peng, Jim Eng, Terry Weymouth, Paul Hubbard, Charles Severance.
Grace Agnew, Rutgers University Libraries1 Personalized; consumer-driven information culture Highly competitive Increasingly cooperative Continuously innovative.
NEESgrid Data Technologies Charles Severance January 8, 2004 NSF Site Visit.
Metadata: Its Functions in Knowledge Representation for Digital Collections 1 Summary.
SCIENCE-DRIVEN INFORMATICS FOR PCORI PPRN Kristen Anton UNC Chapel Hill/ White River Computing Dan Crichton White River Computing February 3, 2014.
METS-Based Cataloging Toolkit for Digital Library Management System Dong, Li Tsinghua University Library
Managing the Record of Research At the Smithsonian Using SIdora SAA Research Forum August 12, 2014.
San Diego Supercomputer CenterUniversity of California, San Diego Preservation Research Roadmap Reagan W. Moore San Diego Supercomputer Center
The Semantic Web Service Shuying Wang Outline Semantic Web vision Core technologies XML, RDF, Ontology, Agent… Web services DAML-S.
The Metadata Object Description Schema (MODS) NISO Metadata Workshop May 20, 2004 Rebecca Guenther Network Development and MARC Standards Office Library.
A centre of expertise in digital information management The MEG Metadata Schemas Registry Pete Johnston, Research Officer (Interoperability),
“Interoperability”??? Opportunities for Applied Research on the Creation, Management, Preservation and Use of Digital Content IMLS Washington, DC March.
JENN RILEY METADATA LIBRARIAN IU DIGITAL LIBRARY PROGRAM Introduction to Metadata.
Lifecycle Metadata for Digital Objects (INF 389K) September 18, 2006 The Big Metadata Picture, Web Access, and the W3C Context.
Extensible Markup Language (XML) Extensible Markup Language (XML) is a simple, very flexible text format derived from SGML (ISO 8879).ISO 8879 XML is a.
Data Management Practices for Early Career Scientists: Closing Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN.
File format registries - a global infrastructure for local persistence Andreas Aschenbrenner, ERPANET.
1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.
Libraries, Archives, and Digital Preservation: The Reality of What We Must Do Leslie Johnston Acting Director, National Digital Information Infrastructure.
Ocean Observatories Initiative Data Management (DM) Subsystem Overview Michael Meisinger September 29, 2009.
METADATA WORKSHOP Conclusions Keith Jeffery Peter Wittenburg.
Metadata Semantic Web Solutions: Web 2.0 and beyond ______________________________ Stephanie Beene, 10/14/2008.
National Partnership for Advanced Computational Infrastructure San Diego Supercomputer Center Persistent Management of Distributed Data Reagan W. Moore.
Jan 9, 2004 Symposium on Best Practice LSA, Boston, MA 1 Comparability of language data and analysis Using an ontology for linguistics Scott Farrar, U.
W HAT IS I NTEROPERABILITY ? ( AND HOW DO WE MEASURE IT ?) INSPIRE Conference 2011 Edinburgh, UK.
Presented by Scientific Annotation Middleware Software infrastructure to support rich scientific records and the processes that produce them Jens Schwidder.
Digital library infrastructure -- systems Repositories for storing digital resources protect, manage, deliver, and preserve digital resources over time.
Introduction to Metadata Jenn Riley Metadata Librarian IU Digital Library Program.
Presented by Jens Schwidder Tara D. Gibson James D. Myers Computing & Computational Sciences Directorate Oak Ridge National Laboratory Scientific Annotation.
A Practical Approach to Metadata Management Mark Jessop Prof. Jim Austin University of York.
WG2 – Enabling Technologies Status of white paper Olaf Droegehorn, Klaus David University of Kassel Chair for Communication Technology (ComTec)
Metadata “Data about data” Describes various aspects of a digital file or group of files Identifies the parts of a digital object and documents their content,
1 Registry Services Overview J. Steven Hughes (Deputy Chair) Principal Computer Scientist NASA/JPL 17 December 2015.
Replica Management Kelly Clynes. Agenda Grid Computing Globus Toolkit What is Replica Management Replica Management in Globus Replica Management Catalog.
WSDL – Web Service Definition Language  WSDL is used to describe, locate and define Web services.  A web service is described by: message format simple.
A centre of expertise in digital information management Shaping the e-future? Grids, Web Services and Digital Libraries Professor Tony.
Sharing Digital Scores: Will the Open Archives Initiative Protocol for Metadata Harvesting Provide the Key? Constance Mayer, Harvard University Peter Munstedt,
Steven Perry Dave Vieglais. W a s a b i Web Applications for the Semantic Architecture of Biodiversity Informatics Overview WASABI is a framework for.
Fedora Metadata The Basics 9/9/2008. Mini Glossary Fedora: ‘ Flexible Extensible Digital Repository Object Architecture;’ asset repository, metadata architecture.
Differences and distinctions: metadata types and their uses Stephen Winch Information Architecture Officer, SLIC.
Preservation Data Services Persistent Archive Research Group Reagan W. Moore October 1, 2003.
EarthCube Integrative Activities: Cross-Domain Observational Metadata Environmental Sensing Network (X-DOMES) September 2015 – August 2017 Focusing on.
The Earth System Curator Metadata Infrastructure for Climate Modeling Rocky Dunlap Georgia Tech.
A Semi-Automated Digital Preservation System based on Semantic Web Services Jane Hunter Sharmin Choudhury DSTC PTY LTD, Brisbane, Australia Slides by Ananta.
Packaging Specification Package Ingest Service
DataNet Collaboration
Lecture #11: Ontology Engineering Dr. Bhavani Thuraisingham
Web Ontology Language for Service (OWL-S)
Introduction to Metadata
Outline Pursue Interoperability: Digital Libraries
Fedora Metadata The Basics 9/9/2008.
PRESERV PReservation Eprint SERVices
Metadata in Digital Preservation: Setting the Scene
Institutional Repositories
Presentation transcript:

Please Describe Data ingestion. This includes support for real-time sensor data (object ring buffers) as well as simulation output (grid portals) –We have our own data streaming protocols (NSDS) which is “our” ring buffer - Looking at Data Turbine (RBNB) –We have an Ingestion tool which uses JAVA APIs, Grid Web Services, and GridFTP to move data into and out of the repository Data collections. This is the standards for organizing data and applying semantic labels Data grids. This is the technology used to share data across administrative domains. –We support data collections - in our own way - Collections are a fundamental element of our data technology

Please Describe… This is the technology to support discovery, display, and publication of data for access over the web. –We have two thrusts in this area very broad and general with no“semantic understanding” - and then very focused where we explore adding lots of semantics Persistent archives. –Evolving - looking to DSAC for guidance on how the field wants to go on this topic Data processing pipelines. This is the technology that couples the collection environment to grid processing systems. –We are early on in this thinking - our mapping capabilities are early - we hope to find existing best practice in this area

Standards - GGF Data Format Description Language group –Watching closely through Jim - Chuck Persistent Archive Research Group –Not participating Grid Portals research group –Chuck is deeply involved - NMI Grid Portal PI - first release of NMI portal is based on the NEESgrid NEESpop software. Grid File System group –Peripherally involved, tracking through Jim Open Grid Open Grid Services Architecture, Grid Security Infrastructure –Chuck is aware and moderately involved

Standards - Digital Library METS - Metadata Encoding Transmission Standard Joe is aware of - need to evaluate further WSDL - Web Services Definition Language and the use of Simple Object Access Protocol to specify the creation of web services. –Used throughout OWL - Ontology Web Language –Tracking this effort as part of our “relationship to RDF” effort Open Archival Information Standard (OAIS) for building a preservation system, the application of data grid technology for preservation environments. –Joe is tracking