1 1 NOAA Office of Ocean Exploration End-to-End Data Management: A Success Story NOAA Tech Conference November 2005 Susan Gottfried National Coastal Data.

Slides:

Advertisements

Similar presentations

2008 EPA and Partners Metadata Training Program: 2008 CAP Project Geospatial Metadata: Intermediate Course Module 3: Metadata Catalogs and Geospatial One.

Advertisements

End-to-end Data Management for Operational Observation Systems Presented to the Summit on Long-Term Monitoring of the Gulf of Mexico Hypoxic Zone Sharon.

California Environmental Resources Evaluation System Environmental Information Sharing and Integration.

Geospatial One-Stop A Federal Gateway to Federal, State & Local Geographic Data

An Operational Metadata Framework For Searching, Indexing, and Retrieving Distributed GIServices on the Internet By Ming-Hsiang.

Visualizing Fitness for Purpose Bob Groman and Dicky Allison Biological and Chemical Oceanography Data Management Office Woods Hole Oceanographic Institution.

Transitioning from FGDC CSDGM Metadata to ISO 191** Metadata National Coastal Data Development Center A division of the National Oceanographic Data Center.

NATIONAL STATES GEOGRAPHIC INFORMATION COUNCIL 2105 Laurel Bush Rd. Suite 200 Bel Air, MD GIS Inventory powered by Ramona.

West Coast Observation Project Click to edit Master text styles –Second level Third level –Fourth level »Fifth level 1 West Coast Observing System Project.

Planned Title: Review of Evaluation of Geospatial Search Allan Doyle.

Integrating SeaDOG into RODIN T. Le Bas, F. Venuti, H. Snaith, and B. Soall.

January 2003National Coastal Data Development Center Brief National Coastal Data Development Center (NCDDC) Susan Starke January 2003.

OER End-to-end Data Management Sharon Mesick, IPT Chair June

NOBLE Digital Library. How does it work? The NOBLE Digital Library uses the DSpace platform. Image files and metadata are imported into DSpace using.

NOAA Metadata Update Ted Habermann. NOAA EDMC Documentation Directive This Procedural Directive establishes 1) a metadata content standard (International.

Metadata (for the data users downstream) RFC GIS Workshop July 2007 NOAA/NESDIS/NGDC Documentation.

Inter Regional Coordination Committee Paper by the IHB Considerations on the development of the General Bathymetric Chart of the Oceans (GEBCO data store.

The State of Kansas Data Access and Support Center (DASC)

OCLC Online Computer Library Center CONTENTdm ® Digital Collection Management Software Ron Gardner, OCLC Digital Services Consultant ICOLC Meeting April.

CIMS – Cruise Information Management System NOAALINC/VDMS - MARC21 Collection-Level (Parent Record) Dive-Level Metadata (Child Record) in FGDC standard.

Bringing it All Together: NODC’s Geoportal Server as an Integration Tool for Interoperable Data Services Kenneth S. Casey, Ph.D. YuanJie Li NOAA National.

Geospatial Platform Update Migration of GOS to Data.gov Rob Dollison GOS Project Manager FGDC Metadata Summit 10/26/11.

1 Systems Development Cheryl Itkin SIMCorB Meeting RTP, NC June 29-30, 2000 SIMCorB Organization Policy Systems Outreach.

Geospatial One-Stop FGDC and GOS: Working as One to Build the NSDI Rob Dollison Geospatial One-Stop Program Office.

1 Next Generation of Operational Earth Observations From the National Polar-Orbiting Operational Environmental Satellite System (NPOESS): Program Overview.

Planning for Arctic GIS and Geographic Information Infrastructure Sponsored by the Arctic Research Support and Logistics Program 30 October 2003 Seattle,

U.S. Department of the Interior U.S. Geological Survey Management of Oceanographic time-series data at the Woods Hole Coastal and Marine Science Center.

BEN Architecture Isovera Consulting Feb Internet consulting for non-profits 2 BEN Architecture Diagram.

IODE Ocean Data Portal - technological framework of new IODE system Dr. Sergey Belov, et al. Partnership Centre for the IODE Ocean Data Portal MINCyT,

Why Archiving and Preserving GIS Data Is Important Maps tell a compelling story of change over time. They document movement, progress, and change to the.

Overview of IU Digital Collections Search Hui Zhang Jon Dunn Indiana University Digital Library Program IU Digital Library Brown Bag October 19, 2011.

OME-TIFF and Bio-Formats K. Eliceiri, E. Hathaway, M. Linkert, and C. Rueden

FGDC and GOS Metadata: Foundations to Build the NSDI Sharon Shin FGDC Secretariat / Geospatial One-Stop.

NcBrowse A Graphical netCDF/OPeNDAP Browser Donald Denbo 1 & John Osborne 2 1 UW/JISAO-NOAA/PMEL, 2 OceanAtlas Software

Fisheries Oceanography Collaboration Software Donald Denbo NOAA/PMEL-UW/JISAO Presented by Nancy Soreide NOAA/PMEL AMS 2002/IIPS 10.3.

M u l t I b e a m III W o r k s h o p M u l t I b e a m III W o r k s h o p National Geophysical Data Center / World Data Centers NOAA Slide 1 End-to-End.

NODC ↔ Data Consumers Steve Rutz NOAA/NESDIS National Oceanographic Data Center NODC Observing Systems Team Leader June 21, 2011.

The Digital Library for Earth System Science: Contributing resources and collections Meeting with GLOBE 5/29/03 Holly Devaul.

CBSOR,Indian Statistical Institute 30th March 07, ISI,Kokata 1 Digital Repository support for Consortium Dr. Devika P. Madalli Documentation Research &

PACSCL Consortial Survey Initiative Group Training Session February 12, 2008 at The Historical Society of Pennsylvania.

NODC Metadata Management for Geoportal Server and Beyond John Relph NOAA National Oceanographic Data Center.

GIS data sources; catalogs of data and services. USGS: National Mapping.

Geospatial One-Stop FGDC and GOS: Working as One to Build the NSDI Sharon Shin Federal Geographic Data Committee Geospatial One-Stop Metadata Coordinator.

OAIS Rathachai Chawuthai Information Management CSIM / AIT Issued document 1.0.

NOAA/NESDIS/National Oceanographic Data Center Following the Flow of Two Underway Data Streams Within the U. S. National Oceanographic Data Center Steven.

Breakout # 1 – Data Collecting and Making It Available Data definition “ Any information that [environmental] researchers need to accomplish their tasks”

Existing knowledge Grey literature and other documents, images, videos, and more represent the mission and work of an agency, but preserving and creating.

Improving Description through Collaboration: The Ethnomusicological Video for Instruction & Analysis Digital Archive Music Library Association, February.

Cartographic Users Advisory Council The National Spatial Data Infrastructure and the Geospatial One Stop E-Gov Initiative May 3, 2002 John Moeller Staff.

National Coastal Data Development Center Status of OPeNDAP at NCDDC 11 September 2003 Susan Starke, Chief of IT Operations

NATIONAL TREASURES DATA PRESERVATION WITH METADATA Sharon Shin Metadata Coordinator Federal Geographic Data Committee Secretariat ASPRS-Reno 2006.

U.S. Environmental Protection Agency Central Data Exchange Pilot Project Promoting Geospatial Data Exchange Between EPA and State Partners. April 25, 2007.

Module 1: Overview of Microsoft Office SharePoint Server 2007.

National Coastal Data Development Center (National Oceanographic Data Center – OC6) Data Management and Visualization Brief CLIMATE AND MARINE PROTECTED.

NOS PUBLICATIONS PROJECT Background NOAA Administrative Order “NOAA Information Access and Dissemination,” issued September 994 Section 6: Responsibilities,

Barrow Area Spatial Data Infrastructure A collaborative effort of the Barrow Arctic Science Consortium Digital Working Group Funding for this effort has.

End-to-End Data Services A Few Personal Thoughts Unidata Staff Meeting 2 September 2009.

DESIGN AND DEVELOPMENT OF NOAA VIRTUAL LIBRARIES: THE INTERSECTION OF TRADITIONAL LIBRARY KNOWLEDGE AND CUTTING EDGE INFORMATION TECHNOLOGIES Dottie Anderson.

National Geospatial Enterprise Architecture N S D I National Spatial Data Infrastructure An Architectural Process Overview Presented by Eliot Christian.

Virtual Oregon Natural Resources Data Clearinghouse Strawman Functional Requirements 4/9/03 Overall goal: Make Oregon natural resources data readily available.

The Earth Information Exchange. Portal Structure Portal Functions/Capabilities Portal Content ESIP Portal and Geospatial One-Stop ESIP Portal and NOAA.

US GLOBEC Georges Bank Phase 4B Scientific Investigators’ Meeting 1 Presentation to the US GLOBEC Georges Bank Phase 4B Scientific Investigators October.

Accessing Digital Videos: OE DV Pilot Project Change is Good! NOAA Librarians’ Workshop March 24-28, 2003 Anna Fiolek Metadata Librarian NOAA Central Library.

Biological and Chemical Oceanography Data Management Office slide 1 of 10 U.S. GEOTRACES Data Management Cyndy Chandler BCO-DMO ~ WHOI 23 September 2008.

NOS DataExplorer Enterprise GIS Efforts within NOAA's Ocean Service Jason Marshall (PSGS) NOAA Coastal Services Center.

Proposal of Satellite Data Center India Meteorological Department A.K.Sharma (Chairman), Virendera Singh (Member), R.K.Giri (Member) and N.Puviarasan (Member.

IODE Ocean Data Portal - technological framework of new IODE system Dr. Sergey Belov, et al. Partnership Centre for the IODE Ocean Data Portal.

RDA Cataloging and DOI Assignments for NOAA Technical Publications NOAA Central Library October 2015.

Document & Web Content Management

Joseph JaJa, Mike Smorul, and Sangchul Song

Presentation transcript:

1 1 NOAA Office of Ocean Exploration End-to-End Data Management: A Success Story NOAA Tech Conference November 2005 Susan Gottfried National Coastal Data Development Center

2 2 The Data Management Challenge Standardize diverse data collection and management efforts Handle multiple types of data and formats Automatically generate required metadata Make data discoverable and accessible Post-cruise Reports & Publications Dive Videos and Digital/Still imagery and annotations Scientific Instrumentation Raw/Processed Data Files Geological/Biological/Water Samples Expeditions Information System Website archives, weblogs, situation reports, etc. ShipTracks & Underway Data Dive and non-dive activities & locations Research Proposals Database & Documents Data files Video Physical samples

3 3 Integrated Product Team (IPT) NOAA’s Office of Ocean Exploration (OE) Expedition Information System (EIS) National Undersea Research Center (NURC) Management Information System (MIS) National Coastal Data Development Center (NCDDC) Metadata Enterprise Resource Management Aid (MERMAid) National Oceanographic Data Center (NODC) National Geophysical Data Center (NGDC) NOAA Central Library (NCL) College of Charleston Mitretek Systems, Inc.

4 4 Phase II Data Flow MIS (Access Data Project, SQL Server) Master EIS (Filemaker Pro 6) Research Proposals & Cruise Plans export/initialize import/update ingest Runtime EIS generate reference record Access db Public and Protected Data Discovery and Access Metadata Generation and Archive catalog

5 5 Phase III Data Flow reference record CIMS Web- Instance (cruise specific) CIMS Portal CIMS Data Repository Public and Protected Data Discovery and Access Metadata Generation and Archive

6 6 Cruise Information Management System (CIMS) Proposal Management –Researchers submit and manage their proposals –OE Proposal managers use for decision making Cruise Planning –Common interface for cruise participants –Standard cruise plan document At-Sea Data Collection –Logical, efficient UI guides data manager –Synchs to main project data management component automatically Project Data Management –Secure, controlled access to project data, post-cruise –Meets OE’s mission to eventually make data accessible to public

7 7 CIMS Technology Web Based Cost Effective Readily Accessible Strong Programming Community and Support Built-in Security Features Zope/Plone/Python

8 8 CIMS User Interface

9 9 Metadata Generation and Archive MERMAid Create/Validate NOAA Central Library NODC Archive NGDC Archive FGDC formatted metadata FGDC metadata bundled with oceanographic data sets FGDC metadata bundled with geophysical data sets FGDC translated via MarcXML to Marc21, bundled with video, imagery, products and documents FGDC records ingested for cruise, project, dives, scientific activities Online Metadata Catalog for Public Discovery CIMS

10 Data Discovery and Access

11 Collaborative Tools

12 Video Data Management System Developed by NOAA Central Library for OE Developed digital video workflow requirements –from acquisition through archiving Provides NOAALINC (online library catalog) access to OE data and information –Digital video clips- Maps –Cruise reports - Images –Raw data- Web Site Establishing original materials archive Participates in outreach and collaboration Data Discovery and Access

13 Data Discovery via Metadata Search Data Discovery and Access Metadata management facilitates data access –Points of Access National Spatial Data Infrastructure NCDDC Metadata Catalog NOAALinc Geospatial One-Stop (GOS) –Data download available Open data format

14 Digital Atlas GIS Internet mapping of OE data collection activities Integrates OE data with other NOAA and non-NOAA data Integrates geospatial data with other data products Developed in accordance with NOAA E-GIS characteristics Data Discovery and Access Documents Data Collections

15 Contact Information OE Deputy Director: John McDonough x113 Federal Program Manager (NCDDC): Sharon Mesick Project Manager (NCDDC): Susan Gottfried CIMS Software Engineer (NCDDC): Stacy Ladnier