British Atmospheric Data Centre (www.badc.rl.ac.uk) Searching: Whither NDG? Bryan Lawrence.

Slides:



Advertisements
Similar presentations
Support.ebsco.com EBSCOhost Digital Archives Viewer Tutorial.
Advertisements

The New online Scar Map Catalogue Australian Antarctic Data Centre Australian Antarctic Division.
TV N EWS The Information Database that gives you access to TV News Reports and Documentaries. Learn How to Search.
Click the Enter button to begin using the Compendium Click to continue.
National Aeronautics and Space Administration Jet Propulsion Laboratory California Institute of Technology Pasadena, California Metadata-Centric Discovery.
Overview of key concepts and features
Oregon Spatial Data Library Partnership Metadata Training OU Knight Library Eugene, Oregon December 3, 2009 Kuuipo Walsh Institute for Natural Resources.
Resource Discovery Module DigiTool Version 3.0. Resource Discovery 2 Deposit Approval Search & Index Dispatcher & Viewers Single & Bulk Web Services DigiTool.
NERC Data Grid Helen Snaith and the NDG consortium …
FGDC, Meet the DDI Adding Geospatial Metadata to a Numeric Data Catalog Julie Linden Yale University.
Catalog: Batch delete old Patron Records How to conduct global/batch updates to records – patron Adding Faculty and Patron/Student Records Manually Standardizing.
CSDGM: Content Standard for Digital Geospatial Metadata February 7, 2006 Geog 458: Map Sources and Errors.
Data Management: Documentation & Metadata Types of Documentation.
Introduction to Geospatial Metadata – ISO 191** Metadata National Coastal Data Development Center A division of the National Oceanographic Data Center.
Disclaimer This presentation is the property of MarketLinx Solutions™ and is intended for the exclusive use of NTREIS and may not be distributed, copied.
Transitioning from FGDC CSDGM Metadata to ISO 191** Metadata National Coastal Data Development Center A division of the National Oceanographic Data Center.
MyiLibrary® ‘Search & View’ Website Training June 8, 2010.
Metadata (for the data users downstream) RFC GIS Workshop July 2007 NOAA/NESDIS/NGDC Documentation.
Metadata Understanding the Value and Importance of Proper Data Documentation Exercise 2 Reading a Metadata File Exercise 3 Using the Workbook Exercise.
DE&T (QuickVic) Reporting Software Overview Term
® IBM Software Group © 2009 IBM Corporation Rational Publishing Engine RQM Multi Level Report Tutorial David Rennie, IBM Rational Services A/NZ
Creating Documentation and Metadata: Metadata for Discovery Lola Olsen 1, Tyler Stevens 2, 1 National Aeronautics and Space Administration (NASA) 2 Wyle.
CF Conventions Support at BADC Alison Pamment Roy Lowry (BODC)
1 Welcome to the GrameneMart Tutorial A tool for batch data sequence retrieval 1.Select a Gramene dataset to search against. 2.Add filters to the dataset.
Creating Documentation and Metadata: Metadata for Discovery Lola Olsen 1, Tyler Stevens 2, 1 National Aeronautics and Space Administration (NASA) 2 Wyle.
1 The NERC DataGrid DataGrid The NERC DataGrid DataGrid AHM 2003 – 2 Sept, 2003 e-Science Centre Metadata of the NERC DataGrid Kevin O’Neill CCLRC e-Science.
2008 EPA and Partners Metadata Training Program: 2008 CAP Project Geospatial Metadata: Introduction Module 2: FGDC CSDGM Metadata Compliancy.
Metadata and Geographical Information Systems Adrian Moss KINDS project, Manchester Metropolitan University, UK
Introduction to Geospatial Metadata – FGDC CSDGM National Coastal Data Development Center A division of the National Oceanographic Data Center Please .
Metadata Implementation Ted Habermann NOAA National Geophysical Data Center Documentation: It’s not just discovery... 50% change in global average Why?
Are Standards Really Standards Any More? Mélanie F. Meaux NASA / GCMD In response to Wyn Cudlip with regards to an IDN profile of ISO …
Using the Global Change Master Directory (GCMD) to Promote and Discover ESIP Data, Services, and Climate Visualizations Presented by GCMD Staff January.
WGISS-40: IDN Report Michael Morahan WGISS-40 Fall meeting / Harwell, United Kingdom
The Metadata Tool Custom Metadata Tool Who this tool is for: This tool designed to be used a data management system. This tool is geared more for the.
Transitioning from FGDC CSDGM Metadata to ISO 191** Metadata
1 Earth System Modeling Framework Documenting and comparing models using Earth System Curator Sylvia Murphy: Julien Chastang:
National Aeronautics and Space Administration Jet Propulsion Laboratory California Institute of Technology Pasadena, California EDGE: The Multi-Metadata.
2008 EPA and Partners Metadata Training Program: 2008 CAP Project Geospatial Metadata: Introduction Module 1: Introduction & Overview of the FGDC CSDGM.
Vers national spatial data infrastructure training program What is Metadata? Introduction to Metadata An overview of geospatial metadata, presentation.
Documenting UAF Data Ted Habermann NOAA/NESDIS/National Geophysical Data Center.
Why Standardize Metadata?. Why Have a Standard? Think for a moment how hard it would be to… … bake a cake without standard units of measurement. … put.
Introducing Geospatial Metadata ---1 Don’t Duck Metadata Introducing Geospatial Metadata A Metadata Workshop.
1 Overview Finding and importing data sets –Searching for data –Importing data_.
The FGDC and Metadata. To maintain an organization's internal investment in geospatial data To provide information about an organization's data holdings.
Introduction to Geospatial Metadata – FGDC CSDGM National Coastal Data Development Center A division of the National Oceanographic Data Center Please .
The Digimap ShareGeo Facility Login to Digimap and select ShareGeo from the Collections page.
ECS Metadata Considerations for Preservation SiriJodha S. Khalsa National Snow and Ice Data Center.
Metadata Training for SEFSC Science Staff Part Two.
COMMON COMMUNICATION FORMAT (CCF). Dr.S. Surdarshan Rao Professor Dept. of Library & Information Science Osmania University Hyderbad
ESRI Education User Conference – July 6-8, 2001 ESRI Education User Conference – July 6-8, 2001 Introducing ArcCatalog: Tools for Metadata and Data Management.
MarLIN: a research data metadatabase for CSIRO Marine Research Tony Rees Divisional Data Centre CSIRO Marine Research, Hobart contact:
ISO 191** Overview A “Family” of Standards. Resources ISO Standards Web Page – Technical.
Getting Familiar with Metadata Laurie Porth Rocky Mountain Research Station Audience: Scientists/researchers who have heard of metadata and now need to.
The Research Data Archive at NCAR: A System Designed to Handle Diverse Datasets Bob Dattore and Steven Worley National Center for Atmospheric Research.
The Proliferation of Metadata Standards and the Evolution of NASA’s Global Change Master Directory (GCMD) Standard for Uses in Earth Science Data Discovery.
Part III – Class Exercise Metadata Creation in ArcCatalog.
A look to the past for the future- The North American Profile Sharon Shin Metadata Coordinator Federal Geographic Data Committee.
Content Standards for Digital Geospatial Metadata Mandatory Legend Identification Information Data Quality Information Spatial Data Organization Information.
CLASS Metadata and Remote Sensing Extensions CLASS Data Provider’s Conference September 2005 Anna Milan, Ted.Habermann,
Standardized Metadata Standardized Metadata The FGDC Content Standard For Digital Geospatial Metadata The FGDC Content Standard For Digital Geospatial.
Welcome to the GrameneMart Tutorial A tool for batch data sequence retrieval 1.Select a Gramene dataset to search against. 2.Add filters to the dataset.
CAA Database Overview Sinéad McCaffrey. Metadata ObservatoryExperiment Instrument Mission Dataset File.
Demystifying Metadata Examining and Understanding the Elements of the Content Standards for Geospatial Metadata.
Geog. 377: Introduction to GIS - Lecture 16 Overheads 1 5. Metadata 6. Summary of Database Creation 7. Data Standards 8. NSDI Topics Lecture 16: GIS Database.
Understanding the Value and Importance of Proper Data Documentation 5-1 At the conclusion of this module the participant will be able to List the seven.
Geospatial metadata Prof. Wenwen Li School of Geographical Sciences and Urban Planning 5644 Coor Hall
GEOGRAPHICAL INFORMATION SYSTEM
WGISS-41: IDN Report Michael Morahan CEOS WGISS-41 Meeting
A Case Study for Synergistically Implementing the Management of Open Data Robert R. Downs NASA Socioeconomic Data and Applications.
Rational Publishing Engine RQM Multi Level Report Tutorial
Presentation transcript:

British Atmospheric Data Centre ( Searching: Whither NDG? Bryan Lawrence

British Atmospheric Data Centre ( Starting position Visualisation is nice but once a user has done that a few times, they want the data for themselves. They want to be able to bookmark workflow (e.g. “I always want the last month’s climatology picture”). Simple hierarchical menus like that provided by LAS simply do not scale (so I have 100+ entities in my menu, how do I deal with that?)

British Atmospheric Data Centre ( NERC Metadata Gateway - SST

British Atmospheric Data Centre ( NERC Metadata Gateway - SST

British Atmospheric Data Centre ( Very Irregularly Copied to GCMD

British Atmospheric Data Centre ( ESIP to BADC (and we didn’t do it!)

British Atmospheric Data Centre ( DIF Fields Some fields are required, meaning that the fields must be present in the DIF in order for the DIF to load into DIF databases. These fields are Entry_ID, Entry_Title, Parameters, Data_Center and Summary. Other fields are deemed critical, meaning these fields are crucially important for data set selection (i.e., searching), user understanding of the data, or data access. Fields critical for searching are Parameters, Temporal_Coverage, Spatial_Coverage and Location. If a user conducts a search by these criteria, and the DIF does not contain the information, the DIF will not be found in the search. Fields critical for user understanding of the data are Entry_Title, Summary and Data_Resolution. Without these fields, users cannot know if a dataset is appropriate for their needs. Lastly, the Data_Center field is critical for users to be able to access the data once they decide the data is appropriate for their needs.

British Atmospheric Data Centre ( Examples of what Q metadata must support Start Search Observations Simulations Type of Model (e.g. UM) When Run? Who by? Why (e.g. 2xCO2) Specific Times Code Base (e.g Kuo Param) Specific Experiment 1d-4d slice: A-type metadata object Field Campaign or Cruise Platform Instrument Observation Period Parameter Observed Phenomena Observed Geographic Location Parameter Algorithm Not exclusive! Very complex routing!

British Atmospheric Data Centre ( NDG version of Bob’s ESG Object Model Ensemble Simulation Aggregation Project Dataset Operational CampaignPlatform Instrument DataFile B-Attributes A-Attributes For the moment, collapsing the inheritance of CF variables into the (netCDF) Data File. Defining TWO types of attribute

British Atmospheric Data Centre (

We can select information from previous pages. People usually complain when selecting means loosing information and have to go back to choose options not available from the current page

British Atmospheric Data Centre ( All these pages are drawn dynamically on the fly as we browse the catalogue

British Atmospheric Data Centre ( … getting to the data

British Atmospheric Data Centre ( Bottom Line Simple (google-like) Re-entrant (bookmarks) Scripting basis (gui decoupled from functionality) Dynamically generated Deliver data first, worry about visualisation second Avoid traversing deep hierarchies where possible or presenting the user with lengthy lists (more than 10 items). Simple!

British Atmospheric Data Centre ( FGDC CSDGM sections 7 Main Sections Description * Identification title, description, subject Data Quality accuracy, processing Spatial Data Organization vector, raster Spatial Reference projection, depth Entity & Attribute features, values Distribution ordering point, media *Metadata Reference date written, author *Required sections 3 Supporting Sections Citation (reference) Time Period Contact

British Atmospheric Data Centre ( Directory Interchange Format (DIF) A de-facto standard for directory entries which describe a group of data. DIF consists of a collection of fields which detail specific information about the data. Five fields are required in the DIF; the others expand upon and clarify the information. Some of the fields are text fields, others require the use of valid values. The DIF allows users of data to understand the contents of a data set. The DIF contains those fields which are necessary for users to decide whether a particular data set would be useful for their needs. The DIF is compatible with Federal Geographic Data Committee's (FGDC) Content Standard on Digital Geospatial Metadata (CSDGM). The compatible content allows fields to be mapped. With the mapping, FGDC CSDGM records can be converted into DIF and vice versa.