AON Data Questionnaire Results 21 Respondents Last Updated 27 March 2007 First AON PI Meeting Scot Loehrer, Jim Moore.

Slides:



Advertisements
Similar presentations
28 March 2003e-MapScholar: content management system The e-MapScholar Content Management System (CMS) David Medyckyj-Scott Project Director.
Advertisements

Introducing… EBSCOhost 2.0 A redesigned EBSCOhost Coming in July 2008.
LaMNA Incoming Dataset Processing Flow.
2009 Mid–Term Review El Verde Field Station June 4, 2009.
Chicago Band Connection Developed by Chutes & Ladders.
CPSC 695 Future of GIS Marina L. Gavrilova. The future of GIS.
Living in a Digital World Discovering Computers 2010.
Systems Oceanography: Observing System Design. Why not hard-wire the system? Efficiency of interface management –Hard-wire when component number small,
Chapter 4: Database Management. Databases Before the Use of Computers Data kept in books, ledgers, card files, folders, and file cabinets Long response.
DoW text: Task and WP leaders will prepare syntheses reports of the project progress, its results and its implications. These synthesis reports will be.
Data Management: Documentation & Metadata Types of Documentation.
Website Content, Forms and Dynamic Web Pages. Electronic Portfolios Portfolio: – A collection of work that clearly illustrates effort, progress, knowledge,
FILING SYSTEMS Research Data Management. Filing is more than saving files, it’s making sure you can find them later in your project. Naming Directory.
HTML Comprehensive Concepts and Techniques Intro Project Introduction to HTML.
Obtaining MISR Data and Information Jeff Walter Atmospheric Science Data Center April 17, 2009.
ETD Repositories Using DSpace Software Andrew Penman The Robert Gordon University 27 th September 2004.
Biostatistics Analysis Center Center for Clinical Epidemiology and Biostatistics University of Pennsylvania School of Medicine Minimum Documentation Requirements.
METADATA Research Data Management. What is metadata? Metadata is additional information that is required to make sense of your files – it’s data about.
Field Project Planning, Operations and Data Services Jim Moore, EOL Field Project Services (FPS) Mike Daniels, EOL Computing, Data and Software (CDS) Facility.
AIRNow-International The future of the United States real-time air quality reporting and forecasting program and GEOSS participation John E. White U.S.
OCLC Online Computer Library Center CONTENTdm ® Digital Collection Management Software Ron Gardner, OCLC Digital Services Consultant ICOLC Meeting April.
OBSERVATIONS & PRÉVISIONS CÔTIÈRES 3 rd SeaDataNet training course – Ostende – June 2008 NEMO reformatting tool v1 M. Fichaut.
Objectives Overview Define the term, database, and explain how a database interacts with data and information Define the term, data integrity, and describe.
COINE Cultural Objects in Networked Environments.
Cataloguing Electronic resources Prepared by the Cataloguing Team at Charles Sturt University.
NEPTUNE Canada Workshop Oceans 2.0 Project Environment NEPTUNE Canada DMAS Team Victoria, BC February 16, 2009.
Technical Overview of SDMX and DDI : Describing Microdata Arofan Gregory Metadata Technology.
How do we represent the world in a GIS database?
EARTH SCIENCE MARKUP LANGUAGE Why do you need it? How can it help you? INFORMATION TECHNOLOGY AND SYSTEMS CENTER UNIVERSITY OF ALABAMA IN HUNTSVILLE.
Extensible Markup Language (XML) Extensible Markup Language (XML) is a simple, very flexible text format derived from SGML (ISO 8879).ISO 8879 XML is a.
Sharing Value Sets (SVS Profile) Ana Estelrich GIP-DMP.
Discovering Computers Fundamentals Fifth Edition Chapter 9 Database Management.
Data Access to Marine Surface Observations and Products from COADS 29 January, 2002 Steven Worley National Center for Atmospheric Research.
The Arctic Observing Network (AON) Cooperative Arctic Data and Information Service (CADIS) Florence Fetterer,
ARCSS Data Management Support Overview and Update James Moore Steve Williams NCAR Earth Observing Laboratory 3-5 October 2007.
Group 3: Art Gallery Monica Almendarez Content/Project Manager Willliam Egle Technology Manager Christina Pié Usability/ADA Compliance Manager Mirjana.
United Nations Economic Commission for Europe Statistical Division The Importance of Databases in the Dissemination Process Steven Vale, UNECE.
Introduction to metadata
ITGS Databases.
The HDF Group Support for NPP/NPOESS by The HDF Group Mike Folk, Elena Pourmal, Peter Cao The HDF Group November 5, 2009 November 3-5,
RAINEX Data Management UCAR Joint Office for Science Support José Meitín Jim Moore Dick Dirks UCAR Joint Office for Science Support José Meitín Jim Moore.
GEON2 and OpenEarth Framework (OEF) Bradley Wallet School of Geology and Geophysics, University of Oklahoma
Peter Granda Archival Assistant Director / Data Archives and Data Producers: A Cooperative Partnership.
Using and modifying plan constraints in Constable Jim Blythe and Yolanda Gil Temple project USC Information Sciences Institute
Mercury – A Service Oriented Web-based system for finding and retrieving Biogeochemical, Ecological and other land- based data National Aeronautics and.
The US Long Term Ecological Research (LTER) Network: Site and Network Level Information Management Kristin Vanderbilt Department of Biology University.
Digital Libraries1 David Rashty. Digital Libraries2 “A library is an arsenal of liberty” Anonymous.
INTRODUCTION TO GIS  Used to describe computer facilities which are used to handle data referenced to the spatial domain.  Has the ability to inter-
An Introduction to the Argo Data Sytem South Pacific Workshop 11 – 14 October 2005 Mark Ignaszewski FNMOC.
John Porter Sheng Shan Lu M. Gastil Gastil-Buhl With special thanks to Chau-Chin Lin and Chi-Wen Hsaio.
RICO DATA MANAGEMENT STATUS UPDATE Steve Williams and Scot Loehrer UCAR/Joint Office for Science Support (JOSS) Boulder, Colorado RICO Planning Workshop.
Non-standard ASCII to netCDF. CF Conventions REQUIRE Latitude Longitude Date/Time …for EVERY observation.
Getting Familiar with Metadata Laurie Porth Rocky Mountain Research Station Audience: Scientists/researchers who have heard of metadata and now need to.
Introduction to HTML Simple facts yet crucial to beginning of study in fundamentals of web page design!
National Geospatial Enterprise Architecture N S D I National Spatial Data Infrastructure An Architectural Process Overview Presented by Eliot Christian.
Building Preservation Environments with Data Grid Technology Reagan W. Moore Presenter: Praveen Namburi.
Scientific data storage: How are computers involved in the following?
1 CAA 2009 Cross Cal 9, Jesus College, Cambridge, UK, March 2009 Caveats, Versions, Quality and Documentation Specification Chris Perry.
Understanding the Value and Importance of Proper Data Documentation 5-1 At the conclusion of this module the participant will be able to List the seven.
Rebecca L. Mugridge LFO Research Colloquium March 19, 2008.
2005 – 06 – - ESSP1 WDC Climate : Web Access to Metadata and Data Frank Toussaint World Data Center for Climate (M&D/MPI-Met, Hamburg)
NASA Earth Science Data Stewardship
INTRODUCTION TO GEOGRAPHICAL INFORMATION SYSTEM
Vocabulary byte - The technical term for 8 bits of data.
Peter Shepherd COUNTER March 2012
Vocabulary byte - The technical term for 8 bits of data.
Microsoft Excel 2007 – Level 2
RICO DATA MANAGEMENT STATUS UPDATE
Overview of Oracle Site Hub
ESRM 250/CFR 520 Autumn 2009 Phil Hurvitz
Presentation transcript:

AON Data Questionnaire Results 21 Respondents Last Updated 27 March 2007 First AON PI Meeting Scot Loehrer, Jim Moore

Summary of Information Requested Contact Information and project summary Data Archive Information –What, where, data types –Need for central archive –Parameters, formats, metadata –Time and space resolution –Quality control

Summary of Information Requested (cont) Real-time data collection and access –What, when, quality control –Where are the data accessed –Interest on other real time data Special Datasets (e.g. human dimensions) Additional Considerations –Complementary data needs –Priority task for AON success –Other special requirements

Interesting statistics/perceptions 200+ parameters More than 300 sites (200 alone from permafrost Need details on ‘collaborator’ networks and sites ~20 unique currently active real-time and/or archive web sites ~15 groups with real-time data provision Different levels of Q/C depending on when the data are made available Most folks not sure about need/desire for real- time data

Summary of PI ‘Data Formats’ Question 1. ASCII 2. ascii comma separated 3. Raw data in various formats; all coverted to Excel for present purposes; many data files archived in ASCII 4. ASCII files, NetCDF, preferably GeoTIFF) 5. ASCII, but we can make NetCDF or any other formats if required. 6. ASCII 7. Many types 8. Typically ascii or matlab 9. ASCII and MATLAB. 10. Variables will range from interval (e.g. income) to categorical (e.g. type of management institution) scaling. 11. ascii column 12. netCDF 13. no response. 14. Ascii 15. Data formats to date are ASCII. 16. spread sheets (Excel) 17. Transcripts; audio recordings; video recordings; photographs; maps; artwork; scientific measurements. 18. MS-Excel or ascii text, jpeg images 19. Prefer.mat (matlab data file) or flat ascii files 20. Real numbers with to digits after decimal point. 21. NETCDF (preferred) and MATLAB binary.

Metadata to be provided Whatever is needed site layout and instrumentation specifications Most data are now available using LTER Network Metadata standards (EML) FDGC and ISO compliant metadata files (html and ASCII txt) Metadata for the buoys are currently provided by the manufacturers to JCOMMOPS, but we can collect these and provide them to the AON. Our data will be presented in a web format with metadata prominently displayed. location, time measurement technique, etc, see Variable definition, scaling, geographic level, time periods, quality assessment.

Metadata to be provided (cont) latitude, longitude, platform, Date, Time netCDF header information detailing the fields that are present in each file. We will also provide metadata that contains both this netCDF header type information, some expansion on that information, and additional information on the dataset as a whole. Standard as per current archive. text description Unknown. ELOKA will work this out with project partners. Joss data set guidelines Lat, long, time and data format readme files (in ascii)

Metadata to be provided (cont) We have a special form for metadata, which was approved and used by GTN-P project. Embedded in NETCDF, with additional information in text files as necessary.

A Central AON Archive the main new need is to ensure seamless collaboration with other AON/IPY projects. To achieve this a central archive is less important than clear and simple metadata protocols Central access point to distributed archive data would be helpful Not absolutely necessary, links and sharing is key Yes, especially for new AON PIs

Summary of Data Management Priorities Comments Prompt collation of AON data at one, easily accessible site. Maintaining an overview of programs and data Permanent archiving of the data Easy data submission process (to aid getting the data collated quickly) QC of the data to be done by PIs (time to do so) Easy search by region, date, measurement and subsetting by region, date, or measurement Clear graphical representations of data availability by maps and update rates

Summary of Data Management Priorities Comments How are the data to be used Archive raw and/or processed data Provide data in a usable format accessible by the broad community and stakeholders Efficient archive procedures A location for collaborative projects/data sharing Standardized datasets of all parameters Consider new data system models (Ameriflux, IDV)

Other comments and concerns CADIS will develop to be a major access point for AON data. Our success will rely on the cooperation of the AON investigators. We think that the Arctic-RIMS database contains many of the desired features to support inter- disciplinary research within AON. can we make sure there is an ASCII version of the data - not just matlab, not just excel… … concerned about other researchers using my data without including me as an author, proper citation, or improperly using the data (bad conclusions that may be biased due to how data was collected etc)