PDS Atmospheres Node Plans for PDS4 User Roll-out 8/28/12PDS4 Roll-outStatus 1 Reta Beebe Lyle Huber Lynn Neakrase Jim Murphy Nancy Chanover Joni Johnson.

Slides:



Advertisements
Similar presentations
1 External Review Results November 30, 2011 Reta Beebe.
Advertisements

Data Processing A simple model and current UKDA practice Alasdair Crockett, Data Standards Manager, UKDA.
Overview of Search Engines
PPI Node Report Raymond J. Walker Steven P. Joy Todd A. King PDS Management Council March 25, 2010.
#PhUSE Standard Scripts Project Proposal for Qualification of Standard Scripts.
March 2010 PDS Imaging Node 1 NASA PDS Imaging Node: NASA PDS Imaging Node: Digital Data Archives and Distribution Archiving and distributing data and.
System Design/Implementation and Support for Build 2 PDS Management Council Face-to-Face Mountain View, CA Nov 30 - Dec 1, 2011 Sean Hardman.
PDS Radio Science Dick Simpson Stanford University Stanford Status PDS4 Status at Stanford o Testing o Mission Support o Migration Proposal o Tools o Issues.
PDS4 Phoenix Beta Review Lynn D. V. Neakrase Atmospheres Node.
NCSU Libraries Ingest Workflow Issues: Metadata North Carolina Geospatial Data Archiving Project Steve Morris North Carolina State University Libraries.
EARTH SCIENCE MARKUP LANGUAGE “Define Once Use Anywhere” INFORMATION TECHNOLOGY AND SYSTEMS CENTER UNIVERSITY OF ALABAMA IN HUNTSVILLE.
Archiving 40+ years of Planetary Mission Data - Lessons Learned and Recommendations K. E. Simmons LASP, University of Colorado, Boulder, CO
PDSMC November 29-30, PDS Imaging Node PDS4 Migration Lisa Gaddis (USGS) Sue LaVoie (JPL) November 30, 2012 PDS Management Council Meeting UCLA.
Copyright © 2004 by The Web Services Interoperability Organization (WS-I). All Rights Reserved 1 Interoperability: Ensuring the Success of Web Services.
PDS 2010 Project Update Dan Crichton MC Face-to-Face Washington DC March 25-26, 2010.
Resource Management Working Group SSS Quarterly Meeting November 28, 2001 Dallas, Tx.
Geosciences Node Ed Guinness MC Face-to-Face Meeting Washington, DC March 27-28, 2012.
Rings Node Mitch Gordon Mark Showalter MC Face-to-Face Meeting Westwood, California 26,27 August 2014.
Thomas C. Stein PDS Geosciences Node Washington University in St. Louis 1MS Supporting Active Surface Missions and Adding Value.
Planetary Science Archive PSA User Group Meeting #1 PSA UG #1  July 2 - 3, 2013  ESAC PSA Archiving Standards.
Rings Node Migration Plan Mark & Mitch PDSMC, UCLA November 28-29, 2012.
1 - A View from the Field - The Next Generation Data Standards For the PDS - PDS4 - ESIP Federation Meeting July 8, 2009 J. Steven Hughes JPL Copyright.
PDS4 Tool Development Strategy PDS Management Council Meeting November 18, 2014 Dan Crichton.
PDS4 and Build 5a Update Dan Crichton, Emily Law November
The european ITM Task Force data structure F. Imbeaux.
PDS Geosciences Node Page 1 Archiving Mars Mission Data Sets with the Planetary Data System Report to MEPAG Edward A. Guinness Dept. of Earth and Planetary.
PDS4 Project Report PDS MC F2F Columbia, MD Dan Crichton April 2-3,
Managing the Impacts of Change on Archiving Research Data A Presentation for “International Workshop on Strategies for Preservation of and Open Access.
Atmospheres Node Report Reta Beebe Nancy Chanover Lyle Huber Lynn Neakrase Jim Murphy Irma Trejo Matias Roybal Shannon Rees.
Label Design Tool Management Council F2F Washington, D.C. November 29-30, 2006
Data Standards and Build 3b Plans Steve Hughes MC Face-to-Face UCLA, Los Angeles, CA November 28-29, 2012.
PDS4 Project Update PDS MC F2F Flagstaff, AZ Dan Crichton August 22,
The Digital Library for Earth System Science: Contributing resources and collections GCCS Internship Orientation Holly Devaul 19 June 2003.
PDS M/C August 2012 PPI Node Report PDS Management Council August 28-29, 2012 R. J. Walker S. P. Joy T.A. King J. Mafi.
System Design and Deployment Status PDS Management Council Face-to-Face UCLA, Los Angeles, California November 28-29, 2012 Sean Hardman.
1 PDS 4 Data Design Report PDS Management Council April 2, 2009 PDS 2010 Data Design WG.
PDS4 User Beta Testing Mars Phoenix Website Lynn D. V. Neakrase Atmospheres Node Management Council Meeting, UCLA November 2012.
PDS M/C November 2012 PPI Data Migration Planning PPI PDS4 Data Migration Planning PDS Management Council November 28, 2012 T. King.
Data Standards Development August 29, Topics 1.Current Status 2.What was delivered for Build 2c 3.How was IPDA supported 4.What mission support.
PPI Node R.J. Walker, T.A. King, S.P. Joy, J.N. Mafi MC Face-to-Face Meeting Westwood, California 26 August 2014.
PDS Geosciences Node Page 1 Archive Status MRO and Phoenix Ed Guinness PDS Management Council August 13, 2007 Ed Guinness.
PDS Geosciences Node Page 1 Archiving LCROSS Ground Observation Data in the Planetary Data System Edward Guinness and Susan Slavney PDS Geosciences Node.
Software Development and Deployment PDS Management Council Face-to-Face Los Angeles, California August 26-27, 2014 Sean Hardman.
System/SDWG Update Management Council Face-to-Face Flagstaff, AZ August 22-23, 2011 Sean Hardman.
PDS4 Mission Needs Assessment Reta Beebe Dan Crichton.
Software Development and Deployment PDS Management Council Face-to-Face Berkeley, California November 18-19, 2014 Sean Hardman.
Lifecycle Metadata for Digital Objects November 15, 2004 Preservation Metadata.
PDS4 Demonstration Management Council Face-to-Face Flagstaff, AZ August 22-23, 2011 Sean Hardman.
Small Bodies Node Report Michael F. A’Hearn, Donald R. Davis, Ludmilla Kolokolova, & Carol Neese 28/8/12PDS Management Councilmfa 1.
PDS4 Build 3b System Readiness PDS Management Council Face-to-Face Columbia, Maryland April 2-3, 2013 Sean Hardman.
Planetary Data System (PDS) Tom Morgan November 24, 2014.
PDS M/C November 2012 PPI MAVEN Report PDS4 Mission Report: MAVEN PDS Management Council November 28, 2012 J. Mafi.
Tools Report Engineering Node March 2007
PDS4 Deployment Planning (Discussion) PDS MC F2F Columbia, Maryland Dan Crichton August 28,
PDS4 Project Report PDS MC F2F UCLA Dan Crichton November 28,
PDS4 Project Report PDS MC F2F University of Maryland Dan Crichton March 27,
IPDA PDS4 Report July 17, PDS4: The Next Generation PDS PDS4 is a PDS-wide project to upgrade from PDS version 3 to version 4 to address many.
NASA PLANETARY DATA SYSTEM ARCHIVING IPDA Steering Committee Reta Beebe, Dan Crichton Paris, France July
SBN-UMD short report. . Identify Missions and Instruments where archive products are behind schedule; particularly, those where the identified issues.
NASA PLANETARY DATA SYSTEM ARCHIVING IPDA Steering Committee Dan Crichton, Reta Beebe, Tom Stein, Steve Hughes Bangalore, India July
Working with MAVEN Data
An introduction to MEDIN Data Guidelines September 2016
SBN PDS4 Migration Planning
PDS4 Update Dan Crichton August 2014.
IPDA PDS4 Report PDS Team July 2015.
Management Council Meeting, UCLA November 2012
An introduction to MEDIN Data Guidelines.
Atmospheres Node Report
Helping Active Missions Convert to PDS4
Getting Planetary Science Data
Presentation transcript:

PDS Atmospheres Node Plans for PDS4 User Roll-out 8/28/12PDS4 Roll-outStatus 1 Reta Beebe Lyle Huber Lynn Neakrase Jim Murphy Nancy Chanover Joni Johnson Irma Trejo Shannon Rees Dylan White Ernesto Gonzalez Management Council Meeting, UCLA November 2012

8/28/12PDS4 Roll-outStatus 2 Management Council Meeting, UCLA November 2012 Topics Testing to date with the PDS4 data standard First mission the node will support with PDS4 Data migration plans User tool developments plans for PDS4 roll-out Lessons learned

8/28/12PDS4 Roll-outStatus 3 Management Council Meeting, UCLA November 2012 Testing to Date with the PDS4 data standard Migration testing has been done with several mission datasets Mars Phoenix (5 Bundles) PDS3 – Detached Labels (ASCII Tables) MET package LIDAR Atmospheric Science Experiment (ASE) Atmospheric Opacity (AO) Telltale Anemometer (TT) Accelerometer Data – PDS3 Attached Labels  PDS4 Detached Mars Reconnaissance Orbiter Accelerometer (1 Bundle) Mars Odyssey Accelerometer (1 Bundle) Mars Global Surveyor Accelerometer (1 Bundle) Prototype products for Galileo UVS/EUV Binary tables Prototype products for Maui Observations of Jupiter and Saturn (FITS) Prototyping preparation for upcoming missions LADEE Instrument Label templates (UVS, NMS) MAVEN Instrument Label templates (NGIMS, IUVS [FITS])

8/28/12PDS4 Roll-outStatus 4 Management Council Meeting, UCLA November 2012 Testing Process With PDS4 data standard 1.Migration is being done with a modular approach to allow efficient construction of labels from PDS3 information. 2.Each dataset presents unique issues but the core Python code for migration is the same in each case. 3.Data product label migration is automated with this code (i.e., translating PDS3  PDS4 labels). 4.Documents are unpredictable and represent considerable effort in migration and usually require by-hand construction of the PDS4 label. 5.Ingestion of new data products from LADEE and MAVEN hopes to use the core migration code for populating their PDS4 labels (i.e., values gleaned from incoming data will be used to populate a label template much like taking it from a PDS3 label).

8/28/12PDS4 Roll-outStatus 5 First Mission Node Will Support With PDS4

8/28/12PDS4 Roll-outStatus 6 First Mission Node Will Support With PDS4

8/28/12PDS4 Roll-outStatus 7 Management Council Meeting, UCLA November 2012 Data Migration Plans MAVEN will act as a driver of our plan MAVEN is an atmospheric loss mission, there are no other Lunar atmospheric missions. The Mars atmospheric community will use PDS4 to access this data. For convenience all Mars data should be available in the same format. Thus, our plan is: 1. Migrate Mars data first Prepare access pages for conversion to PDS4 Migrate the ATMOS Mars archive 2. Assuming we migrate Juno data on arrival at the PDS, other Jupiter data should be in a compatible format. 3. Migration of Cassini and other data should follow. In Addition: We are designing help pages that also can be defined as products in PDS4

8/28/12PDS4 Roll-outStatus 8 Data Migration Plans

8/28/12PDS4 Roll-outStatus 9 User tool needs for PDS4 roll-out PDS-wide, and Node-specific User Tools

8/28/12PDS4 Roll-outStatus 10 Management Council Meeting, UCLA November 2012 Reliance on EN Node Current suite of tools (through Sean Hardman) - PDS-Wide Search - PDS4 Label to Text (Download and Install) - PDS4 Label to PDS3 Label (May not be different from Text) - PDS3 Label to PDS4 Label (Download and Install) - Data Format Translations (In development as needed) Current versions of these tools are usable now, but may not be the final interfaces Interfacing between our local registry and the global registry will still require EN support regarding search routines Data format translations are low priority at this time for ATM data migration efforts (Most likely to be handled in-house as needed; e.g., Binary Table to Character Table translation for end users)

8/28/12PDS4 Roll-outStatus 11 Management Council Meeting, UCLA November 2012 Lessons Learned Use simple products to start with to exercise in house automation of the data labeling adding complexity with each iteration/new migration. Related products should be given priority in the migration queue. For ATM: Mars products first (to dovetail with MAVEN) Jupiter products next (driven by JUNO) Migration WILL NOT be a one-time event, but a continuum of reiteration and refinement. Every migration (each migrated dataset) will allow refinement of the process and provide new insight on best practices. Some early focus must be on automating parts of the process to be independent of the version of the schemas. Discussion of lessons learned across the DNs will help each node refine this process Migration Strategies

8/28/12PDS4 Roll-outStatus 12 Management Council Meeting, UCLA November 2012 Lessons Learned The data have to be organized slightly differently from past iterations. Bundle structures must be clearly visible and spelled out for the user. Need to treat every user for PDS4 as a novice because of the Bundle-Collection- Product structure and the XML usage. Website design should, in part, drive some of the organization  the goal is end-user ease- of-use. The One-Stop-Shop/User Guide approach seems to be a good starting point for the ATMOS node for linking all related data and documentation. Having multiple reviewers with constructive input has helped in refining our focus in what is important from the end-user/scientist perspective. Organization.