PDS M/C August 2012 PPI Node Report PDS Management Council August 28-29, 2012 R. J. Walker S. P. Joy T.A. King J. Mafi

PDS M/C August 2012 PPI Node Report PPI Overview Activities – Data deliveries running smoothly. PDS4 Testing – Very productive and useful. PDS4 Data Migration Plan – Progressing and nearly ready for first phase. PDS4 Tools – Some ready, some needed. PDS4 First Mission – MAVEN 1

PDS M/C August 2012 PPI Node Report Activities Missions Active Pipeline:Messenger, Cassini, LRO, MEX SIS:Juno Peer Review:Dawn, MSL Cruise:New Horizons Assist: Rosetta Baseline PDS4 – Design and Tool Dev. (level of effort equal to an large mission) Archive maintenance Web enhancements Pre-Launch SIS:MAVEN Restoration Pipeline:MGS, Voyager Prelim:Kaguya Issues A few Nothing higher than yellow All manageable 2

PDS M/C August 2012 PPI Node Report PDS4 Testing Selected representative data from our PDS3 archive. – Cassini RPWS (calibrated) Created – Product labels. – Collections. – Bundles. Tested multiple versions of model – Testing pipeline – RFAs: Earlier tests (0700j): 9; Recent tests (0800k): 10. – Some RFAs "closed" with no action. – ??? How well are RFAs being addressed ??? 3

PDS M/C August 2012 PPI Node Report PDS4 Data Migration Plan Started several years ago… Refactor current archive as single Data Set per Volume. – Split volumes with multiple data sets. – Update to PDS 3.8 compliance. – Validate with Ames Validator tool. Progress:720 volumes => 413 datasets Remaining: 27 PVO data sets, Cassini MAG (peer review) and errors in MEX (fixable by PDS?) Transform PDS 3.8 volume to PDS4 4

PDS M/C August 2012 PPI Node Report PDS4 Rollout Switch current PPI interface from current volumes to new dataset volumes. – Same model as PDS4 Convert and register as PDS4 resources. Integrate PDS4 services as they become available. – Incremental and feature-by-feature. 5

PDS M/C August 2012 PPI Node Report Tools We Use for PDS4 Oxygen – Editing and validation pds.docgen (PPI developed, open source) – Apache Velocity based template processor Saxon Schema and Schematron validation – Command-line (java) 6

PDS M/C August 2012 PPI Node Report Tools we use for PDS3 Ames Volume Validator Note: Large volumes cause problems with validator. Work around: Must divide dataset and check as smaller pieces. Something to consider with PDS4 validator. Lbtool – Validate label Tbtool – Validate label/data structure. 7

PDS M/C August 2012 PPI Node Report PDS4 Tool Development Plans PPI Refine pds.docgen as needed. Create PDS4 harvester for Solr search engine. Schema driven, web based XML editor. (adapted from another project) We need: Data Registry services (EN to develop) Volume verifier (AMES?) tbtool (PPI - ????) Clear protocols (all) 8

PDS M/C August 2012 PPI Node Report First Mission – MAVEN Mission Time Line NOW: SIS development has begun 2013-Nov-18 to 2013-Dec-17: Launch window 2014-Sep-22 or later: Mars Orbital Insertion 2014-Nov: start of science operations (5 weeks after MOI) 2015-Apr: first data delivery (6 months after start of science ops) 9

PDS M/C August 2012 PPI Node Report First Mission - MAVEN Instruments: 4 particle, MAG, Plasma wave. Data types: ASCII tables and binary tables. Forms of binary tables – CDF data to be treated as simple binary tables with a header. – Raw data will be archived as packets. Need bit field support in PDS4 – to be worked. Delivery package – Description of package in SIS template. 10

PDS M/C August 2012 PPI Node Report Summary We are well positioned for a migration of our full archive to PDS4. Things we need in PDS4 (to support MAVEN) – Delivery Package (full and incremental) – Association of Instrument and Instrument_Host. – Bit Fields PDS4 information model issues are resolvable. 11

PDS M/C August 2012 PPI Node Report Backup Slides 12

PDS M/C August 2012 PPI Node Report PDS 2010/PDS 4 Participation Participate in DDWG (Steve, Joe, Debra) – Reviews, discussion, studies, white papers – Unsustainable demands – Participation is impacting archive maintenance and migration activities. Participate in SDWG (Todd) – Reviews, discussions, testing – Manageable demands Advisory and Review (Todd) – Manageable demands (to a point). 13

PDS M/C August 2012 PPI Node Report Missions Active Missions – MESSENGER PPI LeadMature Pipeline M. Sharlow – CassiniMature Pipeline D. Kazden, J. Mafi – MEXMature Pipeline M. Sharlow – LROMature Pipeline M. Sharlow – DawnPeer review J. Mafi – RosettaAssist SBN S. Joy, J. Mafi – JunoSIS's in review J. Mafi – MSLPeer Review M. Sharlow – New HorizonsCruiseS. Joy, J. Mafi Pre-launch Missions – MAVENPPI Lead SIS developmentJ. Mafi, S. Joy Restorations – MGSMature Pipeline M. Sharlow – KaguyaLabels designed M. Sharlow – VoyagerNew data setsJ. Mafi, S. Joy China/Foreign Missions – PDS Standards Seminar All – IPDAS. Joy, T. King 14

PDS M/C August 2012 PPI Node Report Issues by Mission - all manageable - MAVEN – Requires PDS4 support for SIS development and product design Cassini – Multiple re-submissions; some user’s guides and high order data behind schedule, but progressing; Dawn – Data in review – trying to meet PMDAP deadline (9/12/12) MESSENGER – Higher order data sets under review Rosetta – PDS not included in ESA/ESTEC review of data sets Kaguya – Data available online at with minimal PDS labelshttp://darts.jaxa.jp 15