1. Data SG – Archive Task Team - 9th May 2002 CEOS ICF Baseband Data Archive InterChange Format Baseband Data Archive InterChange Format Commitee on Earth Observation Satellites (CEOS) Working Group on Information Systems and Services (WGISS) Meeting Frascati, Italy Stéphane MBAYE GAEL Consultant Stephane.Mbaye@gael.fr

2. Data SG – Archive Task Team - 9th May 2002 Rationale  Document status  CEOS ICF - Changes  Presentation - “Data Request Broker” (DRB)  Demo – Derby application  Document status  CEOS ICF - Changes  Presentation - “Data Request Broker” (DRB)  Demo – Derby application

3. Data SG – Archive Task Team - 9th May 2002 Document status  21/04/2000 – Draft 0 - Creation of the document  29/08/2000 – Draft 1 - Use of XML Schema instead of DTD  09/01/2001 – Draft 2 - Includes outputs of Bangkok ATT meeting  09/04/2001 – Draft 3 – Presented at Sioux Falls (USA)  23/07/2001 – Draft 4 – Includes outputs of Sioux Falls ATT meeting  23/08/2001 – Draft 5 – Vega France - Technical proof reading  06/04/2002 – Draft 6 – ESA-ESRIN - Technical proof reading  19/04/2002 – GAEL-CEOS-ICF-060.2 – Issue 1, Revision 0  21/04/2000 – Draft 0 - Creation of the document  29/08/2000 – Draft 1 - Use of XML Schema instead of DTD  09/01/2001 – Draft 2 - Includes outputs of Bangkok ATT meeting  09/04/2001 – Draft 3 – Presented at Sioux Falls (USA)  23/07/2001 – Draft 4 – Includes outputs of Sioux Falls ATT meeting  23/08/2001 – Draft 5 – Vega France - Technical proof reading  06/04/2002 – Draft 6 – ESA-ESRIN - Technical proof reading  19/04/2002 – GAEL-CEOS-ICF-060.2 – Issue 1, Revision 0

4. Data SG – Archive Task Team - 9th May 2002 Partitioning – Analysis  For archives biggest than 2 Gigabytes  Continuous subsets of a single Baseband Interchange Unit  Free cutting policy  For archives biggest than 2 Gigabytes  Continuous subsets of a single Baseband Interchange Unit  Free cutting policy Doc. §3.1 > CEOS ICF > Metadata File (XML) > Signal Data File (binary) 1 1..* > Allows partitioning

5. Data SG – Archive Task Team - 9th May 2002 Partitioning – Declaration  New markup:  Moved attribute: “src”  Updated Naming convention  New markup:  Moved attribute: “src”  Updated Naming convention ceos_icf signal_data subset block signal_data 1 subset 1..* block 1 start : dateTime stop : dateTime 1999-03-12T09:37:12.354666 1999-03-12T09:46:52.223553 … Examples ERS-1-19980225103347732-19980225102345876-1.dat ERS-1-19980225103347732-19980225102345876-2.dat

6. Data SG – Archive Task Team - 9th May 2002 CEOS ICF Namespace  New XML Namespace: http://wgiss.ceos.org/ceos-icf-20020423  Proposed XML Schema location: http://wgiss.ceos.org/ceos-icf-20020423.xsd (TBC)  Use of xsd:targetNamespace in the CEOS ICF Schema  Recommend the use of xsi:schemaLocation  New XML Namespace: http://wgiss.ceos.org/ceos-icf-20020423  Proposed XML Schema location: http://wgiss.ceos.org/ceos-icf-20020423.xsd (TBC)  Use of xsd:targetNamespace in the CEOS ICF Schema  Recommend the use of xsi:schemaLocation Doc. §4.1 <ceos_icfxmlns=”http://wgiss.ceos.org/ceos-icf-20020423“ xmlns:xsi=”http://www.w3.org/2001/XMLSchema-instance” xsi:schemaLocation=”http://wgiss.ceos.org/ceos-icf-20020423 http://wgiss.ceos.org/ceos-icf-20020423.xsd”> …

7. Data SG – Archive Task Team - 9th May 2002 Blocks

8. Data SG – Archive Task Team - 9th May 2002 Block interface occurrence : positiveInteger > block name : string type : string offset : positiveInteger length : positiveInteger name : string type : string offset : positiveInteger length : positiveInteger

9. Data SG – Archive Task Team - 9th May 2002 Composite block composite 117235 6120

10. Data SG – Archive Task Team - 9th May 2002 Telemetry map telemetry_map downlinkOffset : positiveInteger downlinkLength : positiveInteger property [*] : string downlinkOffset : positiveInteger downlinkLength : positiveInteger property [*] : string

11. Data SG – Archive Task Team - 9th May 2002 Telemetry map - example 2 200 25 pn_decoded compressed

12. Data SG – Archive Task Team - 9th May 2002 Timestamp time_stamp Facility facility

13. Data SG – Archive Task Team - 9th May 2002 Timestamp - example 2 ESA FUCINO ITALY TMFR 1.4.0

14. Data SG – Archive Task Team - 9th May 2002 Quality flag quality_flag 1

15. Data SG – Archive Task Team - 9th May 2002 ERS example 1999-03-12T09:37:12.354666 1999-03-12T09:46:52.223553 6541 253 3 253 253 28 259 253

16. Data SG – Archive Task Team - 9th May 2002 The “Data Request Broker” - DRB

17. Data SG – Archive Task Team - 9th May 2002 + extension DRB Derby Software

18. Data SG – Archive Task Team - 9th May 2002 DRB architecture Applications Data Request Broker (DRB) XQuery Engine Schema File SDF XML docs Directories & Files XQuery scripts XML HDF HDF files Binary files ENVISAT-PDS Formats Landsat 5/7 CEOS, Fast SPOT 123-4 etc. Interface Implementations Data sources Facilities XML Schema CEOS ICF SPOT 5 - DIMAP

19. Data SG – Archive Task Team - 9th May 2002 Derby software (demo)

20. Data SG – Archive Task Team - 9th May 2002 ESA + Industry Format design iterative loop Application 1 – Sharing knowledge description ESA CAO Control Authority Office Version management ESA + Industry Processor design in ground segments Validation, non regression ESA PDCC Long loop Quality Control ESA Ground segments Product Quality Control Other agencies Archive interchange End users Data display, analysis Sciences community Multi-disciplinary approach ENVISAT AATSR XML Schema ENVISAT MERIS XML Schema ENVISAT ASAR XML Schema ERS SAR XML Schema

21. Data SG – Archive Task Team - 9th May 2002 Application 2 – Towards a generic transcription 1 – Physical + logical transcription FRED to MDPS semantic translation MDPS writerFRED reader MDPS baseband Archive FRED baseband Archive CEOS ICF format Generic « EO mission » model CEOS ICF interchange Archive CEOS ICF to MDPS semantic translation FRED to CEOS ICF semantic translation FRED reader DOM MDPS writer DOM

22. Data SG – Archive Task Team - 9th May 2002 2 - Logical transcription (DRB) FRED to MDPS semantic translation DRB / SDF Application 2 – Up to a generic transcription MDPS XML Schema CEOS ICF XML Schema or Generic « EO mission » model FRED XML Schema CEOS ICF interchange Archive MDPS baseband Archive FRED baseband Archive CEOS ICF to MDPS semantic translation FRED to CEOS ICF semantic translation DRB / SDF DRB / XML DRB / SDF DRB / XML

23. Data SG – Archive Task Team - 9th May 2002 Application 2 – Up to a generic transcription 3 - Generic transcription MDPS XML Schema CEOS ICF XML Schema or Generic « EO mission » model FRED XML Schema Generic translation engine DRB / SDF CEOS ICF interchange Archive MDPS baseband Archive Generic translation engine FRED baseband Archive Generic translation engine DRB / SDF DRB / XML DRB / SDF DRB / XML

24. Data SG – Archive Task Team - 9th May 2002 Thank you !