® Reading meeting. December 12-14th, 2011 QUAlity aware VIsualisation for the Global Earth Observation system of systems GCI Analysis December 12-14th, 2011 University of Reading CREAF-UAB

Reading meeting. December 12-14th, Numbers Total metadata records in the Clearinghouse –97203 Metadata records with quality indicators –19107 Total number of quality indicators –52187 Metadata records with lineage –10899 (9261 process, 3771 source) Metadata with usage –1226

Reading meeting. December 12-14th, Methodology Harvest (download) all XML documents Massive extraction of MD quality elements –Quality elements –Lineage –Usage PTB. London th December 2011 UAB. WP XML documents XLS Table document GestBD Xpath extraction CSW GEOSS Clearinghouse

Reading meeting. December 12-14th, Quality indicators 19.66% Metadata records with quality 2.7 quality indicators per document

Reading meeting. December 12-14th, Quality indicators

Reading meeting. December 12-14th, Quality indicators GEOSS IDEC

Reading meeting. December 12-14th, Quality indicator values Quantitative22275 Conformance 3669 (mainly conformance to INSPIRE) Coverage5

Reading meeting. December 12-14th, Extension for "per pixel" quality

Reading meeting. December 12-14th, Coverage result (ISO extension) Clearinghouse record: , , , , ) Only 5 records use this. Bad news for visualizing data + quality maps Title: OMNO2e:OMI Column Amount NO2:ColumnAmountNO2CS30 The 'version 003' product is the second public release. It is based on improved radiance calibration. For details, please see document: grid CF-netCDF

Reading meeting. December 12-14th, LI_Lineage ? ?

Reading meeting. December 12-14th, LI_Lineage: MD_Source with temporal extent This is the simplest way to mention that this resource was derived from previous (re)sources Gives credit (attribution, and eventually some trust on them) Allows some from of descriptive quality report based on sources

Reading meeting. December 12-14th, LI_Lineage: MD_ProcessStep MD_ProcessStep only 292 with date Information on the exact list of processes execution and the order of these processes. Difficult to infer resource quality with only a process list class From_LI_ProcessStep_to_LI_Source LI_ProcessStep +description :CharacterString +rationale :CharacterString [0..1] +stepDateTime :TM_Primitive [0..*] +processor :CI_ResponsiblePartyInfo [0..*] +reference :CI_Citation [0..*] +scope :DQ_Scope [0..*] LI_Lineage +statement :CharacterString [0..1] +scope :DQ_Scope [0..*] constraints {"source" role is mandatory if LI_Lineage.statement and "processStep" role are not documented} {"processStep" role is mandatory if LI_Lineage.statement and "source" role are not documented} Metadata Information::MD_Metadata +processStep 0..* +resourceLineage0..*

Reading meeting. December 12-14th, True Provenance: MD_ProcessStep with MD_Source 1226 cases List of processes execution and the order of these processes How and when the data sources where used We can deduce which sources have more influence in the quality of the final result

Reading meeting. December 12-14th, Complete provenance in ISO LI_ProcessStep includes a LE_Processing that has a runTimeParameters attribute that allows us describing the exact list of parameters used in the execution. Exact information needed to execute the process and to reproduce it. There is a citation of the algorithm used (LI_Algorithm). We can completely evaluate de quality of the resulting product if we know the uncertainties that sources have in their metadata (sourceMetadata citation in LI_Source).

Reading meeting. December 12-14th, MD_ProcessStep with MD_Source Example Clearinghouse record (simplified) Compile survey input data from the best and most current survey records. –BLM database of the index to all official (microfilm, CD, other) BLM survey records. –USFS survey records. –Private land surveyor records –GCDB Data Collection Attribute Definitions Version 2.0, Appendix A, 2/14/1991. Survey records used - source abbreviations. Compile listings of known locations of PLSS corners. –USGS topographic quadrangles and other sources. –USC&GS published coordinate data. –NGS published coordinate data. –BLM global positioning Data. –USFS global positioning data. Coordinates of control stations are entered into a control data base with associated reliabilities. Topologically correct GIS coverages are modified to use FGDC compliant naming conventions and then loaded into the LSI database. These layers can then be downloaded as shapefiles through the LSI website. GCDB Data was downloaded for Kiowa and Cheyenne Counties, Colorado. –C:\f\gis_data\sand\zipped\kiowa\twnshp.shp.xml Metadata imported and data was exported from regions format to shapefile format Dataset copied. –C:\f\gis_data\sand\data\basedata\plss\ck_gcdb_region_township Source Contribution: Survey data in the form of official (microfilm, CD, other) survey and BLM, abstracted into a vector digital format.online Source Contribution: Survey and control data from the Cartographic Feature File (CFF) data set.disc Source Contribution: Digitized control data from standard topological quadrangle sheets.disc

Reading meeting. December 12-14th, User feedback There is one an small entry for user feedback in the current ISO-19115: MD_Usage –Brief description of ways in which the resource is currently or has been used

Reading meeting. December 12-14th, MD_Usage –specificUsage brief description of the resource and/or resource series usage –usageDateTime date and time of the first use or range of uses of the resource and/or resource series –userDeterminedLimitations applications, determined by the user for which the resource and/or resource series is not suitable –userContactInfo identification of and means of communicating with person(s) and organization(s) using the resource(s) There are 1133 entries (only specificUsage and userContactInfo) ALL MADE BY ONE PERSON!!: –Landesvermessung und Geobasisinformation Brandenburg (LGB) –Tel , Fax –Heinrich-Mann-Allee 103, Potsdam, Brandenburg 14473, Deutschland –

Reading meeting. December 12-14th, Conclusions Quality indicators are present and in many different kinds –A previous study in the Catalan SDI shows a worse situation Lineage information is rich in many documents with some documents with more that 100 entries in source or processSteps We have usage examples Quality coverage results (by pixel) are almost inexistent an the link not there Current data is enough to demonstrate search and visualization with some limitations Summary data tables and metadata xml files are available to the group to work with.

Reading meeting. December 12-14th, Presented to EuroGEOSS conference The EC as D7.2 deliverable If possible, we will extent this study to some of the capacity catalogues

® Reading meeting. December 12-14th, 2011 QUAlity aware VIsualisation for the Global Earth Observation system of systems Thank you!