Presentation is loading. Please wait.

Presentation is loading. Please wait.

GTS MetaData Generation data GTS data bases GTS Switch www.wmo.int Volume C1 Central Support Office Information Classes white-list Metadata Synchronization.

Similar presentations


Presentation on theme: "GTS MetaData Generation data GTS data bases GTS Switch www.wmo.int Volume C1 Central Support Office Information Classes white-list Metadata Synchronization."— Presentation transcript:

1 GTS MetaData Generation data GTS data bases GTS Switch www.wmo.int Volume C1 Central Support Office Information Classes white-list Metadata Synchronization Data Replication Local Data bases Metadata Portal Catalogue Node Data Repository Ingestion Module MD generation Module Retrieve Module GTS MD GTS cache index MSS Feeding Module 1 – Download remote inputs : - WMO FTP server : GTS bulletins Catalogue : WMO Volume C1, - central server (for homogeneity) : Information Classes (information needed to populate the Metadata tags)  WMO documents in program-readable formats,  information collected from several sources  association tables built for the purpose. - central server : White-list to deal the GTS Metadata publishing responsibilities 2 – Process Bulletins : - Enrich the local copy of Volume C1 with decoded information. - Apply a set of rules to filter bulletins. - Extract relevant information from bulletins definitions and information classes, build the metadata fragments & collect them into metadata files. - Build the index of locally published metadata for the future association of metadata files with bulletin instances. Also store information necessary for the future processing of bulletin instances. 3 – Update the Catalogue & Portal : - Generated metadata files are harvested by the Node. - Relevant information is extracted from the metadata to build the portal descriptions of the products. - Relevant metadata blocks are indexed for free-text search via the portal. VGISC SIMDAT Technology M é t é o - F r a n c e D S I / D E V - J e a n - P i e r r e A u b a g n a c - 2 a p r i l 2 0 0 8 www.wmo.int Volume C1 Central Support Office Information Classes white-list MD generation Module GTS MD index

2 GTS Metadata Generation contact fragment (XML) abstract fragment (XML) topic fragment (XML) 1 st descriptiveKeywords fragment (general hierarchical keywords: discovery) (XML) 2 nd descriptiveKeywords fragment (hierarchical content keywords) (XML) citation fragment (XML) extent fragments (XML) vgisc fragment (XML) GTS Metadata fileIdentifier fragment (XML) metadataConstraint fragment (XML) TTAAii (XSLT) NoaaStations Volume A (XML) fm C13table Content Keywords (XML) Topic Category (XML) Volume C1 (XML) XSLT motor www.wmo.int TimeGroup rule, unicity criterion CodeForm rules Content rules responsibleparties DO (XML) DOdefault (XML) retainE (XSLT) « improved » Volume C1 (XML) RE to provide content keywords for grid point bulletins M é t é o - F r a n c e D S I / D E V - J e a n - P i e r r e A u b a g n a c - 2 a p r i l 2 0 0 8 Interpretation Rules & Information Classes  Information extraction rules match regular forms for the fields of Volume C1 definitions. They could be proposed as instructions for Volume C1 declarations.  New formats developed for WMO sources could be proposed as alternate formats for those sources.  Information collected from sparse sources or constructed from scratch show a need that our classes could fill as first drafts. WMO Core Profile version 1.0 of the ISO19115 standard

3 GTS Ingestion data GTS data bases GTS Switch www.wmo.int Volume C1 Central Support Office Information Classes white-list 1 – Listen to the GTS flow : - GTS bulletins collected into files according to WMO FTP Protocol appear in one or several repositories (channels of the Message Switching Service). - GTS bulletins are extracted & filtered according to their Abbreviated Header. 2 – Process (Instances of) Bulletins : - GTS bulletins with abbreviated headers matching an entry in the metadata index are inserted into the local database. - Merging the metadata index built during the local generation with (all or part of) the index built during generation at another site enables the local ingestion of remotely published bulletins. 3 – « Forward » bulletins : - The Node regularly prompts the data repository for the list of newly available products, as they may be concerned by a subscription request. - Newly inserted bulletins concerned by replication should be proposed to the replication mechanism. Metadata Synchronization Data Replication Catalogue Data Repository Local Data bases Metadata Portal MD generation Module Retrieve Module Node GTS MD GTS cache index MSS Feeding Module Ingestion Module M é t é o - F r a n c e D S I / D E V - J e a n - P i e r r e A u b a g n a c - 2 a p r i l 2 0 0 8 GTS cache index Ingestion Module (Replication) GTS Switch VGISC SIMDAT Technology

4 Retrieve GTS product VGISC SIMDAT Technology data GTS data bases GTS Switch www.wmo.int Volume C1 Central Support Office Information Classes white-list 1 – Discover the product : - GTS bulletins can be discovered on the portal under a variety of keyword hierarchies (sorted by type and / or location, by content keywords) as defined in the metadata. - GTS bulletins can also be discovered by free-text search (content of indexed metadata tags). 2 – Define the request : - Instances of a given GTS bulletin can be requested by selecting an hourly time- slot & a date slot. The metadata defines the choices offered for each parameter: the proposed hours reflect the regular transmission times of bulletin instances, the date slot is bounded by the local database storage depth policy. - GTS metadata offer both retrieve options: one-time only pull & subscription. 3 – Retrieve bulletins : - The request is forwarded by the Node to the Retrieve module and translated into database extraction criteria. - Extracted products are returned to the Node. Metadata Synchronization Data Replication Catalogue Data Repository Local Data bases Metadata Portal MD generation Module Node GTS MD GTS cache index MSS Feeding Module Ingestion Module Retrieve Module M é t é o - F r a n c e D S I / D E V - J e a n - P i e r r e A u b a g n a c - 2 a p r i l 2 0 0 8 Portal GTS cache Retrieve Module

5 MSS Feeding data GTS data bases GTS Switch www.wmo.int Volume C1 Central Support Office Information Classes white-list 1 – Filter products forwarded by the replication : - Refuse products already present in the local database (match sought on the bulletin identifiers independently of the ingesting data repository). - Accepted products are inserted into the local database and retain the detail of their ingesting data. 2 – Forward Bulletins : - Declare locally published but remotely ingested bulletins to the Node. - Forward the newly inserted bulletins to the local MSS: sort the bulletins by WMO Code Form, collect them into files (WMO FTP protocol) and deposit them in the local MSS repository. Metadata Synchronization Data Replication Catalogue Data Repository Local Data bases Metadata Portal MD generation Module Retrieve Module Node GTS MD GTS cache index MSS Feeding Module Ingestion Module (Replication) M é t é o - F r a n c e D S I / D E V - J e a n - P i e r r e A u b a g n a c - 2 a p r i l 2 0 0 8 GTS Switch GTS cache MSS Feeding Module VGISC SIMDAT Technology


Download ppt "GTS MetaData Generation data GTS data bases GTS Switch www.wmo.int Volume C1 Central Support Office Information Classes white-list Metadata Synchronization."

Similar presentations


Ads by Google