Presentation on theme: "Understanding and Implementing WMO INFORMATION SYSTEM"— Presentation transcript:
1 Understanding and Implementing WMO INFORMATION SYSTEM World Meteorological Organization Working together in weather, climate and waterUnderstanding and ImplementingtheWMO INFORMATION SYSTEMDavid Thomas (WMO)RA VI WIS WorkshopAbstractThe aim of this presentation is to demystify the concept of implementing WIS for NC and DCPCs. The relationship between the WIS and the GTS is explained in the context of the evolution of the GTS and the addition of the new functionalities of WIS. It summarises the technical specifications as they apply to a typical DCPC or NC, providing introductory level descriptions of the seven compliance areas described in the 15 WIS interfaces, including:Discovery Metadata for Data and Products;Uploading of Data and Products;Discovery, Access and Retrieval (DAR);Downloading Data & Products;Dissemination Metadata;User Identification and Role management; andReporting of Quality of Service.The relationship of WIS with data management are included, including data representation and various World Weather Watch catalogues such as Vol A and C.1
2 Global Telecommunication System (GTS) RTHRegional Telecommunication HubNMCNational Meteorological CentreDCData CentreMost WMO people are at least a little familiar with the GTS. The Main Telecommunication Network (MTN), linking together three World Meteorological Centres (WMCs) (Melbourne, Moscow and Washington) and main Regional Telecommunication Hubs (RTHs)Regional Meteorological Telecommunication Networks (RMTNs) each support one of the six WMO regions - Africa, Asia, South America, North America, Central America & the Caribbean, South-West Pacific, Europe and Antarctic – feeding information to and from the MTN centres to NMCs. RA VI RMTN is the RMDCN MPLS managed by ECMWF on behalf of RA VI. This MPLS network has been extended under the IMTN project to replace the MTN technology to MPLS. Technology of the RMTNs varies and includes suplementry collection and distribution though satellite systems that used to be referred to as Advanced Dissemination Methods (ADM). It includes in RA VI the EUMETCAST which in turn supports the French and German satellite distribution systems. RA V has the most diverse with three MPLS networks, several FR links or international private lines as well as radio and satellite networks. RA III has moved to largely VPN over the internet solutionsThe National Meteorological Telecommunication Networks (NMTNs) enable the National Meteorological Centres (NMCs) to collect observational data and receive and distribute meteorological information on a national level.The main problem with the GTS is that is grew in the WWW programme and is difficult for other programmes to utilise
3 WMO Information System WIS National Centres (NC)Collect and/or produce national informationData Collection or Production Centres (DCPC)Collect and/or produce regional or international information or act as communications hubsGlobal Information System Centres (GISC)Hold WMO metadata catalogue, 24hr GTS cache, and act as core communications hubsDiscovery, Access & Retrieval (DAR)Data communication networkGTS, satellite two way and broadcast systems, internet, etcCore networkArea based networks (AMDCN)WIS is based on four main components, NCs, DCPCs, GISCs and data networks. These are described here. The networks include the core network connecting GISCs and AMDCNs which connect NC and DCPCs to their principal GISC. The internet is also an integral part of WIS, being used in the AMDCNs as well as a way for non GTS or WMO centres to connect into WIS.
4 WIS / GTS Cloud I & II merged using RMDCN MPLS and add Internet -> WIS Core Network & AMDCNsThe relationship of the WIS can be seen here where the WIS core network utilizes the MTN, shown here as two clouds that merged into one based on the RMDCN MPLS network.The GTS here is depicted as the typical spaghetti diagram with the aim of showing that the GTS is an integral part of WIS so that at least initially the role out of WIS will reveal little impact on NMHS until they decide to take advantage of the new WIS extensions in capability.The AMDCNs are not restricted to the regional structure and may be made up of subparts of various RMTNs or as in RA V, be a direct mapping.
5 Internationally coordinated network of WMO GDPFSGOSWIS / GTSPartnershipsAll WMO ProgrammesHere we see that WMO programmes are supported by the traditional GOS and GDPFS, as well as various partnerships. The WIS,including its GTS components is the connectivity between all programmes, the supporting WWW systems and those of partners
6 marine warnings in area bounded by 40W to 10W and 45N to 70N Search Requestmarine warnings in area bounded by 40W to 10W and 45N to 70NGISC – DAR serviceSecurity/authentication/authorization and even charging is managed by each service providerSearch ResultsInformation request to custodianUser searches for metadata then retrieves information from data custodianRetrieve informationCentre publishes metadata to GISC DAR catalogueSlideThis slide shows how WIS discovery access and retrieval works. Information paths will vary. For instance, a user finding information in the GISC catalogue will be directed to the data custodian, most likely a DCPC or NC to access the information. In this way, all the security, charging and volume measurements are managed at the data download stage by the custodian, not by the GISC. For instance, using the Global Marine Distress Signal System (GMDSS), a user could be directed to the GMDSS web site as follows:The GMDSS publishes its metadata to the GISC catalogue (advising it has forecasts and warnings for Metarea One)The user wants to search the metadata and retrieve information (for example “marine warnings in area bounded by 40W to 10W and 45N to 70N”)The user searches the GISC DAR service for information (ie sends a search request to the GISC)The DAR returns a list of solutions to the user (such as a sorted list of possible marine forecasts and warnings registered at the GISC – several of which point to the websiteThe user selects a solution and visits the custodians centre, in this case the GMDSS websiteThe centre then downloads the data to the requestorSecurity, authentication, authorization and even charging mechanisms are managed by the centre. WIS does not try to enter into financial actions or, outside of collaborative virtual organisation agreements, try to pass user roles or validation to the custodian.DAR in WISNC/DCPC information access service
7 Service Oriented Architecture SOA Interoperability is reduced to 15 interface standards (7 areas)Uploading of Discovery Metadata for Data and ProductsDAR Metadata CatalogueUploading of Data and ProductsCache of current Globally Distributed DataDiscovery, Access and Retrieval (DAR)Downloading Data & Productsvia Dedicated Networksvia Non-dedicated Networksvia Other MethodsMaintenance of Dissemination MetadataDissemination Metadata CataloguesMaintenance of User Identification and Role InformationSharing of Identification and Role InformationUser AuthenticationAuthorization of a User RoleReporting of Quality of ServiceBeing a part of WIS requires centres to comply with standard interfaces where they interact with other WIS centres. They only need to comply with those interfaces that are relevant to the parts of WIS they wish to utilize. There are seven areas these 15 interfaces or standards apply to. They are listed in the slide.Although seemingly complicated, for any one NC or DCPC, apart from the new area of metdata, there is little that needs to be changed, rather it is more about documenting what you do. GISCs of course, have to do all these things and are a new type of specialist centre essential for the inclusion of the new metadata and DAR components of WIS.
8 Discovery Metadata Online Guide Start-up metadata done for GTS bulletinsReview and update (Liaise with GISC)Add metadata for high profile/priority productsEstablish own metadata mgt systemLiaise with GISC to agree on how to upload metadataWIS metadata is to support search and usageDon’t worry about the XML (ISO19139)That is for the tool developers to worry aboutThere is an online guide for NC and DCPC wanting to take advantage of the new WIS and to assist in their setting up of metadataMeteo France has established the startup metadata for the GTS bulletins. It would be ideal if all NMHS and DCPCs liaise with their principal GISC to review the startup metadata and update relevant information such as their proper contact points. They should also add metadata for those data and products they wish to add to expand beyond jsut the GTS bulletins. This is like taking our advertising for your products and services.Initial management of metadata can be done through interfaces and services established by the GISC who you will need to arrange user names and access procedures. The GISCs will provide training and workshops to those centres in their RMDCN to help in this aspect.Once they understand the metadata functions, centres should consider setting up their own metadata management systems. The secretariat can help with this and it can be done utilizing the WIS jumpstart offer. It does require a certain technical level to be present at the centre and you will have to agree with the GISC on how you will upload the metadata to them.For most people, it will not be necessary to go into the weeds of metadata as the XML and complicated components are handled by the metadata management tools. It will only be necessary to get into the weeds if you wish to build your own metadata tools.Populating the metadata will take resources but the benefits are huge
9 More about Metadata Content of metadata is much like library cards abstract, title, author, keywords, format, identifier, coordinates (& CRS), plusTime related details of information or productTime related details of metadataContact information for metadata and for data/productLearn by doingTake advantage of user feedback to refine MDImprove orgnizational capacity to benefit from MDParticipate in and run MD workshopsPractice finding your metadata at different GISCsThis slide highlights some key points about metadata and provides a way to conceptualize what it is for. Anyone who has use a library card system or searched for a book has used metadata.Don’t feel you have to be an expert from day one. Learn by doing, and take advantage of feedback to improve your metadata. You should be able to go to a GISC and easily find your data, products and services. If you can’t then look at how to improve your metadata to be more effective. You can also help the GISC improve their DAR interfaces.
10 Uploading of DataThis only applies if you wish to upload data or products to WISGTS is the most common way, but for non GTS centres, the internet is most commonFTP, HTTP put, , etcOther paths include AFTN, DCPs, etcAgreement between centre and GISCGTS is described in Manual on GTSUploading of data is something all GTS centres are already compliant with adn only applies if you wish to put data into WIS. Many DCPC and NC just want people to find their information and come to established interfaces to access it.
11 Downloading of Data or Products Two components.Downloading from GISC/WIS to your centreOnly applicable if requiredAny method supported by GISCGTS centres follow manual on GTSInternet, via a DCPC, private lines, satellite, etcDownloading from your centre to usersAny method you supportThis is compulsory,Basic requirement of all NC/DCPCsDownloading of data and products is what most centres do anyway. You will just need to describe what and how you do it. If you do not supply information to users, then you should question if the centre should be registered at all in WIS.Downloading also includes those interfaces for getting information off the GTS be it via satellite broadcast systems such as EUMETCAST or via GTS links. This only applies if you wish to do it.
12 Dissemination Metadata Compulsory for RTH and GISCsOther DCPC/NC can maintain own dissemination MD for usersIf centres authorize GISC to distribute data or products to your users,need to share relevant distribution list with the GISC.Dissemination metadata is mainly of interest to RTHs, however, if you wish to get another WIS centre to disseminate information to your users then you will have to provide that information to the WIS centre so they know who to provide the information to, and what needs to be provided. This can be likened to a subscription service and some GISCs will provide quite advance subscription services where your users can edit online what they wish to have delivered or have access to. This will become much more important as WIS matures and centres are comfortable with using this capability.
13 User control NC/DCPCUser control is only applicable if a centre is offering access to protected or restricted data or subscription service.The system used is up to the centre but must be robust and not compromise WIS.Includes user identification and authority, etcWill be tested by seeing if a non regisetered user can access restricted data or logged in user can go outside their authorized areaStandards apply if sharing user data across centresAn important part of online services and participating in WIS is ensuring that you have good user control systems in place. However, many centres may chose to just have open access to their products and services on their web or via other means in their centre adn will not have to worry about complying with WIS user access control or user registration etc.
14 Quality of Service Monitoring Requires a commitment of a centre to participate in the monitoring still to be agreed by ET-WISC and ET-IOECMWF is already doing most of the expected monitoring on the RMDCN and centres can utilise this work.RTH will have greater requirements inlcuding the SMM type monitoring of the WWWAn import part of WIS will be ensuring that all WIS centres participate in performance monitoring of their systems. At this stage the metrics have still to be defined, although the work done by ECMWF for the RMDCN is typical of what might be expected. A commitment to participate is really all we can ask at the moment
15 Data representation and Codes The interfaces allow information to get onto and around on WIS, but …The data representation and coding affects the usability of dataWMO has standard practices and representations eg BUFR, GRIB, CREXMoving away from TACRTH have a major role in TAC-TDCF migrationAlso handle many other standardsNetCDF, XML, GML, CAP…Recommend contributors use common codesWIS is also interested in data representation and codes. This is what you do in the GTS already, although under WIS you will have more flexibility. However, we encourage people to use those practices and standards already defined in WIS to make life easier for all
16 Metadata and catalogues WIS requires DAR metadata (ISO19115)You can have metadata service onsite or rely on GISC serviceGISCs synchronize all their WMO DAR metadata catalogue with other GISCsYou only have to arrange publishing your metadata with your principal GISC but can see it at any GISCVol C1/C2 will be replaced by the DAR catalogues which are not limited just to bulletinsYou will subscribe to information in WISRouting tables will be replaced with subscription servicesVol A will continue as not all Vol A information will be in DAR metadataDAR metadata will tell you where to get more detailed informationThe word catalogue is used in many ways, This slide explains its usage in WIS for DAR metadata and explains how Vol C and A fit apply
17 Implementing WIS Build on SOA and interoperability Note that Metadata is a key standard for registering products and services and enabling DARMake the best of access to DARLiaise with your GISC & RTH on desired data and product representation and formats required by your centres and usersRegister your centres as DCPCs or NCs.Now WIS is being better understood by centres, we are finding that most people are surprised at how easy it really is to be compliant with WIS standards as they only apply to those features of WIS that are relevant to the centre. This is the SOA principle.Metadata is the key new element of WIS that applies to all and DAR is something that you can benefit from straight away.You should work with your GISC to implement WIS, it is not something to do in isolation.You should register your centre so the GISCs and other WIS centres can help you get up to speed as quickly as possible and start to reap the benefits that come with WIS
18 Manual on WIS says How To designate a DCPC or NC To comply with relevant interfacesTo demonstrate capability to CBS & Congress / ECDoes not say how to do Metadata yetBut the information is becoming availableDoes not say what has to be done for monitoring,But this too is coming.The RMDCN monitoring by ECMWF is a good indicator of what WIS will require monitoring of quality of service.Congress has approved the manual on WIS which tells you what you need to do for designating a centre as a DCPC or NC. Unfortunately it does not include the metadata details yet, although these are online. Also, it has yet to be determined what needs to be done for monitoring, but this is coming and will most likely reflect the type of practices already done in most ICT installations,
19 Questions Understanding WIS Role of the GTS in WISWIS Structure and WIS centresNew components (DAR metadata, catalogues)The secretariat can help with the WIS Jump Start, now incorporating experts from WIS centres