1. www.SAFORAH.org Grid-enabled OGC Environment for EO Data and Services in Support of Canada’s Forest Applications Hao Chen 1, David G. Goodenough 1,2, Liping Di 3, Aimin Guan 1, Andrew Dyk 1 and Geordie Hobart 1 1 Natural Resources Canada, Canadian Forest Service, Canada 2 Department of Computer Science, University of Victoria, Canada 3 Center for Spatial Information Science and Systems George Mason University, USA © September 25, 2007

2. www.SAFORAH.org Outlines  Background information  Data grid  Grid services  OGC user interfaces  CUDOS  Applications and impact  Conclusions

3. www.SAFORAH.org Background  Canada contains 10% of the world’s forests. To monitor forest resources, large amounts of Earth Observation (EO) data are collected by the Canadian Forest Service (CFS) and stored at various locations across Canada.  Most of EO data are currently managed separately by each research group from acquisition to archiving. To enhance EO collaboration within CFS and improve the return on investment of data purchases, new systems leading to a greater pooling of EO data resources are required.  SAFORAH or System of Agents for Forest Observation Research with Advanced Hierarchies is a grid computing infrastructure to manage, catalogue and archive EO data within a geographically distributed network of diverse computational resources.  EO data in SAFORAH is available through either a set of OGC Web services or the Catalogue and User Data Ordering System (CUDOS).

4. www.SAFORAH.org Forest Monitoring with Remote Sensing

5. www.SAFORAH.org SAFORAH Participating Partners  Natural Resources Canada (NRCan)  Canadian Space Agency (CSA)  GeoConnections  University of Victoria (UVic)  Center for Spatial Information Science and Systems (CSISS) George Mason University (GMU)  MacDonald, Dettwiler and Associates Ltd. (MDA)  Environment Canada (EC)  Agriculture and Agri-Food Canada (AAFC)  BC Common Information Technology Services (CITS)  Canada Foundation for Innovation (CFI)

6. www.SAFORAH.org SAFORAH System Architecture

7. www.SAFORAH.org Grid Computing  Provides middleware for seamless, scalable and secure access to a wide variety of geographically distributed computational resources: data storage facilities, supercomputers, computer clusters...  Hides the complexity of the infrastructure from users and presents them a single unified resource to solve large scale computational problems.  Supports collaborative and national applications in a dynamic virtual-organization (VO) environment.

8. www.SAFORAH.org Open-Source Grid Middleware  The Open Grid Services Architecture (OGSA) developed by the Global Grid Forum specifies a set of standard interfaces for the Grid services. (as architecture)  The Web Services Resource Framework (WSRF) is a product of the Open Grid Forum and states the relationship between stateful resources and Web services that OGSA needs. (as infrastructure)  Globus Toolkit 4 (GT-4) for service-oriented grids: An open source software toolkit used for building grids by the Globus Alliance (http://www.globus.org); Realization of the OGSA requirements; First implementation of WSRF; Development of grids having a service-oriented-architecture (SOA). Main Grid software to establish the SAFORAH data Grid.

9. www.SAFORAH.org SAFORAH Grid Connectivity   SAFORAH data grid networks Digital certificate signed by Grid Canada; CANARIE fibre backbone across Canada at 10 Gbps. Connection in progress Operational connection

10. www.SAFORAH.org EC GWCS PFC GWCS AFC GWCS EC GWCS Grid-enabled Services and OGC Service Portals Globus Toolkit 4.0.4 HDF-EOS GeoTIFF WCS Portal CSW Portal Client Other OGC Services GCSW WMS Portal Grid Tier ROS MDS CGS GWCS ( PFC) OGC Tier User Tier RLS Metadata GWMS ( PFC)

11. www.SAFORAH.org Grid-enabled OGC Services  Grid-enabled Web Coverage Service (GWCS) provides access to distributed EO data and information products managed by the SAFORAH data grid.  Grid-enabled Web Map Service (GWMS) responses to user’s rendering requests to dynamically produce static maps from geo- referenced EO data managed by the SAFORAH data grid.  Grid-enabled Catalogue Service for Web (GCSW) provides Grid- based archiving, publishing, managing, and querying of geospatial data and services and facilitates transparent access to the replica data and related services under the Grid environment.  Grid-enabled OGC services Work as Grid services. Allow authorized Grid clients to access and interact with the services directly. Allow other OGC clients to access these Grid-enabled OGC services through the OGC Web portals.

12. www.SAFORAH.org Replica Location Service (RLS)  Intend to be one of a set of services for providing data replication management in grids.  Maintain and provide access to mapping information from logical names for data items to target names.  Include Local Replica Catalog (LRC) and Replica Location Index (RLI) ― Aggregated state information contained in one or more LRCs.  RLS requires: ODBC Recommended version 3.51.2 MYODBC Recommended version 3.51.10 MySQL Recommended version 4.1.21 LRC/RLI Server ODBC (libiodbc) MYODBC MySQL Server DB LRC (2) RLI (1)RLI (2)

13. www.SAFORAH.org Replica and Optimization Service (ROS)  Use RLS and MDS to provide replica and optimization service.  Monitoring and Discovery System (MDS) is a GT-4 service and provides information about available resources on the Grid and their status. Determine which host has lowest workload and fastest response time to service a user request.  RLS provides all possible host names containing replica data from available grid nodes where physical data are stored.  ROS selects an optimized source for service. RLS ROS MDS

14. www.SAFORAH.org Control Grid Service  Control Grid Service (CGS) is a central management service, which takes EO data request from a portal and works with other Grid services collectively to generate response for the user’s request. WCS Portal WMS Portal GCSW GWCS GWMS CGS RO S RLS

15. www.SAFORAH.org WCS, CSW and WMS Portals  Three OGC Web portals were implemented and act as the common interfaces for OGC users and other OGC enabled geospatial information systems. Web Coverage Service (WCS) v1.0.0 Web Map Service (WMS) v1.3.0 Catalogue Service for Web (CSW) v2.0  The portals convert a standard OGC request to a Grid-enabled service request or unwrap a Grid service response back to a standard OGC service response so that OGC users can seamlessly access EO data in the SAFORAH grid.  Portals have the responsibility for user access control and for signing into the SAFORAH data Grid using Grid Canada credentials.

16. www.SAFORAH.org OGC Portals Access  OGC services offered by SAFORAH WCS WMS CSW  Portal validations Open GIS Test Suite (http://cite.opengeospatial.org) NFIS Test Server (https://ca.nfis.org). Operation NameGET/POST GetCapabilitieshttp://www4.saforah.org/WCSPortal/WCSPortal? DescribCoveragehttp://www4.saforah.org/WCSPortal/WCSPortal? GetCoveragehttp://www4.saforah.org/WCSPortal/WCSPortal? Operation NamePOST GetRecordhttp://www4.saforah.org/GridCSFPortal/GridCSFPortal? Operation NameGET/POST GetCapabilitieshttp://www4.saforah.org/WMSPortal/WMSPortal? GetMaphttp://www4.saforah.org/WMSPortal/WMSPortal?

17. www.SAFORAH.org  Act as a online portal to the SAFORAH data Grid.  Support a variety of remote sensing satellites, sensors, and image types.  Web access:http://www.saforah.org Catalogue and User Data Ordering System (CUDOS) (by MacDonald, Dettwiler and Associates Ltd.)

18. www.SAFORAH.org  Example Metadata in CUDOS

19. www.SAFORAH.org  Example of a remote sensing image (near Ottawa) from SPOT-4:  Authorized users can download/ingest EO images from/to the data grid via CUDOS. CUDOS: Browse Image and Geological Location View full size browse image button Geographical location indicator map

20. www.SAFORAH.org Access Data via CUDOS or WCS Service grid service User defined geo-objectOriginal data set Legend: User request User request: User received: CUDOS deliveryOGC delivery Original data set:

21. www.SAFORAH.org SAFORAH Application Example - EOSD  The Earth Observation for Sustainable Development (EOSD) of Forests is an initiative of the Canadian Forest Service in partnership with the Canadian Space Agency to create products for forest inventory, forest carbon accounting, monitoring sustainable development, and landscape management.  Four Canadian Forestry Centres work in partnership with the Provinces and Territories to develop forest cover, biomass, and change maps of Canada’s forests. Pacific Forestry Centre, Victoria British Columbia Atlantic Forestry Centre, Cornerbrook Newfoundland Northern Forestry Centre, Edmonton Alberta Laurentian Forestry Centre, Québec  More than 1700 Landsat (TM/ETM+) images for all of Canada were used to develop forest information products.

22. www.SAFORAH.org EOSD Landcover Products Coverage  Based upon the national topographic database (NTDB) national topographic system (NTS) map sheet framework and available for download on a 1:250,000 NTS map sheet basis. Each map sheet represents an area of approximately 14,850 square kilometers.  Total 630 tiles for the circa 2000 coverage.

23. www.SAFORAH.org EO Images and Derived Information Products  Current EO images and information products in SAFORAH OGC access available EO PlatformNumber of imagesCoverageAccess Landsat TM884CanadaPublic Landsat ETM+876CanadaPublic Radarsat 1>10Variable coveragePFC, AAFC Envisat ASAR28Hinton, Petawawa, RadissonPFC,LFC Envisat MERIS11Hinton, Petawawa, RadissonPFC,LFC Spot 3/4/5>3Hinton, OttawaPFC, AAFC Airborne AVIRIS314Variable coverage of CanadaPFC AirSAR>32GVWDPFC PROBA-1 CHRIS>167Variable coverage of CanadaPFC ASTER>11GVWDPFC EO-1 Hyperion>13CanadaPFC EO-1 ALI>14Hinton, GVWD, OttawaPFC, AAFC EOSD Landcover630Across CanadaPublic Canada Mosaic3Canada 2000 and 1990Public “>” Data ingestion in progress

24. www.SAFORAH.org Conclusions  Built the SAFORAH data grid with GT-4 over CANARIE broadband networks to provide seamless, scalable and secure access to a wide variety of geographically distributed computation resources.  Supported EO data collaboration for national forest monitoring programs in a dynamic virtual-organization (VO) environment (part of Grid Canada).  Implemented and deployed grid services in the GT-4 environment, which will lead to the next phase that is the evolution of real time EO data processing by using the supercomputer facilities and petabyte data storage utilities at the University of Victoria.  Provided standard OGC interfaces, including WMS, WCS and CS/W, to enhance information interchange with other geospatial information systems, including the Canadian Geospatial Data Infrastructure (CGDI).

25. www.SAFORAH.org Acknowledgements  Support from: Natural Resources Canada, Canadian Space Agency, GeoConnections, Department of Computer Science at the University of Victoria, The National Forest Information System (NFIS).  DGG is also grateful for the support of the Natural Sciences and Engineering Research Council of Canada (NSERC).