1. Page 1 CSISS Center for Spatial Information Science and Systems CWIC Metrics: Current and Future Weiguo Han, Liping Di, Yuanzheng Shao, Lingjun Kang Center for Spatial Information Science and Systems George Mason University CEOS 37th Working Group on Information Systems and Services Cocoa Beach, FL April 14-18, 2014

2. Page 2 CSISS Center for Spatial Information Science and Systems Contents Background System Architecture Metrics Information Collection Metrics Information Extraction Metrics Information Presentation Demonstration Conclusions

3. Page 3 CSISS Center for Spatial Information Science and Systems Background Answer questions from stakeholders, sponsors, partners, and other users like –How many users have accessed CWIC service during the past month? –How long is the average processing times for the GetRecordById request? –Which data collections or datasets of USGS LSI are queried most often? –Which countries are CWIC users from? With more integrated catalogs and more client requests, it is desired to develop mechanisms and metrics for determining reliability and quality of CWIC service –Catalogs: NASA ECHO, USGS LSI, GHRSST, INPE, and CCMEO –Clients: CWIC Start, USGS LSI Explore, etc

4. Page 4 CSISS Center for Spatial Information Science and Systems Background The previous procedure of creating monthly report was laborious and time consuming 1)Analyze the log file in a Java program 2)Extract monthly statistics information from program output 3)Fill these information in a word document 4)Submit to CWIC website for review and comment Metrics information could not be presented interactively and responsively

5. Page 5 CSISS Center for Spatial Information Science and Systems System Architecture

6. Page 6 CSISS Center for Spatial Information Science and Systems Metrics Information Collection CWIC Mediator retrieve and store information in the format as seen below when handling CSW requests from clients and responses from integrated catalogs

7. Page 7 CSISS Center for Spatial Information Science and Systems Metrics Information Retrieval Six Java classes are defined to hold the requesting information for catalog, operation, output, country, and dataset.

8. Page 8 CSISS Center for Spatial Information Science and Systems Metrics Information Retrieval Free Java Packages used –RandomAccessFile in java.io - avoid repetitive analysis –MaxMind GeoIP – recognize CWIC client information from its IP address –JSON.simple - encode and decode metrics information in JSON format

9. Page 9 CSISS Center for Spatial Information Science and Systems Metrics Information Retrieval

10. Page 10 CSISS Center for Spatial Information Science and Systems Metrics Information Retrieval Metrics information in JSON format –taking catalog access as an example  date indicates the day to which the record applies  failure means the numbered times of failed processing of that day  success represents the ones of successful processing of that day  visits is the total times of accesses to the specified catalog of that day

11. Page 11 CSISS Center for Spatial Information Science and Systems Metrics Information Representation Ext JS for building a responsive and intuitive Web dashboard like portal –free cross-browser AJAX framework –popular model-view-controller (MVC) pattern –a set of components, utilities, and APIs

12. Page 12 CSISS Center for Spatial Information Science and Systems Metrics Information Representation Data Flow among Components

13. Page 13 CSISS Center for Spatial Information Science and Systems Demonstration Two Instances Deployed on GMU CWIC Server and USGS CWIC Server –http://cwictest.csiss.gmu.edu/cwicmetrics/http://cwictest.csiss.gmu.edu/cwicmetrics/ –http://cwic.wgiss.ceos.org/cwicmetrics/http://cwic.wgiss.ceos.org/cwicmetrics/

14. Page 14 CSISS Center for Spatial Information Science and Systems Demonstration CWIC Access Trends in 2013

15. Page 15 CSISS Center for Spatial Information Science and Systems Demonstration CWIC User Distribution in 2013

16. Page 16 CSISS Center for Spatial Information Science and Systems Demonstration CWIC Service Performance in 2013

17. Page 17 CSISS Center for Spatial Information Science and Systems Demonstration GetCapabilities Access Trends and Performance by Day of Week in 2013

18. Page 18 CSISS Center for Spatial Information Science and Systems Demonstration GetRecords Access Trends and Performance by Day of Week in 2013

19. Page 19 CSISS Center for Spatial Information Science and Systems Demonstration GetRecordById Access Trends and Performance by Day of Week in 2013

20. Page 20 CSISS Center for Spatial Information Science and Systems Demonstration Most Often Requested Catalog and Dataset in 2013

21. Page 21 CSISS Center for Spatial Information Science and Systems Demonstration Most Often Requested Catalog and Dataset in 2013

22. Page 22 CSISS Center for Spatial Information Science and Systems New Instance of CWIC OpenSearch on USGS CWIC Test Server –http://cwictest.wgiss.ceos.org/cwicosmetrics/http://cwictest.wgiss.ceos.org/cwicosmetrics/ New Features in CWIC OpenSearch Metrics

23. Page 23 CSISS Center for Spatial Information Science and Systems Demonstration Request Counts by Client ID and Type

24. Page 24 CSISS Center for Spatial Information Science and Systems Demonstration Unique visitor Information parsed and reversed from IP address

25. Page 25 CSISS Center for Spatial Information Science and Systems Summary Drill-down into details of catalog and dataset of interest Display detailed service metrics in multiple dimensions Provide powerful indicators of CWIC performance Filter metrics on-the-fly and update visit statistics automatically Create the periodical reports in seconds Provide interactive tables and graphs Offer complete and detailed traffic analysis

26. Page 26 CSISS Center for Spatial Information Science and Systems Future Plan Add spatial extent and temporal range in the log file View metrics information by time of day Categorize failures and count by categories Send failure alerts to developers and data providers Add new features in CWIC CSW metrics application

27. Page 27 CSISS Center for Spatial Information Science and Systems Questions or comments? Thanks!