1. Presenter: Cindi Dunn, Principal Evaluator Office of Educational Innovation & Evaluation College of Education, Kansas State University June 13, 2013 EVALUATION AND ASSESSMENT 3 RD PARTY EXTERNAL EVALUATION NORTH GULF COASTAL HAZARDS COLLABORATORY TRACK II

2. “AREAS OF SUCCESS” METRICS 1.Cyberinfrastructure Improvement (Cyberinfrastructure Development; Simulation Experiments) 2.Research Production 3.Research Collaboration 4.Human Resource Development (Outreach and Education Activities; Diversity) 5.Sustainability for Future Cyber-Enabled Research and Innovation

3. DATA SOURCES 1.DRAFT Third Annual Report to NSF 2.Project Documents on Portal 3.NG-CHC Retreat held October 2012 4.NG-CHC Annual Conference June 2013 5.Collaboration Survey Spring 2014 6.Portal Analysis Spring 2014 7.Reports and other documentation

4. “AREAS OF SUCCESS” METRICS 1.Cyberinfrastructure Improvement (Cyberinfrastructure Development; Simulation Experiments) 2.Research Production 3.Research Collaboration 4.Human Resource Development (Outreach and Education Activities; Diversity) 5.Sustainability for Future Cyber-Enabled Research and Innovation

5. Number of Researchers and Students Supported by NG-CHC 1. CYBERINFRASTRUCTURE AND EXPERIMENTS

6. MetricData Status Year 3 Number of high performance computing services and tools in NG- CHC  Operational Storm Surge Forecast System (MSU)  Data Grabber to Download Coastal Data (LSU)  Data Merging Tool (MMRI)  Data Extraction Tool (MMRI)  MODIS Daily Imagery Download Too (MMRI)  ASGS-NHC Text Advisories to ATCF format  ASGS-ADCIRC ASCII to NetCDF script  Sulis Metadata Creator  EnVis  Spatial Watershed Erosion Tool  FloodVix  ADCIRC to ESRI Shape File Scripts  Data to NetCDF Scripts  Sulis Portal Viewer  Sulis Severe Weather Viewer  Sulis Informatics Services Portal  Weather Underground Web Data Extraction Tool (WUDEXT)  Coastal Datafactory  Multi-layer Data Infrastructure for System of Systems

7. 1. CYBERINFRASTRUCTURE AND EXPERIMENTS MetricData Status Functionality of each cyber-enabled tool and service Year 1 = Stage 1 (organizing) Year 2 = Stage 2 (defined workflow) Year 3 = Stage 3 (product) What can users do now that they couldn’t do prior? What feedback have users provided? Usability of each cyber-enabled tool and service Functionality of the ASGS, SULIS, and Flood Risk Models Usability of the ASGS, SULIS, and Flood Risk Models Usability of Technologies developed from the ASGS, SULIS, and Flood Risk Models

8. 1. CYBERINFRASTRUCTURE AND EXPERIMENTS MetricData Status Quantitative performance of each cyber-enabled tool and service No data reported any year Number of data analysis services developed and deployed in NG-CHC No data reported any year Capacity and performance of distributed storage systems in NG- CHC Developed by Mississippi in Year 1 Number of virtual organizations and communities established in NG-CHC 3 simulation experiments Number of cyber-enabled applications supported by NG-CHC No data reported any year Number of courses supported by NG- CHC One reported in Year 1; no data reported in subsequent years

9. “AREAS OF SUCCESS” METRICS 1.Cyberinfrastructure Improvement (Cyberinfrastructure Development; Simulation Experiments) 2.Research Production 3.Research Collaboration 4.Human Resource Development (Outreach and Education Activities; Diversity) 5.Sustainability for Future Cyber-Enabled Research and Innovation

10. Number of Publications in Major Scientific Journals 2. RESEARCH PRODUCTION Published or accepted 1 9 8 25 14 30

11. Number of Presentations at Major Peer-reviewed Conferences 2. RESEARCH PRODUCTION 20 9 43 12 44 10 Need to identify peer-reviewed 2

12. Number of Products and Other Types of Intellectual Property 2. RESEARCH PRODUCTION Year 1Year 2Year 3 Website Portal Structured Data Set via THREDDS Server

13. Number and Types of Media Exposure 2. RESEARCH PRODUCTION 8

14. Number and Types of Awards and Honors 2. RESEARCH PRODUCTION 12 5 17 7 9 5 Advisory Boards Editorial Boards Fellowships

15. “AREAS OF SUCCESS” METRICS 1.Cyberinfrastructure Improvement (Cyberinfrastructure Development; Simulation Experiments) 2.Research Production 3.Research Collaboration 4.Human Resource Development (Outreach and Education Activities; Diversity) 5.Sustainability for Future Cyber-Enabled Research and Innovation

16. Number of Multi-State/Institution Research Projects (per year and total) 3. COLLABORATION 58 67 61 186

17. Number of Researchers from Multi- State/Institutions (per strategy* and total) 3. COLLABORATION 66 *Faculty could be in more than one strategy 38 86 5 3

18. Quality of Collaboration (per strategy* and total Year 1 = 3.8; Year 2 = 4.1) 3. COLLABORATION Governance, Administration, Mutuality (Y2H), Norms (Y1H)

19. Overall Quality of Collaboration (per strategy* and total) 3. COLLABORATION

20. Number of Publications Produced by Collaborative Efforts (NSF acknowledged) 3. COLLABORATION Year 1 = 67%; Year 2 = 73%; Year 3 = 89%

21. Number of Collaborative Research Proposals Developed by NG-CHC 3. COLLABORATION Year 1Year 2Year 3 NG-CHC 1Not evident Multiple Partners 2Not evident External Partners 334

22. “AREAS OF SUCCESS” METRICS 1.Cyberinfrastructure Improvement (Cyberinfrastructure Development; Simulation Experiments) 2.Research Production 3.Research Collaboration 4.Human Resource Development (Outreach and Education Activities; Diversity) 5.Sustainability for Future Cyber-Enabled Research and Innovation

23. *Graduate Students in NG-CHC Research Program *Number of Students Recruited for Project that Persist in STEM 4. HUMAN RESOURCES Year 1Year 2Year 3 NG-CHC Graduate Students 152035 Earned Ph.D. 324 Earned Masters 043 Earned Bachelors 020

24. Numbers of Minorities in Outreach and Education Activities 4. HUMAN RESOURCES Year 1Year 2Year 3 Education Activities (UG/GRA) 3 women 4 URM 8 women 7 URM 8 women 3 URM Outreach STEM Bowl 32 URM No report

25. *Number of Summer Workshops for Junior/Senior High Schools 4. HUMAN RESOURCES Year 1Year 2Year 3 Beowulf (40) Northern Gulf Institute STEM Bowl Scholarship Competition (37) Lockheed Martin IT Day/STEM Bowl Scholarship Competition (1000) STEM Bowl Scholarship Competition Teachers Exploring Coastal Hazards and Resilience (20) Teachers Exploring Coastal Hazards and Resilience Dauphin Island Sea Lab (19 teachers)

26. *Number of Summer Workshops for Undergraduate/Graduate Students 4. HUMAN RESOURCES Year 1Year 2Year 3 Evidence not explicitly stated Delft3D Tutorial Evidence not explicitly stated USGS National Wetlands Research Center Modeling Teams NG-CHC Student Poster Session (15)

27. *Number of faculty and staff trained in NG-CHC. *Number of students trained in NC-CHC. *Number of new courses. 4. HUMAN RESOURCES

28. “AREAS OF SUCCESS” METRICS 1.Cyberinfrastructure Improvement (Cyberinfrastructure Development; Simulation Experiments) 2.Research Production 3.Research Collaboration 4.Human Resource Development (Outreach and Education Activities; Diversity) 5.Sustainability for Future Cyber-Enabled Research and Innovation

29. *Number of funded research clusters & other organizations established. *Number of researchers and graduate students in each established center. 5. SUSTAINABILITY

30. Number of Successful Awards from NSF and Other Agencies 5. SUSTAINABILITY $2,604,374 $1,083,000 $210,000 EPA FESD Industry NASA NSF NOAA

31. “AREAS OF SUCCESS” METRICS 1.Cyberinfrastructure Improvement (Cyberinfrastructure Development; Simulation Experiments) 2.Research Production 3.Research Collaboration 4.Human Resource Development (Outreach and Education Activities; Diversity) 5.Sustainability for Future Cyber-Enabled Research and Innovation