Advisor: Professor Fukuda Student: Jason Woodring Climate analysis software to assist climate researchers in the detection of extreme weather events.

Slides:



Advertisements
Similar presentations
GRADD: Scientific Workflows. Scientific Workflow E. Science laboris Workflows are the new rock and roll of eScience Machinery for coordinating the execution.
Advertisements

© Telelogic AB Modeling DoDAF Compliant Architectures Operational Systems Technical.
Introduction to modelling extremes
A Workflow Engine with Multi-Level Parallelism Supports Qifeng Huang and Yan Huang School of Computer Science Cardiff University
A MapReduce Workflow System for Architecting Scientific Data Intensive Applications By Phuong Nguyen and Milton Halem phuong3 or 1.
INTRODUCTION TO SIMULATION WITH OMNET++ José Daniel García Sánchez ARCOS Group – University Carlos III of Madrid.
1 Slides presented by Hank Childs at the VACET/SDM workshop at the SDM Center All-Hands Meeting. November 26, 2007 Snoqualmie, Wa Work performed under.
May 2, May 2, 2015May 2, 2015May 2, 2015 Azusa, CA Sheldon X. Liang Ph. D. Software Engineering in CS at APU Azusa Pacific University, Azusa, CA.
Slide 1 STO-CMRE/T2 GEOSS AIP-7 12 November 2014 Ocean Observations Web App GEOSS Architecture Implementation Pilot (AIP-7) 12 November 2014 A. Berni,
RCAC Research Computing Presents: DiaGird Overview Tuesday, September 24, 2013.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
Agent-Based Services (ABS) for Network-Centric Communities of Interest This Phase II SBIR project has demonstrated efficient and effective agent-based.
1 Preparing Washington for a Changing Climate An Integrated Climate Change Response Strategy Department of Ecology Hedia Adelsman, Executive Policy Advisor.
* Finally, along the lines of predicting system behavior, researchers may want to know what conditions will lead to an optimal outcome of some property.
ARCS Data Analysis Software An overview of the ARCS software management plan Michael Aivazis California Institute of Technology ARCS Baseline Review March.
Determining the Local Implications of Global Warming For Urban Precipitation and Flooding Clifford Mass and Eric Salathe, Richard Steed University of Washington.
Computer Engineering 203 R Smith Requirements Management 6/ Requirements IEEE Standard Glossary A condition or capability needed by a user to solve.
SE 555 Software Requirements & Specification Requirements Management.
Regional Climate Change Water Supply Planning Tools for Central Puget Sound Austin Polebitski and Richard Palmer Department of Civil and Environmental.
Wizer – What-If Analyzer: Validation of Large Scale Stochastic Agent Models Project Investigator: Kathleen M. Carley – CMU, ISRI, CASOS Why is Validation.
Water Management Presentations Summary Determine climate and weather extremes that are crucial in resource management and policy making Precipitation extremes.
Workflow API and workflow services A case study of biodiversity analysis using Windows Workflow Foundation Boris Milašinović Faculty of Electrical Engineering.
Effective Methods for Software and Systems Integration
V. Chandrasekar (CSU), Mike Daniels (NCAR), Sara Graves (UAH), Branko Kerkez (Michigan), Frank Vernon (USCD) Integrating Real-time Data into the EarthCube.
TeraGrid Gateway User Concept – Supporting Users V. E. Lynch, M. L. Chen, J. W. Cobb, J. A. Kohl, S. D. Miller, S. S. Vazhkudai Oak Ridge National Laboratory.
IT Project Management Cheng Li, Ph.D. August 2003.
Workflow Management Chris A. Mattmann OODT Component Working Group.
Christopher Jeffers August 2012
The Old World Meets the New: Utilizing Java Technology to Revitalize and Enhance NASA Scientific Legacy Code Michael D. Elder Furman University Hayden.
1 Chapter 5 Practice: A Generic View Software Engineering: A Practitioner’s Approach, 6th edition by Roger S. Pressman.
Introduction to Hands On Training in CORDEX South Asia Data Analysis
Grob Systems, Inc., the customer, requires an industrial computer system that will have a function of acquiring raw data, processing the data, presenting.
1 Chapter 5 Software Engineering Practice. 2 What is “Practice”? Practice is a broad array of concepts, principles, methods, and tools that you must consider.
What is a Business Analyst? A Business Analyst is someone who works as a liaison among stakeholders in order to elicit, analyze, communicate and validate.
CCGrid 2014 Improving I/O Throughput of Scientific Applications using Transparent Parallel Compression Tekin Bicer, Jian Yin and Gagan Agrawal Ohio State.
A framework to support collaborative Velo: Knowledge Management for Collaborative (Science | Biology) Projects A framework to support collaborative 1.
Copyright © 1994 Carnegie Mellon University Disciplined Software Engineering - Lecture 3 1 Software Size Estimation I Material adapted from: Disciplined.
Composing workflows in the environmental sciences using Web Services and Inferno Jon Blower, Adit Santokhee, Keith Haines Reading e-Science Centre Roger.
_______________________________________________________________CMAQ Libraries and Utilities ___________________________________________________Community.
Using SWARM service to run a Grid based EST Sequence Assembly Karthik Narayan Primary Advisor : Dr. Geoffrey Fox 1.
CCGrid 2014 Improving I/O Throughput of Scientific Applications using Transparent Parallel Compression Tekin Bicer, Jian Yin and Gagan Agrawal Ohio State.
ICCS WSES BOF Discussion. Possible Topics Scientific workflows and Grid infrastructure Utilization of computing resources in scientific workflows; Virtual.
TeraGrid Gateway User Concept – Supporting Users V. E. Lynch, M. L. Chen, J. W. Cobb, J. A. Kohl, S. D. Miller, S. S. Vazhkudai Oak Ridge National Laboratory.
Advisor: Professor Fukuda Student: Jason Woodring A Multi-Agent distributed approach to analyzing large climate data sets.
1 Adventures in Web Services for Large Geophysical Datasets Joe Sirott PMEL/NOAA.
ACCESSING DATA IN THE NIS USING THE KEPLER WORKFLOW SYSTEM Corinna Gries.
Origami: Scientific Distributed Workflow in McIDAS-V Maciek Smuga-Otto, Bruce Flynn (also Bob Knuteson, Ray Garcia) SSEC.
Simulation Production System Science Advisory Committee Meeting UW-Madison March 1 st -2 nd 2007 Juan Carlos Díaz Vélez.
The Virtual Observatory and Ecological Informatics System (VOEIS): Using RESTful architecture and an extensible data model to provide a unique data management.
Test Automation Steffen Goerlitz Barry Lange Mitchell Meerman Harry Schultz Trevor Spees.
® IBM Software Group © 2009 IBM Corporation Viewpoints and Views in SysML Dr Graham Bleakley
Alan F. Hamlet Dennis P. Lettenmaier Center for Science in the Earth System Climate Impacts Group and Department of Civil and Environmental Engineering.
WINTER 2016 – TERM PRESENTATION MICHAEL O’KEEFE. PAST RESEARCH - SUMMER 2015 Continued Jason Woodring’s research on UWCA Main issue with UWCA is the slow.
Building Comfort With MATLAB
MASS Java Documentation, Verification, and Testing
Delivery of Science Components to NRCS Business Applications
Climate Change, Texas, and the Limits of Confidence
Design and Manufacturing in a Distributed Computer Environment
The value of a project-oriented approach to IT and how we do it in IBM
Parallel NetCDF + MASS Development
Business Intelligence: A Managerial Approach (2nd Edition)
Geospatial Technology in Climate Change
Laura Bright David Maier Portland State University
Dtk-tools Benoit Raybaud, Research Software Manager.
ExPLORE Complex Oceanographic Data
Overview of Workflows: Why Use Them?
Seasonal Forecasting Using the Climate Predictability Tool
Scientific Workflows Lecture 15
L. Glimcher, R. Jin, G. Agrawal Presented by: Leo Glimcher
Presentation transcript:

Advisor: Professor Fukuda Student: Jason Woodring Climate analysis software to assist climate researchers in the detection of extreme weather events.

World Climate …. Is changing Rising Temperatures… But why? What to blame?

Human Caused Climate Change 95% chance it’s us according to climate scientists

Local sea level rise Decreased snowpack Glaciers in decline Stream flow peaks earlier in year Ocean acidification The Impact

What's being done about it? Simulated World Climate Data is produced using Many different models Climate Scientists Analyze this Data in different ways to try to predict extreme weather events

Climate Analysis Large climate science facilities may have dedicated computing resources to analyze these climate models. Small to medium size labs often are resource constrained, and create custom tools.

PNCA Inherited PNCA Put climate analysis software in more researchers hands Abstract out complex computer science concepts Framework Allows researchers to write custom analysis

What's Needed An application that is easily accessible Performs calculations which performs better than their custom script counterparts Allows for parameters for calculations to be adjusted Something easy to use (no coding necessary)

UWCA Web Based Application Performs Time of Emergence calculations Utilizes UW-320 Linux lab computing cluster Using MASS Agents to travel computing Nodes to analyze NetCDF data

Input Data NetCDF Software [4] A set of libraries and self-describing, machine independent data formats that support the creation, access, and sharing of array-oriented scientific data. Free software available All sorts of software packages and APIs for working with NetCDF from different environments.

Parallelization MASS [2] Created specifically for scientific analysis Using MASS analyze NetCDF files

Provenance (to come from…) Tracking Calculations Tracking parameters used in calculations Derived files will contain metadata about how they were derived

Architecture

Implementation Official Project Started Using NetBeans 7.4 Using Maven Enterprise Application Archetype Needing dependencies

Workflow Based 1. Select management variable to calculate 2. Select climate model(s) to use 1. Multiple climate models result in multiple calculations 3. Select type of output (high or low estimates) 4. Select parameters for ToE calculations 5. Then wait….. And view job status

GUI (first pass) Application Header Job Status Viewer Job Creator

Calculations Management Variables Excel sheet documenting types of variables Climate resources on remote Kraken machine Simpler, but resource intensive ToE Much more conceptually complex Less of a performance hit

When the average conditions consistently exceed some threshold extreme weather events are more likely to happen. An essential calculation for predicting climate behavior. Time of Emergence (ToE)

Plug directly into ToE calculations. There are many defined Management Variables

ToE Calculation…

NetCDF Operators My requirements gathering has led me to the point where I NEED to learn ncl scripting All the calculations for ToE and management variables are already done in ncl Stakeholders didn’t comment any of it… and haven’t produced sufficient documentation on how to do the calculations

Future state of Visualization PNCA uses off the shelf software, Panopoly viewer. First version will have downloadable files Research needed on web visualization tools for the long term

Schedule Gantt View

Resources Computing resources Hercules computer UW1-320 computing lab Network drive for NetCDF files Domain Resources Climate Researcher to feed requirements UW Tacoma climate science team

Risks Stakeholder availability Countermeasure: Contact stakeholders more frequently Scope too large Countermeasure: Feature drop (still architect in a way that allows extensibility)

CDS&E:small:Multi-Agent-Based Parallelization of Scientific Data Analysis and Simulation Munehiro Fukuda Michael Stiber Eric Salath´e Wooyoung Kim THE WEATHER RESEARCH AND FORECAST MODEL: SOFTWARE ARCHITECTURE AND PERFORMANCE J. MICHALAKES, J. DUDHIA, D. GILL, T. HENDERSON,J. KLEMP, W. SKAMAROCK, W. WANG Supporting Provenance in Climate Science Research Brett Yasutake, Niko Simonson, Hazeline Asuncion, Munehiro Fukuda, Eric Salathe International Journal of High Performance Computing Applications: Scaling Properties of Common Statistical Operators for Gridded Datasets Charles S. Zender and Harry Mangalam MASS: Parallel-Computing Library for Multi-Agent Spatial SimulationJ. MICHALAKES, J. DUDHIA, D. GILL, T. HENDERSON,J. Munehiro Fukuda Estimates of 21st Century Flood Risk 1 in the Pacific Northwest Eric P. Salathe State of Knowledge Report Climate Change Impacts and Adaptation in Washington State: Technical Summaries for Decision Makers References

Time of Emergence of Climate Change Signals in the Puget Sound Basin Quality Assurance Project Plan The Climate Impacts Group University of Washington Determining the time of emergence of the climate change signal at regional scales Les C. Muir, Jaclyn N. Brow, James S. Risbey, Susan E. Wijffels and Alex Sen Gupta Time of emergence of climate signals Hawkins, E. and Sutton, R. Time of emergence of trends in ocean biogeochemistry K.M. Keller, F. Joos, and C. C. Raible References (cont.)