Weather Research and Forecasting (WRF) Portal Seychelles Martinez School of Computing and Information Sciences Florida International University Elias Rodriguez School of Computer Engineering Computer Science and Electrical Engineering Polytechnic University of Puerto Rico REU Summer Program 7/14/2008 1

Outline Introduction Motivation Description of the project Accomplishment Goals Questions 3/9/20162

Introduction What is WRF? What is Ensemble Forecasting? How does the system work? What is the scope of what we are doing? 3/9/20163

Introduction What is WRF?  Weather Research and Forecasting  Developed by National Center for Atmospheric Research (NCAR)  Widely accepted in meteorology 3/9/20164

Introduction What is Ensemble Forecasting?  Purpose: account for errors in forecasting system due to chaotic nature of atmospheric dynamics  Different models created in parallel with different initial conditions.  Models, then, combined to produce a probabilistic forecast 3/9/20165

Introduction How does the system work? Main objective of the overall project:  Grid: enables rapid computation of parallel tasks. 3/9/20166

BSC FIU Job-Flow Manager Peer-to-peer Protocols Web-Based Portal Meteorologist Local Resources Meta- Scheduler Local scheduler Resource Policies Resource Policies Architectural Overview of the Overall Project

Introduction What is the scope of what we are doing?  The WRF Web Portal -Front End -Ease of use for meteorologists 3/9/20168

Motivation Help meteorologist focus on their science Speed up Ensemble Forecasting 3/9/20169

System Architecture 3/9/ Portal: Used by meteorologist. Front End of system JFM: Receives workflow and decides what can be run in parallel Meta-Scheduler: Assigns jobs to different resources

Web-Portal SubArchitecture 3/9/201611

Workflow Architecture 3/9/201612

What we know about files Input Files: −wrfbdy −wrfinput −namelist Output File: −netcdf file 3/9/201613

What we know about files 3/9/ met_em file wrfbdy file wrfinput file Real.exe

What we know about files 3/9/201615

3/9/201616

3/9/201617

Meteorologist Profile Create new Ensemble Forecasts Create new Single Run Show the list of Ensemble Configurations The status of the runs Visualize the results 3/9/201618

3/9/201619

Ensemble Run To run an ensemble, the portal send a workflow to the JFM. −Specify where the real.exe is −Specify what the perturbation function is −Generate the ensemble members −Specify the aggregation function 3/9/201620

3/9/201621

Research-Run -A single run using old storm data as initial data -Change certain WRF modeling variables -Examples -physics-package -cloud cover -snow cover -turbulence & mixing 3/9/201622

Research-Run cont. -Run output then compared against actual storm attributes -Compare results: -Projected track vs. actual track -Projected intensity vs. actual intensity -Etc. 3/9/201623

Research-Run Objectives -Objectives -Upload files from WPS -Edit namelist for their research goals -Run their submission -Get the results of the simulation 3/9/201624

Research-Run Objectives -Future Objective -Certain types of studies only view and modify variables that apply to the specific study -Open a previous study and resubmit with different variables/options selected 3/9/201625

Portal Input – Design Decision -Pre-Processing -Who does it and how much do they do? -Tasks -WPS -Used to create the mother domain and gets the weather data from an archive or uses the current weather conditions. -Real.exe -Used on WPS output to create files needed to run WRF simulations. A fair amount of processing power needed. 3/9/201626

Portal Input – Design Decision Options 1.User does all pre-processing -User runs WPS and Real.exe locally 2.User does half and Portal does half -User runs WPS local and real.exe on portal 3.Portal does all pre-processing -Portal has WPS functionality built in and real.exe runs on portal 3/9/201627

Pros 1.Light design burden, no real.exe processing time 2.User only needs WPS but does not need WRF 3.User only needs web access Cons 1.User needs WRF installed and CS knowledge 2.Real.exe processing time, and User still needs WPS 3.Portal design really complex, and real.exe running time is done on Portal resources 3/9/ Portal Input – Design Decision

Decision Option 2: User runs WPS, and the portal runs real.exe −This will relieve the burden of having a WRF installation from the user −A good separation of functionality Option 3 is a future goal 3/9/201629

Database Diagram 3/9/201630

3/9/201631

Project Plan Develop the API Simulate an ensemble dummy run from the Portal Write the final paper. 3/9/201632

References Transparent Grid Enablement of Weather Research and Forecasting  S. Masoud Sadjadi, Liana Fong, Rosa M. Badia, Javier Figueroa, Javier Delgado, Xabriel J. Collazo-Mojica, Khalid Saleem, Raju Rangaswami, Shu Shimizu, Hector A. Duran Limon, Pat Welsh, Sandeep Pattnaik,`Anthony Praino, David Villegas, Selim Kalayci, Gargi Dasgupta, Onyeka Ezenwoye, Juan Carlos Martinez, Ivan Rodero, Shuyi Chen, Javier Muñoz, Diego Lopez, Julita Corbalan, Hugh Willoughby, Michael McFail,Christine Lisetti, and Malek Adjouadi1 Towards a Self-Configurable Weather Research and Forecasting System  By Khalid Saleem, S. Masoud Sadjadi, Shu-Ching Chen 3/9/201633

Questions ? 3/9/201634