Large company practices. Small company responsiveness. Working for YOU. Jose C. Renteria Kevin Lind 1 RASM: Enhancing VIC.

Slides:



Advertisements
Similar presentations
ADAPT A ssessment & D esign for A daptation: a P rototype T ool Ian Noble, World Bank & Fareeha Y. Iqbal (Consultant, World Bank)
Advertisements

ADePT Automated DECs Poverty Tables Michael Lokshin, Zurab Sajaia and Sergiy Radyakin DECRG-PO The World Bank.
Copyright © 2008 SAS Institute Inc. All rights reserved. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks.
© Crown copyright Met Office Met Office Unified Model I/O Server Paul Selwood.
INSE - Lecture 16  Documentation  Configuration Management  Program Support Environments  Choice of Programming Language.
MS698: Implementing an Ocean Model Benchmark tests. Dealing with big data files. – (specifically big NetCDF files). Signell paper. Activity: – nctoolbox.
FP7-Infra : Design studies for European Research Infrastrutures 1st October 2011 – 31st December 2014 Duration 39 months – Periods : 2 (month.
Land surface model: VIC UW: Bart Nijssen, Amanda Tan, Dennis P. Lettenmaier DRC: Jose Renteria, Kevin Lindt NPS: Andrew Roberts Consultant: Tony Craig.
Making the Case for Networked Business Chapter 4.
MotoHawk Training Model-Based Design of Embedded Systems.
Cacti Workshop Tony Roman Agenda What is Cacti? The Origins of Cacti Large Installation Considerations Automation The Current.
Data Portal for the “Climate changes Spatial Planning” program Henk Klein Baltink (KNMI) Fred Bosveld (KNMI) Hans de Wolf (Dutch Space)
Astrophysics, Biology, Climate, Combustion, Fusion, Nanoscience Working Group on Simulation-Driven Applications 10 CS, 10 Sim, 1 VR.
Automated Tests in NICOS Nightly Control System Alexander Undrus Brookhaven National Laboratory, Upton, NY Software testing is a difficult, time-consuming.
Operational Dataset Update Functionality Included in the NCAR Research Data Archive Management System 1 Zaihua Ji Doug Schuster Steven Worley Computational.
Minerva Infrastructure Meeting – October 04, 2011.
Banking Clouds V International Youth Banking Forum.
The HDF Group July 8, 2014HDF 2014 ESIP Summer Meeting HDF Product Designer Aleksandar Jelenak, H. Joe Lee, Ted Habermann The.
FP OntoGrid: Paving the way for Knowledgeable Grid Services and Systems WP8: Use case 1: Quality Analysis for Satellite Missions.
Created by the Community for the Community BizTalk & Build.
DM_PPT_NP_v01 SESIP_0715_AJ HDF Product Designer Aleksandar Jelenak, H. Joe Lee, Ted Habermann Gerd Heber, John Readey, Joel Plutchak The HDF Group HDF.
CESM/RACM/RASM Update May 15, Since Nov, 2011 ccsm4_0_racm28:racm29:racm30 – vic parallelization – vic netcdf files – vic coupling mods and “273.15”
Interference Cancellation as a Mobile Enhancement to Improve Spectral Efficiency IEEE ComSoc Denver Chapter January 16, 2007.
A Framework for Elastic Execution of Existing MPI Programs Aarthi Raveendran Tekin Bicer Gagan Agrawal 1.
1FileScope  FileScope File Editor Query Tool Report Generator File Conversion Tool Full Screen Support Developers Tool.
CCGrid 2014 Improving I/O Throughput of Scientific Applications using Transparent Parallel Compression Tekin Bicer, Jian Yin and Gagan Agrawal Ohio State.
GPU in HPC Scott A. Friedman ATS Research Computing Technologies.
PhysX CoE: LHC Data-intensive workflows and data- management Wahid Bhimji, Pete Clarke, Andrew Washbrook – Edinburgh And other CoE WP4 people…
A framework to support collaborative Velo: Knowledge Management for Collaborative (Science | Biology) Projects A framework to support collaborative 1.
A Framework for Elastic Execution of Existing MPI Programs Aarthi Raveendran Graduate Student Department Of CSE 1.
History of Microprocessor MPIntroductionData BusAddress Bus
PROGRESS: ICCS'2003 GRID SERVICE PROVIDER: How to improve flexibility of grid user interfaces? Michał Kosiedowski.
Expanding the Functionality of ArcGIS Through Tool Building
ICOADS: Update Status and Data Distribution Steven J. Worley Scott D. Woodruff Sandra J. Lubker Ziahua Ji J. Eric Freeman NCAR, NOAA/ESRL, NOAA/NCDC CLIMAR-III,
Simplify the Complexity of Regulatory Compliance WATS 2009 Maintenance Stream Tuesday April 28, 2009.
A. Freise FINESSE + FINESSE + future plans and work in progress Andreas Freise 22nd July 2006.
CCGrid 2014 Improving I/O Throughput of Scientific Applications using Transparent Parallel Compression Tekin Bicer, Jian Yin and Gagan Agrawal Ohio State.
SAXS Scatter Performance Analysis CHRIS WILCOX 2/6/2008.
ISERVOGrid Architecture Working Group Brisbane Australia June Geoffrey Fox Community Grids Lab Indiana University
March 2004 At A Glance autoProducts is an automated flight dynamics product generation system. It provides a mission flight operations team with the capability.
1 Software Reliability Analysis Tools Joel Henry, Ph.D. University of Montana.
NCEP ESMF GFS Global Spectral Forecast Model Weiyu Yang, Mike Young and Joe Sela ESMF Community Meeting MIT, Cambridge, MA July 21, 2005.
The HDF Group Introduction to netCDF-4 Elena Pourmal The HDF Group 110/17/2015.
CCSM Performance, Successes and Challenges Tony Craig NCAR RIST Meeting March 12-14, 2002 Boulder, Colorado, USA.
Parallel I/O Performance Study and Optimizations with HDF5, A Scientific Data Package MuQun Yang, Christian Chilan, Albert Cheng, Quincey Koziol, Mike.
10/16/2012Annual HDF briefing1 HDF OPeNDAP support Kent Yang, Joe Lee, Mike Folk The HDF Group Oct. 16, 2012.
HPD -- A High Performance Debugger Implementation A Parallel Tools Consortium project
Report on POP & CICE of RACM components Jaromir Jakacki, IO PAS.
NCAS Computational Modelling Service (CMS) Group providing services to the UK academic modelling community Output of UM Diagnostics Directly in CF NetCDF;
Computer Science and Engineering Power-Performance Considerations of Parallel Computing on Chip Multiprocessors Jian Li and Jose F. Martinez ACM Transactions.
Enabling Plant Sciences Research with the iPlant Discovery Environment and Condor Juan Antonio Raygoza Garay, Sonya Lowry, John Wregglesworth.
PROGRESS: GEW'2003 Using Resources of Multiple Grids with the Grid Service Provider Michał Kosiedowski.
1 TCS Confidential. 2 Objective : In this session we will be able to learn:  What is Cloud Computing?  Characteristics  Cloud Flavors  Cloud Deployment.
Introduction to Performance Testing Performance testing is the process of determining the speed or effectiveness of a computer, network, software program.
Climate-SDM (1) Climate analysis use case –Described by: Marcia Branstetter Use case description –Data obtained from ESG –Using a sequence steps in analysis,
Introduction to Performance Tuning Chia-heng Tu PAS Lab Summer Workshop 2009 June 30,
Reference Implementation of the High Performance Debugging (HPD) Standard Kevin London ( ) Shirley Browne ( ) Robert.
Parag Mhashilkar (Fermi National Accelerator Laboratory)
MASS Java Documentation, Verification, and Testing
Defining Performance Which airplane has the best performance?
CS 147 – Parallel Processing
Chapter III Desktop Imaging Systems & Issues
How to Fix Android File Transfer Not Working on Mac?
Windows® MultiPoint™ Server 2010
Implementation of IDEA on a Reconfigurable Computer
Operational Dataset Update Functionality Included in the NCAR Research Data Archive Management System Zaihua Ji Doug Schuster Steven Worley Computational.
Alternative Processor Panel Results 2008
Status for Endeavor 6: Improved Scientific Data Access Infrastructure
ClearSpeed CSX620 Overview
Practical work on NetCDF - CFPOINT
Presentation transcript:

Large company practices. Small company responsiveness. Working for YOU. Jose C. Renteria Kevin Lind 1 RASM: Enhancing VIC

Outline PETTT ► Mission VIC enhancements ► Parallel VIC ► NetCDF Current Work ► VIC output multiple stream support Acknowledgements and Contact Information 2

PETTT : User Productivity Enhancement, Technology Transfer, and Training Mission ► Transferring leading edge HPC-relevant computational technology to DoD from other government, industrial and academic communities. ► Developing training and supporting DoD HPC users through education, knowledge access and tools to maximize productivity. Funding ► DoD High Performance Computing Modernization Program 3

Enhancement: Parallel VIC Parallel VIC completed and included in latest trunk ► About 20% decrease in RASM execution time using identical processor configurations ► About 1 year per day throughput ► Allows RASM to scale to many more processors Parallel VIC Configuration 1. Generate case 2. Update env_mach_pes.xml file, change to 1. Continue as usual 4

Enhancement: Parallel VIC VIC timing (RB running for 5 days) 5 # ProcessorsTotal secondsSeconds/model-dayModel-years/wall-day (original) (vicp) (vicp) (vicp) (vicp) (vicp)

Enhancement: VIC NetCDF output VIC NetCDF output completed and included in latest trunk ► NetCDF ► NetCDF Climate and Forecast (CF) Metadata Conventions Version 1.4 ► Common naming convention > mycase.vic.h.yyyy-mm-dd-sssss.nc Benefits and RACM group discoveries ► VIC output open to community > ncdump, ncview, etc. ► Inconsistent literal constants ► Incorrect initialization of some variables 6

Enhancement: NetCDF VIC Restart File VIC NetCDF restarts completed and included in latest trunk ► NetCDF ► Outputs and reads NetCDF restart files ► Common naming convention > mycase.vic.r.yyyy-mm-dd-sssss.nc Benefits of NetCDF restart files ► Use of more tool to investigate potential problems > ncdump, ncview, etc. ► Better float precision than ASCII (single precision) ► First step to exact restarts 7

Current Work: VIC output multi streaming Current progress ► Extended VIC data structures > multiple frequencies (e, h, d, m) > averaged and instantaneous ► Updated parallel components ► Added configuration options ► Added new output naming scheme Work still required ► Testing and Debugging ► Integration into main trunk Benefits of NetCDF restart files ► Output higher or lower frequency data ► Output multiple frequencies (e, h, d, m) simultaneously ► Output averaged and/or instantaneous data 8

Acknowledgments Andrew Roberts Tony Craig Bart Nijssen 9

PETTT onsite Contact Information 10 NameCTA Phone Jose Kevin