In Situ Fusion Simulation Particle Data Reduction Through Binning

Slides:



Advertisements
Similar presentations
Hank Childs Lawrence Berkeley National Laboratory /
Advertisements

Presentation at WebEx Meeting June 15,  Context  Challenge  Anticipated Outcomes  Framework  Timeline & Guidance  Comment and Questions.
The Challenges Ahead for Visualizing and Analyzing Massive Data Sets Hank Childs Lawrence Berkeley National Laboratory February 26, B element Rayleigh-Taylor.
2003 Fall SIW The Process for Coercing Simulations Sarah Waziruddin, University of Virginia David Brogan, University of Virginia Paul Reynolds, University.
A Case Study in the Visualization of Supernova Simulation Data Ed Bachta Visualization and Interactive Spaces Lab.
Large Vector-Field Visualization, Theory and Practice: Large Data and Parallel Visualization Hank Childs Lawrence Berkeley National Laboratory / University.
January 5, Feature Tracking in VR for Cumulus Cloud Life-Cycle Studies E. J. Griffith, F. H. Post, M. Koutek, T. Heus and H. J. J. Jonker 11 th.
UNCLASSIFIED: LA-UR Data Infrastructure for Massive Scientific Visualization and Analysis James Ahrens & Christopher Mitchell Los Alamos National.
National Partnership for Advanced Computational Infrastructure San Diego Supercomputer Center Evaluating the Tera MTA Allan Snavely, Wayne Pfeiffer et.
B1 -Biogeochemical ANL - Townhall V. Rao Kotamarthi.
E. WES BETHEL (LBNL), CHRIS JOHNSON (UTAH), KEN JOY (UC DAVIS), SEAN AHERN (ORNL), VALERIO PASCUCCI (LLNL), JONATHAN COHEN (LLNL), MARK DUCHAINEAU.
ASCR Scientific Data Management Analysis & Visualization PI Meeting Exploration of Exascale In Situ Visualization and Analysis Approaches LANL: James Ahrens,
MITRE Corporation is a federally-funded research-and- development corporation that has developed their own facial recognition system, known as MITRE Matcher.
Roadmap for Many-core Visualization Software in DOE Jeremy Meredith Oak Ridge National Laboratory.
In Situ Sampling of a Large-Scale Particle Simulation Jon Woodring Los Alamos National Laboratory DOE CGF
Institute for Mathematical Modeling RAS 1 Visualization in distributed systems. Overview. Remote visualization means interactive viewing of three dimensional.
Creating With Code.
Physics Steven Gottlieb, NCSA/Indiana University Lattice QCD: focus on one area I understand well. A central aim of calculations using lattice QCD is to.
So far we have covered … Basic visualization algorithms Parallel polygon rendering Occlusion culling They all indirectly or directly help understanding.
VACET: Deploying Technology for Visualizing and Analyzing Astrophysics Simulations Author May 19, 2009.
Presented by On the Path to Petascale: Top Challenges to Scientific Discovery Scott A. Klasky NCCS Scientific Computing End-to-End Task Lead.
Efficient Visualization and Analysis of Very Large Climate Data Hank Childs, Lawrence Berkeley National Laboratory December 8, 2011 Lawrence Livermore.
Science Problem: Cognitive capacity (human/scientist understanding), storage and I/O have not kept up with our capacity to generate massive amounts physics-based.
The Scalable Data Management, Analysis, and Visualization Institute VTK-m: Accelerating the Visualization Toolkit for Multi-core.
Mark Rast Laboratory for Atmospheric and Space Physics Department of Astrophysical and Planetary Sciences University of Colorado, Boulder Kiepenheuer-Institut.
Hank Childs, University of Oregon Lecture #6 CIS 410/510: Advection (Part 1)
Compression of Real-Time Cardiac MRI Video Sequences EE 368B Final Project December 8, 2000 Neal K. Bangerter and Julie C. Sabataitis.
Interactive Computational Sciences Laboratory Clarence O. E. Burg Assistant Professor of Mathematics University of Central Arkansas Science Museum of Minnesota.
Improving I/O with Compiler-Supported Parallelism Why Should We Care About I/O? Disk access speeds are much slower than processor and memory access speeds.
Lecture 7: Intro to Computer Graphics. Remember…… DIGITAL - Digital means discrete. DIGITAL - Digital means discrete. Digital representation is comprised.
VTK-m Project Goals A single place for the visualization community to collaborate, contribute, and leverage massively threaded algorithms. Reduce the challenges.
VAPoR: A Discovery Environment for Terascale Scientific Data Sets Alan Norton & John Clyne National Center for Atmospheric Research Scientific Computing.
Introduction to Neural Networks. Biological neural activity –Each neuron has a body, an axon, and many dendrites Can be in one of the two states: firing.
Using Cache Models and Empirical Search in Automatic Tuning of Applications Apan Qasem Ken Kennedy John Mellor-Crummey Rice University Houston, TX Apan.
Abstract Particle tracking can serve as a useful tool in engineering analysis, visualization, and is an essential component of many Eulerian-Lagrangian.
Large Scale Time-Varying Data Visualization Han-Wei Shen Department of Computer and Information Science The Ohio State University.
© 2010 Pittsburgh Supercomputing Center Pittsburgh Supercomputing Center RP Update July 1, 2010 Bob Stock Associate Director
Comprehensive Scientific Support Of Large Scale Parallel Computation David Skinner, NERSC.
Data Representation. How is data stored on a computer? Registers, main memory, etc. consists of grids of transistors Transistors are in one of two states,
Convolutional Coding In telecommunication, a convolutional code is a type of error- correcting code in which m-bit information symbol to be encoded is.
Figure 3. Overview of system architecture for RCMES. A Regional Climate Model Evaluation System based on Satellite and other Observations Peter Lean 1.
Kalman Filter and Data Streaming Presented By :- Ankur Jain Department of Computer Science 7/21/03.
Sensing and Measurements Tom King Oak Ridge National Laboratory April 2016.
VisIt Project Overview
PostGraduate Research Excellence Symposium (PGReS) 2015
Visualization Shading
VisIt Libsim Update DOE Computer Graphics Forum 2012 Brad Whitlock
Computer System and Programming
So far we have covered … Basic visualization algorithms
Ray-Cast Rendering in VTK-m
Scientific Discovery via Visualization Using Accelerated Computing
Image Space Based Visualization of Unsteady Flow on Surfaces
Using Tensorflow to Detect Objects in an Image
Yu Su, Yi Wang, Gagan Agrawal The Ohio State University
Digital Image Processing using MATLAB
PARALLEL FINITE ELEMENT MODELING TOOLS FOR ERL DESIGN AND ANALYSIS
Scientific Achievement
Physics-based simulation for visual computing applications
2009 AAG Annual Meeting Las Vegas, NV March 25th, 2009
Find the Taylor series for f (x) centered at a = 8. {image} .
Wavelet “Block-Processing” for Reduced Memory Transfers
Using Tensorflow to Detect Objects in an Image
Usability of In Situ Generated PDFs for Post Hoc Analysis
Portable Performance for Many-Core Particle Advection
Emulator of Cosmological Simulation for Initial Parameters Study
PARALLEL FINITE ELEMENT MODELING TOOLS FOR ERL DESIGN AND ANALYSIS
Wavelet Compression for In Situ Data Reduction
STARmap for 3D transcriptome imaging and molecular cell typing.
Evaluate the integral {image}
Presentation transcript:

In Situ Fusion Simulation Particle Data Reduction Through Binning Scientific Achievement Large data reductions with error bounds for particle data from the XGC1 fusion simulation code, increasing the temporal fidelity of in situ analysis techniques. A B Significance and Impact Scientists can look at particle data at high temporal fidelity (previously not possible) using an alternate data representation, particles → vector field, while utilizing error metrics to tune the final error bounds based on analysis needs. Research Details We are leveraging VTK-m for high performance computation, and ADIOS to enable efficient I/O from the simulation to the visualization routines. We explored data binning on both structured and unstructured meshes at four different mesh resolutions. We provide four different error quantification metrics that allow the final binned output data to fall within a specified error bound, drastically reducing the data size, while preserving the data integrity. In situ visualization is an enabling technique, but can cause challenges in environments with constrained resources. A typical use case with constrained resources is an in situ environment. Some visualization routines require very high temporal fidelity to produce correct results, posing a challenge depending on machine architecture and the simulation type. For our use case, XGC1, the simulation output is too large to be held in memory for long, meaning a visualization routine operating on this data every time step would cause the simulation to stall. To bypass this large data issue, we are working with data transformation and data precision techniques to reduce the size of the data needed to perform visualizations. This means that the simulation will be able to proceed wile visualization algorithms will be given access to a greater temporal data fidelity. We study converting particle data to a vector representation to drastically reduce data size. To evaluate this transformation we utilize four different error metrics to allow us to bound the error coming from the representation change: Poincare contour error, Poincare center error, streamline end point error, and pathline end point error. (A) Boxplots of the differences in area of a Poincarè plot generated from full resolution particle data and a Poincarè plot generated from the binned vector field data for one studied mesh size. (B) The corresponding Poincarè plot for the test using 300M particles. Reduced data is shown in black, original resolution data is shown in blue. This test represents an error of approximately 1% represented in 89 MB, reduced from 500 GB of original particle data. (Image Credit James Kress) J. Kress, R. Michael Churchill, S. Klasky, M. Kim, H. Childs, D. Pugmire, In Situ Processing on Upcoming Supercomputers, Supercomputing Frontiers and Innovations, December 2016 Submitted: J. Kress, J. Choi, S. Klasky, R. Michael Churchill, H. Childs, D. Pugmire, Binning Based Data Reduction for Vector Field Data of a Particle-In-Cell Fusion Simulation, IEEE Symposium on Large Data Analysis and Visualization, 2017 Work was performed at Oak Ridge National Laboratory