Large Data Visualization on Distributed Memory Multi-GPU Clusters Thomas Fogal, Hank Childs, Siddharth Shankar, Jens Krüger, R. Daniel Bergeron, Philip.

Slides:



Advertisements
Similar presentations
Parallel Volume Rendering for Ocean Visualization in a Cluster of PCs Alexandre Coelho Marcio Nascimento Cristiana Bentes Maria Clicia S. de Castro Ricardo.
Advertisements

Distributed DBMS©M. T. Özsu & P. Valduriez Ch.14/1 Outline Introduction Background Distributed Database Design Database Integration Semantic Data Control.
Ultra-Scale Visualization with Open-Source Software Berk Geveci Kitware Inc.
Parallel Visualization At TACC Greg Abram. Visualization Problems Small problems: Data are small and easily moved Office machines and laptops are adequate.
Parallelizing stencil computations Based on slides from David Culler, Jim Demmel, Bob Lucas, Horst Simon, Kathy Yelick, et al., UCB CS267.
Unstructured Data Partitioning for Large Scale Visualization CSCAPES Workshop June, 2008 Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram.
Large Vector-Field Visualization, Theory and Practice: Large Data and Parallel Visualization Hank Childs Lawrence Berkeley National Laboratory / University.
I/O Analysis and Optimization for an AMR Cosmology Simulation Jianwei LiWei-keng Liao Alok ChoudharyValerie Taylor ECE Department Northwestern University.
Tuvok, an Architecture for Large Scale Volume Rendering Thomas Fogal and Jens Krüger DFKI logo?SCI logo?
Memory-Savvy Distributed Interactive Ray Tracing David E. DeMarle Christiaan Gribble Steven Parker.
Support for Global Cloud Resolving Model Simulations VACET All-Hands Meeting IEEE Vis 2008.
DDDDRRaw: A Prototype Toolkit for Distributed Real-Time Rendering on Commodity Clusters Thu D. Nguyen and Christopher Peery Department of Computer Science.
E. WES BETHEL (LBNL), CHRIS JOHNSON (UTAH), KEN JOY (UC DAVIS), SEAN AHERN (ORNL), VALERIO PASCUCCI (LLNL), JONATHAN COHEN (LLNL), MARK DUCHAINEAU.
E. WES BETHEL (LBNL), CHRIS JOHNSON (UTAH), KEN JOY (UC DAVIS), SEAN AHERN (ORNL), VALERIO PASCUCCI (LLNL), JONATHAN COHEN (LLNL), MARK DUCHAINEAU.
Tom Fogal Parallel Rendering && VisIt Infrastructure.
New Coupled Models of Emerging Magnetic Flux in Active Regions W. P. Abbett, S. A. Ledvina, and G.H. Fisher.
Parallel Graphics Rendering Matthew Campbell Senior, Computer Science
Challenges and Solutions for Visual Data Analysis on Current and Emerging HPC Platforms Wes Bethel & Hank Childs, Lawrence Berkeley Lab July 20, 2011.
Parallel Adaptive Mesh Refinement Combined With Multigrid for a Poisson Equation CRTI RD Project Review Meeting Canadian Meteorological Centre August.
Project Overview:. Longhorn Project Overview Project Program: –NSF XD Vis Purpose: –Provide remote interactive visualization and data analysis services.
Visualization Linda Fellingham, Ph. D Manager, Visualization and Graphics Sun Microsystems Shared Visualization 1.1 Software Scalable Visualization 1.1.
Electronic Visualization Laboratory University of Illinois at Chicago “Sort-First, Distributed Memory Parallel Visualization and Rendering” by E. Wes Bethel,
Interactive Volume Visualization of General Polyhedral Grids Philipp Muigg 1,3, Markus Hadwiger 2, Helmut Doleisch 3, M. Eduard Gröller 1 1, Vienna University.
Scalable Algorithms for Structured Adaptive Mesh Refinement Akhil Langer, Jonathan Lifflander, Phil Miller, Laxmikant Kale Parallel Programming Laboratory.
VisIt: a visualization tool for large turbulence simulations  Outline Success stories with turbulent simulations Overview of VisIt project 1 Hank Childs.
7 th Annual Workshop on Charm++ and its Applications ParTopS: Compact Topological Framework for Parallel Fragmentation Simulations Rodrigo Espinha 1 Waldemar.
Lawrence Livermore National Laboratory This work performed under the auspices of the U.S. Department of Energy by Lawrence Livermore National Laboratory.
4/30/04LSU 2004 Cactus Retreat1 Toward Relativistic Hydrodynamics on Adaptive Meshes Joel E. Tohline Louisiana State University
Scientific San Diego Supercomputer Center Presenter: Amit Chourasia.
VisIt Team April 24, 2012 VisIt Update, DOE CGF 2012 PySide GUI, H. Krishnan FTLE from tokamak, Childs, Krishnan, & Sugiyama (MIT)
Rendering Adaptive Resolution Data Models Daniel Bolan Abstract For the past several years, a model for large datasets has been developed and extended.
David S. Ebert David S. Ebert Visual Analytics to Enable Discovery and Decision Making: Potential, Challenges, and.
1 Evaluation and Optimization of Multicore Performance Bottlenecks in Supercomputing Applications Jeff Diamond 1, Martin Burtscher 2, John D. McCalpin.
MPI-hybrid Parallelism for Volume Rendering on Large, Multi-core Systems Mark Howison, E. Wes Bethel, and Hank Childs, LBNL EGPGV 2010 Norkopping, Sweden.
Efficient Visualization and Analysis of Very Large Climate Data Hank Childs, Lawrence Berkeley National Laboratory December 8, 2011 Lawrence Livermore.
Introduction to Parallel Rendering Jian Huang, CS 594, Spring 2002.
Kelly Gaither Visualization Area Report. Efforts in 2008 Focused on providing production visualization capabilities (software and hardware) Focused on.
The Scalable Data Management, Analysis, and Visualization Institute VTK-m: Accelerating the Visualization Toolkit for Multi-core.
Hank’s Activities Longhorn/XD AHM Austin, TX December 20, 2010 Volume rendering of 4608^3 combustion data set Image credit: Mark Howison Volume rendering.
VisIt is an open source, richly featured, turn-key application for large data.  Used by:  Visualization experts  Simulation code developers  Simulation.
GVis: Grid-enabled Interactive Visualization State Key Laboratory. of CAD&CG Zhejiang University, Hangzhou
1 1 What does Performance Across the Software Stack mean?  High level view: Providing performance for physics simulations meaningful to applications 
Introduction to Research 2011 Introduction to Research 2011 Ashok Srinivasan Florida State University Images from ORNL, IBM, NVIDIA.
Efficient Streaming of 3D Scenes with Complex Geometry and Complex Lighting Romain Pacanowski and M. Raynaud X. Granier P. Reuter C. Schlick P. Poulin.
XLAB Research 2003 – 2006Ljubljana / Slovenia "River Socha Project" Visualization of massive amount of data with Grid based engine Authors: Marjan Šterk,
I/O for Structured-Grid AMR Phil Colella Lawrence Berkeley National Laboratory Coordinating PI, APDEC CET.
Hank Childs, University of Oregon Unstructured Grids.
An Evaluation of Partitioners for Parallel SAMR Applications Sumir Chandra & Manish Parashar ECE Dept., Rutgers University Submitted to: Euro-Par 2001.
Electronic visualization laboratory, university of illinois at chicago Visualizing Very Large Scale Earthquake Simulations (SC 2003) K.L.Ma, UC-Davis.
Presented by Visualization at the Leadership Computing Facility Sean Ahern Scientific Computing Center for Computational Sciences.
1 27B element Rayleigh-Taylor Instability (MIRANDA, BG/L) VisIt: a visualization tool for large turbulence simulations Large data requires special techniques.
Remote & Collaborative Visualization. TACC Remote Visualization Systems Longhorn – Dell XD Visualization Cluster –256 nodes, each with 48 GB (or 144 GB)
An interleaved Parallel Volume Renderer with PC-clusters Antonio Garcia and Han-Wei Shen Dept of Computer Science Ohio State University Eurographics Workshop.
IDC HPC USER FORUM Weather & Climate PANEL September 2009 Broomfield, CO Panel questions: 1 response per question Limit length to 1 slide.
Scientific Computing Goals Past progress Future. Goals Numerical algorithms & computational strategies Solve specific set of problems associated with.
VisIt : A Tool for Visualizing and Analyzing Very Large Data Hank Childs, Lawrence Berkeley National Laboratory December 13, 2010.
VisIt Project Overview
GVDB: Raytracing Sparse Voxel Database Structures on the GPU Rama Hoetzlein, NVIDIA High Performance Graphics 2016 Trinity College, Dublin.
Overview PI: Doron Kushnir, Institute for Advanced Study, Weizmann Institute ECSS: David Bock, National Center for Supercomputing Applications Type Ia.
Lennart Johnsson Professor CSC Director, PDC
Title Subtitle.
In-situ Visualization using VisIt
sv7: Blazing Visualization on a Commodity Cluster
TECHjOSH.COM TechJosh.com.
Parallel I/O System for Massively Parallel Processors
Thank You!! For More Information Visit: m/ Call to :
Imaging the Neural Basis of Locomotion
MPM Particle Sim + Galaxy
Parallel Implementation of Adaptive Spacetime Simulations A
Computational issues Issues Solutions Large time scale
Presentation transcript:

Large Data Visualization on Distributed Memory Multi-GPU Clusters Thomas Fogal, Hank Childs, Siddharth Shankar, Jens Krüger, R. Daniel Bergeron, Philip Hatcher

Growth of Data

Parallel Volume Rendering

Need lots of cores to render at acceptable speeds Volume Rendering Scalability Figure: Howison, Bethel, Childs, MPI-hybrid Parallelism for Volume Rendering on Large, Multi-core Systems, EGPGV 2010

Longhorn

Performance

Brick Size NVIDIA Quadro FX 5800's

Dynamic Load Balancing

Load Balancing

"Adaptive mesh refinement" data some spatial regions have higher-resolution coarse/fine boundaries: sampling uneven load distribution Future Work - AMR

High resolution images Load balancing Additional grid types (curvilinear) Decoupled processing and rendering? Future Work

Funding VACET CIBC C-SAFE MMCI (Saarland University) Resources TACC ORNL Open source communities: GLEW, Mesa, VisIt Anonymous reviewers You! Thanks

Questions?