VisIt Project Overview

Slides:



Advertisements
Similar presentations
S ITE R EPORT : L AWRENCE B ERKELEY N ATIONAL L ABORATORY J OERG M EYER
Advertisements

EUFORIA FP7-INFRASTRUCTURES , Grant JRA4 Overview and plans M. Haefele, E. Sonnendrücker Euforia kick-off meeting 22 January 2008 Gothenburg.
1 Slides presented by Hank Childs at the VACET/SDM workshop at the SDM Center All-Hands Meeting. November 26, 2007 Snoqualmie, Wa Work performed under.
Copyright (c) 2014 Intelligent Light All Rights Reserved.
ParaView Tutorial Greg Johnson, Karla Vega. Before we begin… Make sure you have ParaView installed so you can follow along in the lab section –
Scientific Visualization with VisIt
Petascale I/O Impacts on Visualization Hank Childs Lawrence Berkeley National Laboratory & UC Davis March 24, B element Rayleigh-Taylor Instability.
RCAC Research Computing Presents: DiaGird Overview Tuesday, September 24, 2013.
Summary Role of Software (1 slide) ARCS Software Architecture (4 slides) SNS -- Caltech Interactions (3 slides)
Slide 1 Visualization of scientific data under Linux - Techniques and data wrangling Mike Walterman, Manager of Graphics Programming, Scientific Computing.
Lawrence Livermore National Laboratory Visualization and Analysis Activities May 19, 2009 Hank Childs VisIt Architect Performance Measures x.x, x.x, and.
DANSE Central Services Michael Aivazis Caltech NSF Review May 23, 2008.
Astrophysics, Biology, Climate, Combustion, Fusion, Nanoscience Working Group on Simulation-Driven Applications 10 CS, 10 Sim, 1 VR.
E. WES BETHEL (LBNL), CHRIS JOHNSON (UTAH), KEN JOY (UC DAVIS), SEAN AHERN (ORNL), VALERIO PASCUCCI (LLNL), JONATHAN COHEN (LLNL), MARK DUCHAINEAU.
12.1 Vis_04 Data Visualization Lecture 12 Visualization Software Environments: - Overview of Major Systems - Distributed and Collaborative Visualization.
Challenges and Solutions for Visual Data Analysis on Current and Emerging HPC Platforms Wes Bethel & Hank Childs, Lawrence Berkeley Lab July 20, 2011.
Leicester, February 24, 2005 VisIVO, a VO-Enabled tool for Scientific Visualization and Data Analysis. VO-TECH Project. Stage01 Ugo Becciani INAF – Astrophysical.
11 4 VisIt is a richly featured, turnkey application VisIt is an open source, end user visualization and analysis tool for simulated and experimental data.
Scientific Visualization with VisIt Eliot Feibush PLASMA PRINCETON PHYSICS LABORATORY PICSciE Princeton Institute for Computational Science and Engineering.
Chapter Intranet Agents. Chapter Background Intranet: an internal corporate network based on Internet technology. Typically, an intranet can.
National Center for Supercomputing Applications University of Illinois at Urbana–Champaign Practical HPC Visualization Mark Van Moer Visualization Programmer.
VisIt: a visualization tool for large turbulence simulations  Outline Success stories with turbulent simulations Overview of VisIt project 1 Hank Childs.
DANSE Central Services Michael Aivazis Caltech NSF Review May 31, 2007.
VACET: Deploying Technology for Visualizing and Analyzing Astrophysics Simulations Author May 19, 2009.
Nov. 14, 2012 Hank Childs, Lawrence Berkeley Jeremy Meredith, Oak Ridge Pat McCormick, Los Alamos Chris Sewell, Los Alamos Ken Moreland, Sandia Panel at.
A framework to support collaborative Velo: Knowledge Management for Collaborative (Science | Biology) Projects A framework to support collaborative 1.
Khoros Yongqun He Dept. of Computer Science, Virginia Tech.
4.2.1 Programming Models Technology drivers – Node count, scale of parallelism within the node – Heterogeneity – Complex memory hierarchies – Failure rates.
AVS/Express and VisIt Training NERSC Users meeting June PPPL Cristina Siegerist NERSC/LBNL Visualization group June 13, 2006.
VisIt is an open source, richly featured, turn-key application for large data.  Used by:  Visualization experts  Simulation code developers  Simulation.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
GVis: Grid-enabled Interactive Visualization State Key Laboratory. of CAD&CG Zhejiang University, Hangzhou
LBNL VACET Activities Hank Childs Computer Systems Engineer - Visualization Group August 24, 2009.
VAPoR: A Discovery Environment for Terascale Scientific Data Sets Alan Norton & John Clyne National Center for Atmospheric Research Scientific Computing.
MESQUITE: Mesh Optimization Toolkit Brian Miller, LLNL
Lawrence Livermore National Laboratory S&T Principal Directorate - Computation Directorate Tools and Scalable Application Preparation Project Computation.
Connections to Other Packages The Cactus Team Albert Einstein Institute
Hank Childs, University of Oregon Volume Rendering Primer / Intro to VisIt.
Visualization with ParaView. Before we begin… Make sure you have ParaView 3.14 installed so you can follow along in the lab section –
Presented by Visualization at the Leadership Computing Facility Sean Ahern Scientific Computing Center for Computational Sciences.
Comprehensive Scientific Support Of Large Scale Parallel Computation David Skinner, NERSC.
1 27B element Rayleigh-Taylor Instability (MIRANDA, BG/L) VisIt: a visualization tool for large turbulence simulations Large data requires special techniques.
VisIt : A Tool for Visualizing and Analyzing Very Large Data Hank Childs, Lawrence Berkeley National Laboratory December 13, 2010.
OSSIM Technology Overview Mark Lucas. “Awesome” Open Source Software Image Map (OSSIM)
Ganga/Dirac Data Management meeting October 2003 Gennady Kuznetsov Production Manager Tools and Ganga (New Architecture)
Understanding your FLOW-3D simulations better with EnSight June 2012.
Visualization Tools for Nuclear Engineering Data Tom Fogal May 3 rd, 2011.
Deep Neural Networks: A Hands on Challenge
VisIt 2.0 Features Brad Whitlock.
Integrating Scientific Tools and Web Portals
Tools and Services Workshop
Working With Azure Batch AI
Writing a File Format Reader for VisIt
VisIt Libsim Update DOE Computer Graphics Forum 2012 Brad Whitlock
Spark Presentation.
Joseph JaJa, Mike Smorul, and Sangchul Song
In-situ Visualization using VisIt
Initial Adaptation of the Advanced Regional Prediction System to the Alliance Environmental Hydrology Workbench Dan Weber, Henry Neeman, Joe Garfield and.
EIN 6133 Enterprise Engineering
Chapter 18 MobileApp Design
CAE-SCRUB for Incorporating Static Analysis into Peer Reviews
Tutorial Overview February 2017
Document Visualization at UMBC
Polly Baker Division Director: Data, Mining, and Visualization
Overview of big data tools
What's New in eCognition 9
What's New in eCognition 9
What's New in eCognition 9
From Cyclist to Cyclus.js Cyclus user interfaces
Presentation transcript:

VisIt Project Overview

VisIt is an open source, turnkey application for scientific data analysis and visualization. Production end-user tool supporting scientific and engineering applications. Provides an infrastructure for parallel post-processing that scales from desktops to massive HPC clusters. Note: Here is a 500 word summary of VisIt http://visitusers.org/index.php?title=500words Density Isovolume of a 3K^3 (27 Bz) dataset

VisIt supports a wide range of use cases. Data Exploration Comparative Analysis = ? Quantitative Analysis Presentation Graphics Visual Debugging Visual Debugging

VisIt is a vibrant project with many participants. The VisIt project started in 2000 to support LLNL’s large scale ASC physics codes. The project grew beyond LLNL and ASC with research and development from DOE SciDAC and other efforts. VisIt is now supported by multiple organizations: LLNL, LBNL, ORNL, UC Davis, Univ of Utah, … Over 75 person years effort, 1.5+ million lines of code. Project Started LLNL ASC users transitioned to VisIt 2005 R&D 100 VACET Funded Transition to Public SW repo SDAV Funded VisIt 2.0 Release 2000 2003 2005 2006 2008 2010 2012

The VisIt team focuses on making a robust, usable product for end users. Regular releases (~ 6 / year) Executables for all major platforms End-to-end build process script ``build_visit’’ Customer Support and Training visitusers.org, wiki for users and developers Email lists: visit-users, visit-developers Beginner and advanced tutorials VisIt class with detailed exercises Documentation “Getting data into VisIt” manual Python interface manual Users reference manual Slides from the VisIt class

VisIt currently supports over 110 file formats. VisIt provides a flexible data model, suitable for many application domains. Mesh Types: Point, Curve, 2D/3D Rectilinear, Curvilinear, Unstructured Domain Decomposed, AMR Time Varying Fields: Scalar, Vector, Tensor, Material volume fractions, Species VisIt currently supports over 110 file formats.

Examples of VisIt’s visualization capabilities. Streamlines Vector / Tensor Glyphs Pseudocolor Rendering Volume Rendering Molecular Visualization Parallel Coordinates

VisIt employs a parallelized client-server architecture. Local Components Parallel Cluster (Files or Simulation) Data VisIt Engine Data Plugin VisIt Engine Data Plugin Data connection network MPI Data VisIt Engine Data Plugin VisIt Viewer Clients runs locally and displays results computed on the server Data processed in data flow networks Filters in data flow networks can be implemented as plug-ins Server runs remotely in parallel, handling data processing for client. Scalable rendering in parallel for largest datasets Data Flow Network Filter Python Clients Java Clients VisIt GUI VisIt CLI

Final Composited Image VisIt automatically switches to a scalable rendering mode for large data sets. Task 1 Task 3 Task 2 Task 4 Final Composited Image Compositing Rendering Modes: Local (hardware) Remote (software or hardware) Beyond surfaces: VisIt also provides scalable volume rendering.

VisIt scales well on current HPC platforms. Machine Architecture Problem Size # of Cores Graph X86_64 20,0013 (8 Tz) 12K Dawn BG/P 15,8713 (4 Tz) 64K Franklin Cray XT4 12,5963 (2 Tz) 32K JaguarPF Cray XT5 Juno 10,0003 (1Tz) 16K Ranger Sun Purple IBM P5 8,0003 (0.5 Tz) 8K Tz = Trillion Zones (or cells) Pictures are from a core-collapse supernova sim. Top is a Pseudocolor Plot of an isosurface, bottom is a Volume Rendering. Scaling Studies of Isosurface Extraction and Volume Rendering1 (2009) VisIt is also used daily by domain scientists.

VisIt’s infrastructure provides a flexible platform for custom workflows. C++ Plugin Architecture Custom File formats, Plots, Operators Interface for custom GUIs in Python, C++ and Java Python Interfaces Python scripting and batch processing Data analysis via Python Expressions and Queries. “libsim” library enables coupling of simulation codes to VisIt for in situ visualization. Simulation libsim Glue code VisIt runtime Data / Control

VisIt is used as a platform to deploy visualization research. Scaling research: Scaling to 10Ks of cores and trillions of cells. Algorithms research: How to efficiently calculate particle paths in parallel. Research Collaborations: 2006 – 2011 2012 – 2017 UT/TACC Subcontract Algorithms research: Reconstructing material interfaces for visualization Methods research: How to incorporate statistics into visualization. Research Focus: Next Generation Architectures Parallel Algorithms