Towards a Comprehensive Environment for Data Analysis and Visualization Pamela Gillman, John Clyne Users Forum May 19, 2005.

Slides:

Advertisements

Similar presentations

Designing Services for Grid-based Knowledge Discovery A. Congiusta, A. Pugliese, Domenico Talia, P. Trunfio DEIS University of Calabria ITALY

Advertisements

U.S. Department of Energy’s Office of Science Basic Energy Sciences Advisory Committee Dr. Daniel A. Hitchcock October 21, 2003

Hardware and Software Erik Brisson SCV Visualization Workshop – Fall 2008.

National Center for Atmospheric Research John Clyne 4/27/11 4/26/20111.

What’s New in Office Visio 2007 Microsoft Office Visio 2007 drawing and diagramming software makes it easy for IT and business professionals to.

Summary Role of Software (1 slide) ARCS Software Architecture (4 slides) SNS -- Caltech Interactions (3 slides)

Why you need McIDAS-V Steve Ackerman Tom Achtor. Introduction What is McIDAS-V? Why I want it? Why you will want it!

BlogMyData A Virtual Research Environment for collaborative visualization of environmental data Andrew Milsted | 14 September 2010.

Silicon Graphics, Inc. Poster Presented by: SGI Proprietary Technologies for Breakthrough Research Rosario Caltabiano North East Higher Education & Research.

July 21, 2005Interdisciplinary Modeling of Acquatic Ecosystems, Lake Tahoe 1 Advanced Computing in Environmental Sciences ACES Vanda Grubišić Desert Research.

GPPC Connections 2011 | November 6-8 | Las Vegas, NV SharePoint 101: An Introduction to Microsoft SharePoint 2010 Joseph Tews, MCITP, MCT Summit Group.

1 BrainWave Biosolutions Limited Accelerating Life Science Research through Technology.

Current Visualization Software NCL, Amira, and OpenDX By Drew Brumm.

Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.

Storm Tracker – a Web-Based Tool for Working with the Automated Tracking of Thunderstorm Clusters Bob Rabin NOAA / NSSL / CIMSS Tom Whittaker Space Science.

Scientific Data Infrastructure in CAS Dr. Jianhui Scientific Data Center Computer Network Information Center Chinese Academy of Sciences.

CCSM Portal/ESG/ESGC Integration (a PY5 GIG project) Lan Zhao, Carol X. Song Rosen Center for Advanced Computing Purdue University With contributions by:

Research Data at NCAR 1 August, 2002 Steven Worley Scientific Computing Division Data Support Section.

DORII Joint Research Activities DORII Joint Research Activities Status and Progress 4 th All-Hands-Meeting (AHM) Alexey Cheptsov on.

Amit Chourasia Visualization Scientist San Diego Supercomputer Center Presented at : Cyberinfrastructure Internship Experiences for Graduate Students Spring.

Enabling Cloud and Grid Powered Image Phenotyping Nirav Merchant iPlant Collaborative

material assembled from the web pages at

Transparent Grid Enablement Using Transparent Shaping and GRID superscalar I. Description and Motivation II. Background Information: Transparent Shaping.

Creating and Operating a Digital Library for Information and Learning– the GROW Project Muniram Budhu Department of Civil Engineering & Engineering Mechanics.

Scientific Investigations; Support from Research Data Archives for Joint Office for Science Support 26 February, 2002 Steven Worley SCD/DSS.

Cyberinfrastructure Planning at NSF Deborah L. Crawford Acting Director, Office of Cyberinfrastructure HPC Acquisition Models September 9, 2005.

NCAR Computation and Information Systems Laboratory Facilities and Support Overview UCAR Postdoctoral and Graduate Fellows March 16, 2007 Mike Page Consulting.

Fisheries Oceanography Collaboration Software Donald Denbo NOAA/PMEL-UW/JISAO Presented by Nancy Soreide NOAA/PMEL AMS 2002/IIPS 10.3.

RENCI’s BEN (Breakable Experimental Network) Chris Heermann

Grid Architecture William E. Johnston Lawrence Berkeley National Lab and NASA Ames Research Center (These slides are available at grid.lbl.gov/~wej/Grids)

NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.

Welcome! 2 nd User Forum 2005 Computational and Information Systems Laboratory (CISL) User Forum May 2005.

GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.

Scalable Systems Software for Terascale Computer Centers Coordinator: Al Geist Participating Organizations ORNL ANL LBNL.

VAPoR: A Discovery Environment for Terascale Scientific Data Sets Alan Norton & John Clyne National Center for Atmospheric Research Scientific Computing.

SCD Portal Gateway to SCD Supercomputers and Account Information Lana M. Stillwell Assistant Section Manager Enterprise Systems Section SCD User Forum.

Center for Computational Visualization University of Texas, Austin Visualization and Graphics Research Group University of California, Davis Molecular.

PRISM WP4a Visualization Meeting DKRZ / MPI-MaD Hamburg 29th January 2002 PRISM WP4a Visualization Meeting DKRZ / MPI-MaD Hamburg 29 th January 2002.

The OptIPuter Project Tom DeFanti, Jason Leigh, Maxine Brown, Tom Moher, Oliver Yu, Bob Grossman, Luc Renambot Electronic Visualization Laboratory, Department.

1 NSF/TeraGrid Science Advisory Board Meeting July 19-20, San Diego, CA Brief TeraGrid Overview and Expectations of Science Advisory Board John Towns TeraGrid.

29 March 2004 Steven Worley, NSF/NCAR/SCD 1 Research Data Stewardship and Access Steven Worley, CISL/SCD Cyberinfrastructure meeting with Priscilla Nelson.

Sergiu April 2006June 2006 Overview of TeraGrid Resources and Services Sergiu Sanielevici, TeraGrid Area Director for User.

| nectar.org.au NECTAR TRAINING Module 2 Virtual Laboratories and eResearch Tools.

Scientific Visualization Facilities The Digital Worlds Institute Andy Quay Associate Director Digital Worlds Institute University of Florida.

U.S. Department of the Interior U.S. Geological Survey Decision Support Tools and USGS Data Management Best Practices Cassandra Ladino USGS Chesapeake.

Cyberinfrastructure: Many Things to Many People Russ Hobby Program Manager Internet2.

Internet2 Applications Group: Renater Group Presentation T. Charles Yun Internet2 Program Manager, Applications Group 30 October 2001.

Module 1: Overview of Microsoft Office SharePoint Server 2007.

Comprehensive Scientific Support Of Large Scale Parallel Computation David Skinner, NERSC.

National Center for Supercomputing Applications University of Illinois at Urbana–Champaign Visualization Support for XSEDE and Blue Waters DOE Graphics.

1 1 NOAA Office of Ocean Exploration End-to-End Data Management: A Success Story NOAA Tech Conference November 2005 Susan Gottfried National Coastal Data.

Visualization with help from SCV Erik Brisson Boston University Scientific Computing and Visualization.

Office of Science Statement on Digital Data Management Laura Biven, PhD Senior Science and Technology Advisor Office of the Deputy Director for Science.

Books Visualizing Data by Ben Fry Data Structures and Problem Solving Using C++, 2 nd edition by Mark Allen Weiss MATLAB for Engineers, 3 rd edition by.

The Global Organization for Earth System Science Portals Don Middleton National Center for Atmospheric Research; Boulder, Colorado, USA Scientific Computing.

Nigel Lockyer Fermilab Operations Review 16 th -18 th May 2016 Fermilab in the Context of the DOE Mission.

EGEE-III INFSO-RI Enabling Grids for E-sciencE Nov. 18, EGEE and gLite are registered trademarks High-End Computing - Clusters.

Page : 1 SC2004 Pittsburgh, November 12, 2004 DEISA : integrating HPC infrastructures in Europe DEISA : integrating HPC infrastructures in Europe Victor.

Columbia University Department of Computer Science Henning Schulzrinne 2001 NSF CISE/EIA RI PI’s Workshop.

Introduction of Scratch (1/4) You can find Scratch on the Web:

Introduction to Parallel Computing: MPI, OpenMP and Hybrid Programming

MATLAB Distributed, and Other Toolboxes

VE Solution Overview Idea to Performance VE Process Suite – Deep Dive

Joseph JaJa, Mike Smorul, and Sangchul Song

Columbia University Department of Computer Science

University of Technology

SDM workshop Strawman report History and Progress and Goal.

Data Management Components for a Research Data Archive

Scientific Visualization

Gaurab KCa,b, Zachary Mitchella,c and Sarat Sreepathia

Presentation transcript:

Towards a Comprehensive Environment for Data Analysis and Visualization Pamela Gillman, John Clyne Users Forum May 19, 2005

Overview Introduction Mission Mission Goals Current Services Integrating Scientific Work Flow Centralized Data Access Contact Information Questions?

Introduction Data Analysis Services Group Formed in November 2004 Pamela Gillman, John Clyne, Joey Mendoza

Mission Statement Enhancing scientific workflow by providing the research community with a highly advanced computing environment tailored toward the specialized needs of interactive data post-processing, analysis and visualization.

Mission Goals Providing a state of the art, unified computing environment comprised of powerful, closely coupled, interactive processing and visualization engines, high-performance storage, and specialized software applications Providing large-capacity, high-performance file systems shared between heterogeneous computers used for modeling, data analysis, visualization and access Evaluating, exploring and integrating applicable new technologies and methodologies to support the mission Producing visual content (animations and imagery) as a support service on behalf of scientific staff Performing basic research and algorithm development of relevant visualization and analysis methods

Current Services (1) Tempest –Interactive and batch data processing and analysis –Model validation –Applications IDL, MATLAB, NCL, NCO –Libraries IMSL, NAG –Development Environment MIPSPro C, C++, F77, F90 MPI, OMP GNU tools flint, WorkShop, WorkShopMPF

Advanced visualization facilities –3D and 4D data –Terascale data sets Remote visualization services Applications and libraries: –Vtk, Vis5d, IDL, NCL, OpenDX, and more Expert visualization staff Production visualization animation and imaging Customers: –Scientists –Support staff (e.g. VETS) Current Services (2)

Current Services (3) SCD Visualization Lab –Large format, high- resolution stereoscopic display –Group meeting room –Access Grid –Operated by SCD’s Visualization and Enabling Technologies Section (VETS) The SCD VisLab: A decision making environment for NCAR sciences Photo: Carlye Calvin -- UCAR Reservations and info :

Video Switch High Bandwidth Switch SGI Onyx3800 Irix/MIPS Visualization SMP SGI Origin2000 Irix/MIPS Analysis SMP Ciprico Shared Storage Array Interne t 64bit commodity visualization cluster Visual Computing and Display Resources SGI Prism Linux/Itanium2 Visualization SMP

Gfx pipe GigE FC cpu 0 cpu 9 High bandwidth shared storage Visual Supercomputer Local visualization Internet images X11 protocol Remote visualization Office Based Remote Visualization

Integrating Scientific Work Flow Problem Computation Analyze Results Visualize Results Publish Results

Centralized Data Access high-performance file system Analysis Servers VIS Servers CXFS Compute Servers GPFS MSS Servers cache data portal SCD portal SNFS

Contact Information SCD Customer Support – – DASG –

Questions?