VisTrails: Overview Juliana Freire University of Utah Joint work with: Erik Andersen, Steven P. Callahan, David Koop, Emanuele.

Slides:



Advertisements
Similar presentations
GRADD: Scientific Workflows. Scientific Workflow E. Science laboris Workflows are the new rock and roll of eScience Machinery for coordinating the execution.
Advertisements

Kensington Oracle Edition: Open Discovery Workflow Meets Oracle 10g Professor Yike Guo.
Liz Marai 07/08/08 Data Management and Visualization at Pitt CS Liz Marai Pitt Computer Science CMU Robotics Institute (adj) LSST, 08/07/2008.
ASCR Data Science Centers Infrastructure Demonstration S. Canon, N. Desai, M. Ernst, K. Kleese-Van Dam, G. Shipman, B. Tierney.
UCSD SAN DIEGO SUPERCOMPUTER CENTER Ilkay Altintas Scientific Workflow Automation Technologies Provenance Collection Support in the Kepler Scientific Workflow.
The Virtual Estuary: Simulation meets Visualization Yvette Spitz Scott Durski Erik Anderson Joel Daniels Juliana Freire Claudio Silva Antonio Baptista.
Prof. Carolina Ruiz Computer Science Department Bioinformatics and Computational Biology Program WPI WELCOME TO BCB4003/CS4803 BCB503/CS583 BIOLOGICAL.
Web Accessible Virtual Research Environment for Ecosystem Science Community Presentation by Siddeswara Guru.
Experiences In Building Globus Genomics Using Galaxy, Globus Online and AWS Ravi K Madduri University of Chicago and ANL.
Maya to Radiance Combining the best of both worlds Richard Gillibrand Dr Alan Chalmers, Gavin Ellis, Patrick Ledda University of Bristol and 3CResearch.
Funding Networks Abdullah Sevincer University of Nevada, Reno Department of Computer Science & Engineering.
VisTrails Provenance In VisIt David Koop. VisIt Basics ‘Turn-key’ visualization application Viewer GUI Plots / Operators.
Time Series Analyst An Internet Based Application for Viewing and Analyzing Environmental Time Series Jeffery S. Horsburgh Utah State University David.
McGuinness – Microsoft eScience – December 8, Semantically-Enabled Science Informatics: With Supporting Knowledge Provenance and Evolution Infrastructure.
Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.
Supervised by Prof. LYU, Rung Tsong Michael Department of Computer Science & Engineering The Chinese University of Hong Kong Prepared by: Chan Pik Wah,
Integrating Historical and Realtime Monitoring Data into an Internet Based Watershed Information System for the Bear River Basin Jeff Horsburgh David Stevens,
Mike Smorul Saurabh Channan Digital Preservation and Archiving at the Institute for Advanced Computer Studies University of Maryland, College Park.
Social-Aware Collaborative Visualization for Large Scientific Projects Kwan-Liu Ma and Chaoli Wang CTS’085/21/2008.
Social Network Analysis: Tasks and Tools Steven Loscalzo and Lei Yu Department of Computer Science Watson School of Engineering and Applied Science State.
Erik Anderson 1, James Ahrens 2, Gilbert Preston 3, Antonio Baptista 4, Claudio Silva 1 VisTrails: Applications in Scientific Visualization 1 SCI Institute.
Tangible Flags Collaborative Educational Technology to enhance grade school field trips Gene Chipman PhD Candidate in Computer Science
Sara Bowman Center for Open Science Open Science Framework: Facilitating Transparency and Reproducibility.
GMD German National Research Center for Information Technology Innovation through Research Jörg M. Haake Applying Collaborative Open Hypermedia.
Using Provenance to Support Real-Time Collaborative Design of Workflows Tommy Ellkvist 1, Erik Anderson 2, David Koop 2, Juliana Freire 2, and Claudio.
Directions in Web Search Interfaces: Enhancing Visualization and Interaction to Support Exploratory Search Bill Kules 2010 SLIS Symposium - Bridging the.
GRACE Project IST EGAAP meeting – Den Haag, 25/11/2004 Giuseppe Sisto – Telecom Italia Lab.
Geovisualization for Constructing and Sharing Concepts Alan M. MacEachren, Mark Gahegan, & Bill Pike GeoVISTA Center Geography, Penn State
Lecture 01: Introduction September 5, 2012 COMP Visual Analytics and Provenance.
Observatories as Integrators Bill Howe, Phd David Maier,Maseeh Professor of Emerging Techologies, Portland State University Claudio Silva, University of.
The ACGT Workflow Editing & Enactment Environment Giorgos Zacharioudakis Institute of Computer Science, Foundation for Research & Technology – Hellas (ICS-FORTH)
Recent Work/Papers by the Visualization and Geometry Computing (VGC) Group.
Visual Perspectives iPLANT Visual Analytics Workshop November 5-6, 2009 ;lk Visual Analytics Bernice Rogowitz Greg Abram.
Accelerating Scientific Exploration Using Workflow Automation Systems Terence Critchlow (LLNL) Ilkay Altintas (SDSC) Scott Klasky(ORNL) Mladen Vouk (NCSU)
Pascucci-1 Valerio Pascucci Director, CEDMAV Professor, SCI Institute & School of Computing Laboratory Fellow, PNNL Massive Data Management, Analysis,
1 Knowledge Transfer in the Cyber-Infrastructure Group –Microsoft eScience Tools –NANOOS and IOOS Web Services.
ReproZip Packing Experiments for Sharing and Publication Fernando Chirigati, Juliana Freire | NYU-Poly Dennis Shasha | NYU.
VAPoR: A Discovery Environment for Terascale Scientific Data Sets Alan Norton & John Clyne National Center for Atmospheric Research Scientific Computing.
Digital Libraries1 David Rashty. Digital Libraries2 “A library is an arsenal of liberty” Anonymous.
Toward interactive visualization in a distributed workflow Steven G. Parker Oscar Barney Ayla Khan Thiago Ize Steven G. Parker Oscar Barney Ayla Khan Thiago.
© 2010 Pearson Addison-Wesley. All rights reserved. Addison Wesley is an imprint of Designing the User Interface: Strategies for Effective Human-Computer.
Millman—Nov 04—1 An Update on Digital Libraries David Millman Director of Research & Development Academic Information Systems Columbia University
Khalid Belhajjame 1, Paolo Missier 2, and Carole A. Goble 1 1 University of Manchester 2 University of Newcastle Detecting Duplicate Records in Scientific.
Cyberinfrastructure: Many Things to Many People Russ Hobby Program Manager Internet2.
ITE District 6 Annual Meeting 1 Implementing a Web-based Transportation Data Management System Prepared for: ITE District 6 Annual Meeting Honolulu, Hawaii.
© Geodise Project, University of Southampton, Integrating Data Management into Engineering Applications Zhuoan Jiao, Jasmin.
GraDS MacroGrid Carl Kesselman USC/Information Sciences Institute.
VisTrails Second Provenance Challenge Tommy Ellkvist David Koop Juliana Freire Joint work with: Erik Andersen, Steven P. Callahan, Emanuele Santos, Carlos.
2nd Texas A&M Big Data Workshop Development of “Big Data” Scientific Workflow Management Tools for the Materials Genome Initiative: “Materials Galaxy”
IPlant Collaborative Tools and Services Workshop Overview of the iPlant Discovery Environment Sriram Srinivasan.
Workflow-Driven Science using Kepler Ilkay Altintas, PhD San Diego Supercomputer Center, UCSD words.sdsc.edu.
Workflow Management Concepts and Requirements For Scientific Applications.
Using Provenance to Enable Reproducible Science Juliana Freire NYU Poly.
Thomas Grandell April 8 th, 2016 This work is licensed under the Creative Commons Attribution 4.0 International.
INTRODUCTION TO XSEDE. INTRODUCTION  Extreme Science and Engineering Discovery Environment (XSEDE)  “most advanced, powerful, and robust collection.
Visualization Tools for Nuclear Engineering Data Tom Fogal May 3 rd, 2011.
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement n° Reproducible.
Hans-Peter Plag Global Change and Sustainability Research Institute
MIRACLE Cloud-based reproducible data analysis and visualization for outputs of agent-based models Xiongbing Jin, Kirsten Robinson, Allen Lee, Gary Polhill,
Tools and Services Workshop
University of Chicago and ANL
ReproZip: Computational Reproducibility With Ease
Joseph JaJa, Mike Smorul, and Sangchul Song
HydroConnect Managing Hydrological data and Connections between them
Enhancing Scholarly Communication with ReproZip
Future-oriented Benchmarking Through Social Media Analysis
Distributed Storage in Automated Data Transfer
orange.biolab.si A general-purpose open source component-based
CHAPTER 14: Information Visualization
Presentation transcript:

VisTrails: Overview Juliana Freire University of Utah Joint work with: Erik Andersen, Steven P. Callahan, David Koop, Emanuele Santos, Carlos E. Scheidegger, Claudio Silva and Huy T. Vo

VisTrails: An Overview VisTrails: Managing Provenance u Provenance of computational artifacts is necessary to reproduce, validate and share scientific results

VisTrails: An Overview VisTrails: Managing Provenance u Provenance of computational artifacts is necessary to reproduce, validate and share scientific results u VisTrails provides comprehensive provenance infrastructure for computational tasks –Provenance is captured transparently –Efficient storage and intuitive query interfaces for exploring provenance data –Support for collaboration u Designed to support exploratory tasks such as visualization and data mining –Task specification iteratively refined as users generate and test hypotheses u VisTrails is open source:

VisTrails: An Overview Provenance for Workflows u Treat a workflow (computational task)as a first- class data product u In exploratory tasks, series of workflows are created and refined: change is the norm u Keep exploration trail Provenance can be as important as the results! (Freire et al., IPAW 2006)

VisTrails: An Overview Keeping Scientific Exploration Trails Trail Workflows u Uniformly captures data and workflow provenance –Data provenance: where does a specific data product come from? –Workflow evolution: how has workflow structure changed over time?

VisTrails: An Overview Keeping Scientific Exploration Trails Trail Initial visualization with z-scaling corrected Notes Added texture and shading Added plane to visualize internal structure Found good transfer function Identified lesion tissue User juliana eranders stevec

VisTrails: An Overview Provenance Beyond Reproducibility Scalable exploration of parameter spaces Visual comparison of workflows and data products Query workflows by example

VisTrails: An Overview Querying Workflows u Workflows are graphs: hard to specify queries using text u Querying workflows by example –WYSIWYQ -- What You See Is What You Query –Interface to create workflow is same as to query (Scheidegger et al., TVCG 2007)

VisTrails: An Overview Creating Workflows by Analogy u Simplify creation of workflows u Use the wisdom of the crowds –Some workflow refinements are common, e.g., change the rendering technique, publish image on the Web u Apply refinements by analogy, automatically Source Target (Scheidegger et al., TVCG 2007)

VisTrails: An Overview Integrating Tools and Libraries SCIRun in VisTrails Workflow that combines 5 different libraries VisTrails add-on for ParaView

VisTrails: An Overview Applications and Users Psychiatry-U of Utah

VisTrails: An Overview Applications and Users Physics-Cornell

VisTrails: An Overview Applications and Users Environmental Science-OHSU

VisTrails: An Overview Acknowledgments u This work is partially supported by the National Science Foundation, the Department of Energy, an IBM Faculty Award, and a University of Utah Seed Grant.

VisTrails: An Overview More info about VisTrails google vistrails Or