Visualization for astronomy, via medical imaging Michael Halle Initiative in Innovative Computing at Harvard & Surgical Planning Lab, Brigham and Women’s.

Slides:



Advertisements
Similar presentations
Neuroimage Analysis Center An NCRR National Resource Center Viewing essentials GE Research § Isomics ¥ Surgical Planning Laboratory,
Advertisements

NA-MIC National Alliance for Medical Image Computing National Alliance for Medical Image Computing: NAMIC Ron Kikinis, M.D.
Surgical Planning Laboratory Brigham and Women’s Hospital Boston, Massachusetts USA a teaching affiliate of Harvard Medical School User Interfaces and.
Slicer Welcome Tutorial
Surgical Planning Laboratory Brigham and Women’s Hospital Boston, Massachusetts USA a teaching affiliate of Harvard Medical School 3D Slicer And The NA-MIC.
Application of Medical Imaging Software to the 3D Visualization of Astronomical Data Michelle Borkin, Alyssa Goodman, Mike Halle, Doug Alan, & Jens Kauffmann.
Application of Medical Imaging Software to 3D Visualization of Astronomical Data Michelle Borkin Alyssa Goodman, Mike Halle, Doug Alan ADASS 2006 Conference.
Interactive, GPU-Based Level Sets for 3D Segmentation Aaron Lefohn Joshua Cates Ross Whitaker University of Utah Aaron Lefohn Joshua Cates Ross Whitaker.
IS&T Scientific Visualization Tutorial - Summer 2010 Scientific Visualization Tutorial.
Surgical Planning Laboratory Brigham and Women’s Hospital Boston, Massachusetts USA a teaching affiliate of Harvard Medical School Predicting The Future.
The Initiative in Innovative Computing at Harvard Alyssa A. Goodman Professor of Astronomy & Founding Director of the Initiative in Innovative Computing,
NA-MIC National Alliance for Medical Image Computing Interactive Editor tutorial Sonia Pujol, Ph.D. Surgical Planning Laboratory Harvard.
NA-MIC National Alliance for Medical Image Computing Core 1b – Engineering End-user Platform Steve Pieper Isomics, Inc.
An Interactive Segmentation Approach Using Color Pre- processing Marisol Martinez Escobar Ph.D Candidate Major Professor: Eliot Winer Department of Mechanical.
-1- Pujol S et al. National Alliance for Medical Image Computing 3D Visualization of FreeSurfer Data Sonia Pujol, Ph.D. Silas Mann, B.Sc. Randy Gollub,
Surgical Planning Laboratory Brigham and Women’s Hospital Boston, Massachusetts USA a teaching affiliate of Harvard Medical School Visit of Barbara Alving,
NA-MIC National Alliance for Medical Image Computing NAMIC-Kit Update Will Schroeder Jim Miller Bill Lorensen.
Slide 1 Image Guided Surgery. Slide 2 Conventional Surgery: Seeing surfaces Provided by Nakajima, Atsumi et al.
NA-MIC National Alliance for Medical Image Computing Slicer for Neurosurgical Planning IBMSPS th Annual World Congress for Brain.
Diffusion MRI Analysis in 3D Slicer Carl-Fredrik Westin 1,2, Steven Pieper 1,2, Marek Kubicki 1,3, Ron Kikinis 1,2 1 Laboratory of Mathematics in Imaging,
NA-MIC National Alliance for Medical Image Computing The NA-MIC Kit National Alliance for Medical Image Computing.
Image-guided therapy and medical robotics tutorial using a LEGO Mindstorms NXT robot and 3D Slicer Danielle F. Pace, B.CmpH Ron Kikinis, M.D. Nobuhiko.
NA-MIC National Alliance for Medical Image Computing NA-MIC Software Engineering Bill Lorensen GE Research NA-MIC Engineering Core PI.
3D Slicer: A Free & Open Source Platform For Medical Image Analysis and Visualization Brigham and Women’s Hospital.
NA-MIC National Alliance for Medical Image Computing Why NITRC Matters to NA-MIC Steve Pieper, PhD.
Surgical Planning Laboratory Brigham and Women’s Hospital Boston, Massachusetts USA a teaching affiliate of Harvard Medical School Free Open Source Software.
Morphometry BIRN Bruce Rosen, M.D. Ph.D.. Scientific Goal Methods –Multi-site MRI calibration, acquisition –Integrate advanced image analysis and visualization.
NA-MIC National Alliance for Medical Image Computing Core 1b – Engineering Highlights, Aims and Architecture Will Schroeder Kitware.
-1- 3D Visualization. Sonia Pujol, Ph.D., Harvard Medical School National Alliance for Medical Image Computing 3D Visualization Sonia Pujol, Ph.D. Surgical.
Surgical Planning Laboratory Brigham and Women’s Hospital Boston, Massachusetts USA a teaching affiliate of Harvard Medical School Overview Ron Kikinis,
6/21/2005VG 2005 Volume Graphics: What's in the cards... Michael Meissner (Viatronix)
Seeing Science with Animation Alyssa A. Goodman Harvard University.
Pujol S., Plesniak, W. -1- National Alliance for Medical Image Computing Neuroimage Analysis Center Harvard CTSC Slicer3 minute tutorial Sonia Pujol, PhD.
NA-MIC National Alliance for Medical Image Computing The NA-MIC Kit: ITK, VTK, Pipelines, Grids and 3D Slicer as An Open Platform for.
NA-MIC National Alliance for Medical Image Computing NAMIC Software Development Workshop January 24-25, 2005 MIT Computer Science and.
TipiX Rapid Visualization of Large Datasets Adrian V. Dalca, Ramesh Sridharan, Natalia Rost, Polina Golland 1.
NA-MIC National Alliance for Medical Image Computing Registering Image Volumes in Slicer Steve Pieper.
NA-MIC National Alliance for Medical Image Computing National Alliance for Medical Image Computing: NAMIC Ron Kikinis, M.D.
Exploring Peritumoral White Matter Fibers for Neurosurgical Planning Sonia Pujol, Ph.D. Ron Kikinis, M.D. Surgical Planning Laboratory Harvard University.
Volume Visualization Presented by Zhao, hai. What’ volume visualization Volume visualization is the creation of graphical representations of data sets.
EMSegmentation in Slicer 3 B. Davis, S. Barre, Y. Yuan, W. Schroeder, P. Golland, K. Pohl.
Visualization of Tumors in 4D Medical CT Datasets Visualization of Tumors in 4D Medical CT Datasets Burak Erem 1, David Kaeli 1, Dana Brooks 1, George.
Visualization with ParaView. Before we begin… Make sure you have ParaView 3.14 installed so you can follow along in the lab section –
Astronomical Data and Information Visualization Alyssa A. Goodman Harvard-Smithsonian Center for Astrophysics Initiative in Innovative Computing at Harvard.
Morphometry BIRN Semi-Automated Shape Analysis (SASHA) JHU (CIS): M. F. Beg, C. Ceritoglu, A. Kolasny, M. I. Miller, R. Yashinski MGH (NMR): B. Fischl;
©2005 Surgical Planning Laboratory, ARR Slide 1 Prostate Image Processing Steven Haker, PhD.
NA-MIC National Alliance for Medical Image Computing Kitware, Inc. Core 2 Engineering William J. Schroeder.
NA-MIC National Alliance for Medical Image Computing 3D Slicer Version 3.0 and Diffusion MRI Steve Pieper, PhD.
NA-MIC National Alliance for Medical Image Computing NAMIC Software Development Workshop December 9-10, 2004 Surgical Planning Lab, Brigham.
Surgical Planning Laboratory Brigham and Women’s Hospital Boston, Massachusetts USA a teaching affiliate of Harvard Medical School Why Open-Source Will.
Triedman Patient-Specific Modeling of Defibrillation in Children Collaborators: Children’s Hospital Boston: John Triedman, Assoc. Prof. Pediatrics Matt.
An Open Source Platform for Registration, Segmentation, Quantitative Analysis, and Visualization of Biomedical Image Data 3D Slicer About 3D Slicer Segmentation.
Surgical Planning Laboratory -1- Brigham and Women’s Hospital Slicer Tutorial 4 Module: DTMRI Data: Sample Slicer DTI Sonia Pujol,
VisIt Project Overview
3D Visualization Sonia Pujol, Ph.D. Instructor of Radiology
RSNA2012 Quantitative Imaging Reading Room
Ron Kikinis, MD Professor of Radiology, Harvard Medical School
واقعیت مجازی و کاربرد آن در پزشکی
NAMIC Software Development Workshop
3D Visualization of FreeSurfer Data
سخنی از او به میان نمی آورند آنان که از او سخن می رانند
Ron Kikinis, MD Professor of Radiology, Harvard Medical School
3D Slicer Version 3.0 Update for mBIRN
Tumor Segmentation from DCE-MRI with OpenCAD
Igyne Tutorial Xiaojun Chen, Ph.D.1 Jan Egger, Ph.D., Ph.D.1
Scientific Visualization
NA-MIC Kit
Registration Foundations
Introduction to Scientific Visualization
Interactive Editor tutorial
Presentation transcript:

Visualization for astronomy, via medical imaging Michael Halle Initiative in Innovative Computing at Harvard & Surgical Planning Lab, Brigham and Women’s Hospital Michael Halle Initiative in Innovative Computing at Harvard & Surgical Planning Lab, Brigham and Women’s Hospital IIC Astronomical Medicine Project Image: M. Borkin

IIC Astronomical Medicine Project Outline The data analysis (“visualization”) pipeline Medical imaging and astronomy Algorithms, libraries, frameworks, apps The AM project

IIC Astronomical Medicine Project Welcome to my world… …your quick introduction to medical imaging, and thereby astronomical visualization.

IIC Astronomical Medicine Project Wayback machine: early 1990’s Radiologists: special training Slice by slice inspection of CT or MRI “We do it in our head” Not prepared for large datasets “Cine loop”: not much better

IIC Astronomical Medicine Project Today 3D visualization widespread Complex structures Advanced image processing

IIC Astronomical Medicine Project Example: Diffusion Tensor Imaging A. Mewes

IIC Astronomical Medicine Project The jump to 3D, with new semantics A. Mewes

IIC Astronomical Medicine Project A. Mewes

IIC Astronomical Medicine Project From scanner to display segmentregisteracquire visualize display & interact enhance

IIC Astronomical Medicine Project Acquisition

IIC Astronomical Medicine Project Enhancement C.F. Westin et. al.

IIC Astronomical Medicine Project Registration Align multiple images Different…  positions  timepoints  subjects May be warped In medicine, no absolute coordinates S. Pieper

IIC Astronomical Medicine Project Segmentation T. Kapur. Guttmann et. al Single channel Multi-channel

IIC Astronomical Medicine Project Visualization

IIC Astronomical Medicine Project Display and interaction B. Davis, S. Barre, Y. Yuan, W. Schroeder, P. Golland, K. Pohl

IIC Astronomical Medicine Project Not a straight-line process! Interaction can drive:  image processing  registration  segmentation  visualization Iteration is powerful S. Pieper

IIC Astronomical Medicine Project So what is “visualization” ? Computer graphics and computation - plus - Generic structures and techniques  volumes  isosurfaces  streamlines  visual controls, etc. - plus - Application semantics - plus - Human perception Pieper, Fallon (UCI)

IIC Astronomical Medicine Project Example: isosurfaces vs. volume rendering Isosurface renderingVolume rendering representation:surfacesvolumes primitives:continuousdiscrete speed:faster, grows linearly w/complexityslower, stays constant w/complexity segmentation:your choiceglobal transfer functions SCI Institute, Univ. of Utah Talos et. al.

IIC Astronomical Medicine Project How is this like astronomy? Multi-dimensional image data Analysis pipeline:  s/human/sky/g  s/scanner/telescope/g - Most of analysis pipeline the same - Differences:  WCS  Often only partially spatial  Second order image/noise characteristics  Interchange issues Borkin

IIC Astronomical Medicine Project “Astronomical Medicine” Bootstrap astronomical visualization & discover Dual-purpose development Astronomy-specific functionality Cross-pollenate segmentation techniques Borkin Rosolowsky, Kauffmann et.al.

IIC Astronomical Medicine Project Different layers of software Applications  3D Slicer, OsiriX, ParaView, VolView, Amira…  Apps you’ll see here Frameworks/libraries  Visualization: VTK  Segmentation and registration: ITK Rendering and interaction libraries  OpenInventor/Coin  Java3D  OpenGL Borkin

IIC Astronomical Medicine Project Applications: 3D Slicer Medical image analysis, segmentation, and visualization platform Cross platform, open source Surface rendering (volume rendering to come) Borkin

IIC Astronomical Medicine Project Applications: OsiriX Originally designed for radiology image databases Mac only, open-source Volume rendering (some isosurfaces as well) Borkin

IIC Astronomical Medicine Project Research prototypes Dendrogram visualization AMView astronomy data viewer

IIC Astronomical Medicine Project Stereoscopic imaging and 3D See Nick Holliman’s talk and demos! Stereoscopic imaging and 3D

IIC Astronomical Medicine Project Parting thoughts Augment, not replace existing tools Working together to solve, create and discover New “golden age” of astronomy visualization? Borkin

IIC Astronomical Medicine Project Thanks Astronomical Medicine Project Alyssa Goodman, Michelle Borkin, Jens Kauffmann, Doug Alan, Nick Holliman Harvard IIC Rita Tavilla, Emily Lohmann Surgical Planning Lab Ron Kikinis, Steve Pieper, Tina Kapur, and many others Harvard-Smithsonian Center for Astrophysics The CfA COMPLETE team, including Erik Rosolowsky