Visualization for astronomy, via medical imaging Michael Halle Initiative in Innovative Computing at Harvard & Surgical Planning Lab, Brigham and Women’s Hospital Michael Halle Initiative in Innovative Computing at Harvard & Surgical Planning Lab, Brigham and Women’s Hospital IIC Astronomical Medicine Project Image: M. Borkin
IIC Astronomical Medicine Project Outline The data analysis (“visualization”) pipeline Medical imaging and astronomy Algorithms, libraries, frameworks, apps The AM project
IIC Astronomical Medicine Project Welcome to my world… …your quick introduction to medical imaging, and thereby astronomical visualization.
IIC Astronomical Medicine Project Wayback machine: early 1990’s Radiologists: special training Slice by slice inspection of CT or MRI “We do it in our head” Not prepared for large datasets “Cine loop”: not much better
IIC Astronomical Medicine Project Today 3D visualization widespread Complex structures Advanced image processing
IIC Astronomical Medicine Project Example: Diffusion Tensor Imaging A. Mewes
IIC Astronomical Medicine Project The jump to 3D, with new semantics A. Mewes
IIC Astronomical Medicine Project A. Mewes
IIC Astronomical Medicine Project From scanner to display segmentregisteracquire visualize display & interact enhance
IIC Astronomical Medicine Project Acquisition
IIC Astronomical Medicine Project Enhancement C.F. Westin et. al.
IIC Astronomical Medicine Project Registration Align multiple images Different… positions timepoints subjects May be warped In medicine, no absolute coordinates S. Pieper
IIC Astronomical Medicine Project Segmentation T. Kapur. Guttmann et. al Single channel Multi-channel
IIC Astronomical Medicine Project Visualization
IIC Astronomical Medicine Project Display and interaction B. Davis, S. Barre, Y. Yuan, W. Schroeder, P. Golland, K. Pohl
IIC Astronomical Medicine Project Not a straight-line process! Interaction can drive: image processing registration segmentation visualization Iteration is powerful S. Pieper
IIC Astronomical Medicine Project So what is “visualization” ? Computer graphics and computation - plus - Generic structures and techniques volumes isosurfaces streamlines visual controls, etc. - plus - Application semantics - plus - Human perception Pieper, Fallon (UCI)
IIC Astronomical Medicine Project Example: isosurfaces vs. volume rendering Isosurface renderingVolume rendering representation:surfacesvolumes primitives:continuousdiscrete speed:faster, grows linearly w/complexityslower, stays constant w/complexity segmentation:your choiceglobal transfer functions SCI Institute, Univ. of Utah Talos et. al.
IIC Astronomical Medicine Project How is this like astronomy? Multi-dimensional image data Analysis pipeline: s/human/sky/g s/scanner/telescope/g - Most of analysis pipeline the same - Differences: WCS Often only partially spatial Second order image/noise characteristics Interchange issues Borkin
IIC Astronomical Medicine Project “Astronomical Medicine” Bootstrap astronomical visualization & discover Dual-purpose development Astronomy-specific functionality Cross-pollenate segmentation techniques Borkin Rosolowsky, Kauffmann et.al.
IIC Astronomical Medicine Project Different layers of software Applications 3D Slicer, OsiriX, ParaView, VolView, Amira… Apps you’ll see here Frameworks/libraries Visualization: VTK Segmentation and registration: ITK Rendering and interaction libraries OpenInventor/Coin Java3D OpenGL Borkin
IIC Astronomical Medicine Project Applications: 3D Slicer Medical image analysis, segmentation, and visualization platform Cross platform, open source Surface rendering (volume rendering to come) Borkin
IIC Astronomical Medicine Project Applications: OsiriX Originally designed for radiology image databases Mac only, open-source Volume rendering (some isosurfaces as well) Borkin
IIC Astronomical Medicine Project Research prototypes Dendrogram visualization AMView astronomy data viewer
IIC Astronomical Medicine Project Stereoscopic imaging and 3D See Nick Holliman’s talk and demos! Stereoscopic imaging and 3D
IIC Astronomical Medicine Project Parting thoughts Augment, not replace existing tools Working together to solve, create and discover New “golden age” of astronomy visualization? Borkin
IIC Astronomical Medicine Project Thanks Astronomical Medicine Project Alyssa Goodman, Michelle Borkin, Jens Kauffmann, Doug Alan, Nick Holliman Harvard IIC Rita Tavilla, Emily Lohmann Surgical Planning Lab Ron Kikinis, Steve Pieper, Tina Kapur, and many others Harvard-Smithsonian Center for Astrophysics The CfA COMPLETE team, including Erik Rosolowsky