Presentation is loading. Please wait.

Presentation is loading. Please wait.

Interactive Exploration of Large Remote Micro-CT Scans Prohaska, Hutanu, Kähler, Hege (Zuse Institut Berlin)

Published byMarlene Parsons Modified over 8 years ago

Similar presentations

Presentation on theme: "Interactive Exploration of Large Remote Micro-CT Scans Prohaska, Hutanu, Kähler, Hege (Zuse Institut Berlin)"— Presentation transcript:

1 Interactive Exploration of Large Remote Micro-CT Scans Prohaska, Hutanu, Kähler, Hege (Zuse Institut Berlin)

2 Motivation Large medical datasets (10 – 100 GB) Centrally (remotely) stored image data Interactive exploration

3 Design Overview Goal: efficient external data access Interface to “regular grid data”: –multidimensional array of data elements –subblocks at various resolutions can be accessed. Asynchronous access using a background thread Under the hood: HDF5 as data container

4 HDF5 and Data Layout HDF5 supports –subblock/ hyperslab selection –external I/O drivers –only synchronous I/O  Data is stored at highest resolution using a “chunked” layout (blocksize 256KB – 2MB) In addition, a low-res “preview version” of data is generated (adds 15% of data)

5 HDF5 and Remote Data Access When handling remote data, the external I/O driver should know which high-level function it serves (virtual data access layer). GridFTP was chosen as underlying client- server data access architecture.

6 Rendering Hierarchical multi-resolution approach Spherical ROI visualized in high-res, other data displayed at coarser resolution Octree structure used as multilevel representation of data volume, to find blocks intersecting ROI. 3D texture based volume rendering (octree based back-to-front rendering)

7 Results Measurements: –Responsiveness (time to load one block) = latency + block size/ bandwidth –Throughput Data server: dual Xeon 1.7GHz with 170GB storage (at 15MB/s read rate) Network latency: 0.2ms (LAN), 360ms (WAN)

8 Results (Contd.) Dataset: 2048 x 2048 x 1024, 2 bytes per voxel, 8GB of data. Preprocessing (generation of preview version) takes 25 minutes and adds 2GB of extra data. Block sizes used: 128 x 128 x 64 (2MB), 64 x 64 x 32 (256KB)

9 Actual Results Responsiveness: –2MB block: 1.9s/blk (WAN), 0.7s/blk (LAN) –256K block: 1.4s/blk (WAN), 0.1s/blk (LAN) Throughput: –2MB block: 8.3 MBit/s (WAN), 23MBit/s (LAN) –256K block: 1.4MBit/s (WAN), 20MBit/s (LAN) Basically, as expected. Trade off between responsiveness and throughput.

Download ppt "Interactive Exploration of Large Remote Micro-CT Scans Prohaska, Hutanu, Kähler, Hege (Zuse Institut Berlin)"

Similar presentations

University of Chicago Department of Energy The Parallel and Grid I/O Perspective MPI, MPI-IO, NetCDF, and HDF5 are in common use Multi TB datasets also.

University of Chicago Department of Energy The Parallel and Grid I/O Perspective MPI, MPI-IO, NetCDF, and HDF5 are in common use Multi TB datasets also.
EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804 JRA4 Overview and plans M. Haefele, E. Sonnendrücker Euforia kick-off meeting 22 January 2008 Gothenburg.

EUFORIA FP7-INFRASTRUCTURES , Grant JRA4 Overview and plans M. Haefele, E. Sonnendrücker Euforia kick-off meeting 22 January 2008 Gothenburg.
Sanjay Ghemawat, Howard Gobioff, and Shun-Tak Leung Google Jaehyun Han 1.

Sanjay Ghemawat, Howard Gobioff, and Shun-Tak Leung Google Jaehyun Han 1.
A Hardware-Assisted Hybrid Rendering Technique for Interactive Volume Visualization Brett Wilson Kwan-Liu Ma University of California, Davis Patrick S.

A Hardware-Assisted Hybrid Rendering Technique for Interactive Volume Visualization Brett Wilson Kwan-Liu Ma University of California, Davis Patrick S.
Interactive Medical Imaging over the Network Centre Hospitalier Universitaire Vaudois Lausanne Raffaele Noro, Olivier Verscheure and Jean-Pierre Hubaux.

Interactive Medical Imaging over the Network Centre Hospitalier Universitaire Vaudois Lausanne Raffaele Noro, Olivier Verscheure and Jean-Pierre Hubaux.
1 Asynchronous Bit-stream Compression (ABC) IEEE 2006 ABC Asynchronous Bit-stream Compression Arkadiy Morgenshtein, Avinoam Kolodny, Ran Ginosar Technion.

1 Asynchronous Bit-stream Compression (ABC) IEEE 2006 ABC Asynchronous Bit-stream Compression Arkadiy Morgenshtein, Avinoam Kolodny, Ran Ginosar Technion.
Distributed Interactive Ray Tracing for Large Volume Visualization Dave DeMarle Steven Parker Mark Hartner Christiaan Gribble Charles Hansen.

Distributed Interactive Ray Tracing for Large Volume Visualization Dave DeMarle Steven Parker Mark Hartner Christiaan Gribble Charles Hansen.
The Virtual Microscope Umit V. Catalyurek Department of Biomedical Informatics Division of Data Intensive and Grid Computing.

The Virtual Microscope Umit V. Catalyurek Department of Biomedical Informatics Division of Data Intensive and Grid Computing.
1/13 A MJPEG Encoder for the NOW to visualize and navigate on data- intensive scenarios José María González

1/13 A MJPEG Encoder for the NOW to visualize and navigate on data- intensive scenarios José María González
3D Computer Rendering Kevin Ginty Centre for Internet Technologies www.cit.sunderland.ac.uk.

3D Computer Rendering Kevin Ginty Centre for Internet Technologies
Memory Efficient Acceleration Structures and Techniques for CPU-based Volume Raycasting of Large Data S. Grimm, S. Bruckner, A. Kanitsar and E. Gröller.

Memory Efficient Acceleration Structures and Techniques for CPU-based Volume Raycasting of Large Data S. Grimm, S. Bruckner, A. Kanitsar and E. Gröller.
Fast Isosurface Visualization on a High-Resolution Scalable Display Wall Adam Finkelstein Allison Klein Kai Li Princeton University Sponsors: DOE, Intel,

Fast Isosurface Visualization on a High-Resolution Scalable Display Wall Adam Finkelstein Allison Klein Kai Li Princeton University Sponsors: DOE, Intel,
MATE-EC2: A Middleware for Processing Data with Amazon Web Services Tekin Bicer David Chiu* and Gagan Agrawal Department of Compute Science and Engineering.

MATE-EC2: A Middleware for Processing Data with Amazon Web Services Tekin Bicer David Chiu* and Gagan Agrawal Department of Compute Science and Engineering.
Client/Server Software Architectures Yonglei Tao.

Client/Server Software Architectures Yonglei Tao.
Sanjay Ghemawat, Howard Gobioff, and Shun-Tak Leung Google∗

Sanjay Ghemawat, Howard Gobioff, and Shun-Tak Leung Google∗
Report ： Zhen Ming Wu 2008 IEEE 9th Grid Computing Conference.

Report ： Zhen Ming Wu 2008 IEEE 9th Grid Computing Conference.
Parallel HDF5 Introductory Tutorial May 19, 2008 Kent Yang The HDF Group 5/19/20081SCICOMP 14 Tutorial.

Parallel HDF5 Introductory Tutorial May 19, 2008 Kent Yang The HDF Group 5/19/20081SCICOMP 14 Tutorial.
Institute of Computer and Communication Network Engineering OFC/NFOEC, 6-10 March 2011, Los Angeles, CA Lessons Learned From Implementing a Path Computation.

Institute of Computer and Communication Network Engineering OFC/NFOEC, 6-10 March 2011, Los Angeles, CA Lessons Learned From Implementing a Path Computation.
What is a Network?. Definition of a computer network A computer network is a system in which computers are connected to share information and resources.

What is a Network?. Definition of a computer network A computer network is a system in which computers are connected to share information and resources.
WP-8, ZIB WP-8: Data Handling And Visualization Review Meeting Report Felix Hupfeld, Andrei Hutanu, Andre Merzky, Thorsten Schütt, Brygg Ullmer Zuse-Institute-Berlin.

WP-8, ZIB WP-8: Data Handling And Visualization Review Meeting Report Felix Hupfeld, Andrei Hutanu, Andre Merzky, Thorsten Schütt, Brygg Ullmer Zuse-Institute-Berlin.

Similar presentations

Ads by Google