Presentation is loading. Please wait.

Presentation is loading. Please wait.

II - UFRGS Medical Images Visualization at the Computer Graphics Group/UFRGS Carla Maria Dal Sasso Freitas February, 2000.

Similar presentations


Presentation on theme: "II - UFRGS Medical Images Visualization at the Computer Graphics Group/UFRGS Carla Maria Dal Sasso Freitas February, 2000."— Presentation transcript:

1 II - UFRGS Medical Images Visualization at the Computer Graphics Group/UFRGS Carla Maria Dal Sasso Freitas February, 2000

2 II - UFRGS Summary 1. Introduction 3. CG Group overview F Previous works 4. Current project: VPat 5. Final comments

3 II - UFRGS 1. Introduction

4 II - UFRGS Porto Alegre F 470,25 km 2 F Population: ~ 1,286.251 F Climate: Subtropical wet with four well-defined seasons 1. Introduction F Higher education: 4 large universities (each one with more than 20K students) and several small colleges

5 II - UFRGS UFRGS ( Federal University of Rio Grande do Sul ) Created in 1895 One of the top five universities in Brazil, both in size and quality ~ 2,278 faculty members Students: ~ 25,286 ( undergraduate and graduate ) 1. Introduction

6 II - UFRGS Informatics Institute F Teaching and research since 1968 F Established as an Institute in 1989 F Departments Applied Computing Theoretical Computing 1. Introduction

7 II - UFRGS F Faculty 69 professors (INPG, Grenoble; Karslruhe and Stuttgart, Germany; Newcastle, UK; Stanford, USA; Coimbra, Portugal; Louvain, Belgium; Amsterdam, Netherlands;...) Students: 700 undergraduate level + 270 graduate level F Courses at graduate level M.Sc. in Computer Science Ph.D. in Computer Science Professional education 1. Introduction

8 II - UFRGS F Research areas Computer Graphics and Image processing Computer Architecture/Parallel Processing Microelectronics/Digital Systems Data Base Systems Fault Tolerance Software Engineering Theoretical Computer Science Artificial Intelligence Computational Mathematics Computer Networks/Communication Formal Methods 1. Introduction

9 II - UFRGS 2. CG Group Overview Started in 1978, with one professor only People F 4 Professors F 1 Post-doc F 5 Ph.D. Students F 18 M.Sc. Students

10 II - UFRGS Research in the 80's: CAD Research in the 90's F Rendering and animation F Scientific visualization Meteorological data Geological data Medical images F Image processing techniques 2. CG Group Overview

11 II - UFRGS Previous works regarding medical images F Nedel at EPFL F Freitas and group at UFRGS 3. CG Group Overview

12 II - UFRGS Previous works 4 Nedel at EPFL F Freitas and group at UFRGS 3. CG Group Overview

13 II - UFRGS Previous works 4 Nedel at EPFL 4 Freitas and group at UFRGS 3. CG Group Overview

14 II - UFRGS 3. VPat ( Visualization and interaction with Virtual Patients ) F Generation of virtual human models (virtual patients) to use in medical applications such as simulation of surgery and training F Movement simulation F Development of a framework to guarantee software reuse F Integration of the existing tools Goals

15 II - UFRGS Activities F Design of the OO framework F Volume visualization F 3D reconstruction of the human parts from real data F Motion simulation and body deformation (anatomic simulation of human bodies) 3. VPat

16 II - UFRGS Activities F Design of the OO framework F Volume visualization RenderVox improvement and conversion to the VPat framework Survey about collaborative visualization Multimodal visualization F 3D reconstruction of the human parts from real data F Motion simulation and body deformation (anatomic simulation of human bodies 3. VPat

17 II - UFRGS Multimodal visualization with RenderVox MRI and PET data obtained from different patients, no registration algorithm used (Marcelo Silva, 2000) 3. VPat

18 II - UFRGS Multimodal visualization: ongoing work Data obtained from the same patient Cooperation with the best hospital in Brazil ~ INCOR/University of Sao Paulo Study of registration methods (Isabel Manssours PhD thesis) 3. VPat

19 II - UFRGS Activities F Design of the OO framework F Volume visualization F 3D reconstruction of the human parts from real data Marching cubes implementation Study of multi-resolution techniques F Motion simulation and body deformation (anatomic simulation of human bodies) 3. VPat

20 II - UFRGS Activities F Design of the OO framework F Volume visualization F 3D reconstruction of the human parts from real data F Motion simulation and body deformation (anatomic simulation of human bodies) Mechanical modeling of joints Skeleton motion control Soft tissue deformation 3. VPat

21 II - UFRGS F Surgery simulation (Luciana Nedel, 1999) 3. VPat

22 II - UFRGS Activities F Design of the OO framework F Volume visualization F 3D reconstruction of the human parts from real data F Motion simulation and body deformation (anatomic simulation of human bodies) 3. VPat

23 II - UFRGS 4. Final comments F Interactive segmentation of medical images Olabarriaga, 1999 with A. Smeulders, Amsterdam F Development of new filtering techniques Scharcanski & Jung, 1999/2000 ~ ultrasound images from fetal hearts ~ mammographic images Related works in our group

24 II - UFRGS http://www.inf.ufrgs.br/cg

25 F Goal: Medical data visualization overview Different approaches for collaborative visualization To get knowledge about difficulties for its utilization (WSCG 2000, February 7-11, Plzen) Collaborative Visualization in Medicine

26 II - UFRGS Collaborative Visualization in Medicine Collaborative Visualization in Medicine F CSCW ( Computer Support for Cooperative Work ) New successful area People in different places working together F CSCV ( Computer Support for Collaborative Visualization ) Subset of CSCW applications Shared visualization and control parameters Challenge: multi-user interactive applications

27 II - UFRGS F Visualization pipeline ( Haber & McNabb, 1990 ) extension to achieve collaboration Collaborative Visualization in Medicine Shared ControlShared Data Filtering(F)Mapping(M)Render(R) Image Data Filtering(F)Mapping(M)Render(R) Image Data User A User B

28 II - UFRGS F Collaborative visualization systems applied to Medicine Image presentation to remote collaborators Image-based interaction Collaborative Visualization in Medicine F Telemedicine Communication technology used to support interaction between physicians and patients Applications ~ Remote clinical consultation ~ Telesurgery, teleradiology ~ Collaborative diagnosis

29 II - UFRGS F TeleInViVo Fraunhofer Center for Computer Graphics, DARPA e MATMO Main goals ~ Therapy planning and treatment ~ Medical training, surgery and diagnosis Collaborative Visualization in Medicine

30 II - UFRGS F TeleMed Los Alamos National Laboratory and National Jewish Center for Immunology and Respiratory Medicine Prototype of the Virtual Patient Records (VPR) Collaborative Visualization in Medicine Main goal ~ Standardize the electronic management of patient information

31 II - UFRGS F Current trend Use of the Web as a collaboration environment F Challenges and open questions Collaborative Visualization in Medicine Communication technology Identification (security) handling Shared data coherence Synchronization of user activities User-friendly interface Real-time visualization and interaction VR devices accuracy and touch-feedback Realistic images

32 II - UFRGS F The building of a collaborative system is an interdisciplinary effort User-centered approach Efficient data management Object-oriented design and programming Collaborative Visualization in Medicine F Collaborative systems have to be improved to become attractive work tools F Several difficulties for the real utilization of such systems are still found

33 II - UFRGS Anatomic modeling of skeletons F Joints position F The skeleton ( Luciana Nedel, 1998) Nedel at EPFL (Ph.D. Thesis)

34 II - UFRGS ( Luciana Nedel, 1998) Nedel at EPFL Nedel at EPFL

35 II - UFRGS Simulation of the muscles action F Action lines Represent mechanically the force that a muscle produces on a bone Composed by an origin, an insertion and optionally by one or more control points (Luciana Nedel, 1998) Nedel at EPFL

36 II - UFRGS Muscles deformation F Mass-spring deformation model Example: compression Example: extension (Luciana Nedel, 1998) Nedel at EPFL Nedel at EPFL

37 II - UFRGS F Example: reconstructed muscle (Luciana Nedel, 1998) Nedel at EPFL

38 II - UFRGS Framework to allow the human body modeling and simulation F Body Builder Plus - integration tool Allows the design of human models created entirely with bones and reconstructed muscles Combines deformable muscles with metaballs representing some muscles, organs and fat tissues Nedel at EPFL Nedel at EPFL

39 II - UFRGS F Body Builder Plus: examples... (Luciana Nedel, 1998) Nedel at EPFL

40 II - UFRGS Interactive volume visualization of medical images using ray casting Available tools F Navigation through the slices data set F Cutting planes F Cutting volume/ subvolume F Hybrid (geometric and volume) visualization F Multimodal visualization RenderVox

41 II - UFRGS Camera control and slice visualization Marcelo Silva, 1999 RenderVox RenderVox

42 II - UFRGS Interactive interface (Marcelo Silva, 1998/2000) RenderVox

43 II - UFRGS MRI of a head (Marcelo Silva, 1998) RenderVox RenderVox

44 II - UFRGS (Marcelo Silva, 1998) Transparency levels using classification tables RenderVox

45 II - UFRGS (Marcelo Silva, 1998/1999) Cutting with planes RenderVox

46 II - UFRGS (Marcelo Silva, 1998/1999) Cutting with volumes RenderVox RenderVox

47 II - UFRGS Cutting with non-planar tools Cutting with planes and volumes (Marcelo Silva, 1998/1999) RenderVox RenderVox

48 II - UFRGS Hybrid rendering (geometric models & volume data) (Marcelo Silva, 2000) RenderVox

49 II - UFRGS F Visualization of layers 1 and 2 of characteristic Marcos de Inundação, grid dimension 30 x 30, layer 1 in wireframe (Karen Basso, 1999) GeoVis

50 II - UFRGS F Visualization of layer 1 of characteristic Marcos de Inundação, and Isolita attribute. (Karen Basso, 1999) GeoVis GeoVis

51 II - UFRGS F Isocontour map for attribute Percentualde Areia, in layer 1 of Marcos de Inundação (Karen Basso, 1999) GeoVis


Download ppt "II - UFRGS Medical Images Visualization at the Computer Graphics Group/UFRGS Carla Maria Dal Sasso Freitas February, 2000."

Similar presentations


Ads by Google