1. TUMChair for Computer Aided Medical Procedures (I-16)1 Intra-operative Imaging & Visualization Lab Course SS 2004 Lab Course SS 2004 Implementation of an Augmented Reality Visualization Component Chair for Computer Aided Medical Procedures (I-16) Prof. Nassir Navab

2. TUMChair for Computer Aided Medical Procedures (I-16)2 Supervised by - Marco Feuerstein Participants – Imran Shafiq Imran Shafiq Mohan Singh Mohan Singh Franziska Bayer Franziska Bayer Zaheer Akhtar Zaheer Akhtar

3. TUMChair for Computer Aided Medical Procedures (I-16)3 Endoscopic Surgery Endoscopic surgery – endo : meaning the end of, and scopic : meaning to look at -- is an instrument that looks at the end of a closed space. The indirect access to the operation area causes a lot of disadvantages for the surgeon: restricted vision, difficult hand-eye coordination and handling of instruments with limited mobility.

4. TUMChair for Computer Aided Medical Procedures (I-16)4 AIM In endoscopic surgery, the surgeon inserts the instruments through very small incision points. Thus, the view onto the region of interest is very limited. In order to provide enhanced visualization to the surgeon the endoscopic images need to be augmented by pre-operatively acquired data such as CT slices or rendered volumes and models of the instruments. To do so, the surgical instruments and the endoscopic camera will be tracked to dynamically update their poses (positions and orientations). A viewer will be implemented to display the pre-operative data and all models at the correct poses.

5. TUMChair for Computer Aided Medical Procedures (I-16)5 The DICOM Standard Digital Imaging and COmmunications in Medicine Created by the National Electrical Manufacturers Association (NEMA) to Created by the National Electrical Manufacturers Association (NEMA) to aid the distribution and viewing of medical images, such as CT scans, MRIs, aid the distribution and viewing of medical images, such as CT scans, MRIs, and ultrasound. and ultrasound. Part 10 of the standard describes a file format for the distribution of images. Part 10 of the standard describes a file format for the distribution of images. A single DICOM file contains both a header as well as all of the image data. A single DICOM file contains both a header as well as all of the image data. header - stores information about the patient's name, the type of scan, image dimensions, etc image dimensions, etc image data - contain information in three dimensions

6. TUMChair for Computer Aided Medical Procedures (I-16)6 General DICOM Standard format

7. TUMChair for Computer Aided Medical Procedures (I-16)7 The DICOM Header The first 794 bytes are used for a DICOM format header, which describes the image dimensions and retains other text information about the scan. The image data follows the header information (the header and the image data are stored in the same file). Here, the header defines an image which has the dimensions 109x91x2 voxels, with a data resolution of 1 byte per voxel (so the total image size will be 19838). Transfer Syntax Unique Identification (UID) – reports the structure of the image data, also reports the byte order for raw data. And it has lot of other information….

8. TUMChair for Computer Aided Medical Procedures (I-16)8

9. TUMChair for Computer Aided Medical Procedures (I-16)9

10. TUMChair for Computer Aided Medical Procedures (I-16)10 Class Diagram

11. TUMChair for Computer Aided Medical Procedures (I-16)11

12. TUMChair for Computer Aided Medical Procedures (I-16)12