1. You’ve Got SARS!! Group 6 Brent Anderson Lauren Cutsinger Martin Gilpatric Michael Oberg Matthew Taylor Capstone Spring 2006

2. Presentation Outline Project Overview Project Overview Implementation Implementation Hardware Hardware Software Software Project Organization Project Organization Risk and Contingency Risk and Contingency

3. IR in Medical Applications First-Pass Diagnostic Tool First-Pass Diagnostic Tool Soft tissue injuries Soft tissue injuries Circulatory Problems Circulatory Problems Research Research Biological response to low frequency appliances Biological response to low frequency appliances Physical exercise and hypothermia research Physical exercise and hypothermia research Passively screen for a selection of biological agents Passively screen for a selection of biological agents Quick response to possible pandemics Quick response to possible pandemics Airports, office buildings and other mass transit areas Airports, office buildings and other mass transit areas SARS detection in several airports SARS detection in several airports SARS begins with a fever greater than 38°C (100.4°F) SARS begins with a fever greater than 38°C (100.4°F)

4. Project Overview Design an infrared tracking system that will control a motorized camera platform. Design an infrared tracking system that will control a motorized camera platform. Track infrared image of person. Track infrared image of person. Display IR image. Display IR image. Determine temperature of person for possible disease detection. Determine temperature of person for possible disease detection.

5. Thermopile Temperature Sensors Multiple thermocouples in series that provide an extremely sensitive IR sensor. Multiple thermocouples in series that provide an extremely sensitive IR sensor. Bulky and expensive compared to other types of IR sensors. Bulky and expensive compared to other types of IR sensors.

6. So Why Thermopiles? Breakthroughs in Manufacturing process. Breakthroughs in Manufacturing process. Lower cost Lower cost Much smaller footprint Much smaller footprint Very accurate at –50 to 450 ° C Very accurate at –50 to 450 ° C Correct spectrum for Heat Correct spectrum for Heat Comes in a 32x32 array! Comes in a 32x32 array!

7. System Overview SPI PWM VGA Serial Major Components IR Camera IR Camera PIC Processors PIC Processors Camera Mount Camera Mount Motors Motors PCB PCB Output (PC) Output (PC)

8. Hardware Hardware Processors 1. Dual PIC18F4550 Motors 1. Stepper Motors 2. Controllers Camera Mount 1. Lynx-B BPT-NS 2. Dual axis 4 Layer PCB 1. Power & GND planes 2. Lower Noise 3. Allow for high speed 48MHz Camera 1. ATX25C mini core

9. Why PIC18F4550 Harvard Architecture Harvard Architecture Simultaneous data and program memory access Simultaneous data and program memory access Built in SPI interface Built in SPI interface Camera Camera PIC communication PIC communication Two PWM Channels for Stepper Motors Two PWM Channels for Stepper Motors Development Environment Development Environment On Chip Programmer On Chip Programmer 48MHz clock 48MHz clock 2 UARTs for computer communication 2 UARTs for computer communication USB 2.0 Interface (optional) USB 2.0 Interface (optional)

10. Why ATX25C? Why ATX25C? Thermopile 32x32 Array Thermopile 32x32 Array Low Resolution allows for faster data crunching. Low Resolution allows for faster data crunching. Provides enough data for human detection. Provides enough data for human detection. SPI Interface SPI Interface Compatible with PIC18F4550 Compatible with PIC18F4550

11. Why Stepper Motors High precision High precision Up to 1.5 degrees of accuracy Up to 1.5 degrees of accuracy Compatible With PIC18F Compatible With PIC18F PWM signals PWM signals Low cost for precision Low cost for precision Easy positioning Easy positioning

12. Software Outline Tracking Algorithms Tracking Algorithms “Hot Spot” Detection “Hot Spot” Detection Edge Detection Edge Detection Motor control Motor control On Chip Pulse Width Modulation (PWM) On Chip Pulse Width Modulation (PWM) Display Display Comunication with a PC for display and control. Comunication with a PC for display and control.

13. Targeting Software Goals Identify the portion of the picture containing the face of the subject. Identify the portion of the picture containing the face of the subject.

14. Tracking Demonstration Averaging Averages are taken along both the horizontal and vertical axis. The highest value of these averages indicates the hottest cross section in each dimension. The intersection of these cross sections should be the center of the warmest body. In this case we are hoping that this body will be the face of the subject.

15. Tracking Demonstration Differentiation By differentiating the cross section averages generated in the previous method these plots can be generated. The peaks of these plots indicate the planes where there has been the greatest change in value. This method will find the boundries of what should be the head of the subject.

16. Interface Motor control Motor control Interacting with onboard PWM for use with motor control logic. Interacting with onboard PWM for use with motor control logic. Display data via a PC Display data via a PC UART connectivity with a Linux machine to display pertinant information and raw data. UART connectivity with a Linux machine to display pertinant information and raw data. Possibility of screen capture. Possibility of screen capture. Possibility of future additions though PC based processing. Possibility of future additions though PC based processing.

17. Project Goals and Constraints Baseline Objectives Baseline Objectives Advanced Goals Advanced Goals USB2 USB2 Advanced Display and User Interface Advanced Display and User Interface Printing Printing Constraints and Contingency Plans Constraints and Contingency Plans

18. Baseline Objectives IR Camera SPI bus w/ two µcontrollers IR Camera SPI bus w/ two µcontrollers Real-time processing of incoming data stream at 10 Frames Per Second Real-time processing of incoming data stream at 10 Frames Per Second Dynamic image tracking Dynamic image tracking Determine and record temperature data Determine and record temperature data UART Data stream to PC UART Data stream to PC

19. Baseline Objectives (Cont) PC Client software for User Interface and Control PC Client software for User Interface and Control Display of RAW Camera Data Display of RAW Camera Data False Color Representation with Heat Distribution False Color Representation with Heat Distribution Summary Statistics and Indication of Abnormal Temp Summary Statistics and Indication of Abnormal Temp

20. Advanced Goals and Extensions USB2 for data transmission, using UART for control USB2 for data transmission, using UART for control Improvements to PC Software Improvements to PC Software Image Interpolation Image Interpolation Additional Controls Additional Controls Pause Pause Screenshot Screenshot Print Screen Print Screen

21. Project Constraints Airport Usage Tracking a single hot-spot (no crowds) Tracking a single hot-spot (no crowds) Limits on tracking speed. Limits on tracking speed. Target must be within predefined distances (lens specific) Target must be within predefined distances (lens specific) PERSON MUST WEAR CLOTHING!!!! PERSON MUST WEAR CLOTHING!!!! Face must be exposed. Face must be exposed. Heavy clothing preferred. Heavy clothing preferred.

22. Hardware Constraints Timing data on the SPI bus for communication between two processors Timing data on the SPI bus for communication between two processors UART speeds. UART speeds. Camera Resolution Camera Resolution Will 32x32 resolution provide accuracy? Will 32x32 resolution provide accuracy? Image Processing Speed Image Processing Speed Can we processes 10 FPS Can we processes 10 FPS Smooth Motor Control Smooth Motor Control

23. Risks and Contingencies Parts Delivery Parts Delivery IR Camera: Can use CCD which supports SPI IR Camera: Can use CCD which supports SPI Difficulties with optics Difficulties with optics Software workarounds / mods to core algorithms Software workarounds / mods to core algorithms Replacement optics Replacement optics Inability to process data flow in real-time Inability to process data flow in real-time Slow the data, lower the frame rate Slow the data, lower the frame rate Stage the data with external RAM components Stage the data with external RAM components Add additional micro-controllers and design parallel processing Add additional micro-controllers and design parallel processing

24. Team Planning Cost of Implementation Cost of Implementation Individual Member Tasks Individual Member Tasks Team Milestones and Goals Team Milestones and Goals Questions? Questions?

25. Costs

26. Tasks Team Member Main Tasks Brent Core Chip Programming Core Chip Programming Overall Product Design Overall Product Design Lauren PCB Layout PCB Layout Mechanical Assembly Mechanical Assembly Martin Targeting Software Targeting Software UART Interfacing UART Interfacing Michael Image Post-Processing Image Post-Processing PC Client Interface PC Client Interface Matthew PCB Layout PCB Layout Motor Interfacing Motor Interfacing

27. Timeline Timeframe Desired Deliverables CDR 1. Initial 4 Layer PCB Design 2. Reading Camera Data, Display 3. Basic Motor Control Milestone 1 1. 4 layer PCB rev. 2 2. Basic Tracking Milestone 2 1. Advanced Tracking 2. Basic PC Interface Expo 1. Complete PC Interface

28. Questions?