ECE 477 Final Presentation Group 11  Fall 2005 ChadJeffMel Maruf

Outline Project overviewProject overview Block diagramBlock diagram Professional componentsProfessional components Design componentsDesign components Success criteria demonstrationsSuccess criteria demonstrations Individual contributionsIndividual contributions Project summaryProject summary Questions / discussionQuestions / discussion

Project Overview Objective: Design and prototype a device to improve the safety and alertness of a driver.Objective: Design and prototype a device to improve the safety and alertness of a driver. This device should:This device should: –Determine if the driver is leaving the lane. –Detect obstacles in the road ahead. –Watch for patterns indicating unsafe driving. –Appropriately warn the driver if any of the above occur.

Block Diagram

Professional Components Constraint analysis and component selection rationaleConstraint analysis and component selection rationale Patent liability analysisPatent liability analysis Reliability and safety analysisReliability and safety analysis Ethical and environmental impact analysisEthical and environmental impact analysis

Design Constraints Microcontroller Video Support, DSP chip, Packaging, Development Tools Camera Sensor Type (CCD), Output Type (NTSC), Resolution (240+ lines), Input Voltage (<12 V), Size (Small) Clover CM720 Analog BF532

Patent Liability Analysis Commercial products: IterisIteris –AutoVue™ system –Infinity FX (2005) and Infinity M45(2006) ValeoValeo –LaneVue™ CitroenCitroen –Uses 9 infrared sensors Mitsubishi electricMitsubishi electric

Patent Liability Analysis USPTO patents: Patent NoTitleDate Filed 6,553,130Motor vehicle warning and control system and method June 28, ,678,394Obstacle detection systemJanuary 13, ,930,593Lane tracking system employing redundant image sensing devices August 16, ,819,779Lane detection system and apparatusNovember 16, ,813,370Lane marker recognizing apparatusNovember 2, ,748,302Lane tracking control system for vehicleJune 8, 2004 Our device infringes on these patents under the doctrine of equivalents.

Reliability/Safety Analysis Analysis for 10^6 operational hoursAnalysis for 10^6 operational hours PartsMTTF Microprocessor – ADSP- BF ,149 hours Voltage Regulator – FDS9431A 86,374 hours ADC – TVP ,501 hours PLD – ATF22V10C X 10^6 hours SDRAM – MT48LC4M16/SO9.85 X 10^5 hours

Criticality LevelsCriticality Levels  High - A system failure that is undetectable by the user  Unstable voltage supply  Image corruption  False output  Low - A system failure that could be readily identified.  EEPROM  3.3V supply Reliability/Safety Analysis

Ethical/Environmental Analysis Ethical Challenges Ethical Challenges Develop a safe testing strategy. Develop a safe testing strategy. User over-reliance on the device. User over-reliance on the device. Tamper-resistant packaging. Tamper-resistant packaging. Solution Solution Control the test environment. Control the test environment. Use a three-person-test method. Use a three-person-test method. Clearly mark the package with warning labels Clearly mark the package with warning labels Warn about over-reliance. Warn about over-reliance. Warn about tampering with the package. Warn about tampering with the package.

Ethical/Environmental Analysis Environmental Impact Environmental Impact - Manufacture - Manufacture - Normal usage - Normal usage - Disposal/Recycling - Disposal/Recycling Solution Solution - Unavoidable impacts due to PCB manufacturing - Unavoidable impacts due to PCB manufacturing - Use minimal layers and more copper planes over - Use minimal layers and more copper planes over lone traces lone traces - Recycling/Disposal - Recycling/Disposal - Provide a list of certified e-waste - Provide a list of certified e-waste recyclers recyclers

Design Components Packaging design considerationsPackaging design considerations Schematic design considerationsSchematic design considerations PCB layout design considerationsPCB layout design considerations Software design considerationsSoftware design considerations

Packaging Design Power on Indicator LED Array Buzzer Front View – LEDs PWR Side View – External ConnectorsPower Cord Camera Power Supply Camera Video Input

Packaging Design Power Jack Camera Mounting Mechanism Camera Clamp for Camera Red level line

Packaging Design Front View LED Array Power LED Rear View Camera Video input Camera Power Supply Buzzer Top View

Schematic Design

Fix: Changed from power to ground

Schematic Design Fix: Changed from C channel to Y channel Fix: Used oscillator instead of crystal

Schematic Design Added a new LDO to drop from 12 Volt to 5 Volt

PCB Layout Design

Software Design Initialization I2C (Video In signal to ADC) PLL, PPI, GPIO, SDRAM, DMA Find Obstacle Preprocess image Perform Cross Correlation Set Output Find Vehicle Position Interrupt Service Routine

Success Criteria Demonstrations 1.Ability to capture a series of real image video - demo demo 2.Ability to determine lateral position of car within lane - demo demo 3.Ability to detect drift from lane - demo demo 4.Ability to detect intrusion of other vehicle/hazard/obstacle in lane - demo demo 5.Ability to detect an impaired driving behavior- demo demo

Individual Contributions Team Leader – Chad AeschlimanTeam Leader – Chad Aeschliman Team Member 2 – Jeffery LeeTeam Member 2 – Jeffery Lee Team Member 3 – Golam MarufTeam Member 3 – Golam Maruf Team Member 4 – Ying Mei TanTeam Member 4 – Ying Mei Tan

Team Leader – Chad Aeschliman HardwareHardware –Tested components SoftwareSoftware –Initialization –I2C driver –Main interrupt routine –Algorithms for vehicle position and obstacle detection –Debugging DocumentationDocumentation –Design constraints –Software narrative

Member 2 – Jeffery Lee HardwareHardware Schematic and Circuit Design PCB Layout Preliminary and Final Design Most of the hands-on hardware work. 100% of all soldering and fly-wiring. DocumentationDocumentation –Ethical and Environmental Analysis –OrCad and Schematic Documentation

Member 3 – Golam Maruf HardwareHardware - LED and Audio output - LED and Audio output - Packaging - Packaging SoftwareSoftware - Interrupt service routines - Interrupt service routines - Software testing - Software testing DocumentationDocumentation - Schematic - Schematic - Reliability & Safety Analysis - Reliability & Safety Analysis - User Manual - User Manual

Member 4 – Ying Mei Tan HardwareHardware –Packaging SoftwareSoftware –I2C driver –Output generator –Webmaster DocumentationDocumentation –Packaging homework –Patent homework –User Manual

Project Summary Important lessons learnedImportant lessons learned –Technical Image processingImage processing Embedded system design techniquesEmbedded system design techniques Soldering techniquesSoldering techniques –Non-Technical Team organizationTeam organization Professional writingProfessional writing

Project Summary Second iteration enhancementsSecond iteration enhancements –Use a Microprocessor with internal FLASH and video output capabilities to speed software development –Use Analog video chip –Utilize parallel processing –Leave room for heat sinks on LDOs –Add mounting holes to the PCB

Project Summary Additional enhancementsAdditional enhancements –Use extra headers for prototyping. Thoughts/ConclusionsThoughts/Conclusions –The serial port is a vital tool for debugging.

Questions / Discussion