Team RFEyes Presents:

Project SmartCart Sponsored By Dr. Andrew Szeto & The National Science Foundation Tatsani Inkhamfong Andres Flores Alain Iamburg David Shullo Kevin Eichholz Joseph O’Neill Vinty Siev Group Members

There are 15 million blind and visually impaired people in the U.S., according to Research to Prevent Blindness. The National Science Foundation is funding the exploration of technologies that can benefit disabled persons. One major problem for visually impaired people is finding their way around unfamiliar places. Our team has developed a method to assist the visually impaired in navigating and locating products in a grocery store setting. Our Project

Problems Facing the Visually Impaired: Independently Locating Products Avoiding Obstacles Our Solutions: Shopping Cart Navigation System Collision Warning System Navigation in a Grocery Store

SmartCart by RFEyes

How Does It Work? Traverse the aisle

Press the Push-to-Talk button How Does It Work?

Shopper inputs a voice command into the headset How Does It Work?

Shopper inputs a voice command into the headset How Does It Work?

Route is generated by the backend server How Does It Work?

Detecting objects to avoid.

SmartCart by RFEyes

System Description

Navigation System Necessary Components of a Navigation System: ComponentSmartCart Solution DestinationWireless Headset Current LocationRFID Tag/Reader Map of AreaStored on Server

Voice Communication Navigation System  Using Microsoft SAPI  Text To Speech  Speech Recognition  Programming Language: C#  Speaker Independent  Custom Lexicon

Radio Frequency IDentification What is RFID?

M10 RFID Reader and Directional Antenna Alien Higgs “Squiggle” RFID Tag 3.9” 0.5” RFID System

Collision Avoidance

Hall Effect Sensor Usage

Microcontroller Function 1 Hall-Effect sensor causes the MCU to issue a “read” command to the M10. The RFID tag info is sent to the server via the Xbee radio. Hall-Effect Sensor Microcontroller M10 RFID Reader Server Radio Unit

Microcontroller Function 2 To set a destination, the user presses the push-to-talk button then speaks into the headset. Microcontroller Server Radio UnitPTT Button Headset

Backend Server Software Calculates the best route for the shopper Contains all RFID tag information in database Provides a Graphical User Interface (GUI) to inform the manager/cashier of any problems  A computer monitor can be placed at the clerks counter to alert them if the shopper needs help  Scalable for different grocery store layouts

Testing and Verification  Accuracy of RFID reader at various distances  Range testing of wire replacement module  Accuracy of navigation system  Range testing for collision avoidance  Overall product testing after integration

Circuit Boards Partitions Sensor/Feedback Board RFID/Communication Board PIC18F26J11 Microcontroller M10 RFID Reader PB6-915 Directional Antenna Wire Replacement Radio Hall Effect Sensors PIC16F616 Microcontroller Ultrasonic Sensors Dualshock2 Motors

Development Cost Component Cost SM-M10-MH-UF (SkyeTek M10 RFID Reader)$ Mobile Mark Antenna$ Microcontrollers$32.70 Power Supply$59.48 Wireless Headset$34.99 Wireless Support$84.90 Sensor Systems$ RFID Support$40.06 Miscellaneous$ Alien Squiggle RFID Tags (1000xALN-9640-WR)$ Total$1,148.72

Production Cost Component Cost SM-M10-MH-UF (SkyeTek M10 RFID Reader)$ Mobile Mark Antenna$70.00 Microcontrollers$3.41 Power Supply$47.10 Wireless Headset$34.99 Wireless Support$30.00 Sensor Systems$47.66 RFID Support$12.82 Miscellaneous$23.51 Alien Squiggle RFID Tags (1000xALN-9640-WR)$ Total$745.54

Our Engineering Team 1.Navigation System:  David Shullo  Tatsani Inkhamfong 2.RFID System:  Vinty Siev  Alain Iamburg 3.Collision Avoidance System:  Andres Flores  Kevin Eichholz 4.Hardware:  Joseph O’Neill

Milestones 1.November 14th Haptic Feedback and Ultrasonic Functional 2.November 23th Navigation Software Developed 3.November 24th RFID Reader Interfaced 4.November 28th Testing and Finalization Begins

Conclusion The SmartCart Product Provides: Independent Navigation Collision Avoidance

SmartCart by RFEyes