Augmented Reality: Internet of Things ECE 492 - Computer Engineering Design Project Augmented Reality: Internet of Things Adam Sanche • Andrei Usenka • Jiawei Wu • Satyen Akolkar 2017 Project Objective We constructed a data collection module that enables field technicians and wearing a Microsoft HoloLens to automatically gather and review electrical data from a circuit breaker panel. Using a modified version of ScopeAR’s WorkLink App the technician can follow a sequence of steps to service the breaker box safely. Project Diagram Server To transmit sensor data to the HoloLens, we created a RESTful API server in Node.js using Javascript that executes in the Linux environment running on our SoC board. This was possible due to the integration of an ARM processor on the DE0 Nano SoC along with its FPGA components. Express.js was the framework we chose to use on top of Node.js to simplify routing and request handling as it gave us access to great open source libraries. With access to the aforementioned libraries, we were able to address crucial requirements and concerns with our project such an implementing a RESTful API service and IoT security in a much more robust manner. Data storage was accomplished using MongoDB, an open-source NoSQL database, running on our SoC board along with the server. For colour ideas, University Visual Identity Guidelines can be found here: http://www.toolkit.ualberta.ca/VisualIdentityGuidelines.aspx Breakers User HoloLens 6 5 Implementation The system polls the voltage and current sensors at 125 Hz A C program running on the ARM Cortex A9 in the DE0 Nano SoC converts the sensor data into JSON files for processing by the server Circuit Breaker data for the past 20 minutes are stored in MongoDB database The Server and Sensor Interfacing programs require 70% CPU utilization on average ScopeAR’s WorkLink Circuit Breaker App was modified to project real-time information 4 2 1 3 DE0 Nano SoC Router Sensors Core Components System Data Flow Current and Voltage sensors interface with breaker box. Breakers and integrated system provide sensor values to DE0 Nano Soc DE0 hosts a server which polls the sensors HoloLens connects to network and can request data from the server The HoloLens user can choose to see visualizations of past data Client: ScopeAR Department of Electrical & Computer Engineering