Yunji Kang, Jinwoo Ahn, Gyeonghwan Hong Advanced System Software (Autumn 2014) Extensible Hardware Framework for Tizen

17 2 Limits in extension of mobile sensor & actuator Hard to use external sensor, actuators – High implementation cost, maintenance cost … Motivation ?

17 3 Connect blocks and make only logic code! Function Abstraction: represented as blocks – External Sensor, Actuator: Ultrasonic sensor, Motor … – The Functions of Tizen Platform: Notification center Connectivity, Hardware Control Abstraction – Bluetooth, Serial port control, I/O pin control, PWM, … Extensible Hardware Framework

17 4 EHF-Node-RED: Design tool Mindstorm Service: Interaction with Mindstorm Design: Components

17 5 Node-RED runs based on Node.js. We ported Node.js on ODROID-U3 running Tizen. – Integration the process of building Node.js with GBS – ARM compiler configurations Default target architecture HW/SW FPU Now, Node.js can be built by GBS in the same way as building other Tizen packages. Porting Node.js

17 6 Visual Editor Tool based on Node.js – You can make a program with only connecting nodes New Nodes for Tizen/Mindstorm are added. EHF-Node-RED

17 7 Nodes can be specified as below manner. – Each node has its properties that can be tuned. EHF-Node-RED: Nodes

17 8 New node for Tizen – Notification node: fetches notifications of applications from Tizen notification center. New nodes for Mindstorm – Motor node: controls the behavior of survo motor. – Speaker node: makes a sound through speaker. – Sonar node: listens the distance of detected object – Color lamp node: makes color lights through lamps in RGB sensor. EHF-Node-RED: Nodes

17 9 Bidirectional Interaction with Mindstorm – It uses Tizen Bluetooth API/Framework for interaction. – Fit to the format of Mindstorm direct command Listening commands through Mindstorm Service API – dbus: Inter-process communication between EHF-Node- RED and Mindstorm Service Functions – Survo motors: moving – Speaker: playing a sound – Ultrasonic sensor: listening the distance of detected object – Color lamp: emitting light in dedicated colors. Mindstorm Service

17 10 EHF-Node-RED ~ Notification Center – Shared file /usr/share/nodejs/ehf_notification.tail Notification center writes notification events on the shared file. EHF-Node-RED listens file change event through tail tool. EHF-Node-RED ~ Mindstorm Service – dbus: EHF-Node-RED sends commands to Mindstorm service through dbus. – Shared file /usr/share/nodejs/sonar.tail Mindstorm service sends sonar sensor event to EHF-Node-RED through shared file. Interactions among Components

17 11 Mindstorm Service ~ Mindstorm Controller – Mindstorm Direct Command Protocol Mindstorm controller receives commands and sends response to user device with following this protocol. It supports Bluetooth/RFCOMM protocol. – Tizen Bluetooth API/Framework It supports API functions of interactions in RFCOMM protocol. Mindstorm service uses Tizen Bluetooth API for interacting with Mindstorm controller. Interactions among Components

17 12 Notification Center – Path: apps/home/notification – It delivers the notifications of applications to also EHF- Node-RED. Bluetooth Framework – Path: framework/connectivity/bluetooth-frwk – A bug that commands cannot be delivered is occurred. Originally, Tizen Bluetooth Framework used g_strlcpy() function. – We modified to use memcpy() function. Modifications on Tizen Framework 0C Original: 0C00EC2B075C CSocket buffer: g_strlcpy()

17 13 github.com/Tizen-Sunfish

17 14 Modifications on Tizen Frameworks – Notification Center (notification) – Bluetooth Framework (bluetooth-frwk) Node.js Port on Tizen (nodejs-tizen) EHF-Node-RED (ehf-node-red) Mindstorm Service (tizen-mindstorm) Mindstorm Service API (mindstorm-send) github.com/Tizen-Sunfish

17 15 Gyeonghwan Hong (RedCarrottt) – Porting Node.js, EHF-Node-RED – Customizing Tizen notification center Yunji Kang (sonyeo4ever) – Bluetooth communication thread – Ultrasonic Sensor, Playing sound file(Speaker) Jinwoo Ahn (ahnjinwoo) – Mindstorms Device API – Motor, RGB sensor(Color lamp), Beep sensor(Speaker) – Design of Mindstorm hardware Role Distributions

17 16 New Method of Mobile Notification Mindstorm notifies human of notifications by moving its motors and making a sound. Example: Notification

17 This example can be simply implemented by drawing node graph as below. Example: Notification