1. USER-assisted SEMANTIC INTEROPERABILITY in INTERNET of THINGS
IARIA the Sixth International Conference on Mobile Ubiquitous Computing, Systems and Technologies
UBICOMM 2012
USER-assisted SEMANTIC INTEROPERABILITY in INTERNET of THINGS
Authors: Oleksiy Khriyenko
Vagan Terziyan
Olena Kaikova
23-28 September 2012, BARCELONA, SPAIN
Presenter: Oleksiy Khriyenko
Ontology
Industrial Ontologies Group
University of Jyväskylä

2. Outline Towards new era Internet of Things
Thing integration infrastructure
Human-powered Service Ecosystem
Visual ontology alignment
Visually-enriched semantic annotation
Conclusions

3. Towards new era Internet of Things
Demands of Society and Businesses
nowadays, society requires new innovative services and applications that make the life more comfortable and interactive;
industry requires new intelligent systems to better perform maintenance and do better automation of product development and product operation processes.
Thing infrastructure
we are going to be surrounded by amazingly huge amount of smart devices and entities that do a lot of invisible work for us, but bring really useful added value;
various sensors constantly produce huge amount of data measuring and logging various parameters of the environment, devises, systems, and of cause people;
having such variety of data and contextual information, intelligent systems are able to provide new innovative services that were impossible to even imagine before.
Challenges of interoperable Web of Things
unwillingness of vendors to provide open, flexible and interoperable solutions;
lack of infrastructure for third party application and services development;
unavailability of appropriate business model that brings benefits to end-users through fair open competitive environment of thing vendors.

4. Thing Integration Infrastructure
Vendor 3
Vendor 4
Vendor 2
Vendor 5
Application
Subnet of devices
Service/System
Device, sensor, etc. …
Vendor 1
Subnet of devices
Vendor N
Application
Ontology
Smart Gateways
Thing Integration Platform
Users

5. Human as a part of Technology World
Applications
Devices/sensors
Services
Systems
Applications
(Service Provider) Expert
User (Service Consumer)
People are great asset to be utilized in servicing, service support and creation process.
In the context of open solutions and free services development, people (as end-users) are the most interested party. Therefore, people should take active position and be a part of the service they want to utilize, make it smarter, personalized, and able to provide appropriate data, features and capabilities. Human should not be considered only as a user (service consumer) anymore. Human should be involved to the process as an expert – valuable part of a service ecosystem that provides own knowledge and expertise, and adds value to technology evolution.
To be able to utilize the power of people, we have to concentrate our efforts on development of user-oriented tools and technique that involve people to the process, teach and help them to access and manipulate with information and capabilities in easy and handy for human way, utilize people knowledge and expertise for the common welfare of society.

6. Human-powered Service Ecosystem: Visual Ontology Alignment
User
Visual Ontology Alignment
Vendor A
Ontology
Ontology
Vendor B

7. Visually-enriched Semantic Annotation
@prefix : < .
@prefix rdf: <
@prefix rdfs: <
rdfs:visSemantics rdf:type rdf:Property;
rdfs:domain rdfs:Resource;
rdfs:range rdfs:Literal.
:FloorHeatingSystem rdfs:subClassOf :HeatingSystem;
rdfs:visSemantics ”
Ontology/Domain Expert
Scenario 1
Service/System
Ontology
Vendor V
Creates visual ontology
Provides annotation of the Service/System
Visually enriched ontology
Service/System
Vendor
Produces
Service/System V
VisAnnotation
Visually enriched annotation V
Provides visually enriched annotation of the Service/System
Ontology V
Ontology
Vendor
VisOntology
Scenario 2
Service/System
Creates domain ontology
Ontology
Ontology/Domain Expert

8. Conclusions
With the aim to elaborate an environment that enables integration of heterogeneous “things” and intelligent distributed systems within the Internet of Things framework, we addressed the mechanism of human-assisted simplification of semantic matching to allow interoperability of entities in IoT.
We proposed a way to make end-user be not only consumer of thing-based solutions, but also be an expert capable to compose and establish interoperability among the things.
The question that stays open… How to encourage vendors to provide appropriate semantic annotation of things and how to help them by automating this process?

9. Questions and comments…
Thank you
Questions and comments…