1. 14-10-2004thomasbodin@itu.dk1 Presentation Topics 1.System Description 2.System Components  Speech Technology  Positioning Technology  Weighted Graph Algorithm 3.Implementation  PDCS Model  Managing Data  Structuring Code 4.Demo 5.Perspectives 6.Relevant Links

2. 14-10-2004thomasbodin@itu.dk2 1.The Position Dependent Communication System (PDCS) is a location-based service incorporating both positioning and speech technology. 2.The PDCS is a well documented open- source project Existing code can easily be expanded Relevant design patterns have been implemented Unified Modeling Language (UML) and Javadoc have been used to document the project System Description

3. 14-10-2004thomasbodin@itu.dk3 3.The destination is recognized by a speech recognizer 4.The physical position is tracked by a positioning server 5.The route (shortest path) is computed 6.The route is communicated to the user on a map as well as a synthetic speech telling in which direction to go User scenario

4. 14-10-2004thomasbodin@itu.dk4 System Components 1.Speaker-dependent versus speaker- independent recognition 2.Isolated-word versus continuous-speech recognition (c.f. grammar) 3.Quiet versus noisy environment Speech Technology The following features must be taken into account:

5. 14-10-2004thomasbodin@itu.dk5  Java Speech API (JSAPI)  IBM Speech for Java (implementation of the JSAPI)  IBM ViaVoice (speech engine providing both speech recognition and synthesis) The XML based Java Speech Markup Language (JSML) makes the synthesized speech sound more natural, while the Java Speech Grammar Format (JSGF) is a dictation grammar used by the speech recognizer.

6. 14-10-2004thomasbodin@itu.dk6 Positioning Technology 1.Wireless Local Area Network (WLAN) 2.Ekahau Manager includes calibrator functionality (recording signal strengths from access points) 3.Ekahau Positioning Engine 4.Ekahau Client

7. 14-10-2004thomasbodin@itu.dk7 Weighted Graph Algorithm V = {1, 2, 3, 4} E = {(1, 2), (1, 3), (2, 4), (3, 2), (4, 3)} G = (V, E) w(1, 2) = 7, w(1, 3) = 1, w(2, 4) = 5, w(3, 2) = 2, w(4, 3) = 9 Arbitrary relationships among data objects can be expressed in a weighted graph model. An example of a directed weighted graph (in the PDCS the weighted graph is undirected) could be as follows:

8. 14-10-2004thomasbodin@itu.dk8 PDCS model The PDCS model consists of both a physical and logical model (c.f. terminology) Implementation

9. 14-10-2004thomasbodin@itu.dk9 1.The physical model corresponds to the Floor, Room and Door tables in the database 2.The logical model corresponds to the AbstractPosition and Distance tables in the database The PDCS model is directly related to the data in the database: Managing Data

10. 14-10-2004thomasbodin@itu.dk10 mysql> select * from Area; +--------+---------+--------+--------+--------+------+------+ | areaId | floorId | roomId | xStart | yStart | xEnd | yEnd | +--------+---------+--------+--------+--------+------+------+ | 1 | 2 | NULL | 954 | 690 | 1428 | 1212 | | 2 | 2 | NULL | 954 | 1212 | 1428 | 1436 | | 3 | 2 | NULL | 1428 | 1212 | 1912 | 1436 | | 4 | 2 | NULL | 1912 | 1212 | 2400 | 1436 | | 5 | 2 | NULL | 2400 | 690 | 2872 | 1186 | | 6 | 2 | NULL | 2400 | 1186 | 2666 | 1436 | | 7 | 2 | NULL | 2666 | 1186 | 2872 | 1436 | | 8 | 2 | NULL | 2872 | 1186 | 3628 | 1436 | | 9 | 2 | NULL | 3628 | 1186 | 4138 | 1436 | | 10 | 2 | NULL | 4138 | 1186 | 4794 | 1436 | | 11 | 2 | NULL | 4794 | 690 | 5038 | 824 | | 12 | 2 | NULL | 4794 | 824 | 5266 | 1186 | | 13 | 2 | NULL | 4794 | 1186 | 5266 | 1436 | | 14 | 2 | 3.08 | 954 | 0 | 1912 | 690 | | 15 | 2 | 3.09 | 1912 | 0 | 2872 | 690 | | 16 | 2 | 3.10 | 2872 | 0 | 3342 | 1186 | (…) select areaId from Area where roomId = ” 3.09 ” ; select areaId from Area where floorId = 2 and xStart 2000 and yStart 500; 15 will be returned as the areaId in both cases!

11. 14-10-2004thomasbodin@itu.dk11 Structuring Code 1.Dividing the classes into packages makes it easier to debug, while each package can be tested individually (c.f. each package can be considered as a plug-in) dk.funkenstein.graph dk.funkenstein.service dk.funkenstein.position dk.funkenstein.protocol dk.funkenstein.speech dk.funkenstein.model.physical dk.funkenstein.model.logical

12. 14-10-2004thomasbodin@itu.dk12 Demo PDCS example In this scenario John has asked the system how to find Thomas. The system responds with the shortest path according to John’s specific position.

13. 14-10-2004thomasbodin@itu.dk13 Examples on speech synthesis IBM ViaVoice Justin Jane AT&T Natural Voices Charles Crystal

14. 14-10-2004thomasbodin@itu.dk14 1.Loading new packages (grammar, physical and logical model) during run-time 2.The static data (c.f. destination) could be extended with dynamic data (c.f. other users) 3.The map (c.f. PDCS model) must be constructed automatically instead of manually 4.Enrolment of each user 5.Scaling the PDCS by making the logical model hierarchic 6.The experience from designing and implementing the PDCS has been used in the first prototype of the DELCA (Dis- Embodied Location-specific Conversational Agents) Perspectives

15. 14-10-2004thomasbodin@itu.dk15

16. 14-10-2004thomasbodin@itu.dk16 Relevant Links Position Dependent Communication System http://www.itu.dk/people/thomasbodin/itu.html http://www.itu.dk/people/thomasbodin/PDCS/demo/index.html Speech Technology http://java.sun.com/products/java-media/speech/ http://www.alphaworks.ibm.com/tech/speech http://www-106.ibm.com/developerworks/ibm/library/i-voice/ http://www.naturalvoices.att.com/demos/ Positioning Technology http://positionserver.itu.dk/ http://www.ekahau.com/ DELCA (Disembodied Location-specific Conversational Agents) http://lacomoco.itu.dk/index.jsp http://mobilitylab.itu.dk/ http://www.itu.dk/research/delca/