1. 1 COST 278 Spoken Language Interaction in TelecommunicationWG2 – MM Communication / July 2002 / PB WG2 – Multimodal Communication CTU Prague (Vaclav Hanzl) PDA, speech controlled path-finder, car environment, automotive industry Zuercher Hochschule Winterthur - University of Applied Sciences (Hans- Peter Hutter) generic multimode user interface (mobile/office) synchronisation and data fusion/fission modality selection, combination and prioritisation user preferences and adaptation, personalisation multi-modal system prototyping development environments standardisation evaluation, analysis specific for multimodality human factors aspects Universidad de Granada (Ramon Lopez-Cozar Delgado) Tools to develop MM systems Extending current systems with MM input Proposal: multi-modal resources (tools, corpora, knowledge-base, Q/A) Which are the recommended modalities for this application? Why? What may be the advantages of including additional modalities in this application type? Would be a particular modality superfluous for this application type?

2. 2 COST 278 Spoken Language Interaction in TelecommunicationWG2 – MM Communication / July 2002 / PB TIK/ETH (Beat Pfister) Study multi-modal input including speech, typing, and pointing where the user has a high degree of flexibility. Questions addressed: timing, enable/disable modalities (e.g. given a situation where the user has to enter a phone number: should typing disable the speech input? for how long?...) Study timing of dialog turns … and particularly the question of how to find the optimal delay for system responses in order to maximize the user comfort (he does neither get tired from waiting, nor feels to be pushed). These studies are mainly concerned with the following topics: modality selection, combination and prioritisation user preferences and adaptation, personalisation human factors aspects T-Systems Nova GmbH Berkom (Stefan Feldes) Multi Access Portals for Telco customers …. media conversion content presentation from same source in different modalities knowledge representation (1 content - multiple media) Animated agents with TTS output, ASR, written input gesture and mimics (Speech-to-speech translation)

3. 3 COST 278 Spoken Language Interaction in TelecommunicationWG2 – MM Communication / July 2002 / PB Speech and Multimedia group, CPK (Best, Lars Bo) Application multi modal pool trainer Ships (TETRA: text/speech) localisation, routing (PDA) Platform/testbed FACE (Future Adaptive Communications Environment)- architecture and performance of e.g. distributed interactive multimedia dialogue systems ENST (Gerard CHOLLET) Man-machine interface between a handicapped person and his/her home environment. Voice and image communicator embedded in a PDA with the Olympics 2008 as a target. INESC ID Lisboa (João P. Neto) Earlier: Talking Head prototype synchronizing the lips movement with our TTS system Not active at this moment, but interested in

4. 4 COST 278 Spoken Language Interaction in TelecommunicationWG2 – MM Communication / July 2002 / PB WG2 – Multimodal Communication Application development Hans-Peter multi-modal system prototyping CTU, Granada, T-Systems, CPK, ENST, Nokia, UTA, ZHW generic multimodal user interface (mobile/office)ZHW, CPK development environments Granada, Nokia, UTA, T-Systems Human factors, HCIJacques human factors aspectsETH, Nokia, UTA, ZHW, FUB HCI: cognitive based intuitive interfacesEindhoven evaluation, analysis specific for multimodality, WOZCPK, ZHW, Nokia, FUB modality selection, combination and prioritisationETH, Granada, Eindhoven, Nokia, ZHW user preferences and adaptation, personalisationETH, Eindhoven, Nokia, T-Systems, CPK, ZHW TechnologiesKjell synchronisation and data fusion/fissionNokia, ZHW media-independent knowledge representationT-Systems, ZHW multimodal dialogue strategies, modellingT-System, Eindhoven, UTA, CPK, ZHW Multimodal resourcesGranada ?? multi-modal corporaGranada standardisationGranada Waiting list: Telenor, NTNU, KTH