1. Des Hommes de Parole ® WP6 2002-05-021 Des Hommes de Parole ®

2. WP6 2002-05-022 WP6: System Integration Building a Galaxy communicator compliant end-system

3. Des Hommes de Parole ® WP6 2002-05-023 First Step: build One Box System with Dialogic telephony board under LINUX Software portage from NMS board to Dialogic boards under RH7.2 in centralized architecture. Record/play streaming, barge-in and speech detection Call control (loopstart) software Resolve Dialogic issues ( no call transfer for Dialogic global call control API ) Test with the SNCF railway info application as starting blocks for LIMSI co-workers Issues: Intermittent DISCONNECT event from Dialogic board Call transfer not yet available for application development …live with Dialogic board shortage

4. Des Hommes de Parole ® WP6 2002-05-024 ( First Step continued: build One Box System with Dialogic telephony board under LINUX ) System requirements HARDWARE: * Minimum requirements for the PC: - Pentium 4 1.8 GHz - RAM 512 Mo - Hard Disk 8 Go * Dialogic Board: - Long PCI slot for Dialogic board - Dialogic board D/41JCT-LS (4 channels) or D/120JCT-LS (12 channels) SOFTWARE: - LINUX RedHat 7.2 - Kernel V2.4.9 with latest update ( current 2.4.9-31) + sources + headers - Driver Linux Streams 2.13. (current 2.13.19) - System Release 5.1 Dialogic (Runtime Dialogic and CSP library) (Continuous Speech Processing) - Dialogic Global Call Package 2.1

5. Des Hommes de Parole ® WP6 2002-05-025 Context Tracking Context Tracking Hub Application Backend Application Backend Dialogue Management Dialogue Management Language Generation Frame Construction Speech Recognition (LIMSI-VECSYS) Galrecowrapper  Sig2mfcc  nsearch  {Acoustic and Language models} Speech Recognition (LIMSI-VECSYS) Galrecowrapper  Sig2mfcc  nsearch  {Acoustic and Language models} Audio (VECSYS) Galaudio Record   Play  Call Control  Audio (VECSYS) Galaudio Record   Play  Call Control  Text-to- Speech Second Step: Make LIMSI/VECSYS Services GC Compliant

6. Des Hommes de Parole ® WP6 2002-05-026 Audio (VECSYS) Galaudio Record  Audio (VECSYS) Galaudio Record  Milestone 04-30: Record only Soundblaster card integration only Running on LINUX RH 7.2 Fixed record window only, no barge-in or silence detection Communicates with Speech recognition service in stream brokering mode Speech Recognition (LIMSI-VECSYS) Galrecowrapper  Sig2mfcc  nsearch  {Acoustic and Language models} Speech Recognition (LIMSI-VECSYS) Galrecowrapper  Sig2mfcc  nsearch  {Acoustic and Language models} Milestone 04-30: Acoustic and Language models to be provided by LIMSI/VECSYS based on data from partners and WP2 Running on LINUX RH 7.2 Communicates with Audio service in stream brokering mode Input audio stream in PCM 8KHz/16 bit Little Endian ( Second Step continued: Make VECSYS Oasis Services GC Compliant )

7. Des Hommes de Parole ® WP6 2002-05-027 How the system works Audio Speech Recognition Speech Recognition Hub Recognizer.pgm SERVER: Audio HOST:localhost PORT:2800 OPERATIONS: reinitialize Record SERVER: recognizer HOST:localhost PORT:11000 OPERATIONS: Recognize PROGRAM: FromAudio RULE: :binary_port & :binary_host & :call_id --> Recognize IN: :binary_port :binary_host :call_id OUT: none! PROGRAM: ToAudio RULE: :string --> Audio.Record IN: :string OUT: none! reco.csh audio.csh hub.csh

8. Des Hommes de Parole ® WP6 2002-05-028 ( How the system works continued ) Audio Speech Recognition Speech Recognition Hub provider: for Audio @ localhost:2800 GalIO_CommDispatchFrame: got reply: {c Audio :signatures ( ( « Record » …) ( « reinitialize » …) ) :properties {c server_properties } :extra_service_types ( ) :protocol_version 1 }

9. Des Hommes de Parole ® WP6 2002-05-029 ( How the system works continued ) Audio Speech Recognition Speech Recognition Hub “Recognize” provider: for recognizer @ localhost:11000 GalIO_CommDispatchFrame: got reply: {c Recognizer :signatures ( ( "Recognize", ) :properties {c server_properties } :extra_service_types ( ) :protocol_version 1 } {c FromAudio :binary_host "192.9.200.44" :binary_port 2800 :call_id "192.9.200.44:27083:0" :session_id "Default" :tidx 1 }

10. Des Hommes de Parole ® WP6 2002-05-0210 ( How the system works continued ) Audio Speech Recognition Speech Recognition Hub “Audio received” Got new message from provider for recognizer @ localhost:11000 {c ToAudio :notification "Audio received." :language "French" :string " Société Générale" :session_id "Default" :tidx 2 }

11. Des Hommes de Parole ® WP6 2002-05-0211 Context Tracking Context Tracking Hub Application Backend Application Backend Dialogue Management Dialogue Management Language Generation Frame Construction Speech Recognition Audio Text-to- Speech Next Steps: Galaxy compliant Telephony Audio server with barge-in capability and speech detection interaction with partner services

12. Des Hommes de Parole ® WP6 2002-05-0212 ( End-system) Integration questions How is the IVR set up to route calls before the agent picks up? (question from meeting minutes 2002_0226) Brainstorming… Different types of routing paths for internal call routing to a new dialogue application and/or external call routing through the public network (PSTN) or PBX ? Specification of call control interface ( pickup, hangup, explicit call transfer and blind call transfer ) between Dialogue manager server and Audio Server client ( Telephony IVR service ) ? => Definition of frames Configuration ( database queries ) GUI for call routing setup to live operator PBX extensions ( integration in call centers ) ? Usage of the Natural Language Generator (VECSYS/LIMSI) for French ? Which TTS server for English and German ?

13. Des Hommes de Parole ® WP6 2002-05-0213 Contact: Christoph Stier (VECSYS R&D) +33 1 69 29 89 79 cstier@vecsys.fr