1. Media Manager Mail Access Barbara Hohlt and Steve Czerwinski UC Berkeley Ericsson Presentation 2000

2. Project Overview Make messages more accessible –Enable faster browsing of many voicemails –Access from different devices with different capabilities Media Mail services –Universal Inbox infrastructure –Voicemail is email encoded in MIME Transcoding services –Enhance voicemail interaction –Includes: skimmed audio, transcript, text/audio summary, and outline

3. Related Work SpeechSkimmer, MIT’s MultiMedia Lab [Aaron95] Auto-Summarization, Microsoft Research CueVideo, IBM Other Universal Inboxes IBM’s universal inbox type project

4. Architecture Transcoder Service Voicemail->Text Transcript Voicemail->Text Summary Voicemail->Text Outline Email ->Plain Audio Voicemail->Audio Summary Voicemail->Skimmed Audio Mail Access Interface NinjaMail Mail Access Interface POP Mail Access Interface IMAP Media Manager Interface Media Manager Service Client Folder Store

5. Bhaskar’s Cell-Phone Barbara’s Desktop Preference Registry Automatic Path Creation Service 800-MEDIA-MGR UID: mediamgr@cs.berkeley.edu Naming Service 1 1 mediamgr: Cluster locn. 2 2 MediaManager Mail Access Service 3 3 Bhaskar’s PSTN Phone Universal Inbox Clients

6. Messages and Content Objects Message Media Reference ID Queue of Content Objects Content Object Content ID Data Media Reference ID Message Part Content Type

7. MediaManagerServiceIF getFolders() getFoldersAs() getList() getListAs() getMessage() getMessageContent()

8. Audio Tools Speech Recognition/Synthesis –Transcribe voicemail to text –IBM ViaVoice SDK and custom audio libs Natural Language Processing –Directed word spotting by “understanding” content –ViaVoice SRCL Pitch –Detecting important words by emphasized pitch Pause –Compression through pause removal Spurts –Retrieve sentence structure of voicemail

9. Results Pause detection –Worked well for given applications –Playback speedup by 50-70% Pitch detection –Problems due to high pitch sounds and transitions Speech recognition –Performance decrease in conversational settings Natural Language Processing –Performed well with small grammar

10. Example: Adding GSM Adding GSMAudio and GSMSummary Add ContentObject definition to MediaManager –Add method createObject() –Add cases to Media Manager Add method toGSM() to Transcoder Edit.config file –External.transcoder.gsmrungsm Edit related transcoders –speechSynthesizer and audioSummary()

11. Implementing Other Mail Stores Implement MailAccessIF –MMgetFolders() –MMgetFoldersAs() –MMgetList() –MMgetListAs() –MMgetMessage() –MMgetMessageContent() Add new protocol to FolderStore

12. Conclusion