MULTIMEDIA INPUT / OUTPUT TECHNOLOGIES INTRODUCTION 6/1/ A.Aruna, Assistant Professor, Faculty of Information Technology

FAMILIARIZE OURSELF Resolution ▫Resolution is the number of pixels (individual points of color) contained on a display monitor Images ▫Visual representation Picture Quality ▫Characteristics Sever performance Networks Clients 6/1/2016 A.Aruna, Assistant Professor, Faculty of Information Technology 2

INTRODUCTION Can mean different Things ▫Encyclopedia on CD- ROM ▫Hypermedia Message – Composed by user(Text, Images, Audio, Video, Full motion Video, Live Video….) ▫Hypermedia Links Specialized equipment ▫To Capture and Store ▫Playback and Display 6/1/ A.Aruna, Assistant Professor, Faculty of Information Technology

WHAT MAKES MULTIMEDIA REAL? Transfer data across the Network Digitally process the data objects Storage, Networking, Processing and Display resources Existing Technologies ▫Printed materials – Resolution expectations of Images and Graphics Display ▫Television – Quality of Moving images 6/1/2016 A.Aruna, Assistant Professor, Faculty of Information Technology 4

INFORMATION PROCESSING CYCLE INPUTPROCESSOUTPUTSTORAGE Accepting data from user. Processing data into meaningful information. Displaying the information to the user. Storing the information for safe keeping or later use. 6/1/ A.Aruna, Assistant Professor, Faculty of Information Technology

INFORMATION PROCESSING SYSTEM Higher Quality – Cost Associated Price / performance – IPS Well balanced System ▫Performance of Server ▫The Network ▫Clients 6/1/2016 A.Aruna, Assistant Professor, Faculty of Information Technology 6

MULTIMEDIA INPUT / OUTPUT TECHNOLOGIES DIGITAL VOICE AND AUDIO 6/1/ A.Aruna, Assistant Professor, Faculty of Information Technology

INTRODUCTION Multidimensional technology – Enrich Application ▫Audio ▫Voice ▫Music ▫Sound Early 1990’s - visual without any audio Capability. Utilizes speaker with different tones Input – Musical keyboards, Microphones, cassette tape, Live Music Audio and Video recording 6/1/2016 A.Aruna, Assistant Professor, Faculty of Information Technology 8

What Kind of Application require Audio Product or Business Presentation Product catalogs Product brochures Product manuals Installation Instruction Maintenance Manual Training Manuals Online Help Voice Mail 6/1/2016A.Aruna, Assistant Professor, Faculty of Information Technology 9 Utilize Different Technologies based on Application

Why this is Important? Movie – Intensity of actor from voice Inflection Music – Adds tempo to the scene Sound – Generate Thrills and Excitement Emotionally and Logically Entertainment 6/1/2016A.Aruna, Assistant Professor, Faculty of Information Technology 10

Technology ? Audio compression and Video compression technology - Sound Synthesizers and Recording Speech Reorganization Linking or embedding sound files in standards Business Application - Object Linking & Embedding (OLE) capability – Microsoft Audio extension 6/1/2016A.Aruna, Assistant Professor, Faculty of Information Technology 11

DIGITAL AUDIO 6/1/2016A.Aruna, Assistant Professor, Faculty of Information Technology 12

DIGITAL AUDIO 6/1/2016A.Aruna, Assistant Professor, Faculty of Information Technology 13 Generates Electrical Signal Sine Wave Amplitude & frequency Harmonics with Freq & Amplitude Amp – Intensity of sound Freq – Pitch of Sound Continuous analog Sine Wave A/D Converter Through Sampling Process

What is Sampling Process? Analog signal is sampled over a regular time interval – Amplitude of the analog Signal Sampling Rate – Sampling Occurs. Audio Component Generation 6/1/2016A.Aruna, Assistant Professor, Faculty of Information Technology 14

DIGITAL VOICE 6/1/2016A.Aruna, Assistant Professor, Faculty of Information Technology 15 Human Voice Why Voice Input?

VOICE RECOGNITION SYSTEMS Separation between words Speaker dependency - Training and Independent recognition – Without Training,Any person Use of Phonemes- Recognize the word Vocabulary Size 6/1/2016A.Aruna, Assistant Professor, Faculty of Information Technology 16

TYPES OF VOICE RECOGNITION SYSTEMS Isolated word speech Recognition Connected word Speech Recognition Continuous Speech Recognition 6/1/2016A.Aruna, Assistant Professor, Faculty of Information Technology 17

Isolated word speech Recognition 6/1/2016A.Aruna, Assistant Professor, Faculty of Information Technology 18 Speech Input A/ D Converter Amplitude and Noise Normalization Parametric Analysis Train or Recognize Add new reference pattern to the List Dynamic Time Wrap Compare with Reference Pattern O/P Matched

VOICE RECOGNITION SYSTEM PERFORMANCE Voice Recognition Accuracy No. of Correctly Recognized words / No. of Test Words *100 Substitution error No.of Substituted words / No. of Test Words *100 No Response Error No. of No responses / No. of Test Words *100 Insertion error No. of Inserted words / No. of Test Words *100 6/1/2016A.Aruna, Assistant Professor, Faculty of Information Technology 19

SYSTEM PERFORMANCE Size of Vocabulary Speaker Independence Response time User Interface System Throughput 6/1/2016A.Aruna, Assistant Professor, Faculty of Information Technology 20

APPLICATION Voice mail Interaction Voice Command and Control Application Musical instrument Digital Interface (MIDI) 6/1/2016A.Aruna, Assistant Professor, Faculty of Information Technology 21