1. Speech Processing for NSR Vs DSR Veeru Ramaswamy PhD CTO, Vianix LLC Email: veeru@vianix.com

2. Vianix Background Fast-paced speech technology company with corporate headquarters located in Virginia Beach, Virginia. Vianix has developed, tested, proven and licensed MASC ® – Managed Audio Sound Compression (MASC ® ) – State-of-the-Art speech compression technology High performance enabling voice technology For a broad spectrum of healthcare, multimedia communications and enterprise applications

3. NSR Vs DSR NSR DSR

4. Disadvantages of DSR Bandwidth Requirements: Bit rates ~7-11 kbps, no better than that of compressed voice (For e.g., a lot of VBR encoders can compress from 5 to 17 Kbps with a good recognition accuracy). Speech Reconstruction: Not possible to listen to original voice although more recent advances of DSR allow only low quality reconstruction of voice from features such as LPC or cepstral coefficients (MFCC as in ETSI based Aurora). Playback using TTS: Most DSR applications can only synthesize voice using TTS for an audio playback. DWER: Overall DWER may be lower or greater than NSR based recognition Feature-aware recognition: The recognition engine has to know the type of feature extraction being done apriori in order for the recognition engine to transcribe accurately. Cost of additional client: Additional expenditure as the front-end each time a client needs to be changed.

5. Advantages of NSR Delay/Jitter for Transcription: Any delay in the network transmission of NSR is inconsequential because most transcription applications are non-real-time. Single Client: NSR front-end clients do not need to be changed. The same front-end terminal such as those used in VoIP and other applications. Bandwidth Requirement: Transmission of speech data over any data network for NSR applications requires almost the same bandwidth requirements to encode speech data (For e.g., there are different encoders today offering VBR levels to meet bandwidth requirements without compensating too much on the recognition accuracy). Bit-stream domain recognition: Recognizing speech at the compressed bit-stream domain avoids complications such as no additional feature extraction mechanism is required on the device, and there are no reconstruction losses on the server. Channel coding: Standard schemes can be used with compressed stream (to avoid channel errors) VoIP robustness: Earlier, it was difficult to send compressed voice (only voice features) through the data channel. Now that VoIP has become very robust, high quality compressed voice content can also be sent via data channels.

6. PESQ / MOS PESQ (Perceptual Evaluation of Speech Quality) –Originally defined as part of P.861 as PSQM as an objective measure –Modification to PSQM as PESQ in P.862 –PESQ combines the excellent psycho-acoustic and cognitive model of PSQM+ with a time alignment algorithm that handles varying delays. –PESQ usually ranges from 1 to 4.5 MOS (Mean Opinion Score) –A linear mapping and proportional to PESQ –MOS, according to ITU standard can be between 1.0 to 5.0 –MOS is a subjective measure as opposed to PESQ being an objective measure

7. Other Metrics Variable Bit-Rate: –Various bitrates for different codecs (which support variable bit rates) including MASC codec were compared with variable bit-rates. –Bit-rates range from almost 5 kbps to 20 kbps. MIPS: –Computational efficiency for diff codecs are compared using V-Tune. –MIPS ranges from 20 to about 200 depending on the codec used. WER: –A measure to compute the number of words in percentage that have NOT been correctly identified by an ASR. –Accuracy of the ASR engine is computed by identifying how many words were inaccurate. DWER: difference in WER from the original uncompressed PCM samples to decompressed/decoded PCM samples. –Absolute and Relative. –Absolute here and a relative number can be obtained by computing the ratio of Absolute DWER to the Original Uncompressed WER.

8. Procedure for Comparison of different Codecs Procedure for ADWER Computation Comparison of MASC with other various codecs –ADWER –PESQ –Bit-rate

9. PCM REF PCM REF Delta Automatic Speech Recognition Engine Transcribed Text from PCM Ref Comparison Of Text Files for Word Error Rate Original Text %WER Deg %WER REF Encoder PCM Deg STAGE 1 STAGE 2 WER = STAGE 3 %WER REF %WER Deg Decoder Transcribed Text from PCM Deg Signal Train for DWER Calculation

10. Procedure for computing ADWER Stage 1: Obtain the transcribed text of the PCM reference file by passing it thru the PSM.  Obtain % WER of transcribed text from the original text (WER REF)  All inputs were converted to 8 KHz from 16 KHz using Adobe Audition 2.0 Stage 2: Repeat Stage 1 with the PCM reference file encoded and decoded with different encoders and decoders i.e., Repeat Stage 1 using the “Degraded/Decompressed PCM” as input to ASR (WER DEG).  Used Adobe-Audition 2.0 or Sound-Recorder to convert from PCM to compressed/encoded data and back to Decoded/Decompressed PCM. Stage 3:  ADWER = WER REF - WER DEG

11. Inputs and Outputs Input: Speech Test Vectors –A set of test vectors in.wav format are required to adapt and evaluate on ASR –456 test vectors consisting of eight users (4 Male and 4 Female). Each user has eleven adaptation files and forty six evaluation files. Output: Transcribed Text –WER computed from Original text and Transcribed Text from PCM Reference –ADWER computed as a difference between Text from Reference PCM and Text from Degraded/Decompressed PCM

12. CodecWER Absolute DWERPESQbit rate 8KHz Reference14.9143 4.5064.00 MASC Optimized15.45690.54254.1317.20 MASC Original16.29021.37593.9314.40 GSM 6.1016.17231.25803.7213.00 AMR NB setting 018.17103.25673.374.75 AMR NB setting 715.64740.73314.0412.20 EVRC17.61892.70453.558.00 VMR-NB16.21211.29773.8114.20 G71117.63912.72483.4464.00 G72917.45062.53633.708.00 Speex setting 616.38041.46603.7811.50 Speex setting 815.71370.79934.0015.00 True Speech19.41064.49623.418.00 Comparison of 8KHz Codecs on ASR1

13. MASC is the only Codec that exists today at 8 KHz and at a ADWER in the 0.5 range

14. CodecWER Absolute DWERBit ratePESQ 8 KHz Ref 7.93128.04.50 MASC Opt Fixed 8.180.2517.64.13 MASC Opt L4 8.300.3815.83.97 MASC Opt L3 8.380.4514.83.80 MASC Opt L2 8.410.4912.73.65 MASC Original Fixed 8.550.6214.43.98 MASC Original L4 8.560.6412.93.93 MASC Original L3 8.590.6612.23.82 MASC Original L2 8.800.8710.53.61 GSM 6.10 8.740.8113.03.72 AMR NB 7 8.480.5512.44.04 AMR NB 5 8.991.068.43.79 AMR NB 0 10.192.265.23.37 G726 - MS ADPCM 8.600.6732.83.68 Speex 2 10.993.066.43.23 Speex 4 9.791.868.93.48 Speex 6 8.941.0111.73.78 Speex 8 8.450.5215.74.00 TrueSpeech 10.632.708.53.41 Comparison of 8KHz Codecs on ASR2

16. Summary Although, there is a perception that DSR might be using low bandwidth and high accuracy, given the importance of voice reconstruction at the back-end and the accuracy w.r.t ASR engines, NSR outweighs DSR with lot more advantages in reality.