Presentation is loading. Please wait.

Presentation is loading. Please wait.

Investigation of Pitch Detection Characteristics from Different Audio Context.

Similar presentations


Presentation on theme: "Investigation of Pitch Detection Characteristics from Different Audio Context."— Presentation transcript:

1

2 Investigation of Pitch Detection Characteristics from Different Audio Context

3 Part 1: Introduction

4 Pitch Detection Characteristics from Different Audio Context Motivations: Testing pitch detection algorithms using imperfect audio materials Music note itself can be very complex A lot of audio material is recorded in imperfect recording conditions, for example, interference from other music instrument in emsemble recording and noise. Existing source separation algorithms usually provide incomplete separation. Testing and Evaluation Goals: Pitch Detection Performance Analysis using Synthesized Notes Pitch Detection Performance Analysis using Real Musical Notes Testing Framework: add MIR Toolbox distortion interference note noise Pitch detection result 1 SNR Source audio signal combined audio signal (simulate imperfect audio) MIR Toolbox Pitch detection result 2

5 Part 2: Pitch Detection Performance on Synthesized Notes

6 Synthesized tone of 440 Hz. 440Hz MIR Toolbox Hz Synthesized Notes of Different Complexity

7 Synthesized tone of 440 Hz. 440Hz MIR Toolbox Hz Synthesized Notes of Different Complexity

8 Synthesized tone of 440 Hz. We add in some amplitude modulation and frequency modulation to each sonic partials to add in the complexities. AM index = 0.5, maximum frequency deviation = 10 Hz at f1 440Hz MIR Toolbox Hz Synthesized Notes of Different Complexity

9 440Hz MIR Toolbox Hz Synthesized tone of 440 Hz. We add in some amplitude modulation and frequency modulation to each sonic partials to add in the complexities. AM index = 0.5, maximum frequency deviation = 10 Hz at f1 Synthesized Notes of Different Complexity

10 440Hz MIR Toolbox Hz Synthesized tone of 440 Hz. We add in some amplitude modulation and frequency modulation to each sonic partials to add in the complexities. AM index = 0.5, maximum frequency deviation = 10 Hz at f1 Synthesized Notes of Different Complexity

11 440Hz MIR Toolbox Hz Synthesized tone of 440 Hz. We add in some amplitude modulation and frequency modulation to each sonic partials to add in the complexities. AM index = 0.5, maximum frequency deviation = 10 Hz at f1 Synthesized Notes of Different Complexity

12 Synthesized tone of 440 Hz. We add in some amplitude modulation and frequency modulation to each sonic partials to add in the complexities. AM index = 0.5, maximum frequency deviation = 40 Hz at f1 440Hz MIR Toolbox Hz Synthesized Notes of Different Complexity

13 440Hz MIR Toolbox Hz Synthesized tone of 440 Hz. We add in some amplitude modulation and frequency modulation to each sonic partials to add in the complexities. AM index = 0.5, maximum frequency deviation = 40 Hz at f1 Synthesized Notes of Different Complexity

14 Part 3: Pitch Detection Performance on Real Musical Notes

15 Interference from Another Music Note add MIR Toolbox source note f Hz MIR Toolbox combined note f Hz MIR Toolbox interference note f Hz source note interference note combined note Wrong SNR = 3.5dB

16 Interference from Another Music Note MIR Toolbox combined note f Hz combined note Wrong

17 Interference from Another Music Note MIR Toolbox combined note f Hz combined note Wrong

18 Interference from Another Music Note add MIR Toolbox source note f Hz MIR Toolbox combined note f Hz MIR Toolbox interference note f Hz source note interference note combined note Right SNR = 8.61 dB

19 Interference from Another Music Note MIR Toolbox combined note f Hz combined note Right

20 Interference from Another Music Note MIR Toolbox combined note f Hz combined note Right

21 Interference from Another Music Note

22 Interference from Noise add MIR Toolbox source note f Hz MIR Toolbox combined note f Hz source note noise combined note Right SNR = 3.29 dB

23 Interference from Noise MIR Toolbox combined note f Hz combined note Right

24 Interference from Noise MIR Toolbox combined note f Hz combined note Right

25 Interference from Noise add MIR Toolbox source note f Hz MIR Toolbox combined note f Hz source note noise combined note Right SNR = dB

26 Interference from Noise MIR Toolbox combined note f Hz combined note Right

27 Interference from Noise MIR Toolbox combined note f Hz combined note Right

28 Interference from Noise

29 Conclusions

30 We implemented a framework to validate the performance of pitch detection algorithms at different audio qualities. We tested the performance of MIR toolbox pitch detection algorithms using both synthesized music notes and real music notes. Three factors that affects pitch detection performance are investigated. These factors include the complexity of the music note, interference from concurring music note and noise.

31 QA

32 Thank you!


Download ppt "Investigation of Pitch Detection Characteristics from Different Audio Context."

Similar presentations


Ads by Google