1. Singing Voice Separation via Active Noise Cancellation 使用主動式雜訊消除於歌聲分離
J.-S. Roger Jang (張智星)
MIR Lab, CSIE Dept.
National Taiwan University

2. Introduction Definition of active noise cancellation (ANC) Aka
A method for reducing unwanted sound by the addition of a second sound specifically designed to cancel the first (wiki)
Aka
Active noise control, active noise reduction (ANR)
Applications: Enhancement of the following signals
Fetal heartbeat
Captain broadcast
Singing voice of karaoke …

3. Fetal Heartbeat Enhance fetal ECG via ANC
B. Widrow, et al, “Adaptive signal processing : theory and applications”, 1975

4. Application Scenarios for Singing Voice Separation
SVS for common users
Recordings over karaoke box
mostly ok due to unidirectional microphone
Recordings over mobile devices
ANC required due to omni-directional microphone
Example of music rhythm game
SVS for professional artists
Original karaoke recordings (composed of “vocal+music1” and “music2”)
ANC required due to different music in each channel
Our current focus

5. SVS for Recordings with Accompaniment
A common scenario when interacting with music from mobile devices
Adaptive model:
Overall recording
(available)
Users acoustic input
(to be recovered)
Playback music
(to be identified)
Original music
(available)
t: time delay, p: order

6. SVS for Recordings with Accompaniment
Adaptive model:
Methods
To determine time delay t: Empirically
To determine order p: Use training and validating data
To determine coefficients ai: Least square estimate (or “\”)
t: time delay, p: order

7. Examples
Audio examples
Original music
Recording

8. Conclusions and future work
ANC is feasible for SVS of recordings over mobile devices
Extracted singing voice can be used for pitch tracking, etc
Linear models (ARMA) may not be the best for modeling the environment
Future work
Use DNN to replace ARMA model
Use recursive least-squares estimate for varying environment
Move the computation to devices for online display of pitch