One liner “How similar is the face in one video sequence to the other, where the similarity is uncorrelated with pose-induced similarity” illumination, expression, image quality, pose classifier should – discriminate positive/negative AND – uncorrelate w.r.to additional feature set 3
Learning with Side Information Domain adaptation / Co-training Meta features Latent information: maximize /marginalize Learning Using Privileged Information (LUPI) – SVM+ gains additional discrimination power – SVM– eliminates a factor that is irrelevant 4
MBGS Results from  Lior Wolf, Tal Hassner and Itay Maoz. Face Recognition in Unconstrained Videos with Matched Background Similarity. CVPR 2011. 22
This paper results Results where SVM– did most better than MBGS 23
Results MBGS > SVM– at Accuracy but, MBGS + SVM– wins Combination done by stacking – learning yet another SVM for the 2D scores 24
Is it really useful? Combined score “statistically significant” for [FP]LBP Use entire background set, AUC: 83.6% to 79.9% Online applications (one-side), AUC: 83.6% to 81.9% Correlations: – Within method higher, different scores – Across methods, highest for same feature (as expected) 25
Conclusion SVM– : unlearn using additional features MBGS : be choosy about the negative set 3D Pose : a good “privileged” information source They don’t talk about pose estimation accuracy Different types of privileged info that might work Metric learning (and relatives) not compared Thank You! 26
Some more results from other sources YouTube Faces DB Ref MethodAccuracy ± SEAUCEER  MBGS L2 mean, LBP76.4 ± 1.882.625.3 MBGS+SVM-78.9 ±1.986.921.2 APEM-FUSION79.1 ±1.586.621.4  STFRD+PMML79.5 ±2.588.619.9 27 References:  Lior Wolf, Tal Hassner and Itay Maoz. Face Recognition in Unconstrained Videos with Matched Background Similarity. IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2011.  Lior Wolf and Noga Levy. The SVM-minus Similarity Score for Video Face Recognition. IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2013.  Haoxiang Li, Gang Hua, Zhe Lin, Jonathan Brandt, Jianchao Yang. Probabilistic Elastic Matching for Pose Variant Face Verification. IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2013.  Zhen Cui, Wen Li, Dong Xu, Shiguang Shan and Xilin Chen. Fusing Robust Face Region Descriptors via Multiple Metric Learning for Face Recognition in the Wild. IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2013.