Presentation is loading. Please wait.

Presentation is loading. Please wait.

ICDM'07 1 Depth-Based Novelty Detection Yixin Chen Dept. of Computer and Information Science University of Mississippi

Similar presentations


Presentation on theme: "ICDM'07 1 Depth-Based Novelty Detection Yixin Chen Dept. of Computer and Information Science University of Mississippi"— Presentation transcript:

1 ICDM'07 1 Depth-Based Novelty Detection Yixin Chen Dept. of Computer and Information Science University of Mississippi http://www.cs.olemiss.edu/~ychen Joint work with Henry Bart, Xin Dang, and Hanxiang Peng

2 ICDM'072 Outline Novelty detection Motivations Kernelized spatial depth (KSD) Bounds on the false alarm probability Empirical studies Discussions

3 ICDM'073 Outlier Detection Missing label problem One-class learning

4 ICDM'074 A Simple Outlier Detector 1-d example Sensitivity Threshold Structure of the data X mean median X X X ?

5 ICDM'075 Median The sign function Median is

6 ICDM'076 Spatial Median The spatial sign function The spatial median is

7 ICDM'077 Spatial Depth Sample version The expectation of the unit vector starting from x

8 ICDM'078 Spatial Depth and Outlier Detection outlier

9 ICDM'079 Example: Half-Moon Data FAR = 70%

10 ICDM'0710 Example: Ring Data FAR = 100%

11 ICDM'0711 Kernelized Spatial Depth (KSD) σ→∞, KSD converges to SD σ→0, KSD → 0.293

12 ICDM'0712 Example: Half-Moon Data 0.2495

13 ICDM'0713 Example: Ring Data 0.2651

14 ICDM'0714 KSD Outlier Detector outliers normal observations b is margin How should we decide the threshold t?

15 ICDM'0715 Threshold Selection Largest threshold such that upper bound on FAP ≤ desired level

16 ICDM'0716 Bounds on the False Alarm Probability A training set bound A test set bound

17 ICDM'0717 Empirical Study 1 10 species under the order Cypriniforms 989 specimens from Tulane University Museum of Natural History

18 ICDM'0718 Empirical Study 1 Masking Effect

19 ICDM'0719 Empirical Study 2

20 ICDM'0720 Discussions KSD outlier detection and density based approaches

21 ICDM'0721 Acknowledgment Kory P. Northrop, Tulane University Huimin Chen, University of New Orleans University of Mississippi National Science Foundation


Download ppt "ICDM'07 1 Depth-Based Novelty Detection Yixin Chen Dept. of Computer and Information Science University of Mississippi"

Similar presentations


Ads by Google