1. Kernel Similarity Modeling of Texture Pattern Flow for Motion Detection in Complex Background 2011 IEEE transection on CSVT Baochang Zhang, Yongsheng Gao, Sanqiang Zhao, Bineng Zhong

2. Outline  TPF Operator  Kernel Similarity Modeling  Experiment Result  Conclusion

3. TPF Operator-Spatial

4. TPF Operator-Temporal  The temporal derivative is defined as  A pixel value lying within 2.5 standard deviations of a distribution is defined as a match matc h

5. TPF Operator  By integrating both spatial and temporal information, the TPF is defined as  TPF reveals the relationship between derivative directions in both spatial and temporal domains

6. Flowchart for one pixel

7. Integral Histogram

8. Integral Histogram of TPF  Using a neighborhood region provides certain robustness against noise  When the local region is too large, the more details will be lost

9. Building Background Model  Use GMM to model the background  If a match has been found for the pixel, update mean and variance of the matched Gaussian distribution  If none of the K Gaussian distributions match the current pixel value, the least probable distribution is replaced with a new distribution whose mean is the current pixel value

10. Kernel Similarity Measurement  We use k to represent the result of kernel similarity  With the information of kernel similarity, we can get an adaptive threshold to classify the input pixel

11. Update the Background Model  If the pixel is labeled as background, the background model histogram with the highest similarity value will be updated with the new data

12. Experiment Results

13. Experiment 1

14. Experiment 2 Wallflower video (a)GMM (b)CMU (c)LBP (d)TPF (e)KSM-TPF

15. Experiment 2 GMM CMU LBP TPF KSM-TPF

16. Conclusion  KSM-TPF is much more robust to significant background variations  However, it is less computationally efficient than the GMM method or LBP method