1. Automatic Illumination and Color Compensation Using Mean Shift and Sigma Filter
Heechul Han and Kwanghoon Sohn
IEEE Transactions on Consumer Electronics, Vol. 55, No. 3, AUGUST 2009
Reporter: Chun-Jung Chen

2. Outline Introduction Edge-preserving smoothing filter ICCMS
Experimental results
Conclusion

3. Introduction(1/4)
Photography can be expressed as "drawing with light" because it is about capturing light and recording it.
However, it is difficult for amateur photographers to control light perfectly under arbitrary lighting conditions.

4. Introduction(2/4)
The human visual system (HVS) can easily construct a visual representation with vivid color and detail across a wide range of lighting variations through a series of adaptive mechanisms for brightness perception and processing.
In contrast, digital cameras do not have such sophisticated features similar to HVS.

5. Introduction(3/4)
Consequently, the visual quality of captured images suffers from a loss of detail, especially in low-light and shadow regions, and color shifts in photos taken at sunset or incandescent light.

6. Introduction(4/4)

7. Edge-preserving smoothing filter(1/2)

8. Edge-preserving smoothing filter(2/2)

9. ICCMS Image statistics analysis
Alpha blending based on human perception
Layer decomposition
Illumination suppression
Illumination compensation
Color restoration function

10. Image statistics analysis
For automatic processing, the parameter is adaptively obtained by image statistics analysis. First of all, mosaic image can be produced by image “mosaicing” transformation for the fast operation as follows:
We confirm that standard score is good method for the parameter estimation given by

11. Alpha blending based on human perception(1/2)
We apply alpha blending between the compensated image and the input image for estimating proper brightness and color enhancement.
The ratio of alpha blending between input image and compensated image is given by

12. Alpha blending based on human perception(2/2)
After the compensated image is transformed back to RGB color space using a simple matrix transformation, the final image can be computed as followed:

13. Layer decomposition
Our detail layer has edge suppression term based on HVS for attenuating considerable amounts of noise in dark regions in an image.

14. Illumination suppression(1/2)

15. Illumination suppression(2/2)

16. Illumination compensation
We use the base layer that is the edge-preserving low-pass filtered image of the luminance channel through a mean shift filter and a sigma filter for the illumination estimation, which can be expressed using the following equation:

17. Color restoration function
The proposed color restoration function(CRF) is defined as follows:

18. Experimental results(1/4)

19. Experimental results(2/4)

20. Experimental results(3/4)

21. Experimental results(4/4)

22. Conclusion
ICCMS is satisfied with appropriate illumination compensation, vivid color restoration, artifacts suppression, automatic parameter estimation.
Plan to implement in the image signal processing chip for the digital camera.

23. Thanks for your attention!