1. All images are compressed.
The images in this file is not the original ones.
Polarization stereo using graph cut (Miyazaki, Ikeuchi)

2. Photometric stereo using graph cut and M-estimation for a virtual tumulus in the presence of highlights and shadows
Daisuke Miyazaki The University of Tokyo Previously
Hiroshima City University Currently
Katsushi Ikeuchi The University of Tokyo
Polarization stereo using graph cut (Miyazaki, Ikeuchi)

3. Virtual Tumulus Virtual Tumulus Project [Laser range sensor]
[Photometric stereo]
Overall geometry
Fine details
Virtual Tumulus Project
Polarization stereo using graph cut (Miyazaki, Ikeuchi)

4. Proposed method Photometric stereo Graph cut
Robust to outliers: shadow, specular reflection
Point light source in far distance with small size: directional light
Typically around 5 to 8 number of light sources
The direction (and the power) of light sources are known
Polarization stereo using graph cut (Miyazaki, Ikeuchi)

5. Candidates of surface normal
Photometric Stereo using 3 intensities
[Example]
Choose 3 intensities
from 5 inputs
Polarization stereo using graph cut (Miyazaki, Ikeuchi)

6. Candidates selection Neighboring surface normal: smooth Image
Contaminated pixel
with specular/shadow
Diffuse-only pixel 1 1
Choose
Candidates
Smooth surface normal
Graph cut
Polarization stereo using graph cut (Miyazaki, Ikeuchi)

7. Cost function Data cost Smoothness cost Sum of all pixels
Constant weight
Sum of all pixels
Polarization stereo using graph cut (Miyazaki, Ikeuchi)

8. Data cost of pixel p M-estimation (Lorentz function) Image brightness
Surface
normal
Light source
direction
Shading
(Lambert's law)
(Cosine function)
Robust to outlier
(shadow, specular reflection, noise)
Albedo
(Diffuse reflectance)
including
light source color and brightness
Polarization stereo using graph cut (Miyazaki, Ikeuchi)

9. Smoothness cost of neighboring pixels p & q
Albedo
Surface normal
Polarization stereo using graph cut (Miyazaki, Ikeuchi)

10. Graph structure sink sink p p q source source
Polarization stereo using graph cut (Miyazaki, Ikeuchi)

11. Algorithm overview KC3 candidates (surface normal & albedo)
Initial value
Graph cut (Estimate surface normal) [albedo fixed]
Graph cut (Estimate albedo) [surface normal fixed]
Iterate 3-4
Polarization stereo using graph cut (Miyazaki, Ikeuchi)

12. Example of input images
Specular object
Polarization stereo using graph cut (Miyazaki, Ikeuchi)

13. Result Median-PS: Miyazaki et al. IJCV 2010 GC-PS: Proposed method
Polarization stereo using graph cut (Miyazaki, Ikeuchi)

14. Evaluation Conventional PS Shadowcut PS Wu's PS Median PS Proposed
method
Input
Surface
normal
(error)
20.69
(149%)
41.61
(300%)
11.13
(80%)
13.76
(99%)
13.85
(100%)
Polarization stereo using graph cut (Miyazaki, Ikeuchi)

15. The University Museum, The University of Tokyo
Chlamys australis
(Australian scallop)
Polarization stereo using graph cut (Miyazaki, Ikeuchi)

16. Museum Result
Polarization stereo using graph cut (Miyazaki, Ikeuchi)

17. Segonko Tumulus Relief colored by red, green, yellow paints
Not open to the public
~A.D.500
Kumamoto
Polarization stereo using graph cut (Miyazaki, Ikeuchi)

18. Scanning Mission 2007 Aug 1st: preparation
2007 Aug 2nd: scanning (typhoon)
2007 Aug 3rd: data processing
2007 Aug 4th: scanning (hot)
2007 Aug 5th: data processing
2007 Aug 6th: scanning (sudden shower)
2007 Aug 7th: finishing
Polarization stereo using graph cut (Miyazaki, Ikeuchi)

19. 8-Light Measurement System
Photometric Wing
Polarization stereo using graph cut (Miyazaki, Ikeuchi)

20. Scanning
Polarization stereo using graph cut (Miyazaki, Ikeuchi)

21. Images Input image Rendered image
Polarization stereo using graph cut (Miyazaki, Ikeuchi)

22. Segonko result
Polarization stereo using graph cut (Miyazaki, Ikeuchi)

23. Sakurakyo Tumulus Keyhole-shaped tumulus Fukuoka 41m
End of 6th century
Carved triangle
Painted with red, green, yellow
Closed
Mission: 2010 Jan
Fukuoka
Polarization stereo using graph cut (Miyazaki, Ikeuchi)

24. Polarization stereo using graph cut (Miyazaki, Ikeuchi)

25. Polarization stereo using graph cut (Miyazaki, Ikeuchi)

26. Conclusion Graph Cut Photometric Stereo Virtual Museum Segonko Tumulus
Sakurakyo Tumulus
3D Digital Archiving
Polarization stereo using graph cut (Miyazaki, Ikeuchi)

27. Future Work Hiroshima A-bombed materials Shadow & specular
Faded texture
Discontinuity
Polarization stereo using graph cut (Miyazaki, Ikeuchi)

28. Daisuke Miyazaki 2010 Creative Commons Attribution 4
Daisuke Miyazaki 2010 Creative Commons Attribution 4.0 International License.
Daisuke Miyazaki, Katsushi Ikeuchi, "Photometric stereo using graph cut and M-estimation for a virtual tumulus in the presence of highlights and shadows," Proceedings of Workshop on Application of Computer Vision to Archaeology, San Francisco, CA USA, June 2010
以上で発表を終わります。ありがとうございました。
Polarization stereo using graph cut (Miyazaki, Ikeuchi)