Presentation is loading. Please wait.

Presentation is loading. Please wait.

Computer Graphics Laboratory, Hiroshima City University All images are compressed. The images in this file are not.

Published bySheena Palmer Modified over 8 years ago

Similar presentations

Presentation on theme: "Computer Graphics Laboratory, Hiroshima City University All images are compressed. The images in this file are not."— Presentation transcript:

1 http://www.cg.info.hiroshima-cu.ac.jp/ Computer Graphics Laboratory, Hiroshima City University All images are compressed. The images in this file are not the original ones. SVD Photometric stereo (Miyazaki, Ikeuchi)

2 http://www.cg.info.hiroshima-cu.ac.jp/ Computer Graphics Laboratory, Hiroshima City University Photometric stereo under unknown light sources using robust SVD with missing data Daisuke MiyazakiThe University of TokyoPreviously Hiroshima City UniversityCurrently Katsushi IkeuchiThe University of Tokyo SVD Photometric stereo (Miyazaki, Ikeuchi)

3 http://www.cg.info.hiroshima-cu.ac.jp/ CG Lab, Hiroshima City University Geometric modeling SVD Photometric stereo (Miyazaki, Ikeuchi) [Laser range sensor][Uncalibrated photometric stereo] Algorithm(10)Experiment(5)Conclusion(1)Introduction(1/2)

4 http://www.cg.info.hiroshima-cu.ac.jp/ CG Lab, Hiroshima City University Proposed method Photometric stereo SVD: Our hole-filling SVD –Related work: [Mukaigawa 07] [Tomasi 92] [Shum 95] [Brand 02] Robust to outliers: shadow, specular reflection Point light source in far distance with small size: directional light Typically around 30 to 100 number of images The direction (and the power) of light sources are unknown –Related work: [Hayakawa 94] [Woodham 91] [Yuille 99] [Belhumeur 99] SVD Photometric stereo (Miyazaki, Ikeuchi) Algorithm(10)Experiment(5)Conclusion(1)Introduction(2/2)

5 http://www.cg.info.hiroshima-cu.ac.jp/ CG Lab, Hiroshima City University Photometric stereo SVD Photometric stereo (Miyazaki, Ikeuchi) Lambertian model for diffuse reflection Algorithm(1/10)Experiment(5)Conclusion(1)Introduction(2)

6 http://www.cg.info.hiroshima-cu.ac.jp/ CG Lab, Hiroshima City University Linearization SVD Photometric stereo (Miyazaki, Ikeuchi) Specular reflection Shadow pos neg Linearization Linear algebra Cosine function Algorithm(2/10)Experiment(5)Conclusion(1)Introduction(2)

7 http://www.cg.info.hiroshima-cu.ac.jp/ CG Lab, Hiroshima City University Three orthonormal basis images using SVD SVD Photometric stereo (Miyazaki, Ikeuchi) PCA/SVD 3 bases [Shashua 97] -192 4 8 -128-4 -192 -4128 Linearized image Representable by 3 bases pos: green neg: red

8 http://www.cg.info.hiroshima-cu.ac.jp/ CG Lab, Hiroshima City University Outlier SVD Photometric stereo (Miyazaki, Ikeuchi) Shadow Specular reflection Outlier "hole" Algorithm(4/10)Experiment(5)Conclusion(1)Introduction(2)

9 http://www.cg.info.hiroshima-cu.ac.jp/ CG Lab, Hiroshima City University Hole filling SVD Photometric stereo (Miyazaki, Ikeuchi) Without hole Bases With hole ??? cba cba Algorithm(5/10)Experiment(5)Conclusion(1)Introduction(2)

10 http://www.cg.info.hiroshima-cu.ac.jp/ CG Lab, Hiroshima City University Gradually filling holes SVD Photometric stereo (Miyazaki, Ikeuchi) SVD Bases Hole filling SVD Bases Hole filling Algorithm(6/10)Experiment(5)Conclusion(1)Introduction(2)

11 http://www.cg.info.hiroshima-cu.ac.jp/ CG Lab, Hiroshima City University Matrix representation SVD Photometric stereo (Miyazaki, Ikeuchi) Pixel number Image number Matrix-vector representation Image matrix SVD... Image 1Image 2 Algorithm(7/10)Experiment(5)Conclusion(1)Introduction(2)

12 http://www.cg.info.hiroshima-cu.ac.jp/ CG Lab, Hiroshima City University Row/column scraping SVD Photometric stereo (Miyazaki, Ikeuchi) Input image with outliers Algorithm(8/10)Experiment(5)Conclusion(1)Introduction(2)

13 http://www.cg.info.hiroshima-cu.ac.jp/ CG Lab, Hiroshima City University Row/column sticking SVD Photometric stereo (Miyazaki, Ikeuchi) Hole filling Linearized input image Hole filling SVD Algorithm(9/10)Experiment(5)Conclusion(1)Introduction(2)

14 http://www.cg.info.hiroshima-cu.ac.jp/ CG Lab, Hiroshima City University Algorithm flow SVD Photometric stereo (Miyazaki, Ikeuchi) Thresholding & graph cut Hole filling SVD Region segmentation Occluding boundary Outlier detection Linearization Light source direction estimation [Hayakawa 94] [Shi 10] [Belhumeur 99] [Sato 07] [Our method] Light source direction estimation 1 2 3 4 Algorithm(10/10)Experiment(5)Conclusion(1)Introduction(2)

15 http://www.cg.info.hiroshima-cu.ac.jp/ CG Lab, Hiroshima City University Linearizaiton result SVD Photometric stereo (Miyazaki, Ikeuchi) Input image Linearized image Algorithm(10)Experiment(1/5)Conclusion(1)Introduction(2)

16 http://www.cg.info.hiroshima-cu.ac.jp/ CG Lab, Hiroshima City University Result SVD Photometric stereo (Miyazaki, Ikeuchi) Algorithm(10)Experiment(2/5)Conclusion(1)Introduction(2)

17 http://www.cg.info.hiroshima-cu.ac.jp/ CG Lab, Hiroshima City University Result SVD Photometric stereo (Miyazaki, Ikeuchi) Algorithm(10)Experiment(3/5)Conclusion(1)Introduction(2)

18 http://www.cg.info.hiroshima-cu.ac.jp/ CG Lab, Hiroshima City University Comparison SVD Photometric stereo (Miyazaki, Ikeuchi) With outlier detection [Our result] Without outlier detection Algorithm(10)Experiment(4/5)Conclusion(1)Introduction(2)

19 http://www.cg.info.hiroshima-cu.ac.jp/ CG Lab, Hiroshima City University Comparison SVD Photometric stereo (Miyazaki, Ikeuchi) With outlier detection [Our result] Without outlier detection Algorithm(10)Experiment(5/5)Conclusion(1)Introduction(2)

20 http://www.cg.info.hiroshima-cu.ac.jp/ CG Lab, Hiroshima City University Conclusion SVD Photometric stereo (Miyazaki, Ikeuchi) SVD Photometric Stereo Con: Computation time (1h~1d) Light source unknown Shadow Specular reflection Hole filling SVD Algorithm(10)Experiment(5)Conclusion(1/1)Introduction(2)

21 http://www.cg.info.hiroshima-cu.ac.jp/ Computer Graphics Laboratory, Hiroshima City University (c) Crypton Future Media, Inc. Crypton Future Media, Inc. owns the copyright of this character, Miku Hatsune. This picture is drawn by Daisuke Miyazaki under Piapro Character License. http://piapro.jp/license/pcl/summary SVD Photometric stereo (Miyazaki, Ikeuchi)

22 http://www.cg.info.hiroshima-cu.ac.jp/ Computer Graphics Laboratory, Hiroshima City University (c) Daisuke Miyazaki 2010 All rights reserved. http://www.cg.info.hiroshima-cu.ac.jp/~miyazaki/ Daisuke Miyazaki, Katsushi Ikeuchi, "Photometric stereo under unknown light sources using robust SVD with missing data," Proceedings of International Conference on Image Processing, pp. 4057-4060, Hong Kong, China, Sep. 2010 SVD Photometric stereo (Miyazaki, Ikeuchi)

Download ppt "Computer Graphics Laboratory, Hiroshima City University All images are compressed. The images in this file are not."

Similar presentations

A Common Framework for Ambient Illumination in the Dichromatic Reflectance Model Color and Reflectance in Imaging and Computer Vision Workshop 2009 October.

A Common Framework for Ambient Illumination in the Dichromatic Reflectance Model Color and Reflectance in Imaging and Computer Vision Workshop 2009 October.
Photometric Image Formation

Photometric Image Formation
A Graph based Geometric Approach to Contour Extraction from Noisy Binary Images Amal Dev Parakkat, Jiju Peethambaran, Philumon Joseph and Ramanathan Muthuganapathy.

A Graph based Geometric Approach to Contour Extraction from Noisy Binary Images Amal Dev Parakkat, Jiju Peethambaran, Philumon Joseph and Ramanathan Muthuganapathy.
3D Modeling from a photograph https://research.microsoft.com/vision/cambridge/3d/3dart.htm.

3D Modeling from a photograph
Machine Vision Laboratory The University of the West of England Bristol, UK 2 nd September 2010 ICEBT Photometric Stereo in 3D Biometrics Gary A. Atkinson.

Machine Vision Laboratory The University of the West of England Bristol, UK 2 nd September 2010 ICEBT Photometric Stereo in 3D Biometrics Gary A. Atkinson.
Spherical Convolution in Computer Graphics and Vision Ravi Ramamoorthi Columbia Vision and Graphics Center Columbia University SIAM Imaging Science Conference:

Spherical Convolution in Computer Graphics and Vision Ravi Ramamoorthi Columbia Vision and Graphics Center Columbia University SIAM Imaging Science Conference:
Polarization-based Inverse Rendering from Single View Daisuke Miyazaki Robby T. Tan Kenji Hara Katsushi Ikeuchi.

Polarization-based Inverse Rendering from Single View Daisuke Miyazaki Robby T. Tan Kenji Hara Katsushi Ikeuchi.
BMVC 2009 Specularity and Shadow Interpolation via Robust Polynomial Texture Maps Mark S. Drew 1, Nasim Hajari 1, Yacov Hel-Or 2 & Tom Malzbender 3 1 School.

BMVC 2009 Specularity and Shadow Interpolation via Robust Polynomial Texture Maps Mark S. Drew 1, Nasim Hajari 1, Yacov Hel-Or 2 & Tom Malzbender 3 1 School.
Lecture 23: Photometric Stereo CS4670/5760: Computer Vision Kavita Bala Scott Wehrwein.

Lecture 23: Photometric Stereo CS4670/5760: Computer Vision Kavita Bala Scott Wehrwein.
Exchanging Faces in Images SIGGRAPH ’04 Blanz V., Scherbaum K., Vetter T., Seidel HP. Speaker: Alvin Date: 21 July 2004.

Exchanging Faces in Images SIGGRAPH ’04 Blanz V., Scherbaum K., Vetter T., Seidel HP. Speaker: Alvin Date: 21 July 2004.
Robust Object Segmentation Using Adaptive Thresholding Xiaxi Huang and Nikolaos V. Boulgouris International Conference on Image Processing 2007.

Robust Object Segmentation Using Adaptive Thresholding Xiaxi Huang and Nikolaos V. Boulgouris International Conference on Image Processing 2007.
Stereoscopic Light Stripe Scanning: Interference Rejection, Error Minimization and Calibration By: Geoffrey Taylor Lindsay Kleeman Presented by: Ali Agha.

Stereoscopic Light Stripe Scanning: Interference Rejection, Error Minimization and Calibration By: Geoffrey Taylor Lindsay Kleeman Presented by: Ali Agha.
Visibility Subspaces: Uncalibrated Photometric Stereo with Shadows Kalyan Sunkavalli, Harvard University Joint work with Todd Zickler and Hanspeter Pfister.

Visibility Subspaces: Uncalibrated Photometric Stereo with Shadows Kalyan Sunkavalli, Harvard University Joint work with Todd Zickler and Hanspeter Pfister.
Stepan Obdrzalek Jirı Matas

Stepan Obdrzalek Jirı Matas
Previously Two view geometry: epipolar geometry Stereo vision: 3D reconstruction epipolar lines Baseline O O’ epipolar plane.

Previously Two view geometry: epipolar geometry Stereo vision: 3D reconstruction epipolar lines Baseline O O’ epipolar plane.
Object recognition under varying illumination. Lighting changes objects appearance.

Object recognition under varying illumination. Lighting changes objects appearance.
Photometric Stereo Merle Norman Cosmetics, Los Angeles Readings R. Woodham, Photometric Method for Determining Surface Orientation from Multiple Images.

Photometric Stereo Merle Norman Cosmetics, Los Angeles Readings R. Woodham, Photometric Method for Determining Surface Orientation from Multiple Images.
Face Relighting with Radiance Environment Maps Zhen Wen 1, Zicheng Liu 2, Thomas Huang 1 Beckman Institute 1 University of Illinois Urbana, IL61801, USA.

Face Relighting with Radiance Environment Maps Zhen Wen 1, Zicheng Liu 2, Thomas Huang 1 Beckman Institute 1 University of Illinois Urbana, IL61801, USA.
Image segmentation by clustering in the color space CIS581 Final Project Student: Qifang Xu Advisor: Dr. Longin Jan Latecki.

Image segmentation by clustering in the color space CIS581 Final Project Student: Qifang Xu Advisor: Dr. Longin Jan Latecki.
Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’04) 1063-6919/04 $20.00 c 2004 IEEE 1 Li Hong.

Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’04) /04 $20.00 c 2004 IEEE 1 Li Hong.

Similar presentations

Ads by Google