Real-Time Exemplar-Based Face Sketch Synthesis Pipeline illustration Note: containing animations Yibing Song 1 Linchao Bao 1 Qingxiong Yang 1 Ming-Hsuan.

Slides:

Advertisements

Similar presentations

Shape Matching and Object Recognition using Low Distortion Correspondence Alexander C. Berg, Tamara L. Berg, Jitendra Malik U.C. Berkeley.

Advertisements

Active Shape Models Suppose we have a statistical shape model –Trained from sets of examples How do we use it to interpret new images? Use an “Active Shape.

CSCE 643 Computer Vision: Template Matching, Image Pyramids and Denoising Jinxiang Chai.

Decolorization: Is rgb2gray() out? Yibing Song, Linchao Bao, Xiaobin Xu and Qingxiong Yang City University of Hong Kong.

Hongliang Li, Senior Member, IEEE, Linfeng Xu, Member, IEEE, and Guanghui Liu Face Hallucination via Similarity Constraints.

Patch-based Image Deconvolution via Joint Modeling of Sparse Priors Chao Jia and Brian L. Evans The University of Texas at Austin 12 Sep

Computational Photography CSE 590 Tamara Berg Filtering & Pyramids.

Duke University COPYRIGHT © DUKE UNIVERSITY 2012 Sparsity Based Denoising of Spectral Domain Optical Coherence Tomography Images Leyuan Fang, Shutao Li,

Volodymyr Fedak Artifacts suppression in images and video.

1 Active Random Fields Adrian Barbu. FSU 2 The MAP Estimation Problem Estimation problem: Given input data y, solve Example: Image denoising Given noisy.

Patch Based Synthesis for Single Depth Image Super-Resolution (ECCV 2012) Oisin Mac Aodha, Neill Campbell, Arun Nair and Gabriel J. Brostow Presented By:

A LOW-COMPLEXITY, MOTION-ROBUST, SPATIO-TEMPORALLY ADAPTIVE VIDEO DE-NOISER WITH IN-LOOP NOISE ESTIMATION Chirag Jain, Sriram Sethuraman Ittiam Systems.

Temporal Video Denoising Based on Multihypothesis Motion Compensation Liwei Guo; Au, O.C.; Mengyao Ma; Zhiqin Liang; Hong Kong Univ. of Sci. & Technol.,

Image Denoising via Learned Dictionaries and Sparse Representations

New Results in Image Processing based on Sparse and Redundant Representations Michael Elad The Computer Science Department The Technion – Israel Institute.

Region Filling and Object Removal by Exemplar-Based Image Inpainting

Super-Resolution With Fuzzy Motion Estimation

3D Computer Vision and Video Computing 3D Vision Lecture 15 Stereo Vision (II) CSC 59866CD Fall 2004 Zhigang Zhu, NAC 8/203A

Motion Estimation Using Low- Band-Shift Method for Wavelet- Based Moving Picture Hyun-Wook Park, Senior Member, IEEE, and Hyung-Sun Kim IEEE Transactions.

SOS Boosting of Image Denoising Algorithms

Inter-modality Face Sketch Recognition Hamed Kiani.

Background Estimation Mehdi Ghayoumi, MD Iftakharul Islam, Muslem Al-Saidi Department of Computer Science Kent State University, Kent, OH

Matthew Brown University of British Columbia (prev.) Microsoft Research [ Collaborators: † Simon Winder, *Gang Hua, † Rick Szeliski † =MS Research, *=MS.

Yuping Lin and Gérard Medioni.  Introduction  Method  Register UAV streams to a global reference image ▪ Consecutive UAV image registration ▪ UAV to.

Face Alignment Using Cascaded Boosted Regression Active Shape Models

Under the guidance of Dr. K R. Rao Ramsanjeev Thota( )

Troy P. Kling Mentors: Dr. Maxim Neumann, Dr. Razi Ahmed

Adaptive Regularization of the NL-Means : Application to Image and Video Denoising IEEE TRANSACTION ON IMAGE PROCESSING ， VOL ， 23 ， NO,8 ， AUGUST 2014.

1 Patch Complexity, Finite Pixel Correlations and Optimal Denoising Anat Levin, Boaz Nadler, Fredo Durand and Bill Freeman Weizmann Institute, MIT CSAIL.

Learning Visual Similarity Measures for Comparing Never Seen Objects By: Eric Nowark, Frederic Juric Presented by: Khoa Tran.

Last tuesday, you talked about active shape models Data set of 1,500 hand-labeled faces 20 facial features (eyes, eye brows, nose, mouth, chin) Train 40.

CAP5415: Computer Vision Lecture 4: Image Pyramids, Image Statistics, Denoising Fall 2006.

Building local part models for category-level recognition C. Schmid, INRIA Grenoble Joint work with G. Dorko, S. Lazebnik, J. Ponce.

Kaihua Zhang Lei Zhang (PolyU, Hong Kong) Ming-Hsuan Yang (UC Merced, California, U.S.A. ) Real-Time Compressive Tracking.

A Non-local Cost Aggregation Method for Stereo Matching

Fast Direct Super-Resolution by Simple Functions

Structured Face Hallucination Chih-Yuan Yang Sifei Liu Ming-Hsuan Yang Electrical Engineering and Computer Science 1.

Image Enhancement [DVT final project]

Non-local Sparse Models for Image Restoration Julien Mairal, Francis Bach, Jean Ponce, Guillermo Sapiro and Andrew Zisserman ICCV 2009 Presented by: Mingyuan.

Practical Poissonian-Gaussian Noise Modeling and Fitting for Single-image Raw-data Alessandro Foi, Mejdi Trimeche, Vladimir Katkovnik, and Karen Egiazarian.

Computer Vision Lecture #10 Hossam Abdelmunim 1 & Aly A. Farag 2 1 Computer & Systems Engineering Department, Ain Shams University, Cairo, Egypt 2 Electerical.

Sparse Bayesian Learning for Efficient Visual Tracking O. Williams, A. Blake & R. Cipolloa PAMI, Aug Presented by Yuting Qi Machine Learning Reading.

Templates, Image Pyramids, and Filter Banks

Patch-based Image Interpolation: Algorithms and Applications

Paper presentation topics 2. More on feature detection and descriptors 3. Shape and Matching 4. Indexing and Retrieval 5. More on 3D reconstruction 1.

SuperResolution (SR): “Classical” SR (model-based) Linear interpolation (with post-processing) Edge-directed interpolation (simple idea) Example-based.

Active Appearance Models Dhruv Batra ECE CMU. Active Appearance Models 1.T.F.Cootes, G.J. Edwards and C.J.Taylor. "Active Appearance Models", in Proc.

Quiz Week 8 Topical. Topical Quiz (Section 2) What is the difference between Computer Vision and Computer Graphics What is the difference between Computer.

Blind Inverse Gamma Correction (Hany Farid, IEEE Trans. Signal Processing, vol. 10 no. 10, October 2001) An article review Merav Kass January 2003.

Combining the Power of Internal & External Denoising Inbar Mosseri The Weizmann Institute of Science, ISRAEL ICCP, 2013.

EE565 Advanced Image Processing Copyright Xin Li Further Improvements Gaussian scalar mixture (GSM) based denoising* (Portilla et al.’ 2003) Instead.

Single Image Interpolation via Adaptive Non-Local Sparsity-Based Modeling The research leading to these results has received funding from the European.

Introduction to Medical Imaging Week 5: Introduction to Medical Imaging Week 5: MRI (part II) and Denoising (part I) Guy Gilboa Course

National Aerospace University of Ukraine IS&T/SPIE Electronic Imaging METRIC PERFORMANCE IN SIMILAR BLOCKS SEARCH AND THEIR USE IN COLLABORATIVE.

Local Stereo Matching Using Motion Cue and Modified Census in Video Disparity Estimation Zucheul Lee, Ramsin Khoshabeh, Jason Juang and Truong Q. Nguyen.

Aleksey S. Rubel1, Vladimir V. Lukin1,

Nonparametric Semantic Segmentation

The Chinese University of Hong Kong

Fast Preprocessing for Robust Face Sketch Synthesis

Presenter: Hajar Emami

A Graph-based Framework for Image Restoration

Outline S. C. Zhu, X. Liu, and Y. Wu, “Exploring Texture Ensembles by Efficient Markov Chain Monte Carlo”, IEEE Transactions On Pattern Analysis And Machine.

Compressive Sensing Imaging

Non-local Means Filtering

Presented By: Gao Chenhao

Improving K-SVD Denoising by Post-Processing its Method-Noise

Lecture 7 Spatial filtering.

Even Discrete Cosine Transform The Chinese University of Hong Kong

Lecture 7 Patch based methods: nonlocal means, BM3D, K- SVD, data-driven (tight) frame.

Presentation transcript:

Real-Time Exemplar-Based Face Sketch Synthesis Pipeline illustration Note: containing animations Yibing Song 1 Linchao Bao 1 Qingxiong Yang 1 Ming-Hsuan Yang 2 1 City University of Hong Kong 2 University of California at Merced

Our assumption: a database containing photo-sketch pairs 1. photo database 2. sketch database Aligned

Coarse Sketch Generation Step 1: KNN search p Test photo Training photo dataset Relative position Similarly Relative position [ ] =

Coarse Sketch Generation Step 2: Linear Estimation from Photos

Matched sketch pixel p Test photo Matched sketch pixel Estimation on pixel p Repeat for every pixel Coarse sketch Coarse Sketch Generation Step 3: Apply Linear Mapping to Sketches

Denoising: State-of-the-art Image Denoising Algorithms Coarse sketch Nonlocal Means (NLM) p r Little improvement After NLM q [NLM] A. Buades, B. Coll and J.-M. Morel, A non-local algorithm for image denoising, CVPR 2005.

Motivation – BM3D BM3D groups correlated patches in the noisy image to create multiple estimations. Our idea for sketch denoising: group highly similar sketch estimations. How BM3D works [BM3D] K. Dabov, A. Foi, V. Katkovnik, and K. Egiazarian, “Image denoising by sparse 3D transform- domain collaborative filtering,” IEEE Trans. Image Process., vol. 16, no. 8, pp , August 2007.

Proposed Spatial Sketch Denoising Algorithm (SSD) Test photo q p Matched sketch Similarly p r Averaging estimations to generate output sketch value. Nonlocal Means (NLM): Proposed SSD:

p Input