MAP Estimation of Semi-Metric MRFs via Hierarchical Graph Cuts M. Pawan Kumar Daphne Koller Aim: To obtain accurate, efficient maximum a posteriori (MAP) estimation for Markov random fields (MRF) with semi-metric pairwise potentials MAP Estimation vava vbvb  a (i)  ab (i,k) Semi-Metric Potentials  b (k)  ab (i,k) = w ab d(i,k) f(a)-f(b) d(i,i) = 0, d(i,j) = d(j,i) > 0 d(i,j) - d(j,k) ≤  d(i,k) f : {a,b, …} {1, …, H} Bounds For  =1 (Metric) Linear Program: O(log H) Graph Cuts: 2 d max /d min Our Method: O(log H) lili lklk r-HST Metrics min f Q(f) Q(f) = ∑  a (f(a)) + ∑  ab (f(a),f(b)) Variables V, Labels L l1l1 l2l2 l3l3 l4l4 A A BB CC B ≤ A/r C ≤ A/r Overview Distance d T  path length d   1 d T1 +  2 d T2 + …. min f Q(f;d T1 ) f T1 min f Q(f;d T2 ) f T2.. Combine f T1, f T2 …. r-HST Metric Labeling Efficient Divide-and-Conquer Approach Analysis l1l1 l2l2 l3l3 l4l4 Use  -Expansion f 1 = min f Q(f) f(a)  {1,2} l5l5 l6l6 f 2 = min f Q(f) f(a)  {3,4} f 3 = min f Q(f) f(a)  {5,6} Combine f i using  -Expansion Initialize f 0 = f 1 Repeat At each iteration Choose an f i f t (a) = f t-1 (a) OR f t (a) = f i (a) Optimal move using graph cuts Image Denoising ExpTRWBPOur+ EM Q Time Stereo Reconstruction Scene Registration ExpTRWBPOur+ EM Q Time ExpTRWBPOur+ EM Q Time ExpTRWBPOur+ EM Q Time ExpTRWBPOur+ EM Q Time ExpTRWBPOur+ EM Q Time Learning a Mixture of rHSTs (Hierarchical Clustering ) min max i,k ∑  t d T t (i,k) d(i,k) Refinement (Hard EM) l1l1 l3l3 l4l4 l2l2 l3l3 l1l1 l4l4 l1l1 l3l3 l4l4 Permutation π Cluster C j Cluster C j+1 Root  1 cluster Choose random π For l i in cluster C j Find first l k in π s.t. d(i,k) ≤ T Decrease T by r Repeat Fakcharoenphol et al., 2000 Derandomization Boosting-style descent y ik = Residual min ∑y ik d T (i,k) Update y ik. Repeat. Bounds For  =1, O(log H) For  1, O((  log H) 2 ) Initial labeling f y ik : contribution of (i,k) to current labeling min ∑y ik d T (i,k) New labeling f’ Approximate E and M y ik = ∑w ab [f(a)=i][f(b)=k] Bound of 1 for unary potentials, 2r/(r-1) for pairwise potentials l1l1 l2l2 l3l3 l4l4 A A BB CC Mathematical Induction True for children vava vbvb Unary potential bound follows from  -Expansion Bound = 1 vava vbvb vava vbvb Bound = 2d max /d min = 2r/(r-1) Clean up an image with noise and missing data Find correspondence between two epipolar corrected images of a scene Find correspondence between two scenes with common elements (building, fire) QExpSwapTRWBPRSwpRExpOur+EM T-L T-L rHST Met SMet Synthetic Experiments 100 randomly generated 4-connected grid graphs of size 100x100 TimeExpSwapTRWBPRSwpRExpOur+EM T-L T-L rHST Met SMet