1 Enclosing Ellipsoids of Semi-algebraic Sets and Error Bounds in Polynomial Optimization Makoto Yamashita Masakazu Kojima Tokyo Institute of Technology.

Slides:



Advertisements
Similar presentations
Consistent Bipartite Graph Co-Partitioning for High-Order Heterogeneous Co-Clustering Tie-Yan Liu WSM Group, Microsoft Research Asia Joint work.
Advertisements

Optimizing and Learning for Super-resolution
MS&E 211 Quadratic Programming Ashish Goel. A simple quadratic program Minimize (x 1 ) 2 Subject to: -x 1 + x 2 ≥ 3 -x 1 – x 2 ≥ -2.
CSE 681 Bounding Volumes. CSE 681 Bounding Volumes Use simple volume enclose object(s) tradeoff for rays where there is extra intersection test for object.
The Stability of a Good Clustering Marina Meila University of Washington
Globally Optimal Estimates for Geometric Reconstruction Problems Tom Gilat, Adi Lakritz Advanced Topics in Computer Vision Seminar Faculty of Mathematics.
P. Venkataraman Mechanical Engineering P. Venkataraman Rochester Institute of Technology DETC2014 – 35148: Continuous Solution for Boundary Value Problems.
Sum of Squares and SemiDefinite Programmming Relaxations of Polynomial Optimization Problems The 2006 IEICE Society Conference Kanazawa, September 21,
Convex Position Estimation in Wireless Sensor Networks
SE- 521: Nonlinear Programming and Applications S. O. Duffuaa.
Graph Laplacian Regularization for Large-Scale Semidefinite Programming Kilian Weinberger et al. NIPS 2006 presented by Aggeliki Tsoli.
Easy Optimization Problems, Relaxation, Local Processing for a small subset of variables.
Lingwen Gan1, Na Li1, Ufuk Topcu2, Steven Low1
Continuous optimization Problems and successes
Separating Hyperplanes
Javad Lavaei Department of Electrical Engineering Columbia University Graph-Theoretic Algorithm for Nonlinear Power Optimization Problems.
Classification and Prediction: Regression Via Gradient Descent Optimization Bamshad Mobasher DePaul University.
A Randomized Polynomial-Time Simplex Algorithm for Linear Programming Daniel A. Spielman, Yale Joint work with Jonathan Kelner, M.I.T.
Approximation Algoirthms: Semidefinite Programming Lecture 19: Mar 22.
SDPA: Leading-edge Software for SDP Informs ’ 08 Tokyo Institute of Technology Makoto Yamashita Mituhiro Fukuda Masakazu Kojima Kazuhide Nakata.
Support Vector Machines (SVMs) Chapter 5 (Duda et al.)
UMass Lowell Computer Science Analysis of Algorithms Prof. Karen Daniels Fall, 2006 Lecture 9 Wednesday, 11/15/06 Linear Programming.
Jie Gao Joint work with Amitabh Basu*, Joseph Mitchell, Girishkumar Stony Brook Distributed Localization using Noisy Distance and Angle Information.
Semidefinite Programming
1 Introduction to Linear and Integer Programming Lecture 9: Feb 14.
Chapter 1 Introduction The solutions of engineering problems can be obtained using analytical methods or numerical methods. Analytical differentiation.
Chebyshev Estimator Presented by: Orr Srour. References Yonina Eldar, Amir Beck and Marc Teboulle, "A Minimax Chebyshev Estimator for Bounded Error Estimation"
Support Vector Machines Formulation  Solve the quadratic program for some : min s. t.,, denotes where or membership.  Different error functions and measures.
Error Estimation in TV Imaging Martin Burger Institute for Computational and Applied Mathematics European Institute for Molecular Imaging (EIMI) Center.
Online Oblivious Routing Nikhil Bansal, Avrim Blum, Shuchi Chawla & Adam Meyerson Carnegie Mellon University 6/7/2003.
Unconstrained Optimization Problem
UMass Lowell Computer Science Analysis of Algorithms Prof. Karen Daniels Fall, 2008 Lecture 9 Tuesday, 11/18/08 Linear Programming.
Approximation Algorithms: Bristol Summer School 2008 Seffi Naor Computer Science Dept. Technion Haifa, Israel TexPoint fonts used in EMF. Read the TexPoint.
Linear Programming Operations Research – Engineering and Math Management Sciences – Business Goals for this section  Modeling situations in a linear environment.
1 Lecture 4 Maximal Flow Problems Set Covering Problems.
High Performance Solvers for Semidefinite Programs
Computational Geometry Piyush Kumar (Lecture 5: Linear Programming) Welcome to CIS5930.
1 High-Performance Implementation of Positive Matrix Completion for SDPs Makoto Yamashita (Tokyo Institute of Technology) Kazuhide Nakata (Tokyo Institute.
Sparsity in Polynomial Optimization IMA Annual Program Year Workshop "Optimization and Control" Minneapolis, January 16-20, 2007 Masakazu Kojima Tokyo.
1 Mobile-Assisted Localization in Wireless Sensor Networks Nissanka B.Priyantha, Hari Balakrishnan, Eric D. Demaine, Seth Teller IEEE INFOCOM 2005 March.
CSCI 3160 Design and Analysis of Algorithms Chengyu Lin.
On Graphs Supporting Greedy Forwarding for Directional Wireless Networks W. Si, B. Scholz, G. Mao, R. Boreli, et al. University of Western Sydney National.
Energy-Efficient Sensor Network Design Subject to Complete Coverage and Discrimination Constraints Frank Y. S. Lin, P. L. Chiu IM, NTU SECON 2005 Presenter:
Models in I.E. Lectures Introduction to Optimization Models: Shortest Paths.
A New Hybrid Wireless Sensor Network Localization System Ahmed A. Ahmed, Hongchi Shi, and Yi Shang Department of Computer Science University of Missouri-Columbia.
D. M. J. Tax and R. P. W. Duin. Presented by Mihajlo Grbovic Support Vector Data Description.
Javad Lavaei Department of Electrical Engineering Columbia University Convex Relaxation for Polynomial Optimization: Application to Power Systems and Decentralized.
1 Efficient Parallel Software for Large-Scale Semidefinite Programs Makoto Tokyo-Tech Katsuki Chuo University MSC Yokohama.
INFOMRS Charlotte1 Parallel Computation for SDPs Focusing on the Sparsity of Schur Complements Matrices Makoto Tokyo Tech Katsuki Fujisawa.
3D Game Engine Design 1 3D Game Engine Design Ch D MAP LAB.
Introduction to Semidefinite Programs Masakazu Kojima Semidefinite Programming and Its Applications Institute for Mathematical Sciences National University.
Multi-area Nonlinear State Estimation using Distributed Semidefinite Programming Hao Zhu October 15, 2012 Acknowledgements: Prof. G.
Linear Programming Maximize Subject to Worst case polynomial time algorithms for linear programming 1.The ellipsoid algorithm (Khachian, 1979) 2.Interior.
1 Attractive Mathematical Representations Of Decision Problems Warren Adams 11/04/03.
CPS Computational problems, algorithms, runtime, hardness (a ridiculously brief introduction to theoretical computer science) Vincent Conitzer.
1 Ellipsoid-type Confidential Bounds on Semi-algebraic Sets via SDP Relaxation Makoto Yamashita Masakazu Kojima Tokyo Institute of Technology.
1 Parallel Software for SemiDefinite Programming with Sparse Schur Complement Matrix Makoto Tokyo-Tech Katsuki Chuo University Mituhiro.
Computational Intelligence: Methods and Applications Lecture 24 SVM in the non-linear case Włodzisław Duch Dept. of Informatics, UMK Google: W Duch.
Forward and Backward Deviation Measures and Robust Optimization Peng Sun (Duke) with Xin Chen (UIUC) and Melvyn Sim (NUS)
National Taiwan University Department of Computer Science and Information Engineering An Approximation Algorithm for Haplotype Inference by Maximum Parsimony.
1 Chapter 5 Branch-and-bound Framework and Its Applications.
1 An approach based on shortest path and connectivity consistency for sensor network localization problems Makoto Yamashita (Tokyo Institute of Technology)
Core-Sets and Geometric Optimization problems.
Tatsuie Tsukiji (speaker) Tokyo Denki University
Georgina Hall Princeton, ORFE Joint work with Amir Ali Ahmadi
Nonnegative polynomials and applications to learning
Polynomial DC decompositions
SOS is not obviously automatizable,
Compute convex lower bounding function and optimize it instead!
Danny Z. Chen1, Yan Gu2, Jian Li2, and Haitao Wang1
Presentation transcript:

1 Enclosing Ellipsoids of Semi-algebraic Sets and Error Bounds in Polynomial Optimization Makoto Yamashita Masakazu Kojima Tokyo Institute of Technology

2 Motivation from Sensor Network Localization Problem  If positions are known, computing distances is easy  Reverse is difficult  To obtain the positions of sensors, we need to solve Anchor Sensors

3 SDP relaxation (by Biswas&Ye,2004) Lifting SDP Relaxation determines locations uniquely under some condition. Edge sets

4 Region of solutions  SNL sometimes has multiple solutions  Interior-Point Methods generate a center point  We estimate the regions of solutions by SDP ’3’ 3 mirroring

5 Example of SNL 1.Input network 2.SDP solution 3.Ellipsoids difficult sensors Difference of true location and SDP solution solved by SFSDP (Kim et al, 2008) with SDPA 7 (Yamashita et al, 2009)

6 General concept in Polynomial Optimization Problem min Optimal SDP relaxation (convex region) SDP solution Local adjustment for feasible region Optimal solutions exist in this ellipsoid. We compute this ellipsoid by SDP. Feasible region Semi-algebraic Sets (Polynomials)

7 Ellipsoid research ..  MVEE (the minimum volume enclosing ellipsoid)  Our approach by SDP relaxation Solvable by SDP Small computation cost ⇒ We can execute multiple times changing

8 Mathematical Formulation .  Ellipsoid with  We want to compute By some steps, we consider SDP relaxation

9 Lifting .  Note that  Furthermore ⇒ quadratic linear (easier) Still difficult (convex hull)

10 SDP relaxation .... relaxation

11 .. ..  Gradient  Optimal attained at ..  Cover Inner minimization

12 Relations of

13 Numerical Results on SNL  We solve for each sensor by  Each SDP is solved quickly. #anchor = 4, #sensor = 100, #edge = second for each (65 seconds for 100 sensors) #anchor = 4, #sensor = 500, #edge = second for each (2806 seconds for 500 sensors) SFSDP & SDPA on Xeon 5365(3.0GHz, 48GB) Sparsity technique is very important

14 Results (#sensor = 100)

15 Diff v.s. Radius Ellipsoids cover true locations

16 More edges case If SDP solution is good, radius is very small.

17 Example from POP  ex9_1_2 from GLOBAL library (  We use SparsePOP to solve this by SDP relaxation SparsePOP

18 Region of the Solution

19 Reduced POP Optimal Solutions:

20 Ellipsoids for Reduced SDP Optimal Solutions: Very tight bound

21 Results on POP  Very good objective values  ex_9_1_2 & ex_9_1_8 have multiple optimal solutions ⇒ large radius

22 Conclusion & Future works  An enclosing ellipsoid by SDP relaxation Bound the locations of sensors Improve the SDP solution of POP Very low computation cost  Ellipsoid becomes larger for unconnected sensors  Successive ellipsoid for POP sometimes stops before bounding the region appropriately

23 This talk is based on the following technical paper Masakazu Kojima and Makoto Yamashita, “ Enclosing Ellipsoids and Elliptic Cylinders of Semialgebraic Sets and Their Application to Error Boundsin Polynomial Optimization ”, Research Report B-459, Dept. of Math. and Comp. Sciences,Tokyo Institute of Technology, Oh-Okayama, Meguro, Tokyo ,January 2010.

24 SDP Formulation .. SDP (SOCP) SNL is one of such cases.