Fine-Grained Complexity Analysis of Improving Traveling Salesman Tours

Slides:



Advertisements
Similar presentations
Bart Jansen 1.  Problem definition  Instance: Connected graph G, positive integer k  Question: Is there a spanning tree for G with at least k leaves?
Advertisements

22C:19 Discrete Math Graphs Fall 2010 Sukumar Ghosh.
Carthagène A brief introduction to combinatorial optimization: The Traveling Salesman Problem Simon de Givry.
Carthagène A brief introduction to combinatorial optimization: The Traveling Salesman Problem Simon de Givry Thales Research & Technology, France (minor.
22C:19 Discrete Math Graphs Fall 2014 Sukumar Ghosh.
Neural and Evolutionary Computing - Lecture 4 1 Random Search Algorithms. Simulated Annealing Motivation Simple Random Search Algorithms Simulated Annealing.
Lecture 24 Coping with NPC and Unsolvable problems. When a problem is unsolvable, that's generally very bad news: it means there is no general algorithm.
Bart Jansen, Utrecht University. 2  Max Leaf  Instance: Connected graph G, positive integer k  Question: Is there a spanning tree for G with at least.
A Parallel GPU Version of the Traveling Salesman Problem Molly A. O’Neil, Dan Tamir, and Martin Burtscher* Department of Computer Science.
Bart Jansen, Utrecht University. 2  Max Leaf  Instance: Connected graph G, positive integer k  Question: Is there a spanning tree for G with at least.
S. J. Shyu Chap. 1 Introduction 1 The Design and Analysis of Algorithms Chapter 1 Introduction S. J. Shyu.
Combinatorial Algorithms
Ant colonies for the traveling salesman problem Eliran Natan Seminar in Bioinformatics (236818) – Spring 2013 Computer Science Department Technion - Israel.
Computability and Complexity 23-1 Computability and Complexity Andrei Bulatov Search and Optimization.
© 2006 Pearson Addison-Wesley. All rights reserved14 A-1 Chapter 14 Graphs.
MAE 552 – Heuristic Optimization Lecture 27 April 3, 2002
Travelling Salesman Problem an unfinished story...
Hypercubes and Neural Networks bill wolfe 10/23/2005.
ECE669 L10: Graph Applications March 2, 2004 ECE 669 Parallel Computer Architecture Lecture 10 Graph Applications.
Traveling Salesman Problem Continued. Heuristic 1 Ideas? –Go from depot to nearest delivery –Then to delivery closest to that –And so on until we are.
22C:19 Discrete Math Graphs Spring 2014 Sukumar Ghosh.
Ch. 11: Optimization and Search Stephen Marsland, Machine Learning: An Algorithmic Perspective. CRC 2009 some slides from Stephen Marsland, some images.
Ant Colony Optimization: an introduction
Metaheuristics The idea: search the solution space directly. No math models, only a set of algorithmic steps, iterative method. Find a feasible solution.
Escaping local optimas Accept nonimproving neighbors – Tabu search and simulated annealing Iterating with different initial solutions – Multistart local.
Programming & Data Structures
Hon Wai Leong, NUS (CS6234, Spring 2009) Page 1 Copyright © 2009 by Leong Hon Wai CS6234 Lecture 1 -- (14-Jan-09) “Introduction”  Combinatorial Optimization.
Genetic Algorithms and Ant Colony Optimisation
The Traveling Salesperson Problem Algorithms and Networks.
Complexity Classes (Ch. 34) The class P: class of problems that can be solved in time that is polynomial in the size of the input, n. if input size is.
Representing and Using Graphs
Online Algorithms By: Sean Keith. An online algorithm is an algorithm that receives its input over time, where knowledge of the entire input is not available.
Discrete optimization of trusses using ant colony metaphor Saurabh Samdani, Vinay Belambe, B.Tech Students, Indian Institute Of Technology Guwahati, Guwahati.
Thursday, May 9 Heuristic Search: methods for solving difficult optimization problems Handouts: Lecture Notes See the introduction to the paper.
CSE 589 Part VI. Reading Skiena, Sections 5.5 and 6.8 CLR, chapter 37.
Traveling Salesman Problem (TSP)
Presenter: Leo, Shih-Chang, Lin Advisor: Frank, Yeong-Sung, Lin /12/16.
Ramakrishna Lecture#2 CAD for VLSI Ramakrishna
Genetic Algorithms and TSP Thomas Jefferson Computer Research Project by Karl Leswing.
Management Science 461 Lecture 7 – Routing (TSP) October 28, 2008.
Discrete Optimization MA2827 Fondements de l’optimisation discrète Approximate methods: local search Material based.
Brute Force II.
Excursions in Modern Mathematics Sixth Edition
School of Computer Science & Engineering
EECS 203 Lecture 19 Graphs.
Shortest Path Problems
CS1022 Computer Programming & Principles
Routing Through Networks - 1
Traveling Salesman Problems Motivated by Robot Navigation
Paweł Gawrychowski, Nadav Krasnopolsky, Shay Mozes, Oren Weimann
Chapter 3 Brute Force Copyright © 2007 Pearson Addison-Wesley. All rights reserved.
EECS 203 Lecture 20 More Graphs.
Maximum Flow - Best algorithms
Spanning Trees Lecture 21 CS2110 – Fall 2016.
Subject Name: Operation Research Subject Code: 10CS661 Prepared By:Mrs
Comparing Genetic Algorithm and Guided Local Search Methods
Analysis and design of algorithm
Study Guide for ES205 Yu-Chi Ho Jonathan T. Lee Nov. 7, 2000
Bart M. P. Jansen June 3rd 2016, Algorithms for Optimization Problems
Genome Assembly.
REDUCESEARCH Polynomial Kernels for Hitting Forbidden Minors under Structural Parameterizations Bart M. P. Jansen Astrid Pieterse ESA 2018 August.
CS 581 Tandy Warnow.
Approximation Algorithms
Design & Analysis of Algorithms Combinatorial optimization
3. Brute Force Selection sort Brute-Force string matching
traveling salesman problem
3. Brute Force Selection sort Brute-Force string matching
More advanced aspects of search
Hamiltonicity below Dirac’s condition
3. Brute Force Selection sort Brute-Force string matching
Presentation transcript:

Fine-Grained Complexity Analysis of Improving Traveling Salesman Tours Mark T. de Berg Kevin A. Buchin Bart M. P. Jansen Gerhard J. Woeginger October 31st 2017, Asperen, The Netherlands Networks training week

The Traveling Salesman Problem Find a tour among 𝑛 cities visiting each city exactly once while minimizing the total travel distance Classic problem with an extensive history The lens of fine-grained analysis uncovers new insights! We focus on the symmetric problem on graphs 𝑑 𝑢,𝑣 =𝑑(𝑣,𝑢) fine-grained

Background of TSP © xkcd.com

Local search heuristics for TSP A popular way to deal with TSP in practice is using local search Explore the local neighborhood of the current tour 𝑇 The 2-opt neighborhood is often used Consists of tours obtained from 𝑇 by replacing 2 edges As mentioned by Claire Mathieu on Friday.

General 𝑘-opt neighborhood The 𝑘-opt neighborhood of tour 𝑇 contains: Tours obtained from 𝑇 by replacing at most 𝑘 edges Removing 𝑘 edges splits a tour into 𝑘 paths For 𝑘≥3, there are multiple ways to reconnect the tour

Analysis of local search for TSP Many aspects to analyze: How many iterations until convergence? How far are local optima from global optima? How much time is needed for a single iteration?

Two computational problems about 𝑘-opt 𝒌-opt detection Input: A tour 𝑇 in a weighted complete graph 𝐺 Question: Is there a 𝑘-opt move that decreases the cost? 𝒌-opt optimization Input: A tour 𝑇 in a weighted complete graph 𝐺 Task: Find the best tour in the 𝑘-opt neighborhood of 𝑇

Complexity of 𝑘-opt detection / optimization For fixed 𝑘 there is an 𝑂( 𝑛 𝑘 ) algorithm for 𝑘-opt optimization Try all 𝑛 𝑘 possibilities for 𝑘 edges 𝑋 that leave the tour Try all 𝑓(𝑘) different ways to reconnect into a tour Motivating question: What is the exact complexity of detecting whether a given tour can be improved by a 𝑘-opt move, for small 𝑘?

Our results for 𝑘-opt 2-opt detection requires Ω 𝑛 2 time 3-opt detection is unlikely to have a truly subcubic algorithm Could Θ( 𝑛 𝑘 ) be the right complexity for all 𝑘? Theorem. 3-opt detection solvable in 𝑂( 𝑛 3−𝜀 ) time for some 𝜀>0 ⇔ All pairs shortest paths solvable in 𝑂( 𝑛 3−𝛿 ) time for some 𝛿>0 2-opt: easy adversarial argument; must read the entire input.

Exhaustive search can be avoided for 𝑘≥4 For all 𝑘≥4 we can do better than Θ(𝑛 𝑘 ) Best 𝑘-opt move can be found in time 𝑂( 𝑛 1+ 2𝑘 3 ) Based on an analysis of the structure of 𝑘-opt moves Theorem. 4-opt optimization can be solved in Θ 𝑛 3 time

The signature of a 𝑘-opt move Consider a 𝑘-opt move that removes edges 𝑋 and inserts 𝑌 The signature of the 𝑘-opt move is defined as follows: Take the symmetric difference 𝑋Δ𝑌, contract all edges of 𝑋 For each endpoint of each replacement edge 𝑦, store if it attaches to 1st or 2nd endpoint of 𝑥 in this orientation 1st 2nd 1st 2nd Fix starting point and orientation so that we can talk about the 1st, 2nd, 3rd and 4th deleted edges. Starting point 1st 2nd 2nd 1st

Signatures of 4-opt moves

Signatures of 4-opt moves

Signatures of 4-opt moves Main insight: For each type of signature, best move with that signature can be found in time 𝑂 𝑛 2+1 by exploiting signature of the move

𝑂( 𝑛 3 ) algorithm for simple 4-opt signature 1 2 Find best 4-opt for this signature: Try all realizations for leaving edges 1&3 For each of the Θ 𝑛 2 options: Find best realization for 2 and 4 Yields 2 independent 𝑂(𝑛)-time problems

THANK YOU! Conclusion Open problems: Subcubic equivalence 3-opt detection ⇔ All Pairs Shortest P. For 𝑘≥4, we can improve upon exhaustive search for 𝑘-opt Recent improvement: 5-opt in 𝑂 𝑛 3.4 time [Cygan et al.] Is 𝑘-opt detection fixed-parameter tractable: in planar graphs? for finding tours among points in the plane? Open problems: Applications of random-restart hill-climbing for TSP? THANK YOU!