1 Local Restarts in SAT Solvers Vadim Ryvchin and Ofer Strichman Technion, Haifa, Israel.

Slides:



Advertisements
Similar presentations
Hybrid BDD and All-SAT Method for Model Checking Orna Grumberg Joint work with Assaf Schuster and Avi Yadgar Technion – Israel Institute of Technology.
Advertisements

Satisfiability Modulo Theories (An introduction)
Frequent Closed Pattern Search By Row and Feature Enumeration
Daniel Kroening and Ofer Strichman 1 Decision Procedures An Algorithmic Point of View SAT.
1/30 SAT Solver Changki PSWLAB SAT Solver Daniel Kroening, Ofer Strichman.
IBM Labs in Haifa © 2005 IBM Corporation Adaptive Application of SAT Solving Techniques Ohad Shacham and Karen Yorav Presented by Sharon Barner.
On the Potential of Automated Algorithm Configuration Frank Hutter, University of British Columbia, Vancouver, Canada. Motivation for automated tuning.
B ACKTRACK SEARCH ALGORITHM. B ACKTRACKING Suppose you have to make a series of decisions, among various choices, where You don’t have enough information.
ULTIMATELY INCREMENTAL SAT Alexander Nadel 1, Vadim Ryvchin 1,2, and Ofer Strichman 2 1 – Intel, Haifa, Israel 2 – Technion, Haifa, Israel SAT’14, Vienna,
Online Performance Auditing Using Hot Optimizations Without Getting Burned Jeremy Lau (UCSD, IBM) Matthew Arnold (IBM) Michael Hind (IBM) Brad Calder (UCSD)
Hrinking hrinking A signment tack tack. Agenda Introduction Algorithm Description Heuristics Experimental Results Conclusions.
Constraint Systems Laboratory Oct 21, 2004Guddeti: MS thesis defense1 An Improved Restart Strategy for Randomized Backtrack Search Venkata P. Guddeti Constraint.
CP Formal Models of Heavy-Tailed Behavior in Combinatorial Search Hubie Chen, Carla P. Gomes, and Bart Selman
On-The-Fly Resolve Trace Minimization Ohad Shacham and Karen Yorav IBM Haifa Research Laboratory.
Reinforcement Learning Rafy Michaeli Assaf Naor Supervisor: Yaakov Engel Visit project’s home page at: FOR.
Solvable problem Deviation from best known solution [%] Percentage of test runs ERA RDGR RGR LS Over-constrained.
SAT-Based Decision Procedures for Subsets of First-Order Logic
1 Satisfiability Checking of Non-clausal Formulas using General Matings Himanshu Jain Constantinos Bartzis Edmund Clarke Carnegie Mellon University.
1 Linear-time Reductions of Resolution Proofs Omer Bar-Ilan Oded Fuhrmann Shlomo Hoory Ohad Shacham Ofer Strichman Technion.
State-of-the-art in SAT solvers
Efficient Reachability Checking using Sequential SAT G. Parthasarathy, M. K. Iyer, K.-T.Cheng, Li. C. Wang Department of ECE University of California –
1 A theory-based decision heuristic for DPLL(T) Dan Goldwasser Ofer Strichman Shai Fine Haifa university TechnionIBM-HRL.
Identifying Conflicts in Overconstrained Temporal Problems Mark H. Liffiton, Michael D. Moffitt, Martha E. Pollack, and Karem A. Sakallah University of.
8-1 Problem-Solving Examples (Preemptive Case). 8-2 Outline Preemptive job-shop scheduling problem (P-JSSP) –Problem definition –Basic search procedure.
A Probabilistic Method to Determine the Minimum Leakage Vector for Combinational Designs Kanupriya Gulati Nikhil Jayakumar Sunil P. Khatri Department of.
1 Abstraction Refinement for Bounded Model Checking Anubhav Gupta, CMU Ofer Strichman, Technion Highly Jet Lagged.
SAT Solving Presented by Avi Yadgar. The SAT Problem Given a Boolean formula, look for assignment A for such that.  A is a solution for. A partial assignment.
Penn ESE 535 Spring DeHon 1 ESE535: Electronic Design Automation Day 21: April 21, 2008 Modern SAT Solvers ({z}Chaff, GRASP,miniSAT)
1 Linear-time Reductions of Resolution Proofs Omer Bar-Ilan Oded Fuhrmann Shlomo Hoory Ohad Shacham Ofer Strichman Technion.
Optimization and Relaxation in SAT Search Sharad Malik Princeton University Symposium on Satisfiability Solvers and Program Verification (SSPV) Seattle.
Boolean Satisfiability and SAT Solvers
CMU, Oct 4 DPLL-based Checkers for Satisfiability Modulo Theories Cesare Tinelli Department of Computer Science The University of Iowa Joint work with.
1 Agenda Modeling problems in Propositional Logic SAT basics Decision heuristics Non-chronological Backtracking Learning with Conflict Clauses SAT and.
Parallelizing MiniSat I-Ting Angelina Lee Justin Zhang May 05, Final Project Presentation.
Combination of Exact and Approximate Methods for SAT and MAX-SAT Problems Frédéric Lardeux, Frédéric Saubion and Jin-Kao Hao Metaheuristics and Combinatorial.
Local Search Pat Riddle 2012 Semester 2 Patricia J Riddle Adapted from slides by Stuart Russell,
Reactive Tabu Search Contents A brief review of search techniques
SAT 2009 Ashish Sabharwal Backdoors in the Context of Learning (short paper) Bistra Dilkina, Carla P. Gomes, Ashish Sabharwal Cornell University SAT-09.
Efficient SAT Solving Under Assumptions Alexander Nadel 1 and Vadim Ryvchin 1,2 1 – Intel, Haifa, Israel 2 – Technion, Haifa, Israel SAT’12, Trento, Italy.
Preprocessing in Incremental SAT Alexander Nadel 1, Vadim Ryvchin 1,2, and Ofer Strichman 2 1 – Intel, Haifa, Israel 2 – Technion, Haifa, Israel SAT’12,
Heuristics for Efficient SAT Solving As implemented in GRASP, Chaff and GSAT.
Custom Computing Machines for the Set Covering Problem Paper Written By: Christian Plessl and Marco Platzner Swiss Federal Institute of Technology, 2002.
Tommy Messelis * Stefaan Haspeslagh Burak Bilgin Patrick De Causmaecker Greet Vanden Berghe *
A Decision-Making Procedure for Resolution-Based SAT-solvers Eugene Goldberg Cadence Research Labs (USA) SAT-2008, Guangzhou, P.R. China.
Ch. Eick: Randomized Hill Climbing Techniques Randomized Hill Climbing Neighborhood Hill Climbing: Sample p points randomly in the neighborhood of the.
REU 2007-ParSat: A Parallel SAT Solver Christopher Earl, Mentor: Dr. Hao Zheng Department of Computer Science & Engineering Introduction Results and Conclusions.
Bit-Vector Optimization ALEXANDER NADER AND VADIM RYVCHIN INTEL TACAS 2016.
CS137: Electronic Design Automation
Hybrid BDD and All-SAT Method for Model Checking
Knot Pipatsrisawat and Adnan Darwiche Computer Science Department UCLA
On the Power of Clause-Learning SAT Solvers with Restarts
Parallelism in SAT Solvers
SAT’07 Conference, Lisbon;
A theory-based decision heuristic for DPLL(T)
Simple Circuit-Based SAT Solver
Watched Literals and Restarts in MiniSAT
Mining backbone literals in incremental SAT
Extending BUNGEE Elasticity Benchmark for Multi-Tier Cloud Applications - Talk - André Bauer.
Randomized Hill Climbing
Randomized Hill Climbing
Constraint Programming and Backtracking Search Algorithms
Improvements to Combinational Equivalence Checking
Decision Procedures An Algorithmic Point of View
A Progressive Approach for Satisfiability Modulo Theories
Efficient MUS Extraction with Resolution
Constraints and Search
Watched Literals and Restarts in MiniSAT
Decision heuristics based on an Abstraction/Refinement model
Area Coverage Problem Optimization by (local) Search
Faster Extraction of High-Level Minimal Unsatisfiable Cores
Presentation transcript:

1 Local Restarts in SAT Solvers Vadim Ryvchin and Ofer Strichman Technion, Haifa, Israel

2 Restarts  SAT solvers use a "restart" policy Following various criteria, the solver is forced to backtrack to level 0.  Restarts have crucial impact on performance.  Motivation: avoid spending too much time in ‘bad’ branches: no easy-to-find satisfying assignment no opportunity for fast learning of strong clauses.

3 Restarts Motivation  Best time to restart: When algorithm spends too much time under a “wrong” branch No solution Perform restart solution decision level k decision level 1 decision level 0

4 The basic measure for restarts  All existing techniques use the number of conflicts learned as of the previous restart.  The difference is only in the method of calculating the threshold.

5 Restarts strategies 1.Arithmetic (or fixed) series. Parameters: x, y. Init(t) = x Next(t)=t+y  Used in: Berkmin (550, 0) Eureka (2000, 0) Zchaff 2004 (700, 0) Siege (16000, 0)

6 Restarts Strategies (cont.) 2.Geometric series. Parameters: x, y. Init(t) = x Next(t)=t*y  Used in Minisat 2007 (100, 1.5)

7 Restarts Strategies (cont.) 3.Inner-Outer Geometric series. Parameters: x, y, z. Init(t) = x if (t*y < z) - Next(t) = t*y else - Next(t) = x - Next(z) = z*y  Used in: Picosat (100, 1.1, 1000)

8 Restarts Strategies (cont.) 4.Luby et al. series. Parameter: x. Init(t) = x Next(t) = t i *x  Used in: RSat (512) Tinisat (512) t i = …

9 Global vs. Local  Recall: all techniques measure the number of conflicts as of the previous restart.  This is a global criterion.  Somewhat disregards the original motivation of focusing on ‘bad’ branches.  Local criteria: measure difficulty of branches.

10 Global Restarts Perform restart Explored sub tree No solution solution No solution solution decision level k decision level 1 decision level 0

11 Local Restarts Perform restart Explored sub tree No solution solution decision level k decision level 1 decision level 0

12 Calculating the number of conflicts under a branch  We worked with the following local measure: Number of conflicts above each level.  For each decision level d maintain a counter c(d): When making a decision at level d, - c(d) = #global conflicts. When backtracking to level d: - res = #global conflicts - c(d). If res > threshold, restart.  All the presented strategies can be local.

13 Dynamic Criteria  A new dimension for the restart strategy: the decision level d. The restart threshold is a function of d.  Higher decision level  smaller threshold.  Each of the local strategies can be made dynamic.

14 Dynamic Criteria  Dynamic-fix. d – decision level, i – iteration Parameters: x, y, c. Init(t) = x Next(t) = x + y * i – (c * d) min Constant Need a minimum !

15 Dynamic Criteria  Dynamic-fix. d – decision level, i – iteration Parameters: x, y, c, min > 0. Init(t) = x Next(t) = max(x + y * i – (c * d), min) min Constant Not a restart number

16 Experimental Results  Solvers: Minisat 2007 and Eureka  Benchmarks: 100 instances from SAT-race 2006 (the TS1,TS2 test sets).  Timeout: 30 minutes. Instances that timed-out are included and contribute 30 minutes  Restart configurations: 40 Chosen dynamically following ‘hill climbing’ Looked also for best parameters for global restarts

Experimental Results - Minisat Restart Strategy LocalGlobalSpeedup Arithmetic x1.16 Geometric x1.11 Inner-Outer x1.2 Luby x1.13 Original vs. Best Local x1.44

Experimental Results (fails) – Minisat Restart Strategy LocalGlobalimprovement Arithmetic10 1 Geometric1114x1.27 Inner-Outer810x1.25 Luby911x1.22 Original vs. Best Local 814x1.75

19 Dynamic Restart  Unsat improvement: x1.19 speedup (4.09h vs. 4.90h) x1.75 in unsolved instances (4 vs. 7). Zoom in

20 Dynamic Restart  Unsat improvement: x1.19 speedup (4.09h vs. 4.90h) x1.75 in unsolved instances (4 vs. 7).

21 Conclusions  Conclusion: Making restarts local helps all restarts strategies. Improves average run time - ~ x1.44 in Minisat - ~ x1.17 in Eureka Improves fails (timeout = 30 min) by - ~ x1.75 in Minisat - ~ x1.27 in Eureka