LECTURE 19. Course: “Design of Systems: Structural Approach” Dept. “Communication Networks &Systems”, Faculty of Radioengineering & Cybernetics Moscow.

Slides:



Advertisements
Similar presentations
Problems and Their Classes
Advertisements

Multi‑Criteria Decision Making
1 NP-Complete Problems. 2 We discuss some hard problems:  how hard? (computational complexity)  what makes them hard?  any solutions? Definitions 
Lecture 12: Revision Lecture Dr John Levine Algorithms and Complexity March 27th 2006.
5-1 Chapter 5 Tree Searching Strategies. 5-2 Satisfiability problem Tree representation of 8 assignments. If there are n variables x 1, x 2, …,x n, then.
LECTURE 31. Course: “Design of Systems: Structural Approach” Dept. “Communication Networks &Systems”, Faculty of Radioengineering & Cybernetics Moscow.
S. J. Shyu Chap. 1 Introduction 1 The Design and Analysis of Algorithms Chapter 1 Introduction S. J. Shyu.
Discrete Optimization Shi-Chung Chang. Discrete Optimization Lecture #1 Today: Reading Assignments 1.Chapter 1 and the Appendix of [Pas82] 2.Chapter 1.
© 2005 Prentice Hall6-1 Stumpf and Teague Object-Oriented Systems Analysis and Design with UML.
Channel Assignment using Chaotic Simulated Annealing Enhanced Neural Network Channel Assignment using Chaotic Simulated Annealing Enhanced Hopfield Neural.
Introduction to Approximation Algorithms Lecture 12: Mar 1.
COURSE “SYSTEM DESIGN: STRUCTURAL APPROACH” DETC Inst. for Information Transmission Problems Russian Academy of Sciences, Moscow , Russia.
Reporter : Mac Date : Multi-Start Method Rafael Marti.
Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin Company, for the United States Department of Energy under contract.
Chapter 11: Limitations of Algorithmic Power
Multiagent Planning with Factored MDPs Carlos Guestrin Daphne Koller Stanford University Ronald Parr Duke University.
5-1 Chapter 5 Tree Searching Strategies. 5-2 Breadth-first search (BFS) 8-puzzle problem The breadth-first search uses a queue to hold all expanded nodes.
Rule Induction with Extension Matrices Leslie Damon, based on slides by Yuen F. Helbig Dr. Xindong Wu, 1998.
1 Enviromatics Decision support systems Decision support systems Вонр. проф. д-р Александар Маркоски Технички факултет – Битола 2008 год.
LECTURE 1. Course: “Design of Systems: Structural Approach” Dept. “Communication Networks &Systems”, Faculty of Radioengineering & Cybernetics Moscow Inst.
LECTURE 29. Course: “Design of Systems: Structural Approach” Dept. “Communication Networks &Systems”, Faculty of Radioengineering & Cybernetics Moscow.
Metaheuristics Meta- Greek word for upper level methods
Osyczka Andrzej Krenich Stanislaw Habel Jacek Department of Mechanical Engineering, Cracow University of Technology, Krakow, Al. Jana Pawla II 37,
LECTURE 5-6. Course: “Design of Systems: Structural Approach” Dept. “Communication Networks &Systems”, Faculty of Radioengineering & Cybernetics Moscow.
Linear Programming Models Tran Van Hoai Faculty of Computer Science & Engineering HCMC University of Technology Tran Van Hoai.
Computational Complexity Polynomial time O(n k ) input size n, k constant Tractable problems solvable in polynomial time(Opposite Intractable) Ex: sorting,
LECTURE 30 (compressed version). Course: “Design of Systems: Structural Approach” Dept. “Communication Networks &Systems”, Faculty of Radioengineering.
LECTURE 28. Course: “Design of Systems: Structural Approach” Dept. “Communication Networks &Systems”, Faculty of Radioengineering & Cybernetics Moscow.
Optimal Scheduling of File Transfers with Divisible Sizes on Multiple Disjoint Paths Mugurel Ionut Andreica Polytechnic University of Bucharest Computer.
MODULAR SYSTEMS & COMBINATORIAL OPTIMIZATION (based on course “System design”, 2004…2008, MIPT) Mark Sh. Levin Inst. for Inform. Transmission Problems,
LECTURE 8-9. Course: “Design of Systems: Structural Approach” Dept. “Communication Networks &Systems”, Faculty of Radioengineering & Cybernetics Moscow.
Introduction to Job Shop Scheduling Problem Qianjun Xu Oct. 30, 2001.
LECTURE (compressed version). Course: “Design of Systems: Structural Approach” Dept. “Communication Networks &Systems”, Faculty of Radioengineering.
TOWARDS HIERARCHICAL CLUSTERING
TECH Computer Science NP-Complete Problems Problems  Abstract Problems  Decision Problem, Optimal value, Optimal solution  Encodings  //Data Structure.
LECTURE Course: “Design of Systems: Structural Approach” Dept. “Communication Networks &Systems”, Faculty of Radioengineering & Cybernetics Moscow.
Heuristic Optimization Methods Tabu Search: Advanced Topics.
LECTURE 13. Course: “Design of Systems: Structural Approach” Dept. “Communication Networks &Systems”, Faculty of Radioengineering & Cybernetics Moscow.
1 Lower Bounds Lower bound: an estimate on a minimum amount of work needed to solve a given problem Examples: b number of comparisons needed to find the.
LECTURE 26. Course: “Design of Systems: Structural Approach” Dept. “Communication Networks &Systems”, Faculty of Radioengineering & Cybernetics Moscow.
EMIS 8373: Integer Programming NP-Complete Problems updated 21 April 2009.
Towards Communication Network Development (structural systems issues, combinatorial models) Mark Sh. Levin Inst. for Inform. Transmission Problems, Russian.
Chapter 1. Formulations 1. Integer Programming  Mixed Integer Optimization Problem (or (Linear) Mixed Integer Program, MIP) min c’x + d’y Ax +
LECTURE 4. Course: “Design of Systems: Structural Approach” Dept. “Communication Networks &Systems”, Faculty of Radioengineering & Cybernetics Moscow Inst.
Discrete Optimization Lecture #2 2008/2/271Shi-Chung Chang, NTUEE, GIIE, GICE Last Time 1.Course Overview » A taxonomy of optimization problems » Course.
LECTURE 16. Course: “Design of Systems: Structural Approach” Dept. “Communication Networks &Systems”, Faculty of Radioengineering & Cybernetics Moscow.
§1.4 Algorithms and complexity For a given (optimization) problem, Questions: 1)how hard is the problem. 2)does there exist an efficient solution algorithm?
STUDENT RESEARCH PROJECTS IN SYSTEM DESIGN Inst. for Information Transmission Problems Russian Academy of Sciences, Moscow , Russia
LECTURE Course: “Design of Systems: Structural Approach” Dept. “Communication Networks &Systems”, Faculty of Radioengineering & Cybernetics Moscow.
LECTURE 2-3. Course: “Design of Systems: Structural Approach” Dept. “Communication Networks &Systems”, Faculty of Radioengineering & Cybernetics Moscow.
Implicit Hitting Set Problems Richard M. Karp Erick Moreno Centeno DIMACS 20 th Anniversary.
1 Attractive Mathematical Representations Of Decision Problems Warren Adams 11/04/03.
LECTURE 10. Course: “Design of Systems: Structural Approach” Dept. “Communication Networks &Systems”, Faculty of Radioengineering & Cybernetics Moscow.
Design and Analysis of Algorithms (09 Credits / 5 hours per week) Sixth Semester: Computer Science & Engineering M.B.Chandak
Towards Morphological System Design Inst. for Information Transmission Problems Russian Academy of Sciences
LECTURE 27. Course: “Design of Systems: Structural Approach” Dept. “Communication Networks &Systems”, Faculty of Radioengineering & Cybernetics Moscow.
LECTURE Course: “Design of Systems: Structural Approach” Dept. “Communication Networks &Systems”, Faculty of Radioengineering & Cybernetics Moscow.
Algorithms for hard problems Introduction Juris Viksna, 2015.
LECTURE 7. Course: “Design of Systems: Structural Approach” Dept. “Communication Networks &Systems”, Faculty of Radioengineering & Cybernetics Moscow Inst.
© P. Pongcharoen CCSI/1 Scheduling Complex Products using Genetic Algorithms with Alternative Fitness Functions P. Pongcharoen, C. Hicks, P.M. Braiden.
COSC 3101A - Design and Analysis of Algorithms 14 NP-Completeness.
Exhaustive search Exhaustive search is simply a brute- force approach to combinatorial problems. It suggests generating each and every element of the problem.
Conceptual Foundations © 2008 Pearson Education Australia Lecture slides for this course are based on teaching materials provided/referred by: (1) Statistics.
TOWARDS FOUR-LAYER FRAMEWORK OF COMBINATORIAL PROBLEMS
Hard Problems Some problems are hard to solve.
Splash Screen.
Objective of This Course
Metaheuristic methods and their applications. Optimization Problems Strategies for Solving NP-hard Optimization Problems What is a Metaheuristic Method?
Major Design Strategies
Major Design Strategies
Presentation transcript:

LECTURE 19. Course: “Design of Systems: Structural Approach” Dept. “Communication Networks &Systems”, Faculty of Radioengineering & Cybernetics Moscow Institute of Physics and Technology (University) / Mark Sh. Levin Inst. for Information Transmission Problems, RAS Oct. 15, 2004 PLAN: 1.Morphological analysis 2.Hierarchical Morphological Multicriteria Design (HMMD) (morphological synthesis, combinatorial synthesis): Fundamentals 3.Five development phases of morphological analysis 4.Preliminary phases (1, 2, 3, 4) 5.HMMD: *formulation, *solving schemes, *examples

Morphological clique

Fundamentals of Hierarchical Morphological Design 1.Morphological analysis (F. Zwicky, 1943) 2.Paradigm of multicriteria decision making (H. Simon) 3.Dynamic programming (R. Bellman) 4.Engineering practice in hierarchical design of complex multidisciplinary systems 5.Combinatorial optimization 6. Knowledge engineering (multidisciplinary information): extraction, organization, usage

Development Phases of Morphological Analysis 1.Morphological analysis [F. Zwicky] 2.Closeness of feasible combination to “IDEAL” [Ayres,1969; Iakimets, Inst. for System Analysis, Russian Academy of Sci. (RAS), 1977] 3.Multicriteria evaluation of feasible combinations and selection of Pareto-effective decisions [Inst. for Control Problems (IPU), Inst. for System Analysis (ISA), Inst. for Machine-engineering (IMASH); RAS, 1972/82] 4.Hierarchical design (composition of local Pareto-effective solutions) [Comp. Center, RAS, Krasnoshekov et al.,1979…] 5. Hierarchical Morphological Multicriteria Design (HMMD) (combinatorial morphological synthesis) [Levin, 1994…]

Morphological analysis A1A1 AiAi AnAn System... Morphological class 1: |A 1 | = m(1) Morphological class i: |A i | = m(i) Morphological class n: |A n | = m(n) Subsystem 1 Subsystem nSubsystem i

Morphological analysis: Closeness to “IDEAL” (Ayres, 1969) X Y Z System... Subsystem X Subsystem ZSubsystem Y X1X1 ID i ID n ID 1 X2X2 X3X3 X4X4 Y1Y1 Y2Y2 Y3Y3 Y4Y4 Y5Y5 Z1Z1 Z2Z2 Z3Z3 “IDEAL” : X 1 * Y 3 * Z 3 (infeasible combination) S 1 = X 4 * Y 3 * Z 3 S 2 = X 2 * Y 5 * Z 1  (“IDEAL”, S 1 ) <  (“IDEAL”, S 2 )  is a closeness (proximity)

Multicriteria evaluation of feasible combinations & selection of Pareto-effective points ( ) X Y Z System... Subsystem X Subsystem ZSubsystem Y X1X1 X2X2 X3X3 X4X4 Y1Y1 Y2Y2 Y3Y3 Y4Y4 Y5Y5 Z1Z1 Z2Z2 Z3Z3 STEP 1. Generation of feasible combinations: S 3 = X 4 * Y 2 * Z 3 S 4 = X 4 * Y 1 * Z 3 S 1 = X 4 * Y 3 * Z 3 S 2 = X 2 * Y 5 * Z 1 STEP 2. Evaluation upon criteria STEP 3. Selection of Pareto-effective solutions

Morphological analysis Complexity: m(1)*…*m(i)*…*m(n) Decreasing of complexity: Horizontal partitioning Vertical partitioning

Hierarchical morphological design (engineering experience, phases 3, 4) ZXY S=X*Y*Z Alternatives

Search strategies START point Optimal point Search Space

Morphological combinatorial synthesis: example ZXY X 1 (2) X 2 (1) X 3 (1) Z 1 (1) Z 2 (1) Z 3 (2) Y 1 (3) Y 2 (1) Y 3 (2) Y 4 (3) S=X*Y*Z S 1 =X 1 *Y 4 *Z 3

Concentric presentation of morphological clique with estimates of compatibility X 3, X 2 X1X1 Z3Z3 Z 1, Z 2 Y4Y1Y4Y1 Y3Y3 Y2Y

Discrete space of quality (by components) S1S1 Ideal Point The worst point

Discrete space of quality (by components, by compatibility) Ideal Point w=1 N(S 1 ) w=3 w=2 THIS IS THE SPACE OF VECTORS: N(S) = ( w (S) ; n 1 (S), n 2 (S), n 3 (S) ) where w (S) is the estimate of compatibility (e.g., minimum of pairwise compatibility estimates) & n 1 (S) is the number of components at the 1 st quality level, etc.

Discrete space of quality (by components, by compatibility) & improvement Ideal Point w=1 N(S 1 ) w=3 w=2 Improvement action

Two-criteria space of quality & improvement action Ideal Point Quality of compatibility Quality of elements Improvement action

Two types of solving schemes 1.Enumerative directed heuristic: analysis and checking since the best point. 2.Dynamic programming methods: extension of the method for knapsack problem or multiple choice problem.

Examples of clique & quasi-clique 3-element clique 4-element clique Quasi-clique

Space of combinatorial optimization problems Polynomial solvable problems NP-hard problems Approximate polynomial solvable problems Knapsack problem Multiple choice problem Quadratic assignment problem Morphological clique problem Clique problem TSP

“Sequence” of close problems 1.Knapsack problem 2.Multiple choice problem 3.Quadratic assignment problem 4. Integer non-linear programming 5. Mixed non-linear programming