2. ENM 503 Lesson 7 – Discrete Models Combinatorial Problems and their Solutions I am very discrete.

3. The Lineup The General Problem The Transportation Problem The Assignment Problem The Knapsack Problem The Traveling Salesman Problem The Postman problem

4. The General IP Problem Why this is just a linear program with integer restrictions on the variables.

5. Combinatorial Optimization Problems Optimization problem having a finite number of discrete solutions. One solution approach is to explicitly generate and evaluate all possible solutions Explicit enumeration Consider an IP problem with 100 variables where x j = 0, 1, 2, …, 50; j = 1,2, …, 100 number of possible solutions = 51 100 Explicit enumeration not possible Implicit enumeration – attempt to account for all possible solution without enumerating all of them

6. An Integer Program x1x1 x2x2 2 1 1 2 max z = x 1 + 5x 2 subj to: x 1 + 10x 2  20 x 1  2 x 1, x 2 are integers.... lattice points

7. Why not just round the LP solution? x1x1 x2x2 2 1 1 2.... LP solution x 1 = 2, x 2 = 9/5 z * = 11 round (2,2) infeasible Animated max z = x 1 + 5x 2 subj to: x 1 + 10x 2  20 x 1  2 x 1, x 2 are integers

8. Rounding doesn’t always work! x1x1 x2x2 2 1 1 2.... optimal IP solution x 1 = 0, x 2 = 2 z = 10 feasible rounded solution x 1 = 2, x 2 = 1 z = 7 Animated max z = x 1 + 5x 2 subj to: x 1 + 10x 2  20 x 1  2 x 1, x 2 are integers LP solution x 1 = 2, x 2 = 9/5 z * = 11

9. An IP Example Max z = 4.8x 1 + 6.1x 2 + 4.5x 3 + 5.2x 4 subj. to: x 1 + x 2 + x 3 + x 4  200 2.3x 1 + 4.5x 2 + 6.8x 3 + 2.5x 4  150 11.3x 1 + 10.5x 2 + 9.3x 3 + 11.6x 4  400 3.4x 1 + 5.3x 2 + 2.1x 3 + 1.8x 4  125 x 1, x 2, x 3, x 4 = 0, 1, 2, …

10. The Solutions LP Solution rounded LP Solution IP Solution x1x2x3x4 unit profit4.86.14.55.2Max variables016.108395.78801415.2615203.667 sumprodRHS Const 1111137.1579<=50 Const 22.34.56.82.5150<=150 Const 311.310.59.311.6400<=400 Const 43.45.32.11.8125<=125 x1x2x3x4 unit profit4.86.14.55.2Max variables016615202.6 sumprodRHS Const 1111137<=50 Const 22.34.56.82.5150.3<=150 Const 311.310.59.311.6397.8<=400 Const 43.45.32.11.8124.4<=125 x1x2x3x4 unit profit4.86.14.55.2Max variables017019202.5 sumprodRHS Const 1111136<=50 Const 22.34.56.82.5124<=150 Const 311.310.59.311.6398.9<=400 Const 43.45.32.11.8124.3<=125

11. Feasible Rounding feasible rounded LP Solution IP Solution x1x2x3x4 unit profit4.86.14.55.2Max variables016515198.1 sumprodRHS Const 1111136<=50 Const 22.34.56.82.5143.5<=150 Const 311.310.59.311.6388.5<=400 Const 43.45.32.11.8122.3<=125 x1x2x3x4 unit profit4.86.14.55.2Max variables017019202.5 sumprodRHS Const 1111136<=50 Const 22.34.56.82.5124<=150 Const 311.310.59.311.6398.9<=400 Const 43.45.32.11.8124.3<=125

12. The Assignment Problem Assign n workers to n tasks I heard that this is really good!

13. Some Applications workers to tasks jobs to machines facilities to locations Truck drivers to customer pick-up points Umpire crews to baseball games Judges to court dockets State inspectors to construction sites Weapons to targets These are some terrific applications.

14. A problem Three workers are to be assigned to one of 4 distinct tasks. Each worker can perform each task in a different time. The objective is to minimize the total time to complete the assigned tasks. worker task times We need to add a dummy worker. timetask1task2task3task4 w112131011 w210121410 w314111512

15. The Knapsack Problem A total of m items whose weights are a 1, a 2, …, a m are available for packing a knapsack. The total weight to be packed cannot exceed b. The objective is to pack as many items as possible.

16. An Example – solver binary solution Valueweight x108.5 x213.7 x311.9 x412.8 x514.7 x606.9 x708.7 x813.3 x905.8 x1009.1 x1107.9 x1205.4 x1314.1 x1413.8 x1506.7 x1605.4 x1708.5 x1806.4 x1913.4 x2012.2 sum929.9 <= 30 Valueweight x118.5 x213.7 x311.9 x412.8 x514.7 x606.9 x708.7 x813.3 x905.8 x1009.1 x1107.9 x1215.4 x1314.1 x1403.8 x1506.7 x1605.4 x1708.5 x1806.4 x1913.4 x2012.2 sum1040 <= 40 Valueweight x108.5 x203.7 x311.9 x412.8 x514.7 x616.9 x708.7 x813.3 x915.8 x1009.1 x1107.9 x1215.4 x1314.1 x1413.8 x1506.7 x1615.4 x1708.5 x1806.4 x1913.4 x2012.2 sum1249.7 <= 50

17. New and Improved Knapsack Problem Let c j = cost of the i th item w j = weight of the j th item v j = volume of the j th item It is comforting to know my load is optimal!

18. Example – new and improved

19. Let’s count the number of solutions… Dad, how many solutions are there for the knapsack problem if I have 30 items to consider? You should know that Johnny. It is 2 30 or 1,073,741,824 solutions if you include the infeasible ones as well.

20. The Traveling Salesman Problem There once was a farmer’s daughter… You got to know the territory!

21. Traveling Salesman Problem A salesman must visit each of n cities once and only once returning to his starting city. What route should be followed so that the total distance (cost or time) traveled is minimized? (n-1)! possible routes Itinerary Dayton Cincinnati Denver New York Atlanta Chicago Boston San Francisco Wapakoneta My secretary always finds for me, the minimum distance itinerary.

22. A From-to Matrix From / To City ACity BCity CCity D City A253012 City B251723 City C301737 City D122337 distances in miles

23. Traveling on a network 2 5 5 34 6 7 8 11 A B C D E F G 6! = 720 routes A solution is a permutation!

24. A Traveling Salesman Problem P. Rose, currently unemployed, has hit upon the following scheme for making some money. He will guide a group of people on a tour of all National League baseball parks. The tour will start and end in Cincinnati. What route should he follow in order to minimize total distances (costs)?

25. Distances between parks in miles ATL CHI CIN HOU LA MON NY PHI PIT STL SD SF ATL 702 454 842 2396 1196 864 772 714 554 2363 2679 CHI 702 324 1093 2136 764 845 764 459 294 2184 2187 CIN 454 324 1137 2180 798 664 572 284 338 2228 2463 HOU 842 1093 1137 1616 1857 1706 1614 1421 799 1521 2021 LA 2396 2136 2180 1616 2900 2844 2752 2464 1842 95 405 MON 1196 764 798 1857 2900 396 424 514 1058 2948 2951 NYK 864 845 664 1706 2844 396 92 386 1002 2892 3032 PHI 772 764 572 1614 2752 424 92 305 910 2800 2951 PIT 714 459 284 1421 2464 514 386 305 622 2512 2646 STL 554 294 338 799 1842 1058 1002 910 622 1890 2125 SD 2363 2184 2228 1521 95 2948 2892 2800 2512 1890 500 SF 2679 2187 2463 2021 405 2951 3032 2951 2646 2125 500

26. Heuristics -algorithm development I need a good heuristic to solve this problem. Joe EngineerP. Rose Heuristic: A procedure for solving problems by an intuitive approach in which the structure of the problem can be interpreted and exploited intelligently to obtain a reasonable solution.

27. Nearest Neighbor Heuristic – a greedy heuristic algorithm ATL CHI CIN HOU LA MON NY PHI PIT STL SD SF ATL 702 454 842 2396 1196 864 772 714 554 2363 2679 CHI 702 324 1093 2136 764 845 764 459 294 2184 2187 CIN 454 324 1137 2180 798 664 572 284 338 2228 2463 HOU 842 1093 1137 1616 1857 1706 1614 1421 799 1521 2021 LA 2396 2136 2180 1616 2900 2844 2752 2464 1842 95 405 MON 1196 764 798 1857 2900 396 424 514 1058 2948 2951 NYK 864 845 664 1706 2844 396 92 386 1002 2892 3032 PHI 772 764 572 1614 2752 424 92 305 910 2800 2951 PIT 714 459 284 1421 2464 514 386 305 622 2512 2646 STL 554 294 338 799 1842 1058 1002 910 622 1890 2125 SD 2363 2184 2228 1521 95 2948 2892 2800 2512 1890 500 SF 2679 2187 2463 2021 405 2951 3032 2951 2646 2125 500

28. LAXSNFCIN MON SNDATLHOUCHIPITSTLPHINYK DISTANCE = 8015 MILES

29. LAXSNFCIN MON SNDATLHOUCHIPITSTLPHINYK DISTANCE = 8015 MILES X X OPTIMUM = 7577 MILES

30. Other Applications manufacture of circuit boards assembly line reconfiguration mixing paints colors in vats searching for stars

31. The Chinese Postman Problem A study in the optimal delivery of the postal mail

32. The problem defined The Chinese postman problem concerns a postman who has to deliver mail to houses along each of the streets in a particular housing estate, and wants to minimize the distance that has to be walked. The problem was first considered by the Chinese mathematician Mei-ko Kwan in the1960s. Based on this Alan Goldman suggested the name "Chinese Postman problem" to Jack Edmonds when Edmonds was in Goldman's Operations Research group at the U.S. National Bureau of Standards (now NIST). Edmonds appreciated its "catchiness" and adopted it.

33. More of the Chinese Postman Problem Given a network with distances assigned to each arc, find the minimum distance walk that walks each arc at least once and returns to the starting node. 2 5 5 34 6 7 8 11 A B C D E F G I get tired walking this route. It is too long.

34. The Bridges of Königsberg Königsberg (Kaliningrad) was a city in Prussia situated on the Pregel River, which served as the residence of the dukes of Prussia in the 16th century. The river Pregel flowed through the town, creating an island. Seven bridges spanned the various branches of the river, as shown.

35. Graph Theory and the Bridges of Königsberg A famous problem concerning Königsberg was whether it was possible to take a walk through the town in such a way as to cross over every bridge once, and only once. An example of a failed attempt to take such a walking tour is shown below. How many bridges must I cross?

36. Now comes Euler This problem was first solved by the Swiss mathematician Leonhard Euler who invented the branch of mathematics now known as graph theory in the process of his solution. Euler's approach was to regard the spots of land (there are 4 of them) as points to be visited, and the bridges as paths between those points. The mathematical essentials of the map of Königsberg can then be reduced to the following diagram, which is an example of what is called a graph:

37. Leonhard Euler Euler was the most prolific writer of mathematics of all time. He made large bounds forward in the study of modern analytic geometry and trigonometry where he was the first to consider sin, cos etc. as functions rather than as chords. He made decisive and formative contributions to geometry, calculus and number theory. He integrated Leibniz's differential calculus and Newton's method of fluxions into mathematical analysis. He introduced beta and gamma functions, and integrating factors for differential equations. He studied continuum mechanics, lunar theory, the three body problem, elasticity, acoustics, the wave theory of light, hydraulics, and music. He laid the foundation of analytical mechanics. Born: 15 April 1707 in Basel, Switzerland Died: 18 Sept 1783 in St Petersburg, Russia

38. Network Terminology Graph – a finite set of points (vertices or nodes) together with a finite set of connecting links called edges (arcs or branches). Each edge connects two different vertices Path – a sequence of edges in a graph where consecutive edges have the same vertex. Circuit – a path which starts and ends at the same vertex Euler circuit – a circuit in which each edge of the graph is used exactly once

39. Euler's Solution When a vertex is "visited" in the middle of the process of tracing a graph, there must be an edge coming into the vertex, and another edge leaving it; and so the order of the vertex must be an even number. This must be true for all but at most two of the vertices--the one you start at, and the one you end at A connected graph is traversible if and only if it has at most two vertices of odd order. (the starting and ending vertices may be the same, in which case the order of every vertex must be even.) The Königsberg graph shows that there are more than two vertices of odd order, and so the desired walking tour of Königsberg is impossible.

40. Euler Solution If there are no odd nodes in the network, the network is certainly traversable. The minimum distance is the sum of the arc distances and any Eulerian trail is an acceptable shortest route, so the problem is trivial. If a Euler circuit does not exist, then the problem is to find a circuit that covers all the edges of a given graph with the minimum number of duplications. If v 0 is the number of odd-ordered vertices, then no fewer than v 0 / 2 additional edges are necessary.

41. Other Applications delivery mail, newspaper, door-to-door soliciting trash pickup snow plowing and salting streets, street cleaning railroad track inspections and maintenance meter reading school bus routes

42. Play ball! Now it’s your turn. The Department of Engineering Management & Systems has proudly presented Discrete Models and Methods