1. Agents & Intelligent Systems Dr Liz Black elizabeth.black@kcl.ac.uk

2. What is an Agent? Software agents or physical agents (robots) The main point about agents is they are autonomous: capable of deciding for themselves what to do We want to delegate goals to the agent without having to worry about specifying how exactly those goals should be achieved Agent should work out for itself what to do in order to try to achieve its goals 2

3. Why do we need Agents? Because were lazy Because sometimes the problems we want to solve are so complex or unpredictable that we dont know how to write a precise program that solves them 3

4. Video Starring Douglas Adams and Tom Baker, 1990 4

5. 5

6. 6

7. 7

8. 8

9. 9

10. 10

11. 11 While(not home){ If no obstacle, move forward If obstacle, move left If far end of grid, move right }

12. 12 While(not home){ If no obstacle, move forward If obstacle, move left If far end of grid, move right }

13. 13 While(not home){ If no obstacle, move forward If obstacle, move left If far end of grid, move right }

14. 14 While(not home){ If no obstacle, move forward If obstacle, move left If far end of grid, move right }

15. 15 While(not home){ If no obstacle, move forward If obstacle, move left If far end of grid, move right }

16. 16 While(not home){ If no obstacle, move forward If obstacle, move left If far end of grid, move right }

17. 17

18. 18 While(not home){ If no obstacle, move forward If obstacle, move left If far end of grid, move right }

19. 19 While(not home){ If no obstacle, move forward If obstacle, move left If far end of grid, move right }

20. 20 While(not home){ If no obstacle, move forward If obstacle, move left If far end of grid, move right }

21. 21 While(not home){ If no obstacle, move forward If obstacle, move left If far end of grid, move right }

22. 22 While(not home){ If no obstacle, move forward If obstacle, move left If far end of grid, move right } !

23. 23

24. 24 Goal: get home Knowledge: { Home is at C1 I am at C4 } A BC D E 1 2 3 4

25. 25 A BC D E 1 2 3 4 Goal: get home Knowledge: { Home is at C1 I am at C4 Obstacle at D3 No obstacle at B4, C4, D4, B3, C3 }

26. 26 A BC D E 1 2 3 4 Goal: get home Knowledge: { Home is at C1 I am at C3 Obstacle at D3 No obstacle at B4, C4, D4, B3, C3 }

27. 27 A BC D E 1 2 3 4 Goal: get home Knowledge: { Home is at C1 I am at C3 Obstacle at D3, B2, C2 No obstacle at B4, C4, D4, B3, C3, D2 }

28. 28 A BC D E 1 2 3 4 Goal: get home Knowledge: { Home is at C1 I am at B3 Obstacle at D3, B2, C2 No obstacle at B4, C4, D4, B3, C3, D2 }

29. 29 A BC D E 1 2 3 4 Goal: get home Knowledge: { Home is at C1 I am at B3 Obstacle at D3, B2, C2, A2 No obstacle at B4, C4, D4, B3, C3, D2, A3, A4 }

30. 30 A BC D E 1 2 3 4 Goal: get home Knowledge: { Home is at C1 I am at C3 Obstacle at D3, B2, C2, A2 No obstacle at B4, C4, D4, B3, C3, D2, A3, A4 }

31. 31 A BC D E 1 2 3 4 Goal: get home Knowledge: { Home is at C1 I am at C4 Obstacle at D3, B2, C2, A2 No obstacle at B4, C4, D4, B3, C3, D2, A3, A4 }

32. 32 A BC D E 1 2 3 4 Goal: get home Knowledge: { Home is at C1 I am at D4 Obstacle at D3, B2, C2, A2 No obstacle at B4, C4, D4, B3, C3, D2, A3, A4 } 1 2 3 4

33. 33 A BC D E 1 2 3 4 Goal: get home Knowledge: { Home is at C1 I am at D4 Obstacle at D3, B2, C2, A2 No obstacle at B4, C4, D4, B3, C3, D2, A3, A4, E3, E4 } 1 2 3 4

34. 34 A BC D E 1 2 3 4 Goal: get home Knowledge: { Home is at C1 I am at E4 Obstacle at D3, B2, C2, A2 No obstacle at B4, C4, D4, B3, C3, D2, A3, A4, E3,E4 } 1 2 3 4

35. 35 A BC D E 1 2 3 4 Goal: get home Knowledge: { Home is at C1 I am at E3 Obstacle at D3, B2, C2, A2 No obstacle at B4, C4, D4, B3, C3, D2, A3, A4, E3,E4 } 1 2 3 4

36. 36 A BC D E 1 2 3 4 Goal: get home Knowledge: { Home is at C1 I am at E3 Obstacle at D3, B2, C2. A2 No obstacle at B4, C4, D4, B3, C3, D2, A3, A4, E3,E4, E2 } 1 2 3 4

37. 37 A BC D E 1 2 3 4 Goal: get home Knowledge: { Home is at C1 I am at E2 Obstacle at D3, B2, C2, A2 No obstacle at B4, C4, D4, B3, C3, D2, A3, A4, E3, E4, E2 } 1 2 3 4

38. 38 A BC D E 1 2 3 4 Goal: get home Knowledge: { Home is at C1 I am at E2 Obstacle at D3, B2, C2, A2 No obstacle at B4, C4, D4, B3, C3, D2, A3, A4, E3, E4, E2, D1, E1 } 1 2 3 4

39. 39 A BC D E 1 2 3 4 Goal: get home Knowledge: { Home is at C1 I am at E1 Obstacle at D3, B2, C2, A2 No obstacle at B4, C4, D4, B3, C3, D2, A3, A4, E3,E4, E2, D1, E1 } 1 2 3 4

40. 40 A BC D E 1 2 3 4 Goal: get home Knowledge: { Home is at C1 I am at D1 Obstacle at D3, B2, C2, A2 No obstacle at B4, C4, D4, B3, C3, D2, A3, A4, E3, E4, E2, D1, E1 } 1 2 3 4

41. 41 A BC D E 1 2 3 4 Goal: get home Knowledge: { Home is at C1 I am at home Obstacle at D3, B2, C2, A2 No obstacle at B4, C4, D4, B3, C3, D2, A3, A4, E3,E4, E2, D1, E1 } 1 2 3 4

42. 42 A BC D E 1 2 3 4

43. 43 Can anybody help me? A BC D E 1 2 3 4

44. 44 Maybe, Ive got a big pillow A BC D E 1 2 3 4

45. 45 Please bring it to E2 A BC D E 1 2 3 4

46. 46 Why should I? A BC D E 1 2 3 4

47. 47 I will pay you £5 A BC D E 1 2 3 4

48. 48 No way will I do it for less than £7 A BC D E 1 2 3 4

49. 49 Ill give you £6 and thats my final offer A BC D E 1 2 3 4

50. 50 Ok! A BC D E 1 2 3 4

51. 51 A BC D E 1 2 3 4

52. 52 A BC D E 1 2 3 4

53. 53 A BC D E 1 2 3 4 Im in position

54. 54 A BC D E 1 2 3 4

55. 55 A BC D E 1 2 3 4

56. 56 A BC D E 1 2 3 4

57. 57 A BC D E 1 2 3 4

58. 58 A BC D E 1 2 3 4 £6

59. 59 A BC D E 1 2 3 4 £6

60. 60 A BC D E 1 2 3 4 £6

61. 61 While(not home){ If no obstacle, move forward If obstacle, move left If far end of grid, move right } ! What should we do when our actions dont have the effect we expect?

62. 62 Goal: get home Knowledge: { Home is at C1 I am at C3 Obstacle at D3 No obstacle at B4, C4, D4, B3, C3 } How should we represent what we know about our environment?

63. 63 Can anybod y help me? When do we need to get help from other agents?

64. 64 Maybe, Ive got a big pillow How can agents communicate? What language should they use? How can they be sure they have the same shared meaning of words?

65. 65 Im in positio n How do we know we can trust another agent?

66. 66 Why should I? How can we get an agent to do something for us?

67. 67 Ill give you £6 and thats my final offer Whats a good negotiation strategy?

68. Making decisions Deciding what to do becomes much more complicated when we have to take into account what someone else will do Game theory – used to study strategic decision making, takes into account the possible actions of others 68

69. 69 Golden balls woman steals man steal s 0 100 0 100 50 man splits woman splits Both split: share the money One steals and one splits: stealer gets all the money Both steal: neither gets any money

70. 70 Golden balls woman steals man steal s 0 100 0 100 50 man splits woman splits Both split: share the money One steals and one splits: stealer gets all the money Both steal: neither gets any money Dominant strategy A strategy S is dominant if no matter what the other does you can do no better than to play S

71. 71 Golden balls woman steals man steal s 0 100 0 100 50 man splits woman splits Both split: share the money One steals and one splits: stealer gets all the money Both steal: neither gets any money Assume the man splits. Whats the best thing that the woman can do?

72. 72 Golden balls woman steals man steal s 0 100 0 10 50 man splits woman splits Both split: share the money One steals and one splits: stealer gets all the money Both steal: neither gets any money Assume the man steals. Whats the best thing that the woman can do?

73. 73 Golden balls woman steals man steal s 0 10 0 10 5 man splits woman splits Both split: share the money One steals and one splits: stealer gets all the money Both steal: neither gets any money

74. Summary Agents are capable of deciding for themselves what to do to achieve their goals Useful because sometimes we dont know in advance the best way to achieve a goal, or we dont want to have to think about how to achieve a goal Often agents cant achieve their goals on their own but must cooperate with other agents 74