2. ESAW 2004 Extending Electronic Institutions: An Explorer’s Log Pablo Noriega IIIA-CSIC Barcelona

3. EUMAS 04 Barcelona December 16,17 REGISTER SOON

4. ESAW 04 3 Goals of this Talk Present the underlying intuitions of our proposals Share our present cogitations Invite you to participate

5. ESAW 04 4 EI gang at IIIA-CSIC Currently: Josep Lluis Arcos * Eva Bou * Guifre Cuni * Andres Garcia Pere Garcia * Andrea Giovanucci * Carlos Hernandez Pablo Noriega Juan Antonio Rodriguez Aguilar Marco Schloemerer Carles Sierra Formerly: Mark Esteva Jordi Sabater http://e-institutions.iiia.csic.es/

6. ESAW 04 5 EI -Influencias Dialogues Economics Norms Coordination MASMAS

7. ESAW 04 6 “Institution: collection of artificial constraints that regulate agent interactions” A.D. North

8. ESAW 04 7 EI and ordinary institutions Fix meaning Clarify expectations on the behavior of others Implement due process Interface: Individual rationality and social outcomes Purpose: reduce uncertainty

9. ESAW 04 8 EI : alternative views EIs as Dialogues: Dialogical language Types of dialogue (protocol, point of conversation) Changes of conversation Obligations EIs as Norms Logical theories Context Compliance / enforcement EIs as Interface: Coordination artifact Interaction-centered problem solving Success / failure Computational Environments Applications Social Perspective

10. ESAW 04 9 Adscription

11. ESAW 04 10 A-open MAS Adscription-open System Definition: An Adscription-open System is a distributed system involving autonomous, independent entities that are willing to conform to a shared set of interaction conventions

12. ESAW 04 11 A-open MAS: H 0 Participants are commitment-making agents All interactions are construable as speech acts Interactions are repetitive Interactions produce social commitments

13. ESAW 04 12 EI = I(H 0 ) Dialogical Framework: Linguistic and social structure to give meaning to agent interactions. Performative Structure: scenes and relationships between scenes (navigation, precedence, causality) Rules: Role-dependent conventions to establish social commitments

14. ESAW 04 13 Electronic Institution Components PERFORMATIVE STRUCTURE (NETWORK OF PROTOCOLS) SCENE (MULTI-AGENT PROTOCOL) AGENT ROLES Buyers’ Payment NORMS

15. ESAW 04 14 Simple Electronic Institutions: EI 0 = I 0 (I(H 0 )) Dialogical Framework: Linguistic and social structure to give meaning to agent interactions. Performative Structure: scenes and relationships between scenes (navigation, precedence, causality) Rules: Role-dependent conventions to establish social commitments DF = S = PS = (  n j =1 uttered(s j,w kj,i lj )   m k =1 e k )  (  n’ j =1 uttered(s’ j,w’ kj,i’ lj )   m’ k = 0 e’ k )

16. ESAW 04 15 EI 0 : Dialogical Framework We define a dialogical framework as a tuple DF = where: O stands for the institutional ontology; I is the set of illocutionary particles; L stands for a representation language; R I is the set of internal roles; R E is the set of external roles; and R S is the list of relationships over roles; Illocution: i ( , ,  ) Declare (auct,all, offer(good,price), t)

17. ESAW 04 16 Performative Structure Complex activities can be specified by establishing relationships among scenes that: capture causal dependency. define synchronisation mechanisms. establish parallelism mechanisms. define choice points that allow roles leaving a scene to choose which activity to engage in next. establish the role flow policy.

18. ESAW 04 17 Sellers’ admission Buyers’ admission FM Scenes Bidding Sellers’ settlements Buyers’ settlements & Delivery Buyers Sellers

19. ESAW 04 18 EI 0 : Performative Structure A performative structure is a tuple PS = where: S is a finite, non-empty set of scenes; T is a finite and non-empty set of transitions; s 0  S is the root scene; s   S is the output scene; E = E I  E O is a set of arc identifiers where E I  S x T is a set of edges from scenes to transitions and E O  T x S is a set of edges from transitions to scenes; f L : E  2 VA x R is the labelling function; f T : T  {AND-AND,AND-OR,OR-OR,OR-AND} maps each transition to its type; f E O : E O  E maps each arc to its type; C: E I  CONS maps each arc to a boolean expression representing the arc's constraints.  : S  {0,1} sets if a scene can be multiply instantiated at execution time

20. ESAW 04 19 FM Performative Structure (ISLANDER)

21. ESAW 04 20 Scene A scene is a pattern of multi-agent conversation. A scene is specified by a finite state oriented graph where the nodes represent the different states and oriented arcs are labelled with illocution schemes or timeouts. During the enactment new agents can join the scene or some of the participants can leave the scene at definite states depending on their role. A scene may have multiple (simultaneous) instantiations, and be enacted by different groups of agents.

22. ESAW 04 21 Voice Bidding

23. ESAW 04 22 EI 0 : Scene Formally, a scene is a tuple: S = where: R is the set of roles of the scene; DF is a dialogical framework; W is a finite, non-empty set of scene states; w 0  W is the initial state; W f  W is the non-empty set of final states; (WA r ) r  R  W is a family of non-empty sets such that WA r stands for the set of access states for the role r  R; (WE r ) r  R  W is a family of non-empty sets such that WE r stands for the set of exit states for the role r  R;   W x W is a set of directed edges; :   L is a labelling function; min,Max: R  N min(r) and Max(r) return respectively the minimum and maximum number of agents that must and can play the role r  R

24. ESAW 04 23 Norms Social Committments Illocutionary meaning Individual Navigation

25. ESAW 04 24 EI 0 : Norms Individual behavior rules define the conditions for an agent to take an action and the effects of taking such actions within the institution. Conditions: Current state of the scene (conversation) Role played by speaker and hearers of a given illocution Prevailing state of social commitments Effects: Changes in the state of a conversation and social commitments Obligations imposed to agents. Trajectories that agents can follow. Example A buyer winning a bidding round is required to proceed to the buyers settlement scene to pay for the good.

26. ESAW 04 25 FM: Individual Behavior Rules

27. ESAW 04 26 EI 0 Norm Enforcement device: Governor Agent whose purpose is to mediate between the institution and participating agents. Each external agent is attached to a governor that sees to it that the agent behaves according to the institutional conventions: IDENTITY NAVIGATION INFORMATION PASSING MESSAGES TIMING

28. ESAW 04 27 EI : An Idealized Trajectory FM-TestBed FishMarket Auctions MASFIT FM EI EI 0 ISLANDER EIDE : ISLANDER Simdei AMELI Abuilder SADDE EIDE : ISLANDER Simdei AMELI Abuilder

29. ESAW 04 28 EI 0 : Tools

30. ESAW 04 29 EI : Potential Development EI EI 0 Theory Methodology Applications Tools EI plus

31. ESAW 04 30 EI 0 : Cogitations We have taken a strong “dialogical stance” We have also dealt with static scene definitions We have taken a “policing” approach to norm compliance, and norm enforcement (so far). Integrated framework: representation / methodology / tools Unified metaphor from Design to deployment Applicable Extend to dynamic protocols and less structured interactions. other normative conceptions complex regulated social environments

32. ESAW 04 31 EI : Extensions EI EI 0 Theory Methodology Applications Tools EI plus STRUCTURAL EXTENSIONS NORMATIVE EXTENSIONS META INSTITUTIONAL EXTENSIONS

33. ESAW 04 32 EI : Structural Extensions (1) DB UB CB Vickrey Auction PS Scene Interchange

34. ESAW 04 33 EI : Structural Extensions (2) UB CB PS Splicing

35. ESAW 04 34 Splicing Splicing Techniques Clipping Chopping Interleaving Growing Nesting Splicing Algebra ? atomic operations separability, correctness, commitment consistency, …

36. ESAW 04 35 Revising Scenes Scenes as Functors auction ( ; ) Scenes as Goals Price-fixing  {fixed,auction,clearing,negotiation} PS as Problem Decomposition AuctHouse:=registration + adminsion + price-fixing + settlements

37. ESAW 04 36 Structural Extensions: Taxonomy ScenePS Fixed with flexible parametersFixed STATICSTATIC FLEXIBLEFLEXIBLE Interchangeable from set of available fixed scenes Fixed DYNAMICDYNAMIC Interchangeable from set of Available fixed PSs Flexible Assemblable from available subPSc OPENOPEN Dialogical Patterns

38. Ag 1 Ag 2 Ag n Destination Data I Ir 12 I I INPUT Output Competivness Positioning Susteinability Profit Scenarios r 2n r 1n I = Institution Ag n = Agent “n” r i n = Relationship Ag i y Ag n Touring Machine

39. ESAW 04 38 EI : Meta-institutional Environments $ ? Contr

40. ESAW 04 39 EI : Other Extensions EI envr EI EI 0 EI 1 Theory Methodology Tools EI 2 EI  From “buildings” to “urbanism”

41. ESAW 04 40 Other Extensions: Taxonomy (2) Promulgation External, Internal Compliance Obligatory Facultative Enforcement Strict Sanctions Self-enforced

42. ESAW 04 41 Id PromulgationPS StructureComplianceEnforcement EI 0 ExternalFixedObligatoryStrict e-commerce EI n ExternalFlexibleFacultativeSanctions e-government procedures External & internal EvolvingFacultativeIncentives Complaints, conflict resolution EI  InternalFlexibleObligatorySelf Parlamentary Procedures EI env External / internalFlexibleFacultativeIncentives Tourism Destination Supply Network Extensions: Application Domain Examples

43. ESAW 04 42 EI Extensions Applications EI 0 e-commerce EI n Due process EI  Adscription open interactions EI env ( Meta Institutional Environments ) Supply networks Localities Tools e 0 ISLANDER, AMELIE,… e n ISLANDER+, AMELIE+,… e  ISLANDER*,AMELI*… Engineering Environments

44. ESAW 04 43 Ongoing Work

45. ESAW 04 44 Ongoing Work http://e-institutions.iiia.csic.es FREE CD and Demo

46. QUESTIONS ?

47. ESAW 04 46 FIN

48. ESAW 04 47 BACKUP SLIDES Juan Antonio Rodriguez, Marc Esteva, Josep Lluis Arcos, Et.al.

49. ESAW 04 48 EI adscription-open MAS

50. ESAW 04 49 EI adscription-open MAS

51. ESAW 04 50

52. ESAW 04 51 Electronic Institution Infrastructure

53. ESAW 04 52 AMELI functionalities MEDIATION To facilitate agent communication within conversations (scenes). COORDINATION AND ENFORCEMENT To guarantee the correct evolution of each conversation (preventing errors made by the participating agents by filtering erroneous illocutions, thus protecting the institution). To guarantee that agents ’ movements between scenes comply with the specification. To control which obligations participating agents acquire and fulfil. INFORMATION MANAGEMENT To facilitate participating agents the information they need to participate in the institution.

54. ESAW 04 53 AMELI architecture INSTITUTION MANAGER SCENE MANAGERS TRANSITION MANAGERS GOVERNORS

55. ESAW 04 54 Governor Mediates between institution and participating agent. Controls that an agent behaves according to the institution specification (rules).

56. ESAW 04 55 AMELI implementation features Agent-based Realised as a middleware layer Architecturally neutral General purpose (can interpret any institution specification) Communication neutral Scalable (it can be distributed among several machines)

57. ESAW 04 56 Operations

58. ESAW 04 57 Operations

59. ESAW 04 58 Operations

60. ESAW 04 59 Operations

61. ESAW 04 60 Operations

62. ESAW 04 61 Conclusions Engineering open multi-agent systems is a highly complex task. Electronic institutions reduce this complexity by introducing regulatory environments. We have presented AMELI, a social middleware that facilitates the deployment of electronic institutions. Given any institution specification, our social middleware is capable of enforcing the institutional rules. The combination of ISLANDER and AMELI targeted at supporting environment engineering in open multi-agent systems.

63. ESAW 04 62 Transition Management Movements are done asynchronously. For movements to current scene executions the transition informs the scene managers. For movements to new scene execution the transition manager informs the institution manager, which creates a scene manager for it.

64. ESAW 04 63 Transition management Each transition is managed by a transition manager. Agents within a transition can ask for target scenes to join. The transition manager is in charge of controlling when the transition can be fired (agents can move).

65. ESAW 04 64 Norm Management Java Expert System Shell (JESS) to manage norms. A governor has one thread devoted to manage its connection to JESS. For each norm N i, this thread adds the corresponding R1 i into the JESS rule base. Later on this thread adds the illocutions (appearing on the norms) as the facts of the system. JESS informs the thread whenever a rule is fired.

66. ESAW 04 65 Norm management Norms managed as a rule-based system. Constructed from an ISLANDER specification. The facts are illocutions uttered by agents. Each governor manages his agent’s obligations.

67. ESAW 04 66 Norm Management A norm N i : is transformed into: Antecedent Defeasible Antecedent Obligations Norm Activation Obligations fulfilment

68. ESAW 04 67 Agent to Governor Messages

69. ESAW 04 68 Governor to Agent Messages

70. ESAW 04 69 Electronic Institution Specification with ISLANDER Common Ontology and language Agent Roles Multi-agent protocols Network of protocols Norms

71. ESAW 04 70 Institution Execution Electronic institutions will be populated at execution time by heterogenous and self-interested agents. The institution execution can be regarded as the execution of its different scenes. Agents devote their time: interacting with other agents in the different scene executions moving among them. As a consequence agents acquire and fulfill obligations.

72. ESAW 04 71 Institution execution

73. ESAW 04 72 Institution execution

74. ESAW 04 73 Institution execution

75. ESAW 04 74 Approach ENVIRONMEN T ELECTRONIC INSTITUTION NORMS AGENT 1 AGENT 2 AGENT 3 AGENT 1 AGENT 2 AGENT 3  EXECUTION STATE: 

76. ESAW 04 75 Approach ENVIRONMEN T ELECTRONIC INSTITUTION NORMS AGENT 1 AGENT 2 AGENT 3 AGENT 1 AGENT 2 AGENT 3  Action Correct? EXECUTION STATE: 

77. ESAW 04 76 Approach ENVIRONMEN T ELECTRONIC INSTITUTION NORMS AGENT 1 AGENT 2 AGENT 3 AGENT 1 AGENT 2 AGENT 3 ’’ EXECUTION STATE:  →  ’

78. ESAW 04 77 Execution State  = stands for an institution execution state where: Ag = {ag 1,..., ag n } is a finite set of participating agents.  = {  i k | s i  S, k  N} is the set of all scene executions. T = {T 1,..., T n } stands for all transition executions. Obl {obl 1,..., obl n } is the set of agents’ pending obligations.  i k = { , , A} stands for scene execution state where:  represents the scene’s current state.  = {  1,...,  n } stands for the context (bindings) produced by illocutions. A = {(ag,r) | ag  Ag, r  R} is the set participating agents along with their roles. Each transition execution state T i = { (ag,  ) | ag  Ag,  = { (  i k, r) |  i k  , r  R}} contains agents’ target scenes.