Negotiation A Lesson in Multiagent System Based on Jose Vidal’s book Fundamentals of Multiagent Systems Henry Hexmoor SIUC.

Slides:



Advertisements
Similar presentations
Reaching Agreements II. 2 What utility does a deal give an agent? Given encounter  T 1,T 2  in task domain  T,{1,2},c  We define the utility of a.
Advertisements

Nash Equilibrium: Illustrations
Ultimatum Game Two players bargain (anonymously) to divide a fixed amount between them. P1 (proposer) offers a division of the “pie” P2 (responder) decides.
Arbitration. Introduction In this section we will consider the impact of outside arbitration on coordination games Specifically, we will consider two.
Game Theory Assignment For all of these games, P1 chooses between the columns, and P2 chooses between the rows.
This Segment: Computational game theory Lecture 1: Game representations, solution concepts and complexity Tuomas Sandholm Computer Science Department Carnegie.
1 EC9A4 Social Choice and Voting Lecture 3 EC9A4 Social Choice and Voting Lecture 3 Prof. Francesco Squintani
The Voting Problem: A Lesson in Multiagent System Based on Jose Vidal’s book Fundamentals of Multiagent Systems Henry Hexmoor SIUC.
Distributed Rational Decision Making Author: Tuomas W. Sandholm Speakers: Praveen Guddeti (1---5) Tibor Moldovan (6---9) CSE 976, April 15, 2002.
Do software agents know what they talk about? Agents and Ontology dr. Patrick De Causmaecker, Nottingham, March
Game Theory and Computer Networks: a useful combination? Christos Samaras, COMNET Group, DUTH.
Wstęp do Teorii Gier. Consider the following game Mrs Column AB Mr Raw A(2,6)(10,5) B(4,8)(0,0)
Game-theoretic analysis tools Necessary for building nonmanipulable automated negotiation systems.
ECO290E: Game Theory Lecture 4 Applications in Industrial Organization.
Online Cake Cutting Toby Walsh NICTA and UNSW Sydney, Australia.
EC941 - Game Theory Prof. Francesco Squintani Lecture 8 1.
Slide 1 of 13 So... What’s Game Theory? Game theory refers to a branch of applied math that deals with the strategic interactions between various ‘agents’,
Planning under Uncertainty
David Bryce © Adapted from Baye © 2002 Game Theory: The Competitive Dynamics of Strategy MANEC 387 Economics of Strategy MANEC 387 Economics.
Game-Theoretic Approaches to Multi-Agent Systems Bernhard Nebel.
UNIT II: The Basic Theory Zero-sum Games Nonzero-sum Games Nash Equilibrium: Properties and Problems Bargaining Games Review Midterm3/21 3/7.
Approximate and online multi-issue negotiation S.S. Fatima Loughborough University, UK M. Wooldridge N.R. Jennings University of.
Lecture 1 - Introduction 1.  Introduction to Game Theory  Basic Game Theory Examples  Strategic Games  More Game Theory Examples  Equilibrium  Mixed.
17. backward induction – ultimatums and bargaining take it or leave it offers. Two players. Split a dollar. (s,1-s) offer to 2. if accepts get (s,1-s).
Distributed Multiagent Resource Allocation In Diminishing Marginal Return Domains Yoram Bachrach(Hebew University) Jeffrey S. Rosenschein (Hebrew University)
Agent Technology for e-Commerce Chapter 10: Mechanism Design Maria Fasli
Bargaining in-Bundle over Multiple Issues in Finite- Horizon Alternating-Offers Protocol Francesco Di Giunta and Nicola Gatti Politecnico di Milano Milan,
Developing Principles in Bargaining. Motivation Consider a purely distributive bargaining situation where impasse is costly to both sides How should we.
Negotiation: Markets, Rationality, and Games. Intro Once agents have discovered each other and agreed that they are interested in buying/selling, they.
Incomplete Contracts Renegotiation, Communications and Theory December 10, 2007.
Distributed Rational Decision Making Sections By Tibor Moldovan.
UNIT II: The Basic Theory Zero-sum Games Nonzero-sum Games Nash Equilibrium: Properties and Problems Bargaining Games Review Midterm3/23 3/2.
On the Aggregation of Preferences in Engineering Design Beth Allen University of Minnesota NSF DMI
CONSISTENCY MAINTENANCE AND NEGOTIATION. What Is a TMS? A truth maintenance system performs some form of propositional deduction maintains justifications.
Game Theory.
1 Lecture 2: Negotiating Strategy Professor Keith Chen.
UNIT II: The Basic Theory Zero-sum Games Nonzero-sum Games Nash Equilibrium: Properties and Problems Bargaining Games Review Midterm3/19 3/5.
Game Theory.
Overview Aggregating preferences The Social Welfare function The Pareto Criterion The Compensation Principle.
Portfolio Management-Learning Objective
Chapter 12 & Module E Decision Theory & Game Theory.
7-1 LECTURE 7: Reaching Agreements An Introduction to MultiAgent Systems
Multi-Agent Systems Negotiation Shari Naik. Negotiation Inter-agent cooperation Conflict resolution Agents communicate respective desires Compromise to.
The Cost and Windfall of Manipulability Abraham Othman and Tuomas Sandholm Carnegie Mellon University Computer Science Department.
Bargaining Whoever offers to another a bargain of any kind, proposes to do this. Give me that which I want, and you shall have this which you want …; and.
Standard and Extended Form Games A Lesson in Multiagent System Based on Jose Vidal’s book Fundamentals of Multiagent Systems Henry Hexmoor, SIUC.
Lecture 2 Economic Actors and Organizations: Motivation and Behavior.
Linking multi-agent simulation to experiments in economy Re-implementing John Duffy’s model of speculative learning agents.
Game-theoretic analysis tools Tuomas Sandholm Professor Computer Science Department Carnegie Mellon University.
Introduction to Matching Theory E. Maskin Jerusalem Summer School in Economic Theory June 2014.
Game Theory: introduction and applications to computer networks Game Theory: introduction and applications to computer networks Lecture 2: two-person non.
Utilities and MDP: A Lesson in Multiagent System Based on Jose Vidal’s book Fundamentals of Multiagent Systems Henry Hexmoor SIUC.
An Extended Alternating-Offers Bargaining Protocol for Automated Negotiation in Multi-agent Systems P. Winoto, G. McCalla & J. Vassileva Department of.
Lecture 5 Introduction to Game theory. What is game theory? Game theory studies situations where players have strategic interactions; the payoff that.
Algorithmic Game Theory and Internet Computing Vijay V. Vazirani Georgia Tech Primal-Dual Algorithms for Rational Convex Programs II: Dealing with Infeasibility.
1 What is Game Theory About? r Analysis of situations where conflict of interests is present r Goal is to prescribe how conflicts can be resolved 2 2 r.
CMSC 100 Multi-Agent Game Day Professor Marie desJardins Tuesday, November 20, 2012 Tue 11/20/12 1 Multi-Agent Game Day.
MAIN RESULT: We assume utility exhibits strategic complementarities. We show: Membership in larger k-core implies higher actions in equilibrium Higher.
Negotiating Socially Optimal Allocations of Resources U. Endriss, N. Maudet, F. Sadri, and F. Toni Presented by: Marcus Shea.
Bargaining games Econ 414. General bargaining games A common application of repeated games is to examine situations of two or more parties bargaining.
Nash Bargaining Solution and Alternating Offer Games MIT Game Theory.
Second lecture: The theory of monopoly, monopsony and bilateral monopoly: the standard microeconomic theory and its limits. Third lecture: The theory of.
Lecture V: Bargaining Recommended Reading: Dixit & Skeath, Chapter 17 Osborne, Chapter 6.1, 16 Powell, In the Shadow of Power, Ch. 3.
A useful reduction (SAT -> game)
A useful reduction (SAT -> game)
Game Theory: The Competitive Dynamics of Strategy
EC941 - Game Theory Lecture 8 Prof. Francesco Squintani
Chapter 34 Welfare Key Concept: Arrow’s impossibility theorem, social welfare functions Limited support of how market preserves fairness.
Normal Form (Matrix) Games
Presentation transcript:

Negotiation A Lesson in Multiagent System Based on Jose Vidal’s book Fundamentals of Multiagent Systems Henry Hexmoor SIUC

Negotiation: The Bargaining Problem Interaction in order to agree on a deal Approach is to exchange messages among agents – Objective is to reach a deal, that: 1.maximizes utilities, 2.avoids expiration, 3.avoids risk of conflict, and 4.avoid failure on deal

Automated Negotiation Knowledge and Decision making is distributed to local sites Utilities are optimized without: 1.central aggregation, or 2.central reasoning Examples: Large organizations, governments, societies

Bargaining problem(Nash 1950) Where represents set of deals R represents real number of states : the no deal deal i.e., agent prefers no deal to negative utility

Pareto Optimal A deal is Pareto Optimal if there is no other deal such that no one prefers it over

For two agents i and j Pareto Frontier Space of possible deals A deal j i

A Negotiation is independent of utility units if when U chooses and when given chooses Where e.g., money in different countries Independence of Utility units Property

Symmetry Property A negotiation protocol is symmetric if the solution remains the same as long as the set of utility function U is the same, regardless of which agent has which the utility.

Rationality A deal is individually rational iff

A negotiation to protocol is independent of irrelevant alternatives if it is true that when given the set of possible deals it chooses and when where it again chooses, assuming U stays constant Irrelevant Alternatives Property

Egalitarian Solution Gains are equally shared and Where E represents set of deals which equal payoff

Egalitarian solution for two… Egalitarian deal may not be Pareto Optimal

Egalitarian Social Welfare solution A deal that maximizes the utility received by the agent with the smallest utility Example: Helping the poor! Every problem is guaranteed to have an egalitarian social welfare solution

Utilitarian solution A deal that the deal that maximizes the sum of all utilities The utilitarian deal is a Pareto optimal deal. There might be more than one utilitarian deals in the case of a tie. The utilitarian deal violates the independence of utility units assumption.

Nash Bargaining solution A deal that maximizes the product of the utilities : The Nash solution is 1.Pareto efficient, 2.independent of utility units, 3.symmetric, and 4.independent of irrelevant alternatives.

Kalai-smorodinsky A deal that distributes utilities in proportion to the maximum that the agent can get. Human preferences for deals is complex!

The Rubinstein Bargaining Process Agents act only at discrete time steps. In each time step, one of the agents proposes a deal to the other who either accepts it or rejects it. If the offer is rejected then we move to the next time step where the other agent gets to propose a deal. Once a deal has been rejected it is considered void and cannot be accepted at a later time. The alternating offers models does not have a dominant strategy. We assume that time is valuable. The agents’ utility for all possible deals is reduced as time passes. E.g., haggling over how to split an ice cream sundae which is slowly melting.

Time matters Introducing a discount factor = i’s discount coefficient at time t = 0 do it now or lose = 1 do it whenever... The agents’ utility for every possible deal decreases monotonically as a function of time with a discount factor.

Theorem The Rubinstein alternating offers game where the agents have complementary linear utilities has a unique subgame perfect equilibrium strategy where – Agent i proposes a deal and accept the offer from j only if – Agent j proposes a deal and accept the offer from i only if

Corollaries

Monotonic Concession Protocol

Zeuthern strategy Willingness to risk deal break down, risk i Agent calculates the risks for both agents. The agent with the smallest risk should concede just enough to get the deal agreed in one step. Zeuthern strategy converges to Nash solution.

One step negotiation (Rosenschein and Zlotkin, 1994) Each agent then has two proposals: the one it makes and the one it receives. The agents must accept the proposal that maximizes the product of the agents’ utilities. If there is a tie then they coordinate and choose one of them at random.

Distributed Search Search through dominant deals as in a hill climbing strategy problems my exist Deals that dominate

Ad-hoc Negotiation Strategies Faratin(Jenning’s student) deployed Multiagent Negotiation systems, such as ADEPT

Task allocation problem mapping agent i incurs a cost for performing task S Example:  Postman problem: Trading letters to lower their costs  Problems with lies...