Of 19 03/21/2012CISS: Beliefs in Communication1 Efficient Semantic Communication & Compatible Beliefs Madhu Sudan Microsoft, New England Based on joint.

Slides:

Advertisements

Similar presentations

Erasmus Mundus Information Day 20 January Erasmus Mundus Information Day 20 January ERASMUS MUNDUS PREPARING YOUR APPLICATION.

Advertisements

Exploiting Deadline Flexibility in Grid Workflow Rescheduling Wei Chen Alan Fekete Young Choon Lee.

School Leadership that Works:

Of 23 09/24/2013HLF: Reliable Meaningful Communication1 Reliable Meaningful Communication Madhu Sudan Microsoft, Cambridge, USA.

Writing Bad-News Messages

[ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] Bonn, 19 March 2007 Effective Evaluation for Complex Communication Management. The Uses and Abuses.

Computing functions with Turing machines

Of 35 05/30/2012CSOI-Summer: Uncertainty in Communication1 Communication amid Uncertainty Madhu Sudan Microsoft, Cambridge, USA Based on: Universal Semantic.

Of 12 12/04/2013CSOI: Communication as Coordination1 Communication as Coordination Madhu Sudan Microsoft, Cambridge, USA -

Of 31 09/19/2011UIUC: Communication & Computation1 Communication & Computation A need for a new unifying theory Madhu Sudan Microsoft, New England.

PSC 151 Laboratory Activity 9 Electric Circuits II Series and Parallel Connections.

X. Cai C. Fang R. Guo W. Yu B. Qian S.Jiang CSC7333 Machine Learning Project Presentation April.30 th, 2013.

Of 13 10/08/2013MSRNE 5 th Anniversary: Communication Amid Uncertainty1 Communication Amid Uncertainty Madhu Sudan Microsoft Research.

1 Logic Programming School of Informatics, University of Edinburgh Logic Programming in 50 Minutes The purpose of this lecture is to explain why logic.

Modelling uncertainty in 3APL Johan Kwisthout Master Thesis

Semantic communication with simple goals is equivalent to on-line learning Brendan Juba (MIT CSAIL & Harvard) with Santosh Vempala (Georgia Tech) Full.

Planning with Non-Deterministic Uncertainty (Where failure is not an option) R&N: Chap. 12, Sect (+ Chap. 10, Sect 10.7)

Of 29 12/02/2013Purdue: Uncertainty in Communication1 Communication amid Uncertainty Madhu Sudan Microsoft, Cambridge, USA Based on: -Universal Semantic.

Of 24 11/20/2012TIFR: Deterministic Communication Amid Uncertainty1 ( Deterministic ) Communication amid Uncertainty Madhu Sudan Microsoft, New England.

Of 30 10/31/2013Cornell: Uncertainty in Communication1 Communication amid Uncertainty Madhu Sudan Microsoft, Cambridge, USA Based on: -Universal Semantic.

Of 30 09/16/2013PACM: Uncertainty in Communication1 Communication amid Uncertainty Madhu Sudan Microsoft, Cambridge, USA Based on: -Universal Semantic.

Universal Semantic Communication Brendan Juba (Harvard and MIT) with Madhu Sudan (MSR and MIT) & Oded Goldreich (Weizmann)

February Semantic CMU1 Semantic Goal-Oriented Communication Madhu Sudan Microsoft Research + MIT Joint with Oded Goldreich (Weizmann)

Creativity What/Who is creative? What/Who is creative? Folded bike, breathing sofa, futon Folded bike, breathing sofa, futon Fried instant noodles, (your.

BAYESIAN NETWORKS Ivan Bratko Faculty of Computer and Information Sc. University of Ljubljana.

NON - zero sum games.

1 PROPERTIES OF A TYPE ABSTRACT INTERPRETATER. 2 MOTIVATION OF THE EXPERIMENT § a well understood case l type inference in functional programming à la.

Evolution and Repeated Games D. Fudenberg (Harvard) E. Maskin (IAS, Princeton)

Of 7 10/01/2013LIDS Lunch: Communication Amid Uncertainty1 Communication Amid Uncertainty Madhu Sudan Microsoft Research.

Semantic Communication Madhu Sudan (based on joint work with Brendan Juba (MIT); and upcoming work with Oded Goldreich (Weizmann) & J. )

Of 30 09/04/2012ITW 2012: Uncertainty in Communication1 Communication amid Uncertainty Madhu Sudan Microsoft, Cambridge, USA Based on: Universal Semantic.

Of 29 May 2, 2011 Semantic Northwestern1 Universal Semantic Communication Madhu Sudan Microsoft Research Joint with Oded Goldreich (Weizmann)

Of 27 01/06/2015CMI: Uncertain Communication1 Communication Amid Uncertainty Madhu Sudan Microsoft Research Based on Juba, S. (STOC 2008, ITCS 2011) Juba,

Of 13 October 6-7, 2010Emerging Frontiers of Information: Kickoff 1 Madhu Sudan Microsoft Research + MIT TexPoint fonts used in EMF. TexPoint fonts used.

Of 32 October 19, 2010Semantic U.Penn. 1 Semantic Goal-Oriented Communication Madhu Sudan Microsoft Research + MIT Joint with Oded Goldreich.

Of 10 Uncertainty in Communication1 Communication amid Uncertainty Madhu Sudan Microsoft, Cambridge, USA Based on: Universal Semantic.

Of 12 03/22/2012CISS: Compression w. Uncertain Priors1 Compression under uncertain priors Madhu Sudan Microsoft, New England Based on joint works with:

Good Research Questions. A paradigm consists of – a set of fundamental theoretical assumptions that the members of the scientific community accept as.

Reliability Risk Assessment

Of 30 September 22, 2010Semantic Berkeley 1 Semantic Goal-Oriented Communication Madhu Sudan Microsoft Research + MIT Joint with Oded Goldreich.

Efficient Semantic Communication via Compatible Beliefs Brendan Juba (MIT CSAIL & Harvard) with Madhu Sudan (MSR & MIT)

Of 33 March 1, 2011 Semantic UCLA1 Universal Semantic Communication Madhu Sudan Microsoft Research + MIT Joint with Oded Goldreich (Weizmann)

Of 35 05/16/2012CTW: Communication and Computation1 Communication amid Uncertainty Madhu Sudan Microsoft, Cambridge, USA Based on: Universal Semantic Communication.

CHAPTER 11 Episodes, Contexts, and Intercultural Interactions

EPISODES, CONTEXTS, AND INTERCULTURAL INTERACTIONS

Of 19 June 15, 2015CUHK: Communication Amid Uncertainty1 Communication Amid Uncertainty Madhu Sudan Microsoft Research Based on joint works with Brendan.

Web Policy Zeitgeist Panel SWPW 2005 – Galway, Ireland Piero Bonatti, November 7th, 2005.

Limits of Local Algorithms in Random Graphs

Communication & Computing Madhu Sudan ( MSR New England ) Theories of.

Argumentation and Trust: Issues and New Challenges Jamal Bentahar Concordia University (Montreal, Canada) University of Namur, Belgium, June 26, 2007.

Language1 Words, Words, and More Words Chapter 4 Lecture An Early Communication Theory: General Semantics The Listening – Lights

NATURE OF OB Total System Approach Nature of Organisational behaviour

Enhancing Interactive Visual Data Analysis by Statistical Functionality Jürgen Platzer VRVis Research Center Vienna, Austria.

2/2/2009Semantic Communication: MIT TOC Colloquium1 Semantic Goal-Oriented Communication Madhu Sudan Microsoft Research + MIT Joint with Oded Goldreich.

Of 27 August 6, 2015KAIST: Reliable Meaningful Communication1 Reliable Meaningful Communication Madhu Sudan Microsoft Research.

Of 22 10/07/2015UMass: Uncertain Communication1 Communication Amid Uncertainty Madhu Sudan Microsoft Research Based on Juba, S. (STOC 2008, ITCS 2011)

Of 22 10/30/2015WUSTL: Uncertain Communication1 Communication Amid Uncertainty Madhu Sudan Harvard Based on Juba, S. (STOC 2008, ITCS 2011) Juba, S. (STOC.

10/14/2008Semantic Communication1 Universal Semantic Communication Madhu Sudan MIT CSAIL Joint work with Brendan Juba (MIT CSAIL).

Data Mining with Big Data IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2014 Xiangyu Cai （）

Gillat Kol (IAS) joint work with Anat Ganor (Weizmann) Ran Raz (Weizmann + IAS) Exponential Separation of Information and Communication.

Of 17 Limits of Local Algorithms in Random Graphs Madhu Sudan MSR Joint work with David Gamarnik (MIT) 7/11/2013Local Algorithms on Random Graphs1.

Universal Semantic Communication

Communication amid Uncertainty

Universal Semantic Communication

Universal Semantic Communication

Universal Semantic Communication

Universal Semantic Communication

Universal Semantic Communication

Universal Semantic Communication

General Strong Polarization

Presentation transcript:

of 19 03/21/2012CISS: Beliefs in Communication1 Efficient Semantic Communication & Compatible Beliefs Madhu Sudan Microsoft, New England Based on joint works with: Oded Goldreich (Weizmann) and Brendan Juba (Harvard)

of 19 03/21/2012CISS: Beliefs in Communication2 Part I: Background on Semantic Communication

of 19 Semantic Communication: Motivation First era of communication: Reliable Wires First era of communication: Reliable Wires Essentially done: wires are very reliable; performance can be enhanced (maybe) quantitatively but not qualitatively. Essentially done: wires are very reliable; performance can be enhanced (maybe) quantitatively but not qualitatively. Can we get endpoints to also be reliable? Can we get endpoints to also be reliable? Modern systems have smart endpoints. Modern systems have smart endpoints. Smart implies capability. Smart implies capability. Smart implies diversity. Smart implies diversity. But diversity implies (potential) misunderstanding. But diversity implies (potential) misunderstanding. Semantic Communication [Goldreich,Juba+S 10] Semantic Communication [Goldreich,Juba+S 10] Detect/Correct Misunderstanding. Detect/Correct Misunderstanding. 03/21/2012CISS: Beliefs in Communication3

of 19 Semantic Communication: Model - I 03/21/2012CISS: Beliefs in Communication4 A

of 19 Uncertainty about the receiver: Uncertainty about the receiver: (User doesnt know server; vice versa). (User doesnt know server; vice versa). Semantic Communication: Model - II 03/21/2012CISS: Beliefs in Communication5 A B Channel B2B2B2B2 AkAkAkAk A3A3A3A3 A2A2A2A2 A1A1A1A1 B1B1B1B1 B3B3B3B3 BjBjBjBj New Class of Problems New challenges Needs more attention!

of 19 Semantic Communication: Model - IIIa Goal-oriented communication: Goal-oriented communication: User attempting to reach some goal. User attempting to reach some goal. How to model this? How to model this? Classical approaches: Classical approaches: Some function of state of user, or some function of transcript of interaction etc. Some function of state of user, or some function of transcript of interaction etc. Fails in semantic/uncertainty setting. Fails in semantic/uncertainty setting. Our [GJS] approach: Introduce a (hypothetical) third agent. Our [GJS] approach: Introduce a (hypothetical) third agent. 03/21/2012CISS: Beliefs in Communication6

of 19 Semantic Communication: Model - IIIb March 1, 2011Semantic UCLA7UserServer Referee/Environment

of 19 Basic Definitions: Helpfulness, Universality, Sensing What makes a server helpful? What makes a server helpful? S is G-helpful, if there exists a user who can achieve goal (efficiently) for every starting state of S. S is G-helpful, if there exists a user who can achieve goal (efficiently) for every starting state of S. Universality: Universality: User U is universal if it achieves G with every G-helpful server. User U is universal if it achieves G with every G-helpful server. Sensing? Sensing? Roughly, Goal G can be sensed if there exists an efficient algorithm that scan use (with their inputs) to see if Referee will accept. Roughly, Goal G can be sensed if there exists an efficient algorithm that scan use (with their inputs) to see if Referee will accept. 03/21/2012CISS: Beliefs in Communication8

of 19 Principal Thesis and Theorem 03/21/2012CISS: Beliefs in Communication9

of 19 Proof + Insights Positive results by enumeration. Positive results by enumeration. Negative? Mostly by definition. Negative? Mostly by definition. Insights: Insights: Servers should know how to be interrupted. (How else can they function independent of complexity of their own state?) Servers should know how to be interrupted. (How else can they function independent of complexity of their own state?) Short interrupt signal helps. Short interrupt signal helps. Goals should be senseible. Goals should be senseible. 03/21/2012CISS: Beliefs in Communication10

of 19 03/21/2012CISS: Beliefs in Communication11 Part II: Beliefs & Compatibility

of 19 Motivation Why does natural (human) communication differ so much from designed communication? Why does natural (human) communication differ so much from designed communication? Languages are ambiguous Languages are ambiguous They violate their own grammatical rules They violate their own grammatical rules They are needlessly redundant at times, and noisily compressed at other times? They are needlessly redundant at times, and noisily compressed at other times? Can we use information theory to explain such phenomena (departures from information theory)? Can we use information theory to explain such phenomena (departures from information theory)? Use fact that natural communication deals with uncertainty about server. Use fact that natural communication deals with uncertainty about server. 03/21/2012CISS: Beliefs in Communication12

of 19 Does Semantic Communication help? Pros: Pros: Does deal with uncertainty about servers. Does deal with uncertainty about servers. Cons: Cons: Seems quite inefficient (user is enumerating all servers?). Seems quite inefficient (user is enumerating all servers?). Seems to throw away all knowledge about server (that might yield efficiency). Seems to throw away all knowledge about server (that might yield efficiency). Is universality really a goal? Is it not at odds with use of knowledge Is universality really a goal? Is it not at odds with use of knowledge 03/21/2012CISS: Beliefs in Communication13

of 19 Beliefs in Semantic Communication 03/21/2012CISS: Beliefs in Communication14

of 19 Compatibility of Beliefs 03/21/2012CISS: Beliefs in Communication15

of 19 Server Performance? 03/21/2012CISS: Beliefs in Communication16

of 19 Universality of Users under Beliefs 03/21/2012CISS: Beliefs in Communication17

of 19 Consequences/Conclusions Universality of communication is not at odds with efficiency. Universality of communication is not at odds with efficiency. Efficiency comes with compatibility of communicating players. Efficiency comes with compatibility of communicating players. Universality takes care of possibility of misunderstanding, at an affordable price. Universality takes care of possibility of misunderstanding, at an affordable price. 03/21/2012CISS: Beliefs in Communication18

of 19 Thank You 03/21/2012CISS: Beliefs in Communication19