Of 19 June 15, 2015CUHK: Communication Amid Uncertainty1 Communication Amid Uncertainty Madhu Sudan Microsoft Research Based on joint works with Brendan.

Slides:



Advertisements
Similar presentations
Xiaoming Sun Tsinghua University David Woodruff MIT
Advertisements

Of 23 09/24/2013HLF: Reliable Meaningful Communication1 Reliable Meaningful Communication Madhu Sudan Microsoft, Cambridge, USA.
Of 35 05/30/2012CSOI-Summer: Uncertainty in Communication1 Communication amid Uncertainty Madhu Sudan Microsoft, Cambridge, USA Based on: Universal Semantic.
Of 19 03/21/2012CISS: Beliefs in Communication1 Efficient Semantic Communication & Compatible Beliefs Madhu Sudan Microsoft, New England Based on joint.
Of 13 10/08/2013MSRNE 5 th Anniversary: Communication Amid Uncertainty1 Communication Amid Uncertainty Madhu Sudan Microsoft Research.
Of 29 12/02/2013Purdue: Uncertainty in Communication1 Communication amid Uncertainty Madhu Sudan Microsoft, Cambridge, USA Based on: -Universal Semantic.
Of 24 11/20/2012TIFR: Deterministic Communication Amid Uncertainty1 ( Deterministic ) Communication amid Uncertainty Madhu Sudan Microsoft, New England.
Of 30 10/31/2013Cornell: Uncertainty in Communication1 Communication amid Uncertainty Madhu Sudan Microsoft, Cambridge, USA Based on: -Universal Semantic.
Of 30 09/16/2013PACM: Uncertainty in Communication1 Communication amid Uncertainty Madhu Sudan Microsoft, Cambridge, USA Based on: -Universal Semantic.
Information Theory EE322 Al-Sanie.
Gillat Kol (IAS) joint work with Ran Raz (Weizmann + IAS) Interactive Channel Capacity.
Of 7 10/01/2013LIDS Lunch: Communication Amid Uncertainty1 Communication Amid Uncertainty Madhu Sudan Microsoft Research.
Universal Communication Brendan Juba (MIT) With: Madhu Sudan (MIT)
Of 30 09/04/2012ITW 2012: Uncertainty in Communication1 Communication amid Uncertainty Madhu Sudan Microsoft, Cambridge, USA Based on: Universal Semantic.
1 Information complexity and exact communication bounds April 26, 2013 Mark Braverman Princeton University Based on joint work with Ankit Garg, Denis Pankratov,
Enhancing Secrecy With Channel Knowledge
Of 27 01/06/2015CMI: Uncertain Communication1 Communication Amid Uncertainty Madhu Sudan Microsoft Research Based on Juba, S. (STOC 2008, ITCS 2011) Juba,
Of 13 October 6-7, 2010Emerging Frontiers of Information: Kickoff 1 Madhu Sudan Microsoft Research + MIT TexPoint fonts used in EMF. TexPoint fonts used.
Of 14 01/03/2015ISCA-2015: Reliable Meaningful Communication1 Reliable Meaningful Communication Madhu Sudan Microsoft, Cambridge, USA.
Of 10 Uncertainty in Communication1 Communication amid Uncertainty Madhu Sudan Microsoft, Cambridge, USA Based on: Universal Semantic.
Of 12 03/22/2012CISS: Compression w. Uncertain Priors1 Compression under uncertain priors Madhu Sudan Microsoft, New England Based on joint works with:
Sparse Random Linear Codes are Locally Decodable and Testable Tali Kaufman (MIT) Joint work with Madhu Sudan (MIT)
2015/6/15VLC 2006 PART 1 Introduction on Video Coding StandardsVLC 2006 PART 1 Variable Length Coding  Information entropy  Huffman code vs. arithmetic.
Lattices for Distributed Source Coding - Reconstruction of a Linear function of Jointly Gaussian Sources -D. Krithivasan and S. Sandeep Pradhan - University.
2015/7/12VLC 2008 PART 1 Introduction on Video Coding StandardsVLC 2008 PART 1 Variable Length Coding  Information entropy  Huffman code vs. arithmetic.
CSI Uncertainty in A.I. Lecture 201 Basic Information Theory Review Measuring the uncertainty of an event Measuring the uncertainty in a probability.
In a World of BPP=P Oded Goldreich Weizmann Institute of Science.
Of 30 Locality in Coding Theory Madhu Sudan MSR June 16, 2015ISIT: Locality in Coding Theory1.
Of 33 March 1, 2011 Semantic UCLA1 Universal Semantic Communication Madhu Sudan Microsoft Research + MIT Joint with Oded Goldreich (Weizmann)
Of 35 05/16/2012CTW: Communication and Computation1 Communication amid Uncertainty Madhu Sudan Microsoft, Cambridge, USA Based on: Universal Semantic Communication.
Some basic concepts of Information Theory and Entropy
Of 29 August 4, 2015SIAM AAG: Algebraic Codes and Invariance1 Algebraic Codes and Invariance Madhu Sudan Microsoft Research.
Limits of Local Algorithms in Random Graphs
Communication & Computing Madhu Sudan ( MSR New England ) Theories of.
Basic Concepts of Encoding Codes, their efficiency and redundancy 1.
A Continuity Theory of Source Coding over Networks WeiHsin Gu, Michelle Effros, Mayank Bakshi, and Tracey Ho FLoWS PI Meeting, Washington DC, September.
Rei Safavi-Naini University of Calgary Joint work with: Hadi Ahmadi iCORE Information Security.
Erasure Coding for Real-Time Streaming Derek Leong and Tracey Ho California Institute of Technology Pasadena, California, USA ISIT
Information Theory The Work of Claude Shannon ( ) and others.
Coding Theory Efficient and Reliable Transfer of Information
Superposition encoding A distorted version of is is encoded into the inner codebook Receiver 2 decodes using received signal and its side information Decoding.
Of 27 August 6, 2015KAIST: Reliable Meaningful Communication1 Reliable Meaningful Communication Madhu Sudan Microsoft Research.
The Price of Uncertainty in Communication Brendan Juba (Washington U., St. Louis) with Mark Braverman (Princeton)
Of 22 10/07/2015UMass: Uncertain Communication1 Communication Amid Uncertainty Madhu Sudan Microsoft Research Based on Juba, S. (STOC 2008, ITCS 2011)
Of 22 10/30/2015WUSTL: Uncertain Communication1 Communication Amid Uncertainty Madhu Sudan Harvard Based on Juba, S. (STOC 2008, ITCS 2011) Juba, S. (STOC.
Gillat Kol (IAS) joint work with Anat Ganor (Weizmann) Ran Raz (Weizmann + IAS) Exponential Separation of Information and Communication.
Mutual Information, Joint Entropy & Conditional Entropy
Of 17 Limits of Local Algorithms in Random Graphs Madhu Sudan MSR Joint work with David Gamarnik (MIT) 7/11/2013Local Algorithms on Random Graphs1.
SEAC-3 J.Teuhola Information-Theoretic Foundations Founder: Claude Shannon, 1940’s Gives bounds for:  Ultimate data compression  Ultimate transmission.
Entropy estimation and lossless compression Structure and Entropy of English How much lossless compression can be achieved for a given image? How much.
Imperfectly Shared Randomness
Communication Amid Uncertainty
Sublinear-Time Error-Correction and Error-Detection
And now for something completely different!
Communication Amid Uncertainty
Towards Measuring Anonymity
Error-Correcting Codes:
General Strong Polarization
Communication Amid Uncertainty
Communication amid Uncertainty
General Strong Polarization
Communication Amid Uncertainty
Pragmatics of Persuasion
Uncertain Compression
General Strong Polarization
Imperfectly Shared Randomness
Communication Amid Uncertainty
What should I talk about? Aspects of Human Communication
General Strong Polarization
General Strong Polarization
Presentation transcript:

of 19 June 15, 2015CUHK: Communication Amid Uncertainty1 Communication Amid Uncertainty Madhu Sudan Microsoft Research Based on joint works with Brendan Juba, Oded Goldreich, Adam Kalai, Sanjeev Khanna, Elad Haramaty, Jacob Leshno, Clement Canonne, Venkatesan Guruswami, Badih Ghazi, Pritish Kamath, Ilan Komargodski and Pravesh Kothari.

of 27 Context in Communication June 15, 2015CUHK: Communication Amid Uncertainty2

of 27 Communication Complexity Communication Complexity The model The model June 15, 2015CUHK: Communication Amid Uncertainty3 (with shared randomness) AliceAlice BobBob w.p. 2/3 Usually studied for lower bounds. This talk: CC as +ve model.

of 27 Modelling Shared Context + Imperfection 03/26/2015MSR Theory Day: ISR in Communication

of 27 Part 1: Uncertain Compression June 15, 2015CUHK: Communication Amid Uncertainty5

of 27 Specific Motivation: Dictionary 10/31/2013Cornell: Uncertainty in Communication6

of 27 Context? In general complex notion … In general complex notion … What does sender know/believe What does sender know/believe What does receiver know/believe What does receiver know/believe Modifies as conversation progresses. Modifies as conversation progresses. Our abstraction: Our abstraction: Context = Probability distribution on potential “meanings”. Context = Probability distribution on potential “meanings”. Certainly part of what the context provides; and sufficient abstraction to highlight the problem. Certainly part of what the context provides; and sufficient abstraction to highlight the problem. 10/31/2013Cornell: Uncertainty in Communication7

of 27 The (Uncertain Compression) problem 10/31/2013Cornell: Uncertainty in Communication8

of 27 Closeness of distributions: 10/31/2013Cornell: Uncertainty in Communication9

of 27 Dictionary = Shared Randomness? 10/31/2013Cornell: Uncertainty in Communication10

of 27 Solution (variant of Arith. Coding) 10/31/2013Cornell: Uncertainty in Communication11

of 27 Performance 10/31/2013Cornell: Uncertainty in Communication12

of 27 Implications Reflects the tension between ambiguity resolution and compression. Reflects the tension between ambiguity resolution and compression. Larger the ((estimated) gap in context), larger the encoding length. Larger the ((estimated) gap in context), larger the encoding length. Entropy is still a valid measure! Entropy is still a valid measure! Coding scheme reflects the nature of human communication (extend messages till they feel unambiguous). Coding scheme reflects the nature of human communication (extend messages till they feel unambiguous). The “shared randomness’’ assumption The “shared randomness’’ assumption A convenient starting point for discussion A convenient starting point for discussion But is dictionary independent of context? But is dictionary independent of context? This is problematic. This is problematic. 10/31/2013Cornell: Uncertainty in Communication13

of 27 Deterministic Compression: Challenge 10/31/2013Cornell: Uncertainty in Communication14

of 27 Part 2: Imperfectly Shared Randomness June 15, 2015CUHK: Communication Amid Uncertainty15

of 27 Model: Imperfectly Shared Randomness 03/26/2015MSR Theory Day: ISR in Communication16

of 27 Imperfectly Shared Randomness: Results 03/26/2015MSR Theory Day: ISR in Communication17

of 27 Aside: Easy CC Problems 03/26/2015MSR Theory Day: ISR in Communication18 Thanks to Badih Ghazi and Pritish Kamath

of 27 Equality Testing (our proof) 03/26/2015MSR Theory Day: ISR in Communication19 GaussianProtocol

of 27 General One-Way Communication 03/26/2015MSR Theory Day: ISR in Communication20

of 27 General One-Way Communication 03/26/2015MSR Theory Day: ISR in Communication21

of 27 Two-way communication 03/26/2015MSR Theory Day: ISR in Communication22

of 27 Part 3: Uncertain Functionality June 15, 2015CUHK: Communication Amid Uncertainty23

of 27 Model June 15, 2015CUHK: Communication Amid Uncertainty24

of 27 Results June 15, 2015CUHK: Communication Amid Uncertainty25

of 27 Conclusions Context Important: Context Important: New layer of uncertainty. New layer of uncertainty. New notion of scale (context LARGE ) New notion of scale (context LARGE ) Many open directions+questions Many open directions+questions June 15, 2015CUHK: Communication Amid Uncertainty26

of 27 Thank You! June 15, 2015CUHK: Communication Amid Uncertainty27