Of 14 01/03/2015ISCA-2015: Reliable Meaningful Communication1 Reliable Meaningful Communication Madhu Sudan Microsoft, Cambridge, USA.

Slides:



Advertisements
Similar presentations
Noise-Predictive Turbo Equalization for Partial Response Channels Sharon Aviran, Paul H. Siegel and Jack K. Wolf Department of Electrical and Computer.
Advertisements

Locally correctable codes from lifting Alan Guo MIT CSAIL Joint work with Swastik Kopparty (Rutgers) and Madhu Sudan (Microsoft Research)
Of 23 09/24/2013HLF: Reliable Meaningful Communication1 Reliable Meaningful Communication Madhu Sudan Microsoft, Cambridge, USA.
Of 13 10/08/2013MSRNE 5 th Anniversary: Communication Amid Uncertainty1 Communication Amid Uncertainty Madhu Sudan Microsoft Research.
Multiplicity Codes Swastik Kopparty (Rutgers) (based on [K-Saraf-Yekhanin ’11], [K ‘12], [K ‘14])
Of 29 12/02/2013Purdue: Uncertainty in Communication1 Communication amid Uncertainty Madhu Sudan Microsoft, Cambridge, USA Based on: -Universal Semantic.
Of 24 11/20/2012TIFR: Deterministic Communication Amid Uncertainty1 ( Deterministic ) Communication amid Uncertainty Madhu Sudan Microsoft, New England.
Of 30 10/31/2013Cornell: Uncertainty in Communication1 Communication amid Uncertainty Madhu Sudan Microsoft, Cambridge, USA Based on: -Universal Semantic.
Of 30 09/16/2013PACM: Uncertainty in Communication1 Communication amid Uncertainty Madhu Sudan Microsoft, Cambridge, USA Based on: -Universal Semantic.
Probabilistic verification Mario Szegedy, Rutgers www/cs.rutgers.edu/~szegedy/07540 Lecture 4.
Of 7 10/01/2013LIDS Lunch: Communication Amid Uncertainty1 Communication Amid Uncertainty Madhu Sudan Microsoft Research.
Of 30 09/04/2012ITW 2012: Uncertainty in Communication1 Communication amid Uncertainty Madhu Sudan Microsoft, Cambridge, USA Based on: Universal Semantic.
Of 27 01/06/2015CMI: Uncertain Communication1 Communication Amid Uncertainty Madhu Sudan Microsoft Research Based on Juba, S. (STOC 2008, ITCS 2011) Juba,
Of 13 October 6-7, 2010Emerging Frontiers of Information: Kickoff 1 Madhu Sudan Microsoft Research + MIT TexPoint fonts used in EMF. TexPoint fonts used.
Of 10 Uncertainty in Communication1 Communication amid Uncertainty Madhu Sudan Microsoft, Cambridge, USA Based on: Universal Semantic.
For channels with a large noise level: MTD - IKI RAS Dr. Sc. V. V. Zolotarev.
Chapter 6 Information Theory
UCB Claude Shannon – In Memoriam Jean Walrand U.C. Berkeley
Correcting Errors Beyond the Guruswami-Sudan Radius Farzad Parvaresh & Alexander Vardy Presented by Efrat Bank.
6/20/2015List Decoding Of RS Codes 1 Barak Pinhas ECC Seminar Tel-Aviv University.
2/28/03 1 The Virtues of Redundancy An Introduction to Error-Correcting Codes Paul H. Siegel Director, CMRR University of California, San Diego The Virtues.
Forward Error Correction. FEC Basic Idea Send redundant data Receiver uses it to detect/correct errors Reduces retransmissions/NAKs Useful when RTT is.
Barriers to Communication Linzi J Kemp Sept 2003.
Noise, Information Theory, and Entropy
Channel Polarization and Polar Codes
Analysis of Iterative Decoding
Digital Communications Math class.
Of 29 August 4, 2015SIAM AAG: Algebraic Codes and Invariance1 Algebraic Codes and Invariance Madhu Sudan Microsoft Research.
Of 19 June 15, 2015CUHK: Communication Amid Uncertainty1 Communication Amid Uncertainty Madhu Sudan Microsoft Research Based on joint works with Brendan.
Sequential Soft Decision Decoding of Reed Solomon Codes Hari Palaiyanur Cornell University Prof. John Komo Clemson University 2003 SURE Program.
Daphne Koller Message Passing Loopy BP and Message Decoding Probabilistic Graphical Models Inference.
Communication & Computing Madhu Sudan ( MSR New England ) Theories of.
Universität Siegen Institut für Digitale Kommunikationssysteme Univ.-Prof. Dr. Christoph Ruland Hölderlinstraße 3 D Siegen
The Communication Process
Channel Capacity
The Communication Process
11/3/2008Communication & Computation1 A need for a new unifying theory Madhu Sudan MIT CSAIL.
Introduction to Coding Theory. p2. Outline [1] Introduction [2] Basic assumptions [3] Correcting and detecting error patterns [4] Information rate [5]
Summer 2004CS 4953 The Hidden Art of Steganography A Brief Introduction to Information Theory  Information theory is a branch of science that deals with.
Coding Theory Efficient and Reliable Transfer of Information
Of 27 August 6, 2015KAIST: Reliable Meaningful Communication1 Reliable Meaningful Communication Madhu Sudan Microsoft Research.
Section 5.5 The Real Zeros of a Polynomial Function.
Of 22 10/07/2015UMass: Uncertain Communication1 Communication Amid Uncertainty Madhu Sudan Microsoft Research Based on Juba, S. (STOC 2008, ITCS 2011)
Of 22 10/30/2015WUSTL: Uncertain Communication1 Communication Amid Uncertainty Madhu Sudan Harvard Based on Juba, S. (STOC 2008, ITCS 2011) Juba, S. (STOC.
The Communication Model Speech 8 key terms You will present today’s information in the form a speech on WEDNESDAY
Some Computation Problems in Coding Theory
Fundamentals of Communication
Interactive Channel Capacity. [Shannon 48]: A Mathematical Theory of Communication An exact formula for the channel capacity of any noisy channel.
Sequential Soft Decision Decoding of Reed Solomon Codes Hari Palaiyanur Cornell University Prof. John Komo Clemson University 2003 SURE Program.
Welcome This is a template to create an Instructional Design Document of the concept you have selected for creating animation. This will take you through.
The Communication Model Speech 8 key terms You will present today’s information in the form a speech on WEDNESDAY
Shanon Weaver Model Sujit Kumar Mohanty Assistant Professor Department of Journalism & Mass Communication Central University of Orissa Presentation at:-
Source Encoder Channel Encoder Noisy channel Source Decoder Channel Decoder Figure 1.1. A communication system: source and channel coding.
CSI 4118Fall Part 1.1 Signals, Media, And Data Transmission.
Channel Coding and Error Control 1. Outline Introduction Linear Block Codes Cyclic Codes Cyclic Redundancy Check (CRC) Convolutional Codes Turbo Codes.
RS – Reed Solomon Error correcting code. Error-correcting codes are clever ways of representing data so that one can recover the original information.
Fundamentals of Digital Communication
Finding Real Roots of Polynomial Equations
Error-Correcting Codes:
General Strong Polarization
The Fundamental Theorem of Algebra
Communication & Computation A need for a new unifying theory
General Strong Polarization
A Brief Introduction to Information Theory
Mr. Ali Hussain Mugaibel
Signals, Media, And Data Transmission
General Strong Polarization
the communication model
General Strong Polarization
General Strong Polarization
Presentation transcript:

of 14 01/03/2015ISCA-2015: Reliable Meaningful Communication1 Reliable Meaningful Communication Madhu Sudan Microsoft, Cambridge, USA

of 14 Reliable Communication? Problem from the 1940s: Advent of digital age. Problem from the 1940s: Advent of digital age. Communication media are always noisy Communication media are always noisy But digital information less tolerant to noise! But digital information less tolerant to noise! 01/03/2015ISCA-2015: Reliable Meaningful Communication2 AliceAlice BobBob We are not ready We are now ready

of 14 Coding by Repetition 01/03/2015ISCA-2015: Reliable Meaningful Communication3

of 14 Shannon’s Theory [1948] 01/03/2015ISCA-2015: Reliable Meaningful Communication4 AliceAlice BobBob Encoder Decoder

of 14 Shannon’s Theorem 01/03/2015ISCA-2015: Reliable Meaningful Communication5

of 14 Challenges post-Shannon 01/03/2015ISCA-2015: Reliable Meaningful Communication6

of 14 Explicit Codes: Reed-Solomon Code 01/03/2015ISCA-2015: Reliable Meaningful Communication7

of 14 More Errors? List Decoding 01/03/2015ISCA-2015: Reliable Meaningful Communication8

of 14 Reed-Solomon List-Decoding Problem 01/03/2015ISCA-2015: Reliable Meaningful Communication9

of 14 Decoding by example + picture [S’96] Algorithm idea: Find algebraic explanation Find algebraic explanation of all points. of all points. Stare at the solution Stare at the solution (factor the polynomial) (factor the polynomial) Ssss Ssss 01/03/2015ISCA-2015: Reliable Meaningful Communication10

of 14 Decoding by example + picture [S’96] Algorithm idea: Find algebraic explanation Find algebraic explanation of all points. of all points. Stare at the solution Stare at the solution (factor the polynomial) (factor the polynomial) Ssss Ssss 01/03/2015ISCA-2015: Reliable Meaningful Communication11

of 14 01/03/2015ISCA-2015: Reliable Meaningful Communication12 Decoding Algorithm

of 14 Summary and conclusions (Many) errors can be dealt with: (Many) errors can be dealt with: Pre-Shannon: vanishing fraction of errors Pre-Shannon: vanishing fraction of errors Pre-list-decoding: small constant fraction Pre-list-decoding: small constant fraction Post-list-decoding: overwhelming fraction Post-list-decoding: overwhelming fraction Future challenges? Future challenges? Communication can overcome errors introduced by channels. Communication can overcome errors introduced by channels. Can communication overcome errors in misunderstanding between sender and receiver? Can communication overcome errors in misunderstanding between sender and receiver? [Goldreich,Juba,S. ‘2011]; [Juba,Kalai,Khanna,S.’2011] …. [Goldreich,Juba,S. ‘2011]; [Juba,Kalai,Khanna,S.’2011] …. 01/03/2015ISCA-2015: Reliable Meaningful Communication13

of 14 Thank You! 01/03/2015ISCA-2015: Reliable Meaningful Communication14