Learning and Testing Submodular Functions Grigory Yaroslavtsev Slides at

Slides:



Advertisements
Similar presentations
1/15 Agnostically learning halfspaces FOCS /15 Set X, F class of functions f: X! {0,1}. Efficient Agnostic Learner w.h.p. h: X! {0,1} poly(1/ )
Advertisements

Truthful Mechanisms for Combinatorial Auctions with Subadditive Bidders Speaker: Shahar Dobzinski Based on joint works with Noam Nisan & Michael Schapira.
Combinatorial Auctions with Complement-Free Bidders – An Overview Speaker: Michael Schapira Based on joint works with Shahar Dobzinski & Noam Nisan.
Boyce/DiPrima 9th ed, Ch 2.4: Differences Between Linear and Nonlinear Equations Elementary Differential Equations and Boundary Value Problems, 9th edition,
Conditional Equilibrium Outcomes via Ascending Price Processes Joint work with Hu Fu and Robert Kleinberg (Computer Science, Cornell University) Ron Lavi.
Learning and Testing Submodular Functions Grigory Yaroslavtsev Columbia University October 26, 2012 With Sofya Raskhodnikova (SODA’13) + Work in progress.
Property Testing and Communication Complexity Grigory Yaroslavtsev
Lower Bounds for Testing Properties of Functions on Hypergrids Grigory Yaroslavtsev Joint with: Eric Blais (MIT) Sofya Raskhodnikova.
Grigory Yaroslavtsev Joint work with Piotr Berman and Sofya Raskhodnikova.
Approximate List- Decoding and Hardness Amplification Valentine Kabanets (SFU) joint work with Russell Impagliazzo and Ragesh Jaiswal (UCSD)
Online Mechanism Design (Randomized Rounding on the Fly)
OR of XORs of Singletons. Approximation Algorithms for CAs with Complement-Free Bidders ClassUpper BoundLower Bound Generalmin {n, O(m 1/2 )} min {n, O(m.
Private Analysis of Graph Structure With Vishesh Karwa, Sofya Raskhodnikova and Adam Smith Pennsylvania State University Grigory Yaroslavtsev
Maximizing the Spread of Influence through a Social Network
Ch 5.8: Bessel’s Equation Bessel Equation of order :
Estimating the Unseen: Sublinear Statistics Paul Valiant.
Learning Submodular Functions Nick Harvey University of Waterloo Joint work with Nina Balcan, Georgia Tech.
Learning Submodular Functions Nick Harvey, Waterloo C&O Joint work with Nina Balcan, Georgia Tech.
Welfare Maximization in Congestion Games Liad Blumrosen and Shahar Dobzinski The Hebrew University.
Learning and Fourier Analysis Grigory Yaroslavtsev CIS 625: Computational Learning Theory.
Limitations of VCG-Based Mechanisms Shahar Dobzinski Joint work with Noam Nisan.
An Improved Approximation Algorithm for Combinatorial Auctions with Submodular Bidders.
An Improved Approximation Algorithm for Combinatorial Auctions with Submodular Bidders Speaker: Shahar Dobzinski Joint work with Michael Schapira.
Bayesian Combinatorial Auctions Giorgos Christodoulou, Annamaria Kovacs, Michael Schapira האוניברסיטה העברית בירושלים The Hebrew University of Jerusalem.
Computation and Incentives in Combinatorial Public Projects Michael Schapira Yale University and UC Berkeley Joint work with Dave Buchfuhrer and Yaron.
Query Lower Bounds for Matroids via Group Representations Nick Harvey.
Approximation Algorithms for Combinatorial Auctions with Complement-Free Bidders Speaker: Michael Schapira Joint work with Shahar Dobzinski & Noam Nisan.
Efficiently handling discrete structure in machine learning Stefanie Jegelka MADALGO summer school.
Noam Nisan Non-price Equilibria in Markets of Discrete goods Avinatan Hassidim, Haim Kaplan, Yishay Mansour, Noam Nisan.
Learning Submodular Functions
Chap. 4 Continuous Distributions
Online Mechanism Design (Randomized Rounding on the Fly) Piotr Krysta, University of Liverpool, UK Berthold Vöcking, RWTH Aachen University, Germany.
Preference elicitation Communicational Burden by Nisan, Segal, Lahaie and Parkes October 27th, 2004 Jella Pfeiffer.
Approximating Submodular Functions Part 2 Nick Harvey University of British Columbia Department of Computer Science July 12 th, 2015 Joint work with Nina.
Submodular Functions Learnability, Structure & Optimization Nick Harvey, UBC CS Maria-Florina Balcan, Georgia Tech.
Slide 1 of 16 Noam Nisan The Power and Limitations of Item Price Combinatorial Auctions Noam Nisan Hebrew University, Jerusalem.
Randomized Composable Core-sets for Submodular Maximization Morteza Zadimoghaddam and Vahab Mirrokni Google Research New York.
Maximizing the Spread of Influence through a Social Network Authors: David Kempe, Jon Kleinberg, É va Tardos KDD 2003.
AAMAS 2013 best-paper: “Mechanisms for Multi-Unit Combinatorial Auctions with a Few Distinct Goods” Piotr KrystaUniversity of Liverpool, UK Orestis TelelisAUEB,
Lecture 17: The Discrete Fourier Series Instructor: Dr. Ghazi Al Sukkar Dept. of Electrical Engineering The University of Jordan
Fast Fourier Sparsity Testing over the Boolean Hypercube Grigory Yaroslavtsev Joint with Andrew Arnold (Waterloo), Arturs Backurs (MIT),
Deterministic Algorithms for Submodular Maximization Problems Moran Feldman The Open University of Israel Joint work with Niv Buchbinder.
Approximation Algorithms for Combinatorial Auctions with Complement-Free Bidders Speaker: Shahar Dobzinski Joint work with Noam Nisan & Michael Schapira.
6 6.3 © 2016 Pearson Education, Inc. Orthogonality and Least Squares ORTHOGONAL PROJECTIONS.
4.2 Area Definition of Sigma Notation = 14.
Min-Plus Linear Systems Theory Min-Plus Linear Systems Theory.
Digital Image Processing, 2nd ed. www. imageprocessingbook.com © 2001 R. C. Gonzalez & R. E. Woods 1 Review: Linear Systems Some Definitions With reference.
Unconstrained Submodular Maximization Moran Feldman The Open University of Israel Based On Maximizing Non-monotone Submodular Functions. Uriel Feige, Vahab.
MA4229 Lectures 13, 14 Week 12 Nov 1, Chapter 13 Approximation to periodic functions.
Paper Code : BCA-03 Paper Title : Mathematics Theory.
Approximation algorithms for combinatorial allocation problems
Combinatorial Public Projects
INTEGRATION & TECHNIQUES OF INTEGRATION
Dana Ron Tel Aviv University
Vitaly Feldman and Jan Vondrâk IBM Research - Almaden
Understanding Generalization in Adaptive Data Analysis
Warren Center for Network and Data Sciences
Vitaly (the West Coast) Feldman
CIS 700: “algorithms for Big Data”
Discrete Fourier Transform
Before: November 28, 2017 Solve each system by graphing. 1. y = 2x – 1
Advances in Linear Sketching over Finite Fields
Population Proportion
CSCI B609: “Foundations of Data Science”
Kempe-Kleinberg-Tardos Conjecture A simple proof
Systems of Equations Solve by Graphing.
CIS 700: “algorithms for Big Data”
Table 2: Experimental results for linear ELP
Data-Dependent Approximation
Presentation transcript:

Learning and Testing Submodular Functions Grigory Yaroslavtsev Slides at CIS 625: Computational Learning Theory

Submodularity

Approximating everywhere

Approximate learning

Goemans, Harvey, Iwata, Mirrokni Balcan, Harvey Gupta, Hardt, Roth, Ullman Cheraghchi, Klivans, Kothari, Lee Raskhodnikova, Y. Learning TimePoly(|X|) Extra features Under arbitrary distribution Tolerant queries SQ- queries, Agnostic

Learning: Bigger picture XOS = Fractionally subadditive Subadditive Submodular Gross substitutes OXS [Badanidiyuru, Dobzinski, Fu, Kleinberg, Nisan, Roughgarden,SODA’12] Additive (linear) Coverage (valuations)

Discrete convexity

Monotone submodular Submodular

Discrete monotone submodularity

Representation by a formula

Discrete submodularity

Proof

Coverage by monotone lower bounds

Learning pB-formulas and k-DNF

Learning Fourier coefficients

Property testing

Testing by implicit learning

Previous work on testing submodularity

Directions