Supervised learning Given training examples of inputs and corresponding outputs, produce the “correct” outputs for new inputs Two main scenarios: –Classification:

Slides:

Advertisements

Similar presentations

Applications of one-class classification

Advertisements

Pseudo-Relevance Feedback For Multimedia Retrieval By Rong Yan, Alexander G. and Rong Jin Mwangi S. Kariuki

Feature Selection as Relevant Information Encoding Naftali Tishby School of Computer Science and Engineering The Hebrew University, Jerusalem, Israel NIPS.

Unsupervised Learning Clustering K-Means. Recall: Key Components of Intelligent Agents Representation Language: Graph, Bayes Nets, Linear functions Inference.

Unsupervised Learning

Machine learning continued Image source:

An Overview of Machine Learning

Indian Statistical Institute Kolkata

Patch to the Future: Unsupervised Visual Prediction

COMP 875: Introductions Name, year, research area/group

Unsupervised Learning: Clustering Rong Jin Outline  Unsupervised learning  K means for clustering  Expectation Maximization algorithm for clustering.

Learning From Data Chichang Jou Tamkang University.

Introduction to Machine Learning course fall 2007 Lecturer: Amnon Shashua Teaching Assistant: Yevgeny Seldin School of Computer Science and Engineering.

ML ALGORITHMS. Algorithm Types Classification (supervised) Given -> A set of classified examples “instances” Produce -> A way of classifying new examples.

Part I: Classification and Bayesian Learning

Chapter 5 Data mining : A Closer Look.

Introduction to machine learning

Statistical Natural Language Processing. What is NLP?  Natural Language Processing (NLP), or Computational Linguistics, is concerned with theoretical.

CS Machine Learning. What is Machine Learning? Adapt to / learn from data  To optimize a performance function Can be used to:  Extract knowledge.

Crash Course on Machine Learning

More Machine Learning Linear Regression Squared Error L1 and L2 Regularization Gradient Descent.

Introduction to Machine Learning for Category Representation

Introduction Mohammad Beigi Department of Biomedical Engineering Isfahan University

Machine Learning. Learning agent Any other agent.

Data Mining Joyeeta Dutta-Moscato July 10, Wherever we have large amounts of data, we have the need for building systems capable of learning information.

Mehdi Ghayoumi Kent State University Computer Science Department Summer 2015 Exposition on Cyber Infrastructure and Big Data.

INTRODUCTION TO MACHINE LEARNING. $1,000,000 Machine Learning  Learn models from data  Three main types of learning :  Supervised learning  Unsupervised.

Machine learning & category recognition Cordelia Schmid Jakob Verbeek.

Reinforcement Learning

Introduction to Machine Learning for Category Representation Jakob Verbeek November 27, 2009 Many slides adapted from S. Lazebnik.

Machine Learning CSE 681 CH2 - Supervised Learning.

Bayesian networks Classification, segmentation, time series prediction and more. Website: Twitter:

Overview of Supervised Learning Overview of Supervised Learning2 Outline Linear Regression and Nearest Neighbors method Statistical Decision.

1 Pattern Recognition Pattern recognition is: 1. A research area in which patterns in data are found, recognized, discovered, …whatever. 2. A catchall.

Learning from observations

Indirect Supervision Protocols for Learning in Natural Language Processing II. Learning by Inventing Binary Labels This work is supported by DARPA funding.

Applications of Supervised Learning in Bioinformatics Yen-Jen Oyang Dept. of Computer Science and Information Engineering.

Clustering Instructor: Max Welling ICS 178 Machine Learning & Data Mining.

Machine learning Image source:

Data Mining and Decision Support

6.S093 Visual Recognition through Machine Learning Competition Image by kirkh.deviantart.com Joseph Lim and Aditya Khosla Acknowledgment: Many slides from.

Foundational Issues Machine Learning 726 Simon Fraser University.

Learning Kernel Classifiers 1. Introduction Summarized by In-Hee Lee.

Semantic Alignment Spring 2009 Ben-Gurion University of the Negev.

SUPERVISED AND UNSUPERVISED LEARNING Presentation by Ege Saygıner CENG 784.

Machine learning & object recognition Cordelia Schmid Jakob Verbeek.

Brief Intro to Machine Learning CS539

Data Mining, Machine Learning, Data Analysis, etc. scikit-learn

Machine Learning with Spark MLlib

Who am I? Work in Probabilistic Machine Learning Like to teach 

Machine learning Image source:

Machine Learning for Computer Security

Machine Learning overview Chapter 18, 21

Deep Learning Amin Sobhani.

Machine Learning overview Chapter 18, 21

IMAGE PROCESSING RECOGNITION AND CLASSIFICATION

Data Mining 101 with Scikit-Learn

Neural Networks for Machine Learning Lecture 1e Three types of learning Geoffrey Hinton with Nitish Srivastava Kevin Swersky.

Introductory Seminar on Research: Fall 2017

Machine Learning Week 1.

Basic Intro Tutorial on Machine Learning and Data Mining

3.1.1 Introduction to Machine Learning

Data Mining, Machine Learning, Data Analysis, etc. scikit-learn

Data Mining, Machine Learning, Data Analysis, etc. scikit-learn

Machine learning overview

CS639: Data Management for Data Science

Machine Learning – a Probabilistic Perspective

Machine Learning overview Chapter 18, 21

Machine Learning.

What is Artificial Intelligence?

Presentation transcript:

Supervised learning Given training examples of inputs and corresponding outputs, produce the “correct” outputs for new inputs Two main scenarios: –Classification: outputs are discrete variables (category labels). Learn a decision boundary that separates one class from the other –Regression: also known as “curve fitting” or “function approximation.” Learn a continuous input-output mapping from examples (possibly noisy)

Regression: example 1 Suppose we want to predict gas mileage of a car based on some characteristics: number of cylinders or doors, weight, horsepower, year etc. Source: G. Shakhnarovich

Regression: example 2 Training set: faces (represented as vectors of distances between keypoints) together with experimentally obtained attractiveness rankings Learn: function to reproduce attractiveness ranking based on training inputs and outputs Vector of distances v Attractiveness score f(v) T. Leyvand, D. Cohen-Or, G. Dror, and D. Lischinski, Data-driven enhancement of facial attractiveness, SIGGRAPH 2008

Structured Prediction Image Word Source: B. Taskar

Structured Prediction Sentence Parse tree Source: B. Taskar

Structured Prediction Sentence in two languages Word alignment Source: B. Taskar

Structured Prediction Amino-acid sequence Bond structure Source: B. Taskar

Structured Prediction Many image-based inference tasks can be thought of as “structured prediction” Data association problem Source: D. Ramanan model

Unsupervised Learning Given only unlabeled data as input, learn some sort of structure The objective is often more vague or subjective than in supervised learning. This is more of an exploratory/descriptive data analysis

Unsupervised Learning Clustering –Discover groups of “similar” data points

Unsupervised Learning Quantization –Map a continuous input to a discrete (more compact) output 1 2 3

Unsupervised Learning Density estimation –Find a function that approximates the probability density of the data (i.e., value of the function is high for “typical” points and low for “atypical” points) –Can be used for anomaly detection

Active learning The learning algorithm can choose its own training examples, or ask a “teacher” for an answer on selected inputs S. Vijayanarasimhan and K. Grauman, “Cost-Sensitive Active Visual Category Learning,” 2009

Course themes Formal representations High-level reasoning vs. low-level statistical modeling Combinatorial vs. statistical methods Computational complexity barriers “Neat” vs. “scruffy” approaches Building blocks vs. real-world systems

What wasn’t covered? Continuous environments Multi-agent environments Sensing and acting in the real world Natural language understanding, machine translation Knowledge engineering