Machine Learning.

Slides:



Advertisements
Similar presentations
Pat Langley Computational Learning Laboratory Center for the Study of Language and Information Stanford University, Stanford, California
Advertisements

Rerun of machine learning Clustering and pattern recognition.
Godfather to the Singularity
Thomas Trappenberg Autonomous Robotics: Supervised and unsupervised learning.
Machine learning continued Image source:
(Briefly) Active Learning + Course Recap. Active Learning Remember Problem Set 1 Question #1? – Part (c) required generating a set of examples that would.
An Overview of Machine Learning
Supervised Learning Recap
Lecture 17: Supervised Learning Recap Machine Learning April 6, 2010.
LEARNING FROM OBSERVATIONS Yılmaz KILIÇASLAN. Definition Learning takes place as the agent observes its interactions with the world and its own decision-making.
EECS 349 Machine Learning Instructor: Doug Downey Note: slides adapted from Pedro Domingos, University of Washington, CSE
Learning From Data Chichang Jou Tamkang University.
CSE 546 Data Mining Machine Learning Instructor: Pedro Domingos.
Pattern Recognition. Introduction. Definitions.. Recognition process. Recognition process relates input signal to the stored concepts about the object.
Learning Programs Danielle and Joseph Bennett (and Lorelei) 4 December 2007.
Part I: Classification and Bayesian Learning
Machine Learning Theory Maria-Florina Balcan Lecture 1, Jan. 12 th 2010.
Introduction to machine learning
Introduction to Data Mining Engineering Group in ACL.
CS Machine Learning. What is Machine Learning? Adapt to / learn from data  To optimize a performance function Can be used to:  Extract knowledge.
1 What is learning? “Learning denotes changes in a system that... enable a system to do the same task more efficiently the next time.” –Herbert Simon “Learning.
Data Mining Joyeeta Dutta-Moscato July 10, Wherever we have large amounts of data, we have the need for building systems capable of learning information.
MACHINE LEARNING 張銘軒 譚恆力 1. OUTLINE OVERVIEW HOW DOSE THE MACHINE “ LEARN ” ? ADVANTAGE OF MACHINE LEARNING ALGORITHM TYPES  SUPERVISED.
Mehdi Ghayoumi Kent State University Computer Science Department Summer 2015 Exposition on Cyber Infrastructure and Big Data.
COMP3503 Intro to Inductive Modeling
Machine Learning1 Machine Learning: Summary Greg Grudic CSCI-4830.
Introduction to machine learning and data mining 1 iCSC2014, Juan López González, University of Oviedo Introduction to machine learning Juan López González.
Lecture 10: 8/6/1435 Machine Learning Lecturer/ Kawther Abas 363CS – Artificial Intelligence.
1 CSC 8520 Spring Paula Matuszek Kinds of Machine Learning Machine learning techniques can be grouped into several categories, in several ways: –What.
Decision Making Under Uncertainty Lec #8: Reinforcement Learning UIUC CS 598: Section EA Professor: Eyal Amir Spring Semester 2006 Most slides by Jeremy.
Machine Learning Extract from various presentations: University of Nebraska, Scott, Freund, Domingo, Hong,
Computational Approaches for Biomarker Discovery SubbaLakshmiswetha Patchamatla.
Instructor: Pedro Domingos
Neural Networks Presented by M. Abbasi Course lecturer: Dr.Tohidkhah.
Data Mining and Decision Support
Copyright Paula Matuszek Kinds of Machine Learning.
Machine Learning Chapter 18, 21 Some material adopted from notes by Chuck Dyer.
Introduction Machine Learning: Chapter 1. Contents Types of learning Applications of machine learning Disciplines related with machine learning Well-posed.
WHAT IS DATA MINING?  The process of automatically extracting useful information from large amounts of data.  Uses traditional data analysis techniques.
A field of study that encompasses computational techniques for performing tasks that require intelligence when performed by humans. Simulation of human.
Learning Kernel Classifiers 1. Introduction Summarized by In-Hee Lee.
WHAT IS DATA MINING?  The process of automatically extracting useful information from large amounts of data.  Uses traditional data analysis techniques.
CSE344/544 Machine Learning Richa Singh Lecture slides are prepared using several teaching resources and no authorship is claimed for any slides.
SUPERVISED AND UNSUPERVISED LEARNING Presentation by Ege Saygıner CENG 784.
Introduction to Machine Learning. Introduce yourself Why you choose this course? Any examples of machine learning you know?
Network Management Lecture 13. MACHINE LEARNING TECHNIQUES 2 Dr. Atiq Ahmed Université de Balouchistan.
CMPS 142/242 Review Section Fall 2011 Adapted from Lecture Slides.
Brief Intro to Machine Learning CS539
Who am I? Work in Probabilistic Machine Learning Like to teach 
Convolutional Neural Network
Instructor: Pedro Domingos
Machine Learning overview Chapter 18, 21
Deep Learning Amin Sobhani.
Machine Learning overview Chapter 18, 21
Machine Learning for dotNET Developer Bahrudin Hrnjica, MVP
CSEP 546 Data Mining Machine Learning
Data Mining Lecture 11.
AV Autonomous Vehicles.
CSEP 546 Data Mining Machine Learning
Basic Intro Tutorial on Machine Learning and Data Mining
CSEP 546 Data Mining Machine Learning
Overview of Machine Learning
3.1.1 Introduction to Machine Learning
MACHINE LEARNING TECHNIQUES IN IMAGE PROCESSING
MACHINE LEARNING TECHNIQUES IN IMAGE PROCESSING
Deep Learning Authors: Yann LeCun, Yoshua Bengio, Geoffrey Hinton
A task of induction to find patterns
Machine learning: What is it?
Machine Learning overview Chapter 18, 21
A task of induction to find patterns
Presentation transcript:

Machine Learning

Quotes for Machine learning “A breakthrough in machine learning would be worth ten Microsofts” (Bill Gates, Chairman, Microsoft) “Machine learning is the next Internet” (Tony Tether, Director, DARPA) “Machine learning is the hot new thing” (John Hennessy, President, Stanford) “Web rankings today are mostly a matter of machine learning” (Prabhakar Raghavan, Dir. Research, Yahoo) “Machine learning is today’s discontinuity” (Jerry Yang, CEO, Yahoo) “ What are all the important questions in Machine Learning” ( Student(X) , Pre-Final year B.Tech-Cse, SRM University)

Traditional Programming Machine Learning Computer Data Output Program Computer Data Program Output

So What is Machine Learning? Getting computers to program themselves Writing software is the bottleneck Let the data do the work instead!

Applications Web search Computational biology Finance E-commerce Space exploration Robotics Information extraction Social networks Debugging [And your favorite area]

ML is growing growing… More than tens thousands of machine learning algorithms Hundreds are adding every year Every machine learning algorithm has three components: Representation Evaluation Optimization

Representation Decision trees Sets of rules / Logic programs Instances Graphical models (Bayes/Markov nets) Neural networks Support vector machines Model ensembles Etc.

Evaluation Accuracy Precision and recall Squared error Likelihood Posterior probability Cost / Utility Margin Entropy K-L divergence Etc.

Optimization Combinatorial optimization Convex optimization E.g.: Greedy search Convex optimization E.g.: Gradient descent Constrained optimization E.g.: Linear programming

Types of Machine Learning Supervised (inductive) learning Training data includes desired outputs Unsupervised learning Training data does not include desired outputs Semi-supervised learning Training data includes a few desired outputs Reinforcement learning Rewards from sequence of actions

Supervised Learning It is the task of inferring a function from labeled data. The trained data consist of set of trained examples. The supervised learning analyzes the trained data and produces an inferred function (which can be used for new samples)

Supervised Learning- Application Bio/che informatics Handwriting recognition OCR Spam detection Pattern recognition Speech recognition

Unsupervised learning The examples given to the learner are unlabeled data. There is no wrong or improper values to achieve the optimized solution. Clustering (K means , hierarchical clustering) Hidden markov models Self organizing maps (AOM) Adaptive resonance theory (ART) Etc

Semi – supervised Learning A sub class of supervised learning, taking small amount of labeled data and large amount of unlabeled data. It falls between unsupervised learning ( without any labeled training data) and supervised learning (completely labeled training data). Example : heuristic function (From the calulated distance between two cities to discovers the distance between known to unknown cities)

Reinforcement Learning In the Markov decision processed environments, the dynamic programming techniques should apply. It differs from slandered supervised learning in that correct input /output pairs are never presented. Q-Learning algorithm Sarsa algorithm

ML in Practice Understanding domain, prior knowledge, and goals Data integration, selection, cleaning, pre-processing, etc. Learning models Interpreting results Consolidating and deploying discovered knowledge Loop

ML is Just like gardening? Seeds You Nutrients Algorithms Gardener Data Plants Programs

Current “hot” practical issues Learning from labeled and unlabeled data. Nonlinear embeddings. MDPs and stochastic games. Adaptive programs and environments. Kernels, comp bio, many others, ...

Learning from labeled and unlabeled data Often unlabeled data is cheap, labeled data is expensive. unlabeled data can suggest which hypothesis are a-priori more reasonable. Algorithmically, can use to bootstrap. E.g., e.g., words on page; words pointing to page

END