Download presentation

Presentation is loading. Please wait.

Published byEstevan Pinkins Modified over 2 years ago

1
[slides prises du cours cs294-10 UC Berkeley (2006 / 2009)] http://www.cs.berkeley.edu/~jordan/courses/294-fall09/lectures/regression/

2
Classification (reminder) X ! Y Anything: continuous ( , d, …) discrete ({0,1}, {1,…k}, …) structured (tree, string, …) … discrete: – {0,1}binary – {1,…k}multi-class – tree, etc.structured

3
Classification (reminder) X Anything: continuous ( , d, …) discrete ({0,1}, {1,…k}, …) structured (tree, string, …) …

4
Classification (reminder) X Anything: continuous ( , d, …) discrete ({0,1}, {1,…k}, …) structured (tree, string, …) … Perceptron Logistic Regression Support Vector Machine Decision Tree Random Forest Kernel trick

5
Regression X ! Y continuous: – , d Anything: continuous ( , d, …) discrete ({0,1}, {1,…k}, …) structured (tree, string, …) … 1

19
degree 15 overfitting!

20
Between two models / hypotheses which explain as well the data, choose the simplest one In Machine Learning: ◦ we usually need to tradeoff between training error model complexity ◦ can be formalized precisely in statistics (bias- variance tradeoff, etc.)

21
training errormodel complexity

23
Logiciels: ◦ Weka (Java): http://www.cs.waikato.ac.nz/ml/weka/ http://www.cs.waikato.ac.nz/ml/weka/ ◦ RapidMiner (nicer GUI?): http://rapid-i.com/ http://rapid-i.com/ ◦ SciKit Learn (Python): http://scikit-learn.org http://scikit-learn.org Livres: ◦ Pattern Classification (Duda, Hart & Stork) ◦ Pattern Recognition and Machine Learning (Bishop) ◦ Data Mining (Witten, Frank & Hall) ◦ The Elements of Statistical Learning (Hastie, Tibshirani, Friedman) Programmer en python: ◦ cours cs188 de Dan Klein à Berkeley: http://inst.eecs.berkeley.edu/~cs188/fa10/lectures.html http://inst.eecs.berkeley.edu/~cs188/fa10/lectures.html

25
Kernel Regression 02468101214161820 -10 -5 0 5 10 15 Kernel regression (sigma=1)

Similar presentations

OK

1 Bios 760R, Lecture 1 Overview Overview of the course Classification and Clustering The “curse of dimensionality” Reminder of some background.

1 Bios 760R, Lecture 1 Overview Overview of the course Classification and Clustering The “curse of dimensionality” Reminder of some background.

© 2017 SlidePlayer.com Inc.

All rights reserved.

Ads by Google

Ppt on manufacturing industries for class 8 Download ppt on harappan civilization Ppt on positive thinking Ppt on object-oriented concepts in java Ppt on trans-siberian railway cost Ppt on local area network Ppt on social networking sites advantages and disadvantages Ppt on therapeutic environment in nursing Ppt on life study of mathematician euclid Ppt on different types of quadrilaterals and their properties