Download presentation

Presentation is loading. Please wait.

Published byAntonia Dewhirst Modified over 3 years ago

1
Eco 5385 Predictive Analytics For Economists Spring 2014 Professor Tom Fomby Director, Richard B. Johnson Center for Economic Studies Department of Economics SMU

2
Presentation 6 The K-Nearest-Neighbors Model For Prediction or Classification Chapter 7 in SPB

3
OUTLINE I. K-NN: A Nonparametric Method A. No Parameters to Estimate as in Multiple Linear Regression B. Definition of Euclidean Distance between Vectors C. Recommendation: Standardize Input Variables before Proceeding

4
OUTLINE II. Un-Weighted Nearest Neighbor Scores: Simple Average of Training Neighbors Output Values III. Weighted Nearest Neighbor Scores: Weighted Average of Training Neighbors Output Values IV. Therefore K-NN is a sophisticated Step- Function Predictor that relies on an Average of Neighborhood Output Values taken from the Training Data Set

5
OUTLINE V. In the K-NN Prediction Problem the Neighborhood Size, K, is the tuning parameter VI. In the K-NN Classification Problem there are two tuning parameters: The Neighborhood Size and the cut-off probability for choice selection VII. The K-NN Tuning Parameters are Often Chosen so as to maximize the accuracy of scoring the Validation Data Set

6
Now for a Discussion of the Various Parts of this Outline go to the pdf file K-NN Method.pdf

7
Classroom Exercise: Exercise 4

Similar presentations

OK

Memory-Based Learning Instance-Based Learning K-Nearest Neighbor.

Memory-Based Learning Instance-Based Learning K-Nearest Neighbor.

© 2017 SlidePlayer.com Inc.

All rights reserved.

Ads by Google

Ppt on rational numbers for class 10 Ppt on natural resources for class 10 Ppt on save water in india Best ppt on motivation Ppt on asian continent countries By appt only-movie Ppt on generation of electricity from wastewater Ppt on email etiquettes presentation tips Ppt on six sigma Ppt on span of control