1. Feature Engineering Studio October 14, 2013

2. Iterative Feature Refinement

3. Who here Used the Excel Equation Solver Did not use the Excel Equation Solver

4. Excel Equation Solver Users Sort yourself by the town you were born in (in Roman letters)

5. Excel Equation Solver Users Pick one feature What feature did you improve? What parameter did you adjust? What was the original and final value? How big an improvement did you obtain? Did this process change the meaning of the feature?

6. Everyone Else Sort yourself by the town you were born in (in Roman letters)

7. Everyone Else Pick one feature What feature did you improve? What parameter did you adjust? What values did you try? How big an improvement did you obtain? Did this process change the meaning of the feature?

8. Comments? Questions? Thoughts?

9. Question Is the excel equation solver likely to change the meaning of the feature more than hand processes?

10. Question Is it a good thing or a bad thing, when your feature changes meaning due to refinement?

11. Feature Parameter Space I need a volunteer who had a final best feature that was quite different from their original feature

12. One interesting exercise I need a volunteer who had a final best feature that was quite different from their original feature Please bring up your laptop or a flash drive with your data set

13. Making… A line graph X axis – parameter value Y axis – model goodness

14. Another volunteer? Would anyone else like to look at their feature this way? Multiple volunteers are welcome

15. What does it mean?

16. Questions? Comments? Thoughts?

17. Assignment 6 Feature Adaptation “This One’s For Nikolai Ivonavich Lobachevsky”

18. Nikolai Ivonovich Lobachevsky (by Tom Lehrer) “I will never forget the day I first met the great Lobachevsky. In one word he told me the secret of success in mathematics:”

19. Nikolai Ivonovich Lobachevsky (by Tom Lehrer) “I will never forget the day I first met the great Lobachevsky. In one word he told me the secret of success in mathematics: Plagiarize!”

20. Nikolai Ivonovich Lobachevsky (by Tom Lehrer) “I will never forget the day I first met the great Lobachevsky. In one word he told me the secret of success in mathematics: Plagiarize!” “Only be sure to always call it – please – research.”

21. To be clear… Plagiarism: bad

22. To be clear… Plagiarism: bad Borrowing ideas (and citing them): good

23. To be clear… Plagiarism: bad Borrowing ideas (and citing them): good We all clear?

24. Assignment 6 You need to find a previous paper that uses one or more features that can be potentially translated to your current analysis Find the paper Try at least one feature in your own data set

25. Assignment 6 You need to create a 5-minute presentation – Time yourself to make sure it only runs 5 minutes – To be presented in class next Monday

26. Assignment 6 This presentation should discuss – The paper you drew inspiration from – Give a full citation and show us pictures of as many authors as you can find – The construct being predicted in this paper – The context/data set in this paper – The feature you decided to adapt – The feature you ended up creating – Differences between the original paper’s feature and your feature – The goodness of your feature in your data set

27. What if you can’t find a paper?

28. You can find a paper

29. What if you can’t find a paper? You can find a paper Try google scholar

30. What if you can’t find a paper? You can find a paper Try google scholar Email me – but only after you have spent at least 2 hours searching the web

31. Questions? Comments?

32. Upcoming Classes 10/16 No special session today 10/21 Feature Adaptation – Assignment 6 due 10/23 Special Session on Building Prediction Models

33. Upcoming Classes 10/28 Feature Reuse 10/30 No special session today

34. Thank you!