1. Feature Engineering Studio October 7, 2013

2. Welcome to Bring Me Another Rock

3. In birthdate order Each person should tell us about their favorite feature they created for Bring Me Another Rock Tell us what it was How you created it Your just-so story And was your just-so story correct

4. Next Tell us about anything cool you did in Excel or another program to create a feature

5. Too Hard? Were there any features that anyone kind of wanted to create, but it was too difficult? (or too much work?)

6. Better? Who here got better features (in terms of goodness metric) for Bring Me Another Rock, than Bring Me a Rock?

7. Other Interesting Observations?

8. GoogleRefine (now OpenRefine)

9. Mostly just an Excel clone, abandoned in favor of the fully-online Google Towels Sheets But some nice additional functionality

10. GoogleRefine (now OpenRefine) Functionality to make it easy to regroup and transform data – Find similar names – Connect names – Bin numerical data – Mathematical transforms showing resultant graphs – Text transforms and column creation

11. GoogleRefine (now OpenRefine) Functionality for finding anomalies/outliers

12. GoogleRefine (now OpenRefine) Functionality for automatically repeating the same process on a new data set *Really* nice for cases where you complete a complex process and want to repeat it – Replicates a really good logbook, which most data analysts don’t keep – Now seen in other tools like iPython Notebook – Still not in Excel, but Excel has been stagnant for years

13. GoogleRefine (now OpenRefine) Functionality for connecting your data set to web services to get additional relevant info

14. GoogleRefine (now OpenRefine) Can load in and export common but hard-to- work-with data types – JSON and XML

15. GoogleRefine (now OpenRefine) Some videos you should watch later http://www.youtube.com/watch?v=B70J_H_z AWM http://www.youtube.com/watch?v=cO8NVCs_ Ba0 http://www.youtube.com/watch?v=5tsyz3ibYz k

16. Questions? Comments?

17. Assignment for next Monday

18. Iterative Feature Refinement Select three of the features you have created in previous assignments These features should be “among the best” of the features you have previously created For each of these three features, create at least five “close variants” of these features – “time for last 3 actions” and “time for last 4 actions” are close variants – “time for last 3 actions” and “total time between help requests and next action” are two separate features Using the Excel Equation Solver is an OK substitute for creating five “close variants” If you don’t use the excel equation solver – As you create the close variants for each feature, don’t just make them all at once – Make a variant – Test whether it’s better than the previous variant (by goodness metric) If it is, keep going in the same direction If it isn’t, try doing the opposite or something else

19. Iterative Feature Refinement Write a report that discusses your process – I took feature N – I changed it from N to N* – The goodness changed from G to G* – Then I did…

20. Iterative Feature Refinement You don’t need to prepare a presentation But be ready to discuss your features in class

21. Also for Next Monday Please read Rodrigo, M.M.T., Baker, R.S.J.d., McLaren, B., Jayme, A., Dy, T. (2012) Development of a Workbench to Address the Educational Data Mining Bottleneck. Proceedings of the 5th International Conference on Educational Data Mining, 152-155.

22. Next Classes 3/30 Feature Reuse – IFR assignment due 4/1 Lab Session: Building Predictive Models – Come to this if you want to learn more about the theory behind building predictive models; how to do it effectively and appropriately (beyond just the how) – You don’t need to come to this if you’ve taken Core Methods or Big Data and Education

23. Thank you!