Mechanics of Undergraduate Research at Liberal Arts Colleges – Lessons Learned Amruth Kumar Ramapo College of New Jersey Mahwah, NJ

SIGCSE 2007, Covington, KY, March 8, 2007 Experience Intelligent tutors for Computer Science I, Programming Languages Intelligent tutors for Computer Science I, Programming Languages Developing a new tutor Developing a new tutor Large scale software development, integration, testing, documentation Large scale software development, integration, testing, documentation Extending the feature set of tutors Extending the feature set of tutors Artificial Intelligence, HCI Artificial Intelligence, HCI Evaluating a tutor Evaluating a tutor Computer Science education research Computer Science education research

SIGCSE 2007, Covington, KY, March 8, 2007 Experience 1996 – 2000: 1996 – 2000: “What can I do for you?” “What can I do for you?” Independent Study Independent Study 2000 – 2006: 2000 – 2006: “What can you do for me?” “What can you do for me?” + Grant-supported + Grant-supported : : “What can you do for me altius, citius, fortius?” “What can you do for me altius, citius, fortius?” + Honors project + Honors project

SIGCSE 2007, Covington, KY, March 8, 2007 The Ideal Candidate Right mix of ability and motivation Right mix of ability and motivation Success = 10% inspiration + 90% perspiration Success = 10% inspiration + 90% perspiration Ideal student = 40% ability + 60% motivation Ideal student = 40% ability + 60% motivation The 4.0 student on a 3-year degree program The 4.0 student on a 3-year degree program “Show me how to do it and I will do it” student “Show me how to do it and I will do it” student

SIGCSE 2007, Covington, KY, March 8, 2007 Recruiting Pro-active: Approach select students Pro-active: Approach select students Reactive: Publicize, wait for students to approach you Reactive: Publicize, wait for students to approach you Proactive better than reactive Proactive better than reactive 2 : 1 Ratio: Recruited : Retained Recruited : Retained Retained : Participate Retained : Participate Participate : Excel Participate : Excel

SIGCSE 2007, Covington, KY, March 8, 2007 Guidance Highly regimented: Highly regimented: Weekly meetings Weekly meetings Step-by-step instructions Step-by-step instructionsVs Loosely structured: Loosely structured: Schedule, reporting, tasks, etc. Schedule, reporting, tasks, etc. One size does not fit all One size does not fit all Can lose a student with the wrong strategy! Can lose a student with the wrong strategy!

SIGCSE 2007, Covington, KY, March 8, 2007 Managing Expectations Contract drawn up upfront: Contract drawn up upfront: Helps the student measure progress Helps the student measure progress Written in student’s words! Written in student’s words! Detailed weekly log Detailed weekly log Records locus of thinking, rationale for decisions, hours worked Records locus of thinking, rationale for decisions, hours worked Conference deadlines as deadlines Conference deadlines as deadlines

SIGCSE 2007, Covington, KY, March 8, 2007 Managing Expectations Development Development Short cuts in software design, implementation Short cuts in software design, implementation Software never comes out right on the first try! Software never comes out right on the first try! Evaluation Evaluation Inadequate features, interfaces, services Inadequate features, interfaces, services “Good enough” is not good enough! “Good enough” is not good enough! Writing up the results Writing up the results Write rewrite cycles Write rewrite cycles Focusing literature search Focusing literature search Presentation Presentation More than reciting the paper More than reciting the paper Practice makes perfect Practice makes perfect

SIGCSE 2007, Covington, KY, March 8, 2007 “What you can do for me” research Development: Development: Core system on a “need to know basis” Core system on a “need to know basis” Design for reusability Design for reusability Implementation not done until integrated Implementation not done until integrated Vet everything, leave nothing to chance Vet everything, leave nothing to chance Evaluation: Evaluation: Access to previous protocols, data formats, results Access to previous protocols, data formats, results Writing up the results: Writing up the results: Database of references Database of references

SIGCSE 2007, Covington, KY, March 8, 2007 Building a community of researchers Friday evening jam sessions with pizza + coke Friday evening jam sessions with pizza + coke Good for beginning students Good for beginning students Morale booster Morale booster May not work once students mature May not work once students mature Participation in professional conferences Participation in professional conferences Participants “mature” - the experience, recognition and networking Participants “mature” - the experience, recognition and networking Just as influential on other students as the participants – “stories and legends” Just as influential on other students as the participants – “stories and legends”

SIGCSE 2007, Covington, KY, March 8, 2007 Conclusion Convincing them they need to re-implement the solution: hours Convincing them they need to re-implement the solution: hours Cajoling them to clean up the software so that their work can be tested: 2 – 3 revisions Cajoling them to clean up the software so that their work can be tested: 2 – 3 revisions Reminding them of conference deadlines: 5 – 6 messages Reminding them of conference deadlines: 5 – 6 messages Getting them to write a professional paper: 8-10 revisions Getting them to write a professional paper: 8-10 revisions Seeing the appreciation of research dawn on their faces: PRICELESS!