1. The Origins and Evolution of the Ecological Research as Education Network (EREN) One path to building a grassroots ecological research network Laurie Anderson Ohio Wesleyan University

2. Presentation Outline What is EREN? Where did it come from? What does it do and how is it organized? – The heart and soul of EREN: Our collaborative projects One path to building a research network – successes and challenges EREN Evolving: What are students learning through participation in EREN projects? – Preliminary findings from a network-wide assessment

3. A Research Coordination Network (RCN) Funded by the NSF Research Coordination Network- Undergraduate Biology Education Program Award # 0955344

4. The EREN Mission To create a model for collaborative ecological research that generates high-quality, publishable data involving undergraduate students and faculty at primarily undergraduate institutions (PUIs). That is, EREN works to bring “big” science to “small” institutions!

5. Coordinating undergraduate research across many sites enhances the scientific and educational value of these activities.

6. CHIEF Acronym for EREN Research CHIEF projects are: Collaborative High Impact science and education Ecological or environmental research Feasible for all kinds of institutions – PUI Research Limitations: Time, financial resources – PUI Research Strengths: Labor, enthusiasm, low publication pressure allows flexibility for long term work. EREN leverages the research strengths of PUIs to advance both science and education.

7. EREN – An idea whose time has come Inspiration for EREN - Steve Hubbell’s permanent plot on Barro Colorado Island, Panama - The Long Term Ecological Research sites - The National Ecological Observatory Network - The Collaboration through Appalachian Watershed Studies (CAWS) and ROCA projects

8. Anderson, Laurel - Ohio Wesleyan Univ., OH* Bowne, David - Elizabethtown College, PA Gartner, Tracy - Carthage College, WI* Kuers, Karen - Sewanee: The Univ. of the South, TN* Downing, Amy - Ohio Wesleyan Univ., OH Dosch, Jerald - Macalester College, MN Hoopes, Martha - Mount Holyoke College, MA Hornbach, Dan - Macalester College, MN Johnson, David - Ohio Wesleyan Univ., OH Lindquist, Erin - Meredith College, NC* Machado, Jose-Luis - Swarthmore College, PA* O’Reilly, Catherine - Bard College, NY Pohlad, Bob - Ferrum College, VA* Simmons, Jeffrey - Mount St. Mary’s Univ., MD* LoGiudice, Kathleen - Union College, NY Shea, Kathy - St. Olaf College, MN Thomas, Carolyn - Ferrum College, VA* Woods, Kerry - Bennington College, VT The EREN Founders are 18 scientist- educators from 14 PUI institutions. * = RCN Grant PI

9. Some of EREN’s Founders meeting at Ohio Wesleyan University, March 2009

10. EREN now includes 187 institutions and 254 members!

11. How does EREN work? EREN works by inviting people to propose project ideas to the network through an e-mail call for participants. Participants volunteer to join the project, and the group organizes under a Lead Scientist to develop protocols, collect data, and seek funding. EREN funds and online tools provide opportunities for project participants to communicate, share data, post information and meet face-to-face annually. EREN also provides peer-to-peer training and access to experts to enhance professional development.

12. Stream Temperature Project (RBAST) Lead Scientist: Dr. Jeffrey Simmons Mount St. Mary’s University This project is now complete and one manuscript has just come out! Permanent Forest Plot Project Lead Scientists: Dr. Erin Lindquist, Meredith College and Dr. Karen Kuers, Sewanee: The University of the South

13. TurtlePop Lead Scientist: Dr. David Bowne Elizabethtown College Decomposition of Aquatic and Terrestrial Invasive Species (DATIS) Lead Scientists: Dr. Tracy Gartner, Carthage College and Dr. Carolyn Thomas, Ferrum College

14. EREN Worm Project Lead Scientist: Dr. Tim McCay Colgate University Emerald Ash Borer Project Lead Scientists: Dr. Ben Dolan, University of Findlay and Dr. Jason Kilgore, Washington and Jefferson College

15. Bird-Window Collisions Project Lead Scientists: Dr. Steve Hager, Augustana College and Dr. Bradley Cosentino, Hobart and William Smith College Oak Mast Project Lead Scientists: Dr. Harmony Dalgleish, College of William and Mary and Dr. Michael Steele, Wilkes University Stay tuned for up-and-coming projects: Edge Effects and Landscape Projects within the Permanent Forest Plot Network!

16. Building EREN – Success Strategies EREN meets a need and an interest for PUI scientists. EREN is built around a project concept, not a particular research problem, allowing flexibility. EREN has prioritized research ideas and let the teaching flow from these, so everyone in a project is motivated by the excitement of scientific discovery.

17. PUI scientists in EREN trading expertise in the field

18. Building EREN – Success Strategies EREN has emphasized regular communication with its members and has had a consistent presence at various professional meetings. EREN has used a wide range of technological tools to keep people connected. EREN has held three annual meetings that have increased network collegiality and provided professional development.

19. Attendees at EREN’s First All Members Meeting Meredith College, Raleigh, NC– June 2012

20. Building EREN – Success Strategies The EREN Leadership Team has worked well together to oversee EREN as a whole. The Lead Scientists have authority over their own projects and have been willing to put in a tremendous amount of work. EREN Members have been enthusiastic and collegial participants in the projects.

21. EREN Members Hard at Work!

22. Building EREN - Challenges Having an authorship policy for projects and clear communication about criteria for authorship is important. Not all research questions are appropriate for EREN. Not all project protocols are appropriate for EREN. Workload issues are a concern, particularly for those in leadership positions in EREN.

23. Building EREN - Challenges What is the appropriate role for students in EREN? Growing pains – EREN continues to increase in size and has only a part-time student assistant as paid staff. Funding concerns – RCN funding ends in 2015!

24. What do students learn from EREN? EREN Learning Goals Students will be able to apply scientific methodology (including hypothesis generation and experimental design) and recognize the importance of uncertainty for experiments at single and multiple sites. Students will be able to identify factors that vary among sites across geographic or temporal scales, describe how these factors interact, and how they may affect ecological processes. Students will be able to describe the value and techniques of scientific collaboration. Students will demonstrate best practices in the accurate collection, recording, and ethical management of multi-site, multi-participant datasets. Students will be able to analyze, interpret, and draw conclusions from data collected in multi-site studies.

25. EREN Pilot Assessment – Spring 2014 Seven EREN members administered an online pre- and post-test to students in classes that included a range of EREN activities. The online test contained 10 questions (2 per learning goal), both open response (n=6) and multiple choice (n=4). A total of 124 students from seven institutions took both a pre- and post-test. A team of five EREN Leadership Team members scored the open response questions using a four point rubric (1 = novice, 4 = expert). Scores were compared within and across institutions using paired t-tests.

26. Institution Class Level # Student responses # EREN Lectures # EREN Labs Total EREN Lect + Labs Statistically significant improvements observed in post tests SUNY Plattsburgh Lower20000None Carthage College Lower10112None Colgate University Lower48022None Macalester College Lower20044Q1 and Q6 Sewanee: The University of the South Upper15055Q6 and Q8 Ohio Wesleyan University Upper96410Q4, Q6 and Q8 All Institutions Combined* *University of Findlay had 2 student responses NA12471623Q6 and Q8 Take Home Message: EREN projects can have measurable effects on student learning. These effects increase as the emphasis on EREN projects increases in a course.

27. Open response questions that showed significant improvement across institutions Q6: List three to six technological tools, approaches, protocols, or attitudes that are essential to successful scientific collaboration across multiple sites. Provide a one to two sentence description of each one. Pre-test Mean: 1.73 + 0.06 Post-test Mean: 2.08 + 0.09

28. Site 1 Acorn Data Site 2 Acorn Data Tree SpeciesTree ID Number of acorns/m 2 Spe# Number of acorns/ft 2 Quercus albaQa131Q. alba128 Quercus albaQa226Q. alba261 Quercus albaQa317Q. alba345 Quercus albaQa440Q. alba432 Quercus albaQa515Q. alba533 Q8: Here is a list of data collected under oaks at different sites. These data should be put into the same central database. List any problems you see with (1) integrating these data into the same database, and (2) problems scientists who were not involved in collecting the data at that particular site might have in understanding or using it. Pre-test Mean: 1.37 + 0.05, Post-test Mean: 1.53 + 0.07

29. What do students learn from EREN? EREN Learning Goals Students will be able to apply scientific methodology (including hypothesis generation and experimental design) and recognize the importance of uncertainty for experiments at single and multiple sites. Significant improvement at one institution. Students will be able to identify factors that vary among sites across geographic or temporal scales, describe how these factors interact, and how they may affect ecological processes. Significant improvement at one institution. Students will be able to describe the value and techniques of scientific collaboration. Significant improvement at three institutions. Students will demonstrate best practices in the accurate collection, recording, and ethical management of multi-site, multi-participant datasets. Significant improvement at three institutions. Students will be able to analyze, interpret, and draw conclusions from data collected in multi-site studies. No significant improvement.

30. Multiple choice results and next steps in EREN Assessment Multiple choice questions across institutions showed no significant improvement: one question showed a significant decrease in post- test scores. Multiple choice analyses within institutions did not show a discernable pattern with EREN emphasis. These results will be used to – revise the pre/post-test for use at more institutions in EREN. – help us consider how to improve teaching of EREN concepts to further enhance student learning.

31. Summary EREN is a successful and thriving grassroots research network. Strong teamwork among EREN leaders and enthusiastic engagement among network members has been crucial to our success. Challenges include identifying future funding sources, workload management, and integration of students into the network interactions. Assessment data shows that EREN can enhance student learning, but suggests that teaching of EREN concepts can improve.

32. Long live EREN!