1. 1 Research Based Program Assessment Measuring Innovation Self-Efficacy Liz Gerber egerber@northwestern.edu @elizgerber Northwestern University Adam Carberry acarberry@asu.edu Arizona State University Venture Well Washington DC 032015

2. 2 2

3. 3

4. 4 What do we call people who innovate?*

5. 5 How do we prepare people to be innovators?

6. 6 Invest in innovation education 6

7. 7 & Graphic designed by Nick Levesque from the Noun Project

8. 8 And yet Few measures are available for evaluating the effectiveness of these interventions

9. 9 (Ford, 1996, Shalley & Perry-Smith, 2001, Bandura, 1997) Innovators Domain expertise Skills * analytical * creative * social Self-Efficacy

10. 10 Innovation Self-Efficacy Belief in the ability to accomplish tasks necessary for innovating (Gerber, 2011, Gerber, Olson, & Komarek, 2012, Gerber et al, 2012) Graphic designed by Antonis Makriyannis from the Noun Project A B

11. 11 Innovation Self-Efficacy Beliefs in ability influence goal setting, effort, persistence, learning and attribution of failure. (Bandura, 1997, Deci & Ryan, 1985, Schunk, 1984) Graphic designed by Antonis Makriyannis from the Noun Project A B

12. 12 Goal To develop a measure for Innovation Self-Efficacy

13. 13 METHOD Literature Review Design Business Psychology Engineering Org Management Expert interviews 38 skills & behaviors related to innovation (Bandura, 2006, Tierney & Farmer, 2002, Carberry et al, 2010)

14. 14 Innovation Related Skills & Behaviors TOTAL: 38 skills & behaviors related to these concepts Vision Exploration Synthesis Creativity Iteration Resourcefulness Implementation Communication

15. 15 Method Survey (N=22) Literature Review Expert interviews 38 skills & behaviors related to innovation 25 skills & behaviors related to innovation

16. 16 TOTAL : 79 survey items FOR EACH SKILL & BEHAVIOR 3-4 different statements Imagination “Come up with a lot of creative ideas.” “Come up with imaginative ideas.” “Do things in an original way.” “Think of many different ideas when considering a problem.”

17. 17 Method Survey (N=22) Literature Review Expert interviews 38 skills & behaviors related to innovation 25 skills & behaviors related to innovation Pilot (N=62)

18. 18 Method Survey (N=22) Literature Review Expert interviews 38 skills & behaviors related to innovation 25 skills & behaviors related to innovation Pilot (N=62) 13 skills & behaviors related to innovation

19. 19 Method Survey (N=22) Literature Review Expert interviews 38 skills & behaviors related to innovation 25 skills & behaviors related to innovation Pilot (N=62) 13 skills & behaviors related to innovation Survey (N=191) 8 skills & behaviors related to innovation

20. 20 13 SKILLS AND BEHAVIORS RELATED TO INNOVATION Vision Awareness/Perspective Taking Understand how things work Information Processing Creativity Idea Testing Collaboration Utilize resources Persistence Decision-Making Risk-taking Oral and Written Communication Visual and Data Driven Communication Cronbach’s alpha: (.761-.837)

21. 21 8 SKILLS AND BEHAVIORS RELATED TO INNOVATION Creativity Exploration Iteration Implementation Communication Resourcefulness Synthesis Vision Cronbach’s alpha:.807-.907

22. 22 Began with 8 items broken into 2 indicators (imagination & originality) 1 factor, EV = 2.489, 82.95% of variance Cronbach’s alpha= 0.895 6. Come up with imaginative solutions (factor weight: 0.924) 12. Do things in an original way (factor weight: 0.885) 26. Think of new and creative ideas (factor weight: 0.923) Factor 1: Creativity

23. 23 Began with 11 items broken into 2 indicators (awareness/empathy and observation/tinkering) 1 factor, EV = 3.043, 76.07% of variance Cronbach’s alpha= 0.894 1. Understand the needs of people by listening to their stories (factor weight: 0.882) 8. Consider the viewpoints of others/stakeholders (factor weight: 0.876) 18. Learn by observing how things in the world work (factor weight: 0.887) 29. Explore and visualize how things work (factor weight: 0.843) 23 Factor 2: Exploration

24. 24 Began with 4 items 1 factor, EV = 2.456, 81.87% of variance Cronbach’s alpha= 0.887 9. Evaluate the success of a new idea (factor weight: 0.867) 22. Test new ideas and approaches to a problem (factor weight: 0.925) 27. Model a new idea or solution (factor weight: 0.921) Factor 3: Iteration

25. 25 Began with 10 items broken into 2 indicators (decision-making and risk- taking) 1 factor, EV = 2.934, 73.36% of variance Cronbach’s alpha= 0.874 7. Make risky choices to explore a new idea (factor weight: 0.827) 13. Set clear goals for a project (factor weight: 0.820) 21. Suggest new ways to achieve goals or objectives (factor weight:.889) 24. Make a decision based on available evidence and opinions (factor weight: 0.888) Factor 4: Implementation

26. 26 Began with 11 items broken into 2 indicators (spoken/written and visual/data-driven) 1 factor, EV = 2.508, 83.61% of variance Cronbach’s alpha= 0.901 16. Communicate ideas clearly to others (factor weight: 0.884) 17. Provide compelling stories to share ideas (factor weight: 0.925) 23. Share what I have learned in an engaging and realistic way (factor weight: 0.933) Factor 5: Communication

27. 27 Began with 19 items broken into 3 indicators (seeking knowledge, persistence and collaboration) 1 factor, EV = 4.108, 68.46% of variance Cronbach’s alpha= 0.907 3. Seek out information from other disciplines to inform my own (factor weight: 0.803) 14. Troubleshoot problems (factor weight: 0.847) 15. Keep informed about new ideas (products, services, processes, etc.) in my field (factor weight: 0.809) 19. Solve most problems if I invest the necessary effort (factor weight: 0.805) 20. Be resourceful when handling an unforeseen situation (factor weight: 0.844) 28. Find new uses for existing methods or tools (factor weight: 0.856) Factor 6: Resourcefulness

28. 28 Began with 7 items 1 factor, EV = 2.167, 72.22% of variance Cronbach’s alpha= 0.807 2. Find connections between different fields of knowledge (factor weight: 0.880) 10. Apply lessons from similar situations to a current problem of interest (factor weight: 0.831) 25. Relate seemingly unrelated ideas to each other (factor weight: 0.837) Factor 7: Synthesis

29. 29 Began with 7 items broken into 2 indicators (Question how things can be different and identify a need/problem) 1 factor, EV = 2.200, 73.32% of variance Cronbach’s alpha= 0.814 4. Identify opportunities for new products and/or processes (factor weight: 0.868) 5. Question practices that others think are satisfactory (factor weight: 0.819) 11. Envision how things can be better (factor weight: 0.880) Factor 8: Vision

30. 30 Contribution Measure of Innovation Self-Efficacy Creativity (Tierney & Farmer, 2002) Engineering design (Carberry et al, 2010) Modeling (Yildirim et al 2010) Tinkering (Baker et al 2008) Entrepreneurship (Chen et al, 1998)

31. 31 Analyze 260 additional surveys Relate measure to innovation outcomes Ongoing Work

32. 32 Experimental Platform (loft.io) (Easterday, Rees Lewis, & Gerber, 2014, 2015)

33. 33 Experimental Platform (loft.io) (Easterday, Rees Lewis, & Gerber, 2014, 2015)

34. 34 Experimental Platform (loft.io) (Easterday, Rees Lewis, & Gerber, 2014, 2015)

35. 35

36. 36 Innovation Education Develop Domain Expertise, Skills, and Beliefs (Gerber, 2012, 2015)

37. 37 Research Based Program Assessment Measuring Innovation Self-Efficacy Liz Gerber egerber@northwestern.edu @elizgerber Northwestern University Adam Carberry acarberry@asu.edu Arizona State University

38. 38

39. 39 Influential Categories of Innovation Self-Efficacy

40. 40 29 items