1. KIT – University of the State of Baden-Württemberg and National Research Center of the Helmholtz Association KARLSRUHE SERVICE RESEARCH INSTITUTE (KSRI) www.kit.edu www.ksri.kit.edu USING SERIOUS GAMES FOR IDEA ASSESSMENT IN SERVICE INNOVATION Feldmann, Niels; Adam, Marc T. P.; Bauer, Maximilian; Karlsruhe Institute of Technology, Germany

2. Karlsruhe Service Research Institute www.ksri.kit.edu Current challenges in service idea assessment Sources: 1 e.g. Bjelland O. & Wood, R. (2009). An inside view of IBM’s ‘Innovation Jam’, MIT Sloan Management Review, 50(1), 32-40 2 Barczak, G., et al. (2009). PERSPECTIVE: Trends and Drivers of Success in NPD Practices. Journal of Product Innovation Management, 26(1), 3–23. 3 Cooper, R. G. (2009). How Companies are Reinventing their Idea–to–Launch Methodologies. Research Technology Management, 52(2), 47–57. 4 Feldmann, N. & Kohler, M (2013). Service Innovation Capabilities for Idea Assessment. In The Handbook of Service Innovation. Forthcoming 5 Schulze et al. (2012). Idea assessment in open innovation: A state of practice. ECIS 2012 IdeationIdeas Concepts MarketSuccess Cope with large idea portfolios 1 Tap the knowledge of staff 4 December 05, 2014 Innovation Games Summit 2015 Requirements for new approaches Address hollow go-decisions 2, 3 High attractiveness for staff 4 IdeasConcepts IT-supported assessment 5 2

3. Karlsruhe Service Research Institute www.ksri.kit.edu 3 8/2012: San Jose Budget Games in the News Pre-testing a serious game in a real-life environment December 05, 2014 Innovation Games Summit 2015 11/2012: Workshop @ KIT 1/2013: Pre-Study in an Eastern European branch of a German bank Online version 8 players 27 ideas they liked it Participants said... felt involved it‘s enjoyable would play in spare time

4. Karlsruhe Service Research Institute www.ksri.kit.edu 4 Research questions to be addressed in a lab experiment Controlled laboratory experiment RQ1: Do serious games contribute to responding to the challenges of idea assessment in service innovation? RQ2: To what extent does the formation of teams in terms of openness to experience influence the outcome of a serious game for idea assessment? December 05, 2014 Innovation Games Summit 2015

5. Karlsruhe Service Research Institute www.ksri.kit.edu 5 Overall experiment design December 05, 2014 Innovation Games Summit 2015 Students

6. Karlsruhe Service Research Institute www.ksri.kit.edu 6 RQ1: Perception of system by participants (TAM3*) December 05, 2014 Innovation Games Summit 2015 1. Perceived Ease of Use (PEOU) PEOU1 My interaction with the system is clear and understandable.1....... 7 PEOU2 Interacting with the system does not require a lot of my mental effort. 1....... 7 PEOU3 I find the system to be easy to use. 1....... 7 PEOU4 I find it easy to get the system to do what I want it to do.1....... 7 2. Perceived Enjoyment (ENJ) ENJ1 I find using the system to be enjoyable. 1....... 7 ENJ2 The actual process of using the system is pleasant. 1....... 7 ENJ3 I have fun using the system. 1....... 7 3. Output Quality (OUT) OUT1 The quality of the output I get from the system is high. 1....... 7 OUT2 I have no problem with the quality of the system’s output. 1....... 7 OUT3 I rate the results from the system to be excellent. 1....... 7 4. Result Demonstrability (RES) RES1 I have no difficulty telling others about the results of using the system. 1....... 7 RES2 I believe I could communicate to others the consequences of using the system. 1....... 7 RES3 The results of using the system are apparent to me. 1....... 7 RES4 I would have difficulty explaining why using the system may or may not be beneficial. 1....... 7 5. State your overall mood level 1....... 7 *Source: Venkatesh, V. and Bala, H. (2008). Technology Acceptance Model 3 and a research agenda on interventions. Decision Sciences, 39 (2), 273-315. ConstructAverageVariance Perceived Enjoyment5.121.26 Perceived Ease of Use5.810.95 Output Quality4.711.50 Result Demonstrability5.260.88 Mood Level (before - after)Up by 7.6% during game (4.8 to 5.2) Conjecture: The Serious Game helps to increase popularity and regular participation in idea assessment

7. Karlsruhe Service Research Institute www.ksri.kit.edu 7 RQ2: Types of projects bought by varying teams December 05, 2014 Innovation Games Summit 2015 Number of funded radical ideasBudget invested in radical ideas Significance Test: (# of radical idea as dependent variable) HIGH teams selecting more radical ideas is significant* (b=1.864, se=.779, z=2.39, p=.017) All other teams do not show significant differences * Ordered Logit Regression

8. Karlsruhe Service Research Institute www.ksri.kit.edu 8 RQ2: Individuals’ investments in radical ideas December 05, 2014 Innovation Games Summit 2015 OLS regressions on budgets invested in radical ideas by each individual It’s not enough to exhibit a high openness score, participants with high openness scores need to be grouped in homogeneous high openness teams in order to spend more money on radical ideas.

9. Karlsruhe Service Research Institute www.ksri.kit.edu 9 Outcome, Implications & Further Research December 05, 2014 Innovation Games Summit 2015  Field study to compare lab to real-life environment  Benchmark serious game with traditional decision methods  Explore further personality dimensions (e.g. extraversion)  Compare outcome and perception of game when played face-to-face vs. online Further Research 1.Contribution to  Attractiveness for staff  Hollow go-decisions  IT-supported assessment 2.No contribution to  Copes with large portfolios  Tap the knowledge of staff 3.Balanced outcome when played by an average set of participants 4.A wanted bias towards more radical ideas can be introduced Outcome & Implications 

10. Karlsruhe Service Research Institute www.ksri.kit.edu Thank you ! Niels Feldmann Karlsruhe Institute of Technology (KIT) Karlsruhe Service Research Institute (KSRI) Email: niels.feldmann@kit.edu December 05, 2014 Innovation Games Summit 2015 Dr. Marc Adam Karlsruhe Institute of Technology (KIT) Institut of Information Systems and Marketing Email: marc.adam@kit.edu Max Bauer Karlsruhe Institute of Technology (KIT) Karlsruhe Service Research Institute (KSRI) 10

11. Karlsruhe Service Research Institute www.ksri.kit.edu 11 Implications & Further Research December 05, 2014 Innovation Games Summit 2015 Evalutate chat logs of lab experiment Interactions in Teams Compare interaction pattern of lab experiment with pattern from real- life setups Interactions in Teams Explore the impact of further personality dimensions (e.g. extraversion) Further Dimensions Repeat experiment in real life situation, compare to lab and traditional decision methods Real life test 1 2 3 4