1. Management-by-Acronym (MBA) A New Paradigm for Evaluating and Running ICT Research Projects Kooperation erforschen – Kooperationen leben Univ.-Prof. Dr. Peter Reichl Forschungsgruppe “Cooperative Systems” (COSY) Fakultät für Informatik der Universität Wien Universität Dortmund, 05.12.2014

2. Management-by-Acronym (MBA) A New Paradigm for Evaluating and Running ICT Research Projects Univ.-Prof. Dr. Peter Reichl Forschungsgruppe “Cooperative Systems” (COSY) Fakultät für Informatik der Universität Wien Universität Dortmund, 05.12.2014 So weich, dass man es blind erkennt…

3. Management-by-Acronym (MBA) A New Paradigm for Evaluating and Running ICT Research Projects Univ.-Prof. Dr. Peter Reichl Forschungsgruppe “Cooperative Systems” (COSY) Fakultät für Informatik der Universität Wien Universität Dortmund, 05.12.2014 So weich, dass man es blind erkennt… sounds too much like SaaS  out of scope!!

4. Background and Motivation  Starting point: Lehrstuhl Informatik 4, RWTH Aachen  Project ANNABELLE (Anomalies in Normaluser Network Applications Based on Experiments in a Lovely Lehrstuhl-Environment), 1996-1998 M. Berger, O. Kubitz, K. Jakobs, P. Reichl, A. Koch: Project ANNABELLE: Anomalies in Normal-User Network Applications Based on Experiments in a Lovely Lehrstuhl Environment. Proc. 3 rd Biennial SSE European Meeting, p. 26, Freiburg, Germany, Oct. 1996.

5. Background and Motivation  Starting point: Lehrstuhl Informatik 4, RWTH Aachen  Project ANNABELLE (Anomalies in Normaluser Network Applications Based on Experiments in a Lovely Lehrstuhl-Environment), 1996-1998 M. Berger, O. Kubitz, K. Jakobs, P. Reichl, A. Koch: Project ANNABELLE: Anomalies in Normal-User Network Applications Based on Experiments in a Lovely Lehrstuhl Environment. Proc. 3 rd Biennial SSE European Meeting, p. 26, Freiburg, Germany, Oct. 1996. „Annabelle, ach Annabelle, Du bist so herrlich intellektuell, Du bist so wunderbar negativ und so erfrischend destruktiv...“

6. Background and Motivation  Starting point: Lehrstuhl Informatik 4, RWTH Aachen  Project ANNABELLE (Anomalies in Normaluser Network Applications Based on Experiments in a Lovely Lehrstuhl-Environment), 1996-1998 M. Berger, O. Kubitz, K. Jakobs, P. Reichl, A. Koch: Project ANNABELLE: Anomalies in Normal-User Network Applications Based on Experiments in a Lovely Lehrstuhl Environment. Proc. 3 rd Biennial SSE European Meeting, p. 26, Freiburg, Germany, Oct. 1996.

7. Background and Motivation  Starting point: Lehrstuhl Informatik 4, RWTH Aachen  Project ANNABELLE (Anomalies in Normaluser Network Applications Based on Experiments in a Lovely Lehrstuhl-Environment), 1996-1998 M. Berger, O. Kubitz, K. Jakobs, P. Reichl, A. Koch: Project ANNABELLE: Anomalies in Normal-User Network Applications Based on Experiments in a Lovely Lehrstuhl Environment. Proc. 3 rd Biennial SSE European Meeting, p. 26, Freiburg, Germany, Oct. 1996.

8. Background and Motivation  Starting point: Lehrstuhl Informatik 4, RWTH Aachen  Project ANNABELLE (Anomalies in Normaluser Network Applications Based on Experiments in a Lovely Lehrstuhl-Environment), 1996-1998  After the PhD: Forschungszentrum Telekommunikation Wien (FTW)  WISQY (Wireless Inter-System Quality of Service), 2002-2004 M. Berger, O. Kubitz, K. Jakobs, P. Reichl, A. Koch: Project ANNABELLE: Anomalies in Normal-User Network Applications Based on Experiments in a Lovely Lehrstuhl Environment. Proc. 3 rd Biennial SSE European Meeting, p. 26, Freiburg, Germany, Oct. 1996. P. Reichl, M. Umlauft, J. Fabini et al.: Project WISQY: A Measurement-Based End-to-End Performance Compa- rison of 2.5G and 3G Networks. Proc. 5th Wireless Telecommunications Symposium, Pomona, CA, April 2005.

9. Background and Motivation  Starting point: Lehrstuhl Informatik 4, RWTH Aachen  Project ANNABELLE (Anomalies in Normaluser Network Applications Based on Experiments in a Lovely Lehrstuhl-Environment), 1996-1998  After the PhD: Forschungszentrum Telekommunikation Wien (FTW)  WISQY (Wireless Inter-System Quality of Service), 2002-2004  CAMPARI (Configuration, Architecture, Migration, Performance Analysis and Requirements of 3G IMS), 2004-2006 M. Berger, O. Kubitz, K. Jakobs, P. Reichl, A. Koch: Project ANNABELLE: Anomalies in Normal-User Network Applications Based on Experiments in a Lovely Lehrstuhl Environment. Proc. 3 rd Biennial SSE European Meeting, p. 26, Freiburg, Germany, Oct. 1996. P. Reichl, M. Umlauft, J. Fabini et al.: Project WISQY: A Measurement-Based End-to-End Performance Compa- rison of 2.5G and 3G Networks. Proc. 5th Wireless Telecommunications Symposium, Pomona, CA, April 2005. P. Reichl, J. Fabini, N. Jordan et al.: Quo Vadis, IMS? Das Projekt CAMPARI als mobilnetz-orientierte Standortbestimmung für das IP Multimedia Subsystem. e&i 123 no. 7/8, pp. 315–322. Springer, Aug. 2006.

10. Background and Motivation  Successor Projects:  CAIPIRINA (Converging towards All-IP: IMS Realization Issues for NGN Applications), 2006-2008

11. Background and Motivation  Successor Projects:  CAIPIRINA (Converging towards All-IP: IMS Realization Issues for NGN Applications), 2006-2008  BACCARDI (Beyond Architectural Convergence – Charging, Applica- tions, Realization and Demonstration of 3G IMS), 2008-2010

12. Background and Motivation  Successor Projects:  CAIPIRINA (Converging towards All-IP: IMS Realization Issues for NGN Applications), 2006-2008  BACCARDI (Beyond Architectural Convergence – Charging, Applica- tions, Realization and Demonstration of 3G IMS), 2008-2010  BIQINI (BACCARDI’s IMS QoS Implementation Initiative), 2010 C. Egger, M. Happenhofer, J. Fabini, P. Reichl: BIQINI – A Flow-based QoS Enforcement Architecture for NGN Services. Proc. TRIDENTCOM 2010, Berlin, Germany, May 2010

13. Background and Motivation  Successor Projects:  CAIPIRINA (Converging towards All-IP: IMS Realization Issues for NGN Applications), 2006-2008  BACCARDI (Beyond Architectural Convergence – Charging, Applica- tions, Realization and Demonstration of 3G IMS), 2008-2010  BIQINI (BACCARDI’s IMS QoS Implementation Initiative), 2010  Empirical observation: obvious correlation between “efficiency level” of the acronym [in %] and acquired project budget [MEUR] C. Egger, M. Happenhofer, J. Fabini, P. Reichl: BIQINI – A Flow-based QoS Enforcement Architecture for NGN Services. Proc. TRIDENTCOM 2010, Berlin, Germany, May 2010

14. Background and Motivation  Successor Projects:  CAIPIRINA (Converging towards All-IP: IMS Realization Issues for NGN Applications), 2006-2008  BACCARDI (Beyond Architectural Convergence – Charging, Applica- tions, Realization and Demonstration of 3G IMS), 2008-2010  BIQINI (BACCARDI’s IMS QoS Implementation Initiative), 2010  Empirical observation: obvious correlation between “efficiency level” of the acronym [in %] and acquired project budget [MEUR]  EU FP7: similar, but much more hesitant: CHIANTI, SCAMPI, DUPLO … C. Egger, M. Happenhofer, J. Fabini, P. Reichl: BIQINI – A Flow-based QoS Enforcement Architecture for NGN Services. Proc. TRIDENTCOM 2010, Berlin, Germany, May 2010

15. Background and Motivation  Successor Projects:  CAIPIRINA (Converging towards All-IP: IMS Realization Issues for NGN Applications), 2006-2008  BACCARDI (Beyond Architectural Convergence – Charging, Applica- tions, Realization and Demonstration of 3G IMS), 2008-2010  BIQINI (BACCARDI’s IMS QoS Implementation Initiative), 2010  Empirical observation: obvious correlation between “efficiency level” of the acronym [in %] and acquired project budget [MEUR]  EU FP7: similar, but much more hesitant: CHIANTI, SCAMPI, DUPLO …  Research question: can we generalize that? underlying models / metrics? C. Egger, M. Happenhofer, J. Fabini, P. Reichl: BIQINI – A Flow-based QoS Enforcement Architecture for NGN Services. Proc. TRIDENTCOM 2010, Berlin, Germany, May 2010

16. From Evolutionary to Evaluationary Game Theory  Idea: theoretical analysis  Established Framework: Evolutionary Game Theory  “survival of the fittest”

17. From Evolutionary to Evaluationary Game Theory  Idea: theoretical analysis  Established Framework: Evolutionary Game Theory  “survival of the fittest”  Problem: Nash equilibria exist, but asymmetry between applying project consortia and evaluation body (a.k.a. EU)

18. From Evolutionary to Evaluationary Game Theory  Idea: theoretical analysis  Established Framework: Evolutionary Game Theory  “survival of the fittest”  Problem: Nash equilibria exist, but asymmetry between applying project consortia and evaluation body (a.k.a. EU)  Idea: use “Nash-Potton Equilibrium”

19. From Evolutionary to Evaluationary Game Theory  Idea: theoretical analysis  Established Framework: Evolutionary Game Theory  “survival of the fittest”  Problem: Nash equilibria exist, but asymmetry between applying project consortia and evaluation body (a.k.a. EU)  Idea: use “Nash-Potton Equilibrium”  original approach: informatics and religion (catholics/protestants vs GOD)

20. From Evolutionary to Evaluationary Game Theory  Idea: theoretical analysis  Established Framework: Evolutionary Game Theory  “survival of the fittest”  Problem: Nash equilibria exist, but asymmetry between applying project consortia and evaluation body (a.k.a. EU)  Idea: use “Nash-Potton Equilibrium”  original approach: informatics and religion (catholics/protestants vs GOD)  here: project consortia vs. EU

21. From Evolutionary to Evaluationary Game Theory  Idea: theoretical analysis  Established Framework: Evolutionary Game Theory  “survival of the fittest”  Problem: Nash equilibria exist, but asymmetry between applying project consortia and evaluation body (a.k.a. EU)  Idea: use “Nash-Potton Equilibrium”  original approach: informatics and religion (catholics/protestants vs GOD)  here: project consortia vs. EU  Result: Evaluationary Game Theory – Management-by-Acronym (MBA)

22.  First idea: Evaluation result E proportional to acronym matching ratio m Fundamental Metric

23.  First idea: Evaluation result E proportional to acronym matching ratio m  E = m  c 2 Fundamental Metric

24.  First idea: Evaluation result E proportional to acronym matching ratio m  E = m  c 2  Problem 1: formula already invented and heavily used  Problem 2: no Greek letters (  scientific value???) Fundamental Metric

25.  First idea: Evaluation result E proportional to acronym matching ratio m  E = m  c 2  Problem 1: formula already invented and heavily used  Problem 2: no Greek letters (  scientific value???)  Much better: queuing theoretic approach  degree of efficiency [%]  funding arrival rate (  1/runtime, Little’s Law!) ACK  “Formalprüfungsindikator” (FBI, = 1 if proposal has been properly submitted in time & space etc.) Fundamental Metric

26.  First idea: Evaluation result E proportional to acronym matching ratio m  E = m  c 2  Problem 1: formula already invented and heavily used  Problem 2: no Greek letters (  scientific value???)  Much better: queuing theoretic approach  degree of efficiency [%]  funding arrival rate (  1/runtime, Little’s Law!) ACK  “Formalprüfungsindikator” (FBI, = 1 if proposal has been properly submitted in time & space etc.)  Resulting metric: E = ACK     m Fundamental Metric

27. Empirical Validation 27

28. Empirical Validation 28  =40% m < 1  =37.5% m = 1  =24% m  1  =25% m = 1 Simplifying assumption: constant funding arrival rate

29. Empirical Validation 29  Conclusion: no need to worry any more about project content etc.  =40% m < 1  =37.5% m = 1  =24% m  1  =25% m = 1 Simplifying assumption: constant funding arrival rate

30. Empirical Validation 30  Conclusion: no need to worry any more about project content etc.  Open issue: limiting behaviour, e.g. what about other drugs?  =40% m < 1  =37.5% m = 1  =24% m  1  =25% m = 1

31. Empirical Validation 31  Conclusion: no need to worry any more about project content etc.  Open issue: limiting behaviour, e.g. what about other drugs?  MARIUANA (Monitoring, Analysis and Reporting of Intrusive, Unwanted and Anomalous Network Activities)???  =40% m < 1  =37.5% m = 1  =24% m  1  =25% m = 1 © Fabio Ricciato

32. Empirical Validation 32  Conclusion: no need to worry any more about project content etc.  Open issue: limiting behaviour, e.g. what about other drugs?  MARIUANA (Monitoring, Analysis and Reporting of Intrusive, Unwanted and Anomalous Network Activities)???  ViaGra (Via donau Graphics)???  =40% m < 1  =37.5% m = 1  =24% m  1  =25% m = 1 © Fabio Ricciato © Toni Fuhrmann

33. Summary and Conclusions

34. Ode an das Akronym

35. Summary and Conclusions Ode an das Akronym Wie herrlich ist es, ein Projekt zu planen, sodann zu leiten auf kühne Bahnen,

36. Summary and Conclusions Ode an das Akronym Wie herrlich ist es, ein Projekt zu planen, sodann zu leiten auf kühne Bahnen, sich nie zu kümmern um Budget und Zahlen, stattdessen visionär voranzustrahlen.

37. Summary and Conclusions Ode an das Akronym Wie herrlich ist es, ein Projekt zu planen, sodann zu leiten auf kühne Bahnen, sich nie zu kümmern um Budget und Zahlen, stattdessen visionär voranzustrahlen. O Kohle mio, du kommst daher von ganz alleine und ohn‘ Beschwer; o Kohle, o Kohle mio, nur Akronyme, es braucht nicht mehr.

38. BACCARDI, CHIANTI, WISQY, CAIPIRINA, und auch CAMPARI brachten viel Gewinn, ja!

39. BACCARDI, CHIANTI, WISQY, CAIPIRINA, und auch CAMPARI brachten viel Gewinn, ja! MARIUANA…? Man muss nicht viel wagen, um umso mehr Budget davonzutragen.

40. BACCARDI, CHIANTI, WISQY, CAIPIRINA, und auch CAMPARI brachten viel Gewinn, ja! MARIUANA…? Man muss nicht viel wagen, um umso mehr Budget davonzutragen. O Kohle mio, vorbei der Stress der Antragsstellung: wie man bemess‘ die Kohle für das Projekt, das man so mühsam da ausgeheckt.

41. BACCARDI, CHIANTI, WISQY, CAIPIRINA, und auch CAMPARI brachten viel Gewinn, ja! MARIUANA…? Man muss nicht viel wagen, um umso mehr Budget davonzutragen. O Kohle mio, vorbei der Stress der Antragsstellung: wie man bemess‘ die Kohle für das Projekt, das man so mühsam da ausgeheckt. O Kohle mio, du kommst daher von ganz alleine, ’s ist nicht so schwer; o Kohle, o Kohle mio: die Akronyme, die helfen sehr.

42. The End Univ.-Prof. Dr. Peter Reichl Full Professor and Head of Research Group “Cooperative Systems (COSY)” Faculty of Informatics University of Vienna Visiting address: Währinger Strasse 29 / 3.38 1090 Vienna peter.reichl@univie.ac.at Thanks for your attention! Any feedback welcome!