1. Wikipedia as an Academic Reference: Managing Online Information Retrieval Johnny Snyder Mesa State College

2. History of Wikis First wiki developed by Ward Cunningham in 1995 Wiki derived from the Hawaiian phrase “awiwi, wikiwiki” which translates to quick or fast. (Hawaiian Dictionary, 2007) 2009 Mountain Plains Management Conference

3. History of Wikipedia Launched on January 15, 2001 by Jimmy Wales and Larry Sanger (Geekipedia, 2007) 2009 Mountain Plains Management Conference

4. Number of Articles Source Number of Approved Articles Number of Articles in Progress Timeframe Nupedia24742000-2003 Citizendium11011,8009/2006 - present Wikipedia for Schools 55002008/09 edition Wikipedia Unknown (est. 10,000) 3,041,2471/2001 - present Encyclopedia Britannica (print) 500,000~1770 - present 2009 Mountain Plains Management Conference

5. Academic Interest in Wikipedia 2009 Mountain Plains Management Conference

6. Academic Interest in Wikipedia Article Degree Centrality (Korfiatis, Poulos and Bokos, 2006) Vandalism and Edit Wars (Brandes and Lerner, 2007) Information Quality Metrics (Stvilia, Twidale, Gasser and Smith, 2005) Article Quality, Halavais and Lackaff (2008) Controversy Rank Models, (Vuong, Lim, Sun, Le, Lauw, and Chang, 2008) 2009 Mountain Plains Management Conference

7. Growth of Wikipedia (Alexa, 2007; Alexa,2009) Currently: oscillating between 8 – 12% 2009 Mountain Plains Management Conference

8. How I Became Interested... 2009 Mountain Plains Management Conference

9. More References to Wikipedia... UserUsage Efraim Turban, E-Commerce Textbook (Turban, et al., 2008) Wikipedia referenced for problem assignments, definition of “online intermediaries,” Wikipedia used as an e- commerce application case Douglas Samuelson – OR/MS Today Article (Samuelson, 2008) Definition of “Colony Collapse Disorder” for honey bee colonies International Association for Computer Information Systems 2007 Call for Papers (IACIS, 2007) Wikipedia definition for “globalization” Paper appearing in IJKLO Vol. 3 (Parker and Chao, 2007) Utilize Wikipedia as a teaching tool Paper appearing in JISE Vol. 19(2) (White, Longenecker, McKell, and Harris, 2008) Wikipedia definition of “assessment” 2009 Mountain Plains Management Conference

10. Problems with Wikipedia John Seigenthaler - Essjay Controversy - (Tong, 2007) 2009 Mountain Plains Management Conference God King or Benevolent Dictator Developers Stewards Oversight Bureaucrat Administrator (or Sysop) Registered User Anonymous User Banned Users and Bots

11. Solution Attempts by Wikipedia Ranking of Articles Protecting Articles Addition of Reputable Sources Accurate and Complete Articles Article Rank Reader Experience FA or FLEncyclopedic Information AFairly Complete GA Useful to General Audience B Not Complete for Research CUseful to Casual Reader Start Most Will Seek Further Information StubDictionary Definition 2009 Mountain Plains Management Conference

12. Solution Attempts by Others Harvesting and Editing Wikipedia Information for Schools 2009 Mountain Plains Management Conference

13. My Study Created a Survey in spring 2009 Administered it to: ◦ Faculty ◦ Students 2009 Mountain Plains Management Conference

14. Usage of Wikipedia (Compete, 2008) 2009 Mountain Plains Management Conference

15. Questions About Wikipedia Usage Usage statistics Viewpoint on Wikipedia usage Awareness of Wikipedia activity Comparison between faculty and student perspectives 2009 Mountain Plains Management Conference

16. Basic Faculty Statistics Demographic Wikipedia Users (n = 56) Wikipedia Non-Users (n = 24) Age (in years) = 49.7 = 49.6 Non-controversial discipline 35.7%29.2% Controversial discipline28.6%33.3% Discipline not reported35.7%37.5% 2009 Mountain Plains Management Conference Non-controversial discipline: Sciences Controversial discipline: Humanities and Social Sciences (Brandes and Lerner, 2007; Halavais and Lackaff, 2008)

17. Basic Faculty Statistics (2) Type of usageYesNo for an academic paper551 for other research3818 for independent learning (pleasure) 506 alternate types of usage:  initial research on a topic  general topic review  external links to topic 32 38 22 24 18 34 2009 Mountain Plains Management Conference

18. Basic Faculty Statistics (3) CategoryNMinimumMaximumMean Std. Deviation Consensus View_Gen_Ed46152.851.030.73 View_Major49152.471.260.63 Aware_ Controversial 56153.521.490.54 Aware_ Vandalism 56152.981.590.51 Aware_Protected _Pages 56152.571.680.44 Aware_Article_ Rank 56152.071.370.59 Aware_Article_ Revision_History 56152.981.570.50 Aware_Edited_ Anyone 55154.021.470.56 2009 Mountain Plains Management Conference 1 = very negatively, not aware 5 = very positively, very aware 0 = no consensus, 1 = complete consensus

19. Consensus 2009 Mountain Plains Management Conference (Tastle, Wierman, 2007)

20. Faculty Statistics by Discipline View of Wikipedia in: Science Faculty Humanities Faculty Statistics (t-test) General Education Classes 3.12 s = 0.86 n = 17 2.17 s = 0.24 n = 12 t = 2.88 p = 0.007 Major Classes 2.68 s = 1.34 n = 19 1.77 s = 1.53 n = 13 t = 2.11 p = 0.043 2009 Mountain Plains Management Conference

21. Faculty Statistics by Discipline (2) Awareness Category Science FacultyHumanities FacultyStatistics (t-test) Aware of Controversial Articles 3.35 s = 2.24 n = 20 3.06 s = 1.73 n = 16 t = 0.53 p = 0.603 Aware of Vandalism 2.75 s = 2.72 n = 20 2.38 s = 2.25 n = 16 t = 0.71 p = 0.481 Aware of Protected Pages 2.45 s = 2.58 n = 20 2.06 s = 2.60 n = 16 t = 0.72 p = 0.477 Aware of Article Rank Feature 2.05 s = 1.63 n = 20 1.50 s = 0.67 n = 16 t = 1.57 p = 0.126 Aware of Article Revision History 2.95 s = 2.05 n = 20 2.69 s = 2.76 n = 16 t = 0.50 p = 0.620 Aware that Articles can be Edited by Anyone 3.35 s = 3.08 n = 20 4.60 s = 1.26 n = 15 t = -2.56 p = 0.016 2009 Mountain Plains Management Conference

22. Faculty Syllabus and Grading Concerns 2009 Mountain Plains Management Conference

23. Faculty Gender Differences No significant differences were found in usage or awareness categories. 2009 Mountain Plains Management Conference

24. Student Statistics CategoryNMinimumMaximumMean Std. Deviation View_Gen_Ed 343152.350.94 View_Major 334152.201.06 Other_Students_ View 343153.620.85 View_as_Source 351153.211.08 Aware_ Controversial 359153.351.45 Aware_ Vandalism 359152.971.53 Aware_Protected _Pages 356152.531.48 Aware_Article Rank 359152.231.30 Aware_Article_ Revision_History 357152.691.41 Aware_Edited_ Anyone 359153.721.49 2009 Mountain Plains Management Conference 1 = very negatively, not aware 5 = very positively, very aware 0 = no consensus, 1 = complete consensus

25. Faculty to Student Comparison CategoryFacultyStudentsStatistics (t-test) School Year Usage 2.98 s = 4.07 n = 53 1.94 s = 2.61 n = 347 t = 2.48 p = 0.01 Non-School Year Usage 3.02 s = 4.37 n = 53 1.94 s = 4.32 n = 352 t = 1.69 p = 0.09 View in Gen Ed 2.85 s = 1.03 n = 46 2.35 s = 0.94 n = 343 t = 3.35 p = 0.00 View in Major 2.47 s = 1.26 n = 49 2.20 s = 1.06 n = 334 t = 1.62 p = 0.11 All Awareness Categories Equal Awareness 2009 Mountain Plains Management Conference

26. Student to Student Comparison Category_1Category_2Statistics (t-test) View in Gen Ed 2.35 s = 0.94 n = 343 View in Major 2.20 s = 1.06 n = 334 t = 1.94 p = 0.05 View in Gen Ed 2.35 s = 0.94 n = 343 Other Students View 3.62 s = 0.85 n = 343 t = -18.56 p = 0.00 View in Major 2.20 s = 1.06 n = 334 Other Students View 3.62 s = 0.85 n = 343 t = -19.25 p = 0.00 2009 Mountain Plains Management Conference

27. Conclusion Academic interest in Wikipedia is growing There is no consensus on usage More work...correlation and association studies Largest encyclopedia in history 2009 Mountain Plains Management Conference

28. Management of Wikipedia Management of Wikipedia: ◦ i) Do not allow usage ◦ ii) Allow usage with other corroborating source(s) ◦ iii) Allow usage 2009 Mountain Plains Management Conference

29. Questions? Comments? 2009 Mountain Plains Management Conference (Frauenfelder, 2007; Greenberg, 2007)

30. Questions? Comments? 2009 Mountain Plains Management Conference

31. Comments? Questions? 2009 Mountain Plains Management Conference What would Ambrose Bierce, author of “The Devil’s Dictionary” think about Wikipedia or Wiktionary?

32. Viewpoint “I have not bought the latest set of World Books. In fact, having been selected to be an author in the World Book, I now believe that Wikipedia is a perfectly fine source for your information, because I know what the quality control is for real encyclopedias.” (Pausch, 2008, p. 42) 2009 Mountain Plains Management Conference

33. References Alexa (2007). Wikipedia. Retrieved July 3, 2007 from: http://www.alexa.com/data/details/traffic_details?url=wikipedia.com http://www.alexa.com/data/details/traffic_details?url=wikipedia.com Brandes, U. and Lerner, J. (2007). Visual analysis of controversy in user- generated encyclopedias. Proceedings of the IEEE Symposium on Visual Analytics in Science and Technology. Compete (2008c). Personal communication for Wikipedia usage data. Frauenfelder, M. (2007). Make Everything Better. Wired 15(8). p. 103 Greenberg, J. (2007). Make Everything Better (picture). Wired 15(8). p. 102 Geekipedia (2007). A supplement to Wired: Encyclopedia Smackdown. Halavais, A., and Lackaff, D. (2008). An analysis of topical coverage of Wikipedia. Journal of Computer-Mediated Communication 13(2), p. 429- 440. Hawaiian Dictionary (2000). The Coconut Boyz Hawaiian Dictionary. Retrieved May 29, 2007 from: http://fm.hisurf.com/hawaiian/dictionary.taf?_function=list&_start=1 http://fm.hisurf.com/hawaiian/dictionary.taf?_function=list&_start=1 Howe, J. (2007). Breaking the News. Wired 15(8). p. 86-90. 2009 Mountain Plains Management Conference

34. References (2) IACIS (2007). IACIS 2007 Call for Papers. Retrieved August 20, 2007 from: http://www.iacis.org/web/call4pprs.htm http://www.iacis.org/web/call4pprs.htm Korfiatis, N., Poulos, M., and Bokos, G. (2006). Evaluating authoritative sources using social networks: an insight from Wikipedia. Online Information Review 30(3), 252-262. Parker, K. and Chao, J. (2007). Wiki as a teaching tool. Interdisciplinary Journal of Knowledge and Learning Objects 3, p. 57-72. Pausch, R. (2008). The Last Lecture. New York: Hyperion. Samuelson, D. (2008). An Ominous Buzz: Could honeybee colony collapse disorder pose serious threat to civilization? Retrieved December 18, 2008 from: http://www.lionhrtpub.com/orms/orms-12-08/frccd.htmlhttp://www.lionhrtpub.com/orms/orms-12-08/frccd.html Stvilia, B., Twidale, M., Gasser, L. and Smith, L. (2005). Information quality discussions in Wikipedia, Proceedings of ICKM05, 1-20. 2009 Mountain Plains Management Conference

35. References (3) Tastle, W. and Wierman, M. (2007). Consensus and dissention: A measure of ordinal dispersion. International Journal of Approximate Reasoning 45(3), p. 531-545. Tong, Z. (2007). Sir, please come with me for the Google search. Wired 15(10). p. 58 Turban, E., King, D., McKay, J., Marshall, P., Lee, J., and Viehland, D. (2008). Electronic Commerce 2008: A Managerial Perspective. Upper Saddle River, NJ: Pearson Vuong, B., Lim, E., Sun, A., Le, M., Lauw, H., and Chang, K. (2008). On ranking controversies in Wikipedia: Models and evaluation. Proceedings of WSDM 2008 White, B., Longenecker, H., McKell, L., and Harris, A. (2008). Assessment: Placing the emphasis on learning in information systems programs and classes. Journal of Information systems Education, 19(2), p. 165-167. 2009 Mountain Plains Management Conference