1. Usability of Web Content Management Systems Mrudula Talloju Masters Defense Major Professor: Dr. William Hankley

2. Overview Introduction Objectives Web Content Management Systems Jahia Usability Usability Testing Limitations of Testing The Actual Test Results and Conclusion

3. Introduction Web CMS Usability Usability Definition How is it measured? Usability Testing is done to determine whether or not a web application developed in Jahia is more usable than a similar application developed using traditional web designing tools.

4. Objectives Study Usability Testing Design an effective test to check the usability of a website developed using Jahia. Conduct the test with right selection of participants. Determine whether or not applications developed in Jahia are more usable.

5. Web CMS How web CMS works?

6. Web CMS Different web CMS Drupal Jahia Alfresco and many more. Web CMS ease the task of developing and maintaining websites.

7. Jahia – Technologies and Features Enterprise Content Management Server Complete web based interface Multilanguage support WYSIWYG editing Staging Dynamic URL checking Time based publishing Versioning

8. Jahia – Technologies and Features Document Management Server Index and search for files Drag and drop the files Search and Indexation Server Automatic indexation of all content Saved searches Portal Server Collaborative Suite Cache Proxy Server

9. Jahia Architecture

10. Usability Usability Attributes Learn ability Efficiency Memorability Errors Satisfaction

11. Usability Testing Usability testing is a means of measuring the quality of users’ experience when interacting with a website or any user-operated device. Types of Usability Tests Exploratory Test Assessment Test Validation Test Comparison Test

12. Usability test types

13. Limitations of Testing Testing does not guarantee or prove that a product is usable. Testing is always an artificial situation Participants are rarely fully representative of the target population

14. The Actual Test University of Lausanne website developed in Jahia Colorado State University website

15. Test Plan Develop usability test questionnaire for both websites Conduct test with right selection of users Compare results Number of difficult tasks Time taken to finish the tasks Users’ responses Satisfaction level of users

16. Test Documents User Details Document

17. Test Documents Usability Test (Task Based) Document

18. Test Documents Exit Test

19. Selection of Participants End users will be Students Parents General Visitors “The best results come from testing no more than 5 users and running as many small tests as you can afford.” – Jakob Nielsen.

20. Five Users User 1: College Student User 2: Graduate Student User 3: Parent with browsing experience User 4: Parent with very little browsing experience User 5: General visitor with good browsing experience

21. Tasks Given Task 1: Go to Economics Department website. Task 2: Course information Task 3: Admission requirements Task 4: Scholarship information Task 5: Student Activities in the university Task 6: Housing options

22. Difficulty Level of Tasks Difficulty 0: User follows correct path and finishes task Difficulty 1: User follows a different path and finishes task with little effort Difficulty 2: User finishes task with difficulty and feels frustrated Difficulty 3: User does not finish the task or an error occurs.

23. Results University of Lausanne (Jahia) Task 1Task 2Task 3Task 4Task 5Task 6 User 1010220 User 2000010 User 3010120 User 4011120 User 5010020

24. Problems Faced by Users Spelling and grammatical errors in content Content of few pages not available in English Same template for university and department websites

25. Results Colorado State University Task 1Task 2Task 3Task 4Task 5Task 6 User 1031000 User 2030000 User 3022010 User 4022010 User 5011000

26. Problems Faced by Users Few clicks resulted in errors. List of courses is unorganized. Links to navigate back and forth the pages are missing in some pages.

27. Users Response Univ. of LausanneColorado St. Univ. Look and feelGood Organized contentYesNo NavigationEasy Finished all tasks successfully YesNo ErrorsNoYes LanguageNot clearGood

28. Conclusion Users are more satisfied with Jahia website when compared to other website. Rectifying the grammatical errors and using different templates (or colors) increases usability. No task will be of difficulty level 2.

29. Acknowledgements Dr. William Hankley Dr. Mitchell Neilsen Dr. Torben Amtoft

30. Questions