1. Service Oriented Architecture in eTesting Systems Institute of Informatics - FNS University “Ss. Ciryl and Methodious” – Skopje, Macedonia 6 th Workshop Software Education and Reverse Engineering Goce Armenski, M.Sc (armenski@ii.edu.mk)

2. 1. CONTENT Content - C ONCLUSION - C OMMON FRAMEWORK - Е Т ЕСТ – S YSTEM FOR ELECTRONIC TESTING - S ERVICE ORIENTED ARCHITECTURE - I NTRODUCTION - А RCHITECTURE, CONCEPTS AND FUNCTIONALITY OF Е Т EST - A PPLICATION OF E T EST - R ESULTS - SOA IN E A SSESSMENT

3. 2. еТest – concepts and functionality еТest Technology - Web based application - Active Server Pages (ASP) - JavaScript - SQL Server 2000 - NT Server and Win 2000 compatible - IIS 4.0 or newer Web based sollutions VS desktop based sollutions Web Browser (Netscape 4.x or Internet Explorer 4.x, and above) Win 2000 Server Email (SMTP) IIS 4.0 +ASP SQL Server Access JScript

4. 3. еТest – concepts and functionality - learning objects - three structure Course organization Fig. 3 Course organization

5. 4. еТest – concepts and functionality Multichoice questions (choose one of many, choose many of many, yes/no answers);Multichoice questions (choose one of many, choose many of many, yes/no answers); Short entry answer (text or numerical);Short entry answer (text or numerical); Essay answer.Essay answer. Types of questions Questions can have pictures or graphs in the text or offered answersQuestions can have pictures or graphs in the text or offered answers

6. 5. еТest – concepts and functionality - dynamic linear tests (fixed number of questions) Marking and reporting Test creation algorithm - results are shown at the end of the test - negative marking Fig. 4 Algorithms for test creation

7. 6. еТest – concepts and functionality Statistical data analyses Identification of content which is not well presented;Identification of content which is not well presented; Personalized feedback to students;Personalized feedback to students; Identification of week questions which need to be revised before used again;Identification of week questions which need to be revised before used again; Identifying the individual weaknesses of students.Identifying the individual weaknesses of students.

8. 7. 4. APPLICATION OF еТEST Application of eTest - Integration in the process of learning - Controlled learning Fig. 5 Way of passing the learning objects Successful strategy?? - all questions - N questions in a row - N right questions - 3 right questions in a row Statistical analyses of the user activities

9. 8. 5. RESULTS Results The use of technology in education is very dependent of the organization - logistics - social changes Synchronization with other systems Technical infrastructure Practical Implementation Institute of Informatics, FNS (2001)Institute of Informatics, FNS (2001) А.D. Mobimak (2002)А.D. Mobimak (2002) UNDP (2003-2004)UNDP (2003-2004)

10. 9. Results Institute of Informatics, FNS (january 2001) - 26 courses - 26 courses - 12391 questions - 12391 questions - 589 scheduled assessments - 589 scheduled assessments - 9861 generated tests - 9861 generated tests Data gathering Does eTesting provides more effective and more objective assessment compared to the traditional forms, and does it help the learning process

11. 10. Results Installed in 4 Faculties from 3 Universities - not interoperable - does not allow searching or using common question bank - does not allow cross-institutional cooperation - not fully standards compliant Problems Facing with

12. Possible Solution 11. Results

13. 12. 6. SERVICE ORIENTED ARCHITECTURE Service Oriented Architecture IT Architecture Requirements Simplicity Simplicity Software that reflects the need of business Software that reflects the need of business Agility and flexibility Agility and flexibility Reusability Reusability Technology independent Technology independent Promote integration Promote integration Built to Change

14. Evolution of the Web Generation 1 Static HTML HTML Generation 2 Web Applications HTML HTML, XML Generation 3 Web Services 13. Service Oriented Architecture

15. 14. An approach for building distributed computing systems based on encapsulating business functions as services that can be easily accessed in a loosely coupled fashion. SERVICE ORIENTED ARCHITECTURE

16. SOA: It’s Not a Thing Product Product A specific technology A specific technology An application An application A specific standard A specific standard A specific set of rules A specific set of rules It’s not a: An Approach for Building Agile and Flexible Business Applications 15. Service Oriented Architecture

17. 7. SOA in eLearning 16. SOA in eLearning JISC Technical Framework to support e-Learning (ELF). JISC Technical Framework to support e-Learning (ELF). IMS Abstract Framework (IAF) IMS Abstract Framework (IAF) LeAPP Learning Architecture Project LeAPP Learning Architecture Project Carnegie Mellon’s Learning Services Architecture Carnegie Mellon’s Learning Services Architecture

18. e-Learning (ELF) 17. SOA in eLearning

19. 8. SOA in eAssessment 18. SOA in eAssessment FREMA. FREMA. TENCompetence Assessment Model TENCompetence Assessment Model

20. FREMA Core Services Assessment Services Assessment Services –Assign –Author item –Author assessment –Validate assessment –Take assessment –Mark assessment –Moderate assessment –Grade Assessment –View Feedback Support Services Support Services –Schedule –Notify –Track –Authorise and Authenticate Assessment Domain Definition Use Cases Service Profiles Gap Analysis Reference Impl’ Common Usage Patterns19. SOA in eAssessment

21. TENCompetence - Phases in the assessment process Assessment Design ItemConstruction AssessmentConstruction Assessment Delivery ResponsEvaluation Decision Making 20. SOA in eAssessment

22. eTest Core Services Assessment Services Assessment Services –Item Construction –Test Construction –Test Delivery –Results Collecting –Marking –Decision Making –Statistical Analysis Support Services Support Services –Schedule –Notify and Announce –Track –Authentication –User Management 21. SOA in eAssessment

23. 22. SOA Projects in eAssessment SOA in eAssessment –Research Projects TOIA – Technologies for Interoperable assessment TOIA – Technologies for Interoperable assessment ASSIS – Assessment Sequencing ASSIS – Assessment Sequencing APIS – assessment Provision through Interoperability APIS – assessment Provision through Interoperability … and many others … and many others –Standards Bodies In Assessment – IMS, OSIDs … In Assessment – IMS, OSIDs … In Web Services - SOAP, WSDL, WSRF, W3C … In Web Services - SOAP, WSDL, WSRF, W3C …

24. 23. 6. CONCLUSION and FUTURE FORK Conclusion Service Oriented Architecture Advantages over monolithic applications for TestingAdvantages over monolithic applications for Testing Review of existing SOA models for eAssessment Design of Common Framework by service identificationDesign of Common Framework by service identification Practical realizationPractical realization Extend the ASSIS project with different test delivery models Dependent on contextDependent on context Game based learningGame based learning

25. Thank you for your time!