1. SYSTEMIC ASSESSMENT Workshop Faculty of Medicine Zagazig University PART-I Prof.A.F.M.FAHMY January 2010

2. SYSTEMIC ASSESSMENT SYSTEMIC LEARNING OUTCOMES COGNATIVE COGNATIVE AFFECTIVE SKILLS

3. Requirements for building Systemic Assessment -Content analysis of the course unites into concepts, and their related knowledge, skills, attitudes. --Determination of the size of the building - systemics[ Trigonal- Quadrilateral- ……] -Determinations of the types of relations between the given concepts.

4. General Advantages of Systemic Assessment 1- Assess students higher-order thinking skills in which students are required to analyze, synthesize, and evaluate 3- SA enables the students to build correct cognitive structure. 2- SA measures the students' ability to correlate between concepts.

5. 4- SA enables the students to discover new relation between concepts. 5- SA reduces the students guessing the answer. 7-SA based on the psychometric, and eudiometric Domains. 6-SA gives students rapid feedback during the term about how well they are understanding the material.

6. 8- SA assess the students in a wide range of Concepts in the course unites. 10- SA is very easy scored. 9- SA measures the overarching ILO,s, beside separate ILO,s.

7. Types of Systemic Questions - Systemic Multiple Choice Questions [SMCQ,S]. - Systemic Multiple Response Questions [SMRQ,S]. - Systemic True, False, Questions [STFQ,S]. -Systemic Matching Questions [SMQ,S].. - Systemic Multiple True, False Questions [SMTFQ,S].

8. - Systemic Sequencing Questions [SSQ, S]. - Synthesize Systemic relations between concepts, facts, issues, numbers… - Complete systemics - Analyze Systemic to its Components

9. I-Systemic Multiple Choice Questions [ SMCQ, s] - In SMCQ,s the student is provided with a question and a range of possible systemics and asked to choose correct systemic. - - Each systemic represents 3, 4 or 5 Relations between concepts, facts, issues.

10. Disadvantage : - Do not allow instructors to measure students' writing skills. - SMCQ,s reduces the students guessing the answer. Advantages: - SMCQ,s can measure various kinds of knowledge including students' ability to correlate between concepts,

11. - SMCQ,s can assess higher-order thinking Skills in which students are required to analyze, synthesize, and evaluate. - SMCQ,s scored with the machine. - SMCQ,s tests reduces anxiety and Promote mastery of the material

12. Guide lines for Writing good SMCQ,s 1-Specify objectives so that the questions can be specific and focused 2- Provide the information in the stem and keep the options as clear systemics. Avoid the use of negatives in the stem. - 4 3- Put in the stem the information make the problem clear & specific.

13. 5-Keep systemic options similar in size [triangular, or quadrilateral, or pentagonal systemics ] 6-Balance the placement of the correct answer. 7-Use very precise and unambiguous systemic relations

14. Put ( ) in front of the correct systemic diagram: The systemic diagram represents the correct relations between concepts (A D) is one of the following.

15. ( ) A B E X Y Z a) D C ( ) A B E X Y Z b) D C

16. A, B, C, D are concepts. X, Y, Z, E are relations. Answer: a ( ) ( ) A B E X Y Z c) C C ( ) A B E X Y Z d) D C ILO : Analysis

17. ( ) 50 100 -100 X 2 +100 -50 a) 150 200 ( ) 50 100 -100 X 2 +100 -100 b) 150 200 Example-1 : [Math.]: Put ( ) in front of the correct systemic diagram:

18. . Answer : a ( ) ( ) 50 100 -100 X 2 +50 -50 c) 150 200 ( ) 50 100 -100 X 2 +100 +50 d) 150 200 ILO: Analysis

19. Example-2[ Chem.]: Put ( ) in front of the correct systemic diagram:

20. Answer: b ( )

21. II-Systemic Multiple Response Questions [ SMRQ,s] ( SMCQs) involve the selection of more than one correct systemic from a group of systemics. Marking scheme: - Choices are marked as correct or incorrect. As in the MRQ,s

22. - Advantages, and Disadvantages The same as SMCQ,s... Guide lines for Writing good SMRQ,s The same as SMCQ,s

23. A, B, C, D are concepts.. X, Y, Z, E are relations.. Answer: a, c ( ) Learning Level: Evaluation Put ( ) in front of the correct systemics: Systemics of the relations between concepts (A D) are:

24. ( ) 50 100 -100 X 2 +100 -50 a) 150 200 ( ) 50 100 -100 X 2 +100 -100 b) 150 200 Example-1 : [Math.]: Put ( ) in front of the correct systemic diagrams:

25. Answer : a & c ( ) ( ) 50 100 -100 X 2 -50 c) 150 200 ( ) 50 100 -100 X 2 +100 +50 d) 150 200 ILO: Analysis

26. Example 2- [Chem.]: Systemics of correct chemical relations between Ethanol, Acetaldehyde, Acetylene, and Ethylene are.

27. Answer: a, b ( ) ILO: Analysis

28. III-Systemic True False Questions [STFQ,s ] -STFQ,s are well suited for testing student comprehension, synthesis and analysis.. - There is one right answer, gain 100% and one wrong answer gain 'none'. - (STFQs) require a student to assess whether a systemic is true or false.

29. Disadvantage : STFQ,s do not allow instructors to measure students' writing skills.. - Advantages: - Students can respond to many STFQ,s, covering a lot of concepts & facts and their relations in a short time.

30. - STFQ,s. scores are more reliable.. - Teacher's can easily score STFQ,s. STFQ,s can assess higher-order thinking skills in which students are able to analyze, synthesize, and evaluate.

31. Guide lines for Writing good [STFQ,s] - Writing TF Systemics include the following: - Systemics should be relatively simple. - TRUE- Systemics should be about the same size as FALSE-Systemics. - Arrange the Systemics so that there is no- discernible pattern of answers.

32. A, B, C, D are concepts. X, Y, Z, E are relations. Answer: True systemic are a, c ILO: Analysis Put ( ) in front of the correct systemics: Which of the following systemics are true and which are false:

33. ( ) 50 100 -100 X 2 +100 -50 a) 150 200 ( ) 50 100 -100 X 2 +100 -100 b) 150 200 Example-1 : [Math.]: Which of the following systemics are true and which are false:

34. Answer : a & d ( ) ( ) 50 100 -100 X 2 X 3 -50 c) 150 200 ( ) 50 100 -100 +50 +100 -50 d) 150 200 ILO: Analysis

35. Example 2-[Chem.]: Which of the following systemics are true and which are false:

36. Answer : True systemics are (a, b, f, h) ( ) ILO: Analysis

37. IV-Systemic Multiple True False Questions [SMTFQ, s] MTFQ,s require the students to Select the responses (true or false systemic) - SMTFQ, s combines the building elements of SMCQ & STFQ. - MTFQ,s consists of clear stem and 4 or 5 true and false Systemic options

38. ( ) 50 100 -100 X 2 +100 -50 a) 150 200 ( ) 50 100 -100 X 2 +100 -100 b) 150 200 Example-1 : [Math.]: The relations between the numbers :50,100,150,200 are presented systemically in the following systemics, Put ( ) in front of the correct systemic diagram,& (X) in front of the wrong

39. . Answer: a,d ( ) & b,c (x) ( ) 50 100 -100 X 2 +50 -50 c) 150 200 ( ) 50 100 -100 +50 +100 +50 d) 150 200 ILO: Analysis