1. COMMECS Institute of Business & Emerging Sciences (CIBES) Karachi Presentation on Quality Assurance in Education A Brief History and Implications of Examination Systems By: Prof. Dr. Ayub Mehar Dean, Management Sciences Institute of Business & Technology (BIZTEK) Karachi dr.mehar@biztek.edu.pkdr.mehar@biztek.edu.pkDecember 16, 2006

2. OUTLINE 1.Characteristics of a Good Examination System 2.Historical Roots of Examination Systems 3.Chinese System 4.American Examination System 5.Semester System 6.Blind Examination System in Research Evaluation 7.History of Public Examinations 8.Types of Examinations by Purpose of Education 9.Contemporary Issues in Pakistani Environment 10.Recognized Accrediting Organizations

3. Characteristics of a Good Examination System CharacteristicDescriptionIndicators 1. Fitness for PurposeReliability and validity of Marking system and examination Paper Acceptance by teachers and students that the exam are according to the syllabus. Statistical evidence of the exams technical quality (eg. Reliability, level of difficulty) Adequate quality control measures. 2. Equity, Integrity and Public Confidence No particular candidate or group of candidates has an unfair advantage over others. High level of trust in the honesty of exam agency staff Little evidence of candidates resorting to the use of ‘Unfair means’ (cheating). Exam authority has procedures for rechecking of marks and an appeals procedure. Special support is available for disadvantaged candidates.

4. Characteristics of a Good Examination System (Contd.) CharacteristicDescriptionIndicators 3. Efficiency and Cost-Effectiveness The best possible use of physical, financial and human resources. Results should be issued on time. Exam fees do not place an excessive burden on parents and students. Results are issued in time and in an appropriate form for decision making. 4. TransparencyThe examination process should, as far as possible, be open to public scrutiny. Non- confidential materials including regulations, syllabuses and sample/past exam papers are widely available. Reports, including statistical data, on exam performance available. Marking system and criteria for award of grades available.

5. CharacteristicDescriptionIndicators 5. Beneficial Effect on Classroom practice The examination system should promote good teaching and learning practices. Exam encourages the development of higher- order thinking skills and does not place emphasis on recall of facts. Characteristics of a Good Examination System (Contd.)

6. Historical Roots of Examination System Chinese System (Blind Examination) Introduced over 2000 years ago in China To Select the most able citizens for the civil service Examples NTS, Public Examinations Competitive Examinations External Examinations

7. Introduced by Greek philosophers Adopted by Islamic Scholars and Madarsas To Induct new knowledge and promote thinking process Examples Semester System Training Workshops Referral System Greek System (Mentor as Examiner)

8. Introduced over 2000 years ago in China Adopted by Europe Except UK and France in 16th Century Adopted by Russia in 18th Century Adopted by France in late 18th Century Adopted by Britannia in 19th Century Adopted by USA in 1883 Chinese System

9. Developed in 20th Century Emphasis on behavioral (Psychometrics) measurement. Heavy reliance on objective and standardized modes of assessment. Multiple Choice testing Computer-based grading; E-examinations; Moderation; and Averaging Adopted by south and Central America, Indonesia, and the Philippines American Examination System

10. A mixture of Chinese and Greek system Not available to External Candidates Requires higher degree of autonomy, independency and continuous learning environment in the teaching institutions Requires higher degree of integrity and continuous updating of the subject matter by the faculty Semester System

11. Blind Referral System External Evaluation Impact Factor Blind Examination System in Research Evaluation

12. The Abitur as a graduation examination for the classical middle School 1788 The Abitur as a qualified examination for universities The Baccalaureate was established in Napoleonic France in 1808 London university held its first matriculation examination in 1838 The New York Board of Regents conducted the first examination in 1865 The new approaches developed by the United states in 20th century (SAT, GMAT, GRE. etc) History of Public Examination

13. Types of Examination by Purpose of Education Types of Education Purpose System of Assessment / Examination BritishUSA A) Basic i. Primary ii. Elementary To increase literacy rate To increase the level of understanding for the common phenomena Internal Internal/ No Examination B) Higher School and Intermediate To teach learning how to learn Local Boards/ Cambridge/ Edexcel (A & O Level) Internal/ NTS (ETS-SAT)

14. Types of Examination by Purpose of Education (Contd.) Types of Education Purpose System of Assessment / Examination BritishUSA C) Higher Education i. Under graduation ii. Post graduation To impart significant volume of specialized subject knowledge. To make a bridge between existing body of Knowledge and Knowledge Creation University Examinations University Examination (EST – GRE/ GMAT)

15. Types of Examination by Purpose of Education (Contd.) Types of Education Purpose System of Assessment / Examination BritishUSA C) Higher Education iii. Research degree Creation of new Knowledge Published work (or publishable work) (M Phil to PhD) University Exam (MS to PhD

16. Types of Examination by Purpose of Education (Contd.) Types of Education Purpose System of Assessment / Examination BritishUSA D) Vocational Education E) Professional Education (Certification) Training for specialized jobs To ensure required integrity for specialized professions (Doctors, Engineers, Lawyers, chartered Accountants etc. Training Modules Certification leading to membership - Membership leading to certification

17. Contemporary Issues in Pakistani Environment Ideology VS Creativity Religion’s ingredient in Education Duration of Education Academic Orientation (British VS American System) Transformation and Equivalency Issues Accreditation. Job Orientation Linkages between knowledge creation and Economic Development

18. Recognized Accrediting Organizations ACCREDITOR CHEA Recognized Organizatio n USDE Recognized Organization REGIONAL ACCREDITING ORGANIZATIONS Middle State Association of college and School Middle State Commission on Higher Education New England Association of School and College Commission on Institute of Higher r Education New England Association of School and Colleges Commission on Technical and Career Institution North Central Association of Colleges and School The Higher Learning Commission Northwest Commission on College and Universities Southern Association of College and Schools Commission on Colleges western Association of School and College Accrediting Commission for Community and Junior Colleges Western Association of School and College Accrediting Commission for Senior College and University **************** ****************

19. Recognized Accrediting Organizations NATIONAL ACCREDITING ORGANIZATION CHE Recognized Organization USDE Recognized Organization Accrediting Bureau of Health Education Schools Accrediting Commission of Career Schools and Colleges of Technology Accrediting Commission of the Distance Education and Training Council Accrediting Council for Continuing Education and Training Accrediting Council for Independent Colleges and Schools Association of Advanced Rabbinical and Talmudic Schools Accreditation Commission on Accrediting Commission Association for Biblical Higher Education Commission on Accreditation Council on Occupational Education National Accrediting Commission of Cosmetology Arts and Sciences, Inc Transnational Association of Christian Colleges and Schools Accreditation Commission --*-***--*--*-***--* ********************

20. THANK YOU