2Quality Matters Quality Matters Overview and Principles The Quality Matters RubricQuality Matters as a Component of Quality AssuranceFeedback and Input
3What is it anyway?Quality Matters (QM) is a faculty-centered, peer review process designed to certify the quality of online and hybrid courses and online componentsA faculty-driven, collaborative peer review processCommitted to continuous quality improvementBased in national standards of best practice, the research literature and instructional design principlesDesigned to promote student learning and successMore than 110 institutions subscribed to Quality MattersMore than 2,500 faculty and instructional design staff participated in Quality Matters workshopsThe QM Program received the Sloan Consortium’s 2007 Faculty Development Award
5QM Certified Peer Reviewers How to interpret the standards (with examples and annotations)How to evaluate a course (hands-on with sample course)Reviews are conducted by teams of three peer reviewersChairPeer reviewer (external)Peer reviewer (SME)
6700+ faculty trained to review online courses using the rubric individuals from 158 different institutions in 28 statesMore than 2,500 faculty and instructional design staff participated in Quality Matters workshopsQuality Assurance
7The Rubric is the Core of Quality Matters 40 specific elements across 8 broad areas (general standards) of course qualityDetailed annotations and examples of good practice for all 40 standardsorg/FIPSE.htm
8Key components must align Course Alignment5 of the 8 general standards should align:Course Overview and IntroductionLearning ObjectivesAssessment and MeasurementResources and MaterialsLearner InteractionCourse TechnologyLearner SupportADA ComplianceKey components must align
9Standards A statement introduces the student to the course and the structure of the student learningNavigational instructions make the organization of the course easy to understandLearning activities foster interaction:Instructor-studentContent-studentStudent-student (if appropriate)Clear standards are set for instructor response and availability
10Standards Assessment strategies should provide feedback to the student Grading policy should be transparent and easy for the student to understandImplemented tools and media should support learning objectivesand integrate with texts and lesson assignmentsThe course acknowledges the importance of ADA compliance
11Common Areas for Improvement (2006-2007, based on 95 reviews) Area Identified%Purpose explained for ea. course element (IV.3)32%Navigational instructions (I.1)Links to academic support, student services, tutorials/resources (VII.2-VII.4)32-33%Technology/skills/pre-req. knowledge stated (I.6)35%Clear standards for instructor availability(V.3)37%Alternatives to auditory/visual content (VIII.2)39%Instructions to students on meeting learning objectives (II.4)40%Self-check/practice with quick feedback (III.5)42%Learning objectives at module/unit level (II.2)45%
12Maricopa Quality Matters Maricopa/MCLI is the statewide consortium leadTen QM Maricopa CollegesOther online Course Evaluation Resources67 faculty members, instructional designers and technologists are certified peer reviewersCollege-Based Steering Team
13Alignment with Accrediting Best Practices Best Practices Principles*Quality Matters PrinciplesThat education is best experienced within a community of learning where competent professionals are actively and cooperatively involved with creating, providing, and improving the instructional program;QM is a peer review process involving faculty, instructional designers and other support staff in a cooperative effort to continuously improve online instruction.That learning is dynamic and interactive, regardless of the setting in which it occurs;QM treats interactivity and active learning as a critical component of every online course.That instructional programs leading to degrees having integrity are organized around substantive and coherent curricula which define expected learning outcomes;QM treats the alignment of expected learning outcomes with the contents, activities and assessments as a critical element in every online course.That institutions accept the obligation to address student needs related to, and to provide the resources necessary for, their academic success;QM expects every online course to address student access to the academic, technical, and student support services essential to student success.That institutions are responsible for the education provided in their name;Adoption of QM standards reflects institutional commitment to online instructional quality, wherever an institution has endorsed the rubric standards.That institutions undertake the assessment and improvement of their quality, giving particular emphasis to student learning;The QM standards are based on research and best practices to enhance student learning in online environments. Adoption of the QM review process is a clear demonstration of institutional or programmatic commitment to assessment and continuous improvement.That institutions voluntarily subject themselves to peer review.QM is essentially a peer review process involving both internal and external peers in the evaluation of courses.*“Best Practices for Electronically Offered Degree and Certificate Programs” adopted in 2001 by CHEA and 8 regional accreditation bodies.
14Impact on Faculty Support Nationally, 89% of respondents would recommend the QM review process to othersSample commentsI was too close to see what could be improved.Provides a great way to get an objective view of your course.It made all of my online courses better.It provides a view from a more student-oriented perspective.It provides a look into potential student problems areas for course completion.Many elements that might contribute to a student withdrawing can be eliminated.
15QM is about course design Not teaching;QM is about peer reviewNot evaluationQM is about improving Student Success onlineThrough effective and consistent course design