ENQA training of agency reviewers Focus on the ESG and the ENQA membership criteria Guy Aelterman Paris, 22 May 2009

Differences and Similarities ENQA criteria Developed by ENQA (see development ESG) Included in regulations Transformation of ENQA into an association, regulations formulated end 2004 Criteria regulations revised twice (last time 2008 ) Membership criteria (exclusive, substantial compliance) For full membership (new members) For renewal full membership (review report) Focus on the ESG and the ENQA membership criteria Paris, 22 May 2009

Differences and Similarities ESG Historical context Ministers mandate from the Berlin conference (2003) to develop an agreed set of standards, procedures and guidelines on quality assurance ENQA-working group 2003 – 2005, consultation with E4 in late 2004/early 2005 Adoption by ministers in Bergen May 2005 Focus on the ESG and the ENQA membership criteria Paris, 22 May 2009

Differences and Similarities ESG 3 levels, linked one to the other Part 1, programme or institution IQA Part 2, assessment programme or institution EQA Part 3, QA of Agency ESG are as such not exclusive. See the submission of the ESG to BFUG (Feb 2005): to form a background for quality assurance agencies in their work.(reference points ) Focus on the ESG and the ENQA membership criteria Paris, 22 May 2009

Differences and Similarities EQAR (European QA Register) March 2008: Foundation of the European Register Register of QA agencies Compliance with ESG as admission criteria Exclusive (substantial compliance) ENQA full membership as prima facie evidence for meeting the admission requirements of EQAR Focus on the ESG and the ENQA membership criteria Paris, 22 May 2009

Differences and Similarities Standards and guidelines Standards are criteria Guidelines = guiding, explaining, no criteria, no obligations ??? ENQA criteria correspond to ESG, but only to standards and not to guidelines (e.g. student participation is not part of the membership criteria) Cultural context : the same term may have a different connotation or a different meaning Focus on the ESG and the ENQA membership criteria Paris, 22 May 2009

Differences and Similarities Link ENQA criteria and ESG In the development of the criteria and the ESG ENQA criteria = level 3 of ESG External review has often double objective Criteria comparable to codes of other international QA organisations as INQAAHE Principle based or rules based? Agencies shall follow the ESG and have to comply with the membership criteria Focus on the ESG and the ENQA membership criteria Paris, 22 May 2009

Differences and Similarities Comparison of QA standards between networks Focus on the ESG and the ENQA membership criteria Paris, 22 May 2009 INQAAHEENQAECAAPQNAPSAOECD 1Mission Statement13.5;3.31;131;21 2Relation QAA/HEI22.2; ; Decision Making33.6;3.73;4;1474;6 4External Committee4 2.4;3.6; Public face53.78; Documentation ;20.1 7Resources Appeal QA92.8;3.86;782; Collaboration with other QAA10x ;20.3

Differences and Similarities Comparison of QA standards between networks Focus on the ESG and the ENQA membership criteria Paris, 22 May 2009 INQAAHEENQAECAAPQNAPSA OEC D 11 Recognition by authorities/ Status Elements of external review x 13 Issues specifically relating to accreditation 12;13;1 4 14Independance3; Professional staff 3 16 Cross border …. x

Membership criteria ENQA Criterion 1: Activities ESG 3.1, 3.3 Attention: take into account the presence and effectiveness of the external quality assurance processes described in Part 2 of the European Standards and Guidelines (ESG) Focus on the ESG and the ENQA membership criteria Paris, 22 May 2009

Membership criteria ENQA Criterion 2: Official statusESG 3.2 Attention: formally recognised by competent public authorities in the EHEA Focus on the ESG and the ENQA membership criteria Paris, 22 May 2009

Membership criteria ENQA Criterion 3: Resources ESG 3.4 Attention: adequate and proportional resources, both human and financial Focus on the ESG and the ENQA membership criteria Paris, 22 May 2009

Membership criteria ENQA Criterion 4: Mission statement ESG 3.5 Attention: have clear and explicit goals and objectives for its work, contained in a publicly available statement Focus on the ESG and the ENQA membership criteria Paris, 22 May 2009

Membership criteria ENQA Criterion 5: Independence ESG 3.6 Attention: its operational independence from higher education institutions and governments procedures and methods, appointment of external experts and determination of outcomes of quality assurance processes are undertaken autonomously and independently = independent process Focus on the ESG and the ENQA membership criteria Paris, 22 May 2009

Membership criteria ENQA Criterion 6: External quality assurance criteria and processes ESG 3.7 Attention: The processes, criteria and procedures used by the member should be pre-defined and publicly available. Processes will normally be expected to include: -a self-assessment or equivalent - an external assessment by experts, including student - publication of a report - follow-up procedure - appeal procedure Focus on the ESG and the ENQA membership criteria Paris, 22 May 2009

Membership criteria ENQA Criterion 7: Accountability procedures ESG 3.8 Attention: needs for - published policy for own IQA (on website) - a no-conflict-of-interest mechanism for external experts - ensure the quality of work of subcontractors - internal and external feedback mechanism - a mandatory cyclical external review every five years including a report on conformity with ENQA membership criteria Focus on the ESG and the ENQA membership criteria Paris, 22 May 2009

Membership criteria ENQA Criterion 8i, 8ii, 8iii: Miscellaneous (if applicable) Attention: - requirements and processes are managed professionally - judgements and decisions are reached in a consistent manner - having an appeals procedure - contributing to the aims of ENQA Focus on the ESG and the ENQA membership criteria Paris, 22 May 2009