Introduction Methods Results Conclusions and Implications 1

In 2007, introduce the sunset period National Technical Qualifications(NTQ) of Korea Legal basic of NTQs: the National Technical Qualification Act Legal basic of NTQs: the National Technical Qualification Act In 1973, enacting and declaring legal basics for NTQs 2 I. Introduction In 2010, operating 512 NTQs 481 NTQs in technical skills fields, 31 NTQs in service and clerical fields. 481 NTQs in technical skills fields, 31 NTQs in service and clerical fields. 25 job areas, 114 sub job areas 25 job areas, 114 sub job areas Current Levels of NTQs in the technical skills fields Levels in service and clerical fields consist 1~3 or 1~2

Assessment criteria / sunset period 3 I. Introduction Assessment criteria Each of the NTQs has the assessment criteria except certificate of professional engineer Each of the NTQs has the assessment criteria except certificate of professional engineer certificate of professional engineer has covered all range of technic certificate of professional engineer has covered all range of technic regulated by a law in updating the assessment criteria regulated by a law in updating the assessment criteria a minimal period to update a minimal period to update Each of the sunset period was set up 2~5 year Each of the sunset period was set up 2~5 year through gathering the opinions of the experts in The assessment criteria development committee through gathering the opinions of the experts in The assessment criteria development committee suns et perio d (year s) levels total Craftsm an Industria l engineer Engineer Master craftsma n total Set up the sunset period

Needs for Study The assessment criteria is played key role in NTQ Various efforts to updating the assessment criteria It has been five years since the sunset period system was introduced It has been five years since the sunset period system was introduced the development of the NCS and its employment the development of the NCS and its employment Technology has been changed Technology has been changed circumstantial changes about NTQ Reviewing the status of using the assessment criteria/ Developing new update scheme for Assessment criteria 4 I. Introduction The assessment criteria indicate the range of subject assessment The assessment criteria indicate the range of subject assessment regulation to develop assessment criteria for the enactment regulation to develop assessment criteria for the enactment revision of the each qualification in accordance with the National Technical Qualifications Law revision of the each qualification in accordance with the National Technical Qualifications Law set up the sunset period in each assessment criteria to improve field suitability of the criteria set up the sunset period in each assessment criteria to improve field suitability of the criteria the job analysis is carried out by field specialists in developing the assessment criteria, and since 2005 the employment of the NCS was expanded. the job analysis is carried out by field specialists in developing the assessment criteria, and since 2005 the employment of the NCS was expanded.

Methods II. Methods 5 Analysis literature review literature review - precedent studies on the assessment criteria, policy documents and statistical resources - precedent studies on the assessment criteria, policy documents and statistical resources interview interview - for figure out the actual condition - for figure out the actual condition - six staffs in HRD Korea(which was in charge of assessment), two specialists for developing the assessment criteria - six staffs in HRD Korea(which was in charge of assessment), two specialists for developing the assessment criteria and two exam writers. and two exam writers. survey survey - for find out the suitability of assessment criteria sunset period by types - for find out the suitability of assessment criteria sunset period by types - complete enumeration(The assessment criteria development committee member) - complete enumeration(The assessment criteria development committee member) comprised of 52 groups in total with 10 members in each area Development developing the draft developing the draft - prepared through the examinations of precedent studies and related law and through the result of current status analysis and investigation research - prepared through the examinations of precedent studies and related law and through the result of current status analysis and investigation research examine the field suitability / applicability examine the field suitability / applicability - three staffs in HRD Korea, two specialists for developing the assessment criteria and two exam writers. - three staffs in HRD Korea, two specialists for developing the assessment criteria and two exam writers.

Usage status of the Assessment criteria III. Results 6 Using the job analysis, resources from the NCS But, confusion of terms as the forms and names of item were different ex) C.A use the terms likes key item, sub item and detailed sub item J.A, NCS use the terms likes competency unit, competency unit element and key item respectively Development of Assesment Criteria four or five times questions are made to be stocked in the item pool the questions are selected and verified from the item pool to perform an examination Lack of the sufficient information about the level of difficult and field suitability for exam writer 73.7% of the exam writer is academic expert Development of the exam questions

The evidence for selecting the sunset period is not enough suitability of sunset period : too long(25.7%, especially, IT and materials areas), too short(7.5%) requirement to reset the sunset period reflecting the speed of technical change Updated status of the Assessment criteria (1) III. Results 7 Suitability of sunset period Same sub job areas: use the same SME pool for updating job analysis and assessment criteria Updating at the same time, same areas: to prevent the duplication of the A.C to achieve the standardization of the terminology But, 15 areas (13.2%) out of 114 areas had a different sunset period between the areas The adjustment of the sunset period between A.C in the same sub job areas was required Different sunset period between the sub job areas

Revision the A.C in 2008~2010: 195types Due to the expiry of the sunset period: 79.0% A frequent revision: 21.0% Requirement to frequent revisions the sunset period is a minimal period to update Updated status of the Assessment criteria (2) III. Results 8 Updating the A.C great deviation about the A.C revision each years 11, 15 year: 154 types, 13 year: 20 types securing annual budget and splitting up the work are difficult special person in charge is overwork in special year the lack of appropriateness about securing annual budget for revising the A.C deviation about the A.C revision 79.0% 21.0% Due to the expiry of the sunset period A frequent revision

Direction of improvement and new update scheme for Assessment criteria(1) III. Results 9 reorganization of qualification types for using the NCS Revision the A.C using the assemble the NCS Every field has its own standard in the future A scheme to apply the NCS(In updating the A.C ) reset to reflect the speed of technical change, and the sunset period of the same type of sub job areas making revision plan (for revising Every year the same number (85~95 types) of the A.C) Reset the sunset period the rename of the name of items for use the NCS ex) key item competency unit Providing more information(about detailed sub items) to exam writers the level of difficulty, the level of importance and the level of frequency Revision of the current A.C forms & name of items

III. Results 10 A frequent monitoring system to review the field applicability Revision the A.C Requiring change More than 10% Sunset period Restart The sunset period Requiring change less than 10% DB Assessment Criteria A frequent monitoring (when setting exam questions) Direction of improvement and new update scheme for Assessment criteria(2) A frequent monitoring system to review the field applicability might be introduced

Conclusions Conclusions IV. Conclusions & Implications 11 The A.C provide accurate information to users, and contain competency to be applicable to the field the A.C must be reviewed frequently and complemented reflecting newly developed technology But, less frequent revisions, updates were made obligatory after the expiry of the sunset period. Necessary to revise the form and items of A.C, reset the sunset period, adopt the frequent update system Implications Implications to install a frequent monitoring system working together with the sunset period the NCS resources might be employed positively in the update