Presentation is loading. Please wait.

Presentation is loading. Please wait.

IAEA International Atomic Energy Agency Sharing Best Practices for the Design and Management of TC Projects INT/0/085 3-5 September 2012.

Similar presentations


Presentation on theme: "IAEA International Atomic Energy Agency Sharing Best Practices for the Design and Management of TC Projects INT/0/085 3-5 September 2012."— Presentation transcript:

1 IAEA International Atomic Energy Agency Sharing Best Practices for the Design and Management of TC Projects INT/0/ September 2012

2 IAEA Contents Part I:Overview Presentation 1 Part II:Survey Results Part III:Selection and Validation Process Presentation 2 Part IV:Selection and Validation Results Part V:Next Steps 2

3 IAEA International Atomic Energy Agency Sharing Best Practices for the Design and Management of TC Projects Presentation 2 of 2 INT/0/ September 2012

4 IAEA Sharing Best Practices for the Design and Management of TC Projects 4 Part III:Selection and Validation Process Presentation 2 Part IV:Selection and Validation Results Part V:Next Steps

5 IAEA Sharing Best Practices for the Design and Management of TC Projects Part III: Selection and Validation Process 5

6 IAEA Where Are We? The BP initiative has 13 Major Milestones! 0.Consultative Process 1.Collection 2.Selection 3.Dissemination 4.Documentation 5.Main Streaming TCQAS PCMF/ In-Touch/External Web TCDIR-TC-RDIR / RCA 4-TC Regions Selection Dissemination Documentation Start 2011/2012 TC Departments/ Stakeholders Collection 6

7 IAEA III. Selection and Validation Process A. Key Principles B. BPs Selection Process 1. Composition of the BP Selection Committee (BPSC) 2. Consolidated Document on Proposed BPs delivered to BPSC 3. Individual Assessment of Proposed BPs 4. Consolidation of Assessment Results 5. Joint Validation of the Results of Individual Assessment by BPSC C. BPs Selection Process Timetable 7

8 IAEA A. Key Principles Transparency in the Selection Process Ensure a neutral and independent Selection Process Common Understanding on the Principles on how the Selection Process will be taking place Agreed upon in stakeholders consultation workshop on the 16 th & 17 th January

9 IAEA B. BPs Selection Process 9 1.Composition of the BP Selection Committee (BPSC) 2.Consolidated Document on Proposed BPs delivered to BPSC 3.Individual Assessment of Proposed BPs 4.Consolidation of Assessment Results 5.Joint Validation of the Results of Individual Assessment by BPSC

10 IAEA B. BPs Selection Process 1. Composition of the BP Selection Committee (BPSC) The BPSC will be formed by: Regional Division Director TCPC Director TD Division Directors Director MTPS The number of BPSC Members will vary according to actual nominations received as follows : The Chair for BPSC will be nominated by DIR TCPC. Members will choose the alternate Chair if required to act in the absence of the Chair. TC RDs (8+)TDs (4)TCPC (3) 1 or 2 Representatives from the MSs (CP/NLO/Regional Chair or Coordinators) in each region = 4+ 1 PMO/SH from each Regional Division = 4 1 TCLOS/TOs each from NA, NE, NS and MTPS (procurement) = 4 3 TCQAS SH, QMS and Monitoring Officer (BP Consultant as an external observer) 10

11 IAEA 2. Consolidated document on Proposed BPs delivered to BPSC The TCQAS focal point(s): Reviews the Proposed Best Practices for completeness of information Hides any identifying feature that may compromise the neutrality of selection and scoring Prepares a consolidated document. TCPC/TCQAS: Furnishes the consolidated document based on questionnaire, guidelines for selection process and other relevant documents, electronically, to the BPSC members at the set dates for individual assessment and rating according to the quality criteria. B. BPs Selection Process 11

12 IAEA 3. Individual Assessment of Proposed BPs Each BPSC Member receives a BPs Assessment Package electronically of via external website link from TCQAS-BPs Facilitator/Administrator containing the following: Consolidated document of coded, unidentifiable Proposed BPs Best Practices Selection Guidelines with: Annex 1 Individual Assessment Form Annex 2 Joint Assessment form Annex 3 FAQs on Selection Process Annex 4 List of BPSC members Other supporting documents/items for further reference include: Project Document of INT/0/085 Core BPs for the Design and Management of TC Projects Best Practices Surevy Guidelines Best Practices Survey Questionnaire Presentation on Best Practices Survey Results (Pilot) Presentation on Best Practices Selection Process (Pilot) 2 videos of the above presentations (Pilot) The BPSC Member is requested to: Read each BP submission thoroughly Fill an Individual Assessment Report for each BP submission, to the best of his/her skills. B. BPs Selection Process 12

13 IAEA 3. Individual Assessment of Proposed BPs The BPSC members: Reviews and assesses each Proposed Best Practice based only on the criteria indicated by the respondent on the submission. Verifies the same through a list of guiding statements. The BPSC Member/Assessor makes a tick mark under the relevant columns 3 and 4 as shown below to affirm the indicated criteria and to verify the same through the reading of the BP description II. BPs Selection Process 13

14 IAEA II. BPs Selection Process 3. Individual Assessment of Proposed BPs At the end, the BPSC Member/Assessor gives a rating on a scale from 1-5. For example if all indicated criteria is met, then the score is 5; if any of the indicated criteria does not seem to be fully reflected in the BP description, then the rating will proportionately be down scaled. The BPSC Member/Assessor sends all his/her independently assessed reports in one-shot to the TCQAS-BPs focal point(s) by the set date (Pilot: 15 August 2012) 14

15 IAEA 4. Consolidation of Assessment Results TCQAS, BP focal point(s) consolidates assessment results into one document. For consolidation, individual scores given to each Proposed BP are summed up and divided by the number of assessments to get an average score for the total independent assessments (for example 15 BPSC Members X 40 BPs = 600). Accordingly, a consolidated ranking report arranged in descending order for all 40 submissions will be prepared in anticipation of the face-to-face BPSC meeting. III. BPs Selection Process 15

16 IAEA 5. Joint Validation of the Results of Individual Assessment by BPSC On receiving the consolidated assessment results matrix of Proposed Best Practices in this workshop, the BPSC members jointly review the results and, if required, do a random check of any number of submissions to revalidate the assessment. For this purpose, the Chair of the BPSC calls a meeting on a mutually agreable date within the set timeframe (upon mainstreaming). The Chair facilitates random check of scoring and deliberations on the top 10 ranking Proposed Best Practices leading to a final selection of a number of top ranking Best Practices with consensus. The BPSC will make an announcement of the results. Efforts of all participants will be acknowledged and a number of high rated Proposed Best Practices will be publicised for broader sharing. III. BPs Selection Process 16

17 IAEA 5. Joint Validation of the Results of Individual Assessment by BPSC The BPSC Chair shares with the Members a report containing the top ranking BPs, with names of submitters, regional & country affiliations, BPs title, category (all relevant information that had been hidden during the selection process) etc. III. BPs Selection Process 17

18 IAEA BPs Selection and Validation Process (Pilot Phase) 18 Selection ProcessDate 1Composition of BP Selection Committee (BPSC) May/June Consolidated document on Proposed BPs delivered to BPSC July Individual Assessment of Proposed BPs July/August Consolidation of Assessment ResultsAugust Joint Validation of the Results of Individual Assessment by BPSC in a Workshop/Meeting at IAEA, Vienna Agreement on dissemination methodology September 2012 C. BPs Selection Process Timetable

19 IAEA Sharing Best Practices for the Design and Management of TC Projects Part IV: Selection and Validation Results 19

20 IAEA I. BPSC, Chair & Observers RegionNr.PositionNameRole Participation in Workshop Submission BP Assessment TCAF 1 NLO AFRA NC Mr Messaoud Baaliouamer (ALGERIA)BPSC MemberConfirmedYes 2NLAMr Fidelis Iheanyi Obioha (NIGERIA)BPSC MemberConfirmedYes 3PMO Mr Michel Kiza (substitute for Mr Amha) --HQ BPSC MemberConfirmedNo 4NLO Ms Jane Mubanga Mwamba Chinkusu (ZAMBIA) BPSC MemberConfirmedYes TCAP 5NLOMr Raja Jamal (MALAYSIA)BPSC Member Not participating No 6TOMr Long Nguyen--HQBPSC MemberConfirmedNo 7PMOMr Sinh Hoang--HQBPSC MemberConfirmedNo 8NLOMr Syahril Syahril (INDONESIA)BPSC MemberConfirmedNo TCEU 9PMOMr Andrei Chupov --HQBPSC MemberConfirmedNo 10NLO Mr Andras Molnar (HUNGARY) (Representative) BPSC Member Not participating No TCLA 11PMOMr Raul Ramirez--HQBPSC MemberConfirmedYes 12NLAMr Eduardo Cortes (CHILE)BPSC Member Not participating No 13TOMr Alejandro Nader--HQBPSC MemberConfirmedYes 14CPMs Elvira Gaytán Gallardo (MEXICO)BPSC MemberConfirmedYes 20

21 IAEA I. BPSC, Chair & Observers RegionNr.PositionNameRole Participation in Workshop Submission BP Assessment TCAF 1 Ms Amira Bazouzi (ALGERIA)ObserverConfirmedNo 2SHMr Mulugeta Amha –HQObserver Not participating No TCPCNr.Position Name Role TCQAS1Independent ExpertMs Doha AbdelhamidFacilitator TCPCNr.PositionNameRole Participation in Workshop Submission BP Assessment 1DIRMr J.A. Casas ZamoraLeader BP InitiativeConfirmed TCQAS 2SHMr Javier GuarnizoSection HeadConfirmed 3QMSMs Khadija Khan Focal Point/BPSC chair Confirmed 4MOMr Max KodjoBPSC MemberConfirmedYes 5TAMs Brigitte LiepoldFocal PointConfirmed 6InternMs Carolina RodriguezFocal PointConfirmed 21

22 IAEA II. Overall Individual Assessment Results 22 A. Criteria 24

23 IAEA II. Overall Individual Assessment Results 23 A. Criteria

24 IAEA II. Overall Individual Assessment Results B. General: 24

25 IAEA II. Overall Individual Assessment Results C. Few observations: Similarity in BP QC selection Some Assessors relied on final assessment Respondents vs. Assessors conflict of interest Regionality of BPs submissions and assessments Inaccuracies in understanding of some BPs features on side of respondents noted (e.g. policy coherence; causal relationships; BPs titles, template, definition & QC, etc.) Dual Scoring 25

26 IAEA Sharing Best Practices for the Design and Management of TC Projects Part V: Next Steps 26

27 IAEA I. Immediate Step: Validation of Consolidated Assessment 27 Average score is the total score gained/number of assessments. Scores are out of 5.

28 IAEA II. Near Term Steps A. Dissemination by BPSC √ B. Awards 1.Invitation 2.Presentation 3.Certification C. Publication D. Launch of BPs Community of Practice E. Incentives √ } (Capacity Building, Expert Missions, Trophies, Medallions, Academic studies etc.) F. Sustenance/Mainstreaming 28

29 IAEA Sharing Best Practices for the Design and Management of TC Projects (Part 2 of 2) Thank you! 29


Download ppt "IAEA International Atomic Energy Agency Sharing Best Practices for the Design and Management of TC Projects INT/0/085 3-5 September 2012."

Similar presentations


Ads by Google