1. Baldrige Performance Excellence Program | www.nist.gov/baldrige Baldrige Examiner Preparation 2016 1

2. Baldrige Performance Excellence Program | www.nist.gov/baldrige Learning Objectives… “Brilliant at the basics” Enhance your ability to:  evaluate an award application by: - increasing skill in applying the six-step evaluation process - increasing knowledge of the Baldrige Framework  write feedback comments that result in an accurate, value-added, actionable feedback report. 2

3. Baldrige Performance Excellence Program | www.nist.gov/baldrige Course Overview  Wednesday – Prework Review Item 4.1, Criteria Discussion Item 4.2  Thursday – Six-Step IR Process Practice on Non-Prework Items 1.1, 3.1, 5.1, 6.1, 6.2 - Consensus Review - Key Themes - Judges Expectations (time permitting  Friday – Prework Review Item 7.2 3

4. Baldrige Performance Excellence Program | www.nist.gov/baldrige Today’s Agenda…  Getting Ready To Learn  Begin with the End in Mind  Segment 1: Prework Item 4.1  Item 4.2 Criteria Discussion  Wrap Up 5:00 pm.  Reception 4

5. Baldrige Performance Excellence Program | www.nist.gov/baldrige 5

6. 6

7. Step 1: Read the Criteria. 7

8. Baldrige Performance Excellence Program | www.nist.gov/baldrige Step 2: Determine Most Relevant Key Factors. 8

9. Baldrige Performance Excellence Program | www.nist.gov/baldrige Key Factors Table Activity Using round robin, each person gives a key factor from prework for 4.1 and rationale. Write on flipchart. Table discusses to clarify / understand the rationale. Indicate on flipchart how many in the table group chose that KF. Also indicate if, after the discussion, anyone would have removed their KF. (cross these off the list). Prepare to report out the discussion around each KF

10. Baldrige Performance Excellence Program | www.nist.gov/baldrige Step 3: Read & Analyze the Application. 9

11. Baldrige Performance Excellence Program | www.nist.gov/baldrige Step 4: Identify Strengths / OFIs. 10

12. Baldrige Performance Excellence Program | www.nist.gov/baldrige 12 Strengths/OFIs Table Activity Using round robin, each person gives a strength from prework for 4.1 and rationale. Write on flipchart. Table discusses to clarify / understand the rationale. Do another round for OFIs. Indicate on flipchart how many in the table group chose the same strength / OFI. Also indicate if, after the discussion, anyone would have removed their strength / OFI. (cross these off the list). Prepare to report out the discussion around each strength / OFI.

13. Baldrige Performance Excellence Program | www.nist.gov/baldrige Step 5: Write Feedback Ready Comments 11

14. Baldrige Performance Excellence Program | www.nist.gov/baldrige Step 6: Determine the Scoring Range and Score 12

15. Baldrige Performance Excellence Program | www.nist.gov/baldrige Scoring Table Activity Using round robin, each person gives the scoring range from prework for 4.1 and rationale. Write on flipchart. Table discusses to clarify / understand the rationale. Indicate on flipchart how many in the table group chose the same range. Also indicate if, after the discussion, anyone would have changed their range. (indicate the change on the flipchart). Prepare to report out the discussion around scoring ranges chosen.

16. Baldrige Performance Excellence Program | www.nist.gov/baldrige Agenda for Thursday  Segment 2 — IR Practice NON - Prework Items 1.1, 3.1, 5.1, 6.1, 6.2 (3.2 if 6 tables)  Consensus Review  Key Themes  Judges Expectations (time permitting) 13

17. Baldrige Performance Excellence Program | www.nist.gov/baldrige Table 1 – Item 1.1 Table 2 Item 3.1 Table 3 – Item 5.1 Table 4 Item 6.1 Table 5 – Item 6.2 Table 6 Item 3.2 (if needed) Today’s Table Assignments 14

18. Baldrige Performance Excellence Program | www.nist.gov/baldrige 1.Using a round-robin approach, participants in turn share a strength and the rationale for the strength, then list the strength on your flip chart. 2.Do another round for the OFIs. Decide and indicate on the flipchart the most important key strengths/OFIs (around six). Be prepared to discuss your table’s strengths and OFIs. Step 4 Exercise: 15

19. Baldrige Performance Excellence Program | www.nist.gov/baldrige  Planning Call 1 (happens during IR)  Planning Call 2  Item Leads Work their Assigned Items (KFs, strengths/OFIs, feedback ready comments, scoring)  Team members provide feedback  Planning Call 3  Consensus Call Consensus Review Process: Highlights 16

20. Baldrige Performance Excellence Program | www.nist.gov/baldrige Consensus Review Synthesis Of Item 6.1 + Six step approach is systematic and enhances core competencies (Fig. 6.1-2) (RH) + Process improvement approach was improved two years ago to include best practice search (Fig.6.1-2) (DE) + Processes are improved every three years on a scheduled cycle (BK) + Approach applies to all business processes rated A or B or higher (HS) -- The approach does not appear to require flowcharting so it’s not clear how current state is identified (CH) -- C rated processes are improved using a more casual PDCA approach (FT) 17

21. Baldrige Performance Excellence Program | www.nist.gov/baldrige Consensus Review Synthesis “The six step approach to process improvement (Figure 6.1-2) addresses core competencies and is evaluated and improved on a three year cycle. The most recent enhancement added a step to include a best practice search. This approach is systematically deployed to processes rated A or B, with processes rated C or below are improved using the PDCA approach. This systematic approach to process improvement reinforces the value of “Always Improving”. ADLI (RH, DE, BK, HS)” 18

22. Baldrige Performance Excellence Program | www.nist.gov/baldrige Consensus Review Synthesis Rationale: EE’s observation on lack of flowcharting was not used as it’s prescriptive and flowcharting is not required. FF’s observation on C processes being improving using a PDCA approach was not used as it is not required that only one approach be used for all processes. Since A and B processes are the applicant’s most important and these are improved using the six step approach, using PDCA on less important ones is not an OFI in my opinion. 19

23. Baldrige Performance Excellence Program | www.nist.gov/baldrige The Consensus Call Agenda 1. Review agenda and rules 2. Review draft key factors 3. Review draft key themes 4. Discuss / Consense on Items 5. Confirm scores 6. Finalize key factors and key themes 7. Discuss / confirm scoring bands 8. Next Steps 20

24. Baldrige Performance Excellence Program | www.nist.gov/baldrige The Judging Process Early June Meeting  Planning  Introduction of New Members Late August Meeting  Selection of Applicants for Site Visits September - SV Applicant Review November –  Recommendations for Award  Recommendations for Category Recognition 21

25. Baldrige Performance Excellence Program | www.nist.gov/baldrige Agenda for Friday  Closing Plenary 12:15 – 1:00 pm  Segment 3 - Prework Review Item 7.2 22

26. Baldrige Performance Excellence Program | www.nist.gov/baldrige 26 Key Factors Table Activity Using round robin, each person gives a key factor from prework for 7.2 and rationale. Write on flipchart. Table discusses to clarify / understand the rationale. Indicate on flipchart how many in the table group chose that KF. Also indicate if, after the discussion, anyone would have removed their KF. (cross these off the list). Prepare to report out the discussion around each KF

27. Baldrige Performance Excellence Program | www.nist.gov/baldrige 27 Strengths/OFIs Table Activity Using round robin, each person gives a strength from prework for 7.2 and rationale. Write on flipchart. Table discusses to clarify / understand the rationale. Do another round for OFIs. Indicate on flipchart how many in the table group chose the same strength / OFI. Also indicate if, after the discussion, anyone would have removed their strength / OFI. (cross these off the list). Prepare to report out the discussion around each strength / OFI.

28. Baldrige Performance Excellence Program | www.nist.gov/baldrige 28 Scoring Table Activity Using round robin, each person gives the scoring range from prework for 7.2 and rationale. Write on flipchart. Table discusses to clarify / understand the rationale. Indicate on flipchart how many in the table group chose the same range. Also indicate if, after the discussion, anyone would have changed their range. (indicate the change on the flipchart). Prepare to report out the discussion around scoring ranges chosen.

29. Baldrige Performance Excellence Program | www.nist.gov/baldrige Optional Slides Follow

30. Baldrige Performance Excellence Program | www.nist.gov/baldrige Sample Process Strength 2.2a(4) To mitigate the strategic challenge of competitors wishing to hire its engaged workforce, the applicant ensures that workforce plans support any needed changes. For example, through data and budget analysis and surveys, the applicant takes a proactive approach to workforce capacity and allocates instructional staff to areas of greatest need through “vertical teamwork.” RelevanceNugget Examples 53 words, 372 characters/spaces

31. Baldrige Performance Excellence Program | www.nist.gov/baldrige Sample Process OFI 4.2a(1) It is not clear how the applicant systematically transfers knowledge specific to the needs of parents and volunteers in support of the PhilP that all are accountable for student performance. For example, parents and volunteers do not appear to be included in teachers’ grade-level discussions, and parents do not appear to have access to teachers’ online forums, blogs, and classroom support server (Figure 4.2-1). RelevanceNugget Examples 64 words, 415 characters/spaces

32. Baldrige Performance Excellence Program | www.nist.gov/baldrige Sample Results Strength 7.3a(1) Strong results for key measures of workforce capability and capacity may help strengthen the engagement factor of having sufficient resources to get the job done. Rates of certification (Figure 7.3-1) and student-teacher ratio (Figure 7.3-2) have improved over the periods shown, reaching 100% or close to 100% for all segments, and the student-teacher ratio in elementary and middle schools compares favorably to that of a Baldrige Award winner. Relevance Nugget Examples

33. Baldrige Performance Excellence Program | www.nist.gov/baldrige Sample Results OFI 7.2a Results related to key student requirements, such as stimulating creative thought, treating students fairly, and maintaining a safe school, are missing. Tracking such results may give the applicant insights into how to retain families and how to attract families to the district. Relevance Nugget Examples

34. Baldrige Performance Excellence Program | www.nist.gov/baldrige UNDERSTANDING SYSTEMATIC APPROACH 34

35. Baldrige Performance Excellence Program | www.nist.gov/baldrige UNDERSTANDING DEPLOYMENT 35

36. Baldrige Performance Excellence Program | www.nist.gov/baldrige UNDERSTANDING IMPROVEMENT/LEARNING/INNOVATION 36

37. Baldrige Performance Excellence Program | www.nist.gov/baldrige UNDERSTANDING INTEGRATION 37

38. Baldrige Performance Excellence Program | www.nist.gov/baldrige Key Themes l Key themes are addressed to the applicant’s senior leaders and serve as an executive summary. l Key themes summarize the most vital issues for the organization as a whole, including what the organization must do to remain or become competitive and to ensure long-term sustainability. l Key themes are strategic in nature and may address how well the organization is managing a major change or improvement; competitiveness or social issues; or significant customer, market, product, or technological opportunities and challenges. l The team leader or a designated team member uses the team’s Consensus Review Worksheets to develop an initial list of key theme ideas. l Key themes are organized into 4 groups: process strengths, process OFIs, results strengths, and results OFIs.

39. Baldrige Performance Excellence Program | www.nist.gov/baldrige 39

40. Baldrige Performance Excellence Program | www.nist.gov/baldrige 40

41. Baldrige Performance Excellence Program | www.nist.gov/baldrige Consensus Review l All members of the Board of Examiners are expected to participate in the Consensus Review as a condition of being appointed to the Board. l The individual examiners assigned to your Item will now come together to work as a team, generating a scorebook that builds on the individual work, while reflecting the wisdom of the group. l Consensus begins early in July and extends to mid August, depending on the Wave you selected.

42. Baldrige Performance Excellence Program | www.nist.gov/baldrige Consensus Review continued l Consensus Review includes individual work, online collaboration, and conference calls. l Each member of the team will serve as the lead for several items (usually three). l The objective of the assignment will be to produce item worksheets that incorporate the best thinking of each team member while forming a concise and coherent whole.

43. Baldrige Performance Excellence Program | www.nist.gov/baldrige Consensus Review continued l BOSS will aggregate your teammates’ Independent Review Worksheets for your lead items. l You will record your work for each item on a Consensus Review Worksheet within BOSS. l You will receive feedback from all of your team members on your Consensus Review Worksheets, and you will provide feedback to all of your team members on their Consensus Review Worksheets. l The Step-by-Step for Consensus Review will be available to guide you through the process.