1. DI Score Room Appraiser Training 2015 Your Name Here

2. Score Room Masters Useful email addresses Your Email Here Cell Phone Numbers Your Cell Phones Here

3. Important Websites  Destination Imagination http://www.destinationimagination.org/http://www.destinationimagination.org/  Your Region Destination Imagination http://your.region.orghttp://your.region.org  Score Site http://discoring.texasdi.org http://discoring.texasdi.org  DI Appraiser Basics http://www.diuniversity.org

4. Overview of the Training  2015 Challenges  Score Room Mission  Paperwork Flow  Scoring Considerations  Individual Jobs for Score Room  Handling Problems  Final Thoughts

5. 2015 Challenges Technical Challenge: Creature Feature Scientific Challenge: Making Waves Fine Arts Challenge: Feary Tales Improvisational Challenge: The Improv Games Structural Challenge: Lose to Win Early Learning Challenge: Animal Mish Mash Service Learning Challenge: Brandaid

6. Example Challenges & Colors A: Creature Feature (Creature) Orange/Salmon Yellow B: Making Waves (Waves) Yellow C: Feary Tales (Feary) Blue D: The Improve Games (Improv)Pink/Red E: Lose to Win (L2Win)Green Grey PO: BrandAid (Brand)Grey IC Purple Score room Black White Animal Mish Mash (Animal) White We like to color code everything for easy sorting. Consult your RD/AD for their choice of colors!

7. General Procedures  When? Report to Score Room by 9:00  Leave time for Breakfast and Sign in before this  We’ll be working until about 5:30 (we hope!)  Access to the room is limited  Not a place for visiting or hanging out  All paperwork is logged in and out of the room  Refer anything unusual to the room leaders  This allows everyone else to continue processing the “normal” scores, keeping the flow going  Add to the bottom, take from the top  This keeps paperwork flowing in time order

8. Primary Mission  The primary Mission of a DI Score Room is to provide the announcer at the conclusion of a tournament with an accurate list of place finishes for the teams that competed at that tournament.  Help keep the tournament running smoothly  Get everyone home at a reasonable hour  Goal: All scores Complete 1 hr before the award ceremony  Accuracy  Efficiency  Timeliness

9. Score Room Mission  Accuracy is foremost.  Procedures result in all scoring operations being done twice by independent people.  These two people must agree on the resulting computation.  If in doubt ask your CM or send back to appraiser to correct  Never erase a score  Initial ALL changes

10. Score Room Mission  Efficiency is defined as computing the final scores by the time that the Tournament Director expects them to be done.  Typically final scores are available about an hour or less after the last team performance. Efficiency is secondary to Accuracy.

11. Score Room Mission Timeliness  Process paperwork ASAP  Don’t Hold on to Packets!  Process Packets in order (first in first out)  Process and move on to the next step, then file!  Have everything completed well before the scheduled awards ceremony

12. Individual Responsibilities  Appraiser – Site, not score room personnel  Appraisal Team Organizer- Site  Score checkers  Computer operators  Score runner  Gate keeper  Paperwork Manager  Score Room Challenge Masters

13. Paperwork Flow - Central Appraisers Appraisal Team Organizer Gate Keeper Head Appraiser Team Manager Checker (optional) Paper Work ManagerFile Manager Challenge Sites Score Room Data Entry 1 Data Entry 2 Results TM, HA Logs all Time(s) In Time(s) Out Final Score storage area Runner

14. Paperwork Flow - Hybrid Appraisers Appraisal Team Organizer Checker (optional) Gate Keeper Head Appraiser Team Manager Checker (optional) Paper Work Manager File Manager Challenge Sites Score Room Data Entry 1Data Entry 2 Runner HA & TM Copy Logs all Time(s) In Time(s) Out Final Score storage area Network or USB Flash Drive electronic check

15. Central Score Room Sample Layout Gate Keeper Score Room Data Entry 1 Data Entry 2 Final Score storage area Check In Checker (optional) Data Entry 1 Data Entry 2 Data Entry 1 Data Entry 2 Tournament Master Printer / Copier Paper Flow Check and Backup Backup

16. Scoring Guidelines  Objective - Non-averaged scores  0, 5, 10, 15  all appraisers agree  Subjective - Averaged scores  USS Appraiser ranges 1-30  will vary between appraisers  Rounding – Score program does this for us  2 digits to right of decimal.666 >.67 and.333 >.33  Zero Score  if element is not present  all appraisers scoring that element must agree it was not there  Deductions  all appraisers must agree  % of the points earned  reason(s) must be noted highlighted entry  Deduction Worksheet with highlighted entry

17. Appraiser  Complete the Appraiser Score Sheet  Must complete all assigned items and no more!  Must be legible  Must agree on all deductions, zero scores or non averaged scores (0, 5, 10, 15)

18. Appraisal Team Organizer  Collect Appraiser forms, envelope and all paperwork from the team.  Check for legibility and any missing items  Place all paperwork in envelope, give to runner to deliver to checker & Computer Operator  Receive Head Appraiser and Team copies from computer operator - log times in for Head Appraiser.  Log times when team has received their copy

19. Making up the Score Packet  Team label on the upper left corner of envelope  Please put the papers in this order  Deductions worksheet if there is a Deduction  Weigh-in (Check In) sheet (Challenge E Only)  Appraisers sheets  In Order (Alpha or Numeric)  Prep area sheet  Everything else last  Small Envelope with Award Certificates  Team manager Copy of scores also goes in when complete  Stickies on the special stickies sheet stay at the appraisal site to give back to Team manager with team scores  ONLY positive comments! Trash inappropriate ones… Label Status Dots

20. Score Checkers  Check incoming score sheets for completeness & legibility  Check Weight held calculation (Challenge E)  Not needed for 2015!  Write initials next to calculation  Check order of paperwork  Deduction Work sheet  Weigh-in Sheet (Challenge E)  Appraiser sheets (in order)  Prep Area sheet  extra material last  Pass to Computer Operators.

21. Score Checker  Ensure Legibility  Common Errors  Subjective vs Objective  Objective all must agree  Range  Deductions

22. Checking Scores  Never have two team’s paperwork out in your work area at once!  If your Head Appraiser needs you to look at something, put the current team’s paper away!  After checking, please put the score sheets in the order that they appear on the printed Appraiser Assignment sheet form before sending to score room.

23. Score Runners  Very Important Job!  Introduce yourself to Head Appraiser, Appraisal Team Organizer and Gate Keeper  Pick up completed score packets from competition sites  Team challenges  Instant challenges  Deliver score packets to score room check-in  Make scheduled runs

24. Computer Operators - Central  Will use provided Computers & Printers  Computer Proficiency very helpful!  Importance of accuracy in typing numbers  1 st Entry Operators  Enter scores from appraiser sheets  Place all remaining paperwork in team envelope and pass to 2 nd entry computer operator  2 nd Entry Operators  Re-enter scores from appraiser sheets  Check is automatically done when saved  Occasionally enter bad data to verify check  Print 1 Team, 1 Head Appraiser and 1 Score Room Copy  Score Room Copy into envelope  Team and HA copies get returned to site in folder  Can download program and be familiar with it http://discoring.texasdi.org/ http://discoring.texasdi.org/

25. Computer Operators - Site  Will use provided Computers & Printers  Computer Proficiency very helpful!  Importance of accuracy in typing numbers  1 st Entry Operators  Enter scores from appraiser sheets  Place all remaining paperwork in Large envelope  Print 1 Team, 1 Head Appraiser and 1 Score Room Copy  Score Room Copy into Large envelope  Team and HA copies go in small envelope for HA  Send Large Envelope to Score room for 2 nd entry computer operator  2 nd Entry Operators  Re-enter scores from appraiser sheets  Check is automatically done when saved  Occasionally enter bad data to verify check  Print Score Room Copy – Put in Envelope  Can download program and be familiar with it http://discoring.texasdi.org/ http://discoring.texasdi.org/

26. Gate Keeper / Check In  Accept all incoming packets  Using Check In Computers and Program  Log in and out times on IC/TC  Log out paperwork leaving score room for questions  Do not let unauthorized individuals in score room

27. Paperwork Manager  Pick up incoming folders from gatekeeper and transfer to the correct computer operator  Pick up completed folders from Computer Operators  Deliver HA and Team score printouts to return folder  File folders in appropriate boxes by challenge and update checklist  If scores are pulled after filing, hand walk the returned envelope to computer operators and identify actions needed

28. Score Room Challenge Master  Knowledge of  the challenges  scoring program  how calculations are done  all score room jobs  Recruit and train  appraisal team organizers  score room personnel There to help with any questions or issues

29. How to Handle Issues  Talk with your score room leader  Mark team with an Issue in the program  Enter explanation in Modify Team dialog box  Print Appraiser Feedback form or use “yellow sticky” to describe issue  Put all paperwork in the package  Put on a red sticker  Log team red in the Check-In program  Return to team challenge room for correction

30. Processing Issues (cont.) When a red sticker packet comes back in  Log it in  Goes to head of the queue for the first computer  It is an older packet than those we’re processing  Could be from  A change we requested  A change the Head Appraiser is requesting  Partially cover green sticker with red

31. Sticker Management Good packet after 1 st entry – put a green sticker on packet MJA Good packet after 2nd entry and check – initial green sticker – Send to File Bad packet during 2nd entry – add red sticker – return for problem resolution Problem resolved and re-run through 1st entry – add a green sticker Good packet after 2nd entry and check – initial green sticker – Send to file MJA Bad packet during 1st entry – put a red sticker on packet – return for problem resolution

32. Practice  Some people will not be doing data entry  Everyone should be familiar with the scoring program  In case of illness, etc.  If you haven’t used it before, please download it and practice http://discoring.texasdi.org

33. Scoring Goals  Ensure that every team gets the full credit they deserve for their challenge solution  And only the credit they deserve  Turn scores around promptly  Allows team managers to review them  Maintain the confidentiality of the scores  Never leave your paperwork unattended  Let everyone get home at a reasonable hour  Have fun in the process

34. QUESTIONS!  Ask and we’ll see if we can answer.

35. Computer Entry Demo

36. Tournament Summary Window  Scoreboard for the tournament  number of teams  number whose scores are incomplete  when they should finish  when the scores were printed  Drill down to a challenge level

37. Drilling Down to Enter Scores  List of teams in a challenge level  performance time  status  being scored?  TC done?  IC Done?

38. Entering Scores  Data entry of all appraisers’ scores  Computer verifies ranges  Verifies appraiser agreement for objective scores  Computer calculates it all  Computer scales the final results and prints them

39. Error Checking

40. Entering Item-Specific Deductions Click on “OK” to close the deduction dialog box Click on the square checkbox to the left of the item’s title Fill in the deduction value and the reason Note that deductions can be a percent of the awarded score (not the max score!)

41. Entering “Other” Deductions  Deductions are not normally editable as a safety measure.  To enable:  Right click in the score area  Select “Modify Deductions”  Or, “Alt-D” for you keyboard types  All deductions MUST have a reason  Entered in the second computer

42. All Challenge Level Window a VERY useful tool! Use with Quick Search!

43. Issues Form (Modify Team dialog)

44. … for your time. … for your service. … for your generosity. … for all you do.