1. Literacy/Numeracy Literacy/Numeracy Made Simple January 29 th, 2013 4:00 - 5:30 PM EST 4:00 - 5:30 PM EST

2. 2 Literacy/Numeracy Made Simple Literacy/Numeracy Made SimplePractice In the Chat Room, please type the name of your organization, your location, and how many people are attending with you today.

3. 3 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple How To Participate in a Poll Welcome to Workforce 3 One!

4. 4 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple Access to Webinar Resources WEBINAR RESOURCES: Recordings and transcripts are available within 2 business days after the event.

5. 5 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple Welcome  Region 1: Holly O'Brien, Regional Administrator  Region 2: Lenita-Jacobs Simmons, Regional Administrator  Region 3: Helen Parker, Regional Administrator  Region 4: Nick Lalpuis, Acting Regional Administrator  Region 5: Byron Zuidema, Regional Administrator  Region 6: Virginia Hamilton, Regional Administrator Literacy and Numeracy Gains

6. 6 Literacy/Numeracy Made Simple Literacy/Numeracy Made SimpleModerator Evan Rosenberg Division of Youth Services Employment and Training Administration

7. 7 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple Question 1 A.Expert B.Advanced C.Intermediate D.Novice E.None My level of understanding and knowledge of the Literacy/Numeracy Gains measure’s requirements and reporting is:

8. 8 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple Importance of Literacy/Numeracy Gains Measure  Based on PY 2011 WIASRD data, 61.4% of youth exiters were basic skills deficient and 46.3% were out of school. –Both of these numbers are all time highs for WIA Youth.  If youth do not possess basic literacy skills, they will not be successful in the labor market.  It is critical that WIA Youth programs help ensure these youth increase their basic literacy skills. Literacy and Numeracy Gains

9. 9 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple Partnering to Provide Basic Literacy Skills  Leverage Partnerships! –Workforce system does not need to go it alone in providing basic literacy skills training.  The Workforce System can partner with Adult Education System (WIA Title II) –Overlap in populations served –Title I and II are required to use the same assessments.  Potential Areas for partnership include: –Test Administration Training (Academic Assessment) –Service Delivery Partnership –Data Sharing Literacy and Numeracy Gains

10. 10 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple Literacy/Numeracy Gains National Performance PY 2008 – 2011 Performance has increased each year, but still room for improvement Literacy and Numeracy Gains

11. 11 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple Highlights of Literacy/Numeracy Gains  Only common measure that is not solely exit-based.  Excludes in-school youth and out-of-school youth who are not basic skills deficient.  Includes individuals with learning disabilities.  A positive outcome means the youth must advance one or more Adult Basic Education (ABE) or English as a Second Language (ESL) functioning levels.  Gains can occur in literacy or numeracy (programs can pre-test at different levels in each category).  Educational levels are consistent with Department of Education’s National Reporting System (NRS). Literacy and Numeracy Gains

12. 12 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple  All out-of-school youth must be assessed in basic reading/writing and math.  Pre-testing should occur within 60 days of the first youth program service; can use pre-test from up to six months prior to date of first youth service.  The same standardized assessment must be used for pre- and post- testing.  Youth should be post-tested by the end of one year of participation and compared to pre-test results obtained during initial assessment.  If a youth continues to be basic skills deficient after the first 12 months of participation, they should continue to receive training in literacy and/or numeracy skills.  Youth should be post-tested and included in the measure at the completion of the 2nd year only if they complete two full years in the program. Literacy and Numeracy Gains

13. 13 Literacy/Numeracy Made Simple Literacy/Numeracy Made SimplePresenter Dave McEachern Senior Statistician Command Decisions Systems and Solutions (CDS 2 ) CDS 2 provides consulting services to ETA for report validation and date element validation and the operation and maintenance of DRVS software

14. 14 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple Official Definition Of those out-of-school youth who are basic skills deficient: # of participants who increase one or more educational functioning levels -------------------divided by-------------------------- # of participants who have completed a year in the youth program (i.e., one year from the date of first youth program service) plus the # of participants who exit before completing a year in the youth program Literacy and Numeracy Gains

15. 15 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple  The definition looks simple but the reported outcomes depend on several factors.  The following slides will explain the factors that impact the literacy/numeracy outcome including the participants that make up the numerator and denominator and the constructed variables and WIASRD fields used in calculating the outcome. Literacy and Numeracy Gains

16. 16 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple Reference Documents  TEGL 17-05 –http://wdr.doleta.gov/directives/corr_doc.cfm?DOCN=2195http://wdr.doleta.gov/directives/corr_doc.cfm?DOCN=2195  TEGL 17-05, Change 2 –http://wdr.doleta.gov/directives/corr_doc.cfm?DOCN=2759http://wdr.doleta.gov/directives/corr_doc.cfm?DOCN=2759  TEGL 18-11 –http://wdr.doleta.gov/directives/corr_doc.cfm?DOCN=4054http://wdr.doleta.gov/directives/corr_doc.cfm?DOCN=4054  WIASRD –http://www.doleta.gov/performance/pfdocs/Edit_Checks_Website_0 51210.pdfhttp://www.doleta.gov/performance/pfdocs/Edit_Checks_Website_0 51210.pdf Literacy and Numeracy Gains

17. 17 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple 102102 Date of BirthYYYYMMDD Blank A. Mandatory field in DRVS version 5.0 for youth B. Must not be blank if Date of First Intensive Service (WIASRD 334) is not null or Date Entered Training (WIASRD 335) is not null (for Adult, DW, and NEG only). 129129 School Status at Participation 1 = In-school, H.S. or less 2 = In-school, Alternative School 3 = In-school, Post-H.S. 4 = Not attending school or H.S. Dropout 5 = Not attending school; H.S. graduate Blank or 0 = Adult only and for dislocated worker/NEG A. Must be 3 or 5 if WIASRD 122 (Highest School Grade Completed) is 13-17, 87, 88, 90, or 91. (For Youth only) B. Must be 1, 2, or 4 if WIASRD 122 (Highest School Grade Completed) is 00-12. (For Youth only) 130130 Basic Literacy Skills Deficiency 1 = Yes 2 = No Blank or 0 = Adult only and for dislocated worker/NEG No additional edit checks. 303303 Date of ExitYYYYMMDD Blank = has not exited A. Must be blank or greater than or equal to WIASRD 302 (Date of Program Participation). B. Must be a valid date if WIASRD 327 (Other Reasons for Exit) is 01, 02, 03, 04, 05, or 06. WIASRD ELEMENTS

18. 18 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple 306306 Date of First Youth Service YYYYMMDD Blank = no youth service A. Must be blank or greater than or equal to WIASRD 302 (Date of Program Participation). B. Must be blank or less than or equal to WIASRD 303 (Date of Exit). C. Must have valid date if WIASRD 307 (Youth (Statewide 15% Activities)) is 1 or 2. 327327 Other Reasons for Exit (at time of exit or during 3-quarter measurement period following the quarter of exit) 01 = Institutionalized 02 = Health/Medical 03 = Deceased 04 = Family Care 05 = Reservists Called to Active Duty 06 = Relocated to Mandated Residential Program 85-95 = Other ETA exclusions 96 = TAA demonstration 97 = Hurricane exclusion 98 = Retirement 99 = Invalid SSN. Blank or 00 = Participant has not exited or exited for reason other than one of the conditions listed above. A. Must be blank, 00-06 or 85-99. B. Must be blank, 00, or 99 if WIASRD 303 (Date of Exit) is blank. WIASRD ELEMENTS

19. 19 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple 19 701701 Category of Assessment 1 = ABE 2 = ESL 3 = Both ABE and ESL Blank or 0 = no assessment A. Must be 1, 2, or 3 if WIASRD 129 (School Status at Participation) is 3, 4, or 5 and WIASRD 130 (Basic Literary Skills Deficient) = 1 and Date of First Youth Service >= LitNum Start Date. (For Youth only) 702702 Type of Assessment Test 1 = TABE 9-10 2 = CASAS (Life Skills) 3 = ABLE 4 = WorkKeys 5 = SPL 6 = BEST 7 = BEST Plus 8 = TABE Class E 9 = Wonderlic 10 = Other Approved Assessment Tool Blank or 0 = no assessment A. Must be 1, 2, 3, 4, 5, 6, 7, 8, 9, or 10 if WIASRD 701 (Category of Assessment) is 1, 2, or 3. 703703 Functional Area 1 = Reading 2 = Writing 3 = Language 4 = Mathematics 5 = Speaking 6 = Oral 7 = Listening 8 = Other Functional Area Blank or 0 = no assessment A. Must be 1, 2, 3, 4, 5, 6, 7, or 8 if WIASRD 702 (Type of Assessment Test) is 1, 2, 3, 4, 5, 6, 7, 8, 9, or 10. WIASRD ELEMENTS

20. 20 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple 704704 Date Administered Pre-TestYYYYMMDD Blank = no assessment A. Must have a valid date if WIASRD 702 (Type of Assessment Test) is 1, 2, 3, 4, 5, 6, 7, 8, 9, or 10. C. Must have a valid date if WIASRD 707 or WIASRD 710 or WIASRD 713 (Dates Administered Post-Test) has a valid date. D. Must have a valid date if end of report period is greater than Date of First Youth Services + 90 days. 705705 Pre-Test Score000 Blank or 000 = no assessment A. Must be greater than 000 if WIASRD 704 (Date Administered Pre-Test) is not blank. B. Must be greater than 000 if WIASRD 706 (Educational Functioning Level) is 1, 2, 3, 4, 5, 6, 7, or 8. 706706 Educational Functioning Level 1 = Beginning ESL Literacy 2 = Low Beginning ESL Literacy 3 = Beginning ABE Literacy/High Beginning ESL Literacy 4 = Beginning Basic Education/Low Intermediate ESL 5 = Low Intermediate Basic Education/High Intermediate ESL 6 = High Intermediate Basic Education/Advanced ESL 7 = Low Adult Secondary Education/Exit ESL 8 = High Adult Secondary Education Blank or 0 = no assessment A. Must be 1, 2, 3, 4, 5, 6, 7, or 8 if WIASRD 705 (Pre-Test Score) is greater than 000. WIASRD ELEMENTS

21. 21 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple 707707 Date Administered Post-Test (Year #1) YYYYMMDD Blank = no post-test A. Must be greater than WIASRD 704 (Date Administered Pre-Test). B. Must be greater than or equal to WIASRD 306 (Date of First Youth Service) and less than or equal to WIASRD 306 + 1 year 708708 Post-Test Score (Year #1) 000 Blank or 000 = no post-test A. Must be greater than 000 if WIASRD 707 (Date Administered Post-Test Year #1) is not blank. B. Must be greater than 000 if WIASRD 709 (Educational Functioning Level Year #1) is 1, 2, 3, 4, 5, 6, 7, or 8. 709709 Educational Functioning Level (Year #1) 1 = Beginning ESL Literacy 2 = Low Beginning ESL Literacy 3 = Beginning ABE Literacy/High Beginning ESL Literacy 4 = Beginning Basic Education/Low Intermediate ESL 5 = Low Intermediate Basic Education/High Intermediate ESL 6 = High Intermediate Basic Education/Advanced ESL 7 = Low Adult Secondary Education/Exit ESL 8 = High Adult Secondary Education Blank or 0 = no assessment A. Must be 1, 2, 3, 4, 5, 6, 7, or 8 if WIASRD 708 (Post- Test Score Year #1) is greater than 000. 710710 Date Administered Post-Test (Year #2) YYYYMMDD Blank = no post-test A. Must be greater than WIASRD 704 (Date Administered Pre-Test). B. Must be greater than WIASRD 306 (Date of First Youth Service) + 1 year and less than or equal to WIASRD 306 + 2 years WIASRD ELEMENTS

22. 22 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple 711711 Post-Test Score (Year #2) 000 Blank or 000 = no post-test A. Must be greater than 000 if WIASRD 710 (Date Administered Post-Test Year #2) is not blank. B. Must be greater than 000 if WIASRD 712 (Educational Functioning Level Year #2) is 1, 2, 3, 4, 5, 6, 7, or 8. 712712 Educational Functioning Level (Year #2) 1 = Beginning ESL Literacy 2 = Low Beginning ESL Literacy 3 = Beginning ABE Literacy/High Beginning ESL Literacy 4 = Beginning Basic Education/Low Intermediate ESL 5 = Low Intermediate Basic Education/High Intermediate ESL 6 = High Intermediate Basic Education/Advanced ESL 7 = Low Adult Secondary Education/Exit ESL 8 = High Adult Secondary Education Blank or 0 = no assessment A. Must be 1, 2, 3, 4, 5, 6, 7, or 8 if WIASRD 711 (Post-Test Score Year #2) is greater than 000. 713713 Date Administered Post-Test (Year #3) YYYYMMDD Blank = no post-test A. Must be greater than WIASRD 704 (Date Administered Pre-Test). B. Must be greater than WIASRD 306 (Date of First Youth Service) + 2 years and less than or equal to WIASRD 306 + 3 years WIASRD ELEMENTS

23. 23 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple 714714 Post-Test Score (Year #3) 000 Blank or 000 = no assessment A. Must be greater than 000 if WIASRD 713 (Date Administered Post-Test Year #3) is not blank. B. Must be greater than 000 if WIASRD 715 (Educational Functioning Level Year #3) is 1, 2, 3, 4, 5, 6, 7, or 8. 715715 Educational Functioning Level (Year #3) 1 = Beginning ESL Literacy 2 = Low Beginning ESL Literacy 3 = Beginning ABE Literacy/High Beginning ESL Literacy 4 = Beginning Basic Education/Low Intermediate ESL 5 = Low Intermediate Basic Education/High Intermediate ESL 6 = High Intermediate Basic Education/Advanced ESL 7 = Low Adult Secondary Education/Exit ESL 8 = High Adult Secondary Education Blank or 0 = no assessment A. Must be 1, 2, 3, 4, 5, 6, 7, or 8 if WIASRD 714 (Post-Test Score Year #3) is greater than 000. 716to743716to743 Information on Additional Functional Areas Same values as WIASRD 702 through 715 - corresponding to type of assessment, functional area, test dates, test scores, and educational functioning levels. Same edit checks as WIASRD 702 through 715 - except do not repeat the edit for WIASRD 702. (There are no additional edit checks for WIASRD elements 716 and 730) WIASRD ELEMENTS

24. 24 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple  The denominator includes every participant and exiter that meets the criteria to be counted in literacy/numeracy measure during the report period.  The specifics: Denominator Variables

25. 25 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple  Count of Unique records where Youth –Date of First Youth service ( WIASRD 306) is not null and age based on Date of Birth (WIASRD 102) compared to Date of First Youth Service (WIASRD 306) is =>14 and <22. –Date of Program Participation (WIASRD 302) is not a factor in determining age. –If Date of First Youth Service is 2/15/10, then the birth date must be on or before 2/15/96 or after 2/15/88. Denominator Variables

26. 26 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple  ( AND) SCHOOL STATUS AT PARTICIPATION >= 3 – WIASRD Element 129 = 3, 4, or 5 In-School Post HS Attending Not Attending School or H. S. Dropout Not Attending School, High School Graduate  (And) BASIC LITERACY SKILLS DEFICIENCY – WIASRD Element 130 = 1 Record 1 if the participant is a person who computes or solves problems, reads, writes, or speaks English at or below the 8th grade level or is unable to compute or solve problems, read, write, or speak English at a level necessary to function on the job, in the individual's family, or in society. In addition, states and grantees have the option of establishing their own definition, which must include the above language. In cases where states or grantees establish such a definition, that definition will be used for basic literacy skills determination.  The youth is an out of school youth for reporting purposes as defined in TEGL 14-00: An out of school youth is either not attending school or attending post secondary school and is basic skills deficient as indicated by WIASRD Element 130. Denominator Variables

27. 27 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple  (And) Date of First Youth Service =>Lit-Num Start Date –The youth first received youth funded services after the date the state first began to report literacy-numeracy measure. While no longer in play, it is still included as a variable to allow reproduction of older reports (PY06 - PY09).  (And) Basic Skills Deficient –As defined by the pre-test (WIASRD 706) or post test (WIASRD 709 or 712)  If 130 is 1, but the pre-test EFL is 7 or 8 (706 > 6) or a post test EFL is 7 or 8 (709 or 712 > 6), Youth is not BSD for the measure and is excluded.  States must ensure that all out of school youth identified as Basic Skills Deficient have a pre-test recorded. Failure to pre-test automatically includes the youth in the denominator, but excludes the youth from the numerator. However if all reported pre-tests are EFL 7 or higher the youth is excluded from the measure even if 130 = 1. Denominator Variables

28. 28 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple Plain English Denominator  No Recorded Pre-Test Results = No Success  If the youth is basic skills deficient without pre-test results, the youth will count as a negative outcome for the measure.  TIP: Record all test results! Denominator Variables

29. 29 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple  (And) End of the current participation year is within the reporting period –Date of First Youth Service (WIASRD 306) + 365 is within the specified reporting cohort. –Date of First Youth Service + 1 year is the Anniversary Date. –If the Date of First Youth Service is 2/15/2010, the Anniversary Date is 2/15/2011.  (And) End of the current participation year =< end of participation year #3 –Date of First Youth Service + 1095 is > the start date of the cohort. –Defines the end point for the measure as youth are excluded after the third anniversary date even if they are still basic skills deficient. –Date of First Youth Service + 3 years is the third Anniversary Date. –If the Date of First Youth Service is 2/15/2010, the third Anniversary Date is 2/15/2013. Denominator Variables

30. 30 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple  (And) Date of Exit is null –WIASRD 303 is null  (Or) Date of exit > end of current participation year –WIASRD 303 > WIASRD 306 + 365  (Or) Date of Exit <= end of participation year #1 – Only those that exit prior to the first anniversary date are included in the measure. Exiting prior to the second or third anniversary excludes you from the measure.  (And) End of Participation Year #1 is within the reporting period –WIASRD 303 < WIASRD 306 + 365 and WIASRD 306 + 365 is within the reporting period. –Inclusion in the denominator is always based on the anniversary date being in the cohort. Those that exit prior to the first anniversary date are not included in the cohort until the first anniversary of the date of first youth service. Denominator Variables

31. 31 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple  If Date of First Youth Service is 2/15/2010, then the first anniversary is 2/15/2011, the second is 2/15/2012 and the third is 2/15/2013.  The second participation year begins 2/16/2011 and the third begins 2/16/2012.  The out of school youth's exit date must be prior to the first anniversary or after the second or third anniversary. –Exit dates that fall between the first and second anniversary dates or second and third anniversary dates exclude the OSY from the measure even if a gain is attained.  2/15/2011, 2/15/2012 and 2/15/2013 must be in the reporting cohort for the result to be included in the denominator or numerator. Denominator Variables

32. 32 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple Plain English Denominator  Everyone counts in the first year. –Youth still receiving services at the first year anniversary AND the youth who exited are included.  Only youth celebrating an anniversary are in the measure for Year 2 and Year 3. –Youth who exit during the second or third year don’t count.  TIP: Remember anniversaries! Denominator Variables

33. 33 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple  (And) Other reason for exit (WIASRD 327) is null –Participant has not exited  (Or) Other reason for exit (WIASRD 327) = 00 –Participant has exited, but not for one of the enumerated other reasons  (Or) Other reason for exit (WIASRD 327) = 98 –Participant has retired  Each listed code, null, 00 or 98 includes the youth in the measure after exit. All other codes exclude the youth from the measure. Denominator Variables

34. 34 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple Plain English Denominator  There are very few ways to be excluded from performance. Follow the WIA exclusions outlined in TEGL 17-05 (institutionalized, health issue, etc.)  TIP: When in doubt, the youth probably count! Denominator Variables

35. 35 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple  The numerator is created using all of the elements used in the denominator except the numerator checks for a valid post test and that the difference between the pre- test and the post-test EFL results in a gain. Numerator Variables

36. 36 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple  Count of unique records where Youth  (And) SCHOOL STATUS AT PARTICIPATION >= 3  (And) BASIC LITERACY SKILLS DEFICIENCY  (And) Date of First Youth Service =>Lit-Num Start Date  (And) Basic Skills Deficient  (And) End of the current participation year is within the reporting period  (And) End of the current participation year =< end of participation year #3 Numerator Variables

37. 37 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple  (And) Pre-test educational functional level is not null –WIASRD 706 must have a valid pretest result  (And) A successful post-test completion date >= the start of the current participation year –WIASRD 707, 710 or 713 post test date must be on or after the start of the participation year  (And) Successful post-test completion date <= the end of the current participation year –WIASRD 707, 710 or 713 post test date must be on or before the end of the participation year and or before the exit date if exit is within the first participation year. Numerator Variables

38. 38 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple Numerator Variables  If the date of first youth service is 2/15/10, then in addition to the pretest existing, the pretest must be dated prior to 2/15/11.  The successful post test must be on or after 2/15/10 and on or before 2/15/11 for the first year.  The successful second post test must be on or after 2/16/11 or on or before 2/15/12 and the exit after 2/15/12.  The successful third post test must be on or after 2/16/12 or on or before 2/15/13 and the exit after 2/15/13.

39. 39 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple  (And) Date of Exit is null  (Or) Date of exit > end of current participation year  (Or) Date of Exit <= end of participation year #1  (And) End of Participation Year #1 is within the reporting period Numerator Variables

40. 40 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple  (And) Other reason for exit (WIASRD 327) is null  (Or) Other reason for exit (WIASRD 327) = 00  (Or) Other reason for exit (WIASRD 327) = 98 Numerator Variables

41. 41 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple To summarize, these are the additional variables used in the numerator and determine if a gain has occurred with the participation year.  (And) Pre-test educational functional level is not null –WIASRD 706 must have a valid pretest result  (And) A successful post-test completion date >= the start of the current participation year –WIASRD 707, 710 or 713 post test date must be on or after the start of the participation year  (And) Successful post-test completion date <= the end of the current participation year Numerator Variables

42. 42 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple Plain English Numerator  Numerators are the successful Youth!  Youth can only be a success if the POST- TEST shows a gain of at least one EFL.  TIP: Post-test and RECORD the results! Numerator Variables

43. 43 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple  Numerator and Denominator Variables are further defined by Constructed Variables. –Youth –Basic Skills Deficient –Start of Participation Year, End of Participation Year and Current Participation Year – Successful Post-Test Completion Date  Constructed Variables must loop through each of the three possible functional areas. Constructed Variables

44. 44 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple  Youth –Unique records where date of first youth service (WIASRD 306) is not null –(And) Date of first youth service – date of birth (WIASRD 102) => 14 –(And) Date of first youth service – date of birth < 22 Constructed Variables

45. 45 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple Constructed Variables  Basic Skills Deficient –Educational Functional Levels –The EFL ranges for Literacy/Numeracy originally defined in TEGL 17-05, change 1 were updated in TEGL 17-05, change 2. –A youth must be EFL level 7 or 8 to be considered no longer basic skill deficient.

46. 46 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple Basic Skills Deficient Constructed Variables

47. 47 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple  Basic Skills Deficient –Educational Functional Level 1, 2 or 3 <= 6 –(or) Educational Functional Level 1, 2, and 3 = null  Youth must either be pre-tested as EFL (WIASRD 706 and subsequent) 6 or less or be identified as basic skills deficient because 130 = 1. –If each EFL is > 6, then 130 is ignored. –If 130 = 2, but any EFL is <= 6, then 130 is ignored. Constructed Variables

48. 48 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple  Basic Skill Deficient –Date administered post-test #1 < start of the current participation year –(And) Educational functional level post-test #1 > 0 –(And) Education functional level post test <= 6  This checks to make sure that the youth is still BSD. If any post test has an EFL of 7 or 8, youth are excluded for that functional area. Constructed Variables

49. 49 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple  Basic Skills Deficient –The criteria established for post test 1 is applied to post-test 2 to determine if the Youth is still BSD after post test #2. –Post test 3 is not evaluated in this manner because Youth are not post-tested after their third year of participation.  This same criteria is applied to the second functional area (post-tests 4 and 5) and the third functional area (post-tests 7 and 8). Constructed Variables

50. 50 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple Plain English Constructed Variables  There are triple checks to ensure that the right participants are in the measure.  To stay in the measure for the next round, a youth must still be BSD in one functional area.  To be excluded for the next round, a youth must no longer be BSD in any functional area.  TIP: Know the RESULT! –No matter what you check after the pre-test, a youth’s results determines BSD for this measure Constructed Variables

51. 51 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple  Lit-Num Start Date –This constructed variable is no longer used since all Youth who were initially registered in PY 2006 have either exited from services or completed their third participation year. –It is retained only for historical reports. Constructed Variables

52. 52 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple Current Participation Year  Year #1: –Start of Participation Year#1 = Date of First Youth Service (2/15/10) –End of Participation Year#1 = Date of First Youth Service + 1 Year (2/15/11)  Year #2: –Start of Participation Year#2 = Date of First Youth Service + 1 Year + 1 Day (2/16/11) –End of Participation Year#2 = Date of First Youth Service + 2 Years (2/15/12)  Year #3: –Start of Participation Year#3 = Date of First Youth Service + 2 Years + 1 Day (2/16/12) –End of Participation Year#3 = Date of First Youth Service + 3 Years (2/15/13) Constructed Variables

53. 53 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple Current Participation Year –If end of participation year #1 >= start of the reporting period and end of participation year #1 =< end of the reporting period then set start of current participation year = start of participation year #1 and end of current participation year = end of participation year #1 –If end of participation year #2 >= start of the reporting period and end of participation year #2 =< end of the reporting period then set start of current participation year = start of participation year #2 and end of current participation year = end of participation year #2 –If end of participation year #3 >= start of the reporting period and end of participation year #3 =< end of the reporting period then set start of current participation year = start of participation year #3 and end of current participation year = end of participation year #3  The current participation year establishes the one year period for which results are being calculated. Constructed Variables

54. 54 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple  Successful Post-Test Completion Date –Set successful post-test completion date = date administered post-test (Year #1) where educational functional level (Year #1) minus educational functioning level > 0 and educational functioning level =< 6 –This sets the post test completion date equal to the date the post test was administered where the EFL for the first post test is greater than the EFL for the pre-test and the youth was BSD in the first functional level. Constructed Variables

55. 55 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple  Successful Post Test Completion Date –(And) Date of exit is null –(Or) Date of exit => Date administered post test (Year #1) No exit date or the post test was prior to the exit date if the participation year is Year #1. –(And) Date administered post-test (Year #1) => date of first youth service and date administered post-test (Year #1) =< end of participation year #1 The post-test is within the first year of that the youth is in the program. Constructed Variables

56. 56 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple  Successful Post-Test Completion –(And) End of the participation year #1 >=start of the report period –(And) End of the participation year #1 =< end of the report period  The end of the first participation year is within the report period.  Exit date is not the end of the participation year even when exit occurs during the first year of participation.  This process repeats for each year and each post test until the third year of participation is complete. Constructed Variables

57. 57 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple Calculation Process  Three functional areas are available  Each Area with one pre-test and up to three post-tests  The calculation process must evaluate each functional area distinctly.  If one area shows a gain, the record is included in the numerator.

58. 58 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple  All areas must be have an EFL > 6 to not be in the denominator.  Failure to post-test or post-test within the participation year is a negative outcome. Calculation Process

59. 59 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple Bottom Line  Youth only have to increase one EFL in any functional area to be a success.  Achieve over 6 in a functional area and the youth is no longer BSD in that area. Congratulations!  TIP: Testing results and dates are the way to success. –Test before the anniversary and watch the results! One gain gets you a success!

60. 60 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple Putting It Together  Seven new youth participants –Christina is a 17 year old high school drop out who is basic skills deficient as identified in 130. –Lane is a 20 year old high school graduate attending post secondary and is basic skills deficient as identified in 130. –Denise is a 19 year old high school graduate who is basic skills deficient as identified in 130. –Maria is a 21 old high school drop out who is basic skills deficient as identified in 130. –Ed is a 16 year old high school drop out who is not basic skills deficient as identified in 130. –Keith is a 21 year old high school graduate who is basic skills deficient as identified in 130. –Ryan is a 16 year old attending secondary school who is basic skills deficient as identified in 130.  Who is included in the measure? –Based on the listed information all are included except Ed who has 130 = 0 and Ryan who is an in- school youth.

61. 61 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple  Christina, Lane, Denise and Keith all take the pre-test in Reading and Math with the following results. –Christina: Math EFL 8, Reading EFL 8 –Lane: Math EFL 4, Reading EFL 7 –Denise: Math EFL 5, Reading EFL 3 –Keith: Math EFL 7, Reading EFL 3  Maria does not pre-test.  Who is included in the measure? –All are included except Christina whose test results were greater than EFL 6. Putting It Together

62. 62 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple  Date of first you service for Lane, Denise, Maria and Keith is 2/15/10. All take the first year post-tests except Maria with the following results. –Lane: Pre-Math EFL 4 – Post Math EFL 4, Pre-Reading EFL 7 Date of Successful Post Test: 2/12/11 –Denise: Pre-Math EFL 5 – Post-Math EFL 6, Pre- Reading EFL 3 – Post-Reading EFL 3 Date of Successful Post Test 2/01/11 –Keith: Pre-Math EFL 7, Pre-Reading EFL 3 – Post-Reading EFL 4 Date of Successful Post-Test 12/11/10 and Date of Exit 12/12/10 Putting It Together

63. 63 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple Question 2 A.All B.Keith, Denise and Lane C.Maria and Keith D.Just Lane Who is included in the denominator?

64. 64 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple Putting It Together ● Who is included in the denominator? – A. All – All are in the denominator when 2/15/11 is included in the cohort for the measure, which is the PY10 annual report and the 3/31/11 quarterly report.

65. 65 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple Question 3 A.All B.Keith and Denise C.Maria and Keith D.Just Lane Who is included in the numerator?

66. 66 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple Putting It Together ● Who is included in the numerator? – B. Keith and Denise – Denise is included for an EFL gain in Math. – Keith is included for an EFL gain in Reading. – Lane is not included because no EFL gain occurred. – Maria is not included because of no pretest or post test.

67. 67 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple  Lane and Denise enter a second participation year starting 02/16/2011. Both take the second year post-tests with the following results. –Lane: 1 st Post-Math EFL 4 – 2 nd Successful post Math EFL 5 Date of Successful Post Test: 2/12/12 –Denise: 1 st Post-Math EFL 6 – 2 nd Successful Post- Math EFL 7, Pre- Reading EFL 3 – Post-Reading EFL 3 Date of Successful Post Test 1/04/12; Date of Exit 01/05/12 Putting It Together

68. 68 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple Question 4 A.Both Lane and Denise B.Lane C.Denise Who is included in the denominator?

69. 69 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple Putting It Together ● Who is included in the denominator? – B. Lane – Only Lane is in the denominator when 2/15/12 is included in the cohort for the measure, which is the PY11 annual report and the 3/31/12 quarterly report. – Denise is excluded because she exited during the second year of participation.

70. 70 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple Question 5 –Lane –No one Who is included in the numerator?

71. 71 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple Putting It Together ● Who is included in the numerator? – A. Lane – Lane is included because an EFL gain occurred in Math.

72. 72 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple  Lane enters a third participation year starting 02/16/2012. She takes the third year post-test with the following results. –Lane: 2 nd Post-Math EFL 5 – 3 rd Successful post Math EFL 6 Date of Post Test: 2/17/12 Putting It Together

73. 73 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple Putting It Together ● Who is included in the denominator? – Lane is in the denominator when 2/15/13 is included in the cohort for the measure, which is the PY12 annual report and the 3/31/13 quarterly report. ● Who is included in the numerator? – Lane is excluded because the Post Test date is after the anniversary date.

74. 74 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple Calculation Process Issues  Post test results cannot be included in the WIASRD until the participation year end date is within the report period. –For youth with a FDYS of 7/1/2011 to 6/30/2012, only show 1 post-test. If the youth has a year 2 post-test, remove it from the extract file. –For youth with a FDYS of 7/1/2010 to 6/30/2011, only include year 1 and year 2 post-tests. If the youth have a year 3 post-test, remove it from the extract file. –For youth with a FDYS of 7/1/2009 to 6/30/2010, all post- test can be included in the extract file.

75. 75 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple  If any functional area shows a post-test EFL > 6, but another area is still BSD, any gains in the areas that are still BSD are not included in the numerator. –If functional area 1 (702 – 715) has any post-test with an EFL > 6, but functional area 2 (716 – 729) is still indicating an EFL > 6, even when a gain is recorded in a post-test for functional area 2, the youth will only be in the denominator and not the numerator. Functional area 1 must be removed from the file extract to correctly process functional area 2. Calculation Process Issues

76. 76 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple ● Example: ● Functional Area 1 ● Post test year #1 EFL >6 (709). No longer in measure for Functional Area 1 ● Functional Area 2 ● Post test year #2 EFL is a gain from post test year #1 Calculation Process Issues 701702703704705706707708709 114201012084044201104286507 716717718719720721722723724725726 11201012084224201104284775201204285256

77. 77 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple  Pre-test = 5, Post-Test #1 = 3, Post-Test #2 = 4, results in a gain for participation year #2. Calculation Process Issues

78. 78 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple Question 6 A.Expert B.Advanced C.Intermediate D.Novice E.None After the presentation, my level of understanding and knowledge of the Literacy/Numeracy Gains measure’s requirements and reporting is:

79. 79 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple Please enter your questions into the Chat Room! Question and Answer Period

80. 80 Literacy/Numeracy Made Simple Literacy/Numeracy Made Simple www.workforce3one.org For more information about the Workforce Investment System:  Visit www.careeronestop.orgwww.careeronestop.org  Call 1-877-US2-JOBS