1. Literacy Matters: EM Messages & Readability Levels Dr. Tom Phelan phelandrtom@gmail.com Urban Assembly School for Emergency Management, Advisory Board www.uasem.org 1

2. The Numbers Don’t Lie U.S.Facts: Adults Over 16 See more at: http://www.proliteracy.org/the-crisis/adult-literacy- facts#sthash.lepUzlWg.dpufhttp://www.proliteracy.org/the-crisis/adult-literacy- facts#sthash.lepUzlWg.dpuf 2

3. 14% is HUGE CITYPopulation #Adults at or below 5 th Grade Level EM Homepage Readability Grade Level Gap EM to Intended Audience < 5 th Grade 1New York - city8,405,8371,176,817 15.910.9 2 Los Angeles ‐ city 3,884,307543,802 15.410.4 3Chicago ‐ city2,718,782380,629 22.317.3 4Houston ‐ city2,195,914307,427 11.76.7 5 Philadelphia ‐ city 1,553,165217,443 10.25.2 6Phoenix ‐ city1,513,367211,871 13.58.5 3

4. 29% are at 8 th Grade or Below What are the readability levels of your homepage and emergency notifications? What are the readability levels of the intended audiences of your emergency messages? 4

5. Research Questions 1.Are emergency managers aware of the range of cognitive skills of adults in their communities in the domains of literacy, numeracy, and computer-based problem solving skills? 2.Is the awareness applied to developing emergency messages to adults in the community at appropriate levels of literacy, numeracy, and computer-based problem solving skills? 3.If a gap exists between emergency managers and their intended audiences, could it be reduced by providing targeted training in literacy, numeracy, and computer- based problem solving skills for emergency managers? 5

6. Hypotheses H 1 : Awareness of literacy skill level differences and training of emergency managers to address the differences will improve the effectiveness of disaster messages to the public at all levels of literacy. H 0 : Literacy levels are too complex and can’t be addressed by emergency managers. 6

7. The Flesch Reading Ease Scores 90-100 : Very Easy 80-89 : Easy 70-79 : Fairly Easy 60-69 : Standard 50-59 : Fairly Difficult 30-49 : Difficult 0-29 : Very Confusing 7

8. Grade Level Scores Reading Ease ScoreSchool Level 90 to 1005 th grade 80 to 906 th grade 70 to 807 th grade 60 to 708 th and 9 th 50 to 6010 th to 12 th 30 to 50college 0 to 30college graduates 8

9. Commonly Read Materials PublicationReading EaseGrade Level Time5210 th -12th Newsweek5010 th – 12 th Wall Street Journal43College Harvard Business Review43College New York Times39College New York Review of Books35College Harvard Law Review32College Standard auto insurance policy10College Graduate Internal Revenue Codeminus 6Your Accountant/Lawyer 9

10. EM Home Page Grade Levels 10

11. Rudolph Flesch (1911-1986) Flesch Reading Ease Formula is considered as one of the oldest and most accurate readability formulas. Rudolph Flesch, an author, writing consultant, and a supporter of the Plain English Movement, developed this formula in 1948. Raised in Austria, Rudolph Flesch studied law and earned a Ph.D. in English from the Columbia University. Flesch, through his writings and speeches, advocated a return to phonics. In his article, A New Readability Yardstick, published in the Journal of Applied Psychology in 1948, Flesch proposed the Flesch Reading Ease Readability Formula 11

12. J. Peter Kincaid Peter Kincaid Graduate Research Professor Ph.D. Human Factors Psychology Ohio State University, 1971 M.A. Experimental Psychology Roosevelt University, 1966 B.A. Psychology, Oberlin College, 1964 E-mail: pkincaid@ist.ucf.edu Phone: 407-882-1330pkincaid@ist.ucf.edu Dr. Kincaid's areas of R&D include training systems analysis, instructional technology and human factors. He has 30 years applied research and university teaching experience and currently is a member of the Human Factors Ph.D. faculty and co- director of the Modeling and Simulation graduate program at UCF. Dr. Kincaid received his Ph.D. in human factors from Ohio State University in 1971. He is a member of the Human Factors and Ergonomics Society and is Associate Editor for the society's applied research journal, Ergonomics in Design. http://www.ist.ucf.edu/people/kincaidp/kincaid.htm 12

13. The Flesch Reading Ease Readability Formula The specific mathematical formula is: RE = 206.835 – (1.015 x ASL) – (84.6 x ASW) RE = Readability Ease ASL = Average Sentence Length (i.e., the number of words divided by the number of sentences) ASW = Average number of syllables per word (i.e., the number of syllables divided by the number of words) The output, i.e., RE is a number ranging from 0 to 100. The higher the number, the easier the text is to read. Scores between 90.0 and 100.0 are considered easily understandable by an average 5th grader. Scores between 60.0 and 70.0 are considered easily understood by 8th and 9th graders. Scores between 0.0 and 30.0 are considered easily understood by college graduates. 13

14. To rewrite a passage to get a higher score… Cut the average sentence length. When it comes to replacing complex words with simple ones, – first aim at words with prefixes and suffixes – Then look for plain language two-word replacements – establishment, available or required. – setting up, in stock or called for – “evacuate” becomes “get out” or “leave” 14

15. Existing EM Homepage The Jackson County Emergency Management Agency stands ready to RESPOND to incidences when they occur, PREPARE for future threats that may develop, direct RECOVERY programs to save life and property and reduce local threats through MITIGATION programs Our goal at the Jackson County Emergency Management department is the protection of lives and property of Jackson County citizens. Are you prepared for the possible emergencies we face in this section of the country? Navigate our Disaster pages by clicking on our links on the menu above to read about important information about various disasters, what to do in the event of one, and most importantly, how to be prepared for them. Flesch-Kincaid Grade Level = 13.7 15

16. Re-write The Jackson County EMA is ready to RESPOND to and PREPARE for disasters, and lead RECOVERY programs to save lives and property and reduce threats through MITIGATION programs. Our goal is to protect the lives and property of our citizens. Are you prepared for the emergencies we may face? Look at our Disaster pages by clicking on the links above to read about disasters, what to do in one, and how to be prepared. Flesch-Kincaid Grade Level = 9.3 (a reduction or 4.4 grade levels) 16

17. Digital Literacy 17

18. Numeracy 18

19. Relating Numbers to Pictures Probability in per cent (%) from 2% to Significant (above 60%) 19

20. Computer-based Problem Solving 20

21. In Summary EM messages may be reaching their intended audiences, but at a level that is not being understood. EM academic programs should include lessons on literacy and crafting EM messages at appropriate reading levels. College EM programs should teach the basic skills of crafting messages at lower readability levels. 21

22. References Goodman, M., Finnegan, R., Mohadjer, L., Krenzke, T., & Hogan, J. (2013). Literacy, numeracy, and problem solving in technology-rich environments among U.S. adults: Results from the Program for the International Assessment of Adult Competencies 2012: First Look (NCES 2014-008). Washington, DC: National Center for Education Statistics, U.S. Department of Education. Retrieved from http://nces.ed.gov/pubsearch. http://nces.ed.gov/pubsearch 22

23. References The numbers don’t lie. (2015). Syracuse, NY: ProLiteracy. Retrieved from http://www.proliteracy.org/the-crisis/adult- literacy-facts http://www.proliteracy.org/the-crisis/adult- literacy-facts 23

24. Appendix A Emergency Management Home Page Readability Grade Levels 8.8 http://www.co.warren.oh.us/emergencyservices/dispatch/911/expect.aspx 9.6 http://www.voa.org/action-team?gclid=Cj0KEQjw_pmoBRDu986bpISz5ZsBEiQANiuHDJ-9qYBmBMzZj- XDta2Y5gOxzOmnBs5CueAYbPhQpHQaAt_j8P8HAQ 9.6 http://www.uscg.mil/tcyorktown/default.asp 9.8 http://www.redcross.org/ks/about-us 10.2 http://oem.readyphiladelphia.org/RelId/606683/ISvars/default/Home.htm 10.3 http://www.greenvillenc.gov/government/fire-rescue 10.3 http://www.ci.medford.or.us/Page.asp?NavID=662 11.5 http://www.uscg.mil/d1/ 11.7 http://www.houstonoem.org/go/doc/4027/1995702/ 11.8 http://www.loudoun.k12.va.us/site/Default.aspx?PageType=6&SiteID=1&SearchString=emergency%20plan 12.9 http://www.lcounty.com/ema/ 13.5 https://www.phoenix.gov/fire/directory/cert 13.7 http://www.jacksoncountyfl.net/emergency-management 13.9 http://hampton.gov/eoc/ 14 http://www.monmouthsheriff.org/ 14.1 http://www.dhses.ny.gov/ 14.9 http://oldharbortribal.org/ohtc/ 24

25. Appendix A (con’t) 14.9 http://www.pwcgov.org/government/dept/FR/OEM/Pages/default.aspx 15.4 http://emergency.lacity.org/index.htm 15.5 http://www.glendaleaz.com/Fire/messagefromthechief.cfm 15.9 http://www.nyc.gov/html/oem/html/home/home.shtml 16 http://www.bces.wa.gov/ 16 http://www.usda.gov/wps/portal/usda/usdahome?contentid=Emergency_Preparedness_and_Response.html 16.1 http://www.apu.edu/?a=1299&TrackingCode=sCDHewidh_dc|pcrid|56917759386|pkw|azusa%20pacific%20university|pmt|e&c3a pimn=CDHewidh&ClientMarketingCampaignID=26&VendorAccountID=41856&gclid=Cj0KEQjw_pmoBRDu986bpISz5ZsBEiQANiuHDK 5nltcKuCiEmSbveTIMwcHY5hJnClW_EsiNksH04uUaAv6o8P8HAQ 16.3 http://sema.dps.mo.gov/ 16.7 https://www.waubonsee.edu/safety/ 17 http://offices.nsuok.edu/publicsafety/EmergencyAlerts.aspx 18 http://www.roundrocktexas.gov/departments/police/ 18 http://www.msema.org/about/ 25

26. Appendix A (con’t) 20.9 http://www.hcanj.org/ 21.6 http://www.usace.army.mil/About.aspx 22.3 http://www.cityofchicago.org/city/en/depts/oem/provdrs/emerg_mang.html 22.4 https://training.fema.gov/hiedu/ 26.4 http://www.co.cumberland.nc.us/emergency_mgmt/ 18.3 http://www.nola.gov/homeland-security/ 18.4 http://www.montana.edu/police/about.html 18.6http://www.tetonwyo.org/em/ 19.1 http://www.miamidade.gov/fire/emergency-management.asp 19.6 http://mema.maryland.gov/Pages/AboutMEMA.aspx 19.6 http://www.capecoral.net/government/city_government/city_departments/emergency_management.php#.VQcYnOGnTEY 26

27. Questions? 27