1. Evaluation Requirements and South Dakota-PLI Webinar January 5, 2015 BROOKE BLAALID, MSW AND DOUG PIPER, PHD SPF PFS EVALUATION B CONSULTING, LLC 1

2. PFS Community Outcome Measure Requirements Community Outcome Measures are due annually in November Baseline data must be submitted by November 2015 Required Collection 1.Consumption: 30 day use, binge drinking 2.Intervening Variables (Risk & Protective Factors): Risk of harm 3.Consequences: Alcohol arrests, prescription drug arrests or emergency room visits ALL 3 AREAS MUST BE REPORTED ANNUALLY and INCLUDE ALCOHOL AND PRESCRIPTION DRUG USE ( Evaluators will complete forms to be submitted to B Consulting, LLC which will then be uploaded into PEP-C). B CONSULTING, LLC 2

3. PFS Community Outcome Measure Requirements (Continued) Consumption/Substance Use (Required Collection) 1.Past 30-day alcohol use 2.Past 30-day nonmedical use of prescription drugs 3.Binge drinking IndicatorMeasureMeasure ResponseOutcomeSourceFrequency CollectedMethod of Collection Substance use: Past 30 day alcohol use During the past 30 days, on how many days did you drink one or more drinks of an alcoholic beverage? A number between 0 and 30Percent who reported having used alcohol during the past 30 days (i.e., percent who responded 1 or more days) School SurveyAnnualIn-person collection in sub-grantee schools. Substance use: Past 30 day nonmedical use of prescription drugs During the past 30 days, on how many days did you use prescription drugs that were not prescribed for you or that you took only for the experience or feeling they caused? A number between 0 and 30Percent who reported having used prescription drugs not prescribed or for the experience or feeling during the past 30 days (i.e., percent who responded 1 or more days) School SurveyAnnualIn-person collection in sub-grantee schools Substance use: Binge drinking During the past 30 days, on how many days did you have 5 or more drinks on the same occasion? A number between 0 and 30Percent who reported having binge drank during the past 30 days (i.e., percent who responded 1 or more days) School SurveyAnnualIn-person collection in sub-grantee schools B CONSULTING, LLC 3

4. PFS Community Outcome Measure Requirements (Continued) Intervening Variables / Risk & Protective Factors (Required Collection) 1.Perceived risk or harm of use for alcohol 2.Perceived risk or harm of use for nonmedical use of prescription drugs IndicatorMeasureMeasure ResponseOutcomeSourceFrequency CollectedMethod of CollectionLevel of Data Perception of Harm: Alcohol How much do people risk harming themselves physically and in other ways when they have five or more drinks of an alcoholic beverage once or twice a week? No risk, Slight risk, Moderate risk, Great risk Percent reporting moderate or great risk (i.e., percent reporting “moderate risk” and percent reporting “great risk” combined) School SurveyAnnualIn-person collection in sub- grantee schools Community Perception of Harm: Prescription Drugs How much do people risk harming themselves physically and in other ways if they use prescription drugs that are not prescribed to them or that they took only for the experience or feeling they caused? No risk, Slight risk, Moderate risk, Great risk Percent reporting moderate or great risk (i.e., percent reporting “moderate risk” and percent reporting “great risk” combined) School SurveyAnnualIn-person collection in sub- grantee schools Community B CONSULTING, LLC 4

5. PFS Community Outcome Measure Requirements (Continued) Consequences (Required Collection) 1.Alcohol-related crime 2.Prescription drug-related emergency room visits IndicatorMeasureOutcomeSource Frequency Collected Method of Collection Level of Data Alcohol-Related Crime* Measure calculation: The number of alcohol-related arrests divided by the total number of arrests and multiplied by 100 Measure calculation: # of alcohol-related arrests divided by the total number of arrests and x100 Uniform Crime Reporting (UCR) Program Annual (summer)Administrative DataState *Alcohol-related arrests include the following Uniform Crime Reporting [UCR] categories: DUI and Liquor Law Violations.) Prescription Drug- Related Emergency Room (ER) Visits** Measure calculation: The number of ER visits involving prescription drugs divided by the total number of ER visits and multiplied by 100 Measure calculation: # of ER visits involving prescription drugs divided by the total # of ER visits and x 100 Avera HospitalsAnnualAdministrative DataState **DAWN defines prescription drug–involved ER visits as those in which prescription drugs are the direct cause or contributing factor). B CONSULTING, LLC 5

6. South Dakota PLI SD Prevention is requiring that all coalitions who do individual EBPs must have their students (participants)complete the SD-PLI. 1.Pre and Post are required (non-matching). 2.13 questions are required for the SD-PLI. 3.Additional questions may be added. This is up to the discretion of the coalition and local evaluator. 4.Coalitions will determine how the SD-PLI is distributed to participants via paper or web- based. 5.Local Evaluators will submit SD-PLI data to B Consulting, LLC in an excel file. B CONSULTING, LLC 6

7. PEP-C Reporting Quarterly reporting data that state will need for PEP-C submission State will need various data from coalitions that ranges from volunteer hours to all available funds (other grants, fundraising activities, in-kind donations, ect). Coalitions will be provided with an excel document to input data. 1.Assessments 1.Accomplishments and Barriers 2.Capacity 1.Accomplishments and Barriers 3.Planning 1.Accomplishments and Barriers 2.Strategic Plan 4.Implementation 1.Accomplishments and Barriers 2.Description of SPF Process 4.Evaluation 1.Accomplishments and Barriers 2.Evaluation Plan 3.Evaluation Report 5.Health Disparity 1.Accomplishment and Barriers 2.Health Disparity Work-plan B CONSULTING, LLC 7

8. PEP-C Reporting (Continued) Coalitions will report into the PEP-C: May and November CLI-R is not approved by OMB. Anticipated approval date is May 2015. CLI-R is similar in nature to CLI data that was submitted for SPF SIG. Data will include but not limited to: 1.Demographics 2.Participants Served 3.EBPs implemented 4.Fidelity 5.Funding B CONSULTING, LLC 8

9. Evaluation Plans 1.Every coalition will need to complete an evaluation plan that will be utilized throughout the course of PFS. 2.Coalitions will submit a final Evaluation Plan and Evaluation Report to PEP-C. 3.B Consulting, LLC will provide training and technical assistance for evaluation plans and reports. 4.What do your calendars look like? 1.Potential Training/Work days 2.Sometime after the end of March (PFS meeting in Maryland: March 24 th and 25 th ) B CONSULTING, LLC 9

10. Questions?? B CONSULTING, LLC 10

11. Evaluation Contact Information Brooke Blaalid, MSW PFS Evaluation Manager Email: Blaalid.bconsulting@outlook.comBlaalid.bconsulting@outlook.com Office: 605-689-0478 Cell: 605-660-9721 Doug Piper, PhD PFS Evaluation Email: dpiper2@wisc.edudpiper2@wisc.edu Office: 608-263-7629 B CONSULTING, LLC 11