Presentation on theme: "Basic FBA to BSP Module 7: Evaluation"— Presentation transcript:
1Basic FBA to BSP Module 7: Evaluation Using FBA to Develop Function-Based Support for Students with Mild to Moderate Problem BehaviorModule 7: Evaluation
2Adapt BSP and implementation as needed based on on-going monitoring The Basic FBA to BSP Process1. Define the Problem Behavior2. Conduct assessment for behavior support planninga. Functional Behavioral Assessment• Defining behavior in observable & measureable terms• Ask staff and student about where, when, & why behavior occurs• See the behavior during specified routines• Hypothesize a final summary of where, when, & why behavior occurs3. Design an individualized behavior support plan (BSP)• Ensure technical adequacy• Ensure contextual fit4. Ensure Fidelity of Implementation5. Monitor Plan Impact on Student BehaviorAdapt BSP and implementation as needed based on on-going monitoringAdapted from Horner, Albin, Todd, Newton & Sprague, 2011
3Basic FBA to BSP Training Series Module 1- Teaching Basic PrinciplesModule 2- FBA: Practice InterviewingModule 3- FBA: Practice ObservingModule 4- Critical Features of BSPModule 5- Building BSP from FBAModule 6- Implementation & EvaluationModule 7- Evaluation
4Basic vs. Complex FBA/BSP Focus of this training seriesBasicComplexFor:Students with mild to moderate problem behaviors (behaviors that are NOT dangerous or occurring in many settings)Students with moderate to severe behavioral problems; may be dangerous and/or occurring in many settingsWhat:Relatively Simple and Efficient process for behavior support planning based on “practical” FBA dataTime-intensive process that involves emergency planning, family-centered planning, and collaboration with outside agenciesDeveloped by whom:Team of school-based professionals (e.g., PBS team members whose job responsibilities include FBA and behavior support planning)School-based team including professionals trained to develop and implement intensive interventions for students with severe problem behaviors (e.g., behavior specialist)444
5Objectives By the end of this module you will be able to: Define the necessary components of evaluation plans and provide examples of appropriate short- and long-term goalsDescribe data collection procedures that would be used to track implementation fidelity and student progress when provided with a sample BSPDescribe the process for conducting and products that should result from a Plan Review Meeting
6Review #1The Basic FBA to BSP training series is designed to teach school staff to conduct assessment and develop supports for students with what type of behavior?Mild to Moderate, NON-DANGEROUS Behaviors
7Review #2What are the 4 steps of the Basic FBA Process (Hint: D.A.S.H)?#1: Define behavior in observable, measureable terms#2: Ask staff about When, Where, & Why the behavior occurs#3: See the behavior (direct observation)#4: Hypothesize a final summary of when, where and why behavior occurs
8Review #3Please list the 4 critical components of Behavior Support Plans:#1: Competing Behavior Pathway#2: Prevention, Teaching, and Consequence Strategies#3: Implementation Plan#4: Evaluation Plan
10Evaluation PlanningThe team leader will ensure that the BSP includes an evaluation plan with:A short-term goal that is reasonable based on current performanceFocused on decreasing problem behavior and increasing Replacement behaviorA long-term goal focused on increasing desired behaviorSpecific activities/procedures that will be used to evaluate progressA specific date when the team will next meet to review progress
11Evaluation Planning: How Will We Measure Progress?? Behavioral Goal (Use specific, observable, measurable descriptions of goal)The team identifies:Short-term goalLong-term goalSpecific evaluation proceduresDate to meet and evaluate the effectiveness of the planWhat is the short-term behavioral goal?_________ Expected dateWhat is the long-term behavioral goal?Evaluation ProceduresData to be CollectedProcedures for Data CollectionPerson ResponsibleTimelineIs Plan Being Implemented?Is Plan Making a Difference?Plan date for review meeting (suggested within 2 weeks) ________________
13Evaluation Planning: Short- and Long-term Goals Short-term goalFocus on reducing problem behavior and increasing student’s use of the identified Replacement behavior &Use baseline data to develop a REASONABLE initial goal that student will be able to achieveShort term goal will CONTINUOUSLY be revised as student moves closer to achieving the long-term goalLong-term goalFocus on desired behavior & sustained reductions in problem behaviorBegin by reinforcing approximations of desired behavior13
14Developing Goals Goals should include the following components: ConditionStudentBehaviorCriterionMeasurement Plan
15Developing Goals Both short and long-term goals should: A. Be written in observable, measureable termsWhat specific behaviors will you increase/decrease?Increase use of Replacement BehaviorReduce Problem BehaviorIncrease APPROXIMATIONS of the desired behaviorB. Include specific mastery criteriaHow will you know when the student has met the goal?
16Measuring Reduced Problem Behavior via increased Positive Behavior Developing GoalsMeasuring Reduced Problem Behavior via increased Positive BehaviorShort-term GoalDuring Reading, when asked to complete independent writing tasks, (Condition) Jonas (Student) will work in his seat quietly OR appropriately request a break (Behavior) at least 70% of the time (Criterion) as measured by ratings on a daily point card (Measurement).Notice that the goal is stated positively (what to do) rather than negatively… reductions of problem behavior can be measured by monitoring the expected behavior
17Sample Short-Term Goal for Dexter Short-term: Dexter will:a) stay on task without leaving his seat or talking to peers about unrelated topics for at least 75% of independent work time, ORb) appropriately ask to work with a peer (or work independently) in Writing,c) complete at least 25% of his daily writing assignmentsfor 4 out of 5 days across 2 consecutive weeks.Decrease Problem BehaviorIncrease use of Replacement BehaviorIncrease Approximations of Desired BehaviorMastery Criteria17
18Example Goals for Leroy During Writing class, Leroy is currently engaging in problem behavior (throwing materials and cursing) to escape difficult tasks in Math approximately 4 days per week. On average, he is completing only 25-30% of his work in class.Behavioral Goals ( Always include mastery criteria )What is the short-term behavioral goal?During Writing, Leroy will ask appropriately for an easier task or for a “break” from difficult tasks without throwing materials or cursing at least 75% of the time as measured by a daily point card for 2 consecutive weeks.What is the long-term behavioral goal?Leroy will complete at least 80% of his assigned work in his math class with no more than 3 incidences of problem behavior (throwing materials, cursing) for 3 consecutive weeks.__5/1____ Expected dateShort-term goalIncrease Alt. Behavior & Reduce Problem Behavior+ Approximation toward Desired BehaviorLong-term goalIncrease Desired Behavior & Reduce Problem Behavior
20Is the Plan Making a Difference? FAQ: I see the student every day, why do I need to collect data?Answer: Data help us toDocument what has occurred and the variables responsiblePredict future performanceBe accountable for our own behaviorDetermine when program modifications are needed
21Balancing Accuracy and Feasibility The “quality” of the measurement system is irrelevant if no one uses it.How often will data need to be collected? How often does the behavior occur?How much time, effort will data collection methods require? Does this “fit” the context/setting?Are there forms that staff are already using (ex. point cards) that can be modified/used?Are implementers included when finalizing the measures to ensure feasibility?
22Measures for Tracking Student Behavior Considerations:Does the measure capture the specific tasks/target behaviors of interest?Was it a “good” or “bad” day? vs. How many talk-outs occurred during Spanish class today?Is the measure sensitive enough to change?Are we tracking specific student behaviors?
23Developing Data Forms Estimates vs. Real-Time Recording Consider using Scales or Ratings rather than Frequency Counts/Duration MeasuresEx. 0, 1-3, 4-5, 5+ incidents/minutes (circle one)
24Example Goals for Leroy During Writing class, Leroy is currently engaging in problem behavior (throwing materials and cursing) to escape difficult tasks in Math approximately 4 days per week. On average, he is completing only 25-30% of his work in class.Behavioral Goals ( Always include mastery criteria )What is the short-term behavioral goal?During Writing, Leroy will ask appropriately for an easier task or for a “break” from difficult tasks without throwing materials or cursing at least 75% of the time as measured by a daily point card for 2 consecutive weeks.What is the long-term behavioral goal?Leroy will complete at least 80% of his assigned work in his math class with no more than 3 incidences of problem behavior (throwing materials, cursing) for 3 consecutive weeks.__5/1____ Expected dateShort-term goalIncrease Alt. Behavior & Reduce Problem Behavior+ Approximation toward Desired BehaviorLong-term goalIncrease Desired Behavior & Reduce Problem Behavior
25Measuring the Short-term Goal During Science, LeRoy will ask appropriately for an easier task or for a “break” from difficult tasks without making inappropriate comments or throwing materials at least 75% of the time as measured by a daily point card.Measuring the Short-term GoalLeRoyFeb. 4thMeasure Decrease in Problem Behavior through focus on increasing Expected BehaviorsAsk teacher for break / easier taskUse Respectful LanguageUse materials appropriately
26Example: Rating Feasibility During Science class, LeRoy often makes inappropriate comments, pushes materials off his desk and refuses to do his work to escape difficult tasks.To evaluate the effectiveness of Leroy’s BSP, the team members have suggested that his teacher:Have participants rate using hand signals (i.e., thumbs up, thumbs down, thumb in the middle/maybe)Indicate at the end of each class period if LeRoy had ( 0, 1-3, or 4 or more ) instances of problem behavior
27LeRoy’s Weekly Data Chart During Science, LeRoy will ask appropriately for an easier task or for a “break” from difficult tasks without making inappropriate comments or throwing materials at least 75% of the time as measured by a daily point card.LeRoy’s Weekly Data ChartDateStaffStaff provided modified tasks & pretaught to ask for “break” or easy taskProblem behavior (inappropriate comments, throwing materials)Replacement Behavior (Student asked for break or easier task)yes noPlease complete at the end of each Science block
28Intermediate Goals: Approximations Leroy’s Short-Term GoalLeroy will ask appropriately for an easier task or for a “break” from difficult tasks without throwing materials or cursing at least 75% of the time as measured by a daily point card for 2 consecutive weeks.Leroy will ask appropriately for an easier task or for a “break” no more than 3 times during Math block with no more than 2 problem behavior incidents for 4 consecutive days .Leroy will ask appropriately to cross off up to 60% of difficult math problems and will have no more than 3 problem behavior incidents for 2 consecutive weeks.Leroy’s Long-Term GoalLeroy will complete at least 80% of his assigned work in his math class with no more than 3 incidences of problem behavior (throwing materials, cursing) for one month.
29Over time focus shifts to Long Term goal Focus will shift to work completionCalculate percentage of problems completed on class work daily & graphMonday = 15/20Tuesday = 11/12Wednesday = 14/15Thursday = 25/25Friday = 11/14
30Grant’s Weekly Data Chart When one of Grant’s teachers asks him to complete a folder task at his work station, Grant will often yell, tear up materials, and flop on the floor to avoid completing the task.Grant’s team has decided that during desk work, they will teach him how to use pictures to ask for a break or for an easier task. He will also have a visual reminder placed on his desk during this time.Grant’s Weekly Data ChartDateStaffStaff used visual cue (1st, then or schedule)Problem behavior (yell, destroy materials, flop)Replacement Behavior (Student used PECS book to communicate)yes noPlease complete at the end of each 20 min 1:1 work time block
31Activity #2 (page 89)When asked to read aloud or answer questions during small group reading lessons, Charlie makes inappropriate comments (e.g., “This is so stupid”), puts her head down on the desk and refuses to comply with any of the teachers directions. The FBA shows that this problem behavior is maintained by adult attention, and the team has decided to teach Charlie to raise her hand and ask appropriately for teacher help/attention.Develop: a) a short-term goal, b) an intermediate goal, and c) a long-term goal for Charlie.Make sure that you include:observable, measureable descriptions of behaviormastery criteria
32Evaluation Planning: How Will We MEASURE Progress? In addition to long- and short-term goals, the evaluation plan includes the specific data that will be collected to assess:Is the plan making an impact on student behavior?
33Evaluating the BSP: Role of Plan Implementers Collect fidelity of implementation data at least x per weekReport any difficulties in implementing the plan to the team leaderCollect data on student behavior at least x per week to assess progressIf problem behavior increases or escalates contact team leader immediately
34Is the Plan Being Implemented? Considerations When Developing Measures of Fidelity:Does the measure capture the specific tasks/target behaviors of interest?Is the plan being implemented?Did I implement the plan? vs. Did I check in with student and provide specific praise when she entered class?
35Manipulate Antecedent Example: SheldonDesired BehaviorSitting appropriately and responding with group during circle timeConsequenceFeeling of success, adult praise for appropriate behaviorRoutine: Circle Time on CarpetSetting EventNone IdentifiedAntecedentTeacher teaching to whole class or praising another studentProblem BehaviorMaking noises with mouth or hands, leaning on or grabbing others or materials, out of seatConsequence/FunctionTeacher reprimands, teacher takes to time-outAccess Teacher / Adult AttentionReplacement BehvRaise hand for adult attention or to answer a questionSetting EventsManipulate AntecedentTeach BehaviorAlter ConsequencesEliminate/Neutralize Setting EventsN/AEliminate/Modify Antecedents- Sheldon will sit in front of teacher / tape outline on carpet marking his spotWeighted vestFrequent adult attention/ stickers for appropriate behavior (at least 1 x per min)Prompt Alt/Des Behavior- Pre-teach on the way to circle time (model raising hand, “safe body”)Teach Replacement BehaviorTeach Sheldon to raise hand for attentionTeach what it means to have a “listening ears”Teach Desired Behavior/SkillsTeach appropriate sitting on carpet (use examples/non-examples; teach outside of circle time routine)RewardsSheldon will earn stickers and teacher praise for sitting appropriately (5 stickers will = teacher recognition in front of class)Teacher will quickly respond to and praise hand raisingResponse to ProblemAt first sign of problem behavior, remind Sheldon to raise his hand using visual cue only (minimize adult attention to problem behavior)Time out (no longer than 3 min), praise and bring back after several seconds of approp behv
36Example: Implementer Checklist QuestionsYes(everyday thisweek)Kind of(2-3days thisNo(0 daysThisNotables *1. Was the tape outline on the carpet marking Sheldon’s spot?2. Was Sheldon given a weighted vest at the beginning of circle time?3. Did I remind Sheldon what appropriate sitting/raising hand looks like at the beginning of circle time?4. Did I provide stickers for hand raising, and staying in seat?5. Did I minimize attention to problem behavior?6. Did I provide frequent attention for appropriate behavior?7. If Sheldon had to go to time-out, did I allow him to rejoin the group within 2 minutes?TOTALS
37Manipulate Antecedent Desired BehaviorWork with peers to complete group assignmentConsequence Success, sense of accomplishment, peer attentionRoutine: Social StudiesSetting EventStudent gets to school late and misses breakfastAntecedentAsked to complete a project with a group (2-3 peers)Problem BehaviorWhining and refusing to do workConsequence/FunctionStudent is told to go complete her work in the officeAvoids working with peersReplacement BehaviorAsk appropriately if she may work on the assignment aloneSetting EventsManipulate AntecedentTeach BehaviorAlter ConsequencesProvide a.m. snack on days when Maizey arrives late and misses breakfast.When passing out assignments provide student with a choice of working with a group or completing the assignment alonePlace a “reminder” card on student’s desk stating that she may ask to work alone at any point during the group taskExplicitly teach Maizey: a) when it is okay to appropriately ask for a break, and b) what “appropriately asking to work alone” looks like using examples and non-examplesProvide social skills training focused on how to work cooperatively with peers 3 x per weekRewardsStudent will be allowed to work alone when asks appropriatelyWhen Maizey works with peers for 15 min, she will be given the option to work aloneResponse to ProblemAt first sign of problem behavior, remind Maizey that she can ask to work alone.Student is told that she may work alone after she either a) asks appropriately, or b) completes one part of the task with peers
38Evaluation Procedures for Maizey Data to be CollectedProcedures for Data CollectionPerson ResponsibleTimeline(Implement as of 2/27)Is plan being implemented?-Verbal and visual prompts used- Pre-teaching “appropriate asking”-Rewards for app. behavior-Response to prob. behavior- Social Skills TrainingMiss Posey (school psych) to observe in classroomCollect daily-task checklistsCheck in with Miss Posey for progress in social groupsMiss PoseyMrs. RyanMrs. Foster1 x per weekCollect 3 x per weekIs plan making a difference?-# of instances of work refusal per week in social studies-Student use of hand-raising to request working alone- % group assignments completedTeacher notes # of occurrences per week in mathTeacher notes daily on behavior report cardTeacher grade book / permanent productsCheck in 3 x per weekDaily for 2 weeksWeeklyPlan Review Date 3/14/0538
39Activity #3 (page 91)Using the summary statement and strategies provided for Kelly on pages in your guide, work with a partner to determine/describe:What SPECIFIC student behaviors will you collect data on?
40Manipulate Antecedent KellyDesired BehaviorStay in seat, sit quietly, complete assignmentsConsequenceTeacher acknowledgementRoutine: Math, WritingSetting EventAltercation/ reprimand on the bus on way to schoolAntecedentAsked to complete desk work independentlyProblem BehaviorTalks out, makes noises, talks to/makes faces at peers, out of seat/walks aroundConsequence/FunctionPeers talk back / laugh or tell him to leave them aloneObtain Peer AttentionReplacement BehaviorRaise hand and ask to work with peerSetting EventsManipulate AntecedentTeach BehaviorAlter ConsequencesEliminate / NeutralizeOn days when an altercation on bus has occurred, Kelly will be given a job/task to do with peer before beginning work (ex. carrying books down to office)Eliminate / Modify AntecedentsProvide modified assignments that are broken down into stepsGive specific praise often in front of peersHave Kelly sit in front of teacher / away from distracting peersPrompt Replacement/Desired BehvAt beginning of independent work, remind Kelly that she can earn time with peers for being on task (point sheet on desk)Teach Replacement BehaviorTeach Kelly how and when to raise hand and ask to work with peer (use examples and non-examples)Teach Desired Behavior / SkillsExplicitly teach what on-task behavior looks like(Teach whole class how to ignore problem behavior)RewardsKelly will be allowed to work with a peer if she raises her hand and asks appropriatelyShe will earn points for staying on task that can be exchanged to earn free-time with peersResponse to ProblemAt first sign of problem behavior, redirect to alternative behaviorRemind peers to ignore problem behavior and ask Kelly to work away from the group
42Meeting to Review the Plan The plan is a WORKING DOCUMENT!Team members meet regularly to:a) Monitor progressb) Modify the plan as needed to:Make the plan more effectiveorChange mastery criteria and increase student independence
43Review Meeting: Role of the Team Leader Guide team in reviewing DATA for each component of the plan to document:1. Is each strategy being implemented as designed?2. Is the plan resulting in change in student behavior?3. Do data indicate that the plan needs to be modified and how?4. What is the date of the next Review Meeting?
44The Implementation Plan is used to record: 1. The extent to which the plan is being implementedand…2. Team evaluation decisions made, based on the data presented at the meeting: 3/21/11Add more multi-digit problemsMonitorMonitorCompleted/ Discontinue78
45Insert data graph – example of data for student outcomes
46Barriers to Implementation Questions to ask if plan is not being implemented:Do implementers understand how and when to use strategies?Have implementers been provided with a way to measure implementation?Are strategies feasible in the natural setting?Are there ways that plan can be modified to make implementation more likely?*Note: If the plan is not being implemented with fidelity, we can not assess if the plan is working.
47Barriers to Plan Effectiveness Questions to ask if progress is not being made:Is plan being implemented regularly and accurately?prevention, teaching & reinforcement strategies?Is student Consistently being rewarded for alt/des behavior? How often?Are reinforcers for alt/des behavior “powerful” enough? Are reinforcers functionally equivalent?Is the Problem Behavior still being Reinforced?Remember: we must minimize pay-off for problem behavior for new appropriate behavior to “compete”
48The Plan is Working! Now What?? The student is making progress, but has not yet met the short term goal.Continue plan and progress monitoringThe student has met the short-term goal!!Create a new short-term goal that more closely approximates the desired behavior and ASK:Can we expand the plan/implement in more contexts?Can we being fading antecedent prompts and modifications?Should we start fading and/or modifying rewards?Are there strategies that we can use to increase the student’s monitoring of his or her own behavior?
49Key Points An EVALUATION PLAN for determining A) if the plan is being implementedB) if the plan is making a difference in student behaviorC) when team members will meet again to discuss progressBoth the Team Leader and Team Implementers collect Fidelity and Effectiveness data regularly.The Behavior Support Plan is a Work in Progress!!!Team members meet every to weeks to determine:Is the BSP being implemented as agreed on by the team?Is the student making progress?Do we need to modify the plan to:Improve effectivenessIncrease student independence?When is the date of our next meeting?49
50Check #3When developing a BSP evaluation plan, short-term goals should focus on increasing the student’s use of:The Replacement BehaviorThe long-term goal focuses on increasing:Desired Behavior/Skills
51Check #2Edgar’s team has met to review his progress since implementing the BSP.The data show that Edgar’s problem behavior has not decreased in the past 2 weeks.What is the first question that Edgar’s team should ask?Is the plan being implemented??
52Check #3 Go to page 105 in your guidebook. In teams of 3, please select a sample scenario and use the forms provided in your guidebook (pages ) to build a complete student BSP.
53Example #1: CharlieAt the end of “free-choice” time, when asked to transition back to her desk, Charlie verbally refuses, cries, and falls to the floor to avoid transitioning to a less preferred activity. This is most likely to occur on days when Charlie does not take her medicine before school. Charlie’s “tantrums” occur 3-4 times per week and can last up to 10 minutes.
54Example #2: GarretDuring large-group instruction in Math, when students are asked to attend to the materials being projected on the screen at the front of the class. Garrett often turns around in his chair, gets out of his seat and walks around the room, and makes comments to or faces at peers. FBA data show that his behavior is mostly likely maintained by peer attention. Garrett is currently off-task approximately 85% of the time during large-group and he is turning in less than 50% of his math assignments.
55Task Over the next two weeks… Please meet with team members at your school to develop a student plan based on FBA results.Your role as Team Leader will be to guide the team through the questions on pages 101 and 102 in your workbook and to ensure that the plan is:Complete (don’t forget about implementation and evaluation plans!)Function-BasedContextually Relevant5555
56Comments/Questions about Module 7 At the bottom of page 109 please write any comments/questions you may have pertaining to this module.Thank you for your time & attention!5656