Behavior Plan Practicum: Developing and Scoring High Quality Behavior Plans Diana Browning Wright, M.S, L.E.P, Behavior Analyst Director-Ca. Dept. of Education- Positive Environments, Network of Trainers Education Consultant-LRP Legal Publications www.pent.ca.gov dianawright@earthlink.net All you need to know about me Agenda – 2 breaks, lunch, model team approach Packet review Norms –ask questions about content – “I have a student who…” take care of your personal needs RAISED HAND MEANS CALL TO ORDER
Positive Environments, Network of Trainers P E N T www.pent.ca.gov Your one stop shop!
Objectives Practice using the BSP Quality Evaluation Scoring Guide Be prepared to lead site teams To see if the principles, concepts, methods and requirements are all present
Are you a dog person? Raise your HANDS Why? What is it you like about dogs? Loyal Obedient Loving companionable
Or a cat person? Raise hands. Dog people: What don’t you like about cats? independent, Do what they want Don’t care what you want Egocentric How many prefer dogs? WELL,
In every classroom you get both In every classroom you get both! But in your program, you may have ALL Cats!
Come Spot, Come!
Here Kitty, Kitty!
Average Day for a Teacher
“Humiliation Protection” Affects Coping Skills The number one step in effective support of diverse learners, e.g., learning differences, cultural or subcultural differences, language learners and learning disorders The student must feel entirely safe from humiliation and its lethal effects excessive negative comments conspicuous negative comments policies that openly expose or stigmatize
Humiliation Protection Strategy Why use “Humiliation Protection”? Leads to Development of Resilience and Carl and Fred Relationships Why not just use fast, negative practices? They result in serious complications behavioral motivational affective …AND THEY DON’T WORK!
Do You Protect Us?
What about us?
Learning disabilities Drugs in home Resilience Absent parents Thriving in life despite risk factors 40 Developmental Assets Model See www.search-institute.org Poverty Learning disabilities Disturbed parents Poor peer models Violence exposure Mental retardation
Behavior Support Plans Why? It’s the law! It is best practice It improves outcomes It increases staff morale Audience –Read along w/ me p.1 Ideally, BSP is what you do BEFORE the beh occurs Every student is entitled to FAPE. Any beh which interfere with the learning prcess so that all may benefit Shall=must Intervention = bsp “Proacttive acton planning to address behaviors that are impeding learning Another reason why……………… (Pg 2 goes into greater detail re: fed & state law)
Beginning with IDEA 1997….. Behavior impeding learning of student or peers Strategies, including positive behavioral interventions, strategies and support Public agency shall ensure that each teacher and provider is informed of their specific responsibilities to accommodate, modify and support…. 45 day placement: services to be sure behavior doesn’t reoccur
Continuing with IDEA 2005; Regs 2006….. Behavior impeding learning of student or peers Strategies, including positive behavioral interventions, strategies and support (removed, but comments state it is ASSUMED we do this-- Public agency shall ensure that each teacher and provider is informed of their specific responsibilities to accommodate, modify and support…. During any 45 day placement: services to be sure behavior doesn’t reoccur
Behavior Support Plans - Why? To improve teacher attendance “I know the kids don’t like you and they pick on you, but you have to go to school… you’re the teacher!”
Behavior Support Plans For whom? Ultimately, to remove barriers to academic success: Any student who needs one! Tier 1: positive techniques for all Tier II: team-developed individualized positive techniques; add BSP if needed Tier III: highly individualized, multiple services and well designed, continuous data I like this picture because it represents that support must be provided threshold to threshold BS is Mandated for Special ed under IDEA whenever the student exhibits difficult behaviors the IEP team must address the situation in a behavior plan. It doesn’t have to be THIS behav plan but are suitable for all students.
Behavior Support Plans Who makes up the team? Everyone relevant to the implementation Legal requirements for IEP and 504 Depends on the specific needs of student. Reg ed, an admin, parent, counselor, student study team, 504 team, IEP team
In a lot of plans I see, it is impossible to tell what to do.
Differences Behavior “management” reactive Behavior “support” proactive
Looking at Behavior Management vs. SUPPORT ABC dance SIGNS- HAND OUT. HERE’S THE BEHAVIOR EG, CALLING OUT – FOCUS ON CONSEQ, EITHER PUNISH (TAKE AWAY PRIVILEGES) OR Reinforce – give check marks when he raises his hand. But ignoring the function – e.g. calls out because of great anxietly, or to get peer attention, or to derail a hard lesson, or to obtain teacher attention Old way – all the time spent on C Consequence based plan depends on the assumption that a strong enough, tho legal, punishment, or a strong enough, tho legal, reinforcer can be found to change a behavior e.g. extreme case scenario: severely disabled adolescent boy who frequently masturbates. What punisher – restraints? What reinforcer? – M&Ms? AS OPPOSED TO LOOKING AT FUNCTION TO DETERMINE WHAT PURPOSE A BEHAVIOR SERVES TO THE STUDENT
That surly teen with attitude… I look for tips when I’m in classrooms. One teacher told me how he dealt with this problem with his ED high school students (many cats in one class). He remembers that
was once….. Have the students bring in baby pictures. Even the most hardened teenager has a soft spot for his own baby picture.
Behavior Support Plans Focus on… SUPPORT vs. Management Management is a focus on CONSEQUENCES (+ or -)like a GIRDLE – something slips out Support focuses on TEACHING, ENVIRONMENT, + POSITIVE REINFORCEMENT like support hose - gentle
Behavior Support Plans Focus on… FUNCTION vs. Consequences ABC dance SIGNS- HAND OUT. HERE’S THE BEHAVIOR EG, CALLING OUT – FOCUS ON CONSEQ, EITHER PUNISH (TAKE AWAY PRIVILEGES) OR Reinforce – give check marks when he raises his hand. But ignoring the function – e.g. calls out because of great anxietly, or to get peer attention, or to derail a hard lesson, or to obtain teacher attention Old way – all the time spent on C Consequence based plan depends on the assumption that a strong enough, tho legal, punishment, or a strong enough, tho legal, reinforcer can be found to change a behavior e.g. extreme case scenario: severely disabled adolescent boy who frequently masturbates. What punisher – restraints? What reinforcer? – M&Ms? AS OPPOSED TO LOOKING AT FUNCTION TO DETERMINE WHAT PURPOSE A BEHAVIOR SERVES TO THE STUDENT
Behavior Support Plans Focus on… ANTECEDENTS vs. Consequences ABC dance Antecedent based plan result in environmental change + student skills acquisition What in the environment contributed to the behavior Change of the use of the word consequence to what S gets from behav instead of how the staff can control the punishment or reinforcement
Behavior Support Plans Focus on… TEACHING vs. Controlling Teach positive behavior: model shape cue in a conducive environment. Possibility for LASTING change vs. Controlling and eliminating without regard for environment or skill deficit
QUALITY BSPs All effective plans address both the environment and the function of the behavior Change environments to eliminate the need to use this behavior Teach alternative, acceptable (replacement) behaviors which allow student to get or reject something. The new behavior still has to meet the old behavior’s need. e.g., if throwing the spelling paper off the desk was a protest, replacing the page with a shorter page doesn’t satisfy the need to protest. You can decrease the need to protest but must offer an acceptable manner to protest. l
Multiple Purposes for a Scoring Guide Use to train staff on the key concepts of applied behavioral analysis
Multiple Purposes for a Scoring Guide Use to improve the quality of BSPs AS they are being written
Multiple Purposes for a Scoring Guide Use when a BSP has not been successful.
Multiple Purposes of a Scoring Guide Use to keep proper focus balance between positive behavioral interventions and potential future disciplinary considerations.
Multiple Purposes for a Scoring Guide Use to improve your ability to legally defend the team’s Behavior Plan.
BSP QE: What is it? Measures the extent to which the 6 consensus criteria components of effective positive behavior support are present in a behavior plan Produces scores of Adequate (Good or Superior 24-17 points) or Inadequate (Underdeveloped to Weak 0-16 points) Examines 12 areas for quality and internal consistency
BSP-QE evaluates 6 Keys Behavior serves a purpose Behavior is related to environment BSPs should address both purpose (through replacement behavior) and environment (remove need for problem behavior to attain the goal)
BSP-QE evaluates 6 Keys New behavior must be taught (or elicited) and reinforced Reactive strategies should be described (cue replacement behavior taught, specify how to handle the problem behavior, debrief following the behavior, consequences [if required]) Communication should be two-way between team members and stakeholders, specifying manner, frequency and nature of the communication
The “Behavior Support Plan Quality Evaluation Scoring Guide© - II” A Scoring Rubric developed by Diana Browning Wright, G.Roy Mayer Dru Saren
The “Behavior Support Plan Scoring Guide© - Revised” Quality Evaluation Scoring Guide© - Revised” A Scoring Rubric Developed following input from the PENT Cadre at the PENT SUMMITS, 2003 Further field-tested by 55 CSULA Graduate Students in Advanced Behavior Analysis
What IS the Positive Behavior Support Process ? A data-driven team approach with built-in accountability Follows a carefully look at the context of the problem behavior Hypothesizes why the behavior is occurring. Develops a plan to teach the student a replacement behavior and new skills Changes environments to match student needs Involves people who really care about the student Develops a written plan capturing the team’s decisions and methods “Positive Behavior Support” is a conceptual approach that is rapidly changing how we approach problem behavior. By focusing on the following approaches and key concepts, even behaviors that have been occurring for a long time can be changed. These concepts are radically different from reduction approaches that simply try to either punish the student for the behavior, or reward the student if s/he stops the problem behavior.
This team cannot develop effective BSPs.
Positive Behavioral Support Principle: Behavior serves a purpose for the student. All behaviors, including problem behavior, allow the student to get a need met (i.e., behavior serves a function). Although all functions are legitimate and desirable, the method or form of the behavior may require alteration.
Key Concept: This behavior has worked in the past, or it is currently working to either: get something the student desires or avoid or protest something the student wishes to remove.
Why? Review Function Chart in packet
Development counts! See charts
Requirement: A behavior plan must identify the function of the problem behavior. This is necessary in order to develop a plan that teaches an alternative replacement behavior that serves the same function.
Method: Observing the student in the problem situation and interviewing others who are frequently present when the problem occurs is required. Focusing on the student’s facial expression and the response of others often yields cues as to what the function of the behavior may be.
Examples of functions of behavior: Billy Billy throws his work on the floor because it is hard work for him. When he does this, his face shows anger and frustration. His actions are a protest.
Examples of functions of behavior: Dolores Dolores giggles and disrupts peers around her because she enjoys the attention and reactions she gets and her face shows pleasure and excitement. Her actions are to get social attention, even when that attention from peers is one of displeasure and disapproval.
Bruce Examples of functions of behavior: Bruce uses swear words not related to what is going on around him. His face shows pleasure and excitement and he uses these words as a method of starting a conversation, e.g., his peers immediately tell him not to use these words and start conversing with him about the use of appropriate language. His actions are to get social interactions started.
Function of Behavior: See supplementary handouts Complete the activity in teams get something the student desires or avoid or protest something the student wishes to remove.
Positive Behavioral Support Principle: Behavior is related to the context/ environment in which it occurs. Key Concept: Something is either present in the environment, or NOT present in the environment which increases the like- lihood the problem behavior will occur.
Requirement: The behavior plan must identify what environmental features support the problem behavior. This is necessary in order to know what environmental changes will remove the student’s need to use the problem behavior to achieve something he or she desired.
Method: Observing the student in the problem situation and interviewing others who are frequently present when the problem occurs is required. Focusing on everything going on around the student, the nature of the instruction, interactions with and around the student, and the work output required by the curriculum is necessary to understand why the student uses this problem behavior in that particular place, at that time.
Examples of context/environment impact on problem behavior: Billy Billy has NOT YET received support to complete difficult work. He throws math or reading worksheets that appear long and hard to him on the floor.
Examples of context/environment impact on problem behavior: Dolores Dolores has NOT YET received direct instruction on how to appropriately make and keep friends. Her peers reinforce her behavior inadvertently by their strong responses. Her peers have neither learned how to reinforce her for appropriate behavior, nor learned how to change their loud expressions of disapproval in response to Dolores’ behavior.
Examples of context/environment impact on problem behavior: Bruce Bruce has NOT YET received instruction on how to initiate social conversation without the use of his attention-getting swear words. His peers have not learned how to direct Bruce to use the alternative method of attention-seeking rather than giving him attention by correcting him for his attention-seeking behaviors. They will be important in shaping a new behavior.
Positive Behavioral Support Principle: There are two strands to a complete behavior plan. Key Concept: Changing behavior requires addressing both the environmental features (removing the need for use of problem behavior to get needs met) AND developing a replacement behavior (teaching a functionally-equivalent behavior that student can use to get that same need met in an acceptable way).
Requirement: A complete behavior plan must address both strands: make environmental changes that support acceptable behavior, AND specify how to teach or elicit functionally equivalent acceptable behavior and new skills.
Method: Writing an effective two strand plan requires a collaborative team that includes plan implementers and other important, supportive people in the student’s life such as family members, any agency personnel (e.g., social workers, mental health providers, probation officers) and of course the student if his/her participation is possible.
Examples of two strand, complete approaches: Billy Billy’s team decided, and his teacher agreed, that she will alter his assignments so that hard work will not appear overwhelming to him (remove need to protest). Billy will be taught an acceptable protest for work that appears difficult, such as calling the teacher over and telling her the work appears long and hard (functionally- equivalent alternative behavior).
Examples of two strand, complete approaches: Dolores Dolores’ team, decided she will receive instruction on how to make and keep friends. Her peers will receive instruction in how to calmly redirect her to use appropriate interactions to achieve their brief expressions of approval (remove need to get social attention in maladaptive ways). Dolores will learn brief interactions during work periods that result in social approval from her peers, yet do not disrupt others (get social attention with functionally-equivalent alternative behavior).
Examples of two strand, complete approaches: Bruce Bruce’s teachers will provide collaborative learning opportunities that allow Bruce to be in sustained social interactions with his peers (removes need to use swear words to start a social interaction). Bruce will be taught specific social interaction initiation techniques and his peers will be taught how to prompt him to use these techniques (functionally equivalent ways of starting a social dialogue).
Requirement: The behavior plan must specify reinforcement for the new functionally equivalent behavior. The behavior plan may also wish to specify general reinforcement for positive behaviors as well. Often a general lack of reinforcement available for following class rules will increase a wide range of problem behaviors. When reinforcement is given to all students for a wide range of positive behaviors, dramatically decreases in problem behaviors occurs.
Positive Behavioral Support Principle: New behavior must get a pay-off as big or bigger than the problem behavior. Key Concept: To achieve maintenance of a new behavior, it must be reinforced. Reinforcement is actions we take, privileges or tangibles we give, that the student really wants to get, and therefore he/she does the behavior again and again to get that reinforcement.
Shape Model Cue
Shaping Defined Reinforcing closer and closer approximations to an end goal
Shaping
5:1 Gets the job done!!!
Class wide Systems to Cue, Shape and Model Behavior: Strategies for Teachers Stop & Think Stop! Think… Make a good choice? Make a bad choice? What are you going to do? Make a good choice! Pat on the back STOP AND THINK
What is fair? Fair is not everyone getting the same thing. Fair is everyone getting what they need.
Reinforcement Considers: Power Frequency Variety Immediacy Reinforcer: evidence present that it will change behavior Reward: guessing it will change behavior
Method: Find out what the student typically seeks in the environment. Ask the student and observe him/her in the situation or have the student complete a “reinforcement survey” of things s/he would want to earn. Does she like computer games? Adults to praise her work? Opportunities to be first in line? Make access to the reinforcer you discover contingent on performing the desired behavior. Parental reinforcement for progress should also be considered.
Examples of Reinforcement of Replacement Behavior: Billy Billy’s teacher will praise his use of the new form of protest behavior his behavior plan suggests, i.e., calling her over to tell the teacher the work looks hard. (Efficacy evidence: Billy’s classroom and home behavior shows he is really pleased by any positive attention from adults.) She will also send home daily report cards describing his use of the new behavior and Billy’s parents will amply praise his new skill at home.
Examples of Reinforcement of Replacement Behavior: Dolores Dolores’ circle of friends will meet daily for 5 minutes at recess to praise Dolores for her quiet, quick checking in with them during a work period that does not disrupt work. Dolores and her friends will all receive points toward lunch with the teacher for their teamwork and support of each other. (Efficacy evidence: Dolores and her friends chose this reinforcer at the beginning of the intervention, telling the teacher how much they wanted the opportunity to be in the “lunch crew” they had observed other students earning).
Examples of Reinforcement of Replacement Behavior: Bruce Bruce’s friends will award him “friendly talking” points and a “high five” gestural acknowledgement each time he tries to start a conversation using the language scripts he has been taught. The teacher will allow Bruce to choose from a menu of tangible and activity reinforcers for every 10 points earned. (Efficacy evidence: Bruce loves the high fives from adults and peers and says he wants to earn the variety of reinforcers on the list).
Positive Behavioral Support Principle: Implementers need to know how to handle problem behavior if it occurs again. Key Concept: The behavior plan must specify reactive strategies across four stages: 1) Beginning stage: Prompting the alternative replacement behavior;
Just Try Ignoring Him! Try ignoring him.
Key Concept: The behavior plan must specify reactive strategies across four stages: 2) Mid-behavior stage: The problem behavior is fully present and now requires staff to handle the behavior safely through an individualized, careful deescalating of the behavior. This might include specific techniques, calming words, presenting of choices, distraction, and redirection. Each technique will likely be unique to the student. What has worked in the past is important to discuss. Some staff deescalate the student better than others and this should be considered.
Key Concept: The behavior plan must specify reactive strategies across four stages: 3) Problem-solving/Debriefing stage: Debriefing with the student is to review what happened, practice the alternative behavior again, and plan what to do next. 4) Required consequences stage: Clearly written consequences or other team determined actions because of the behavior are important, e.g., school and district disciplinary required actions; calling parents; notifying probation department; attendance at special seminars, detention, and so forth.
Requirement: All implementers must be clear on specifically how to handle behavior to assure safety of all and that the intervention matches the stage of escalation. Method: The behavior team will need to discuss what has worked in the past to alter the problem behavior, and what interventions are required at all four stages of problem behavior.
Example of reactive strategies: Billy Billy’s Behavior Support Plan includes the four stages of reactive strategies as follows: 1. Beginning Behavior Stage: Use gestures Billy has been taught that are cues to Billy to use the alternative protest, i.e., call the teacher over to protest hard work. Follow the “Stop and Think” gestural system taught to teachers and students at this school. Howard Knoff, Stop & Think Social Skills Program, www.sopriswest.com
Example of reactive strategies: Billy Billy’s Behavior Support Plan includes the four stages of reactive strategies as follows: 2. Mid-behavior Stage: Increase proximity to Billy, point to the work on the floor, get on eye level, use calm voice requiring work to be replaced on desk, wait patiently for compliance and praise in accordance with the teacher training on “4 step procedure-One Minute Skill Building (reinforcement sandwich).” If Billy is too agitated to work, invite him to take a “Time Away” in a specified classroom area. Praise his return when he is ready to work.
Phase B: Correction Strategies Time Away
Time Away Differentiated from Time Out Time away: Student decides to leave vs. Time-out: Teacher forces students to leave Time away: In the classroom Time-out: Out of the classroom
Time Away Differentiated from Time Out Time away: Gives freedom, builds relationships vs. Time-out: Results in side effects of punishment: fight and flight
Time Away Differentiated from Time Out Time away: Teacher thanks student when he/she returns vs. Time-out: Teacher frequently reprimands hen he/she returns Time away: Puts responsibility for behavior on student Time-out: Puts responsibility for behavior on the teacher
Australia Go through customs Declare baggage you are bringing in Log arrival and departure times
5 Rules of Responding 1. Don't direct peer pressure to a misbehavior publicly when the matter can be handled gently in private. 2. Do move toward the student creating an aura of personal contact. 3. Develop nonverbal cues. 4. Identify the misbehavior after the reprimand and direct the student toward the desired activity. 5. Direct the sanction to a specific person.
Ten Variables that Affect Compliance 1. Stop Using a Question Format. 2. Reduce Distance. 3. Achieve Eye Contact. 4. Limit to Two Requests. 5. Reduce Loudness of Request. 6. Give the Student Time. 7. Cue alternative. 8. Flat tone, words spaced 9. Describe minimal compliance to exit. 10. Reinforce.
Building Instructional Control Correction Strategy 4 Step Procedure - Reinforcement Sandwich Building Instructional Control Reinforce earlier behavior State inappropriate behavior with calm voice (“Just now, you…”) State appropriate behavior with a dangling sentence Require response Require performance Reinforce compliance
Example of reactive strategies: Billy Billy’s Behavior Support Plan includes the four stages of reactive strategies as follows: 3. Debriefing Stage: Ask Billy why he chose the old form of protest rather than his new alternative. Have Billy help fill out the daily report card communicating the poor choice he made and what Billy and the teacher will do next time to help assure the new behavior to protest is selected.
Example of reactive strategies: Billy’s Daily Report Card
Example of reactive strategies: Billy Billy’s Behavior Support Plan includes the four stages of reactive strategies as follows: 4. Consequences Stage: If the behavior escalates to loud swearing, Billy will be sent to the counselor to complete a written process, “My Inappropriate Behavior,” which may or may not result in a suspension or other school disciplinary procedures given by the Vice Principal for the disruptive behavior.
The “flight attendant” approach Maintain instructional control Maintain stimulus control Build behavioral momentum
Instructional Control Following any direction given by a teacher.
Doing what I should be doing in that setting Stimulus Control Doing what I should be doing in that setting (e.g., doing seatwork at my seat)
Building Behavioral Momentum First some irresistible tasks, then follow with less desired
Behavior correction that minimally disrupts the “flow of instruction” Maintains the relationship Allows time for compliance Delivers precise commands If you ask me what to do about a kid being ‘off task’, my first response is going to be, ‘What's the task?’" (Alfie Kohn)
Mentorship for Students with Difficulties Unconditional positive regard and support Goal: The mentored student feels, “He/she cares about you all the time, not just when I behave acceptably” Coaching the student to: think through the situation discuss better ways to handle the situation Coaching may include: practice for future situations a paperwork process , role playing, or simple verbal dialogue
Mentor’s Duties Provide unconditional love and support Meet with the student regularly Check on work, effort, attitude, grades Offer friendship and guidance Assist student in understanding the school’s position Help school staff understand any of the student’s extenuating circumstances
Mentor’s Duties Provide respite/”safe haven” Serve as an alternative to study hall or independent study when appropriate Use praise/other reinforcers to recognize achievement, growth or effort Support success Care!
Example of reactive strategies: Billy’s “My Inappropriate Behavior”
Positive Behavioral Support Principle: On-going communication needs to be between all important stakeholders in the student’s life. Key Concept: The behavior plan must specify who communicates with whom, how frequently and in what manner. Two-way communication between message senders and recipients is important.
Requirement: The communication needs to be frequently enough to result in the continuous teaming necessary to achieve success. Method: Communication ideas: sent home in writing, through messages on email or voice mail, through posting on a teacher’s answering machine in school (if information can be communicated in codes to assure confidentiality) or face-to-face.
Example of Communication between important stakeholders: Billy Billy’s team decided on the following communication provisions: 1. Communication between: parents, teacher, school counselor, therapist from Department of Mental Health, school principal
Example of Communication between important stakeholders: Billy’s team decided on the following communication provisions: 2. Frequency: a. Daily: Report card on use of replacement behavior will be sent home; parents report back on praise or other reinforcers for accomplishment they gave Billy each day. b. Weekly: Teacher will send weekly summary of Billy’s behavior to principal, school counselor, parents and therapist through email
Example of Communication between important stakeholders: Billy’s team decided on the following communication provisions: 2. Frequency: c. Per Incident: Episodes of protest that include throwing furniture or loud swearing will be reported to the school counselor, who will debrief and send “My Inappropriate Behavior” analysis sheet to the principal, therapist, family, teacher. Therapist and parents will communicate any discussions with Billy about the incident which have yielded important insights about future interventions to counselor, who will inform others as needed.
Example of Communication between important stakeholders: Billy’s team decided on the following communication provisions: Manner: a. Daily: written report hand carried by Billy to parents b. Weekly: email summaries using a report chart c. Per Incident: paper copy to principal, teacher. Email scanned copy to therapist, family
What does the BSP QE measure? Extent to which this plan reflects a team developed plan in alignment with principles of behavioral change from the field of applied behavior analysis Those are the behavior change principles we just reviewed !
What the QE does NOT measure
What the QE does NOT measure Whether the new behaviors, interventions, environmental changes, and reinforcers fit the student Whether this plan is developmentally appropriate for this student Asking Mikey to eat in the cafeteria
Who is this student? Current developmental stage Skill mastery levels Personality, temperament, and other unique characteristics Team members must know the student well to develop an effective plan Asking Mikey to eat in the cafeteria
What the QE does NOT measure Whether the hypothesized function is correct
What the QE does NOT measure Whether the plan was or will be implemented consistently and skillfully
The BSP QE Analysis Areas _____ A. Problem Behavior _____ B. Predictors of Behavior _____ C. Analyzing What is Supporting Problem Behavior _____ D. Environmental Changes _____ E. Predictors Related to Function _____ F. Function Related to Replacement Behaviors _____ G. Teaching Strategies _____ H. Reinforcement _____ I. Reactive Strategies _____ J. Goals and Objectives _____ K. Team Coordination _____ L. Communication _____ Total Score (X /24)
The BSP QE Analysis Results Fewer than 12 points = Weak Plan This plan may affect some change in problem behavior but the written plan only weakly expresses the principles of behavior change. This plan should be rewritten. 13 – 16 points = Underdeveloped Plan This plan may affect some change in problem behavior but would require a number of alterations for the written plan to clearly embody best practice. Consider alterations. 17 – 21 points = Good Plan This plan is likely to affect a change in problem behavior and elements of best practice are present. 22 – 24 points = Superior Plan This plan is likely to affect a change in problem behavior and embodies best practice.
Layout of the Scoring Guide Area Eval-uated & BSP Line A-L Scoring Criteria 0-2 Actual Examples Student who refuses to do work Key Concepts Clarify scoring or extend your understanding
Scoring Suggestions Look at the criteria for 2 first. If it’s not met, look at 0. Figure a 1 from there.
Scoring Problems IGNORE IT!! When there is lots of extraneous information, such as curriculum adaptations not relevant to the problem behavior IGNORE IT!!
Scoring Problems “Logically related” means that you can grasp the connection between the items. DON’T OVERANALYZE!
Scoring Suggestions Score leniently if you have reason to believe that the principles and key concepts are there.
Scoring Problem Writing a “gold standard” goal and objective in the era of accountability 6 Key Components for Scoring A Complete Goal or Objective 1.) by when 2) who 3) will do what 4) under what conditions 5.) at what level of proficiency 6.) as measured by whom, and how?
6 format for increase and decrease By when Who Will do what Under what conditions At what level of proficiency as measured by whom and how
Expanded: 9 format for FERB By when Instead of x behavior For the purpose of y Who Will do what (new behavior) Under what conditions At what level of proficiency As measured by whom and how
Example Goals: adequate/inadequate? Why? See bsp-qe p. 19 Decrease type: 1. Mike will stop fighting on the playground STOP—WAIT FOR INSTRUCTIONS FROM DIANA Increase type: 2. By 1.04.07 Mike will use appropriate behaviors on the playground - STOP—WAIT FOR INSTRUCTIONS FROM DIANA
Example Goals: adequate/inadequate? Why? See bsp-qe p. 19 Functionally equivalent type?: By 1.04.07 Mike will substitute appropriate behaviors (seeking help, walking away or verbally problem-solving as taught by the counselor) in lieu of physical aggression as measured by counselor observations and recording on an IEP team designed record sheet for 90% of yard observations.
Hint Write all goals using a chart format See bsp-qe p. 19 See behavior goal manual (www.pent.ca.gov)
Activity- See Handouts Scoring “Mario’s” BSP gang affiliation threatened peer expulsion considered but didn’t “pass” manifestation determination placement changed
BSP How To
Scoring activity rules Minimum: 3 person team—maximum 6 person team Assign yourselves roles ALL: Review “components to evaluate” column ALL review “key concepts” column A. Restates, in own words for group ALL review “scoring” column B. Restates, in own words, for the group ALL read Mario’s line statements ALL read “examples” column C. Lead discussion as to why it scores X rather than Y D. Records team reasoning and score
What’s the research? PENT 2003-2006 Develop a quantifiable approach for comparison of plans Determine best teaching methods
Training Improves Plan Quality Superior 6% Superior 18% Weak 16% Good 36% Weak 30% SUMMIT Pre-Summit Plans Post-Summit Plans Underdeveloped 19% 2002 2003 Good 47% Underdeveloped 28% These changes are statistically significant! χ2 = 15.64***
Effects of Training on Quality of Plans
Percentage Change in Plan Quality
Relationship Between Component Scores and Plan Quality Chi Square = 54.22***
Relationship Between Component Scores and Plan Quality Unlike the component of behavioral goals, if individuals receive a score of 1 on environmental changes it is likely that their plan will be in the inadequate range. These results indicate that the quality of specification of environmental changes is a good indicator as to whether the team or person responsible for the plan’s development sufficiently understands the how to develop or the purpose the BSP is supposed to serve. On average Chi Square = 39.22***
GOOD NEWS: Additional Improvement in the Quality of Positive Behavior Support Plans with Additional Training!! Changes in Plan Quality Following Second Round of BSP-QE Weak 7% Plans Turned in for Forum 2005 Weak 16% Superior 18% Good 47% Underdeveloped 19% Underdeveloped 17% Superior 34% Second Round of BSP-QE Training Plans Turned in for Form 2006 Good 41% χ2 = 15.64*** These changes are statistically significant!
Percentage Change in Plan Quality PENT 2005-2006
Comparison of plan quality with no training, Six key concepts training, Round one training on BSP-QE, and Round two training on BSP-QE 11% Adequate 42% Adequate 65% Adequate 75% Adequate BSP-QE Training Round 1 BSP-QE Training Round 2 6 Concepts Training No Training 89% Inadequate 58% Inadequate 35% Inadequate 25% Inadequate
Implications: What have we learned? Additional Forum training using the BSP-QE was associated with significant improvements in the quality of positive behavior support plans. The mean plan score was 18.57, indicating that, on average, PENT Cadre members developed plans in the Adequate range. The greatest amount of change was seen in the increase of plans into the “Superior” category. 34% of the plans were rated as “Superior” compared to only 18% a year earlier.
Comparison of Component Scores PENT Cadre Forum 2005 Plans, PENT Cadre Forum 2006 Plans, Plan Component Mean Beh. Definition 1.87 Predictors 1.85 Environ. Support 1.57 Environ. Changes 1.79 Function Replacement Beh 1.48 Teaching Strat. 1.55 Reinforcement 1.53 Reactive Strat. 1.49 Beh. Goal/Objs 1.12 Team Coord. 1.52 Communication 1.19 Plan Component Mean Beh. Definition 1.78 Predictors 1.80 Environ. Support 1.49 Environ. Changes 1.64 Function 1.61 Replacement Beh 1.46 Teaching Strat. Reinforcement Reactive Strat. 1.25 Beh. Goal/Objs .89 Team Coord. 1.54 Communication 1.05 ***Improvement across all but three of the plan components.
PBS Plan ImplementationFidelity Current Research: Exploring the connection between PBS plan quality, plan implementation fidelity, and student outcomes. PBS Plan Quality Student Outcomes PBS Plan ImplementationFidelity
Consultant Report: Relationship Between PBS Plan Quality and Student Outcomes Three ways of looking at this: Decrease in problem behaviors Correlation = .43* The better the plan, the more likely the student’s problem behaviors will decrease. Increase in general positive behaviors Correlation = .32* The higher quality the plan, the greater chance the student will increase his/her general positive behaviors. Increase in student using a FERB Correlation = .24* The higher quality the plan, the more likely the team will witness an increase in FERBs.
Follow-up Analysis Consultant report correlated to implementer report of student outcomes and plan implementation fidelity. Do they agree? Consultant characteristics that relate to PBS plan quality, implementation fidelity, and student outcomes. Preliminary results suggest that “number of ABA courses” is positively correlated with PBS plan quality and “years in education” is negatively correlated with PBS plan quality (i.e., the more years in education the poorer the PBS plan).
Relationship Between Plan Quality and Plan Fidelity Preliminary results suggest that the better the plan, the more likely the plan is to be implemented with integrity (i.e., implemented as written [r = .56]). In process: to determine whether integrity significantly predicts student outcomes. Step 1: Develop a high quality plan Step 2: Implement the plan with high integrity (as written) Step 3: Improved student outcomes
Autism Outcomes Autism Study: Pre- and post-training PBS plans were collected from Autism Specialist Teachers. Results suggested that following training on the BSP-QE, Autism Teachers as a group significantly improved in their ability to develop high quality PBS plans.
Change in Plan Categories Following BSP-QE Training
Peer-Reviewed Research Publications Cook, C.R., Crews, S.D., Browning-Wright, D., Mayer, G.R., Gale, B., Gresham, F.M., & Kraemer, B. (in press). Establishing and evaluating the substantive adequacy of positive behavior supports plans. Journal of Behavioral Education. Browning-Wright, D., Mayer, G.R., Gale, B., Cook, C.R., & Crews, S.D. (in press). Effects of training on the use of the Behavior Support Plan Quality Evaluation Guide © (BSP-QE) to improve positive behavioral support plans. Education and Treatment of Children.
Research Publications Effects of Training Autism Teachers to Develop Evidence-Based Positive Behavior Support Plans The Relationship Between Educator Characteristics and Positive Behavior Support Plan Quality Exploring the Relationship between PBS Plan Quality and Student Outcomes: The Mediating Role of Treatment Integrity
Recent Research (Cook & Browning Wright) Assessed further improvements in PBS plan quality (BSP-QE II), especially in the area of progress monitoring of behavioral change in: problem behavior reduction positive behavior increase functionally equivalent replacement behavior (FERB) use. Determined the higher the score, the more likely behavior change occurred, and the great the likelihood the plan was implemented with fidelity
Elements of Progress Monitoring of Intervention Effectiveness Goal Monitoring and Attainment Ongoing Communication Program Implementation (treatment integrity) Program Evaluation/Problem-solving
Designing School-Wide Systems for Student Success Academic Systems Behavioral Systems Intensive, Individual Interventions Individual Students Assessment-based High Intensity Intensive, Individual Interventions Individual Students Assessment-based Intense, durable procedures 1-5% 1-5% 5-10% 5-10% Selected Group Interventions Some students (at-risk) High efficiency Rapid response May inckude individual bsp Selected Group Interventions Some students (at-risk) High efficiency Rapid response 80-90% Universal Interventions All students Preventive, proactive Universal Interventions All settings, all students Preventive, proactive 80-90%
Take home message Behavior serves a purpose Change environments, teach replacement behavior A behavior plan is not a mental health treatment plan Compare your plan to the scoring rubric