Presentation on theme: "Advanced Placement Articulation and Policy Making for Enrollment Managers February 10, 2008 Boyd Bradshaw, Saint Louis University Michael Kabbaz, College."— Presentation transcript:
1 Advanced Placement Articulation and Policy Making for Enrollment Managers February 10, Boyd Bradshaw, Saint Louis University Michael Kabbaz, College Board Sally Lindsley, University of Michigan Gordon Mork, Purdue University Ted Spencer, University of Michigan
2 Workshop Outline Michael Kabbaz: AP overview - (50 minutes) AP Program Data; Field Research; Latest Validity Research; AP Course Audit Update; and Credit and Placement Policy Considerations10 minute breakBoyd Bradshaw - 25 minutesTed Spencer and Sally Lindsley - 25 minutesGordon Mork - 25 minutes
3 First Session: AP Overview Agenda AP Program OverviewData highlightsWhat’s New in APAP Course Audit/LedgerField ResearchRecent AP Validity ResearchCredit and Placement Policy Considerations
4 College Board’s Mission The College Board’s mission is to connect students to college success and opportunity. We are a not-for-profit membership organization committed to excellence and equity in education.
5 AP Participation Statement: Achieving Equity With a Focus on Quality and Preparation All prepared students who are willing to accept the challenge of a rigorous academic curriculum should be considered for admission to AP courses. The Board encourages the elimination of barriers that restrict access to AP courses for students from ethnic, racial, and socioeconomic groups that have been traditionally underrepresented in the AP Program. Schools should make every effort to ensure that their AP classes reflect the diversity of their student population.
6 What Sort of AP Experience Consistently Addresses Student College Success? The College Board encourages participation in AP, and believes students should be encouraged and supported in taking on the challenge of a college-level course in high school.While students may benefit from AP even if they don’t learn at the level that will produce a score of 3 or better on the AP Exam, it is vital that partnerships between K-12, higher education, states and the College Board focus on helping students achieve a score of 3 or better, which is the level of performance research consistently finds is predictive of college success.
7 AP OverviewSince 1955, AP has been providing high school students with rigorous course work that is comparable to entry-level college courses37 Advanced Placement exams in 22 subject areasWorld Languages expansion: Italian (2006), Chinese and Japanese (2007)AP Exams, which colleges utilize for credit, placement or both, are given annually in May.
8 Some Key Benefits of APAP courses establish a college-level standard in secondary schools that is measured through a national assessment designed and scored by college faculty.AP courses expose college-bound students to the amounts of homework, study skills, and habits of mind essential for success in college courses.AP provides leverage for aligning and strengthening the grades 6-12 curriculum.Students who take AP Exams and score a 3 or higher typically experience greater academic success and college graduation rates than non-AP students.The AP course is typically the most rigorous curriculum offered in secondary schools and is designated on the student transcript.Because AP is widely used for college credit and/or placement, it attracts motivated students eager to double major, or engage in deeper, upper-division courses at college.
9 Who Participates in AP?16,000+ secondary schools worldwide offer AP examsMore than 120,000 AP teachers in over 14,300 schools worldwide teach AP coursesIn 2007, over 1.4 million students took about 2.5 million exams4,700+ college faculty develop and score the AP Exams ensuring college-level standards3,500+ colleges receive AP Exam scores annually
10 Faculty Expertise is Essential in Every Facet of AP Course and Exam Development Pre-test AP Exams by embedding them within exams offered in the college classroomWrite AP Exam questions and develop all AP course descriptionsCollege faculty serve as Chairs of all AP Development CommitteesScore the free-response sections of AP Exams by attending the AP Reading at a college campus or convention center every JuneCollege faculty serve as Chief Readers for all exam gradingsTeach professional development institutes for experienced and new AP teachersParticipate in the annual audit of courses labeled “AP” by reviewing electronic copies of AP teachers’ syllabi to provide feedback
11 What do AP Exam Grades Represent? Each AP Exam grade is a weighted combination of the student's score on the multiple-choice section and on the free-response section. The final grade is reported on a 5-point scale:5 = extremely well qualified 4 = well qualified 3 = qualified 2 = possibly qualified 1 = no recommendationAP grades of 5 and 4 are comparable to a college course grade of A, while at some institutions, an AP grade of 4 is comparable to a college course grade of BAn AP grade of 3 is approximately equal to a college course grade of B at many institutions, while at others it is more nearly comparable to a college course grade of C.
12 College Faculty Ensure Rigor and Quality of AP Standards by Participating in Comparability Studies To identify the number of points AP students must earn on the AP Exam, college professors regularly administer AP Exams to their own college students in order to ensure comparability between the standards applied to college students and the standards AP students must meet.
13 Faculty at the Following Institutions Pre-Administered AP Exams in 2007 Baylor UBrigham Young UDuke UGrinnell CollegeHarvard UMichigan State UMiddlebury CollegePrinceton UPurdue USmith CollegeStanford UTufts UUCLAUC-BerkeleyU of Colorado-BoulderU of Maryland-College ParkUNC-Chapel HillU of PennsylvaniaUniversity of Southern CaliforniaU of VirginiaU of WashingtonU of Wisconsin-MadisonWashington UYale U
14 AP Continues to Grow in the Number of Participating Schools, Students and Exams AP Growth: No. of SchoolsAP Growth: Students/ExamsSource: The College Board SDRS
15 And within the fraction of students who take AP: Despite AP’s Growth, Participation in AP is Limited, Even Among College-Bound StudentsWhile about 74% of U.S. high school graduates are entering college, less than a fourth (24.2%) took an AP Exam during their high school yearsAnd within the fraction of students who take AP:82 percent took just 1, 2, or 3 AP Exams during their entire 4 years of high schoolLess than 4 percent took 7 or more AP Exams during their entire 4 years of high schoolSource: AP Report to the Nation; College Board SDRS
16 AP Exam Fee Reduction for Low-Income Students The College Board believes the cost of the AP Exam should not be a barrier for low-income students.The College Board provides a $22 fee reduction per exam for students with financial need. For each eligible student, secondary schools should also forgo their $8/per exam rebate.More than 40 states and U.S. territories use federal and/or state funds to help cover all or part of the remaining cost to the student.More information on state exam fee subsidies:
17 * - represents percentage growth from 2002 AP Participation Growth Rate is Greatest Among Low-Income, African American, and Latino studentsHispanic – 91%*Low Income – 142%*Asian – 62%*African American – 105%*American Indian – 82%*Source: SDRS* - represents percentage growth from 2002
18 * - represents percentage growth from 2002 Increasing Numbers of Traditionally Underserved Students are Now Earning Scores of 3 or BetterHispanic – 62%*Low Income – 97%*African American – 73%*American Indian – 80%** - represents percentage growth from 2002Source: SDRS
19 However, Significant Achievement Gaps Remain and are a Concern the College Board is Seeking to AddressPercent of Total Exams Scored 1, 2, or 3+:All Exams and Low Income (FR) ExamsPercent of Total Exams Scored 1, 2, or 3+:By Ethnic / Racial CategorySource: SDRS 2006 data
20 What’s New in AP? AP Course Audit Field Research Overview Release of the AP Course LedgerField Research OverviewAdmission Officer PerceptionsCollege Faculty Perceptions
21 What is the AP Course Audit? Created at the request of secondary school and college members of the College Board, the AP Course Audit was designed to:• Provide teachers and administrators with clear guidelines on curricular and resource requirements that must be in place before labeling a course “AP”; and• Ensure consistency and currency across the curriculum of courses labeled “AP.”
22 How is the AP Course Audit Conducted? From , college faculty nationwide established the criteria for earning the AP designation; these criteria are publicly available on the WebFrom , teachers and principals desiring to continue to label their courses “AP” submitted their curricula for review by college faculty.More than 800 select college and university faculty currently conduct the audit on behalf of the College Board.These professors represent a diverse range of institutions such as Yale University, Florida State University, and Haverford College
23 The Outcome of the AP Course Audit Qualifying schools receive legal authorization to use the “AP” label on their school profile and student transcripts, and are included in the public ledger of official AP courses.For , the “AP” designation is now restricted to courses in approximately 14,300 secondary schools worldwide.
24 Course Audit: What Was the Impact? A recent survey of 26,000 teachers who participated in the audit provided such a statistically significant sample size to justify the following claims about the impact of the audit. Hundreds of thousands of high school students will benefit from the increased resources they now receive due to the audit, which enabled a projected:• 17,000 teachers to prevent reductions in lab time and instructional time that were scheduled to affect their courses;• 16,000 teachers to obtain more current college textbooks for their students;• 22,000 teachers to incorporate advances in the discipline that had not yet been added into their curricula; and• 16,000 teachers to receive increased funding from their school or district for professional development.
25 Course Audit: What Was the Impact? The vast majority of AP teachers felt the AP Course Audit curricular requirements were broad and flexible enough to permit a wide variety of approaches to teaching an AP course, while at the same time, providing them a valuable opportunity to reflect upon their course and its relationship to colleges' rigorous expectations.
26 AP Course Audit Results are Accessible: AP Course Ledger Searchable database of over 136,200 courses and 14,300 secondary schools worldwide authorized to carry the “AP” labelSearch database by high school, high school code, city, state, and subjectEntire database is able to be downloaded to be integrated into campus systemcollegeboard.com/apcourseledger
27 AP Course Ledger: Possible Uses? Confirmation of AP courses taught in high schoolsPossible tool for targeted recruitment of high schoolsSearch on secondary schools with specialized content areas, such as world languagescollegeboard.com/apcourseledger
28 Field Research: Attitudes, Beliefs, Needs, Wants – What Do We Know? Beginning in spring 2007 and continuing through this year, the AP Program is undertaking the largest study of stakeholders’ values ever conducted by AP. Large, representative samples are being gathered from the following groups:AP TeachersCollege Admissions OfficersCollege Department ChairsAP CoordinatorsSchool and district administratorsAP exam ReadersStudentsParents
29 % Extremely / Very Important Higher Education’s Support for K-12 is Critical if Secondary Schools are to Continue to Increase Academic Opportunities for StudentsTo sustain your school’s current level of participation in AP, how important is it that…% Extremely / Very ImportantSource: Crux Market Research Inc. (2006): AP Teachers – Q345 Base: (n=3,417)
30 Nearly 90% of Bldg and District Administrators School and District Administrators also Affirmed the Importance of Higher Education’s SupportTo sustain your school’s/district’s level of participation in AP, how important is the fact that colleges award credit for AP Scores?Nearly 90% of Bldg and District AdministratorsSource: Crux Market Research Inc. (2006): Administrators – Q313_02 Base: (n=604)
31 Why do Students take AP Courses? Which of these are reasons why you have decided to take AP?Intrinsic ReasonsExtrinsic ReasonsSource: Crux Market Research Inc. (2006): Q310
32 Credit / Placement Opportunities Remain the Strongest Drivers of the Decision to Take the AP Exam Which are key reasons why you would take an AP Examat the end of an AP course?Extrinsic ReasonsIntrinsic ReasonsSource: Crux Market Research Inc. (2006): Q630
33 What is the Current AP Experience Among Colleges?
34 Top 200 colleges based on AP score report volume A Wide Range of Institutions Report Increases in the Proportion of Students with AP ExperienceOver the past few years, has the proportion of your department’s students who took AP coursework in high school been…?(% Increasing)Top 200 colleges based on AP score report volumeSource: Crux Market Research Inc. (2006): Q630 Dept. Chairs – Q315 Base: (n=125) / Admissions – Q315 Base: (n=125)
35 AP Policies are Not Affecting Application Volume or Tuition Revenue Which of the following are true at your institution?Source: Crux Market Research Inc. (2006): Admissions – Q245 Base: (n=125) / Dept. Chairs – Q245 Base: (n=125)
36 College Preparedness of Their Incoming AP Students Has Been Either Improving or Constant, Not Worse Over the past few years, has the degree of college preparedness of your students with AP experience been…?Source: Crux Market Research Inc. (2006):Admissions – Q320 Base: (n=125)
37 Most Admissions Officers Find AP Experience Helpful in Evaluating Admissions Candidates When evaluating a candidate for admission, how helpful is itto evaluate their AP course experience?74% Extremely or Very Helpful“We look favorably on students who have taken AP courses. The presence of AP courses is a sign that a student has chosen to challenge him/herself.”AP Admissions Officer Online Bulletin BoardSource: Crux Market Research Inc. (2006): Admissions – Q300 Base: (n=125)
38 A Vast Majority of Admissions Officers Report that AP Course Experience Favorably Impacts Admissions DecisionsSource: Crux Market Research Inc. (2006): Admissions – Q340 Base: (n=125)
39 41% of Admissions Officers Anticipate an Increase in the Use of AP in Admissions in the Future Think about the use of AP in admissions decisions at your institution.Five years from now, do you expect that …?Higher among selective institutions (47%)Source: Crux Market Research Inc. (2006): Admissions – Q705 Base: (n=125)
40 On the whole, do you feel that having AP on a college transcript is …? Many Admissions Officers Find AP to be More Meaningful Today than it has in the PastOn the whole, do you feel that having AP on a college transcript is …?Why?“Because AP is now available to so many different schools, which are clearly not equal.”Admissions Officer telephone surveyWhy?“Because of the growth of the AP program, such that the coursework is more readily available at schools…thus making it more useful for broad-based comparisons.”Admissions Officer telephone surveySource: Crux Market Research Inc. (2006): Admissions – Q305 Base: (n=125)
41 Colleges Use AP to Determine Preparedness, Student Motivation, and for Placement How does your institution use AP, if at all, to support admissions decisions?“We consider the learning environment for each applicant – how many AP’s are offered and how many has the student taken advantage of and grades earned.”AP Admissions Officer Online Bulletin BoardSource: Crux Market Research Inc. (2006): Admissions – Q301 Base: (n=125)
42 Strong Support from Department Chairs on Providing AP Credit or Placement to Students In general, would you say you favor or oppose allowing AP studentsto receive credit or placement in your department?76% Strongly Favor or FavorSource: Crux Market Research Inc. (2006): Dept. Chairs – Q240 Base: (n=125)
43 Most Department Chairs Report that Their Institution Uses AP for Both Credit and Placement Does your institution’s AP policy allow students to apply AP scores for …?Source: Crux Market Research Inc. (2006): Dept. Chairs – Q300 Base: (n=125)
44 Most Admissions Officers and Department Chairs Report Little Change in the Ease or Difficulty for Students to Obtain Course CreditOver the past few years, has your institution/department made it harder or easier for students to use their AP exam score to obtain credit or skip introductory courses?Source: Crux Market Research Inc. (2006): Admissions – Q355 Base: (n=125 / Dept. Chairs – Q355 Base: (n=125)
45 Some Colleges and Universities Tailor Their AP Exam Polices Does your institution/department…?Source: Crux Market Research Inc. (2006): Admissions – Q375 Base: (n=125) / Dept. Chairs – Q375 Base: (n=125)
46 How important is the following to you? % Extremely / Very Important Colleges Want Assurance that AP Quality is Consistent Across High Schools and are Interested in Seeing the Relationship Between AP and College SuccessHow important is the following to you?% Extremely / Very ImportantSource: Crux Market Research Inc. (2006): Admissions – Q700/Q701 Base: (n=125) / Department Chairs – Q700/Q701 Base: (n=125)
47 The More Selective the Institution, the Less the College is Concerned About Having the Same AP Policies as PeersHow important is it that your AP policies are the same as peer institutions?“We care and like to see what other schools are doing in their academic and admission policies.”Participant, AP Admissions Officer Online Bulletin BoardSource: Crux Market Research Inc. (2006): Admissions – Q235 Base: (n=125) / Dept. Chairs – Q235 Base: (n=125)
48 Most Institutions are Doing Something to Monitor Peer Institution AP Policies; Departments are More Active than Admissions RealizesWhat does your institution do to monitor what peer institutionsare doing with regard to AP?Source: Crux Market Research Inc. (2006): Admissions – Q236 Base: (n=125) / Dept. Chairs – Q236 Base: (n=125)
49 Satisfaction Levels for AP and IB are Similar Mean Overall Satisfaction (10 point scale)“[AP and IB] are both rigorous programs that should be taken very seriously…both are highly respected by admissions committees.”Admissions Officer telephone surveySource: Crux Market Research Inc. (2006) Admissions – Q385 Base: (n=125), Colleges that have students with IB/DE experience Q445/Q540 Base: (n=114/116)Admissions – Q385 Base: (n=125), Colleges that have students with IB/DE experience Q445/Q540 Base: (n=80/53)
50 Which students tend to succeed more in your department? Half of Department Chairs Feel that Students with any Advanced Coursework Experience are Equally Likely to Succeed in Their DepartmentWhich students tend to succeed more in your department?Source: Crux Market Research Inc. (2006):Base - Department Chairs from colleges that have students with AP and IB experience – Q615 Base: (n=100)
51 AP ResearchWhile much caution should be exercised in interpreting AP’s impact, research continues to establish strong connections between AP and college success.
52 Course Placement: Research Two large scale studies have collected official student transcript data from numerous colleges and universities (Morgan & Ramist, 1998; Morgan & Klaric, 2007)Institutions varied by location, selectivity, and curriculum emphasisNo. of institutions in both studies exceeded 20Compared subsequent course grades of AP students with an exam grade of > 3 who were exempted from the introductory course to the subsequent course grades of students who took the introductory course
53 Course Placement: Research Results AP students exempted from the introductory course generally did at least as well, if not better, in the subsequent course as those who took the introductory courseMagnitude of achievement difference generally varied as a function of the students’ AP Exams gradesThat is, students earning higher exam grades tended to do better, on average, in the subsequent course than those earning lower exam grades.
54 Course Placement: Research UT Austin Study (Keng & Dodd, 2007)Followed 4 cohorts of entering freshmen ( ) enrolled at the University of Texas at Austin.Results showed that AP students who placed out of introductory college courses as a result of successful AP exam grades (i.e., the AP credit group) earned significantly higher college GPAs in the subject area of their exam and took more credit hours in the subject area of their exam than non-AP students.Non-AP students were matched to the AP group in terms of high school rank and admission test scores (i.e., SAT and ACT).
55 AP Students with Credit Outperformed Non-AP Students
56 AP & College Success: Results Students who take AP Exams more likely to:Earn at least a B average in their freshman yearMaintain that average for the duration of their college careerGraduate with academic honors (Willingham & Morris, 1986)Students who earn 3 or better on AP Exam more likely to:Graduate from college in five years or less compared to non-AP students, even after controlling for prior academic achievement, SES, % low income, and district dropout rate (Dougherty, Mellor, & Jian, 2006).
57 AP Exam v AP Course Participation Texas Statewide Study (Hargrove, Godin, & Dodd, 2007)Provides an extensive comparison of students’ performance on several college outcomes (first and fourth-year GPA and 4-year graduation status) by various groupsAP course and exam groupAP course only groupStandard high school courses groupControls for SAT scores and SES (as measured by Free or Reduced Price Lunch status)
58 Hargrove, Godin, & Dodd, 2007The “AP course and exam” group significantly outperformed the “standard high school courses” group on all college outcomes in all years, after statistically controlling for SAT scores and SES.The “AP course and exam” group also significantly outperformed the “AP course only” group on all college outcomes.
59 First-Year College GPA for AP and non-AP groups by SAT Score Category
60 AP Exam v AP Course Participation In the context of college admissions, UC-Berkeley researchers Geiser & Santelices (2004) investigated the role of AP course participation and exam performance in predicting:First-year GPADiscipline-specific GPAFor admission at University of California, students obtain additional “bonus points” for approved AP and honors courses. Policy intended to encourage rigorous course taking in high school
61 AP & College Admissions: Results Using UC data, the Berkeley researchers studied the role of several variables in predicting college GPA:HSGPA, SAT I scores, SAT II scoresSES, Parents’ educationNumber of AP/honors coursesAP Examination performanceFindings indicated that:While the number of AP courses was not a significant predictor of college GPAAP Exam performance was “among the very best predictors of college performance The subject-specific, curriculum-intensive AP exams are the epitome of ‘achievement tests,’ and their validity in predicting college performance should not be surprising.”
62 AP Exam Grade of 3 or higher AP Scores of 3+ on AP Exams are Strongly Predictive of a Higher Rate of College GraduationCollege Graduation Rate differences between “matched” AP and non-AP students Student DemographicAP Exam Grade of 3 or higherAfrican-American21% higherHispanic27% higherWhite19% higherLow-Income32% higherNot Low-Income23% higherSource: Chrys Dougherty, Lynn Mellor, and Shuling Jian, The Relationship Between Advanced Placement and College Graduation (National Center for Educational Accountability, 2006)
63 Does granting AP credit result in student avoidance of further studies in that discipline? Data show the opposite:Source: Morgan, Rick and Behroz Maneckshana. AP Students in College: An Investigation of Their Course Taking Patterns and College Majors. Princeton: ETS , 2000.
64 Reminders about Setting Institutional AP Credit & Placement Policies Anecdotal information should not be a basis for evaluating/changing institutional AP credit and placement policiesEnsure campus-based research is usedUtilize College Board’s free placement study service – ACES (Admitted Class Evaluation Service)Before changing any campus AP policies, thoroughly understand how any change could potentially impact student enrollment behaviorAre your key overlap institutions providing more AP credit or better placement opportunities for students?Educate faculty, deans and senior administrators on the possible ramifications of restricting AP credit and placement policies without understanding first AP student performance on your campusEnsure AP credit and placement policies are organized and easily accessible on your admission Web site
65 What are the Best Guidelines for Establishing AP Credit & Placement Policies? 1) Understand What an AP Exam Grade RepresentsAP curriculum based on equivalent college courses identified by college facultyAP conducts comparability studies to first-year equivalent courses ensuring AP scores standards meet or exceed the standards of institutions nationally2) Use Data and Research on the Performance of AP Students in CollegeUtilize recent, peer-reviewed, and published research studies to compare AP performance against non-AP peers in higher-level coursesTrack subsequent performance of your AP students in upper division courses
66 3) Review External Recommendations What are the Best Guidelines for Establishing AP Credit & Placement Policies?3) Review External RecommendationsAmerican Council on Education (ACE) recommends a 3, 4 and 5 should be awarded credit4) Review AP Curricula and AP ExamsReview AP curricula and exam questions to gauge level of content mastery required and its relation to your institution’s requirements
67 AP Credit Policies on collegeboard.com Searchable by institution for students, parents and school counselorsFor each institution that provided their AP credit policy information, you can find the following:A link to the institution’s own Web page that details its AP credit and placement policiesA statement by the college or university about their AP policy