Web-Enhanced, Blended or Online - Do Options Increase Student Success? 35th Annual AMATYC Conference Las Vegas, NV November 13, 2009 Mariana Coanda & Marcial Echenique

Broward College Profile Established in 1959 Open admissions Its a public college that offers BS, AA, AS, AAS degrees and Technical Certificates (selected degrees and certificates completely online). It has three major campuses, six educational centers located throughout Broward County, three international centers and many study abroad programs. Students (fall 2009): 46,000 (about 15% online students) Website:

Broward College Demographics Traditional Age 19-24: 42% Female: 60% Part-time: 72% Minority: 47% Non-Minority: 43% Other: 10% – Asian/Pacific Islander: 7% – Black: 18% – Hispanic: 22% – Native American: <1% – Caucasian: 43% – Other: 10%

e-Learning Course Formats Web-Enhanced courses are traditional classroom-based courses that meet regularly on campus, but use some Blackboard tools and features to enhance teaching and learning. Blended courses are non-traditional courses that replace 25%-80% of traditional, face-to-face instruction with online learning activities. Online courses are non-traditional courses that replace 80% or more of traditional, classroom-based instruction with online learning activities. Length of courses: 6 weeks, 8 weeks, 12 weeks, and 16 weeks.

BC Enrollment

BC Enrollment – College

BC Enrollment – Mathematics

BC Enrollment – Statistics

Enrollment Teach more traditional than online classes Traditional enrollment has been decreasing or staying constant Online enrollment increased at double digit percent rate Blended has increased dramatically in the last year (due to increased awareness and need for more classroom space) Enhanced has also increased in the last few years due to instructional technology training for interested faculty Overall Mathematics enrollment decreased in (due to policy changes at college requiring prep reading before math).

Enrollment - continue Traditional mathematics enrollment has continued to increase slightly, but online mathematics enrollment has increased significantly at an average rate of 50% per year. Blended and enhanced course have also increased In the last year, statistics enrollment increased at the same rate in both traditional and online formats. During this same period of time blended and enhanced enrollment increased at a much higher rate.

Math Success – College Algebra

Math Success – Elementary Algebra

Math Success - Statistics

Math Success Success rate in College Algebra for online and traditional courses is comparable. During the period of time all formats show a steady increase in the success rate. Success rate in Elementary Algebra for traditional courses is higher than for online courses. This may be due to the students college experience level. During the period of time all formats show a slight increase in the success rate. Success rate in Statistics for traditional classes has stayed the same, but online success rate has increased slightly. During the period of time, the overall success in the traditional course has been substantially higher than the other formats.

Quality Matters Quality Assurance in Online Learning Quality Matters Inter-Institutional Quality Assurance in Online Learning Quality Matters (QM) is a faculty-centered, peer review process designed to certify the quality of online courses and online components. The goals of the program are to increase student retention, learning and satisfaction in online courses by implementing better course design. Quality Matters has been adopted by hundreds of higher education institutions across forty-two states, Canada and Bermuda. Ninety-two course have received the QM seal of recognition in Over 5000 faculty and staff have been trained by QM. More details:

Quality Matters Standards 1.Course Overview & IntroductionCourse Overview & Introduction 2.Learning Objectives / OutcomesLearning Objectives / Outcomes 3.Assessment & MeasurementAssessment & Measurement 4.Resources & MaterialsResources & Materials 5.Learner EngagementLearner Engagement 6.Course TechnologyCourse Technology 7.Learner SupportLearner Support 8.AccessibilityAccessibility QM created a set of 40 specific elements (QM Rubric), distributed across eight categories:

QM Rubric – Scoring: For any e-learning course to be nationally QM recognized, it must meet all the Essential Standards in Quality Matters Standards and achieve a score of 72 or more out of 85. STANDARDSPOINTSRELATIVE VALUE 173Essential 112Very Important 121Important 4085

Peer Course Review Feedback Course Course Meets Quality Expectations Course Revision Instructional Designers Institutions Faculty Course Developers National Standards & Research Literature Rubric Faculty Reviewers Training Quality Matters Course Peer Review Process

Quality Broward College Broward College became a QM member in May Our BC rubric combines and integrates BC-specific standards with all 17 Quality Matters Essential Standards ( edition), indicated with (QM), as well as 9 Quality Matters Important/Very Important Standards, indicated with (qm). For an online or blended/hybrid course to be internally QM certified, it must meet ALL 40 standards. For an online or blended/hybrid course to pass the Final Review for course development, it must meet all 30 standards with bold bullets and asterisks(*). All commissioned courses, whether fully online or blended/hybrid, have to meet all 40 BC standards.

College Algebra Online – prior to QM

College Algebra Online- BC Internally Certified Your Location: Home Page

College Algebra Online- BC Internally Certified Your Location: Home Page > Learning Units

College Algebra Online- BC Internally Certified Your Location: Home Page > Learning Units > Learning Unit 1

Best Practices and Exemplary Courses in Broward College 40 e-learning courses are BC internally certified 7 are QM nationally recognized

Elementary Algebra Blended (QM nationally recognized)

Statistics Online (QM nationally recognized)

BC e-Learning Primary Goal Areas e-Learning Course Quality – Standards for Course Development – Recognition for QM Certified Courses & Faculty – New Commissioned Course Development (25 to 30 in ) – Existing Commissioned Course Re-design (20 to 25 in ) – 5 -year course redesign cycle 2. Ubiquitous Blackboard Access (starting Jan.2010 all BC classes will be in Blackboard) 3. Faculty Development and Support ( 120 more faculty complete certification/re-certification courses to teach or develop online courses and about attend web-enhanced workshops) 4. Program and Enrollment Growth 5. Increase Academic and Student Support 29

Overall Conclusions College Algebra success rate has continued to increase in all four formats during the period For Elementary Algebra and Statistics the traditional format has a higher success rate. Because of the substantial increase in online enrollment, we need to improve the online formats for Elementary Algebra and Statistics courses, as well as all other online courses offered at Broward College. Do options increase student success? Not yet. But with the plan currently in place, we hope that it will increase the success rate even more.

Team Members Lisa Ciardulli Associate VP of Instructional Technology Yaping Gao District Director, Instructional Design Matthew Seeman Assistant Director for Institutional Research

Q & A Dr. Marcial Echenique Mariana Coanda