The Ecology of Language Assessment Carl Falsgraf, Director CASLS.

Slides:



Advertisements
Similar presentations
We-Speak : Why do we use the application? Benefits for Students Increased opportunities for students to practise oral skills Less confident students can.
Advertisements

Progress Monitoring And RtI System
USING ASSESSMENT TOOLS TO IMPROVE THE TEACHING OF SOUTHEAST ASIAN LANGUAGES.
Assessment types and activities
Classroom Factors PISA/PIRLS Task Force International Reading Association January 2005.
Assessment & Evaluation adapted from a presentation by Som Mony
Classroom Assessments Formative Assessment Ongoing or continuous during instruction NOT graded Process Descriptive feedback Assessment FOR learning to.
LinguaFolio Kansas Pilot Project Language: How do ‘they’ know you know it?
Requested Faculty Input 4 Packages 1.Course catalog description, List of CLO (Achieved) 2.List of assessments, List of activities- Today 3.Course topics.
ASSESSMENT DEVELOPMENT: BUILDING VALID AND RELIABLE TESTS Habeeb Quadri, M.Ed Denis Jarvinen, Ph.D.
L2 program design Content, structure, evaluation.
TELPAS Grades K-1 Holistic Rating Training Spring 2010 Hitchcock ISD.
Measuring Information Literacy from Third Grader to College Senior Carolyn Radcliff, M.L.S., SAILS Project Director Julie Gedeon, Ph.D., TRAILS Assessment.
Overview of Formative Assessment (Diagnostic & Feedback) vs. Summative Assessment (Mastery & Standardised) Presented by Philip Holmes-Smith School Research.
Discover potential. Expand global opportunity. Copyright © 2011 by Educational Testing Service. All rights reserved. ETS, the ETS logo, LISTENING. LEARNING.
Robyn Seifert February 6,  smarterbalanced.org  K-12 EDUCATION  Administrators 2.
I can structure lesson plans to help students reach goals I can create new activities from raw content.
5th International Conference Khartoum, Sudan Towards Building a Community of Learners February 26-28, 2015.
NJSTAMP Testing Preparation What will we do Today? Training Agenda - Purpose of the GEWLPAP STANDARDS - ASSESSMENT - INDICATORS TECHNOLOGY PREPARATION.
Assessment Foreign Language Pedagogy EA 125. What is assessment for?  What do we want to assess?  How do teachers benefit from assessment?  How do.
Technology-mediated Assessment: Documenting Learners' Progress Carl Falsgraf Center for Applied Second Language Studies University of Oregon
Identification, Assessment and Re-classification of English Learners Initial Identification  Complete within 30 school days of enrollment Administer Home.
Assessment! Principles of Best Practice -Language Assessment 101- Assessment! Principles of Best Practice -Language Assessment 101- NCCLP 2009 Kyle Ennis.
Assessment in Language Teaching: part 2 Today’s # 24.
Glastonbury Public Schools
Best Practices in the Work Place. Needs Assessment During our previous all staff meeting, I conducted a informal with Center Directors. I was able to.
Common Core State Standards & Assessment Update The Next Step in Preparing Michigan’s Students for Career and College MERA Spring Conference May 17, 2011.
Reading Maze General Outcome Measurement TES Data Meeting April, rd and 4 th Grades Cynthia Martin, ARI Reading Coach.
The Five New Multi-State Assessment Systems Under Development April 1, 2012 These illustrations have been approved by the leadership of each Consortium.
NEXT GENERATION BALANCED ASSESSMENT SYSTEMS ALIGNED TO THE CCSS Stanley Rabinowitz, Ph.D. WestEd CORE Summer Design Institute June 19,
CALIFORNIA DEPARTMENT OF EDUCATION Tom Torlakson, State Superintendent of Public Instruction California Assessment Update California Mathematics Council.
Module 3: Unit 1, Session 2 MODULE 3: ASSESSMENT Adolescent Literacy – Professional Development Unit 1, Session 2.
Together we LEAD!. Purpose of Riverwatch Middle School Our vision statement is “Together we LEAD – Learn, Excel, Achieve and Dream.”
Adolescent Literacy – Professional Development
The English High School – 144 McBride Street – Jamaica Plain, MA – – The English High School ELL Academy Goal.
Assessment Tools for Different Languages OPI & AP Dr. Jack Liu Associate Professor Coordinator of Chinese Program California State University - Fullerton.
ACTFL Immersion. Who uses this?  US Department of Defense  Missionary training schools.
Lynn Thompson Center for Applied Linguistics Startalk Network for Program Excellence Chicago, Illinois October 16-18, 2009 Formative and Summative Assessment.
CALIFORNIA DEPARTMENT OF EDUCATION Tom Torlakson, State Superintendent of Public Instruction California Measurement of Academic Performance and Progress.
1 Performance Assessment in American Foreign Language Classrooms Dr. Paula Winke FLTA Orientation August 10, 2011 Parlor C, MSU Union.
1 An Introduction to Language Testing Fundamentals of Language Testing Fundamentals of Language Testing Dr Abbas Mousavi American Public University.
Understanding Meaning and Importance of Competency Based Assessment
M-STEP A presentation for Macomb County Math Teachers.
About Us Headquartered in Charleston, SC; CASE Office in Durham, NC High-quality tools for assessments and instruction with expert training CASE Assessments.
Education Commission 11 December 2004 Progress of the Education Reform.
Smarter Balanced Assessment System March 11, 2013.
To Test or Not to Test?...that is the question! By: Sandy Church and Linda Lerch.
TAPCo. Full Staff Mtg March 17 th Agenda ● ADVANCE ● Regents.
NATO BAT Testing: The First 200 BILC Professional Seminar 6 October, 2009 Copenhagen, Denmark Dr. Elvira Swender, ACTFL.
Washington State Office of Superintendent of Public Instruction (OSPI) 1 K-12 Immersion Articulation Project Fourth Project Report October 14, 2010 For.
Formative and Summative Evaluation. Formative Evaluation The goal of formative assessment is to Monitor student learning Provide ongoing feedback Improve.
1 Division of Public Schools (PreK -12) Florida Department of Education An Update on the Review and Revision of English for Speakers of Other Languages.
Language Issues Constructs, Theories, and Scales.
STAMP (Standards-based Measurement of Proficiency)
Assessment Design. Four Professional Learning Modules 1.Unpacking the AC achievement standards 2.Validity and reliability of assessments 3. Confirming.
1 Add Composition, Creativity, and Self- Expression To Any Music Curriculum.
Standards Instruction Assessment Feedback. Session Outcomes Participants will:  Develop an understanding of the Test and Quizzes application in BCPS.
ELEMENTARY SPANISH 2 INTERMEDIATE SPANISH 1 CONSISTENCY PROJECT El Camino College Fall 2015 Workshop 2: November 13, 2015.
Fall River Public Schools Leveraging Educator Evaluation to Support ELL Initiatives & RETELL.
The Proof is in the Assessment Brenda Clark Director of Professional Development.
Evaluation and Assessment Evaluation is a broad term which involves the systematic way of gathering reliable and relevant information for the purpose.
STAMP. History STAMP is an exam developed by CASLS (Center for Applied Second Language Studies) at the University of Oregon. Avant Solutions. CASLS research.
Oral Proficiency Interview Workshop for Language Education Majors
What is the National Portuguese Examination?
Screener Administration
Homework questions How does ACTFL define a beginning level learner? (p.30) What are the principles for teaching speaking to beginning learners? (pp.36-40)
LinguaFolio standards-based self-directed formative assessment tool
Week Sessions On-line Class Off-line Class 1
ILP INDIVIDUAL LEARNING PLAN
Presentation transcript:

The Ecology of Language Assessment Carl Falsgraf, Director CASLS

The Language Education Ecosystem Curriculum Instruction Formative Assessment Formative Assessment Summative Assessment Summative Assessment REFLECTION

Can one assessment do it all?

ASSESSMENT CONTINUUM Teacher administered Customized Curriculum dependent + high validity + supports instruction - low reliability - context dependent Expert administered Standardized Curriculum independent + high reliability + context independent - low validity - divorced from instruction STAMP?

Proficiency PerformanceAchievement OPI Oral quiz Service learning project Weekly quiz Final exam STAMP?

Specifications of Intended Test Use (SITU) (Norris, 2003) Who are the test takers? Who are the test score users? What is the purpose of the test? What information should the test provide? What are the intended consequences of using the test? Norris (2000) STAMP?

ILR Novice-High Novice-Mid Novice-Low Intermediate-High Intermediate-Mid Intermediate-Low Advanced Plus Advanced Superior Benchmark 1 Benchmark 2 Benchmark 3 Benchmark 4 Benchmark 5 Benchmark 6 ACTFL BENCHMARKS Assessment

STAMP 101 By teachers, for teachers By teachers, for teachers Designed to inform, not just measure Designed to inform, not just measure Online: Anywhere, anytime, anybody Online: Anywhere, anytime, anybody Computer adaptive reading/listening Computer adaptive reading/listening Computer assisted speaking/writing Computer assisted speaking/writing

STAMP LISTENING

STAMP READING

NOELLA SPEAKING

Example of a good item

Example of a bad item

Level 3 Level 4

CLASS REPORT

PROGRAM REPORT

SLA Web

National 3rd/4th YR Japanese Data

Proficiency Levels by Years (Spanish - High School students) 1 year of study 2 years of study 3 years of study 4 years of study

NEEDS AUDIT CERTIFICATION PROGRAM EVALUATION PROGRESS CHECK DIAGNOSIS IMPROVE INSTRUCTION MOTIVATE STUDENTS NCLB/STAMP AP/OPI STAMP MIDTERM LINGUAFOLIO ASSESSMENTS

DEVELOPING AN ASSESSMENT PLAN CLARIFY GOALS DEFINE PURPOSES/USES RESEARCH EXISTING TOOLS DEFINE INTERNAL TOOLS INITIATE ASSESSMENT LITERACY PROFESSIONAL DEVELOPMENT

SAMPLE ASSESSMENT PLAN