Presentation on theme: "FLACS Regional Exams Checkpoints A & B"— Presentation transcript:
1 FLACS Regional Exams Checkpoints A & B Join us in preparing these important exams.September 2013
2 FLACS ExamsFLACS Regional Checkpoint A: Part 1: Speaking (30 points)* Part 2: Listening (40 Points) Part 3: Reading (20 points) Part 4: Writing (10 points)*FLACS Regional Checkpoint B: Part 1: Speaking (24 points) Part 2: Listening (30 points) Part 3: Reading (30 points) Part 4: Writing (16 points)*We are not changing the writing until June This year, there are no changes to the exam.*Change made last year: Three tasks, 5 utterances—2 points each, no quality point, no informal assessment in class.*CHANGE COMING IN THE FUTURE: 2015Writing task be informed by a reading. There will be 3 choices of texts/writing prompts.
3 Standards/ContentThe New York State Standards for World Languages (LOTE), the National Standards for World Languages, and the New Revised Themes for World Languages in the 21st Century (based on the Topics from the Modern Language Syllabus, IB and AP Themes) establish the content, skills, knowledge and performance standards for these exams.Distribute Standards/Performance Indicators/Syllabus with Topics at this slide
4 Highlight the new topics like Technology, Media, Internet and Communication as these are not the original NYSED topics.
5 Multiple Choice Listening and Reading Test Items Test items are the building blocks of an exam. All multiple choice test items are composed of three parts:Item stem (question/incomplete statement)Correct answerDistracters (incorrect responses)“Options” refers to all the choices that are available. The correct answer must be 100% correct, 100% of the time.
6 Writing good MC Items:Be sure to choose appropriate content (refer to Themes/Topics/Standards)Content should be at an appropriate level of difficultyBe sure the answer to the question does not rely on one word in the reading/document or on a visual aloneCheckpoint A=a question and 4 optionsCheckpoint B=a question and 4 options or an incomplete statement with four optionsDo not use negatives in the question or optionsMake sure the options are all the same length/formatThe options should be viable and not grammatically incorrectStudents should not be able to answer the question just by reading the question and the options.Place repeated words in the stem, not in the options.
7 DistractersDesigning plausible distracters is the most challenging aspect of multiple choice item writing.A good distracter should be chosen by low achievers, not high achievers.The distracters are clearly not the correct answer when the best answer is selected.All distracters should be similar in length and format (i.e. verbs, infinitives, statements).The way to judge a good stem: students who know the content should be able to answer before reading the alternatives.
8 Do not have more than one answer that is possibly correct. Do not make correct answer noticeably shorter or longer than the distracters.Do not use copyrighted material. Public domain content like newspaper/internet articles and ads are permissible.
9 Things to RememberPlease keep in mind the ability level of your own students and students throughout New York State as well as Checkpoint A or B standards. The text should be understandable. The vocabulary and grammatical structures should not be out of the reach of the average student who would take the test.Please include the complete original document for each item (magazine article, etc.) with a reference to the name and date of the magazine or other source. This pertains to both reading and listening passages.Share handout of Checkpoint A vs. Checkpoint B.Also – announce that this year the source of the documents will be noted on the exam. They must include the citation (web or print source) when they submit their items.
10 Item Writing FLACS Regional Exams Checkpoint A Exams Part 2a Listening Comprehension: The passage is in the target language; the question is in English. One multiple-choice question for each passage. Part 2b Listening Comprehension: The passage is in the target language; the question is also in the target language. One multiple-choice question for each passage. Part 2c Listening Comprehension: The passage is in the target language; the question is in English with four pictures as the choices. One multiple-choice question for each passage. Part 3a Reading Comprehension: Short reading passages or authentic document of similar size; one multiple-choice question for each selection. The questions are in English. Please upload the originals. Part 3b Reading Comprehension: Short reading passages or authentic document of similar size; one multiple-choice question for each selection. The questions are in the target language. Please upload the originals.Share copies of last year exam.
11 Item Writing FLACS Regional Exams Checkpoint B Exams Part 2a Listening Comprehension: The passage is in the target language; the question is in English. One multiple-choice question for each passage. Part 2b Listening Comprehension: The passage is in the target language; the question is also in the target language. One multiple-choice question for each passage. Part 3a Reading Comprehension: Long reading passage; five multiple-choice questions based on the reading. The questions are in the target language. Please upload the originals. Part 3b Reading Comprehension: Short reading passages or authentic document of similar size; one multiple-choice question for each selection. The questions are in English. Please send the original(s) rather than copies. Part 3c Reading Comprehension: Long reading passage; five multiple-choice questions based on the reading. The questions are in English. Please upload the originals.Share example of Regents.
12 Reading Comprehension For Checkpoint B reading comprehension items, the questions may be phrased as either a complete question or an incomplete statement. (e.g. “The main idea of this selection is….”)Word count for reading passages should bePlease make sure that the actual physical size is appropriate – materials should not be at either extreme. A reading selection should not be so huge that it cannot fit on the test paper and it should not be so small that the text is impossible to read.Color: Please make a copy of the selection first to make sure that it will reproduce well in black and white. If the answer depends upon the color of certain parts of the selection, then it will not work.Give them an idea of word count for the long passages. I went through 4 long passages on two different NYSED Spanish Regents exams. The word count range was from 550 – 670.
13 Sample Listening ItemYou are listening to the radio and you hear the following:This month marks a celebration of dance and music. Several famous dancers and musical groups from around the world will be performing at the largest stadium in the city. Tickets go on sale today. The first 200 people to purchase a ticket will win a free T-shirt with the dancer or musical group of your choice pictured on the shirt. There are discounts for senior citizens and students. Call today and get your tickets for this great event and you might just get a free T-shirt.Why would someone want to go to this concert?1-The opportunity to attend a free concert2-The opportunity to get a free car wash3-They are going to offer free T-shirts if you buy the tickets buy tomorrow4-The opportunity to bring a senior citizen to a concert for freeThe question is not a good one…Correct answer for this item is #3. The correct option is too long and has grammatical errors (buy instead of by). The distracters all begin with “The opportunity” and the correct answer is different. Repeating the same phrase could be avoided by rewording the options.
14 Sample Listening Item~Enhanced You are listening to the radio and you hear the following:This month marks a celebration of dance and music. Several famous dancers and musical groups from around the world will be performing at the largest stadium in the city. Tickets go on sale today. The first 200 people to purchase a ticket will win a free T-shirt with the dancer or musical group of your choice pictured on the shirt. There are discounts for senior citizens and students. Call today and get your tickets for this great event and you might just get a free T-shirt.What is this advertisement about?1-A performance of dance and music2-New musical groups in the city3-A free concert for seniors4-Discounts of $200 on dance lessonsThis question/options are better. The correct answer is #1. #2 might also be confused as true but it is not precise.
15 Sample Reading Item When would someone use these coupons? This item is not good because three options begin with the same wording and one does not. The correct answer is #2, but #3 and #4 could be considered correct also.When would someone use these coupons?1-Buying clothing for kids2-Buying furniture3-Saving money on purchases at a special store4-Buying gifts for friends and getting a discount
16 Sample Reading Item~Enhanced This item is better. The correct answer is #3.For what purpose would someone use these tickets?1-To go to a movie2-For a high school dance3-To attend rock concerts4-For traveling by train
17 Let’s review some sample items that posed problems for students on last year’s exams…
18 2011 Spanish Checkpoint A # 29There is no correct answer for this one. None of the dates is after 9/21. Also, question should be worded “Que pais celebra…?”
19 Spanish Checkpoint A # 21 21 What service does el diario offer? ¡El campeón de los hispanos!el diarioLA PRENSA21 What service does el diario offer?(1) discounts on magazines(2) news from Latin America(3) employment opportunities(4) vacation planningCorrect answer is #2. This presented a lot of problems for students. Most of them chose #4.Cuando esté de visita en Nueva York, el periódico el diario/La Prensa es su fuente informativa sobre lo que está pasando en su propio país latino. Disponible en quioscos de revistas a través de todo Nueva York.el diarioLA PRENSA¡El campeón de los hispanos!
20 Spanish Checkpoint B # 1515 You are listening to the radio in Seville, Spain when you hear thefollowing announcement:Hola, soy Maribel. Tengo 22 años y soy española. Soy estudiante en la Universidad de Sevilla y estoy estudiando para ser maestra. Hablo español, francés e inglés. Me he propuesto cuidar de niños y ayudarles con sus tareas escolares. Soy una joven muy responsable, seria y paciente, además tengo experiencia con los niños de todas edades. Y ya que estudio en una universidad, tengo tiempo libre y horario flexible. Vivo en el centro de Sevilla. Si desea más información, llame por teléfono al¿Por qué llamarías a esta persona?Correct answer is #4. Most students chose #2.15 ¿Por qué llamarías a esta persona? (1) para informarse sobre la universidad (2) para aprender un idioma nuevo (3) para hacer una excursión en Sevilla (4) para tener ayuda con sus hijos
21 Spanish Checkpoint B # 23 23 ¿Cómo se comunican hoy los adolescentes? Por: Elespectador.comUna relación entre adolescentes comienza con el cambio deestado en Facebook. Los mensajes de texto son uno de susmedios favoritos de comunicarse, pero no hay nada mejor que unencuentro físico. Para los jóvenes, el teléfono es una herramientasocial.Estas fueron algunas de las conclusiones de una investigaciónrealizada, entre junio y noviembre de 2011, por el laboratorio delproveedor de telecomunicaciones, Ericsson, que investigó losmedios que prefieren los adolescentes a la hora de comunicarse ysocializar con los demás.Correct answer is #4. #1 could be implied. #2 was also chosen by students.23 What is one of the conclusions of the article? (1) Letter writing is becoming more popular. (2) The telephone is growing obsolete. (3) There is a lack of communication. (4) The best form of communication is in person.
23 Spanish Checkpoint B # 3030 A trip to Puerto Rico can also interest people who are… (1) interested in the study of tropical animals (2) worried about animal extinction (3) employees at international companies (4) inclined to study indigenous societiesThe correct answer is #1. Students selected from all four answers indiscriminately.
24 French Checkpoint B # 1313 While listening to a French talk show, you hear a noted psychologist say thefollowing:Il y a une phobie qui se caractérise par la peur de ne pas avoir son téléphone portable avec soi. Elle semble refléter un mal nouveau qu'on doit surtout aux technologies de communication et particulièrement à l’usage intensif que l’on fait de nos smartphones. Tous attachés au mobile, nous sommes tous concernés. Pourquoi nos chers téléphones portables sont-ils devenus indispensables à la condition humaine? Voila ce qu'on se demande.De quelle phobie parle-t-on?Correct answer is #1. Students chose #2 or #3.13 De quelle phobie parle-t-on? (1) d'une phobie d’être sans son téléphone portable (2) d'une phobie de la technologie (3) d'une phobie des téléphones portables (4) d'une phobie de la foule
25 French Checkpoint B # 2222 Si vous recevez plusieurs personnes à la maison et vous ne voudriez pas passer trop de temps à la cuisine, voici une idée pour un dessert qui s’accompagne de glace. Faites vos boules de glace à l’avance et gardez-les sur un plat au congélateur. La glace sera ainsi beaucoup plus facile à servir à vos invités le moment venu, tout en vous permettant de confectionner rapidement des coupes glacées pour ceux qui en voudront.The correct answer is #1. Students chose #3. #2 could be an unfair distracter.22 This tip would be of interest to a person who.... (1) wants to spend more time with dinner guests. (2) does not like to prepare big dinners. (3) is looking for a new dessert recipe. (4) is allergic to dairy products.
26 Starting the item writing process: Find or Create Listening and Reading Comprehension Stimuli Listening passages can also be derived from reading sources.Reading passages are texts, articles from authentic sources (schedules, tickets from events, travel, advertisements, etc.)Long reading passages can be taken from a variety of sources.Authentic documents=realia.Handouts: NYSED article on maintaining requirement. NYS Syllabus with topics. Martino hand out on Checkpoint A vs. B. Examples of test items in English.It would be nice to give them specific examples of where they might find long reading passages.
27 Think of your students… Why are you choosing this listening or reading passage or document? Is it based on the goals for the course/student learning objectives?Read the passage, document, or article, decide why you selected this item. Is it giving you information about the students’ knowledge, skill, ability in the language that is meaningful?Create items that you know would be challenging yet appropriate for the level of students you teach.
28 Checklist for item writing Item is based on standards/learning objectivesAddresses one of the Themes/Topics and is culturally accurateIs written at appropriate level of difficultyAnswer is not based on one wordNo double negativesOptions are all same format, length, etc.Document is clear, legible and reprints wellThere are no grammatical errors in itemWe discussed at our FLACS Executive Board meeting the idea of gathering examples of good test items (hopefully, there will be some) before lunch and sharing it with them before they begin writing in the afternoon. I thought this was a good idea.