1. “Technology is a useful servant but a dangerous master” (C. Lange)
Col. Corina ISPAS
Head of NDFLTC
Romania

2. Agenda Testing on-line. The empiric know-how! The where-about ‘s!
The what-to-do’s!
Conclusions

3. On-line testing Computer Based Testing (CBT)
Computer Adaptive Testing (CAT)
CBT vs Paper-based Pro’s and Con’s IELTS (ieltsadvantage.com)

4. Feasibility Analysis CBT
CBT Center/Computers
CBT Software & Vendor
Organizational Administration (TCO’s)
proftesting.com

5. Feasibility Analysis CBT
Computer literacy !!!!
Item banks
Delivery Methods (fixed CBT vs. Random CBT)
CBT Vendor

6. Feasibility Analysis CAT
Internet connection
Software (CATSim, FastTest,XCalibre)
IRT knowledge
Develop item bank
Pilot items ( candidates)
Item Analysis+ IRT Calibration
(Thomson and Weiss Model/ 2011)

7. Feasibility Analysis CAT
Upload into FastTest
Validity study
Publish CAT
Quality Assurance

8. Where-about’s Romania- case study
Placement test
Time to convert from paper-based to computer- based
Instructed administrative personnel
Logistics
Number of locations
Receptive skills (Speaking)
Number of candidates/testing session

9. Receptive Skills+W Evaluation Center Current Logistic
Available for exams
Testing capacity/day
BUCHAREST
(General Staff )
3 Language labs x 10 seats each
1 lab + 1 exam room (R,W)
30 persons/day
Brasov
(Air Force)
1 Language lab x 20 seats
Constanta
(Navy)
1Language lab x 20 seats each
35 persons/day
Pitesti
(Land Forces)
1 Language lab x 20 seats each
40 persons/day
Sibiu
2 Language labs x 10 seats each
1 Language lab x 18 seats
54 persons/day
No computers at any of the seats in the language labs

10. SPEAKING Evaluation Center Current Logistic Certified testers
Testing capacity/day
BUCHAREST
(General Staff )
2 rooms 2
10 persons/day
Brasov
(Air Force)
1 room
Constanta
(Navy) 4
Pitesti
(Land Forces)
2 (on rotation)
Sibiu 10
Bucharest
No computers at any of the seats in the language labs

11. What to do’s Romania- case study
Computer based placement test (convert or purchase)
Convert STANAG from paper-based to computer-based
Create item bank
Identify and train the TCOsl
Logistics (computer rooms, rooms for the interview, waiting room)
Number of locations
Number of candidates/days/testing session

12. Conclusions Romania - case study
Paper-based
Computer-based
Number of candidates/week for R, L,W
1040 persons/week
440 persons/week

13. Questions? Thank you!