1. mlearning Assessment From A Continuous Quality Improvement Perspective
Gary Marrer | March 4rd 2010

2. Agenda Goal: Discussion of mLearning Assessment
Share questions, practices, experiences
My Definitions and Assumptions
One Approach from the Research
Other Research
Let’s have some discussion…

3. Scope of Discussion
Focus is on Course Learning Objectives and how assessment of mLearning can provide continuous quality improvement.
Assumptions/My Background
At my Campus, we use mobile assisted learning.
I am an advocate of continuous quality improvement.
I am technology faculty and an early adopter
This presentation shares my experience on my campus.
Please answer the two survey questions as I present…Thanks!
Survey: What is your experience with mobile learning? (1) Not using yet (2) Using as part of traditional classroom delivered class (3) Using with on-line delivered class (4) Have classes that are delivered entirely on mobile device

4. An Assessment Definition (a teaching perspective)
What does it mean to assess the effectiveness of a pedagogy or technology?
“For many instructors, assessment just means grading, but it actually entails much more than this. When designed thoughtfully and implemented carefully, assessments can provide important evidence about what and how students are learning and whether course goals have been met.”1
1Strategies for Assessing Learning Effectiveness : by Constance A. Steinkuehler & Sharon J. Derry University of Wisconsin–Madison Copyright© NJIT & Constance Steinkuehler
Survey: For mobile learning assessment we (1) do not do assessment (2) we use traditional classroom assessment techniques (3) we use on-line classroom assessment techniques (4) we have specially designed assessment instruments designed for mobile learning.

5. mLearning Pedagogy Mobile Devices Support: mLearning can support:
Anytime anywhere learning
Small portable computers
Support multi-tasked lifestyles
mLearning can support:
Exploration
Observation
Social Learning
Evidenced based learning
Experiential learning
But mLearning supports traditional assessment also:
Testing
Surveys
Interviews

6. The Application of Mobile Learning
Mobile Learning can be practiced in any of this environments to varying degrees.

7. Some research I like…
Vavoula, G & M. Sharples. (2008). Challenges in Evaluating Mobile Learning.
REQUIREMENTS FOR MOBILE LEARNING EVALUATION 2
Capture and analyse learning in context with consideration of learner privacy
Assess the usability of the technology and how it affects the learning experience
Look beyond measurable cognitive gains into changes in the learning process and practice
Consider organisational issues in the adoption of mobile learning practice and its integration with existing practices and understand how this integration affects attributes of in/formality
Span the lifecycle of the mobile learning innovation that is evaluated, from conception to full deployment and beyond
2 (page 298) or

8. A Three Level Framework (Vavuola and sharples) (systematic)
Vavuola and Sharples – A three level framework for systematically evaluating mobile learning.
“Micro level: the micro level examines the individual activities of the technology users and assesses usability and utility…
Meso level: the meso level examines the learning experience as a whole, to identify learning breakthroughs and breakdowns; it also examines how well the learning experience integrates with other related learning …
Macro level: the macro level examines the longer term impact of the new technology on established educational and learning practice…”3
________________________________________________
3 Vavoula, G & M. Sharples. (2008). Challenges in Evaluating Mobile Learning. Proceedings of the mLearn Conference Ironbridge Gorge, Shropshire, UK. (page 298) or

9. Research Sample - Empirical
Pragmatic/Empirical – Comparison along similar variables / Data Driven
Mobile learning in higher education: an empirical assessment of a new educational tool
MLearning: pedagogical, technical and organizational hypes and realities, Pul B. Muyinda, Department of Distance Education, Institute of Adult and Continuing Education, Makerere University, Kampala, Uganda, and Department of Information Systems, Faculty of Computing and IT, Makerere University, Kampala, Uganda

10. Research Sample – Institutional Commitment
Mobile learning work at Abilene Christian University
College with “focused” commitment to Mobile Learning
Over 1000 iPhone/iTouch devices for Students, Faculty and Staff.
Customized ACU content
ACU's iPhone initiative: a year later by Brett Terpstra

11. mLearning Resources …continued
Excellent mobile learning articles
Are You Ready for Mobile Learning? By Joseph Rene Corbeil and Maria Elena Valdes-Corbeil ,
REPORT 11: FUTURELAB SERIES - Laura Naismith, Peter Lonsdale, Giasemi Vavoula, Mike Sharples University of Birmingham,
Defining, Discussing and Evaluating Mobile Learning: the moving finger writes and having writ John Traxler University of Wolverhampton, UK

12. mLearning Resources …continued
Pedagogy:
JISC TechDis
The Pedagogical Perspectives of Mobile Learning,
Chapter 6 - Pedagogical forms for mobile learning: framing research questions Diana Laurillard, London Knowledge Lab, Institute of Education, London

13. Let’s talk…
Is mlearning assessment just another example of technology being assessed in the learning process? or Is it different?
Is mobile assisted learning have a different assessment process than distance mobile learning?
Can traditional techniques work?
Who is doing something with mobile learning assessment?
What are the successes and failures you can talk about.
Lessons learned…

14. Glendale Community College
THANK YOU
Gary Marrer
Glendale Community College
Glendale, Arizona