Design of online survey system with an advanced IPA discrimination index for customer satisfaction assessment Presenter: Mai, Yi-Ting ( 麥毅廷, 臺體大運管系 ) Paper.

Slides:



Advertisements
Similar presentations
Online Course Design Online Course Design EVALUATION AND REVISION
Advertisements

Item Analysis.
Standardized Scales.
1 COMM 301: Empirical Research in Communication Kwan M Lee Lect4_1.
Research Methodology Lecture No : 11 (Goodness Of Measures)
Customer Satisfaction in the Public Administration.
CH. 9 MEASUREMENT: SCALING, RELIABILITY, VALIDITY
Introduction Goal of this work is to better understand Guelph’s 2007 LibQUAL+ comments (in aggregate), within the context of the quantitative findings.
1 Developing and Measuring CRM. 2 Outline  Developing and Implementing CRM  Customer satisfaction –The value of measuring Customer satisfaction –Objective.
Reliability Analysis. Overview of Reliability What is Reliability? Ways to Measure Reliability Interpreting Test-Retest and Parallel Forms Measuring and.
The art and science of measuring people l Reliability l Validity l Operationalizing.
Selecting Your Evaluation Tools Chapter Five. Introduction  Collecting information  Program considerations  Feasibility  Acceptability  Credibility.
The value of e-assessment in interprofessional education and large student numbers Melissa Owens* John Dermo* Fiona MacVane Phipps * Presenters.
BS2914 Quality Management & Customer Care 5: The SERVQUAL Questionnaire.
1 A Comparison of Traditional, Videoconference-based, and Web-based Learning Environments A Dissertation Proposal by Ming Mu Kuo.
Company LOGO B2C E-commerce Web Site Quality: an Empirical Examination (Cao, et al) Article overview presented by: Karen Bray Emilie Martin Trung (John)
Social Science Research Design and Statistics, 2/e Alfred P. Rovai, Jason D. Baker, and Michael K. Ponton Internal Consistency Reliability Analysis PowerPoint.
Measurement and Data Quality
Reliability, Validity, & Scaling
Business and Management Research
1 MSP-Motivation Assessment Program (MSP-MAP) Tools for the Evaluation of Motivation-Related Outcomes of Math and Science Instruction Martin Maehr
Evaluation and analysis of the application of interactive digital resources in a blended-learning methodology for a computer networks subject F.A. Candelas,
What’s cooking at Sponsorium Miami, February 10, 2015.
Copyright © 2012 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 14 Measurement and Data Quality.
Induction to assessing student learning Mr. Howard Sou Session 2 August 2014 Federation for Self-financing Tertiary Education 1.
EXPECTATIONS AND MARKET SEGMENTATION RESULTS OF THE ONLINE SURVEY Klaus Ehrlich José Manuel Ortega Egea* *University of Almería (Spain)
Author: Mels Gerhard, Boshoff Christo, Nel Deon
 Collecting Quantitative  Data  By: Zainab Aidroos.
Copyright 2007, Prentice Hall, Inc. 1 1 Principles of Marketing Fall Term MKTG 220 Fall Term MKTG 220 Dr. Abdullah Sultan Dr. Abdullah Sultan.
By: A. Parasuraman Valarie A. Zeithaml Leonard L. Berry
Students’ and Faculty’s Perceptions of Assessment at Qassim College of Medicine Abdullah Alghasham - M. Nour-El-Din – Issam Barrimah Acknowledgment: This.
Chapter Thirteen Measurement Winston Jackson and Norine Verberg Methods: Doing Social Research, 4e.
Perceptive Agile Measurement: New Instruments for Quantitative Studies in the Pursuit of the Social-Psychological Effect of Agile Practices Department.
THE MEASUREMENT OF USER INFORMATION SATISFACTION (BLAKE IVES ET.AL) Presented by: IRA GERALDINA
Copyright © 2014 by The University of Kansas Conducting Surveys.
Learning Objective Chapter 9 The Concept of Measurement and Attitude Scales Copyright © 2000 South-Western College Publishing Co. CHAPTER nine The Concept.
Joanna Huang YE4A Analysis of Mobile Shopping Behavior of Taiwanese Consumers.
Q2010 – Internet based user satisfaction surveys Claudia Junker & Antonio Baigorri Eurostat.
Measuring the impact of Technology on Quality of Services and Operations in an Academic Library Ashok Kumar Sahu Senior Librarian, IIMT Gulam Rasul Asst.
Validity and Item Analysis Chapter 4. Validity Concerns what the instrument measures and how well it does that task Not something an instrument has or.
Validity and Item Analysis Chapter 4.  Concerns what instrument measures and how well it does so  Not something instrument “has” or “does not have”
© Iris Vilnai-Yavetz – 1 Meeting the challenge of service intangibility: Are Top universities more innovative in the design of their.
Measurement Reliability Objective & Subjective tests Standardization & Inter-rater reliability Properties of a “good item” Item Analysis Internal Reliability.
The Quality of Life Index A Literature Survey of the Usage and Results from the Ferrans and Powers QLI.
Creating A Survey Using Office of Student Affairs Assessment The University of Georgia A-Team Training-Skills Session 1 October 30, 2007.
Measurement Experiment - effect of IV on DV. Independent Variable (2 or more levels) MANIPULATED a) situational - features in the environment b) task.
1 Evaluating the User Experience in CAA Environments: What affects User Satisfaction? Gavin Sim Janet C Read Phil Holifield.
Improving Results with Positive Directed Feedback in Summative Assessments Wayne Ellis
Applied Quantitative Analysis and Practices LECTURE#17 By Dr. Osman Sadiq Paracha.
Copyright © 2014 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 11 Measurement and Data Quality.
A Tool for Measuring Service Quality in Restaurants
Overview of Types of Measures Margaret Kasimatis, PhD VP for Academic Planning & Effectiveness.
MS. Priya - Teaching Asstt (BPSMV Khanpur Kalan).
Chapter 10 (3.8) Marketing Research.  What is Marketing Research? Marketing research is the systematic design, collection, analysis, and reporting of.
1 1 Principles of Marketing Spring Term MKTG 220 Spring Term MKTG 220 Dr. Abdullah Sultan Dr. Abdullah Sultan.
ACCESSING SERVICE QUALITY CUSTOMER SATISFACTION AND LOYALTY.
4.1 NOTES. x-Axis – The horizontal line on the coordinate plane where y=0. y-Axis – The vertical line on the coordinate plane where x=0.
Traditional descriptors Multi-item measures Preference measurement
Reliability Analysis.
Assessing Musical Behavior
RELIABILITY OF QUANTITATIVE & QUALITATIVE RESEARCH TOOLS
assessing scale reliability
A Quality Framework For Web Site Quality: User Satisfaction And Quality Assurance Background UKOLN, a national centre of expertise in digital information.
Lecture 6 Structured Interviews and Instrument Design Part II:
First study published in JOGS.
Interim Assessment Training NEISD Testing Services
Reliability Analysis.
The first test of validity
Business and Management Research
Hispanic Bilingual Gifted Screening Instrument
Presentation transcript:

Design of online survey system with an advanced IPA discrimination index for customer satisfaction assessment Presenter: Mai, Yi-Ting ( 麥毅廷, 臺體大運管系 ) Paper source: Electronic Commerce Research, vol. 14, No. 3 Contact Info.:

Total 26 pages22 Outline The purpose of survey Related works –Web-based computing –Importance - Performance Analysis (IPA) Web-based survey system with an advanced IPA discrimination index Performance analysis Conclusion

Total 26 pages33 The purpose of survey? Service trade, business, academic domain, etc. To provide the high quality service for customer To get feedback from customers/clients –How to prepare a questionnaire? –How to analyze results? –Considering user preference?

Total 26 pages44 Related works How to know service quality satisfaction from clients? –Questionnaire survey –Cloud, web, online questionnaire survey systems Convenience, survey anytime & anywhere Survey system with IPA model –Importance - Performance Analysis (IPA) –Survey including extra-functionality Creative, lower complicated and higher effective

Total 26 pages55 IPA Importance - Performance Analysis (IPA) –To measure the relation between the importance of the service quality and satisfaction IPA four steps: –To produce questionnaire with each service attribute –To give scores in “ Importance ” and “ Performance ” –Importance as y-axis, Performance as x-axis –I-P matrix is divided into four quadrants or sections

Total 26 pages66 IPA framework B. A.

Total 26 pages7 PZB model PZB (Parasuraman, Zeithaml & Berry, 1985) –service quality perceptions of user satisfaction Five dimensions: –Assurance –Empathy –Tangibles –Reliability –Responsiveness

Total 26 pages8 Web-based questionnaire Web-based questionnaire with IPA model –View with Likert Scale 5 point –Support Likert Scale 9 point Multiple choice –Online checking scheme No answer alert, pagination for large subjects

Total 26 pages99 Web-based questionnaire (cont.)

Total 26 pages10 IPA discrimination index The positive effective value of IPA area B. A.

Total 26 pages11 IPA discrimination index (cont.) Negative effect Positive effect

Total 26 pages12 IPA discrimination index (cont.)

Total 26 pages13 Result analysis information 257 valid questionnaires (278 questionnaires) 30 regular questions about user satisfaction ( for visited clients ) Special question item for survey checking

Total 26 pages14 Result analysis information (cont.) Web-based questionnaire – Multiple-option with single-survey High single-option (higher value of multiple choices) Low single-option (lower value of multiple choices)

Total 26 pages15 Result analysis I – survey types The three grading schemes –high single-option –low single-option –multiple-option Which one is the best? What is the appropriate tool for comparison?

Total 26 pages16 Reliability vs. Validity Case1Case2Case3 Neither Reliable nor Valid Reliable not Valid Both Reliable and Valid

Total 26 pages17 Reliability Reproducibility of a measurement

Total 26 pages18 Scale reliability analysis Internal consistency –correlations amongst multiple items in a factor –e.g., Cronbach’s Alpha (α) –<.6  not reliable –>=.6  OK

Total 26 pages19 Reliability of three grading schemes

Total 26 pages20 Mean Squared Error (MSE) As stated in our discussion on closeness, one potential measure for the goodness of an estimator is MSE.

Total 26 pages21 MSE of three grading schemes

Total 26 pages22 Multiple-optionHigh single-option Low single-option Comparison?? IPA matrix

Total 26 pages23 Quadrant analysis Quadrant Multiple- option High single- option Low single- option Quadrant A 1099 Quadrant B 475 Quadrant C Quadrant D 566

Total 26 pages24 IPA index An advanced IPA discrimination index

Total 26 pages25 Result analysis II – PZB model Five categories of PZB –How to compare? IPA matrix IPA index

Total 26 pages26 Conclusion “Web-based Survey system with an advanced IPA discrimination index” is a useful tool for assessment of the quality of service. The advanced IPA index is an efficient tool to enlarge the application scale of the original IPA model. The advanced IPA discrimination index can provide the quantitative comparisons information.