Fact: We constantly employ the entire assessment cycle in our daily lives Determining our desired outcomes Designing an assessment methodology Collecting.

Slides:



Advertisements
Similar presentations
Lecture 2 The Science of Psychology
Advertisements

Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?
Marketing Research and Information Systems
Chapter 2 Psychological Research Methods and Statistics
Chapter 5 Research Design.
Chapter 2: The Research Process
Research methods – Deductive / quantitative
EBI Statistics 101.
DEVELOPING A QUESTIONNAIRE FOR USE IN OUTCOMES ASSESSMENT
Survey Design Steps in Conducting a survey.  There are two basic steps for conducting a survey  Design and Planning  Data Collection.
Formative and Summative Evaluations
Survey Research & Understanding Statistics
Chapter 4 Research Design.
Comparing Assessment to Educational Research. In this session, we will… Construct and discuss the (related but different) goals and attributes of assessment.
Title I Needs Assessment and Program Evaluation
Chapter 8 Conducting & Reading Research Baumgartner et al Chapter 9 Descriptive Research.
FINAL REPORT: OUTLINE & OVERVIEW OF SURVEY ERRORS
The Proposal. The Final Product Introduction –Including your Management Question Literature Review Your Model –Research Questions –Hypotheses you plan.
Descriptive Research. D Used to obtain information concerning the current status of a phenomena. D Purpose of these methods is to describe “what exists”
UOFYE Assessment Retreat
Cover Letters for Survey Research Studies
5.04 Discuss the Consumer Research Process. Consumer Research  Consumer research is used to gather information in order to know what consumers want and.
That’s Not True!!!! Research Methods in Psychology.
RESEARCH A systematic quest for undiscovered truth A way of thinking
Methods Overview.  Description: What happens?  Prediction: When does it happen?  Explanation: Why does it happen? ◦ Theory ◦ Causal Inferences  Intervention/Application:
Research Methods Key Points What is empirical research? What is the scientific method? How do psychologists conduct research? What are some important.
CHAPTER 21: Comparing Two Proportions
Chapter 13 Data Sources, Sampling, and Data Collection.
Research Methodology.
Copyright © 2007 Pearson Education Canada 3-1 Marketing Research Marketing research serves many roles. It can: 1.Link companies with customers via information.
The Natural Inquirer Science Education Journal & Climate Change Education.
Research !!.  Philosophy The foundation of human knowledge A search for a general understanding of values and reality by chiefly speculative rather thanobservational.
Interactive Power Point Evaluating Your Program. Evaluating your Program First – Review the Steps Step 1 ◦State overall objectives Step 2 ◦State desired.
Quantitative Research. Quantitative Methods based in the collection and analysis of numerical data, usually obtained from questionnaires, tests, checklists,
HOW TO WRITE RESEARCH PROPOSAL BY DR. NIK MAHERAN NIK MUHAMMAD.
Quality Assessment July 31, 2006 Informing Practice.
 Descriptive Methods ◦ Observation ◦ Survey Research  Experimental Methods ◦ Independent Groups Designs ◦ Repeated Measures Designs ◦ Complex Designs.
Chapter 4 Marketing Research and Information Systems Dr. Franck VIGNERON.
Question paper 1997.
Copyright © 2013, 2009, and 2007, Pearson Education, Inc. 1 In an observational study, the researcher observes values of the response variable and explanatory.
1. To what extent does the Correctional Education Association College of the Air (CEA/COA): a. Increase rates of participation in postsecondary and.
Surveys.
Canadian Marketing in Action, 6 th ed. Keith J. Tuckwell ©2004 Pearson Education Canada Inc. 3-1 Marketing Research Marketing research serves many roles.
Foundations of Research Survey Research This is a PowerPoint Show Open it as a show by going to “slide show”. Click through it by pressing any key.
1 Chapter 13 Collecting the Data: Field Procedures and Nonsampling Error © 2005 Thomson/South-Western.
Chapter 7 Data for Decisions. Population vs Sample A Population in a statistical study is the entire group of individuals about which we want information.
Center for Learning Outcomes Assessment Indiana State University, Terre Haute, IN The University Learning Outcomes Assessment (UniLOA) Measuring the “rest”
Evaluation Results MRI’s Evaluation Activities: Surveys Teacher Beliefs and Practices (pre/post) Annual Participant Questionnaire Data Collection.
4.1 Statistics Notes Should We Experiment or Should We Merely Observe?
Local Data Collection Strategies for Safety Net Assessment Joel C. Cantor, Sc.D.
How do you know your product “works”? And what does it mean for a product to “work”?
Citizen Satisfaction Survey September 2003 Results Office of the Mayor Program Management Office Nov 6, 2003.
Selection and Formulation of Research Problem DR NORIZA MOHD JAMAL DEPT OF MANAGEMENT, FPPSM.
What is Research Design? RD is the general plan of how you will answer your research question(s) The plan should state clearly the following issues: The.
What Is Sociology? Original Content Copyright © Holt McDougal. Additions and changes to the original content are the responsibility of the instructor.
Chapter 3 Research Design.
2009 TACUSPA Fall Conference October 5, 2009 El Paso, Texas.
Citizen Satisfaction Survey March 2003 Results Office of the Mayor Program Management Office March 28, 2003.
STUDENT DIVERSITY AND HOW IT RELATES TO STUDENT SUCCESS Dr. Michael Conyette.
MGT301 Principles of Marketing Lecture-12. Summary of Lecture-11.
Data Coaching Services Types of Data 1. 2 o Qualitative Data vs. o Quantitative Data o Where do student and teacher data fall within these categories?
Improved socio-economic services for a more social microfinance.
Conducting surveys and designing questionnaires. Aims Provide students with an understanding of the purposes of survey work Overview the stages involved.
Assessing Impact: Approaches and Designs
Research Methods: Concepts and Connections First Edition
Assessing Community Opinions, Strengths, & Needs
Chapter Six Training Evaluation.
Data Collection Methods
Survey Design Steps in Conducting a survey
Evaluating Staff Development Initiatives
Presentation transcript:

Fact: We constantly employ the entire assessment cycle in our daily lives Determining our desired outcomes Designing an assessment methodology Collecting data Data analysis and interpretation Publicly disseminating findings Implementing necessary change Engaging in follow-up assessment

Determining Your Desired Outcomes Student learning outcomes must be grounded in your mission statement What is it you would like students to know, behave like, feel, or “be” as a result of your programs, services, supports?

Asking the right question Your question drives your method. Your question drives who you ask. Your question drives your analysis. Take a minute and write down your question

Asking the right question? How many? How satisfied are you? What are your perceptions? What are your attitudes? What have you learned? What is your experience? What values are reflected in each question?

Asking the right question Edit your question... Now, what is your question?

How will you get an answer? Indirect measures Self report, Surveys, Interviews Direct measures Observations Write down your assessment method

Asking the right question? Will the answer be useful? What decision can I make when I get an answer to my question?

Asking the right people Determining the “group” Identifying the sample random sample, convenience sample Who will you ask? Write down your answer

Asking the right people How many is enough people Sample size and return rate Paper and pencil survey When and how Web based survey When and how

So far What is your question? Who will you ask? What method will you use? What will you do with the results?

Logistics Is certification required for you to conduct the study? Is IRB approval required?

Time frame “When” will it be best to collect data? Single point-in-time (benchmarking, satisfaction, etc.) Longitudinal (measuring growth, learning and development over time)

Doing the Right Analysis Can you “handle the truth?” Correlation vs. Causal Relationships Significance Using demographic variables to refine your findings Simple comparing of means and understanding normal distribution

Contact Information