1. LOOKING FOR EVIDENCE? A CASE FOR THE CASE STUDY DR. GURU NAGARAJAN DR. SARA BHATTACHARJI

4. Finding Evidence Observation Experiment Quantitative Qualitative

5. Case Studies - Types and Uses Case Reports : disseminate information Case Studies as stories for teaching/HI Case Studies for evaluation Case Studies for research

6. What is Case Study in Research? “The case study research method is an empirical inquiry that investigates a contemporary phenomenon within its real-life context; when the boundaries between phenomenon and context are not clearly evident; and in which multiple sources of evidence are used” (Yin R. K. (2003). Case Study Research - Design and Methods (3rd ed.). Thousand Oaks, London, New Delhi: Sage Publications)

7. GATHERING EVIDENCE/EVALUATION What actually occurred? – Information on what happened is important but evidence is needed to prove the causation Whether it had an impact (expected or unexpected) – Pre and Post measurement works for expected – Challenge is to measure the unexpected Links between programme and its observed impact

8. When to use Case Study? Gather information for planning For unique programmes – Better to start from the beginning Established programme in a new setting – Helps to understand how it worked in a new setting Unique outcome – Substitute with quantitative measurements In an unpredictable environment – Good picture of what worked (facilitating and limiting factors)

9. Is the projected programme unique? Is it premature to establish impact measures? Are the programme impacts too impractical or too difficult to measure? Is there unexplained variation in the programme impacts? Will understanding the programme implementation in detail help anybody design future programmes? When to use Case Study?

10. How to do a case study? Sampling Techniques Random Purposive Convenient

11. How to do a case study? Selecting the respondent Representative of what is studied Knowledgeable and Willing Engage in conversation Help in identifying further respondents

12. How to do a case study? Data collection Who was involved in the programme? What did they do in terms of activities? In what context where they working? When and where did the programme activities take place? Why did participants do what they did? What actions caused the changes?

13. Interviewing Exchange of information What are the ways in which exchange of information takes place?

14. List

15. How to do a case study? Interview Techniques Structured Questionnaires Semi-Structured Interviews Completely Unstructured Interviews Interview protocols or checklist

16. Interviewing Respondents experience the world in unique ways and the objective is not to standardise the experience but to understand it. Good interview protocol shapes the interview without constraining it.

17. How to do a case study? Do’s of Interviewing Listen carefully and follow-up Allow time for interview Summarize what you heard Tape the interview

18. How to do a case study? Dont’s of Interviewing Don’t ask leading questions Don’t ask for yes/no questions

19. ASKING QUESTIONS Questions of clarification What do you mean? Questions that probe assumptions. Is this always the case? Questions that probe reason & evidence. Why do you say so?

20. Questions of clarification What do you mean? Questions that probe assumptions. Is this always the case? Questions that probe reason & evidence. Why do you say so? ASKING QUESTIONS

21. Questions of clarification What do you mean? Questions that probe assumptions. Is this always the case? Questions that probe reason & evidence. Why do you say so? ASKING QUESTIONS

22. Questions about viewpoints and perspectives. Could we look at this issue differently? Questions that probe implication & consequences What would happen if this were done? ASKING QUESTIONS

23. Questions about viewpoints and perspectives. Could we look at this issue differently? Questions that probe implication & consequences What would happen if this were done? ASKING QUESTIONS

24. Type of Questions Open and closed ended questions Closed questions give facts and are easy and quick to answer. The questioner is in control Open questions may receive long answers and take time. They ask the respondent to think and reflect. They give opinions and feelings and the respondent is in control

25. Type of Questions Leading and Neutral questions Turning the answer deliberately in a particular direction. Leading questions include the answer; point the listener in a direction or include some clue to the ‘right’ answer. Neutral questions are not directional and allow the listener to answer freely

26. Leading to Neutral Questions What is the chance that this task will succeed? (L) What obstacles may interfere with this task (N) Isn’t it better to put this project on hold for the time being? What are the points in favour of continuing this project? How do you cope with so many projects at the same time? How can we help you to be more effective with all the projects that you are in charge of?

27. How to do a case study? Tape recording interviews Notes taking can distract Paraphrasing provides weaker evidence Capture good quotes is possible Tape recording is advisable

28. How to do a case study? Transcription Preferable to do transcription but.. Time consuming Alternative option – Interview Log (verbatim of selected paragraphs or statements)

29. How to do a case study? Observation Supplement to interviews Maintain field notes (factual statements, relevant quotes and useful information)

30. How to do a case study? Document Reviews Can guide the development of the interview protocol Confirm comments made by participants

31. Data Analysis and Interpretation Challenges and opportunities Dual role of an evaluator (chief data collector and data analyst) Helps in digging more information

32. Data Analysis and Interpretation Start data analysis and collection concurrently Start building theory from first information analysis Confirm the first theory through subsequent interviews Writing should start at the beginning

33. Data Analysis and Interpretation Use of computer programmes Computer programmes eg: NVivo, Ethnograph One need not use a computer programme for a small evaluation of a minor programme

34. Data Analysis and Interpretation Interpretation Make judgments about the links between the programme and impacts Uncertainty to be acknowledged

35. Sources of Error Inaccuracies Bias Competing Explanations Selection Mistakes

36. Presentation Make it concise What are the key findings? What does the reader needs to know? Create a transparent path of inference

37. Ethical Considerations Consent Confidentiality

38. Summing Up Useful if used appropriately and done well Useful if the programme is –Unique, unique outcomes, unpredictable context Key to successful case study –Well designed data collection and analysis and interpretation