1. Conducting the eCRC Survey A Practical Guide The Asia Foundation, Dambulla, September 1-4, 2013

2. DREAMERS LEARNERS DOERS DOUBTERS Meeting Expectations

3. SESSION 1 The Asia Foundation, Dambulla, September 1-4, 2013 Methodology of eCRC

4. The Key Steps… 1.Identifying services & issues– Which services and what to study? 2.Determining the sample – Whom to ask? 3.Designing the questionnaire – What to ask? 4.Conducting the survey – How to collect information? 5.Analyzing the information – What to report? 6.Using the information – How to use the findings to improve services? The Asia Foundation, Dambulla, September 1-4, 2013

5. What services are we looking at LG Regulatory Services (10) LG Common Services (10) Local Infrastructure (9) The Asia Foundation, Dambulla, September 1-4, 2013

6. 1. Local Infrastructure What do we want to know? - meeting community priority - quality of construction - time taken to complete the work - availability of information - performance of the contractor - awareness & performance of SACs - community participation Whom do we ask? - Immediate beneficiaries The Asia Foundation, Dambulla, September 1-4, 2013

7. 1. Local Infrastructure (Contd.) What type of information / analysis are we interested in? - variations of experiences across a. LAs b. GN Divisions (within a LA) c. Type of infrastructure d. Value of contract e. Contractors The Asia Foundation, Dambulla, September 1-4, 2013

8. 2. LG Common Services What do we want to know? - Availability of service - Usage of service - Quality of service - Reliability of service - Satisfaction with service ` Whom do we ask? - Users (in a household) The Asia Foundation, Dambulla, September 1-4, 2013

9. 2. LG Common Services (Contd.) What type of information / analysis are we interested in? - variations of experiences across a. LAs b. GN Divisions (within a LA) c. Gender d. Age e. Ethnicity f. Economic status g. Distance of residence from centre The Asia Foundation, Dambulla, September 1-4, 2013

10. 3. LG Regulatory Services What do we want to know? - Availability of information - Ease of applying - Process time - Satisfaction with service ` Whom do we ask? - Users The Asia Foundation, Dambulla, September 1-4, 2013

11. 3. LG Regulatory Services (Contd.) What type of information / analysis are we interested in? - variations of experiences across a. LAs b. GN Divisions (within a LA) c. Gender d. Ethnicity e. Economic status f. Distance of residence from centre The Asia Foundation, Dambulla, September 1-4, 2013

12. Understanding the Questionnaire Components of questionnaire Enumerator information Introduction Filter / qualifiers questions Demographics The body of the schedule - sections if needed - sub- schedules if required 12 The Asia Foundation, Dambulla, September 1-4, 2013

13. Ayubowan! I am ……… from the ……LA. This is my identity card. We are currently conducting a survey on the services provided by the LA. We are conducting interviews at over 1500 households and your house is one of them that was chosen by chance from this area. We would like to discuss your experiences with these services. Information from this interview will be used to study and improve the services and will not be used for any other purpose. Your identity will be kept confidential and your name will not be recorded here. This survey will take about 10 minutes. May I please talk with you or any other adult member in the family who can give me information on the services? Introduction*** The Asia Foundation, Dambulla, September 1-4, 2013

14. What not to do during an introduction! 14 In a previous CRC, an enumerator introduced himself by saying, “We are here to find out what problems you face when using services provided by the government.” This introduction immediately communicates a biased tone to the interview. Let the respondent tell you about their experience with service delivery—not the other way around! The Asia Foundation, Dambulla, September 1-4, 2013

15. Section 3 – Filter Questions “Have you, or anyone in your family, visited a Trade Licence Office in the past one year?” Yes [continue with interview] No [terminate interview] 15 Filters/ Qualifiers

16. Section 4 – Demographics Basic information about the household/respondent – age, gender, ethnicity, economic status, etc. 16

17. Sampling Population: The complete collection of individuals or objects that are of interest to us. Sample: A subset of the population which can help us study the population 17

18. Size of the sample has no meaning after a certain number Sample should be representative How? Sampling techniques: Ex: Simple Random Sampling Stratified sampling Cluster sampling etc… Some Simple Rules

19. Population – (People who live in the Eastern Province) Sampling (FOR COMMON SERVICES)

20. 1326 5 781094 11131216 15 1718201914 21232226 25 2728 30 2924 Simple Random Sampling (SRS) Randomly select 12 people Generate 12 random numbers between 1 – 30 11, 28, 4, 2, 21, 13, 19, 26, 16, 7, 23,30 Sample size - 12

21. Stratified Sampling Identify possible Strata

22. Strata Proportionately allocate people from strata ( 4 from each stratum). Then apply SRS Batti Ampara Kalmunai

23. How do we sample within a LA 2 methods a.Scientific Method – PPS b.Quick Method – Social Mapping 23 The Asia Foundation, Dambulla, September 1-4, 2013

24. What is PPS? Probability Proportionate to Size (PPS) -Selecting sample within a strata in the same proportion as they are represented in the population. -E.g., Ethnicity, location, 24 The Asia Foundation, Dambulla, September 1-4, 2013

25. How do we do a PPS selection a.First allocate the total sample for the LA (1500) across the GN Divisions using PPS b.Within each GND, select the sample on the basis of a pre determined criteria – ethnicity, location, economic status c.Randomly select households keeping the quotas in mind ….Let us see an example 25 The Asia Foundation, Dambulla, September 1-4, 2013

26. NUWARA ELIYA Municipal Council Ethnicity GN. DivisionsSinhalese SL Tamil Indian Tamil MoorOtherTotal 535 - Nuwara Eliya10574026 535A - Magasthota16212021 535B - Kalukele13101015 535C - Kelegala13741025 535D - Nuwara Eliya Central3511125164 535E - Sandathenna145181038 535F - Hawaeliya West14624026 535G - Hawaeliya North18972036 535H - Hawaeliya East181022132 535I - Bulu Ela14423023 535K - Bambarakele185222148 535L - Nuwara Eliya West1210121035 535M - Shanthipura15211018 535N - Kalapura911222044 Total21788110315450

27. Quick Method a.First allocate the total sample for the LA (1500) across the GN Divisions using PPS b.Within each GND, select the sample on the basis of a clusters (diversity) c.Select sample households randomly within each cluster 27 The Asia Foundation, Dambulla, September 1-4, 2013

28. SAMPLING (FOR REGULATORY) 3 Methods a.Census of HHs within GN Division b.Tracer Interviews c.Exit Interviews / Intercept Interviews 28 The Asia Foundation, Dambulla, September 1-4, 2013

29. 1. Census of HHs in a LA a.Quick survey of all HHs to identify which HHs have used which of the 10 services. b.Target HHs where maximum number of services have been used. c.Proceed with the list till you get the required number for all services (50 respondents per service) 29 The Asia Foundation, Dambulla, September 1-4, 2013

30. 2. Tracer Interviews a.Obtain a list of all users of a service who applied /interacted during the last 1 year. b.Generate a random list of 50 names from the list c.Carry out the interview for the identified names 30 The Asia Foundation, Dambulla, September 1-4, 2013

31. 3. Exit/ Intercept Interviews a.Stand outside the centre/facility b.Interview persons coming out at a pre- determined frequency (every 3 rd person) – first determine the average number of transactions per day. c.Ensure that the quota is obtained (50) 31 The Asia Foundation, Dambulla, September 1-4, 2013