Presentation on theme: "Evolution of Web Surveys at USDAs National Agricultural Statistics Service United States Department of Agriculture National Agricultural Statistics Service."— Presentation transcript:
Evolution of Web Surveys at USDAs National Agricultural Statistics Service United States Department of Agriculture National Agricultural Statistics Service Gail Gregory & Morgan Earp A presentation for the International Conference of Establishment Surveys, June 2007
Overview Background of NASS Web Response Rates over time. Web Respondent comments at two different time periods. Internet Usage Project-reasons why respondents dont report on the Web.
Survey Nations farms, ranches, agri-businesses Analyze, summarize data and set official estimates for all facets of agriculture HQ in Washington, DC and 46 field offices National Agricultural Statistics Service (NASS)
Up to 400 surveys a year Mixed-mode - some versions optimized for certain modes Annually, quarterly, monthly, weekly Diverse in terms of mode used (State to State) NASS Surveys
Evolution of the NASS Web Instruments Began Web Surveys in Cotton Ginnings Report Currently 125 surveys on line. Two distinct populations Agribusinesses Farmers/Ranchers
Web Response Rates Overall Web Response rate is 1.8%. Almost 1.5 million samples uploaded and over 27,000 completed. While the sample size uploaded to the Website is known, it is not known how many respondents were sent an invitation and instructions to complete the survey on the Web.
Web Response Rates over Time By July , 57 Surveys on the Web. Overall Response Rate was 1.7% Response Rate for surveys targeting Farms/Ranches 1.2% Response Rate for surveys targeting Agribusinesses 6.6% By February , 125 Surveys on the Web. Overall Response Rate was 1.8% Response Rate for surveys targeting Farms/Ranches 1.3% Response Rate for surveys targeting Agribusinesses 8.2%
Summary of Comments Respondent comments from all Web surveys from July 1, 2005 until January 30, 2007 were coded and summarized. Each of the 1,278 comments from 108 Web surveys was recorded into one of the following categories: Liked Web Site Web Complaints Survey Complaints Survey Comments Survey Refusal No Comment Called before chance to do on the Web Got someone elses Survey Code
Categories of Web Data Collection Site Responses Category Number of Comments 2007 Percentage of Comments 2007 Number of Comments 2005 Percentage of Comments 2005 Liked Web Site Web Complaints Survey Complaints Survey Comments Survey Refusal Reported No Comment Called too Early221.7___ Got incorrect Survey Code30.2___ Total1,
Web Complaints By Number and Percentage CategoryNumber of Comments 2007 Percentage of Comments 2007 Number of Comments 2005 Percentage of Comments 2005 Experienced Log In Problems Long Download Time Problems Printing Lack of Edits No use of Previously Reported Data Web does not Match the Paper Form Received Miscellaneous Errors Paging Issues Data did not stay in the Form Navigational Problems Want Survey Code and/or Survey Results ed Total
Survey Complaints By Number and Percentage CategoryNumber of Comments 2007 Percentage of Comments 2007 Number of Comments 2005 Percentage of Comments 2005 Questionnaire Complaints Security Concerns about SSN Survey Purpose Unclear Total
Initial Results from the Internet Usage Project Investigated why more respondents do not complete their surveys on the Internet. Questions were added to 3 surveys to discover why respondents didnt complete their survey on the Web. The surveys were: December 2005 Cotton Ginnings October 2006 Labor Survey (Blaise only) March 2007 Agricultural Survey (Blaise only)
Internet Usage Project Cotton Ginnings Agribusinesses Labor Very large Farms/Nurseries Small Farms March Agricultural Survey Large Crop Farms Small Crop Farms
Internet Usage Questions The three questions asked on the surveys were: 1.Do you have access to the Internet? Yes Don't Know No 2.[if 1 = Yes] Did you know this survey can be completed on the Internet? Yes Don't Know No 3. [if 2 = Yes] What was the main reason why you did not complete this survey on the Internet?
Results of Internet Usage Project 1-Do you have access to the Internet? Survey No. of States YesNoDont Know Total CountPercentCountPercentCountPercent Cotton Ginnings Agricultural Labor462, , ,509 Agricultural Survey4818, , , ,504
2- Did you know this survey can be completed on the Internet? Survey No. of States YesNoDont Know Total CountPercentCountPercentCountPercent Cotton Ginnings Agricultural Labor , ,734 Agricultural Survey486, , ,172
Coded Reasons for not Responding on the Web CodeReason Description Agricultural Survey Agricultural Labor Cotton Ginnings CountPercentCountPercentCountPercent 1Other modes (telephone, fax) are quicker or easier Does not like using computers / Internet.1, Problem with the NASS EDR Website Prefers a telephone call Telephone call is prompt to complete survey Did not have enough time. / Too busy.1, Competition for use of computer User problem with computer Fear of computer viruses (claimed) Completed on-line Web notice was sent out too late The letter said someone would call Did not think Survey applied to them Other reason No reason given Total6,
Reasons for Not Completing the Survey on the Web By Type of Farm (Crop/Livestock)
Some Reasons for Not Completing the Agricultural Labor Survey on the Web by Value of Farm Sales
For the Future Adequately train all Field Office personnel as to the importance of Web data collection. Ensure that potential respondents know that the Web is an option, especially highlighting it in a cover letter. Provide well tested Edits in Web Surveys.