Presentation is loading. Please wait.

Presentation is loading. Please wait.

Using an Odometer and a GPS Panel to Evaluate Travel Behaviour Changes Peter Stopher and Natalie Swann Institute of Transport and Logistics Studies The.

Published byHubert Robinson Modified over 8 years ago

Similar presentations

Presentation on theme: "Using an Odometer and a GPS Panel to Evaluate Travel Behaviour Changes Peter Stopher and Natalie Swann Institute of Transport and Logistics Studies The."— Presentation transcript:

1 Using an Odometer and a GPS Panel to Evaluate Travel Behaviour Changes Peter Stopher and Natalie Swann Institute of Transport and Logistics Studies The University of Sydney and Camden FitzGerald Parson Brinkerhoff, Sydney April 2007

2 Using an Odometer and a GPS Panel to Evaluate... 2 Introduction  Policies often aimed at changing travel behaviour  Rarely are the changes monitored to see if the policy was successful  Often the changes expected are within the error levels of self- report surveys

3 April 2007Using an Odometer and a GPS Panel to Evaluate... 3 Introduction  A policy of major interest in Australia is Voluntary Travel Behaviour Change (VTBC or TravelSmart)  Based on improving household information about alternatives to current travel  Expectation is that it will result in reduced VKT by private car and possibly increased walk, bicycle, transit use, and car occupancy

4 April 2007Using an Odometer and a GPS Panel to Evaluate... 4 Introduction  TravelSmart is a relatively cheap strategy compared to capital projects  Would be very cost-effective if it reduced car VKT by even 3-4 percent  Standard diary surveys have been shown to be in error by 20 percent or more on average  Self-reporting of distance travelled is potentially even more in error

5 April 2007Using an Odometer and a GPS Panel to Evaluate... 5 An Innovative Approach  Use of panels to monitor change  Measurement of the panel begins prior to policy introduction  Panel continues until some period of time after introduction  Method one – quarterly odometer survey  Method two – annual or semi- annual GPS survey

6 April 2007Using an Odometer and a GPS Panel to Evaluate... 6 An Innovative Approach  Panels – recruit households who are asked to repeat the survey at prescribed intervals  Attrition – recruit additional households in each wave  Panel reduces error in measuring change  Panel members report changes in demographics on each wave

7 April 2007Using an Odometer and a GPS Panel to Evaluate... 7 An Innovative Approach  Odometer survey – request households to provide current odometer readings from each household vehicle and the date on which they take the reading  If a car is bought or sold, then beginning/ending odometer reading is requested and date of acquisition/sale  Readings are requested every quarter

8 April 2007Using an Odometer and a GPS Panel to Evaluate... 8 An Innovative Approach  GPS survey involves carrying a GPS device for up to 28 days  Everyone over age 14 in household is asked to take a device  Survey is repeated either annually or semi-annually

9 April 2007Using an Odometer and a GPS Panel to Evaluate... 9 An Innovative Approach  Three elements to the pilot evaluation  Quarterly odometer panel of 200 households in South Australia and 200 in Victoria  Six-monthly 28-day GPS survey of 50 households in South Australia  Focus groups on participants in GPS panels  Six waves of the odometer panel completed  Two waves of GPS panel completed  Focus Groups completed

10 Odometer Surveys

11 April 2007Using an Odometer and a GPS Panel to Evaluate... 11 Odometer Pilots Six waves completed

12 April 2007Using an Odometer and a GPS Panel to Evaluate... 12 Odometer Panels Response rates were as follows: Returned/Estimated Eligible (%) W1W2W3W4W5W6 SA New Recruit HHs 25.315.518.9NA Continuing HHs NA89.888.190.690.189.8 VIC New Recruit HHs 17.819.5NA12.7NA Continuing HHs NA88.387.488.588.389.3 Overall, similar patterns of recruitment and response in Melbourne and Adelaide

13 April 2007Using an Odometer and a GPS Panel to Evaluate... 13 Odometer Panels - Response Comparison * These are all TravelSmart households Negligible difference between 3 month and 4 month frequency Returned/Estimated Eligible (%) W1W2W3W4W5W6 SA Main New Recruit HHs 30.617.725.236.311.2*NA Continuing HHs NA90.191.692.388.7NA Add On SA New Recruit HHs 25.315.518.9NA Continuing HHs NA89.888.190.690.189.8 Add On VIC New Recruit HHs 17.819.5NA12.7NA Continuing HHs NA88.387.488.588.389.3

14 April 2007Using an Odometer and a GPS Panel to Evaluate... 14 Odometer Panels – Demographic Bias? The demographic profile of the sample from wave to wave is remarkably stable. There may be some coverage error, which can be corrected by applying weighting factors, but there does not appear to be any systematic non-response error.

15 April 2007Using an Odometer and a GPS Panel to Evaluate... 15 Odometer Panels – Elapsed Time – SA Attribute Waves 2-1 Waves 3-2 Waves 4-3 Waves 5-4 Waves 6-5 Waves 6-1 Elapsed Days 113.5598.4390.35100.4868.41471.25 Standard Deviation in Days 31.7711.389.2711.176.4432.43 No. of Valid Observations 260308331318321207 No. Missing/Refused 66 (20%) 92 (23%) 104 (24%) 114 (26%) 116 (27%) 113 (35%) Total No. of Vehicles 326400435432437320

16 April 2007Using an Odometer and a GPS Panel to Evaluate... 16 Odometer Panels – Elapsed Time – Victoria AttributeWaves 2-1 Waves 3-2 Waves 4-3 Waves 5-4 Waves 6-5 Waves 6-1 Elapsed Days 99.78101.6193.2295.6966.10454.62 Standard Deviation in Days 35.2913.2211.0210.4812.0634.01 No. of Valid Observations 274262272279282235 No. Missing/Refused 97 (26%) 143 (35%) 129 (32%) 138 (33%) 140 (33%) 126 (35%) Total No. of Vehicles 371405401417422361

17 April 2007Using an Odometer and a GPS Panel to Evaluate... 17 Odometer Panels – Average VKT – SA Attribute Waves 2- 1 Waves 3-2 Waves 4-3 Waves 5-4 Waves 6-5 Waves 6-1 Average Daily VKT31.4632.9630.1630.3529.1829.42 Standard Deviation25.7145.8527.9634.3621.2620.38 No. of Valid Observations 260308331318321207 No. Missing/Refused 66 (20%) 92 (23%) 104 (24%) 114 (26%) 116 (27%) 113 (35%) Total No. of Vehicles 326400435432437320

18 April 2007Using an Odometer and a GPS Panel to Evaluate... 18 Odometer Panels – Average VKT –Victoria Attribute Waves 2- 1 Waves 3-2 Waves 4-3 Waves 5-4 Waves 6-5 Waves 6-1 Average Daily VKT31.4232.3529.8429.0730.7931.48 Standard Deviation20.8619.3318.2417.3419.9017.79 No. of Valid Observations 274262272279282235 No. Missing/Refused 97 (26%) 143 (35%) 129 (32%) 138 (33%) 140 (33%) 126 (35%) Total No. of Vehicles 371405401417422360 Strong evidence of success in collecting Odometer readings – not Trip meter readings

19 April 2007Using an Odometer and a GPS Panel to Evaluate... 19 Odometer Survey - Conclusions  Method works in both a small and large urban area  Response rates are higher than normal for a postal survey  Good evidence for successful reporting of Odometer readings and not trip-meter readings  The sample does not become more biased over time, although rotation of the panel may still be preferable.

20 GPS Surveys

21 April 2007Using an Odometer and a GPS Panel to Evaluate... 21 GPS Panel  Set up as 50 households in SA  Two waves conducted with 28-day task, six months apart  Third wave set up with 15-day task, six months later

22 April 2007Using an Odometer and a GPS Panel to Evaluate... 22 GPS Panels Panel WaveSA Panel (50) Wave 1Wave 2“Wave 3” Recruited (New to the wave)57170 Completed50140 Continuing (Recruited)3544 Continuing (Completed)--3236 Total Complete Households504636 Households Failing to comply4 (8%)4 (9%)1 (3%)

23 April 2007Using an Odometer and a GPS Panel to Evaluate... 23 GPS Panels – Days of Data by Person Number of DaysWave 1 Pilot Panel (50) Wave 2 Pilot Panel (46) All Days1 (1%)39 (44%) Up to 6 days per week13 (12%)21 (24%) 5 to less than 6 days10 (10%)7 (8%) 3 to less than 5 days27 (25%)8 (9%) 1 to less than 3 days32 (30%)9 (10%) More than 0 and less than 124 (22%)5 (6%) Total10789 (100%)

24 April 2007Using an Odometer and a GPS Panel to Evaluate... 24 GPS Survey Analysis  Analysis has been done at several levels  Disaggregate – person by day  Aggregated to days of the week  Aggregated to persons  Aggregated further to households  In wave 2, some households overlapped the Easter Holidays  Person days that appeared to have extensive travel on one or two days in the period were dropped from disaggregate analysis

25 April 2007Using an Odometer and a GPS Panel to Evaluate... 25 GPS Panel – Trip Data Per Person Day Statistic (sd in brackets) Wave 1 PanelWave 2 Panel* All Days Week- days Week- ends All Days Week- days Week- ends Number of Valid Obs.1571111645519681397571 Mean Number of Trips3.85 (3.44) 3.64 (3.30) 4.35 (3.71) 3.80 (3.74) 3.68 (3.71) 4.07 (3.80) Mean PKT25.6 (33.0) 24.1 (31.79) 29.2 (35.5) 25.8 (36.36) 25.0 (34.37) 27.6 (40.81) Mean Travel Time55.3 (51.6) 53.0 (50.36) 60.8 (54.10) 50.6 (52.24) 49.8 (51.89) 52.7 (53.08) * 4 households were found to have undertaken excessive (probably holiday) travel on two or more days around the Easter period in 2006 and were excluded from these statistics

26 April 2007Using an Odometer and a GPS Panel to Evaluate... 26 GPS Panel – Trip Data Per Person by Day of Week Statistic (sd in brackets) Wave 1 PanelWave 2 Panel All Days Week- days Week- ends All Days Week- days Week- ends Number of Valid Obs.509364145551394157 Mean Number of Trips3.96 (2.37) 3.77 (2.22) 4.44 (2.65) 3.99 (2.61) 3.90 (2.59) 4.21 (2.62) Mean PKT25.0 (22.73) 23.3 (22.49) 29.2 (22.86) 29.3 (37.96) 28.7 (40.15) 30.8 (31.86) Mean Travel Time54.8 (38.14) 52.2 (37.26) 61.5 (39.59) 51.8 (41.85) 51.0 (42.30) 54.0 (40.73) Note that even the large values are included in Wave 2.

27 April 2007Using an Odometer and a GPS Panel to Evaluate... 27 GPS Panel – Trip Data Per Person by Day of Week Note that even the large values are included in Wave 2. Statistic (sd in brackets) Wave 1 PanelWave 2 PanelWave 1-Wave 2 Covariance All Days Number of Valid Obs. 797342 Mean Number of Trips 3.91 (1.77) 3.96 (1.58) 1.66 Mean PKT 24.7 (15.80) 25.0 (14.76) 69.6 Mean Travel Time 48.8 (25.55) 54.7 (24.45) 246.4

28 April 2007Using an Odometer and a GPS Panel to Evaluate... 28 GPS Panels – Trip Data Per Household Statistic (sd in brackets) Wave 1 Pilot Panel Wave 2 Pilot Panel Wave 1-Wave 2 Covariance All Days Number of Valid Obs.414328 Mean Number of Trips per person 4.06 (1.50) 3.94 (1.64) 2.11 Mean PKT24.8 (14.03) 24.3 (12.52) 92.1 Mean Travel Time54.9 (22.94) 47.8 (20.70) 273.3

29 April 2007Using an Odometer and a GPS Panel to Evaluate... 29 GPS Duration  Panel Survey suggests that:  Recruitment rates are not affected much between 7 and 28 days  Also, early drop out is not much affected by the length of GPS recording  Statistics tend to stabilise after about 10- 12 days  We have determined that there is no halo effect in the first few days  Ideal appears to be a 15-day GPS

30 April 2007Using an Odometer and a GPS Panel to Evaluate... 30 GPS Frequency  Attrition for three waves of the six-monthly GPS was not markedly different than for two waves of the annual GPS survey  Annual participants have received interim mailings  Non-compliance rate is about double in the annual survey (8% versus under 4%)

31 Focus Groups

32 April 2007Using an Odometer and a GPS Panel to Evaluate... 32 Focus Groups - Themes Six themes were derived from the group discussions: 1.Respondents’ understanding of the survey task; 2.The form and functions of the devices; 3.Patterns of respondent behaviour in undertaking the task; 4.Reactions to the survey documents and survey administration; 5.Respondent attitudes and perceptions of issues relevant to the study; and 6.Curiosities about the study displayed by respondents.

33 April 2007Using an Odometer and a GPS Panel to Evaluate... 33 Focus Groups - Outcomes  Newsletter - to encourage and educate respondents  Sourcing new devices – to improve performance  Refining survey documentation – to further clarify the GPS task

34 April 2007Using an Odometer and a GPS Panel to Evaluate... 34 Conclusions  Both panel surveys are feasible methods  Odometer survey can show small differences in average VKT with suitable sample sizes  GPS survey can provide a much greater wealth of data on effects of the policy  Other work shows much smaller sample sizes are required for GPS versus Odometer

Download ppt "Using an Odometer and a GPS Panel to Evaluate Travel Behaviour Changes Peter Stopher and Natalie Swann Institute of Transport and Logistics Studies The."

Similar presentations

UK hours measures from different sources – a comparison Mari Kangasniemi.

UK hours measures from different sources – a comparison Mari Kangasniemi.
MICS 3 DATA ANALYSIS AND REPORT WRITING. Purpose Provide an overview of the MICS3 process in analyzing data Provide an overview of the preparation of.

MICS 3 DATA ANALYSIS AND REPORT WRITING. Purpose Provide an overview of the MICS3 process in analyzing data Provide an overview of the preparation of.
Key Steps to running a survey. Aims and Objectives Have clear aims and objectives for the project. Ensure you know what you want to get out of the survey.

Key Steps to running a survey. Aims and Objectives Have clear aims and objectives for the project. Ensure you know what you want to get out of the survey.
Copyright © D&D Research, 2010 Structured evaluation of the efficiency of POC project Complex quantitative research report March – April 2010.

Copyright © D&D Research, 2010 Structured evaluation of the efficiency of POC project Complex quantitative research report March – April 2010.
Grandparenting and health in Europe: a longitudinal analysis Di Gessa G, Glaser K and Tinker A Institute of Gerontology, Department of Social Science,

Grandparenting and health in Europe: a longitudinal analysis Di Gessa G, Glaser K and Tinker A Institute of Gerontology, Department of Social Science,
A1: Surveys for Behavioural Experiments Peter Jones, CTS, UCL Regine Gerike, TUD Giorgia Servente, Polito, TO.

A1: Surveys for Behavioural Experiments Peter Jones, CTS, UCL Regine Gerike, TUD Giorgia Servente, Polito, TO.
The National Household Travel Survey Heather Contrino US Department of Transportation Federal Highway Administration, Office of Highway Policy Information.

The National Household Travel Survey Heather Contrino US Department of Transportation Federal Highway Administration, Office of Highway Policy Information.
An Assessment of the Impact of Two Distinct Survey Design Modifications on Health Insurance Coverage Estimates in a National Health Care Survey Steven.

An Assessment of the Impact of Two Distinct Survey Design Modifications on Health Insurance Coverage Estimates in a National Health Care Survey Steven.
1 Fieldwork logistics and data quality control procedures Kathleen Beegle Workshop 17, Session 2 Designing and Implementing Household Surveys March 31,

1 Fieldwork logistics and data quality control procedures Kathleen Beegle Workshop 17, Session 2 Designing and Implementing Household Surveys March 31,
Putting Research Evidence to Work Research Seminar 14 th January 2009.

Putting Research Evidence to Work Research Seminar 14 th January 2009.
Www.shadac.org Challenges to Surveys Non-response error –Falling response rates over time Sample coverage –Those without landline telephones excluded –Growing.

Challenges to Surveys Non-response error –Falling response rates over time Sample coverage –Those without landline telephones excluded –Growing.
GCSE Sociology Research Methods.

GCSE Sociology Research Methods.
Introduction Ashton Hayes is aiming to become England’s first carbon neutral village. Carbon neutrality will be achieved when sources of carbon dioxide.

Introduction Ashton Hayes is aiming to become England’s first carbon neutral village. Carbon neutrality will be achieved when sources of carbon dioxide.
The Effort to Develop Disability Questions for the Current Population Survey Terence M. McMenamin U.S. Bureau of Labor Statistics October 5, 2006.

The Effort to Develop Disability Questions for the Current Population Survey Terence M. McMenamin U.S. Bureau of Labor Statistics October 5, 2006.
Consumer Expenditure Survey Redesign Jennifer Edgar Bureau of Labor Statistics COPAFS Quarterly Meeting March 4, 2011.

Consumer Expenditure Survey Redesign Jennifer Edgar Bureau of Labor Statistics COPAFS Quarterly Meeting March 4, 2011.
USE OF PEAK FLOW METER AS AN OBSERVATION AND TEACHING TOOL IN AN EDUCATIONAL PROGRAM IN WOMEN WITH ASTHMA Noreen M. Clark, Molly Z. Gong, Martha B. DeRoeck,

USE OF PEAK FLOW METER AS AN OBSERVATION AND TEACHING TOOL IN AN EDUCATIONAL PROGRAM IN WOMEN WITH ASTHMA Noreen M. Clark, Molly Z. Gong, Martha B. DeRoeck,
National Consumer Agency Market Research: Economiser – Transport Section February 2011 Research Conducted by.

National Consumer Agency Market Research: Economiser – Transport Section February 2011 Research Conducted by.
Geographic Profiling in Australia – An examination of the predictive potential of serial armed robberies in the Australian Environment By Peter Branca.

Geographic Profiling in Australia – An examination of the predictive potential of serial armed robberies in the Australian Environment By Peter Branca.
Eurostat Repeated surveys. Presented by Eva Elvers Statistics Sweden.

Eurostat Repeated surveys. Presented by Eva Elvers Statistics Sweden.
Using survey data collection as a tool for improving the survey process Silvia Biffignandi, Antonio Laureti Giulio Perani University of Bergamo Istat Istat.

Using survey data collection as a tool for improving the survey process Silvia Biffignandi, Antonio Laureti Giulio Perani University of Bergamo Istat Istat.

Similar presentations

Ads by Google