Kick Off Meeting June 2010

WP6: Overview WP Leader: Province of Asti (in close collaboration with iMpronta) Importance of monitoring and evaluation: assist the project management by providing feedback and aiding accountability track achievements of targets/objectives: is the project coming closer to its objectives or not help in the learning process: sharing and comparing similar experiences highlights what did work, how barriers can be tackled, etc. enhance knowledge about cause and effect relationships provide data for measuring cost-effectiveness of MM measures

WP6: Goals WP Goals: Evaluate local actions (and compare the results internationally) Evaluate in general the impact of the project on the local communities, on the target groups and on the policy level (both at local and international level) Evaluate the process, in order to maintain high quality, look at the whole implementation process, barriers encountered and type of solution found to get around barriers (related to the progress report in WP1)

TaskPartner 1. Definition of the evaluation framework, including the definition and evaluation of sustainability indicators (CO 2, energy consumption) for mobility in BIZ Province of Asti & iMpronta 2. Final evaluation surveyiMpronta, Tartu, EREN, EAP, ALTERnet, SSCCI 3. Collection and comparison of all the local participatory evaluation indicators Province of Asti 4. Comparative evaluation results: barriers, indicators, solutionsiMpronta 5. Provide local indicators and information to the WP leaderTartu, EREN, EAP, ALTERnet, SSCCI 6. Carrying out of two video-audits at each BIZiMpronta 7. Editing of the guide “Boxed Solutions” methodology (English)iMpronta 8. Translation and printing of the guide in the remaining national languages Province of Asti, Tartu EREN, EAP, ALTERnet, SSCCI (only printing) 9. Shooting and editing of the final conference videoSSCCI 10. Organization & leadership of the Intermediate Evaluation Session. Organization, leadership & hosting of the Final Evaluation Conference Province of Asti & SSCCI 11. Preparation & printing of the Final Publishable Report in EnglishiMpronta

WP6: Deliverables D6a: Interim Report D6b: “Boxed Solutions” methodology guide – in all the national languages of the partners, printing a total of 7000 copies D6c: WebCast (video to be published on the web) presenting the most interesting aspects of the final project conference D6d: Two video-audits of each BIZ (to be published on the web) before and after the mobility plan implementation D6e: Final Publishable Report in English– printing and posting of 700 copies

WP6: Monitoring & Evaluation Tools Project Meetings 1. Intermediate Evaluation Meeting (18 th month – October 2011) just before the presentation of the Interim Report to EACI 2. Final Evaluation - International Conference meeting (30 th month – October 2012) at the end of the project MaxSumo A tool to be adopted and adapted to MoMa.BIZ for carrying out the monitoring and evaluation of the various project activities.

WP6: MaxSumo 1 What is MaxSumo Deliverable of the EU project Successful Travel Awareness Campaigns and Mobility Management Strategies completed in October 2009 ( Provides a systematic and standardised evaluation methodology designed for the monitoring and evaluation of mobility projects.

WP6: MaxSumo 2 Why MaxSumo It provides a simple and systematic approach for the project monitoring and evaluation It is the predecessor of SUMO (proven to work in over 100 projects) and has already been tried and tested in projects Possibility to enter the project results in the MaxEva database, which allows the comparison of MoMa.BIZ with other similar European projects Contribution to the development of Mobility Management on a European level as the project results could be used for optimising future work

WP6: MaxSumo 3 MaxSumo Structure The different assessment levels in MaxSumo are divided into four main categories; 1. Intervention framework conditions refer to underlying background conditions in the location where the project is to take place, and characteristics of the group that is the focus of the project. 2. Services provided by the project refer to the different activities and outputs the project provides in order to promote changes in travel behaviour (i.e. what the project is providing to people).

WP6: MaxSumo 4 3. Mobility options offered through the services provided refer to the travel behaviour the project is attempting to persuade the target sample to use (e.g. attempt to switch car drivers to public transport, cycling or walking for some or all of their trips) 4. Overall effects refer to main outcomes of the project with regard to new attitudes and behaviour adopted, and system impacts achieved by a change in behaviour (e.g. reduction in car mileage, CO 2 emissions)

WP6: MaxSumo 4 MaxSumo ASSESSMENT LEVELS Intervention framework conditions External factors A description of the external conditions for the measures. These are the same for all users. Person-related factors Information about the personal situation for different individuals, in order to divide them into target groups, etc. This includes both ‘objective conditions’ (such as distance home-to-work, access to public transport) and ‘subjective conditions’ (such as the individual’s stage of behavioural change and the travel behaviour before the intervention). Assessment of services provided A Project activities and outputs Describes the project effort invested in the measure to change behaviour, such as meetings, material distributed, data systems introduced, decisions on travel policy, etc, and the costs for this. B Awareness of mobility services provided Describes the awareness of the project or the mobility services provided. C Usage of mobility services provided Among those people that are aware of the services, this level describes the usage or the interest shown in the project or mobility services. DSatisfaction with mobility services provided Measures how satisfied users are with the services provided.

WP6: MaxSumo 5 Assessment of mobility options offered E Acceptance of mobility option offered Describes the acceptance of the mobility option offered, by measuring the intent to change behaviour. F Take up of mobility option offered Measures how many test the new mobility option offered i.e. try a new mobility behaviour. G Satisfaction with the mobility option offered Shows if people that have tested the mobility option offered are satisfied with it (often a pre- condition if they are to make it a permanent behavioural change). Overall effects H Long-term attitudes and behaviour Measures how many users, due to the intervention, adopt new attitudes and ultimately change how they travel. ISystem impacts These are the effects that the project or programme is aiming for at a system level e.g. effect on total traffic on an urban road network. It assesses e.g. how much vehicle mileage, emissions, energy consumption or accidents have changed as a result of the change in travel behaviour.

WP6: MaxSumo 6 Adapting of MaxSumo to MoMa.BIZ Two direct groups: Employees/commuters of the local companies (BIZ) Local stakeholders One indirect group: European companies and BIZ & European Mobility Managers So far three monitoring tables have been prepared, one for each of the above mentioned groups, that should guarantee the homogeneity between the data collected at the different BIZ. The project indicators have been incorporated in these tables. 71% of the Project’s Specific Objective indicators are included in them.

WP6: MaxSumo 7 Monitoring & Data Collection Methods Background study of each BIZ Project Website: it is designed so as to provide statistics on its visitors Documentation of the activities carried out and their costs throughout the project implementation. Surveys: home-work survey final evaluation survey satisfaction questionnaires at the end of the training sessions satisfaction questionnaires aimed at the local stakeholders at the end of the project satisfaction survey aimed at the project partners Video-audits before and after the implementation of the local mobility plan.

WP6: MaxSumo 8 How to use the MaxSumo-MoMa.BIZ tables The tables should be used throughout the project duration for monitoring the project activities at the time they are implemented. Collect the data indicated at the tables for each activity. Possible that not all activities are covered, in that case communicate with the Project Coordinator in order to identify the indicators to monitor for the missing activity and for them to be communicated to the consortium (guarantee homogeneity) Communicate the data collected at the Project Coordinator when asked (three times foreseen, each one just before the presentation of the three evaluation reports to EACI)

WP6: Conclusion WP LeaderProvince of Asti Monitoring & Evaluation Tools Project Meetings MaxSumo Monitoring & Data Collection Methods Background study Website Documentation Surveys Video audits Communication of Data to the Project Coordinator January 2011 October 2011 September 2012