1. Collaboration & Data Collection TechnologyOctober 2014Butler Institute for Families Visionary Evaluation for a Sustainable, Equitable Future AEA Roundtable Session October 16, 2014 Presented by: Salvador Armendariz and Anna deGuzman Butler Institute for Families, University of Denver

2. Collaboration & Data Collection TechnologyOctober 2014Butler Institute for Families Purpose To get us thinking about ways in which we can harness the power of technology in the evaluation process to create a more inclusive collaborative environment among evaluation and/or project partners as well as those individuals and communities from whom we obtain information through data collection.

3. Collaboration & Data Collection TechnologyOctober 2014Butler Institute for Families Summary of Collaboration Tools Presented Online project management software that allows for real-time collaboration and contains organizational tools such as calendars, Gantt charts, message threads, file storage, and automatic task reminders. Online collaboration tool to design, export, and share diagrams such as flow charts, logic models, organizational charts, etc. Teleconferencing software to host, manage, record, store, and share interactive video calls and meeting materials.

4. Collaboration & Data Collection TechnologyOctober 2014Butler Institute for Families Summary of Data Collection Tools Presented Online software to create and distribute surveys, manage distribution lists and messages, and produce reports. Online software to conduct live polls via text, web browser, or Twitter and present results to audience in real time. Software to design, manage, and distribute automated phone surveys, collect data, and produce reports. Software to collect geo-referenced data through hand-held GPS device or Smartphone, manage data, and produce data visualization displays. Online software to observe and record PC user interactions while collaborating with your research team and highlighting observations in real time. Software to conduct and gather data from interactive online groups such as focus groups, discussion boards, chat groups, and webcam groups. Customizable voice to text software to streamline qualitative data collection process.

5. Collaboration & Data Collection TechnologyOctober 2014Butler Institute for Families Functions to look for (Collaboration tools) Ability to communicate in various ways (orally, written, visual) Ability to share and collaborate on work Widely/easily accessible Easy to use Ability to automate and customize

6. Collaboration & Data Collection TechnologyOctober 2014Butler Institute for Families Functions to look for (Data collection tools) Ability to reach participants and collect data through various methods (text, phone, internet, Smartphone, tablets, GPS) Ability to collect different types of data (qualitative, quantitative, visual text, speech) Ability to collect data with or without network connection As non-intrusive as possible Widely/easily accessible Easy to use Ability to automate and customize

7. Collaboration & Data Collection TechnologyOctober 2014Butler Institute for Families Other factors to consider What hardware, software, and type of network connection do you and/or your users need and how will it be obtained? What is the likelihood participants will be willing or able to use it? How easy is it for the evaluator and the participant to learn how to use it? How easily can it be used “on the go”? What are the privacy and safety risks? What measures will you take to reduce these risks? What are the IRB or human subjects research considerations? How much does it cost? (remember many offer free versions, free trials, and a variety of pricing options including nonprofit, educational, and new customer discounts) Some companies are willing to customize their tools for your field or project

8. Collaboration & Data Collection TechnologyOctober 2014Butler Institute for Families These technologies are useful for: Geographically dispersed Visual communication useful when language or cultural barriers exist Some of these tools support different languages Various methods of communication helpful for people with disabilities or with mobility challenges Diagrams helpful in communicating complex ideas to various groups Some of these tools can be customized for those who cannot read/write Various data collection methods (text, phone, internet, mobile) accommodate for different availability of devices and network connections

9. Collaboration & Data Collection TechnologyOctober 2014Butler Institute for Families Limitations of these tools Must have reliable internet Must have access to computer/device Must be technologically savvy There is usually a learning curve Must get buy-in from users Must use consistently or it will likely fail Not all of these tools accommodate various languages Some of these data collection tools can be considered intrusive Some of these data collection tools can be easy for users to ignore Some of these tools may not be practical/feasible for some fields Nothing beats face-to-face communication

10. Collaboration & Data Collection TechnologyOctober 2014Butler Institute for Families Lessons learned in using these tools Buy-in is key: you can champion use of a technology, but if no one actually uses it, then it’s a waste Try, try again: figure out why folks aren’t using a technology and offer alternatives Use what you have and make it work: Especially if your organization has an existing, paid-for technology