THE MYSTERY OF GETTING RESEARCH INTO USE… THE ONGOING MYSTERY OF GETTING RESEARCH INTO USE

THE MYSTERY OF GETTING RESEARCH INTO USE… WHAT WILL SUCCESS LOOK LIKE? BE VERY SPECIFIC….GENERICS BANNED 1.What are indicators you can use to show progress and success? 2.What systems and processes will you use to gather and analyse across the project team? 3.TWO challenges of showing policy influence of IEs 4.ONE TOP TIP to help others monitor policy influence more smartly

KNOWLEDGE GENERATED  Producing high quality research to fill key knowledge gaps DISSEMINATION AND ENGAGEMENT EVENTS  Number of meetings with government officials  Number of meetings with leading academics.  Dissemination conferences  Presentation of findings at health and water conferences.  talks given on the paper by PIs.  High level meetings with major stakeholders  Number of different organizations represented at the meeting  Quality of discussion at workshop (minutes will be taken and report prepared);  number of public meetings;  Number of meeting attendees  # of people to whom findings reports distributed, within list of key audiences  # of people and organization to receive paper,  # of letters sent  # of briefs circulated  number of public lotteries held  Number of briefs distributed;  # of media events conducted HOW YOU’LL SHOW YOUR POLICY INFLUENCE…1

ACADEMIC DISSEMINATION  Publication of dispenser research findings in leading academic and policy journals  postings to (other people’s) websites, mentions (of our work)  Publication in respected journal DEMAND/USE OF YOUR INFORMATION  # of citations.  Citation rate of published journal articles  # of visits to websites  Number of website hits and downloads of our evaluation results from the IFRP and TFCG websites  Number of related media articles, and diversity of media outlets referencing evaluation findings  Feedback (multiple stakeholders)  Post-conference communication b/t conference attendees and PIs about findings.  number of newspaper and radio stories HOW WILL WE MEASURE OUR SUCCESS ….1HOW YOU’LL SHOW YOUR POLICY INFLUENCE..2

INCREASED AWARENESS AND KNOWLEDGE  Village elders in the research communities are aware of visit dates and know how to contact members of the research team.  Villagers are aware of the purpose of the dispenser and they are able operate the dispenser appropriately.  # of officials aware of preliminary research findings POLICY (AND PRACTICE) OUTCOMES  Recommendations adopted by implementing (and other) institutions.  Operational impact  Policy impact  Influencing the upstream policy dialogue  Evidence of policy change as a result of evaluation results, as indicated by feedback from FBD policy makers  Changes in level of PFM funding at national and district levels  Use of best practices Incidence of Similar projects; Scaling of the original program within Uganda  Frequency & quality of interactions with high level policy makers  Number of policies, programs, or products developed on basis of this study HOW YOU’LL SHOW YOUR POLICY INFLUENCE…3

GREATER CREDIBILITY AND AUTHORITY both individual and institutional levels  Increased visibility  More invitations to policy forums and decision-making forums  Increased reputation both corporately and as experts in your chosen field of evaluation DEMAND FOR RESEARCH AND SERVICES  Greater number of, and quality of quotes in the media  Increased number of citations of work in various forums  Policymaking processes express demand for research  More commissions to do research and consultancy  Increased demand for ‘a conversation’ and the opinions of researchers and their institutions from influential actors  Invitations to key forums, panels, conferences, behind-the-scenes briefings with key policymakers HOW ELSE COULD WE MEASURE OUR SUCCESS ….1

 MORE ACTIVE INTERMEDIARY ENGAGEMENT  More partners ask you for help from you/your organisation  More partners want to work with you  Other organisations increasingly use your research/knowledge e.g. for campaigning, citations etc.  Your requests for collaboration and strategic partnerships are more successful  More informed reporting and evidence-based stories in the media that reach policy audiences  social media (e.g. blogs, facebook) engages with topics and drives demand for more information  Bloggers recognise that you exist and see you as source material HOW ELSE COULD WE MEASURE OUR SUCCESS ….2

CHANGES IN POLICY AND POLITICAL WILL Shift in social norms: Changes in awareness Increased agreement about the definition of a social problem Changes in beliefs Changes in attitudes Changes in values Changes in the salience of an issue  Increased alignment of campaign goal with core societal values  Increased knowledge on an issue  Increased interest on an issue or proposal  Increased number of partners supporting an issue  Improved alignment of partnership efforts (e.g. shared priorities, shared goals, common accountability system)  Strategic alliances with important partners  Increased ability of coalitions working toward policy change to identify policy change processs  Increased media coverage (e.g. quantity, prioritization, extent of coverage, variety of media "beats", message echoing)  Increased visibility of the campaign message (engagement in debate, presence of campaign message in media)  Changes in political will HOW ELSE COULD WE MEASURE OUR SUCCESS ….3

ACHIEVING CITIZEN OUTCOMES  Changes in public behaviour  Increased knowledge/interest on an issue or proposal  Changes in public beliefs  Changes in public values  Changes in public attitudes  Increased ability of coalitions working toward policy change to identify policy change process  Increased public involvement in an issue  Increased level of actions taken by champions of an issue  Increased voter registration  Changes in voter behaviour  Increased breadth of partners supporting an issue (e.g. number of "unlikely allies" supporting an issue)  Increased media coverage (e.g. quantity, prioritization, extent of coverage, variety of media "beats", message echoing)  Increased salience and debate of the issue in online social networks  Increased visibility of the campaign message (engagement in debate, presence of campaign message in media)  Changes in public will  New advocates HOW ELSE COULD WE MEASURE OUR SUCCESS ….4