1. Session: 6 Understanding & Using the RDQA Tool Output
MEASURE EVALUATION
Data Quality Assurance Workshop
Session: 6
Understanding & Using the RDQA Tool Output

2. Topics to Cover Charts and graphs overview
How to interpret RDQA graphs
Bar charts
Spider graphs
Line graphs

3. Ongoing Monitoring & Follow up
The RDQA Process
Data Verification
System Assessment
Interpret the Output
Develop Action Plans
Disseminate Results
Ongoing Monitoring & Follow up

4. Charts & Graphs Charts and graphs summarize information visually
Advantage: Information is easier to understand
Disadvantage: You might loose some of the detail
RDQA tool automatically generates summary graphs of assessment data
Open the RDQA Tool to show a quick overview of each worksheet

5. Basic Guidance for Building Graphs
Ensure graph has a title
Label the components of your graph
Indicate source of data with date
Provide number of observations (n=xx) as a reference point
Add footnote if more information is needed

6. Interpreting Graphs
The summary statistics that are calculated include the following:
Strength of the Data Management and Reporting System based on a review of the programme’s data collection and reporting system
Accuracy of Reported Data through the Calculation of Verification Factors generated from the recounting exercise performed at each level of the reporting system
Availability, Completeness and Timeliness of Reports through percentages calculated at the Health District(s) and the national level

7. Type of Graphs in the RDQA Tool
Column or bar chart – used for comparing categories of data
Spider graph – used to compare categories in an alternate format

8. Bar Charts in the RDQA Tool
Generated on the Global Dashboard, intermediate aggregation and service delivery point sheets
Include charts for both data verification and system assessment outputs
At the intermediate aggregation and Global level, data on reporting performance is also on a chart.

9. Output of Data Verification
Verification factor
Over-reporting
Under-reporting
Recommended range of acceptability:
100%+/-10%
(90-110%)
Numerator: Recounted Data
Denominator: Reported Data

10. Bar Chart – Overall Average
Under-reporting
Over-reporting

11. Bar Charts – Disaggregated by Level
Do we have under-reporting or over-reporting in this bar chart?

12. Reporting Performance

13. Spider Graph Visual display of information on various axis
What matters are the points on the axis NOT the area

14. Spider Graph – How to draw one
Categories
Score
M&E capabilities, roles and responsibilities
2.5
Training
3.0
Indicator definition
1.0
Data reporting requirements
1.5
Data collection, reporting forms and tools
2.0
Data mngt process and quality control
Links with national reporting systems
0.5 3 2 1
Step 1 – draw the scores of each category on the graph

15. Interpreting the Graph
M&E capabilities, roles and responsibilities
Step 2 – Connect the dots. Focus on the points/scores not on the area
Links with national reporting systems
Training
Data mngt process and quality control
Indicator Definition
Data collection, reporting forms and tools
Data reporting requirements

16. Line Graphs
Track outcomes from repeat data verifications and system assessments
Important for routine monitoring
Chart data by service delivery site and by district
Require you to build the graph yourself

17. Routine Monitor Line Graph
How would you interpret this graph?

18. Routine Monitor Line Graph
Under-reporting
Over-reporting

19. Questions & Answers

20. MEASURE Evaluation is funded by the U.S. Agency for
International Development (USAID) and implemented by the
Carolina Population Center at the University of North Carolina at
Chapel Hill in partnership with Futures Group, ICF International,
John Snow, Inc., Management Sciences for Health, and Tulane
University. Views expressed in this presentation do not necessarily
reflect the views of USAID or the U.S. government.
MEASURE Evaluation is the USAID Global Health Bureau's
primary vehicle for supporting improvements in monitoring and
evaluation in population, health and nutrition worldwide.