United States Department of Agriculture Food Safety and Inspection Service 1 National Advisory Committee on Meat and Poultry Inspection August 8-9, 2007.

Slides:

Advertisements

Similar presentations

ENTITIES FOR A UN SYSTEM EVALUATION FRAMEWORK 17th MEETING OF SENIOR FELLOWSHIP OFFICERS OF THE UNITED NATIONS SYSTEM AND HOST COUNTRY AGENCIES BY DAVIDE.

Advertisements

The Department of Energy Enterprise Risk Management Model

Study Objectives and Questions for Observational Comparative Effectiveness Research Prepared for: Agency for Healthcare Research and Quality (AHRQ)

Protocol Development.

1 Department of State Program Evaluation Policy Overview Spring 2013.

Brian A. Harris-Kojetin, Ph.D. Statistical and Science Policy

United States Department of Agriculture Food Safety and Inspection Service 1 National Advisory Committee on Meat and Poultry Inspection August 8-9, 2007.

Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.

CFSAN’s Peer Review for Risk Assessments Robert L. Buchanan, Sherri Dennis, and Marianne Miliotis.

Attribution of Haze Phase 2 and Technical Support System Project Update AoH Meeting – San Francisco, CA September 14/15, 2005 Joe Adlhoch - Air Resource.

Lessons Learned in Initiating and Conducting Risk Assessments within a Risk Analysis Framework: A FDA/CFSAN Approach Robert Buchanan DHHS Food and Drug.

Session V: Programme Roles and Responsibilities

CADTH Therapeutic Reviews

1 Program Performance and Evaluation: Policymaker Expectations 2009 International Education Programs Service Technical Assistance Workshop Eleanor Briscoe.

Topics - Reading a Research Article Brief Overview: Purpose and Process of Empirical Research Standard Format of Research Articles Evaluating/Critiquing.

Quality evaluation and improvement for Internal Audit

Creating Research proposal. What is a Marketing or Business Research Proposal? “A plan that offers ideas for conducting research”. “A marketing research.

Office of Science & Technology Policy Executive Office of the President The National Climate Assessment Version 3.0 Kathy Jacobs Assistant Director for.

United States Department of Agriculture Food Safety and Inspection Service August 27, 2008 Carol Maczka, PhD Assistant Administrator Office of Food Defense.

Purpose Program The purpose of this presentation is to clarify the process for conducting Student Learning Outcomes Assessment at the Program Level. At.

1 C-99 Assessing Student Learning in Graduate Degree Programs C-99 Assessing Student Learning in Graduate Degree Programs Bob Smallwood, University of.

United States Department of Agriculture Food Safety and Inspection Service National Advisory Committee on Meat and Poultry Inspection (NACMPI) Public Meeting.

NACMPI November 15-16, 2005 Risk-Based Inspection Dr. Barbara Masters Administrator, Food Safety and Inspection Service Philip Derfler Assistant Administrator,

What is Business Analysis Planning & Monitoring?

Metadata: Integral Part of Statistics Canada Quality Framework International Conference on Agriculture Statistics October 22-24, 2007 Marcelle Dion Director.

The Interagency Food Safety Analytics Collaboration: Moving Forward Together Christopher Braden, MD Director, Division of Foodborne, Waterborne, and Environmental.

University of Wisconsin Population Health Institute Kit R. Van Stelle, Principal Investigator Treatment Alternatives and Diversion (TAD)

Integrating Evaluation into the Design of the Minnesota Demonstration Project Paint Product Stewardship Initiative St. Paul, MN May 1, 2008 Matt Keene,

FSIS’s Needs for Peer Review of Risk Assessments Carol Maczka, Ph.D. Senior Scientist for Risk Assessment FSIS/USDA September 30, 2003 Presented at JIFSAN/SRA/RAC.

1 Current Funding Streams in New York State The 2008 Equity Symposium Comprehensive Educational Equity: Overcoming the Socioeconomic Barriers to School.

FAO/WHO Codex Training Package Module 3.2 FAO/WHO CODEX TRAINING PACKAGE SECTION THREE – BASICS OF NATIONAL CODEX ACTIVITIES 3.2 How to develop national.

United States Department of Agriculture Food Safety and Inspection Service FSIS Foodborne Illness Investigations: Current Thinking Scott A. Seys, MPH Chief,

United States Department of Agriculture Food Safety and Inspection Service February William C. Smith Assistant Administrator Office of Program.

What is a Business Analyst? A Business Analyst is someone who works as a liaison among stakeholders in order to elicit, analyze, communicate and validate.

Tracking national portfolios and assessing results Sub-regional Workshop for GEF Focal Points Western and Central Africa Dakar, May 2007.

Methods: Pointers for good practice Ensure that the method used is adequately described Use a multi-method approach and cross-check where possible - triangulation.

ISM 5316 Week 3 Learning Objectives You should be able to: u Define and list issues and steps in Project Integration u List and describe the components.

National Commission for Academic Accreditation & Assessment Developmental Reviews at King Saud University and King Faisal University.

Division Of Early Warning And Assessment MODULE 5: PEER REVIEW.

IAEA International Atomic Energy Agency. IAEA Outline LEARNING OBJECTIVES REVIEW TEAM AND COUNTERPARTS Team Composition Qualification PREPARATORY PHASE.

State EE/RE Policy Best Practices & Next-Generation Innovations: September Meeting Feedback on overall work plan and phasing of policies September 25,

Shaping a Health Statistics Vision for the 21 st Century 2002 NCHS Data Users Conference 16 July 2002 Daniel J. Friedman, PhD Massachusetts Department.

United States Department of Agriculture Food Safety and Inspection Service 1 HACCP Systems Validation NACMPI September 22-23, 2011 Washington, DC William.

 Council Overview  Past Priorities and Recommendations  Current Priorities ◦ Promoting Equity in State Policies and Programs ◦ Adverse Birth Outcomes.

Data Acquisition to Anticipate Foodborne Hazards National Advisory Committee on Meat and Poultry Inspection Sean Altekruse DVM, PhD November 16, 2004.

United States Department of Agriculture Food Safety and Inspection Service 1 Public Health Based Slaughter Inspection: Rationale and Process August 7,

Integrating Evaluation into the Design of the Minnesota Demonstration Project Paint Product Stewardship Initiative St. Paul, MN May 1, 2008 Matt Keene,

United States Department of Agriculture Food Safety and Inspection Service UPDATE : Improvements for Processing and Slaughter Inspection August 27, 2008.

International Atomic Energy Agency Regulatory Review of Safety Cases for Radioactive Waste Disposal Facilities David G Bennett 7 April 2014.

Quality Assessment of MFA’s evaluations Rita Tesselaar Policy and operations Evaluation Department Netherlands Ministry of Foreign Affairs.

IAEA International Atomic Energy Agency. IAEA Outline LEARNING OBJECTIVES REVIEW TEAM AMD COUNTERPARTS Team Composition Qualification PREPARATORY PHASE.

Monitoring Afghanistan, 2015 Food Security and Agriculture Working Group – 9 December 2015.

United States Department of Agriculture Food Safety and Inspection Service Validation – In Plant Findings Kenneth Petersen, DVM, MPH Assistant Administrator.

United States Department of Agriculture Food Safety and Inspection Service Overview of Trim Sampling Compliance Guidelines and Discussion Daniel Engeljohn,

U.S. Department of Agriculture eGovernment Program Smart Choice Pre-Select Phase Transition September 2002.

United States Department of Agriculture Food Safety and Inspection Service 1 03B Raw Ground Meat Industry FSA Methodology Walk-through December 18, 2008.

United States Department of Agriculture Food Safety and Inspection Service National Advisory Committee on Meat and Poultry Inspection (NACMPI) Public Meeting.

United States Department of Agriculture Food Safety and Inspection Service National Advisory Committee on Microbiological Criteria for Foods Subcommittee.

Company LOGO. Company LOGO PE, PMP, PgMP, PME, MCT, PRINCE2 Practitioner.

Session 2: Developing a Comprehensive M&E Work Plan.

EIAScreening6(Gajaseni, 2007)1 II. Scoping. EIAScreening6(Gajaseni, 2007)2 Scoping Definition: is a process of interaction between the interested public,

United States Department of Agriculture Food Safety and Inspection Service Draft Labeling Policy Guidance for N- 60 Testing Claims for Boneless Beef Manufacturing.

Monitoring and Evaluation Systems for NARS organizations in Papua New Guinea Day 4. Session 10. Evaluation.

Governance and Institutional Arrangements What they have to do with Regional Water Planning (RWP)

National Quality Standards Framework

Sample Fit-Gap Kick-off

Writing a sound proposal

Outline: OCS Overview: Organizational Structure USDA Coordination

Monitoring and Evaluation using the

Presentation transcript:

United States Department of Agriculture Food Safety and Inspection Service 1 National Advisory Committee on Meat and Poultry Inspection August 8-9, 2007 Issue Paper Data Collection and Analysis at FSIS: Standard Operating Procedures

United States Department of Agriculture Food Safety and Inspection Service 2 Overview of presentation Purpose of draft document Roles and responsibilities of data collection and analysis teams Process for data collection and analysis at FSIS Stakeholder input Independent peer review Use of data in decision-making Program evaluation

United States Department of Agriculture Food Safety and Inspection Service 3 Purpose of Draft Document To describe the standard operating procedure for data collection and analysis at FSIS  Developed in response to stakeholders’ comments Seeking the Committee’s comments:  Suggestions for improving data collection and analysis strategy?  Suggestions for additional stakeholder input in this process?  Suggestions for conducting external peer review?  Should NACMPI form an on-going Sub-Committee to assist FSIS in evaluating data issues?

United States Department of Agriculture Food Safety and Inspection Service 4 Roles and Responsibilities of the Data Collection and Analysis Teams Data Analysis and Integration Group (DAIG)  Characterize, coordinate, analyze and integrate data within and across different program areas Data Coordinating Committee (DCC)  Senior Agency representatives, serves as a liaison between the various FSIS Program Offices and the DAIG

United States Department of Agriculture Food Safety and Inspection Service 5 Data Analysis and Integration Group Ensure data analyses are relevant to Program Office business processes and the Agency’s mission Ensure data analyses are consistently of high quality Conduct analyses to inform Agency decisions Provide automated tools to facilitate data analysis and display

United States Department of Agriculture Food Safety and Inspection Service 6 Data Analysis and Integration Group Conduct analyses to identify data gaps/needs within and across Program Offices Develop sophisticated analytical models to integrate data streams and rapidly identify events, trends and anomalies Ensure data analyses are consistent with FSIS policies and OMB guidelines

United States Department of Agriculture Food Safety and Inspection Service 7 Process for Data Collection and Analysis In response to stakeholder comments, FSIS is formalizing an overall process for data analysis Involves the development of a technical plan, and subsequent technical paper that describes: –the problem to be addressed –the data collection and analysis strategy –the results and interpretation of data analysis Leverage updated IT systems (e.g., PHS) Stakeholder input and peer review incorporated into the process

United States Department of Agriculture Food Safety and Inspection Service 8 Problem Definition Develop Technical Plan Collect Data, Perform Analyses Develop Report Program Evaluation Stakeholder input Stakeholder input and peer review Use Data in Decision-Making Overview of The Process

United States Department of Agriculture Food Safety and Inspection Service 9 Problem Definition Define issues in terms of questions to be answered  Inform decision-making to improve public health Identified by policy managers, data analysts and other Agency officials Purpose and justification for each type of analysis should be stated Include impacts on Agency resources. Stakeholder input

United States Department of Agriculture Food Safety and Inspection Service 10 Develop Technical Plan Summary of issues/questions to be addressed Identify, collect and review existing data Describe data collection strategy  Standard/ validated methodology  Statistically valid sampling plan  Expert elicitation Describe data analysis methods  Descriptive statistics  Probabilistic methods Program evaluation Stakeholder input and independent peer review

United States Department of Agriculture Food Safety and Inspection Service 11 Collect and analyze data Follow methods described in the technical plan Consider sources of uncertainty and variability in data Discuss validity of assumptions made Determine whether additional data or other analytical techniques are needed

United States Department of Agriculture Food Safety and Inspection Service 12 Technical Report Policy issues driving the analysis The sources and quality of the data Methodology used Results Sources of uncertainty and variability Data gaps and assumptions Internal review External peer review

United States Department of Agriculture Food Safety and Inspection Service 13 Stakeholder input Integral part of data collection and analysis Problem definition  Input into framing and context of issue  Review questions to be addressed  Purpose and justification for analysis Technical plan  Additional sources of existing data  Review proposed methods of data collection and analysis Technical report  Results of data analysis

United States Department of Agriculture Food Safety and Inspection Service 14 External Peer Review Ensure scientifically sound data collection/ analysis Peer Reviewers could include:  NACMPI  NACMCF  National Academy of Sciences  Subject matter experts Technical plan  Data quality issues, e.g., avoid bias in data sets  Appropriate methods of analysis used  Validity of assumptions Results of data analysis

United States Department of Agriculture Food Safety and Inspection Service 15 Use data in decision-making Based on the results of the analyses, make recommendations how to best address the policy issues/questions identified during the problem definition phase

United States Department of Agriculture Food Safety and Inspection Service 16 Program evaluation Evaluate outcome of program compared with control  Consider type of data needed for comparison How well is program achieving its objectives? Is there a need to improve the program? Ideally, measure improvements in public health outcomes  E.g., reduction in illness attributable to specific foods Surrogate:  Reduction in pathogen prevalence/ levels  Reduction in product recalls Use to refining program planning, development, and accountability

United States Department of Agriculture Food Safety and Inspection Service 17 Questions Do you have any suggestions for improving our strategy for data collection and analysis? Do you have other suggestions for stakeholder input in this process? Do you have any other suggestions for conducting peer review? Do you believe it would be worthwhile to form an on- going Sub-Committee to assist FSIS in evaluating various data issues? If so, please provide a rationale as to why it would be useful and recommendations on how it would be structured and should operate.

United States Department of Agriculture Food Safety and Inspection Service 18 Contact Information: Isabel Walls, Ph.D. Office of Food Defense & Emergency Response Food Safety Inspection Service (202)