1. Integrated Performance Information Systems: Florida’s Experience Phoenix, Arizona June 14-16, 2005 Jay Pfeiffer, Assistant Deputy Commissioner Division of Accountability, Research, and Measurement Florida Department of Education 850-245-0437Jay.Pfeiffer@FLDOE.org

2. Francis Jeanne Charley Ivan Bonnie Source: Florida K20 Education Data Warehouse Florida: The Home of Integrated Performance

3. Additional role: Department-wide conduit for LMS, LED, Census, BEBR publications Office of K-20 Education Information & Accountability Public Schools Community College & Technical Center University Source Information Systems K-12 Adult Education Career/Technical Associate Degree Baccalaureate Masters Ph.D./Professional Integrating Systems Source Systems Employment Assessment Financial Aid Teacher Certification Facilities Employment Earnings Postsecondary Ed. Welfare Incarceration Licensure K-20 Education Data Warehouse FETPIP K-20 Governance Organization: Alignment of Data Systems

4. FETPIP – The Florida Education and Training Placement Information Program FETPIP – The Florida Education and Training Placement Information Program

5. Florida Education and Training Placement Information Program (FETPIP) Collection Cycle Florida Education and Training Placement Information Program (FETPIP) Collection Cycle High School Vocational Center Community College Public University Independent University Other Programs Federal Programs Welfare Transition Services FL Corrections Releases Special Projects, Longitudes FL UC Covered Employment Fed Government & Postal Service Uniformed Military Service Out-of-State Employment Out-of-State Postsecondary Ed. Public University Enrollment Public Adult Ed. & Vocational Enrollment Private College & University Enrollment Public Community College Enrollment FL Corrections Incarcerations Performance and Accountability Reports Workforce Funding Formula Ad Hoc Reports “CHOICES” Career Counseling Software Internet Education & WIA Reports Merge Files Unduplicate Edit Names & SSN Create Master Follow-up File Create Tapes & Files for Record Links Public Assistance Receipt June, 2005

6. Input Data  Student/Participant - demographic, socio-economic, enrollment/services, educational programs, promotion, attendance, GPA, test scores…  Educational Institution - types, location, performance statistics, private/public…  Financial Aid - federal/state/local, loans/grants, amounts disbursed…  Courses - offerings, student & teacher participation, instruction type, grades…  Educational Staff - demographic, awards, certification, teaching & work activity  Educational Awards - type, program, institution, date Examples

7. Postsecondary Enrollments Starting an Integrated Performance Information System High School Vocational Center Community College Welfare Transition Services State UC - Covered Employment Fed Government & Postal Service Uniformed Military Service. State Performance and Accountability Reports Workforce Reporting Ad Hoc Reports Career Counseling Software WIA Reports Merge Files Unduplicate Edit Names & SSN Create Master Follow-up File Create Tapes & Files for Record Links Public Assistance Receipt June, 2005 WIA Participants Adult Education

8. FETPIP Data  Public Education Funding  Performance-Based Budgeting  Federal Performance Measurement: WIA, Wagner-Peyser, Voc Rehab, Blind Services, Perkins, NRS (Adult Education)  Private School Licensure  School District Accountability Reports  Community College Performance Reports  University System Program Reviews  ICUF Accountability Reporting  Legislative Performance Reviews  Workforce Estimating Conference  Policy Research  Career Counseling, Consumer and Guidance Information Major Uses

9. FETPIP-Type Operations  Use existing data resources  Cheaper, more accurate, more complete, and with more capabilities, than traditional surveys  Data are regarded as objective- non-judgmental  Provide a basis for common core sets of outcome measures, comparisons, discussions of issues across many programs & operations Benefits

10. Challenges (part 1)  Administrative data are designed for purposes other than performance measurement Definitions, taxonomies may differ Definitions, taxonomies may differ Time periods may differ Time periods may differ What is measured may not be exactly what is desired What is measured may not be exactly what is desired Administrative data change over time Administrative data change over time  Owners of Administrative Data have legal, ethical, proprietary obligations They won’t naturally want to share They won’t naturally want to share “Legal” beliefs may be conjured up “Legal” beliefs may be conjured up Program interests may be different from those of technical staff Program interests may be different from those of technical staff The “owners” change over time The “owners” change over time

11. Challenges (part 2)  Confidentiality of Information Requirements may be different for each data source Requirements may be different for each data source The issue is complicated by legal issues as well as beliefs The issue is complicated by legal issues as well as beliefs Beliefs/requirements may change over time Beliefs/requirements may change over time  Weakest Links The strength of a system of linked data sets is determined by the weakest of the data resources The strength of a system of linked data sets is determined by the weakest of the data resources Opponents will focus on the weaknesses Opponents will focus on the weaknesses The data lag actual performance The data lag actual performance  Support On going, reliable funding On going, reliable funding On going, reliable political support On going, reliable political support Cooperative attitude among stake holders Cooperative attitude among stake holders All involved will change All involved will change

12. What has worked for FETPIP?  Statutory authority, provisions, including cross references  Core funding from State General Revenue appropriated by the Legislature  Persistently collaborate with legislative, executive staff  Persistently collaborate with data owners, stakeholders in decisions about the mechanics of exchanges, reporting of results  Constantly anticipate roles that the system can play in accountability, performance measurement, cost return analysis, evaluation  Consistently work with data owners on changes, data anomalies, problems  Steadfastly make it easy for stake holders to participate, reduce burdens, provide data in exchange  Always facilitate discussions about common data elements, definitions, core performance measures, performance funding Support

13. What has worked for FETPIP?  Location within the state education agency  Always surpass all requirements, expectations regarding data security  Faithfully limit uses to statistical purposes for evaluation, program improvement  Persistently keep exchange agreements current and up- to-date, continually brief employees, stake holders on security and confidentiality issues  Always refer inquiries about particular resources to the resource owners Confidentiality/Security

14. What has worked for FETPIP?  Strive to meet changes, challenges head-on  Persistently refresh understanding of resources, requirements, limitations  Persistently seek new data resources, expand coverage  Always revise business rules as understanding, conditions change  Establish short term and long term visions for the effort Changes

15. What has worked for FETPIP?  Establish archival data resources  Accommodate ad hoc interests and requirements  Seek out opportunities to demonstrate your wares  Always collaborate Other

16. – K20 EDW – Florida’s K20 Education Data Warehouse – K20 EDW – Florida’s K20 Education Data Warehouse

17. Employee Identity Educational Institutions Educational Curriculum Employee Demographic Includes:  Teachers  Faculty Members  Support Staff Course K-20 Budget Student Demographic Certified Staff Instructional activity Financial Assistance includes:  Federal Aid  State Aid  Local Aid  Bright Future Student Test Scores (Ex-)student Employment District Institution's Finances Chart of Accounts Institution's Revenues Active Student includes:  All enrollments  Acceleration  Attendance  Discipline  Exceptionality Program Educational Facilities Student Award Student's Identity Student's Identity Student's Courses Includes:  Public Schools  Colleges  Universities  Private Institutions Includes  SUS Application  Talented 20 Florida’s K20 Education Data Warehouse

18. Educational Institution Demography Educational Awards Educational Staff Courses Grades, Standardized Test Scores Financial Aid Student Employment K20 Data Warehouse: Student-Centered

19. Matching Individuals in Florida’s Education Data Warehouse: Sophisticating the Matches, Anonymizing Data