Chief of the Geography Division of the U.S. Census Bureau, Washington, DC A member of the Association of American Geographers Cartography and Geographic.

Slides:



Advertisements
Similar presentations
Fernando Armstrong / Tony Farthing Regional Directors New Jersey State Data Center June 11, Decennial Census Program.
Advertisements

Burton Reist Chief, 2020 Research and Planning Office U.S. Census Bureau 2014 SDC and CIC Steering Committee Meeting March 5, Census Updates.
Geographic Support System (GSS) Discussion FY 2011 Update Tim Trainor February 16, 2011.
Lisa Blumerman Assistant Director for 2020 Census State Data Centers/Census Information Centers Steering Committee Meeting October 22, Census.
Utilizing Administrative Records in the 2020 Census SDC/CIC Steering Committee Update October 24,
1 Geographic Support System Proposed Initiative – FY 2011 and Beyond Timothy Trainor U.S. Census Bureau 1.
1 Geographic Support System Proposed Initiative – FY 2011 and Beyond Michael Ratcliffe U.S. Census Bureau 1.
The Geographic Support System Initiative (GSS-I) Partnership Program Donna Bullock U.S. Census Bureau November 2,
On the Road to 2020 Census Geographic Programs Update Oregon State Data Center Annual Meeting 11/29/2012 Rick Campbell Geographer L.A. Regional Office.
Geographic Support System Initiative (GSS-I) Partnership Program Update for the State Data Center Leads September 19, 2012.
Planning for the 2020 Census Presentation to the SDC/CIC Steering Committees Daniel H. Weinberg Assistant Director for ACS and Decennial Census June 17,
Kevin Deardorff Assistant Division Chief, Decennial Management Division U.S. Census Bureau 2014 SDC / CIC Conference April 2, Census Updates.
United Nations Workshop on Revision 3 of Principles and recommendations for Population and Housing Censuses and Census Evaluation Amman, Jordan, 19 – 23.
Quality evaluation and improvement for Internal Audit
NYSDC Affiliate Meeting Michael Horgan Geographer, Address Programs Management Division May 7-8,
Introduction of Internet Survey Methodology to the Emirate of Abu Dhabi Andrew Ward, Maitha Al Junaibi and Dragica Sarich.
Philadelphia Regional Update
MAF Update Plans and The Proposed FY2011 Geographic Support System Initiative Tim Trainor Chief, Geography Division.
Geographic Partnerships In Support of the 2020 Census U.S. Census Bureau, Geography Division SDC/CIC Annual Training Conference June 3, 2015.
Plans for the Research and Testing Phase of the 2020 Census Presentation to: Council of Professional Associations on Federal Statistics December 3, 2010.
Building Quality Address Data: A Census Bureau Perspective Rocket City Geospatial Conference Huntsville, AL November 16, 2011.
U.S. Census Bureau Geography Division Programs Presentation to the Indiana Government Geospatial Coordinator Forum September 20, 2012.
Economics and Statistics Administration U.S. CENSUS BUREAU U.S. Department of Commerce Geo-Elections Tampa, Florida December 6, 2012 Cathy McCully James.
1 Boundary and Annexation Survey (BAS) Laura Waggoner Legal Areas Team Lead Boundary and Annexation Survey Project Manager Michael Clements Geographer.
US Census Bureau Philadelphia Region Update Maryland State Data Center Annual Affiliate Meeting June 12, 2014.
111 American Community Survey Fundamentals 2009 Population Association of America ACS Workshop April 29, 2009.
“... providing timely, accurate, and useful statistics in service to U.S. agriculture.” NASS Methodological, Operational, and Structural Transformation.
Geographic Support System Initiative
2020 Census: Program Overview, Testing, and Technological Innovations
Planning for 2010: A Reengineered Census of Population and Housing Preston Jay Waite Associate Director for Decennial Census U.S. Census Bureau Presentation.
Plans for the Research and Testing Phase of the 2020 Census Presentation to the State Data Centers October 15, 2010 Daniel H. Weinberg (Assistant Director.
American Community Survey ACS Content Review Webinar State Data Centers and Census Information Centers James Treat, ACSO Division Chief December 4, 2013.
The 2020 Redistricting Data Program (and the role of the Boundary and Annexation Survey)
Gearing up for 2010 Geographic Programs Leading up to the Census Katy Rossiter US Census Bureau – Denver North Dakota GIS Users Conference October 24,
Quality Assurance Programme of the Canadian Census of Population Expert Group Meeting on Population and Housing Censuses Geneva July 7-9, 2010.
1 Update on the Coverage Improvement Program for the 2010 Census Dave Sheppard Decennial Statistical Studies Division Census Information Center Program.
Arona L. Pistiner International Relations Officer, U.S. Census Bureau United Nations Economic Commission for Europe Conference of European Statisticians.
Shirin Ahmed Acting Assistant Director for Decennial Census Programs U.S. Census Bureau Reducing the Cost for the 2020 Decennial Census of the United States.
European Conference on Quality in Official Statistics Session 26: Census 2011 « Helsinki, 6 May 2010 « Census quality control with BSC: the Portuguese.
Transforming Census Bureau Operations Meeting on the Management of Statistical Information Systems (MSIS 2012) Streamlining Statistical Production.
1 Presentation to the Tennessee State Data Center’s Affiliate Workshop and Data Users Conference November 16-17, Census: Program Overview, Testing,
Regional Seminar on Promotion and Utilization of Census Results and on the Revision on the United Nations Principles and Recommendations for Population.
Systems Accreditation Berkeley County School District School Facilitator Training October 7, 2014 Dr. Rodney Thompson Superintendent.
1 Quality Control for Field Operations. 2 Overview Goal To ensure the quality of survey field work Purpose To detect and deter interviewer errors and.
Innovations in the population census of the Republic of Belarus 2009: progress and challenges ___________________________________________________________________.
Mid-Decade Assessment of the United Nations 2010 World Population and Housing Census Program Arona L. Pistiner Office of the Associate Director for 2020.
United Nations Oslo City Group on Energy Statistics OG7, Helsinki, Finland October 2012 ESCM Chapter 8: Data Quality and Meta Data 1.
Census Processing Baku Training Module.  Discuss:  Processing Strategies  Processing operations  Quality Assurance for processing  Technology Issues.
Planning for the 2020 US Census Presentation to the Joint UNECE-Eurostat Meeting on Population and Housing Censuses (Geneva, 7-9 July 2010) Daniel H. Weinberg.
Best Practices for Implementing a Paradata Warehouse Presentation at the Washington Statistical Society Mini-Conference on Paradata Washington, D.C. Jason.
Frank Vitrano Associate Director for Decennial Census Programs United States Census Bureau Beyond 2011 Workshop & International Review Panel Titchfield,
2020 Census Updates Tennessee State Data Center Conference
United Nations Statistics Division
6/24/2014 Utilizing Administrative Records in the 2020 Census SDC/CIC Steering Committee Update October 24, 2014.
Census Bureau Agency Briefing
How the Lessons Learned from Using Handhelds in the 2010 Census Impacts the Use of Technology in the 2020 Census Arona L. Pistiner Deirdre Dalpiaz Bishop.
The Geographic Support System Initiative (GSSI)
2020 Census Updates Lisa Blumerman Assistant Director for 2020 Census State Data Centers/Census Information Centers Steering Committee Meeting October.
Meryem Demirci United Nations Statistics Division
Update and Overview of Administrative Records for the 2020 Census
Data collection with Internet
Multi-Mode Data Collection Approach
Data collection with Internet
Multi-Mode Data Collection Approach
United Nations Statistics Division
Changes in the Canadian Census of Population Program
Data collection with Internet
Multi-Mode Data Collection
Data collection with Internet
International Standards and Contemporary Technologies,
Presentation transcript:

Chief of the Geography Division of the U.S. Census Bureau, Washington, DC A member of the Association of American Geographers Cartography and Geographic Information Society (CaGIS) A member of the National States Geographic Information Council A member of the Urban and Regional Information Systems Association and the Senior Executive Association A Vice President of the International Cartographic Association and chairs the Census Cartography Working Group

The 2020 U.S. Census: A Time for Change Tim Trainor U.S. Census Bureau

Trends  Adaptive design  Mobile technologies and increased automation in the field  Big data / paradata  Focus on addresses for survey frames 3

Background 4

Planning for the 2020 U.S. Census  Contain costs  Design and conduct a census that costs less per housing unit than the 2010 Census while maintaining high quality  Identify cost drivers and implement innovative enumeration methods aimed at reducing these costs  Plan based on research and testing  Focus early research and testing program on major innovations to the design of the census oriented around major cost drivers of the 2010 Census 5

Census 2020 Objectives  Contain costs  Increased use of addresses  A redesigned address canvassing operation  Optimize self-response program  Increase self-response options  Make use of electronic contact strategies and methods  Maximize internet response  Increase awareness of the internet option  Encourage respondents to respond via the internet  Continue small area geographies for data users 6

Decennial Census Cost Drivers  Need for nationwide updating of address list prior to Census  Diversity of the population  Demand for improved count accuracy  Declining response rates  Management of major acquisitions, schedule, and budget  Field Infrastructure 7

 Redesigned Address Canvassing Operation  Administrative and Commercial Records  Use of Mobile Technologies  Streamlining and Automating Field Management and Operations  Optimizing Self Response Decennial Census Research Relative to Cost-Drivers 8

Key Milestones Steps Towards 2020 Census 9

Adaptive design 10

Adaptive Design  A data collection is adaptive to the extent that it:  Plans fieldwork to achieve cost and quality goals  Monitors process data and cost and quality indicators  Uses auxiliary frame data to tailor contact approaches (or impute or adjust)  Uses auxiliary data, paradata and response data to change contact approaches rapidly  Strikes data-based cost/quality tradeoffs 11

Adaptation is NOT New  Sub-sampling non-respondents  Increasing contacts  Timing contacts  Increasing incentives  Tailoring survey invitations  Tailoring refusal letters  Switching modes 12

Some Adaptations ARE New  More centralized, less ad hoc, more timely efforts, e.g.  Using auxiliary data to tailor contacts  Using auxiliary data, paradata and response data to alter contacts  Switching modes based on auxiliary data, paradata and response data  Motivated by a plan and enabled by new systems 13

Optimizing Self-Response  Internet data collection  Adaptive contact strategies  New contact modes  Telephone  14

Mobile Technologies and Increased Automation in the Field 15

Major Changes for Field Operations  Using automation to support processes  Optimized daily enumerator assignments of respondent contact attempts  Near real time operations information for decision making  Enhanced operational control system  Automated training for enumerators and managers  New field structure, including field staff roles and staffing ratios 16

Mobile Technologies  Routing  Navigation  Data Collection 17

Field Reengineering and Nonresponse Followup (NRFU) using Administrative Records and Adaptive Design  Reengineer the roles, responsibilities, and infrastructure for the field  Evaluate the feasibility of fully utilizing the advantages of technology, automation, and real- time data to transform the efficiency and effectiveness of data collection operations  Move to automated training for enumerators and managers  Test and implement routing and/or navigation  Reengineer the approach to case management 18

Field Reengineering and NRFU using Administrative Records and Adaptive Design (cont.)  Reduce NRFU workload and increase NRFU productivity with:  Administrative Records  Reduce cases that need to be resolved in NRFU by varying type of cases removed and timing of case removal from the workload  Reduce the number of contact attempts to cases resolved in NRFU  Field Reengineering and Adaptive Design  Reduce the number of contact attempts  Leverage dynamic case management with route planning and other methodologies to improve enumerator productivity through automation  Planned for an April 1 Census Day 19

Field Organizational Structure 20 Area Manager of Operations (AMO) Enumerators in the Field (ENUM) Receive Training Submit Available Schedule Conduct Field Work According to Schedule Complete Time and Expense (T&E) Maintain Ongoing Work Availability Local Supervisor of Operations (LSO) Conduct In-Person Training Supervise and Support Enumerators Approve Time & Expense (T&E) Work Designated Shifts to Support On-Duty Enumerators Field Manager of Operations (FMO) Supervise and Support LSOs Monitor FMO Zone Workload Progress Ensure Adequate Staffing Manage the Area Operations Support Center Supervise and Support FMOs Monitor Area Workload Progress Coordinate with RCC Regional Census Center (RCC) Supervise and Support AMOs Manage All Regional Operations Manage Space and Leasing At the Area Operations Support Center (AOSC) In the Field Within the Region Admin Recruiting Technology Partnership Quality Control

Concept of Operations 21 > > LSO Supports Enumerators Training Certified Enumerator Independent Study Mobile Device Load Production Application Mobile Device One day with LSO Enumerator Does the Work Updates Daily Workload Optimized Daily Workload and Routing FMO Manages Field Operations Management Views In Operational Control Center AOSC > AMO Coordinates the Work of the Area Operations Support Center (AOSC)

Big Data 22

Big Data 23

Big Data Research  Administrative records to improve cost and increase timeliness and accuracy  Quality control  Coverage improvement  Substitute for in-person visits to households that do not self respond  Processing techniques to allow real time decision making  Adaptive design  Self response options  Data dissemination via API’s to allow creation of apps and products that combine our data with other external data sets  Census explorer data visualization  Other apps from our web site  More work required in this area to stimulate interest 24

Big Data: Concerns  There are no currently acceptable processes or procedures for using Big Data to produce Official Statistics  Don’t even have a common definition of Big Data 25

Focus on Addresses for Survey Frames 26

The GSS Initiative (GSS-I)  An integrated program of improved address coverage, continual spatial feature updates, and enhanced quality assessment and measurement  All activities contribute to MAF/TIGER Database improvement  Builds on the accomplishments of last decade’s MAF/TIGER Enhancement Program (MTEP)  Supports the goal of a redesigned address canvassing for the 2020 Census  Continual updates throughout the decade support current surveys 27 Address Updates 123 Testdata Road Anytown, CA Lat 37 degrees, 9.6 minutes N Lon 119 degrees, 45.1 minutes W Street/Feature Updates Quality Measurement

Redesigned Address Canvassing General Questions:  Is a traditional, on-the-ground canvassing operation necessary to ensure a complete and accurate address list for the decennial census?  Are there areas of the country in which the address list and locational information can be kept current without canvassing?  What characteristics identify an area that should be included in a traditional canvassing? 28

Research Goals  Develop statistical models to identify geographic areas to be canvassed or not canvassed  Predict adds and deletes with estimated coverage error  Interactive Review - Identify and classify areas  In which the number of addresses/housing units is stable and unlikely to change  With unique housing/addressing/mail delivery situations that may require canvassing  Land use/land cover is entirely non-residential  Where the address list can be updated and assured through administrative or operational methods 29

Address Canvassing Research, Model, and Area Classification  2009 Statistical Model  2013 Statistical Model  Interactive Review  27 test counties 30

MAF Error Model Objective  The objective of the MEM project is to provide statistical models for the MAF that will produce estimates of coverage error at levels of geography down to the block level  These models could potentially inform Address Canvassing decisions 31

What is the MAF Error Model?  Two predictive models developed at the block level, collectively known as the “MAF Error Model”  One model for the number of adds and one model for the number of deletes as functions of identified predictors  Zero-inflated (ZI) regression models  Zero-inflated models can provide a model-based approach to obtaining coverage estimates  Provides more granularity at lower levels of geography over other common modeling approaches (e.g., logistic regression) 32

Address Canvassing: Master Address File (MAF) Model Validation Test and Focused Field Address Resolution Approach Model Based Approaches  Test our ability to use statistical modeling to measure error in the MAF and to identify areas experiencing significant change  Inform the performance of the models used to define the Address Canvassing workloads Focused Field Address Resolution (“micro-targeting”) Approach  Incorporate imagery reviews to detect changes and discrepancies  Include field updating of addresses for portions of blocks 33

MAF Model Validation Test Objectives  The purpose of the MAF Model Validation Test (MMVT) is to collect data to inform components of the Address Canvassing decision-points  MAF Error Model  Address Canvassing, Research, Model, and Classification team  Models for Zero Living Quarters blocks  Test the concept of Micro-Targeting and uses of imagery 34

Getting to a Recommendation for a Redesigned Address Canvassing Operation Partner File Acquisition Data Upload Data Evaluation Quality Indicators Data Modeling Statistical Empirical Cost Estimation 2009 model First Round of Geographic Exclusions Identified Federal Lands Military Methodology for inclusion determined 35 Partner File Acquisition Data Upload Data Evaluation Quality Indicators Models and Methodologies refined 2020 Census Operations Defined Assess results of the 2014 MAF Model Validation test 35

Address Canvassing Methodology Plan Preliminary Federal Land Use and similar types of blocks 2013 Statistical Models 4/14 Use only data available in Methodology 3/15 Process Defined -Preliminary Cost Estimation -Jan March Cost Estimation -Quality Metrics (QI and models) -LCAT -Cost Estimation -Quality Metrics (MMVT) -LCAT GEO “go/no go” Recommendation 9/14 Field Infra Decision Point 1/15 - Recommendation for Integration 9/15 - Field Infrastructure Decision Point 1/16 MAF Model Validation Test 9/14-12/14 Data available on January Observe and measure the performance of the models -Update the models with more current field data (5 yr. field update) Preliminary Interactive Review 4/14 Use Aerial Imagery to add/remove blocks Process definition occurs here and will be repeated LCAT will examine costs on later operations and provide feedback to modify models Consolidate the Models 2009 TEA* Operational Overlay - Remove non-MO/MB areas (UL, UE…) 2009 Statistical Models (2020 and GSS) - Use only data available in 2009 Federal Land Use and 2009 TEA Operational Overlay 36

Frame Schedule Preliminary Federal Land Use and similar types of blocks *MAF Model Validation Test (MMVT) Data available in January/February 2015 Analysis Preliminary Micro Targeting research Observe and measure the performance of the models Update the models with more current field data (5 yr. field update) Preliminary Interactive Review Use Aerial Imagery and Micro Targeting * Denotes that the activity is in the current 2020 schedule Denotes GEO/GSS activity 2009 Type of Enumeration Area (TEA) Operational Overlay Remove non- MO/MB areas (UL, UE…) * 2009 Statistical Models (2020 and GSS) Use only data available in 2009 * 2013 Statistical Models Use only data available in 2013 Nov 2013 Jan Mar 2014 Apr 2014 Sept 2014 – Dec 2014 Jan 2015July 2015Sept 2015Mar 2016 * Estimate Preliminary AC Workload * Determine Preliminary Operational Design for AC * Final Field Infrastructure Decision Point * Targeting Methodology Process Defined * Cost Estimation Quality Metrics (QI and models) LCAT * Preliminary Field Infrastructure Decision Point * Preliminary Cost Estimation Quality Metrics (MMVT) Preliminary LCAT GEO “go/no go” Recommendation (Sept 2014) GEO “go/no go” Recommendation (Sept 2014) Consolidate the Models Consolidate the Models LCAT (Life Cycle Analysis Team) examine impacts on later operations * Workloads * Production rates * Operational timeline 37

Summary  A redesigned census  Traditional approaches are challenged  Adds risk  Modernization is critical  All comes down to cost 38

Questions? 39