The complexities of publishing gridded data for the UK European Forum for Geostatistics Krakow – October 2014 Ian Coady Geography Policy and Research Manager.

Slides:



Advertisements
Similar presentations
Will 2011 be the last Census of its kind in England and Wales? Roma Chappell, Programme Director Beyond 2011 Office for National Statistics, July 2011.
Advertisements

The Impact of LFS & APS Reweighting Marilyn Thomas Labour Force Survey Output Manager, Office for National Statistics.
Statistical Disclosure Control (SDC) for 2011 Census Progress Update Keith Spicer – ONS SDC Methodology 23 April 2009.
Grid models of population: temporal comparison by fixing the geography David Martin, School of Geography University of Southampton.
Confidentiality and the SARs Update on SAR progress, and discussion of the disclosure work done for Scotland. Sam Smith
Scottish Executive Large Scale Survey Developments Dr Robert Williams Analytical Services Group Office of the Chief Statistician.
Harmonisation Explained. Introduction The Next few slides will explain; What is harmonisation? Who are the Harmonisation Team? Why Harmonise? Governance.
The future of output geography - geography policy for NeSS Robert Heyward ONS.
GeoConvert: Creating that Spatial Relationship David Rawnsley Mimas, University of Manchester.
The micro-geography of UK demographic change Paul Norman School of Geography, University of Leeds Understanding Population Trends and Processes.
EGM – Population & Housing Censuses Eurostat / UNECE - Geneva - 24/25 May 2012 Beyond 2011 The future of population statistics (England & Wales) Alistair.
Statistical Disclosure Control for the 2011 UK Census Keith Spicer Office for National Statistics.
Access routes to 2001 UK Census Microdata: Issues and Solutions Jo Wathan SARs support Unit, CCSR University of Manchester, UK
2001 Census Programme Delivering UK Census Data to Researchers: Progress and Challenges David Martin University of Southampton and ESRC/JISC Census Programme.
Methods of Geographical Perturbation for Disclosure Control Division of Social Statistics And Department of Geography Caroline Young Supervised jointly.
CCG 1 MoSeS Introduction and Progress Report Andy Turner
2011 Census Using administrative data to address under-enumeration Robert Beatty Northern Ireland Census Office.
Population Projections by Ethnic Group Pete Large ONS
RGS-IBG Online CPD course in GIS Analysing Data using WebGIS: The Office of National Statistics Session 3.
The Spatial Scale of Residential Segregation in Northern Ireland, 1991–2001 Chris Lloyd 1, Ian Shuttleworth 1 and David Martin 2 1 School of Geography,
General Register Office for S C O T L A N D information about Scotland's people Producing small area housing and household statistics from Council Tax.
Lisbon, 12th October 2011 Creating 2001 to 2011 population grids using Census Geography Bart-Jan Schoenmakers Department of Methodology and Information.
Nigel James Bodleian Library The Census Accessing and mapping British Census Data.
GEOG3025 Census and administrative data sources 2: Outputs and access.
The micro-geography of UK demographic change Paul Norman School of Geography, University of Leeds understanding population trends and processes.
Using Research to Inform Geographic Policy Best-fitting from Output Areas to Higher Geographies.
The Population of the UK – © 2012 Sasi Research Group, University of Sheffield MAPS…A DIFFERENT VIEW OF THE UNITED KINGDOM Chapter 1 THE POPULATION OF.
General Register Office for S C O T L A N D information about Scotland's people General Register Office for Scotland “Information about Scotland’s people”
Coverage assessment and adjustment methodology Owen Abbott Methodology Directorate, ONS.
Plans for Access to UK Microdata from 2011 Census Emma White Office for National Statistics 24 May 2012.
POPGROUP Slide 1 The Derived Forecasts module of the POPGROUP software Ludi Simpson, University of Manchester BSPS day meeting on household projection.
1 Guidelines for production and steps towards harmonisation Marja Tammilehto-Luode Population Statistics Statistics Finland FI Statistics Finland.
2011 Census: Lessons learned from the Business Sector Dr Barry Leventhal MRS Census & Geodemographics Group CAG Meeting 8 th January 2015.
Household Estimates and Projections: What next? Bob Garland Housing Markets and Planning Analyses.
New and easier ways of working with aggregate data and geographies from UK censuses Justin Hayes UK Data Service Census Support.
Whole of Government Accounts Ian Bulmer Head of WGA, Government Financial Reporting.
Teaching Research Methods: Resources for HE Social Sciences Practitioners Workshop 2: Using Census 2011.
General Register Office for S C O T L A N D information about Scotland's people Comparison between NHSCR and Community health index sources of migration.
GEOG3025 Administrative and statistical geographies.
WP 19 Assessment of Statistical Disclosure Control Methods for the 2001 UK Census Natalie Shlomo University of Southampton Office for National Statistics.
JOINT UN-ECE/EUROSTAT MEETING ON POPULATION AND HOUSING CENSUSES GENEVA, MAY 2009 DETERMINING USER NEEDS FOR THE 2011 UK CENSUS IAN WHITE, Office.
Structural analysis of the aggregate outputs from the 2011 Census to develop alternative integrated multidimensional conceptual models of data and geographies.
The future of Scottish Government Cross-Sectional Population Surveys Sara Grainger Survey Methodology and Co-ordination, Office of the Chief Statistician.
The statistical implications of proposed devolution of further powers – the “Balkanisation” of the UK statistics system? James Gillan – NISRA GSS Methodology.
School of Geography FACULTY OF ENVIRONMENT ESRC Research Award RES What happens when international migrants settle? Ethnic group population.
TerraPop Mission Enabling research, learning, and policy analysis by providing integrated spatiotemporal data describing people and their environment.
Data Zones - Consultation Euan Smith Small Area Stats 5 th October 2010.
Exploring Microsimulation Methodologies for the Estimation of Household Attributes Dimitris Ballas, Graham Clarke, and Ian Turton School of Geography University.
European population grids, from Models to Official Statistics Ekkehard Petri (Janusz Dygaszewicz)
Beyond 2011 Administrative data sources and low-level aggregate models for producing population counts.
The 2011 Census: Estimating the Population Alexa Courtney.
JOINT UN-ECE/EUROSTAT MEETING ON POPULATION AND HOUSING CENSUSES GENEVA, 7-9 JULY 2010 DISSEMINATING THE RESULTS OF THE 2011 CENSUS IN ENGLAND AND WALES.
General Register Office for S C O T L A N D information about Scotland's people 1 Small Area Population Estimates for Scotland Quality Assurance Harvey.
Census 2011 – A Question of Confidentiality Statistical Disclosure control for the 2011 Census Carole Abrahams ONS Methodology BSPS – York, September 2011.
EUROPEAN FORUM FOR GEOSTATISTICS CONFERENCE (EFGS) October Lisbon, Portugal 1 Lessons learned from disaggregating population data by using.
JOINT UN-ECE/EUROSTAT WORK SESSION ON MIGRATION STATISTICS GENEVA, OCTOBETR 2012 COLLECTING MIGRATION DATA IN THE UK CENSUS IAN WHITE, Office for.
IAOS Shanghai – Reshaping Official Statistics Some Initiatives on Combining Data to Support Small Area Statistics and Analytical Requirements at.
Data disclosure control Nordic Forum for Geography and Statistics Stockholm, 10 th September 2015.
The evolution of the England and Wales census in a European context Garnett Compton, ONS RSS Conference, 9 September 2015.
Evaluating the potential for moving away from a traditional census Becky Tinsley Office for National Statistics (ONS), UK.
Progress towards a table builder with in-built disclosure control for 2021 Census Keith Spicer UNECE, 22 September 2017.
The Indices of Deprivation Poverty and deprivation: Statistics for Action – Places: What are the local/ devolved administration/ UK needs? 10 February.
Conference of European Statisticians
England and Wales Grid Map
Country report – United Kingdom (ONS)
Ola Nordbeck Statistics Norway
Report on the 2008 meeting in Bled
JOINT UN-ECE/EUROSTAT MEETING ON POPULATION AND HOUSING CENSUSES
The GEOSTAT project Work Package 2 Geostatistics Working Party/Meeting
UK Labour Market Areas and Rural Urban Characteristics
Presentation transcript:

The complexities of publishing gridded data for the UK European Forum for Geostatistics Krakow – October 2014 Ian Coady Geography Policy and Research Manager Office for National Statistics

Why are we different? No use of grids at the national or sub-national level No use of administrative data in the collection and publication of statistics Historic reliance on administrative boundaries for the publication of official statistics Large user demand for Census microdata on administrative boundaries

But…. It is (partially) understood that the publication of Census microdata at the administrative level is not sustainable due to disclosure issues INSPIRE has given us a common platform and specification for the publication of statistics …and I am here to try promote the interoperability of data at the European level

Output Areas  Created for the 2001 Census  Built around consistent numbers of population and households  Used postcodes as the building blocks  Included a high level of social homogeneity  Some cartographic constraints were used

Geography Policy for National Statistics

Previous work on grids 1km grids provided between 2005 and 2006 Provided by aggregating population estimates from the postcode level to the grids Lack of administrative data sources meant data below postcode level was no longer available ONS has provided data for England and Wales but (we think) Scotland and Northern Ireland have provided data separately

Best-Fitting from Postcode

Research Questions 1) How can the sex and age variables that do not currently exist on the postcode level mid-year population estimates be published? 2) How do the methodologies for publishing gridded population data differ across the devolved administrations of the UK, and how could this approach be harmonised? 3) What is the statistical impact of publishing gridded data at the postcode aggregate level rather than from the microdata? 4) What options exist for visualising gridded population data?

Small Area Population Estimates team no longer produce mid-year estimates at the postcode level To align with the Geography Policy for National Statistics all estimates are now produced at the Output Area level

Best-Fitting from Output Areas

Exact-Fitting from Census Microdata

Grid Methodologies LevelRecordsFrequencySourceAdditional Variables Households23,406,16210 yearsCensusYes PostcodesUnknown No Output Areas 181,408AnnualMid-Year Estimates No

Other alternatives….. Use soil sealing layer (SSL) to produce dasymetric reallocation of population: Small area population data are intersected with the SSL and used to re-weight population counts into settled areas, which are then aggregated to grid cells May offer consistency with broader European practice, but inconsistent with other ONS approaches. Disclosure control attitude unknown and would need to be tested. Offers alternative to postcode use that can no longer be carried out. Use ONS built-up areas layer to produce dasymetric reallocation of population: Variant of previous option but consistent with ONS data sources as uses the Built- Up Areas (BUA) layer instead of SSL. Intersects OA boundaries with BUAs and allocates population to BUAs in proportion to area. Then aggregate to grid cells. Uses only published ONS data, so no additional disclosure risk. Reproducible methodology but needs to be tested.

A country of countries Northern Ireland have disclosure concerns about the disclosure risk of publishing on both the Irish National Grid and the GEOSTAT Grid Both Scottish and Northern Irish Census microdata is stored separately and experience shows accessing this data can be a long and slow process

Sustainable variables Small Area population estimates do not currently include sex or age Increasing use of administrative data could allow this to be included Change to the SAPE processes would be required Would depend on the agreed level of publication but could potentially go further than age and sex

Conclusions Producing UK level grid outputs is possible Producing them from Census microdata is possible but only through Census and the differences between this and the small area population estimates would be noticable Differences in the methodologies of the devolved administrations are superficial but improved data sharing is needed to do this on an ongoing basis Additional variables could be provided on an ongoing basis but only through administrative data that has not yet been integrated into the ONS Statistical Business Process Model

Any questions???