2011 Census (E&W) Dissemination Strategy Key Drivers: Direction of government policy ONS Web Strategy Aspirations for a re-use community
Direction of Government Policy Transparency Board and Public Data principles User demand, machine readable, open, re-usable Open Government Licence Free to publish and exploit legally Acknowledge source Do not mislead Linked Data : 5 star data ratings 1 On the web (whatever format), with an open licence 2 Plus machine-readable structured data (e.g. excel) 3 Plus non-proprietary format (e.g. CSV instead of excel) 4 Plus, open standards to identify published objects 5 Plus, link your data to other peoples data to provide context
1.Enabling re-use of our content by others 2.A single ONS website 3.Integration of back office systems 4.To fit within a wider official statistics strategy 5.User focus 6.New ways of presenting and communicating our statistics 7.Automating data take-on 8.Open data standards and metadata 9.Focusing on core requirements and using partnerships 10.Keep it simple ONS Web Strategy
A Re-use Community Open Sharing Encouraging Enabling [Dont have to behave in this way to re-use our data, but we are keen to encourage this type of use] Ordnance Survey example
UK Harmonised Datasets No post tabular disclosure control Potential at UALA and above: Greater detail than 2001 Themed Multi-dimensional Datasets Below UALA: Cross classifications generally contain the same level of detail as 2001. Same Table types (Univariate/CAS/Standard) 2011 Census Datasets
2011 Census Metadata Structural : Needed to make & use datasets Reference/supporting information: needed to understand the data in the datasets
Metadata About the Census Legislation and Policy documentation Programme/Project documentation Operational and Statistical Processing documentation Documentation of Statistical Methodology Quality Management documentation Timeliness and Punctuality Relevance About the Data Product and Service documentation Statistical Population Accuracy and Reliability Comparability Confidentiality Coherence Comments Index of Variables Definition Associated Variables Source Questions Glossary Definition
Mandatory Optional Structural MetadataReference Metadata About the Census Legislation and Policy documentation Programme/Project documentation Operational and Statistical Processing documentation Documentation of Statistical Methodology Quality Management documentation Timeliness and Punctuality Relevance About the Data Product and Service documentation Statistical Population Accuracy and Reliability Comparability Confidentiality Coherence Comments Glossary Definition Index of Variables Definition Associated Variables Source Questions Dataset Details Dimension Dimension Item Target Classification Target Classification Item Linked Metadata:
ONS Data Feeds Development ESRC funded group started in 2007 ONS established Census Web Services Working Group in 2008 Membership / Participants ONS/GROS/NISRA/WAG ESRC/JISC SASPAC/Local Gvt NOMIS Ordnance Survey BBC / Home Office / DOH
Data Feeds: Work To Date Working in partnership with Manchester University to create test datasets; using 2001 data from InFuse. Launched an Alpha API (clone of the API behind the new website) in December 2010. SASPAC, Manchester University, and NOMIS rapidly built applications to access the test data via the API
Data Feeds: Application Development Three Applications developed December 2010 NOMIS: Data Picker and Report SASPAC: Integrating data into desktop software CDU: Visualisation application
Live Links NOMIS live: http://nmtest.dur.ac.uk/Default.aspx and http://nmtest.dur.ac.uk/scenario3.aspx NOMIS video https://www.nomisweb.co.uk/Projects/ONS/WDP/FR3/demo.htm CDU video http://cdu.mimas.ac.uk/projects/3dapp/demo.htm SASPAC video: http://www.saspac.org/dev/SASPAC-API-demo-Jan2011.swf
Work To Do More datasets from Manchester University; based on the indicative table layouts. Working towards a Beta API in early 2012; with more data, metadata, and partners. Working with the ONS Web Strategy Implementation team to develop a fully operating Data Feeds Service prior to release of 2012 Census data in September 2012.
Call to action If you think you may be interested in accessing ONS data through the API service – we want to hear from you Census.email@example.com
Your consent to our cookies if you continue to use this website.