September, 2013 Best Practices in Data Dissemination Public Use Data files (PUF) Mohammed Sahmoud Programmer & Web Developer Dissemination & Documentation.

Slides:



Advertisements
Similar presentations
MICS4 Survey Design Workshop Multiple Indicator Cluster Surveys Survey Design Workshop Data Archiving.
Advertisements

Domestic Violence Survey in the Palestinian Territory ((December, January, 2006.
National Seminar on Developing a Program for the Implementation of the 2008 SNA and Supporting Statistics in Turkey Uğuzhan TÜRKOĞLU 10 September 2013.
An Introduction to the UK Data Archive and the Economic and Social Data Service November 2007 Jack Kneeshaw, UKDA.
Will 2011 be the last Census of its kind in England and Wales? Roma Chappell, Programme Director Beyond 2011 Office for National Statistics, July 2011.
The Samples of Anonymised Records: Understanding Individual differences Mark Brown.
Implementation of the CoP in SLOVENIA Cooperation with data users Genovefa RUŽIĆ Deputy Director-General.
The state of the art: DHS and MICS
Dissemination of U.S. Census Data and Results: The role of ICPSR First Conference of Al-Khawarezmi Committee on Statistics Doha, Qatar 6-8 December 2010.
United Nations Expert Group Meeting on Revising the Principles and Recommendations for Population and Housing Censuses New York, 29 October – 1 November.
Developing a System for Web Based Data Dissemination CSO Experience Strategies for Web based Data Dissemination Ghusoon M. Hameed IRAQ.
QATAR STATISTICS AUTHORITY DATA AND METADATA STRATEGY Pinar UCAR Statistical Specialist.
St. Lucia Country Report By Edwin St Catherine Director, Central Statistical Office Presented to IPUMS Workshop August 24 th, 2007.
REDATAM+SP WebServer as a tool for dissemination of microdata REDATAM+SP WebServer as a tool for dissemination of microdata Alejandra Silva CELADE- Population.
Palestinian Central Bureau of Statistics (PCBS) Palestine Poverty Maps 2009 March
United Nations Expert Group Meeting on Revising the Principles and Recommendations for Population and Housing Censuses New York, 29 October – 1 November.
CAPMAS Arab Republic of Egypt Central Agency for Public Mobilization and Statistics Presented by : Salwa Elsayed Selim Elshazly Director of establishments.
National Statistical Office, Thailand 2-6 December 2013, Hanoi, Viet Nam Census Evaluation.
IPUMS to IHSN: Leveraging structured metadata for discovering multi-national census and survey data Wendy L. Thomas 4 th Conference of the European Survey.
World Bank: Microdata Library Development Data Group.
Issues Related to Data Dissemination in Official Statistics Presented at the European Conference On Quality in Official Statistics Helsinki, Finland May.
Emerging Trends in Data Dissemination – A Trinidad & Tobago Perspective By Mohanee Sinanan-Mitchell.
Ola Awad Acting President, Palestinian Central Bureau of Statistics Ramallah, Palestine Statistics development for fragile and post conflict.
United Nations Regional Workshop on Data Dissemination and Communication Ms. Fallon Lambert Rio de Janeiro, Brazil, 5-7 June 2013 General Bureau of Statistics.
REFERENCE METADATA FOR DATA TEMPLATE Ales Capek EUROSTAT.
Record matching for census purposes in the Netherlands Eric Schulte Nordholt Senior researcher and project leader of the Census Statistics Netherlands.
Population Census carried out in Armenia in 2011 as an example of the Generic Statistical Business Process Model Anahit Safyan Member of the State Council.
1 The 2001 Census PUMFS Odyssey Sponsored by HAL and PALS Presented by Chuck Humphrey.
Population census micro data for research: the case of Slovenia Danilo Dolenc Statistical Office of the Republic of Slovenia Ljubljana, First Regional.
Documenting and disseminating census and survey data sets Ilpo Survo, United Nations ESCAP, Bangkok, for UNECE.
Developing Survey Handbooks as Educational Tools for Data Users Presented at the European Conference on Quality in Official Statistics May 2010 Deborah.
Increasing the Effectiveness of Household Surveys Eric Swanson, Program Manager for Global Monitoring Development Data Group World Bank.
The 2010 Population and Housing Census of Mongolia: Census PES 1 A.Amarbal Director of Population and Housing Census Bureau, National Statistical Office.
Use of Administrative Data Seminar on Developing a Programme on Integrated Statistics in support of the Implementation of the SNA for CARICOM countries.
1 Census Data Dissemination and Utilization A Case of China 2010 Census.
United Nations Regional Seminar on Census Data Dissemination and Spatial Analysis for Arabic Speaking Countries, Amman, Jordan May 2011 Identification.
United Nations Regional Seminar on Census Data Dissemination and Spatial Analysis Amman - Jordan 16 – 19 May 2011 Determination of the scope and form of.
Instituto Nacional de Estadística, Geografía e Informática (INEGI), Mexico National Economic Surveys (NES) Jun 2007.
The Role of Metadata in Census Data Dissemination Presented By Mrs. Shirley Christian-Maharaj Assistant Director of Statistics CSO Trinidad &Tobago.
Statistical data confidentiality and micro data in Albania
United Nations Regional Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys Asunción,
UN Workshop for South Asian Countries on Collection and Dissemination of Socio-economic Data from Population and Housing Censuses May 2012 Rudra.
High-Level Forum on Strategic Planning for Statistics in Central Asia Countries Bishkek, Kyrgyz Republic, May 2006 Oleg Kara, Deputy Director General,
United Nations Regional Seminar on Census Data Dissemination and Spatial Analysis for Arabic Speaking Countries, Amman, Jordan May 2011 Identification.
Workshop on Collection and Dissemination of Socio-economic Data from Population and Housing Censuses New Delhi, India, May 2012 United Nations Demographic.
UNSC 41 Palestinian Central Bureau of Statistics (PCBS) Palestinian CensusInfo February 22 nd, 2010 Presented by: Ola Awad Acting President of PCBS.
Agency on Statistics of the Republic of Kazakhstan A strategy for the dissemination of statistical information: the Kazakhstan experience.
United Nations Regional Seminar on Census Data Dissemination and Spatial Analysis, Bangkok, 5-8 October 2010 Seminar on Data Dissemination and Spatial.
JOINT UN-ECE/EUROSTAT MEETING ON POPULATION AND HOUSING CENSUSES GENEVA, 7-9 JULY 2010 DISSEMINATING THE RESULTS OF THE 2011 CENSUS IN ENGLAND AND WALES.
SURVEYS WORKSHOP Edinburgh City Council, 16 th April 2009 ScotStat Network of Analysts from Local Government and Other Public Bodies.
10 August Inter-Regional Workshop on the Production of Gender Statistics New Delhi, India, 6-10 August 2007 Strengthening National Gender Statistics.
Census Office Fernando Casimiro Geneva, July 2010 Portugal – Census results tailored to user needs «
Palestinian Central Bureau of Statistics Best Practices in Data Dissemination Public Use Data files (PUF) Ola Awad, Acting President March, 2010.
Department of Census and Statistics 1 United Nations Regional Seminar on Census Data Dissemination and Spatial Analysis 5-8 October, 2010 Bangkok, Thailand.
How official statistics is produced Alan Vask
Developments in dissemination over the time Anne Nuka Head of Marketing and Dissemination Division
GHANA STATISTICAL SERVICE IPUMS – Country Report: Ghana BY N.N.N. Nsowah-Nuamah (Deputy Government Statistician)
Data access and development: The IPUMS perspective United Nations Commission on Population and Development The data revolution in action: National and.
French new census : method and utilization IPUMS Workshop 9 june Paris.
CENSUS MICRODATA : THAILAND NATIONAL STATISTICAL OFFICE by PAKAMAS RATTANALANGKARN Thailand National Statistical Office.
PREPARED BY ABDALLAH NAJJAR PALESTINIAN CENTRAL BUREA OF STATISTICS CENSUSES EXPERIENCE IN PALESTINE OCTOBER 2013.
INTERNATIONAL EXPERT GROUP MEETING ON MECHANISMS FOR ENSURING CONTINUITY OF 10-YEAR POPULATION CENSUSES: STRATEGIES FOR REDUCING CCENSUS COSTS Conducting.
Population and Housing Census of the Kyrgyz Republic
Legal framework of territorial classifications and typologies for European statistics – state of play NUAC meeting, Brussels June 2015 Gorja Bartsch.
2011 POPULATION AND HOUSING CENSUS PREPARATORY WORKS
Albania 2021 Population and Housing Census - Plans
High-level Working Group on Statistical Confidentiality
A review of the 2011 census round in the EU, including the successful implementation of a detailed European legal base First meeting of the Technical Coordination.
Topic : The use of Technological tools in Data Dissemination
Presentation transcript:

September, 2013 Best Practices in Data Dissemination Public Use Data files (PUF) Mohammed Sahmoud Programmer & Web Developer Dissemination & Documentation Department

PCBS’ dissemination Strategy The PUF (digital files) The Proactive Dissemination The Social Responsibility The Core User Producer Dialogue

PCBS’ dissemination Strategy As part of PCBS dissemination strategy, the focus is on empowering users through: 1.Micro data for public use (PUF) 2.Micro data for special use 3.Statistical library Empower users

PCBS’ dissemination Strategy 1.Census micro data is available for public use for everyone with detailed information on the contents posted on PCBS’ web site 2.Micro data usage is regulated by special agreement and a license: Site, personal, and group license 3.All local universities have free copies of PCBS’ digital data files including the census

What is PUF: 1.Data in digital formats based on surveys and censuses as part of user empowerment 2.Data is treated to ensure the preservation of data confidentiality 3.Data is documented in user friendly manner along with the corresponding metadata to enable effective utilization of data by users 4.Use of data is regulated by agreement and license between the user and the PCBS

Why to PUF: 1.Break the rigid relation between surveys and type of output from 1-1 relation to 1-many: One surveys gives variety of outputs 2.Empower users mainly researchers, academic institutions, post graduate students 3.Data Feeder for on-line statistical databases as a By Product Output (PUF as input to statistical databases) 4.Reduce the burden off PCBS – Reduce data requests for detailed and customized data

The PUF System InputOutput Process Survey Data Census Data Methodologies Treatment of data according to predefined standards Public Use Data File (ASCII; SPSS) Documentation (User Manual) Balancing between user’s needs and data confidentiality

The beginning of the PUF experience……. 1.Census 1997 as learning experience for the whole organization 2.Final results disseminated in nine months from census enumeration 3.Census was the first experiment in preparing microdata. Since then, all of PCBS surveys are disseminated in digital formats

Output of Census 1997 PLUS 20% sample as PUF

Census 1997 – The characteristics of the PUF The micro data file was a sample with the following characteristics: The sampling frame consists of a list of all households that have been counted during the population, housing and establishment census These households cover all households living, during the census, in the West Bank and Gaza Strip except those living in the annexed part of Jerusalem. Regarding sample design, a systematic random sample of 20% of the households is selected, then all household members of the selected households are selected. Regarding sampling weights, they are calculated and added to the data file, and they should be used when calculating estimates from the data file.

The PUF of Census 1997 – Selected International Publications 1.Taraki L (editor). Living Palestine. Family Survival, Resistance, and Mobility under Occupation. Syracuse University Press, New York Hill, AG, CJ Clark, IM Lubbad and C Bruderlein (2006) Hope and despair over health in Gaza. British Medical Journal 333 (21): Lubbad, I, CJ Clark and AG Hill (2006) Population Projections for Socio- economic Development in the Gaza Strip, Harvard Program on Humanitarian Policy and Conflict Research. 4.Hill, AG. Demographic and health prospects in the Occupied Palestinian Territory. A Congressional Briefing on Changing Demographics of the Middle East: How Policies and Programs Affect Stability in the Region sponsored by the Office of Representative Danny Davis (D-IL), the Office of Representative Rush Holt (D-NJ), The Office of Representative Mark Kirk (R-IL), Rayburn Building,

The PUF of Census 2007 – The approach First step: surveying data users who used PUF 1997 about their views and feedback to incorporate their needs into the PUF of Census 2007 Some of the comments received by users…………. 1.Our demand is for digital files which contain all of the data for particular locales, especially cities. This is because we have noted varied urbanities emerging in the OPT, ranging from Ramallah to Hebron and Gaza, which are important to study in detail in order to assess what is currently taking place now, and to plan for the future 2.Census micro data was like a dream come true for us as researchers 3.To have census digital data files posted on our intranet at the university for utilization by our graduate students is something that we are very proud of.

The PUF of Census 2007 – The approach Second step: Technical committee to prepare the PUF 1.The PUF was prepared in The Sample is 20% 3.Data available in ASCII and SPSS formats 4.Since 2009, it is available for PUBLIC USE 5.Provided to IPUMS projects so it is available for users worldwide

1.The PUF is compulsory output of every survey 2.More than 190 PUF data sets based on surveys and censuses 3.The closure of survey’s project not complete without the PUF 4.PUF release date is specified in PCBS statistical calendar

PCBS’ census PUF - International

PCBS’ PUF – The Web Portal :

Digital data PUF(PUF++ (Researchers Standard; All users Standard PUF More variables More details (Less grouping of variables)

Best Practices in Data Dissemination Public Use Data files (PUF) September, 2013 Thank You