Presentation is loading. Please wait.

Presentation is loading. Please wait.

Www.ipums.org/international 54th ISI, Berlin 20031 IPUMS-International: A Restricted Access Web-Site Providing Anonymized, Integrated Census Microdata.

Similar presentations


Presentation on theme: "Www.ipums.org/international 54th ISI, Berlin 20031 IPUMS-International: A Restricted Access Web-Site Providing Anonymized, Integrated Census Microdata."— Presentation transcript:

1 www.ipums.org/international 54th ISI, Berlin 20031 IPUMS-International: A Restricted Access Web-Site Providing Anonymized, Integrated Census Microdata for Social Science and Policy Research * * * Robert McCaa, Steven Ruggles, Matt Sobek (University of Minnesota) and Albert Esteve (Centre d’Estudis Demografics)

2 www.ipums.org/international 54th ISI, Berlin 20032 Overview: access, privacy and confidentiality for integrated census microdata of 40+ countries 1. Goals and accomplishments 2. Confidentiality and privacy protections: legal, administrative, technical 3. Data: cleaning, constructing, and integration 4. Access: custom-tailored extracts (not whole datasets); users and uses 5. Summary: new directions, 6 strengths and an aspiration

3 www.ipums.org/international 54th ISI, Berlin 20033 1. Goals and accomplishments

4 www.ipums.org/international 54th ISI, Berlin 20034 Four Goals: Four Goals: » 1. Inventory the world’s census microdata » 2. Preserve endangered microdata a. contract preservation with repositories b. deposit copies in at least two archives: National Statistical Organization and... WHO… * * * » 3. Integrate datasets of authorized countries using UNSD and other standards » 4. Disseminate extracts of database to approved researchers without charge (copy to each NSI)

5 www.ipums.org/international 54th ISI, Berlin 20035 Minnesota Population Center University of Minnesota Principal investigators: historians: Steven Ruggles Robert McCaa www.ipums.org/international 1998First agreement signed 1999Funding authorized 2002First data release, 7 countries: China, Colombia, France, Kenya, Mexico, USA, Vietnam 2003 Regional projects: Latin America, Europe … Accomplishments:

6 www.ipums.org/international 54th ISI, Berlin 20036 Preserve data Preserve data & documentation & documentation UN Demographic Center for Latin America (CELADE, Santiago, Chile) 3000+ microdata tapes preserved

7 www.ipums.org/international 54th ISI, Berlin 20037 Integration projects: 40 Partners + 1 (Table 1: August 16, 2003 ) World Region Official Statistical Authority Africa Ghana, Kenya, Madagascar Americas Argentina, Brazil, Chile, Colombia, Costa Rica, Dominican Republic, Ecuador, El Salvador, Guatemala, Honduras, Mexico, Nicaragua, Panama, Paraguay, Peru, Venezuela, USA Asia China, Tajikistan, Turkmenistan, Vietnam Europe Austria, Belarus, Bulgaria, Czech Republic, France, Germany, Greece, Hungary, Netherlands, Portugal, Romania, Russia, Slovenia, Spain, the United Kingdom Middle East Israel, Palestinian Authority

8 www.ipums.org/international 54th ISI, Berlin 20038 Data Access: first release May 2002 7 countries, 23 samples ~60 million person records USA 1960, 1970, 1980, 1990, 2000 China 1982 Colombia 1964, 1973, 1985, 1993 France 1962, 1968, 1975, 1982, 1990 Kenya 1989, 1999 Mexico1960, 1970, 1990, 2000 Vietnam 1989, 1999

9 www.ipums.org/international 54th ISI, Berlin 20039 2. Confidentiality and privacy protections

10 www.ipums.org/international 54th ISI, Berlin 200310 Confidentiality and privacy protections: changing perceptions » Growing recognition that anonymized census microdata samples do not violate national legislation on statistical confidentiality and privacy » International Monetary Fund’s General Data Dissemination System: 52 countries with uniform standards: » All enforce strict standards of statistical confidentiality » Prohibit disclosure of information which may identify individuals or entities » In 2000, 37of 52 countries disseminate anonymized census microdata samples

11 www.ipums.org/international 54th ISI, Berlin 200311 Confidentiality protections, IPUMSI: legal, administrative, and technical 1. Dissemination agreement between University of Minnesota and each National Statistical Institute » Uniform 10 point protocol: ownership, use, authorization, restrictions, confidentiality, security, publication, violations, sharing, and arbitration 2. Conditional use license between the University of Minnesota and each researcher » Permission to use restricted access microdata, 3 criteria: research need, research competence, and agree to conditions of use 3. Technical data protection measures » Specific to each country …/

12 www.ipums.org/international 54th ISI, Berlin 200312 Confidentiality protections, IPUMSI: technical » Technical data protection measures » Adopt sample size according to national norms » Suppress detailed geography » Top and bottom code continuous variables » Suppress dates: (birth, migration, marriage, etc.) » “Swap” (recode) place of enumeration for a small fraction of households » Randomly order households within administrative units » No semi-automatic procedures (e.g., μ-Argus)

13 www.ipums.org/international 54th ISI, Berlin 200313 Only serious researchers need apply (Table 2) Official Over-sight Boards cited by approved users Commission Nationale Information et Liberte Commission Nationale Information et Liberte Comite National d'Ethique Comite National d'Ethique Institutional Review Board--research on human subjects) Institutional Review Board--research on human subjects) IRD scientific commission (Conseil Scientifique) IRD scientific commission (Conseil Scientifique) ISA and its research committees RC28 and RC33 ISA and its research committees RC28 and RC33 National Committees for Research Ethics--Norway National Committees for Research Ethics--Norway USA Federal Code title 13/title 26 /title 5 USA Federal Code title 13/title 26 /title 5 Vice-decanat a la recherche, l'ethique Vice-decanat a la recherche, l'ethique Funding Agencies Canadian Foundation for Innovation Canadian Foundation for Innovation Council for the Development of Social Science Research in Africa Council for the Development of Social Science Research in Africa Economic and Social Research Council, UK Economic and Social Research Council, UK National Science Foundation National Science Foundation National Institutes of Health National Institutes of Health Norwegian University Development Aid Funding Norwegian University Development Aid Funding Rockefeller Foundation Rockefeller Foundation Wellcome Trust Wellcome Trust Institutional affiliations (Europe & Canada) Cardiff University Cardiff University Demographic Studies Center - University A. of Barcelona Demographic Studies Center - University A. of Barcelona Department of Statistics, University of Florence Department of Statistics, University of Florence INED Paris INED Paris Institut d etudes politiques de Paris Institut d etudes politiques de Paris Institut francais de recherche en Afrique (IFRA) Institut francais de recherche en Afrique (IFRA) Ministry of Economic Development and Trade Ministry of Economic Development and Trade Novosibirsk State Technical University Novosibirsk State Technical University University College London University College London Department of Demography, University of Montreal Department of Demography, University of Montreal Queen's University Queen's University Simon Fraser University Simon Fraser University Statistics Canada -Library and information centre Statistics Canada -Library and information centre University of Toronto University of Toronto Institutional affiliations (Africa, Asia, Latin America) African Population and Health Research Center African Population and Health Research Center Centro de Investigacion y Docencia Economicas. Centro de Investigacion y Docencia Economicas. Hong Kong University of Science and Technology Hong Kong University of Science and Technology National University of Singapore National University of Singapore The University of Nairobi The University of Nairobi The World Bank The World Bank Universidad Externado de Colombia Universidad Externado de Colombia Universidad Pedagogica Experimental Libertador Universidad Pedagogica Experimental Libertador World Agro-Forestry Centre World Agro-Forestry Centre World Health Organization World Health Organization

14 www.ipums.org/international 54th ISI, Berlin 200314 3. Data enhancements & integration

15 www.ipums.org/international 54th ISI, Berlin 200315 Data Enhancements: » Data quality and enhancements: added value » Clean data to eliminate duplicate records » Conduct internal consistency checks » Impute missing, inconsistent values » Constructed variables to facilitate analysis » Pointer variables for Mothers, Fathers, Spouses » Family and household variables

16 www.ipums.org/international 54th ISI, Berlin 200316 Integration (not standardization): » Adopt uniform coding schemes, nomenclatures and classifications » United Nations Statistics Division (Priniciples & Recs) » UNESCO (ISCED) » International Labor Office (ISCO-88) » Composite coding scheme; 2 simple, but seemingly contradictory rules (Table 3, next slide): 1. Retain original detail 2. Harmonize each digit …/

17 www.ipums.org/international 54th ISI, Berlin 200317 Composite coding scheme: Employment Status Composite coding scheme: Employment Status

18 www.ipums.org/international 54th ISI, Berlin 200318 Integration Work Plan: » Assemble microdata and documentation (MPC, NSI) » Develop samples to minimize confidentiality risk and maximize robustness (MPC or NSI partner) » Design national integration plan (NSI, consultants) census-by-census concept-by-concept code-by-code » Write integrated documentation (MPC, partners) » Program integration (MPC)

19 www.ipums.org/international 54th ISI, Berlin 200319 Photos from Colombia integration project, February-March, 2000: 4 experts from DANE (census office) +7 academics (3 universities) Standard:UN/ Eurostat Principles & Recs... Census documentation compiled for Colombian microdata

20 www.ipums.org/international 54th ISI, Berlin 200320 4. Access

21 www.ipums.org/international 54th ISI, Berlin 200321 Data Access: web-based extraction system » Password protected: to make and retrieve extracts » Researcher selects: » countries, » censuses, » Cases/sub-populations, » variables, and » Sample densities » Extract engine queues request, generates extract » Researcher retrieves extract via web » NO: CDs, original codes, or complete datasets

22 www.ipums.org/international 54th ISI, Berlin 200322 5. Regional initiatives & summary

23 www.ipums.org/international 54th ISI, Berlin 200323 IPUMS-Latin America, 2003-2007: 16 countries, ~500m. people » Scope: Latin American census microdata, 1960-present census microdata, 1960-present census microdata, 1960-present » Work Plan » 2001-2: Sign licensing agreements with official agencies 2001-2: Sign licensing agreements with official agencies 2001-2: Sign licensing agreements with official agencies » 2002-3: Obtain funding from U.S. NIH » 2004: Develop/translate microdata & metadata » : Country expert teams design national integrations » 2005: MPC/expert teams design regional integration » 2006: MPC integrates microdata and metadata » 2007: MPC disseminates to bona fide researchers who show need and agree to conditions of use.

24 www.ipums.org/international 54th ISI, Berlin 200324 ICM-Europe: 14+ national teams

25 www.ipums.org/international 54th ISI, Berlin 200325 Summary, 6 strengths and an aspiration 1. Uniform legal authorization 2. Access restricted to scientists with need 3. Experienced integration teams 4. Proven web-based distribution system 5. High user satisfaction 6. Sustainability: MPC, ICPSR, WHO Aspiration: 90 countries, 90% world’s population by 2010…

26 www.ipums.org/international 54th ISI, Berlin 200326 additional information at: http://www.ipums.org/international * * * * * * Contact: Robert McCaa rmccaa@umn.edu


Download ppt "Www.ipums.org/international 54th ISI, Berlin 20031 IPUMS-International: A Restricted Access Web-Site Providing Anonymized, Integrated Census Microdata."

Similar presentations


Ads by Google