The centrality of marginalia: analysing paradata from the Poverty in the UK study Heather Elliott www.novella.ac.uk.

Slides:



Advertisements
Similar presentations
SURVEY QUALITY CONTROL
Advertisements

MICS4 Survey Design Workshop Multiple Indicator Cluster Surveys Survey Design Workshop Field Staff and Field Procedures.
MICS4 Survey Design Workshop Multiple Indicator Cluster Surveys Survey Design Workshop Survey Quality Control.
Critical Reading Strategies: Overview of Research Process
Gender Inequalities in the 21 st Century Within Household Inequalities: Couple Finances March 2009 Togetherness and Autonomy in Low/Moderate Income.
The Possibilities of Narrative Analysis for Paradata: An Historically Situated Exploration NOVELLA: Ann Phoenix Janet Boddy Heather Elliott HUB: Ros Edwards.
A Student’s Guide to Methodology
MARKET RESEARCH. LEARNING INTENTIONS Students will be able to:  Describe the basic terminology of statistics  Explain how ‘sampling’ can help marketers.
Conducting the Interview/Survey
Factors affecting carers’ acceptance and use of support Dr Katherine Pollard Professor Pam Moule Dr Rennie Thompson.
Multiple Indicator Cluster Surveys Survey Design Workshop
RESEARCH METHODS Lecture 24
Social Research Methods
Everything you need to know in order to set up your Reader’s Notebook
How do I summarize and make sense of all these words?
A Student’s Guide to Methodology Justifying Enquiry 3 rd edition P ETER C LOUGH AND C ATHY N UTBROWN.
B121 Chapter 7 Investigative Methods. Quantitative data & Qualitative data Quantitative data It describes measurable or countable features of whatever.
1 RUNNING a CLASS (2) Pertemuan Matakuliah: G0454/Class Management & Education Media Tahun: 2006.
Unit 4 – Theory and Methods in Cultural Anthropology
1 Psych 5500/6500 The t Test for a Single Group Mean (Part 5): Outliers Fall, 2008.
DATA ANALYSIS IN QUALITATIVE RESEARCH Review - DATA COLLECTION METHODS= before I analyze, I must collect 1. usually data is collected by the use of two,
A QUALITATIVE RESEARCH METHOD Depth/intensive interviewing.
An Overview of Grounded Theory Dr. Simon Hayhoe, London Paper Delivered to Vrije Universiteit, Brussel (Free University, Brussels), Department of Psychology,
AUDIT PROCEDURES. Commonly used Audit Procedures Analytical Procedures Analytical Procedures Basic Audit Approaches - Basic Audit Approaches - System.
Reflective practice Session 4 – Working together.
Fieldwork. The Nature of Fieldwork  Researchers have two major options for collecting data:  Developing their own organizations or  Contracting with.
MANAGEMENT OF MARKETING
Inside Out and Back Again
Thinking Actively in a Social Context T A S C.
Making Sense of the Social World 4th Edition
Exploring the use of QSR Software for understanding quality - from a research funder’s perspective Janice Fong Research Officer Strategies in Qualitative.
Xiangyun Du Learning portfolio Xiangyun Du
THE SUCCESSFUL INTERVIEW A step by step guide to navigating the interview process.
Week 8: Research Methods: Qualitative Research 1.
Methods of Media Research Communication covers a broad range of topics. Also it draws heavily from other fields like sociology, psychology, anthropology,
S14: Analytical Review and Audit Approaches. Session Objectives To define analytical review To define analytical review To explain commonly used analytical.
 Situational Based Interviews  Behavioral Based Interviews  Competency Based Interviews SP - O MALIK AZHAR MAHMOOD.
Dr. Engr. Sami ur Rahman Assistant Professor Department of Computer Science University of Malakand Research Methods in Computer Science Lecture: Data Generation.
Multiple Indicator Cluster Surveys Regional Training Workshop I – Survey Design General Characteristics of MICS3 Questionnaires.
WHAT IS THE NATURE OF SCIENCE?. SCIENTIFIC WORLD VIEW 1.The Universe Is Understandable. 2.The Universe Is a Vast Single System In Which the Basic Rules.
1 © 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation How do I summarize and make sense of all these words?
Aim: Review Session 1 for Final Exploratory Data Analysis & Types of Studies HW: complete worksheet.
Copyright 2010, The World Bank Group. All Rights Reserved. Testing and Documentation Part II.
Sight Words.
Interview Task Assignment Description The Interview Task involves talking with an individual who is a member of a different ethnic group than your.
Close Reading Skills Evaluation Questions. What does it mean? When you have to evaluate a piece of writing you have to judge its effectiveness – the extent.
What’s coming up….  Ethnocentrism  Nature-nurture  Individual and situational explanations  Determinism and free will  Reductionism and holism  Psychology.
Analytical Review and Audit Approaches
Case Studies and Review Week 4 NJ Kang. 5) Studying Cases Case study is a strategy for doing research which involves an empirical investigation of a particular.
How to structure good history writing Always put an introduction which explains what you are going to talk about. Always put a conclusion which summarises.
Discuss how researchers analyze data obtained in observational research.
How to answer the American West exam paper Edexcel.
WHAT IS RESEARCH? According to Redman and Morry,
EXAMINERS’ COMMENTS RAPHAEL’S LONG TURN GRAMMAR Accurate use of simple grammatical structures and also of some complex sentences: ‘they could also be preparing.
My Discourse Community Professional Athletes Personal Team.
Designing a Survey The key to obtaining good data through a survey is to develop a good survey questionnaire.
Slide 7.1 Saunders, Lewis and Thornhill, Research Methods for Business Students, 5 th Edition, © Mark Saunders, Philip Lewis and Adrian Thornhill 2009.
Week 2: Interviews. Definition and Types  What is an interview? Conversation with a purpose  Types of interviews 1. Unstructured 2. Structured 3. Focus.
Sociology. Sociology is a science because it uses the same techniques as other sciences Explaining social phenomena is what sociological theory is all.
Responding to Literature The Talking Cloth Houghton Mifflin Grade 3 D. Crisler 2012/2013.
Conducting a research project. Clarify Aims and Research Questions Conduct Literature Review Describe methodology Design Research Collect DataAnalyse.
Using extracts of student work Patrick Andrews. Outline ›Context – courses taught ›Purposes of using student extracts ›The practical issues ›Student responses.
The United Kingdom experience in data collection and statistics on disability Ian Dale Head of Disability Analysis Department for Work and Pensions Steel.
What is qualitative data analysis? Different approaches to analysing qualitative data.
SP_ IRS : Research in Inclusive and Special Education
Ann Phoenix, Rosalind Edwards, Heather Elliott and Janet Boddy
RESEARCH METHODS Lecture 24
Family centred Early Intervention programmes in Jordan: a grounded theory study into family and occupational therapists’ collaboration Nisrin Alqatarneh.
‘See Me’: Exploring unmet need among young adults in Bristol
RESEARCH BASICS What is research?.
Presentation transcript:

The centrality of marginalia: analysing paradata from the Poverty in the UK study Heather Elliott

The possibilities for a narrative analysis of paradata project Research Team: Ann Phoenix, Janet Boddy, Ros Edwards; Heather Elliott Aim: To investigate the possibilities of narrative analysis of paradata, and attendant ethical issues, through working with historically situated archived data Poverty in the UK: A Survey of Household Resources and Standards of Living Aimed to define and measure poverty 3566 households, 9584 people 630 parliamentary constituencies with 4 ‘special areas’

Paradata in the Poverty in the UK Study

Paradata within survey methodology Paradata valuable to understand survey practices, particularly how technologies work in the field; how to improve response rates / data quality. Nicolaas, 2011 Paradata comprises : All data about the process of collecting survey data : such as interviewer call records, length of interview, key stroke data, interviewer characteristics Although interviewer observations and information do not describe processes, this kind of information is also often referred to as paradata. ‘A crucial step in gaining co-operation from sample members is the interaction between the interviewer and the contacted sample member’

Outline of research method Sampled four types of area: special areas, affluent, high immigration, seaside Identified booklets with extensive marginalia Emergent categorisation of marginalia: amplification : justification; explanation; evaluation : de-briefing (of self and of team); standpoint (political; personal) Focused thematic analysis (69 cases) Narrative analysis (6 cases):close reading and joint analysis

Marginalia : insights from the history of reading Readers’ marks have an uncanny ability to unsettle assumptions, pose questions, and provide new perspectives on the history of people, practices, and technologies. Sherman, 2013 ‘Marginalia cannot become ‘central’ it seems, without relegating the source text to the margins Marginalia are responsive. They arise out of a reader’s reaction to a prior printed text and are by definition dependent upon that text for their meaning. With rare exceptions they cannot be re-produced as free standing utterances.’ Jackson, 2000

Poverty in the UK : ground-breaking survey ‘Poverty can be defined objectively and applied consistently only in terms of the concept of relative deprivation’ ‘Unusual, odd and extraordinary households’...this survey is different from others. It is vital for unusual, odd and extraordinary households and not only usual or ordinary households to be properly represented in the results. Society is diverse and we are concerned to capture this diversity.... ‘Keep the number of persons refusing an interview as small as possible’ ‘ People with inadequate resources... are more likely than others to be...living in crowded conditions which make tempers short and interviewing difficult.’ ‘

Poverty in the UK : a groundbreaking survey Reliance on researchers’ observations ‘We are seeking to distinguish between coloured and non- coloured immigrants.. You should base your codes on observation together with inferences from what you are told in the interviews...’ Cash Incomes and Assets : ‘the centrepiece of the questionnaire.’ ‘Respondents will be asked about almost every possible source of income – we are convinced this method obtains better results than less complete prompting.’ ’The compensations of the poor :Private help given and received’ To develop a ‘crude classification of social integration or isolation’......

Emphasis on low refusal rates Detailed data on income /assets Reliance on observations Inclusive of hard to reach groups Interest in social support

‘ After a while she allowed me in ’ ‘The informant in this case was deaf. Two calls were made at the house. No answer 1 st visit. At 2 nd no answer was received. I called next door and was told that the informant was deaf. I asked if help could be given with the questionnaire, but was told that the informant was ‘odd’ and no-one had anything to do with her. I called at house again and informant came to the door. After a while she allowed me in. I stayed about an hour.’

‘I talked down her ear’ ‘Informant managed to hear some of what I said if I talked down her ear. She was 83 years of age and it was obviously impossible to ask her the questions in an ordinary way. We talked and I managed to ask her quite a few of the relevant questions.’

‘It was rather sad...’ ‘It was rather sad, informant had lived alone for two years, sister died in Informant kept on crying. On this bright summer evening we sat in front ‘parlour’ with curtains drawn and lights on, newspapers covered the ‘good’ chairs. Informant did not really understand why I was there – hoped that perhaps I might manage to get her more money to live on. She would not however, think of applying for national assistance, I think though that something could be done for her. Informant constantly said there is ‘no debt’ here. I have completed the questionnaire as best as I can.’

‘I completely forgot to ask her name’ ‘Informant said that she never had anyone in, was completely independent. I came away wishing I could help informant and would like to call again. Also, informant talked so much about her dead sister Ada that completely forgot to ask informant’s name.’

Paradata as indicative of team dynamics and hierarchies ‘We are checking and editing in green and purple pens: may we ask interviewers to continue to use the more prosaic colours of black, blue and red’

‘Join the dots to make a picture of the survey so far’

Typology of Paradata Forms AMPLIFICATION - figures and computation - background clarification - direct quotes JUSTIFICATION- of coding decision - of lack of coding EXPLANATION- relates to substantive focus and coding EVALUATION Character …….- individual or household personality/emotions - material/resource circumstances Claims…………- veracity of interviewee information - what may have happened/will happen DEBRIEFING Self …………….- offload/explain to self Core team …..- discuss/explain interview process - comment on research focus or questions - exchanges between interviewer and core team STANDPOINT Political ………- wider political context Social …………- wider general or local social situation Personal …….- active/voice beyond fieldworker role