Pre-processing AFFY data

Slides:



Advertisements
Similar presentations
NASC Normalisation and Analysis of the Affymetrix Data David J Craigon.
Advertisements

Computational Statistics. Basic ideas  Predict values that are hard to measure irl, by using co-variables (other properties from the same measurement.
P. J. Munson, National Institutes of Health, Nov. 2001Page 1 A "Consistency" Test for Determining the Significance of Gene Expression Changes on Replicate.
Bias, Variance, and Fit for Three Measures of Expression: AvDiff, Li &Wong’s, and AvLog(PM-BG) Rafael A. Irizarry Department of Biostatistics, JHU (joint.
Microarray Quality Assessment Issues in High-Throughput Data Analysis BIOS Spring 2010 Dr Mark Reimers.
Gene Expression Index Stat Outline Gene expression index –MAS4, average –MAS5, Tukey Biweight –dChip, model based, multi-array –RMA, model.
Microarray Normalization
Zhongxue Chen, Monnie McGee, Qingzhong Liu and Richard Scheuermann
Analysis and Interpretation of Microarray Data Michael F. Miles, M.D., Ph.D. Depts. of Pharmacology/Toxicology and Neurology and the Center for Study of.
Introduction to Affymetrix Microarrays
Normalization of Microarray Data - how to do it! Henrik Bengtsson Terry Speed
Statistical Methods in Microarray Data Analysis Mark Reimers, Genomics and Bioinformatics, Karolinska Institute.
Getting the numbers comparable
Probe Level Analysis of AffymetrixTM Data
DNA Microarray Bioinformatics - #27612 Normalization and Statistical Analysis.
Preprocessing Methods for Two-Color Microarray Data
Low-Level Analysis and QC Regional Biases Mark Reimers, NCI.
Summarizing and comparing GeneChip  data Terry Speed, UC Berkeley & WEHI, Melbourne Affymetrix Users Meeting, Friday June 7, 2002 Redwood City, CA.
Identification of spatial biases in Affymetrix oligonucleotide microarrays Jose Manuel Arteaga-Salas, Graham J. G. Upton, William B. Langdon and Andrew.
1 Preprocessing for Affymetrix GeneChip Data 1/18/2011 Copyright © 2011 Dan Nettleton.
SNP chips Advanced Microarray Analysis Mark Reimers, Dept Biostatistics, VCU, Fall 2008.
Normalization of 2 color arrays Alex Sánchez. Dept. Estadística Universitat de Barcelona.
Data analytical issues with high-density oligonucleotide arrays A model for gene expression analysis and data quality assessment.
1 Models and methods for summarizing GeneChip probe set data.
Microarray Data Analysis Data quality assessment and normalization for affymetrix chips.
Microarray Data Analysis Data quality assessment and normalization for affymetrix chips.
ViaLogy Lien Chung Jim Breaux, Ph.D. SoCalBSI 2004 “ Improvements to Microarray Analytical Methods and Development of Differential Expression Toolkit ”
SPH 247 Statistical Analysis of Laboratory Data. Two-Color Arrays Two-color arrays are designed to account for variability in slides and spots by using.
Summaries of Affymetrix GeneChip probe level data By Rafael A. Irizarry PH 296 Project, Fall 2003 Group: Kelly Moore, Amanda Shieh, Xin Zhao.
Microarray Preprocessing
1 Normalization Methods for Two-Color Microarray Data 1/13/2009 Copyright © 2009 Dan Nettleton.
(4) Within-Array Normalization PNAS, vol. 101, no. 5, Feb Jianqing Fan, Paul Tam, George Vande Woude, and Yi Ren.
Practical Issues in Microarray Data Analysis Mark Reimers National Cancer Institute Bethesda Maryland.
DATA TRANSFORMATION and NORMALIZATION Lecture Topic 4.
CDNA Microarrays MB206.
Probe-Level Data Normalisation: RMA and GC-RMA Sam Robson Images courtesy of Neil Ward, European Application Engineer, Agilent Technologies.
Estimating Signal with Next Generation Affymetrix Software Earl Hubbell, Ph.D. Principal Statistician, Applied Research.
Assessing expression data quality in high-density oligonucliotide arrays.
Lo w -Level Analysis of Affymetrix Data Mark Reimers National Cancer Institute Bethesda Maryland.
Inference for Regression Simple Linear Regression IPS Chapter 10.1 © 2009 W.H. Freeman and Company.
Regression Analysis Week 8 DIAGNOSTIC AND REMEDIAL MEASURES Residuals The main purpose examining residuals Diagnostic for Residuals Test involving residuals.
Lecture Topic 5 Pre-processing AFFY data. Probe Level Analysis The Purpose –Calculate an expression value for each probe set (gene) from the PM.
Summarization of Oligonucleotide Expression Arrays BIOS Winter 2010.
Model-based analysis of oligonucleotide arrays, dChip software Statistics and Genomics – Lecture 4 Department of Biostatistics Harvard School of Public.
1 Global expression analysis Monday 10/1: Intro* 1 page Project Overview Due Intro to R lab Wednesday 10/3: Stats & FDR - * read the paper! Monday 10/8:
Statistics for Differential Expression Naomi Altman Oct. 06.
Microarray Data Pre-Processing
Statistical Analyses of High Density Oligonucleotide Arrays Rafael A. Irizarry Department of Biostatistics, JHU (joint work with Bridget Hobbs and Terry.
Oigonucleotide (Affyx) Array Basics Joseph Nevins Holly Dressman Mike West Duke University.
Gene expression  Introduction to gene expression arrays Microarray Data pre-processing  Introduction to RNA-seq Deep sequencing applications RNA-seq.
Distinguishing active from non active genes: Main principle: DNA hybridization -DNA hybridizes due to base pairing using H-bonds -A/T and C/G and A/U possible.
Statistical Analysis for Expression Experiments Heather Adams BeeSpace Doctoral Forum Thursday May 21, 2009.
Exploration, Normalization, and Summaries of High Density Oligonucleotide Array Probe Level Data Rafael A. Irizarry Department of Biostatistics, JHU (joint.
Microarray Data Analysis Xuming He Department of Statistics University of Illinois at Urbana-Champaign.
Global predictors of regression fidelity A single number to characterize the overall quality of the surrogate. Equivalence measures –Coefficient of multiple.
Data Modeling Patrice Koehl Department of Biological Sciences
Introduction to Affymetrix GeneChip data
Canadian Bioinformatics Workshops
Copy-number estimation using Robust Multichip Analysis - Supplementary materials for the aroma.affymetrix lab session Henrik Bengtsson & Terry Speed Dept.
Differential Gene Expression
CDNA-Project cDNA project Julia Brettschneider (UCB Statistics)
Normalization Methods for Two-Color Microarray Data
Gene Expression Arrays
The Basics of Microarray Image Processing
Modelling data and curve fitting
Getting the numbers comparable
Normalization for cDNA Microarray Data
Microeconometric Modeling
Lecture 3 From Images to Data
DATA TRANSFORMATION and NORMALIZATION
Presentation transcript:

Pre-processing AFFY data Lecture Topic 5 Pre-processing AFFY data

Probe Level Analysis The Purpose Calculate an expression value for each probe set (gene) from the 11-25 PM and MM intensities Critical for later analysis. Avoiding GIGO

Difficulties Large variability Few measurements (11-25) at most MM is very complex, it is signal plus background Signal has to be SCALED Probe-level effects

Different Methods MAS 4 Affymetrix 1996 MAS 5 Affymetrix 2002 Robust Multichip Analysis (RMA) 2002 GC-RMA 2004

MAS 4 A- probe pairs selected

Avg Diff Calculated using differences between MM and PM of every probe pair and averaging over the probe pair Excluded OUTLIER pairs if PM-MM > 3 SD Was NOT a robust average NOT log-transformed COULD be negative (about 1/3 of the times)

MAS 5 Signal=TukeyBiweight{log2(PMj-IMj) Discussed this earlier. Requires calculating IM Adjusted PM-MM are log transformed and robust for outlying observations using Tukey Biweight.

Robust Multichip Analysis ONLY uses PM and ignores MM SACRIFICES Accuracy but major gains in PRECISION Basic Steps: 1. Calculate chip background (*BG) and subtract from PM 2. Carry out intensity dependent normalization for PM-*BG Lowess Quantile Normalization (Discussed before) Normalized PM-*BG are log transformed Robust multichip analysis of all probes in the set and using Tukey median polishing procedure. Signal is antilog of result.

RMA- Step 1: Background Correction Irrizary et al(2003) Looks at finding the conditional expectation of the TRUE signal given the observed signal (which is assumed to be the true signal plus noise) E(si | si+bi) Here, si assumed to follow Exponential distribution with parameter q. Bi assumed to follow N(me, s2e) Estimate me and se as the mean and standard deviation of empty spots

RMA- BG Corrected Value

RMA-Normalization Lowess (for Spatial effects) Use the background corrected intensities B(PM) to carry out normalization Lowess (for Spatial effects) Quantile Normalization (to allow comparability amongst replicate slides) Normalized B(PM) are log transformed

RMA summarization Use MEDIAN POLISH to fit a linear model Given a MATRIX of data: Data= overall effects+row effects + column effects + residual Find row and column effects by subtracting the medians of row and column successively till all the medians are less than some epsilon Gives estimated row, column and overall effect when done

Median Polish of RMA For each probe set we have a matrix (probes in rows and arrays in columns) We assume: Signal=probe affinity effect + logscale for expression + error Also assume the sum of probe affinities is 0 Use MEDIAN polish to estimate the expression level in each array