(Station Dependent) Correlation in VLBI Observations John M. Gipson NVI, Inc./NASA GSFC 4 th IVS General Meeting 9-11 January 2006 Concepcion, Chile.

Slides:



Advertisements
Similar presentations
CMB Power spectrum likelihood approximations
Advertisements

Autocorrelation and Heteroskedasticity
D. S. MacMillan 16-April-2008 Modeling Phase and Cable Cal for ONSALA60 Dan MacMillan NVI/NASA/GSFC Per Bjerkeli Chalmers University, Sweden Modeling Phase.
Topic 12: Multiple Linear Regression
Regression and correlation methods
Computational Statistics. Basic ideas  Predict values that are hard to measure irl, by using co-variables (other properties from the same measurement.
The Simple Regression Model
Use of Kalman filters in time and frequency analysis John Davis 1st May 2011.
6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.
The Multiple Regression Model Prepared by Vera Tabakova, East Carolina University.
The Simple Linear Regression Model: Specification and Estimation
1-1 Regression Models  Population Deterministic Regression Model Y i =  0 +  1 X i u Y i only depends on the value of X i and no other factor can affect.
PSY 307 – Statistics for the Behavioral Sciences
Chapter 13 Introduction to Linear Regression and Correlation Analysis
VieVS User Workshop 7 – 9 September, 2010 Vienna Creating OPT-files Detecting and solving problems Tobias Nilsson.
1 BA 555 Practical Business Analysis Review of Statistics Confidence Interval Estimation Hypothesis Testing Linear Regression Analysis Introduction Case.
Chapter 14 Introduction to Linear Regression and Correlation Analysis
Weights of Observations
Lecture 5 Correlation and Regression
Principles of the Global Positioning System Lecture 13 Prof. Thomas Herring Room A;
Principles of the Global Positioning System Lecture 11 Prof. Thomas Herring Room A;
Introduction to Linear Regression and Correlation Analysis
CPE 619 Simple Linear Regression Models Aleksandar Milenković The LaCASA Laboratory Electrical and Computer Engineering Department The University of Alabama.
Data Handling & Analysis BD7054 Scatter Plots Andrew Jackson
Soc 3306a Multiple Regression Testing a Model and Interpreting Coefficients.
Chap 12-1 A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. A Course In Business Statistics 4 th Edition Chapter 12 Introduction to Linear.
Modern Navigation Thomas Herring
Retreat Miesenbach Daniel Landskron - My previous and upcoming research 12015/04/28 Retreat 2015 Daniel Landskron.
Chapter 4 Linear Regression 1. Introduction Managerial decisions are often based on the relationship between two or more variables. For example, after.
© Copyright McGraw-Hill Correlation and Regression CHAPTER 10.
Modern Navigation Thomas Herring MW 11:00-12:30 Room
Principles of the Global Positioning System Lecture 12 Prof. Thomas Herring Room ;
Error Modeling Thomas Herring Room ;
Basic Business Statistics, 10e © 2006 Prentice-Hall, Inc. Chap 15-1 Chapter 15 Multiple Regression Model Building Basic Business Statistics 10 th Edition.
SVY207: Lecture 10 Computation of Relative Position from Carrier Phase u Observation Equation u Linear dependence of observations u Baseline solution –Weighted.
Université d’Ottawa / University of Ottawa 2001 Bio 8100s Applied Multivariate Biostatistics L11.1 Lecture 11: Canonical correlation analysis (CANCOR)
Chapter 14 Introduction to Regression Analysis. Objectives Regression Analysis Uses of Regression Analysis Method of Least Squares Difference between.
Regression Analysis Part A Basic Linear Regression Analysis and Estimation of Parameters Read Chapters 3, 4 and 5 of Forecasting and Time Series, An Applied.
Stats Methods at IC Lecture 3: Regression.
Chapter 13 Simple Linear Regression
The simple linear regression model and parameter estimation
Regression Analysis AGEC 784.
Regression.
Correlation and Simple Linear Regression
Regression.
Multiple Regression.
...Relax... 9/21/2018 ST3131, Lecture 3 ST5213 Semester II, 2000/2001
…Don’t be afraid of others, because they are bigger than you
Correlation and Simple Linear Regression
Correlation and Regression
CHAPTER 29: Multiple Regression*
Chapter 12 Regression.
6-1 Introduction To Empirical Models
Regression.
Regression.
Correlation and Simple Linear Regression
Undergraduated Econometrics
OVERVIEW OF LINEAR MODELS
Regression.
Regression Chapter 8.
Regression.
OVERVIEW OF LINEAR MODELS
Simple Linear Regression and Correlation
Regression.
Principles of the Global Positioning System Lecture 11
Principles of the Global Positioning System Lecture 13
Diurnal and Semi-Diurnal Earth Rotation from 37 Years of VLBI Data
F test for Lack of Fit The lack of fit test..
Correlation and Simple Linear Regression
Correlation and Simple Linear Regression
Presentation transcript:

(Station Dependent) Correlation in VLBI Observations John M. Gipson NVI, Inc./NASA GSFC 4 th IVS General Meeting 9-11 January 2006 Concepcion, Chile

Agenda Quick review of observations and formal errors in VLBI Evidence for (unmodeled) station-dependent delay Sources of station-dependent delay Handling station-dependent delay Results Conclusions

Independence of Observations The standard assumption in VLBI is that all observations are independent, that is, that the noise terms are not correlated between observations: Suppose that we have a VLBI observation at time t on baseline ij. This is related to the “true” delay by: The  ’s on the right indicate that the covariance is 0 for observations of different baselines, or the same baseline at different times. Here  ij is the noise associated with the observation.

What do the formal errors depend on?

Number of parameters grows ~ Nstat!

What do the formal errors depend on? Number of observations grows ~ Nstat^2.

What do the formal errors depend on? Can improve formal errors by increasing number of scans OR increasing number of stations

What do the formal errors depend on? A key hidden assumption is that the observations are uncorrelated.

Are the observations independent? Is observational noise uncorrelated? We do not have direct access to the observation noise term  ij. We need to approach study of correlation indirectly. Use the residuals to a solution (=  ij ) as a proxy for  ij. My approach: Look at the residuals to the solution of an RDV experiment to see if they are correlated. RDVs have many observations, and many large net-work scans. This makes uncovering correlations easier.

Evidence From RDV48 Delay Residuals for Source :06:59 BRFDHNKPLANLOVPISCWSMEONTS#AVGSIGAvg/Sig 1BR-VLBA FD-VLBA HN-VLBA KP-VLBA LA-VLBA NL-VLBA OV-VLBA PIETOWN SC-VLBA WESTFORD MEDICINA ONSALA TSUKUB This table gives the residual delay for all observations in a given scan. “AVG” is the average delay over all baselines involving this station. “SIG” is the formal errors for this average (based on the formal errors of the baseline observations). The delay between FD-VLBA and KP-VLBA is 31 ps. The average residual delay for FD is 14 ps For FD the formal error is 2 ps.

Residual Station-Delays vs Time. Br-VLBA

Residual Station-Delay vs Azimuth: Br-VLBA

Residual Station-Delay vs Elevation: BR-VLBA

RDV50: RMS Residual Delay per Station Station# ScansWt RMS 1 ALGOPARK BR-VLBA FD-VLBA GGAO GILCREEK HN-VLBA KOKEE KP-VLBA LA-VLBA MK-VLBA NL-VLBA OV-VLBA PIETOWN SC-VLBA TIGOCONC WESTFORD WETTZELL909.4 Note: This gives no indication of the origin of the residuals. This residual delay could be due to unmodeled atmosphere, cable variation, other effects or a combination of all of these. Conclusion: Based on RDVs, there is significant evidence of station-dependent correlated noise.

Sources of Station-Dependent Delay Noise Unmodeled (or incorrectly modeled) atmosphere. Expect that this will be larger at lower elevations. Unmodeled cable length variations. Unmodeled clock variation. This is elevation independent. Other sources of real station delay, e.g. phase cal.

Atmosphere modeling Simplest model of the atmosphere assumes it is elevation dependent and axially symmetric: “Mapping function” Next order model adds gradient term. Departures of the atmosphere from this simple model show up as station dependent delay. Kolmogorov turbulence predicts that these departures ~ cot(el)^2/3.

Data from: John Braun, Christian Rocken, and Randolph (“Stick”) Ware: Validation of Line-of-Sight Water Vapor measurements in GPS Analysis and graphing of data is original. Evidence From GPS

Modeling Station-Dependent Delay Assume that the delay takes the following form: I also assume that the station-dependent delay is uncorrelated at different times. This seems reasonable based on the RDVs. (Note that some of the time dependent variation is soaked up by clocks.) Here the  ’s are the station-dependent delay. Assume that these are not correlated with each other, or with the baseline noise.

Handling Station Dependent Delays 1.Estimate Delays Explicitly. A.For each N station scan, need N nuisance parameters. B.Normal equations become singular. Introduce weak constraints. C.Number of parameters estimated increases greatly. i.Building the normal equations takes longer. ii.Inversion of normal equations takes longer, since inversion ~N par ^3 2.Modify Normal Equations A.Use full covariance information for each scan. i.Computation of normal equations slows down ~3. ii.Inversion takes same amount of time.

Modification of Normal Equations Standard Least Squares equations for uncorrelated observations: For correlated observations, normal equations become: Here A are the parameters you are estimating, the B are the “O-C”, and the F are the derivatives. Here Cov is the covariance of the observations. For uncorrelated observations, the covariance matrix is diagonal, and this reduces to the standard case.

Building up the Normal Equation 1.By assumption, station dependent delays are uncorrelated across time. The covariance matrix is block diagonal, with each block being for a single scan. 2.Divide the data into scans. 3.For each scan, compute F T Cov -1 F and F T Cov -1 B. 4.Sum these up over all scans to get the full normal equations.

Calculation of Covariance 1. Inflation of diagonal terms: 2. Introduction of off-diagonal terms. These are non-0 only if there is a station in common. (In this equation the pair ij is not the same as the pair lm.) Station dependent delay has two effects. (Note that each observation is labeled by a pair of indices denoting the baseline.) The  terms are new.

Covariance Example. 3-Station Scan. Assume we have a 3 station scan, with baselines 12, 23, and 31 in that order. Then the covariance matrix will be: In this case all of the off-diagonal terms are populated. For larger networks this won’t be the case. Only diagonal terms that have a common station will be non-0. For a 4-station net-work there are 6 observations involving baselines 12, 13, 14, 23, 24, and 34. The off-diagonal terms involving the pairs of baselines (12,34), (13,24), and (14,23) will all be 0 since they have no stations in common

What are the  ’s? Atmosphere delay ~(cot(el)^(2/3)) From GPS, coefficient is ~ 1.5 mm=5ps May also have constant (non-el dependent) terms. From RDV study, total size ~5-15 ps. Atmosphere mis-modeling Cable, clock, etc. Both C and A are on the order of 5-10 ps

Empirical Tests Used all R1s, R4s and CONT sessions from Did standard baseline independent solution. Did several solutions with different additive correlated noise: –The “A” and the “C” parameters were varied in 5ps steps. Also did solutions with no off-diagonal terms. –Accounts for additional noise –Doesn’t account for correlation between observations. Calculated baseline repeatability. Found difference in baseline repeatability between the “standard” solution and “new” solutions.

Baseline Repeatability

Results for Cont05

Results for R1s & R4s 2005

Summary of Results R1s & R4s Cont05 AC # bl Better (tot=84) Avg  wrms OffPPB Avg ChiSq # bl Better (tot=54) Avg  wrms Avg ChiSq Standard Diag Atm Diag Atm Diag Atm

Effect of covariance on Formal Errors Notice dependence on number of stations

Effect of covariance on Formal Errors Station dependent noise: 1.Increases the formal errors. 2.Puts a station independent floor on formal errors.

Conclusions 1.Clear evidence from RDVs that there is unmodeled station dependent delay noise terms. 2.GPS data indicates the presence of unmodeled atmosphere delay. 3.There may be other sources of delay as well: cable, clocks, etc. 4.Accounting for the correlation: A.Reduces baseline scatter. B.Makes the formal errors more realistic. 5.In VLBI, most of the unmodeled-station-dependent-delay appears to be “atmosphere like”. 6.Reduction in scatter is not due to down-weighting the data: correlation between observations is necessary.