Hazardously Misleading Information Analysis for Loran LNAV Dr. Ben Peterson, Peterson Integrated Geopositioning Dr. Per Enge, Dr. Todd Walter, Dr. Sherman.

Slides:



Advertisements
Similar presentations
SJS SDI_21 Design of Statistical Investigations Stephen Senn 2 Background Stats.
Advertisements

International Civil Aviation Organization
Using Seasonal Monitor Data to Assess Aviation Integrity Sherman Lo, Greg Johnson, Peter Swaszek, Robert Wenzel, Peter Morris, Per Enge 36 th Symposium.
Loran Integrity Performance Panel The Loran Integrity Performance Panel Sherman Lo, Per Enge, & Lee Boyce, Stanford University Ben Peterson, Peterson Integrated.
3.3 Hypothesis Testing in Multiple Linear Regression
Computational Statistics. Basic ideas  Predict values that are hard to measure irl, by using co-variables (other properties from the same measurement.
11/11/02 IDR Workshop Dealing With Location Uncertainty in Images Hasan F. Ates Princeton University 11/11/02.
Hazardously Misleading Information Analysis for Loran LNAV Dr. Ben Peterson, Peterson Integrated Geopositioning Dr. Per Enge, Dr. Todd Walter, Dr. Sherman.
Differential Loran Ben Peterson, Ken Dykstra & Peter Swaszek Peterson Integrated Geopositioning & Kevin Carroll, USCG Loran Support Unit Funded by Federal.
Copyright © 2009 Pearson Education, Inc. Chapter 29 Multiple Regression.
CmpE 104 SOFTWARE STATISTICAL TOOLS & METHODS MEASURING & ESTIMATING SOFTWARE SIZE AND RESOURCE & SCHEDULE ESTIMATING.
Use of Kalman filters in time and frequency analysis John Davis 1st May 2011.
Loran Integrity Performance Panel Loran Integrity & Performance Panel (LORIPP) Per Enge, Stanford University, November 2003 Based on the work of: Federal.
Collaboration FST-ULCO 1. Context and objective of the work  Water level : ECEF Localization of the water surface in order to get a referenced water.
Regression Analysis. Unscheduled Maintenance Issue: l 36 flight squadrons l Each experiences unscheduled maintenance actions (UMAs) l UMAs costs $1000.
Error Propagation. Uncertainty Uncertainty reflects the knowledge that a measured value is related to the mean. Probable error is the range from the mean.
Communication Systems Simulation - II Harri Saarnisaari Part of Simulations and Tools for Telecommunication Course.
Absolute Receiver Autonomous Integrity Monitoring (ARAIM)
Experimental Evaluation
Ch. 14: The Multiple Regression Model building
1 1 Slide © 2003 South-Western/Thomson Learning™ Slides Prepared by JOHN S. LOUCKS St. Edward’s University.
Correlation and Regression Analysis
Data Acquisition Chapter 2. Data Acquisition 1 st step: get data 1 st step: get data – Usually data gathered by some geophysical device – Most surveys.
Introduction to Regression Analysis, Chapter 13,
Copyright ©2006 Brooks/Cole, a division of Thomson Learning, Inc. More About Regression Chapter 14.
Simple Linear Regression Analysis
Modern Navigation Thomas Herring
Principles of the Global Positioning System Lecture 10 Prof. Thomas Herring Room A;
Method Comparison A method comparison is done when: A lab is considering performing an assay they have not performed previously or Performing an assay.
Loran Integrity Performance Panel Integrity Fault Tree for Loran Sherman Lo Second LORIPP Meeting Portland, OR September 23-24, 2002.
Mitigation of the Effects Early Skywaves Ben Peterson, Peterson Integrated Geopositioning & Per Enge, Stanford University Funded by Federal Aviation Administration,
Physics 114: Lecture 15 Probability Tests & Linear Fitting Dale E. Gary NJIT Physics Department.
Introduction to Linear Regression and Correlation Analysis
Inference for regression - Simple linear regression
Review of Statistical Inference Prepared by Vera Tabakova, East Carolina University ECON 4550 Econometrics Memorial University of Newfoundland.
Regression Method.
Multiplexing GPS & eLoran on single RF cable for retrofit installations Benjamin Peterson Peterson Integrated Geopositioning International Loran Association.
Loran Integrity Performance Panel The Loran Integrity Performance Panel Sherman Lo, Per Enge, & Lee Boyce, Stanford University Ben Peterson, Peterson Integrated.
Oceanography 569 Oceanographic Data Analysis Laboratory Kathie Kelly Applied Physics Laboratory 515 Ben Hall IR Bldg class web site: faculty.washington.edu/kellyapl/classes/ocean569_.
1 FORECASTING Regression Analysis Aslı Sencer Graduate Program in Business Information Systems.
1 1 Slide © 2007 Thomson South-Western. All Rights Reserved Chapter 13 Multiple Regression n Multiple Regression Model n Least Squares Method n Multiple.
1 1 Slide © 2008 Thomson South-Western. All Rights Reserved Chapter 15 Multiple Regression n Multiple Regression Model n Least Squares Method n Multiple.
Physics 114: Exam 2 Review Lectures 11-16
1 Statistical Distribution Fitting Dr. Jason Merrick.
EDGE DETECTION IN COMPUTER VISION SYSTEMS PRESENTATION BY : ATUL CHOPRA JUNE EE-6358 COMPUTER VISION UNIVERSITY OF TEXAS AT ARLINGTON.
Baseband Demodulation/Detection
MEGN 537 – Probabilistic Biomechanics Ch.5 – Determining Distributions and Parameters from Observed Data Anthony J Petrella, PhD.
Multiple Regression and Model Building Chapter 15 Copyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved.McGraw-Hill/Irwin.
Managerial Economics Demand Estimation & Forecasting.
Chapter 6. Control Charts for Variables. Subgroup Data with Unknown  and 
1 Loran-C User Position Software (LUPS) Navigation Performance with the August 2001 Cross-Country/Alaska Flight Test Data Jaime Y. Cruz and Robert Stoeckly.
Modern Navigation Thomas Herring MW 11:00-12:30 Room
Loran Integrity Performance Panel The Loran Integrity Performance Panel (LORIPP) The LORIPP Team Loran Team Meeting McLean, VA July 30, 2002.
F E D E R A L A V I A T I O N A D M I N I S T R A T I O N A I R T R A F F I C O R G A N I Z A T I O N Loran Update Mitchell Narins (US FAA) G. Thomas Gunther.
The Wide Area Augmentation System (WAAS) Todd Walter Stanford University Todd Walter Stanford University
Limits On Wireless Communication In Fading Environment Using Multiple Antennas Presented By Fabian Rozario ECE Department Paper By G.J. Foschini and M.J.
Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Simple Linear Regression Analysis Chapter 13.
Université d’Ottawa / University of Ottawa 2001 Bio 8100s Applied Multivariate Biostatistics L11.1 Lecture 11: Canonical correlation analysis (CANCOR)
LORIPP Meeting July 24-25, Implementing a LORIPP-Compliant Option in the Loran-C User Position Software (LUPS) LORIPP Meeting July 24-25, 2002 Jaime.
Stats Methods at IC Lecture 3: Regression.
Chapter 14 Introduction to Multiple Regression
1.) Acquisition Phase Task:
Deep Feedforward Networks
Experimental Power Graphing Program
Statistical Methods For Engineers
Telecommunications Engineering Topic 2: Modulation and FDMA
Master Thesis Presentation
Loran Integrity & Performance Panel (LORIPP)
Chapter 13 Additional Topics in Regression Analysis
International Civil Aviation Organization
Presentation transcript:

Hazardously Misleading Information Analysis for Loran LNAV Dr. Ben Peterson, Peterson Integrated Geopositioning Dr. Per Enge, Dr. Todd Walter, Dr. Sherman Lo and Lee Boyce Stanford University Robert Wenzel, Booz Allen Hamilton Mitchell Narins, U. S. Federal Aviation Administration Loran Integrity Performance Panel (LORIPP) Stanford University, July 24, 2002

Key Assumptions/Requirements Integrity requirement is % for all conditions/locations; not an average, prove with analysis, not statistics All-in-view receiver w/H field, software steered, antenna TOE vice SAM control Signal in space integrity > % –RAIM does not have to detect transmitter timing error Cross rate cancelled –Or blanked, but getting enough pulses to average a problem Modulation, if present, does not affect navigation performance Integrity requirement met once at start of approach, then if signal lost, receiver checks accuracy requirement One time calibration of ASF, periodic validation by NPA flight inspection, no real time airport monitors Not an attempt to certify existing receivers

95% Levels by Time of Day and Season of Year 34 dB

Typical Distributions of TOA Measurement Blue - Low SNR, Red - High SNR Probability Density of TOA Accuracy = fn(Phase uncertainty) Pcycle error = fn(Envelope uncertainty)

Phase Error Terms Noise terms –Transmitter jitter (6 meters, one  ) –Noise at the receiver Bias terms not correlated from signal to signal –Transmitter offset –Errors in predicting ASF (modeled as % of predicted ASF) ASF seasonal variation correlated from signal to signal

Number of Pulses Averaged Standard Deviation of Phase Measurements Phase Measurement Error in usec Due to Noise and Interference

Gain realized by clipping 15% of the samples (Discrete points from: Enge & Sarwate, “Spread-Spectrum Multiple-Access Performance of Orthogonal Codes: Impulsive Noise,” IEEE Tr. Comm., Jan ) We are temporarily using 15dB

EXAMPLE OF LORAN SEASONAL ASF VARIATION CORRELATION Correlation Coefficient Calculated Over 2.8 Years: M: Dana, IN, X: Seneca, NY, Y: Baudette, MN

Regions of rate of seasonal variation in ASF (ns/Mm = nanoseconds/Megameter)

Bias due to seasonal asf variations in meters W = R -1, R = R noise + 0 x correlation of bias terms

Bias due to seasonal asf variations in meters W = R -1, R = R noise + 1 x correlation of bias terms

Loran Cycle Error Analysis compared to GPS RAIM Signal in space integrity better than % –Allow for finite but small probabilities for Signal out of tolerance w/o blink Signal out of tolerance w/ blink & blink not detected –Future effort to validate/quantify Algorithm detects receiver cycle selection failure (3,000 m) not Loran transmitter timing errors Large variation in reliability of cycle selection Need to be able to detect multiple errors

Cycle Slip #1: Envelope TOA Versus SNR and Averaging (Austron 5000 method, new technology may be 30% or more better) Number of Pulses Averaged Standard Deviation of ECD Measurements-usec

Cycle slip #2: Calculation of Probability of cycle error (P cycle ) P cycle = red areas under curve = normcdf(-5, ECDbias,  ) + normcdf(-5,- ECDbias,  ) Where:  = K/sqrt(N * SNR), K = 42 usec for Austron 5000 method, present technology may be 3dB or more better N = number of pulses averaged, 1000 is used ECDbias = bound on constant errors such as propagation uncertainty, receiver calibration, & transmitter offset

Cycle slip #3: Loran Cycle Integrity Equations G is the usual 3 x 3 matrix of direction cosines. The weighted least squares solution is: x wls = (G T W G) -1 G T W y = K y W is the weighting matrix given by W = R -1 R is the covariance matrix of the pseudorange errors y is the pseudorange measurements, and K  (G T W G) -1 G T W Predicted y = G x wls Prediction error: w = y - predicted y = [I – G K] y w = [I – G K]  (  is the vector of pseudorange errors)

Cycle slip #4: Loran Cycle Integrity Equations Positive definite test statistic: WSSE = w T W w =  T  [I – G K] T W [I – G K]  =  T   Where M   [I – G K] T W [I – G K] The expected distributions of WSSE are chi square with N-3 degrees of freedom for the non fault case and chi square with a non zero non-centrality parameter with N-3 degrees of freedom for the faulted case.

Cycle slip #5: LORAN Cycle Integrity Equations For P false_alarm = 10 -3, Threshold = chi2inv(0.999, N-3) Where N = # of signals No Fault Fault P missed_detection P false_alarm Need to investigate tradeoffs among: P missed_detection Continuity P false_alarm Frequency of cycle integrity calculation Correlation time of underlying errors Power of slip detector after a trusted fix

Cycle slip #5: Loran Cycle Integrity Equations P missed_detection = ncx2cdf(threshold,N-3,  ) (ncx2cdf = Noncentral chi-square cdf) Where  = M ii * [300 * (10 – PhaseBias i )] 2 for a single cycle error on the i th signal  = M ii * [300 * (10 – PhaseBias i )] 2 + M jj * [300 * (10 – PhaseBias j )] 2 +/- 2 * M ij * [300 * (10 – PhaseBias i )] * [300 * (10 – PhaseBias j ) For a double cycle error on the i th & j th signals, +/- depends on relative signs of the cycle errors.

Cycle slip # 6: Loran Cycle Integrity Equations P wc =  P cycle (i) P missed_detection (i) +   P cycle (i) P cycle (j) P missed_detection (i,j) + terms for 3 or more cycle errors If N = 3, then P wc =  P cycle (i) P wc must be < Probability that a signal was out of tolerance w/o blink - Probability that a signal was out of tolerance w/ blink and blink was not detected j = i i = 1:N Probability of undetected cycle error P wc is probability error occurred x probability it was not detected summed over all possible combinations of errors

HPL #1: Horizontal Protection Limit (HPL) Calculations If P wc satisfies integrity criterion (i.e. we have > % confidence in cycle selection and signal in space) –1. Calculate one sigma noise contribution using weighted least squares, multiply by 5.33 –2. Add vectors associated with phase bias terms for all combinations of signs –3. Calculate bias annual variation assuming correlation from signal to signal –4. Add terms in #2 & #3 assuming worst combination of signs (analogous to absolute value in VPL) –5. Add this to #1 linearly

HPL #3: Combining Bias and Noise in Calculation of HPL Choose sign of bias term for each pseudorange that maximizes HPL (red lines) Bias term for seasonal variation

ECD Noise  = 29 usec/sqrt(N env *SNR), 3dB better than Austron 5000 N env = 4000, N ph = 500, Clipping Credit = 15dB

ECD Noise Sigma = 42 usec/sqrt(N env *SNR) N env = 4000, N ph = 500, Clipping Credit = 15dB

Single Point Analysis The software then permits the user to click on a particular point of interest –Shows plots of stations used, noise an ASF’s –Analyzes P wc and HPL with signals removed one at a time –2 nd version analyzes weighted vs unweighted test statistics

Example where removing single station helps integrity calculation

Alaska w/one station removed at a time and using best combination

Weighted vs Unweighted Test Statistics In GPS, we want to detect a ranging error large enough to cause a significant position error. If a particular SV is weighted out of the solution, using a weighted RAIM test statistic makes sense because even if that particular error is large, we don't care. In Loran integrity analysis we are trying to detect cycle errors of 3,000m. These don’t show up in weak stations when using a weighted test statistic. The expected unweighted test statistic is not chi square with N-3 degrees of freedom, but that of the sum of normal rv's with different variance or a convolution of chi square distributions each with one degree of freedom & different scale parameters.

Example where cycle error detectability enhanced with unweighted test statistic

Example of Bad Detection Geometry

Conclusions to this Point I We are quite confident that Loran will be able to provide RNP 0.3 integrity over virtually all of CONUS and much of Alaska –To get availability north of Brooks Ranges requires additional transmitter, Prudoe Bay –Because main limit is cycle integrity, RNP 0.5 and RNP 0.3 availability/coverage not significantly different

Conclusion to this Point II Key assumptions –Analysis assumes ASF error is 30% of whole value. –Most likely way to implement is one time calibration of each airport. –Periodic validation by NPA flight inspection. –Temporal variation not needed –Early airports will need more intense calibration. –With experience, later airports will need no more than a one time calibration (and perhaps less).

Where do we go from here? Validate/revise each part of the analysis, assumption, parameter, etc. –Credit for impulse nature of noise Revised noise model for RF simulator –Sensitivity to size of ASF error –Bounds on ASF estimates, transmitter timing offsets, ECD predictions, transmitted ECD errors –Bounds on probability of signal out of tolerance w/o blink, probability of missed blink detection –Averaging time constants in receivers –Investigate areas that are counter-intuitive –Implement algorithms in receiver/validate actual performance

Where do we go from here? -2 Can we do better in either integrity of accuracy by elimination of some signals from the solution? –If so, what is criteria for eliminating signals? Would an unweighted test statistic give better detectability of cycle errors and thus better availability? Use the analysis software to see where we need to allocate effort to get the availability we need –How far down do we need to beat the bounds on ASF errors? –Are more stations required? –User receiver performance –Transmitter performance Establish work plan for LORIPP Maintain list of new monitoring requirements