INTRODUCTION When two or more instruments sound the same portion of atmosphere and observe the same species either in different spectral regions or with.

Slides:



Advertisements
Similar presentations
5.4 Basis And Dimension.
Advertisements

5.1 Real Vector Spaces.
Lect.3 Modeling in The Time Domain Basil Hamed
Grey Level Enhancement Contrast stretching Linear mapping Non-linear mapping Efficient implementation of mapping algorithms Design of classes to support.
Errors in Chemical Analyses: Assessing the Quality of Results
CmpE 104 SOFTWARE STATISTICAL TOOLS & METHODS MEASURING & ESTIMATING SOFTWARE SIZE AND RESOURCE & SCHEDULE ESTIMATING.
The General Linear Model Or, What the Hell’s Going on During Estimation?
Visual Recognition Tutorial
Raymond J. Carroll Texas A&M University Nonparametric Regression and Clustered/Longitudinal Data.
MAE 552 Heuristic Optimization Instructor: John Eddy Lecture #19 3/8/02 Taguchi’s Orthogonal Arrays.
Microwindow Selection for the MIPAS Reduced Resolution Mode INTRODUCTION Microwindows are the small subsets of the complete MIPAS spectrum which are used.
Institut für Umweltphysik/Fernerkundung Physik/Elektrotechnik Fachbereich 1 Retrieval of SCIAMACHY limb measurements: First Results A. Rozanov, V. Rozanov,
INTEGRALS Areas and Distances INTEGRALS In this section, we will learn that: We get the same special type of limit in trying to find the area under.
CPI International UV/Vis Limb Workshop Bremen, April Development of Generalized Limb Scattering Retrieval Algorithms Jerry Lumpe & Ed Cólon.
Chiara Piccolo and Anu Dudhia Atmospheric, Oceanic and Planetary Physics, Department of Physics, Oxford University, Oxford, UK Predicted.
On average TES exhibits a small positive bias in the middle and lower troposphere of less than 15% and a larger negative bias of up to 30% in the upper.
Page 1 ENVISAT SYMPOSIUM - Montreux – 23/27 April 2007 Page 1 Stratospheric Distribution of CO 2 from the MIPAS High-resolution Full Mission Bianca Maria.
Retrieval Theory Mar 23, 2008 Vijay Natraj. The Inverse Modeling Problem Optimize values of an ensemble of variables (state vector x ) using observations:
REMOTE SENSING & THE INVERSE PROBLEM “Remote sensing is the science and art of obtaining information about an object, area, or phenomenon through the analysis.
Linear and generalised linear models
Linear Equations in Linear Algebra
Copyright © Cengage Learning. All rights reserved. 5 Integrals.
Statistical Treatment of Data Significant Figures : number of digits know with certainty + the first in doubt. Rounding off: use the same number of significant.
Linear and generalised linear models
Lorelei Howard and Nick Wright MfD 2008
Chapter 9: Introduction to the t statistic
1 This sequence shows why OLS is likely to yield inconsistent estimates in models composed of two or more simultaneous relationships. SIMULTANEOUS EQUATIONS.
Business Statistics: Communicating with Numbers
Copyright © Cengage Learning. All rights reserved. CHAPTER 11 ANALYSIS OF ALGORITHM EFFICIENCY ANALYSIS OF ALGORITHM EFFICIENCY.
Physics 114: Lecture 15 Probability Tests & Linear Fitting Dale E. Gary NJIT Physics Department.
Chapter 9 Superposition and Dynamic Programming 1 Chapter 9 Superposition and dynamic programming Most methods for comparing structures use some sorts.
Development of An ERROR ESTIMATE P M V Subbarao Professor Mechanical Engineering Department A Tolerance to Error Generates New Information….
COST 723 Training School - Cargese October 2005 OBS 2 Radiative transfer for thermal radiation. Observations Bruno Carli.
Simpson Rule For Integration.
R. Kass/W03P416/Lecture 7 1 Lecture 7 Some Advanced Topics using Propagation of Errors and Least Squares Fitting Error on the mean (review from Lecture.
1 2. Independence and Bernoulli Trials Independence: Events A and B are independent if It is easy to show that A, B independent implies are all independent.
Chapter 5 Errors In Chemical Analyses Mean, arithmetic mean, and average (x) are synonyms for the quantity obtained by dividing the sum of replicate measurements.
Upper haze on the night side of Venus from VIRTIS-M / Venus Express limb observations D. Gorinov (1,2), N. Ignatiev (1,2), L. Zasova (1,2), G. Piccioni.
Integrals  In Chapter 2, we used the tangent and velocity problems to introduce the derivative—the central idea in differential calculus.  In much the.
Copyright © Cengage Learning. All rights reserved. 4 Integrals.
Chapter 5 Review Advanced Algebra 1. System of Equations and Inequalities - System of Linear Equations in Two Variables - Solutions of Linear Inequalities.
CS 782 – Machine Learning Lecture 4 Linear Models for Classification  Probabilistic generative models  Probabilistic discriminative models.
Page 1ENVISAT Validation Review / GOMOS session - ESRIN – 13th December 2002 ENVISAT VALIDATION WORKSHOP GOMOS Recommendations by the ESL team : Service.
Computational Intelligence: Methods and Applications Lecture 23 Logistic discrimination and support vectors Włodzisław Duch Dept. of Informatics, UMK Google:
© Copyright McGraw-Hill Correlation and Regression CHAPTER 10.
CHAPTER 5 SIGNAL SPACE ANALYSIS
1 6. Mean, Variance, Moments and Characteristic Functions For a r.v X, its p.d.f represents complete information about it, and for any Borel set B on the.
Dept of Bioenvironmental Systems Engineering National Taiwan University Lab for Remote Sensing Hydrology and Spatial Modeling STATISTICS Linear Statistical.
8.4.2 Quantum process tomography 8.5 Limitations of the quantum operations formalism 量子輪講 2003 年 10 月 16 日 担当:徳本 晋
Evaluation of gene-expression clustering via mutual information distance measure Ido Priness, Oded Maimon and Irad Ben-Gal BMC Bioinformatics, 2007.
Estimating the uncertainties in the products of inversion algorithms or, how do we set the error bars for our inversion results? Emmanuel Boss, U. of Maine.
1 6. Mean, Variance, Moments and Characteristic Functions For a r.v X, its p.d.f represents complete information about it, and for any Borel set B on the.
Measurements and Their Analysis. Introduction Note that in this chapter, we are talking about multiple measurements of the same quantity Numerical analysis.
1 Information Content Tristan L’Ecuyer. 2 Degrees of Freedom Using the expression for the state vector that minimizes the cost function it is relatively.
Chapter 9: Introduction to the t statistic. The t Statistic The t statistic allows researchers to use sample data to test hypotheses about an unknown.
CORRELATION-REGULATION ANALYSIS Томский политехнический университет.
Shadow Detection in Remotely Sensed Images Based on Self-Adaptive Feature Selection Jiahang Liu, Tao Fang, and Deren Li IEEE TRANSACTIONS ON GEOSCIENCE.
Copyright © Cengage Learning. All rights reserved. 4 Integrals.
Fundamentals of Data Analysis Lecture 11 Methods of parametric estimation.
INTEGRALS 5. INTEGRALS In Chapter 3, we used the tangent and velocity problems to introduce the derivative—the central idea in differential calculus.
Copyright © Cengage Learning. All rights reserved.
Copyright © Cengage Learning. All rights reserved.
Physics 114: Lecture 13 Probability Tests & Linear Fitting
Introduction to Instrumentation Engineering
Solution of Equations by Iteration
Volume 98, Issue 11, Pages (June 2010)
6.1 Introduction to Chi-Square Space
MIPAS-2D water database and its validation
16. Mean Square Estimation
Propagation of Error Berlin Chen
Presentation transcript:

INTRODUCTION When two or more instruments sound the same portion of atmosphere and observe the same species either in different spectral regions or with different geometries, two strategies are possible for the retrieval of the best vertical profile estimate that exploits all the available information. First, we can use all the observations acquired by the different instruments as inputs of a single retrieval algorithm that produces a single profile. We refer to this approach as the simultaneous retrieval. Second, we can use the observations of the different instruments to retrieve from each one an independent vertical profile and then use a posteriori an algorithm that combines the different profiles and determines a single estimate. We refer to this approach as the data fusion. The simultaneous retrieval is of difficult implementation but provides the best estimate. The implementation of data fusion is more easy but usually it is not expected to have the same performance as the simultaneous retrieval. We present herewith a new data fusion method for atmospheric vertical profiles retrieved by remote sensing measurements. It uses an algorithm that takes into account both the retrieval errors of the single profiles, described by the covariance matrices (CM), and the sensitivity of the retrieved profiles to the true profile, described by the averaging kernel matrices (AKM). We compare the results of the new data fusion method with those of the simultaneous retrieval using the measurements of the MIPAS (Michelson Interferometer for Passive Atmospheric Sounding) instrument onboard the ENVISAT satellite. The observations of a MIPAS limb sounding sequence are divided into two complementary sets and two profiles are independently retrieved from the two sets of observations. The two profiles are fused with the data fusion algorithm and the result is compared with the profile retrieved using simultaneously all the observations of the sequence. The performance of the new data fusion method is also compared with those of weighted and arithmetic means. THE NEW DATA FUSION METHOD We suppose to have N independent simultaneous measurements of the vertical profile of an atmospheric species referred to a specific geolocation. Performing the retrieval of the N measurements we obtain N vectors (i=1, 2, …, N) that provide independent estimates of the profile on a common vertical grid. These vectors are characterized by the CMs S i and the AKMs A i. If we expand at the first order the relationship that exists between retrieved profile and true profile, exploiting the definition of the AKM, we obtain the following equation : (1) where we have indicated with x ai the a priori profile used in the i-th retrieval, with x true the true profile and with  i the error on the vertical profile obtained propagating the errors of the observations through the retrieval process. Rearranging Eq. (1) we obtain: (2) where I represents the identity matrix. In Eq. (2) we notice that the vector (3) which is obtained from known quantities, is an estimate of the vector A i x true, made of the components of x true along the averaging kernels and, as such, corresponds to a new indirect measurement of the true profile made in the vector space generated by the averaging kernels. From Eqs. (2) and (3) we see that the new measurement provided by the vector  i has the same errors  i as the retrieved profile (consequently its CM is also given by S i ), but does not depend on the a priori profile x ai (which instead contributes as a bias to ). Since the vectors  i are indirect measurements in the form of A i x true, we can perform a simultaneous fit of these measurements minimizing the following cost function: (4) where x a and S a are an a priori profile and its CM that we may want to use as a constraint of the solution. This constraint depends on the ill conditioning of the simultaneous fit and is in general different from the constraints used in the individual retrievals. The minimum of c(x) is obtained for x equal to: (5) This relationship provides a new estimate of the profile determined with the data fusion of N different profiles. If the AKMs A i are equal to the identity matrices from Eq. (3) it follows that  i = and Eq. (5) coincides with the weighted mean of the N measurements (which in turn reduces itself to the arithmetic mean when all the measurements are considered to have the same S i ). Therefore, Eq. (5) is a generalization of weighted mean in the case of AKMs different from identity matrices and, for its capability of considering all the features of the measurements that are being combined, we shall refer to it as complete fusion formula. It is possible to analytically demonstrate that in a linear approximation the solution obtained with complete fusion coincides with the solution obtained with simultaneous retrieval. APPLICATION TO REAL DATA We experimentally evaluate the performance of the new data fusion approach applying it to an ozone vertical profile retrieved from MIPAS observations. We divided the observations consisting of 27 spectra in two different ways. Firstly, we obtained two data sets taking spectra at alternate tangent altitudes (referred to as even and odd spectra). In this way, we obtain two data sets that cover approximately the same vertical range. In the second place, we obtained two data sets including the 13 higher spectra in the first one and the remaining 14 spectra in the second one. In this way, we obtain data sets that cover two complementary altitude ranges: the first one approximately from 29 km to 71 km (referred to as high spectra) and the second one from 7 to 29 km (referred to as low spectra). FUSION OF EVEN AND ODD SPECTRA Fig. 1. Left panel: a priori profile (green line) and profiles retrieved using all spectra (black line), even spectra only (red line) and odd spectra only (blue line). Right panel: differences between the profiles obtained with reduced data sets and simultaneous retrieval in the case of even spectra (red line) and in the case of odd spectra (blue line). Fig. 2. Left panel: profile obtained using the simultaneous retrieval of all spectra (black line) and profiles obtained with complete fusion (blue line), weighted mean (red line) and arithmetic mean (green line) of the two profiles retrieved from even and odd spectra. The right panel shows the differences, with respect to the profile of the simultaneous retrieval, of profiles obtained with complete fusion (blue line), weighted mean (red line) and arithmetic mean (green line). The dashed lines show the error amplitudes. Simultaneous retrieval Even spectra Odd spectra Complete Fusion Weighted mean Arithmetic mean Table 1. Number of degrees of freedom (NDOF) of the profiles reported in Figs. 1 and 2. FUSION OF HIGH AND LOW SPECTRA Fig. 3. Left panel: a priori profile (green line) and profiles retrieved using all spectra (black line), low spectra only (red line) and high spectra only (blue line). Right panel: differences between the profiles obtained with reduced data sets and simultaneous retrieval in the case of low spectra (red line) and in the case of high spectra (blue line). Fig. 4. Left panel: profile obtained using the simultaneous retrieval of all spectra (black line) and profiles obtained with complete fusion (blue line), weighted mean (red line) and arithmetic mean (green line) of the two profiles retrieved from low and high spectra. The right panel shows the differences, with respect to the profile of the simultaneous retrieval, of profiles obtained with complete fusion (blue line), weighted mean (red line) and arithmetic mean (green line). The dashed lines show the error amplitudes. Table 2. Number of degrees of freedom (NDOF) of the profiles reported in Figs. 3 and 4. Simultaneous retrieval Low Spectra High Spectra Complete Fusion Weighted mean Arithmetic mean CONCLUSIONS Comparing the results of the two tests, we see that they are very similar independently of the type of complementarity of the measurements: interlaced observations in the first test and complementary altitude ranges in the second test. The complete fusion reproduces very well the results of the simultaneous retrieval both from the point of view of the values, which differ by quantities much smaller than the errors, and from the point of view of the error estimates (in Figs. 2 and 4 the black dashed lines are exactly under the blue dashed lines). The arithmetic and weighted means differ from the simultaneous retrieval by much larger quantities and are characterized by errors that are much smaller than the observed differences. This apparent contradiction is explained by the analysis of NDOF. The profiles retrieved from reduced data sets have, as expected, a NDOF that is about half the NDOF of the profile obtained from the simultaneous retrieval. The profile obtained with the complete fusion has the same NDOF as simultaneous retrieval while weighted and arithmetic means have a NDOF of the same order as profiles retrieved from reduced data sets. The weighted mean and the arithmetic mean are the result of an averaging process that reduces the errors, but cannot provide a better NDOF. Accordingly, the small NDOF prevents an adequate representation of the shape of the profile so that the differences with respect to the more realistic representation provided by the simultaneous retrieval are significant and, in particular, larger than the reduced errors. The simultaneous retrieval and the complete fusion best exploit the available NDOF at the cost of a slightly larger retrieval error. These results show that data fusion when performed using either weighted or arithmetic mean provides worse results than those obtained with the simultaneous retrieval. However, when the more rigorous method of the complete fusion is used, the data fusion reproduces very well the results of the simultaneous retrieval (from the point of view of values, of error estimates and of NDOF) and, therefore, can be considered equivalent to the simultaneous retrieval. REFERENCE S. Ceccherini, B. Carli and P. Raspollini, Equivalence of data fusion and simultaneous retrieval, Optics Express, Vol. 23 No. 7, (2015). Equivalence of data fusion and simultaneous retrieval Simone Ceccherini, Bruno Carli and Piera Raspollini Istituto di Fisica Applicata "Nello Carrara" del Consiglio Nazionale delle Ricerche, Via Madonna del Piano 10, Sesto Fiorentino (Firenze), Italy