Column rejection in the MOS  The core of soft sources is removed by the standard emchain.  Due to very large fluctuations in count rate from one column.

Slides:



Advertisements
Similar presentations
GWDAW 11 - Potsdam, 19/12/ Coincidence analysis between periodic source candidates in C6 and C7 Virgo data C.Palomba (INFN Roma) for the Virgo Collaboration.
Advertisements

Grey Level Enhancement Contrast stretching Linear mapping Non-linear mapping Efficient implementation of mapping algorithms Design of classes to support.
MA-250 Probability and Statistics Nazar Khan PUCIT Lecture 3.
STAT 135 LAB 14 TA: Dongmei Li. Hypothesis Testing Are the results of experimental data due to just random chance? Significance tests try to discover.
Bruno Altieri EPIC Calibration meeting, Feb. 1-3, 2005 European Space Astronomy Centre Page 1 XMM-Newton ESAC Status of XMM-Newton cross-calibration with.
XMM 1 EPIC MOS Monitoring CAL/OPS Meeting MPE
Jonathan Gimeno Boal, UCM MODEL PSF EFFECTS OF PILE-UP Jonathan Gimeno Boal, UCM Tutor: Martin Stuhlinger.
XMM-Newton 1 Michael Smith, ESAC PN Monitoring MPE, May 2006.
Part 9: Normal Distribution 9-1/47 Statistics and Data Analysis Professor William Greene Stern School of Business IOMS Department Department of Economics.
XMM-Newton 1 Michael Smith, ESAC PN Monitoring Palermo, April 2007.
Experience with combined Fe55/Vela SNR calibration - MOS Andrea Tiengo INAF, IASF-Milano In collaboration with: Mariachiara Rossetti (IASF-Milano) Martin.
EPIC Calibration Meeting, MPE K. Dennerl, 2006 May 04 EPIC pn at low energies: LW mode Properties of EPIC pn at low energies: LW mode.
Descriptive Statistics In SAS Exploring Your Data.
A Study of the Quiescent Particle Background A Study of the “Corner Spectra” from the public archive: obsids that were public as of 20 July 2005.
EPIC Calibration Meeting, K. Dennerl Saclay/France, 2003 Sept offset map correction Spatial variation of the energy scale Energy correction for pixels.
XMM-Newton 1 M.Stuhlinger/P.Calderon, ESAC Re-appearance of the MOS1 CCD1 meteorite column during revs Madrid, 23. March 2010.
XMM EPIC MOS Steve Sembay EPIC Calibration Meeting Tuebingen 03/02/03-06/02/03 MOS Cooling Results and Current Response Both MOS Cameras.
Mallorca EPIC Cal Meeting - February 2005 Darren Baskill: XMM project: MOS monitoring.
Chandra X-Ray Observatory CXC Paul Plucinsky EPIC Cal Nov ACIS Calibration: Planned Updates & Future Issues 2.ACIS Operations: Controlling the.
EPIC Calibration Meeting, Mallorca K. Dennerl, 2006 October 26 Suppression of the low-energy noise Suppression of the low-energy noise: an improved approach.
Deterministic Modeling of the MOS Background Steve Snowden NASA/Goddard Space Flight Center EPIC Operations and Calibration Meeting Mallorca 1-3 February.
Source detection at Saclay Look for a fast method to find sources over the whole sky Provide list of positions, allowing to run maximum likelihood locally.
XMM-Newton 1 Michael Smith, ESAC PN Monitoring Mallorca, October 2006.
CHAPTER 6 Statistical Analysis of Experimental Data
Marcus Kirsch, XMM-Newton European Space Astronomy Center Page 1 EPIC ESAC XMM-Newton Instrument Anomaly Tool & Cross-Calibration Tool Marcus G. F. Kirsch.
Darren Baskill Timing mode spectral correction MOS Timing mode spectra problem.
XMM 1 EPIC MOS Monitoring CAL/OPS Meeting Mallorca
Became pressing issue when 1XMM catalogue showed a distinct excess of weak sources in MOS 2 emevents 7.10 marks flickering pixels and event clusters in.
CXC CUC September SDS Page 1 CUC Sep 2007 Science Data Systems – Jonathan McDowell.
XMM EPIC MOS Steve Sembay Mallorca 02/02/05 Temporal and spatial variability of the MOS RMF 1.Introduction and brief history of the.
Bit flips in the MOS offset tables  First detected in 0640_ MOS 1, CCD 6 by M. Ceballos in routine screening. RAWY=303 had its offset increased.
Probability and Statistics in Engineering Philip Bedient, Ph.D.
The Statistical Properties of Large Scale Structure Alexander Szalay Department of Physics and Astronomy The Johns Hopkins University.
Math 116 Chapter 12.
NASSP Masters 5003F - Computational Astronomy Lecture 19 EPIC background Event lists and selection The RGA Calibration quantities Exposure calculations.
CHAPTER 18: Inference about a Population Mean
SAG+SASWG Meeting Potsdam /15 PN Tasks – Status Report (update since Leicester) Hermann Brunner - MPE  epframes:  The dark quadrant problem.
OS-ESL meeting, Barcelona, February nd, 2011 OTT sensitivity study and Sun correction impact J. Gourrion and the SMOS-BEC team SMOS-BEC, ICM/CSIC.
Aldo Dell'Oro INAF- Observatory of Turin Detailed analysis of the signal from asteroids by GAIA and their size estimation Besançon November 6-7, 2003.
Atmospheric Aerosol Measurements at the Pierre Auger Observatory The Pierre Auger Observatory operates an array of monitoring devices to record the atmospheric.
A statistical test for point source searches - Aart Heijboer - AWG - Cern june 2002 A statistical test for point source searches Aart Heijboer contents:
20 Jan 2009SiD Benchmark Meeting1 Chargino / Neutralino Analysis Update Yiming Li University of Oxford.
1 Statistics, Data Analysis and Image Processing Lectures Vlad Stolojan Advanced Technology Institute University of Surrey.
AP Statistics Section 11.1 B More on Significance Tests.
PSF in-flight calibration - PN IFC/CNRRingberg, April 2-4, 2002 PSF in-flight calibration for PN camera Simona Ghizzardi Silvano Molendi.
Testing Hypotheses about a Population Proportion Lecture 29 Sections 9.1 – 9.3 Fri, Nov 12, 2004.
NICMOS Calibration Challenges in the Ultra Deep Field Rodger Thompson Steward Observatory University of Arizona.
The Slow Slew Survey Richard Saxton / Pedro Rodriguez November 2006.
Source catalog generation for DC2 Aim (in order of priority): 1.Improve on source detection algorithm and error box. 2.Provide a list of source identifications.
Chapter 9: Introduction to the t statistic. The t Statistic The t statistic allows researchers to use sample data to test hypotheses about an unknown.
Uncertainty and confidence Although the sample mean,, is a unique number for any particular sample, if you pick a different sample you will probably get.
Comparison of MC and data Abelardo Moralejo Padova.
In conclusion the intensity level of the CCD is linear up to the saturation limit, but there is a spilling of charges well before the saturation if.
Cross-Calibration Meeting, ESTEC, February Comparison of the EDI and FGM Measurements of the Magnetic Field Magnitude Plot shown.
Anomaly Detection Carolina Ruiz Department of Computer Science WPI Slides based on Chapter 10 of “Introduction to Data Mining” textbook by Tan, Steinbach,
Your friend has a hobby of generating random bit strings, and finding patterns in them. One day she come to you, excited and says: I found the strangest.
Binomial Distribution Possion Distribution Gaussian Distribution Lorentzian Distribution Error Analysis.
All-sky source search Aim: Look for a fast method to find sources over the whole sky Selection criteria Algorithms Iteration Simulations Energy information.
Investigation into the strong residuals seen
A.Zanichelli, B.Garilli, M.Scodeggio, D.Rizzo
Charge Transfer Efficiency of Charge Coupled Device
Jean Ballet, CEA Saclay GSFC, 31 May 2006 All-sky source search
Source catalogue generation
All-sky source search issues
NanoBPM Status and Multibunch Mark Slater, Cambridge University
EPIC Calibration & Operations Meeting
Descriptive Statistics: Describing Data
UVIS Calibration Update
The Ventriloquist Effect Results from Near-Optimal Bimodal Integration
CHAPTER 18: Inference about a Population Mean
Presentation transcript:

Column rejection in the MOS  The core of soft sources is removed by the standard emchain.  Due to very large fluctuations in count rate from one column to the next at low energy.  This is probably the consequence of differences in the energy reconstruction from column to column in this very soft source.  New column rejection algorithm in embadpixfind 2.1.  New columns with very bad (too low) energy were discovered in 1E  Apparently appeared after cooling, and worsen with time. Jean Ballet, CEA/SAp 01 February 2005

MOS column rejection Problem first reported by B. Altieri in calibration studies on a very soft source. 0831_ , MOS 1, CCD 1, GD 153 (SW mode) Standard analysisBad pixels not removed The columns running through the source core are rejected by embadpixfind 1.20 in SAS 6.1. They are flagged bad because they stick out from their surroundings (proximity analysis).

MOS column rejection One expects fluctuations of +/- 0.5 on √counts for a Poisson distribution. This is indeed what is observed in the reference dataset (0087_ on PKS , dashed). But the fluctuations on GD 153 are much larger. Counts integrated over entire columns. Reference dataset has been truncated to have exactly the same number of counts Mode is the same (SW)

MOS column rejection The spectrum is extremely soft. So the count rate is defined largely by the lower threshold.. Fluctuations of the energy reconstruction from one column to the next (for example CTI variations) of +/- 2 ADU (at 25 ADU) could explain the observed dispersion.

New detection algorithm for bad pixels/columns/rows (embadpixfind 2.1)  Uses the locally measured dispersion (when it is larger than Poisson) to decide whether a column/row is significantly discrepant.  This actually replaces the previous security (depending on the PSF shape) to avoid detecting the core of bright sources (because bright sources induce a strong dispersion in count values).  Accounts for the count distribution along a column (averaged over the neighbouring columns) when deciding which parts of a column to flag as bad.  Uses a larger window for 1D searches (7) than 2D searches (5).  A new statistic is used to detect bright pixels against their surroundings in the very low count limit. Li and Ma 1983 (ApJ 272, 317) as a first estimate and the binomial law as a check.  The median is computed internally. This allows a much more accurate estimate of the significance of excesses from the start.  Not so MOS-specific any longer. Could be tried on other instruments with small pixels wrt PSF (RGS, Swift).

Bad pixels not removed MOS column rejection 0831_ , MOS 1, CCD 1 GD 153 (SW mode) The columns running through the source core are not rejected any more. One piece of column is rejected because it is significantly too dark (even with the new algorithm). With embadpixfind 2.1

The spectrum of column 320 of MOS1 is shifted to the left by an approximately constant amount (~ 130 eV). This is NOT visible in a broad band image (the number of counts is exactly right) but is visible in narrower bands. For example, column 320 is overbright in band 1 (200 to 500 eV) Column 320 is indeed dark in the GD 153 data. That column was not that shifted at the time G. Pratt studied the big energy shifts (before cooling). 1E 0102, rev 894 (counts / 4)

The spectrum of column 291 of MOS1 was normal up to rev 521 (before cooling, red and blue curves). It was offset by about 60 eV at rev 616 (after cooling, green curve). It is offset by a much larger amount (~ 150 eV) now (rev 894, black curve). Vertical normalisation is arbitrary (not exactly the same part of the remnant at each observation)