Jean Ballet, CEA Saclay GSFC, 31 May 2006 All-sky source search

Slides:



Advertisements
Similar presentations
Noise in Radiographic Imaging
Advertisements

A Crash Course in Radio Astronomy and Interferometry: 4
High Energy Gamma Ray Group
QR Code Recognition Based On Image Processing
November 12, 2013Computer Vision Lecture 12: Texture 1Signature Another popular method of representing shape is called the signature. In order to compute.
Deriving and fitting LogN-LogS distributions An Introduction Andreas Zezas University of Crete.
Basic Principles of X-ray Source Detection Or Who Stole All Our Photons?.....
1Andrea Caliandro Search of Optimized Cuts for Pulsar Detection Andrea Caliandro - INFN Bari DC2 CloseOut May Goddard Space Flight Center.
GLAST Science Support CenterAugust 9, 2004 Likelihood Analysis of LAT Data James Chiang (GLAST SSC – SLAC)
GLAST LAT Project Astrostatistics Workshop, HEAD meeting, 10 September 2004 James Chiang (GSSC/UMBC) 1 Gamma-ray Large Area Space Telescope Challenges.
Edge detection. Edge Detection in Images Finding the contour of objects in a scene.
GLAST LAT ProjectDC1 Closeout Workshop, Feb , Statistical Issues in Likelihood Analysis of LAT Data Seth Digel (HEPL/Stanford Univ.) & Guillaume.
Digital Image Processing Chapter 5: Image Restoration.
GLAST Science Support Center February 12, 2004 DC1 Closeout Detecting Gamma-Ray Bursts in the DC1 Data David Band (GSSC)
Source detection at Saclay Look for a fast method to find sources over the whole sky Provide list of positions, allowing to run maximum likelihood locally.
C&A 10April06 1 Point Source Detection and Localization Using the UW HealPixel database Toby Burnett University of Washington.
THB Source Catalog Meeting 12/21/05 1 Healpixels and Wavelets Toby Burnett and Bruce Lesnick University of Washington.
Searching for pulsars using the Hough transform Badri Krishnan AEI, Golm (for the pulsar group) LSC meeting, Hanford November 2003 LIGO-G Z.
Column rejection in the MOS  The core of soft sources is removed by the standard emchain.  Due to very large fluctuations in count rate from one column.
GLAST for Lunch 2004 Sept. 231 Fluctuation Analysis: Shadows of Invisible Sources What’s happening here?
Tal Mor  Create an automatic system that given an image of a room and a color, will color the room walls  Maintaining the original texture.
EE513 Audio Signals and Systems Statistical Pattern Classification Kevin D. Donohue Electrical and Computer Engineering University of Kentucky.
The Statistical Properties of Large Scale Structure Alexander Szalay Department of Physics and Astronomy The Johns Hopkins University.
Medical Image Analysis Image Reconstruction Figures come from the textbook: Medical Image Analysis, by Atam P. Dhawan, IEEE Press, 2003.
EECS 274 Computer Vision Segmentation by Clustering II.
A statistical test for point source searches - Aart Heijboer - AWG - Cern june 2002 A statistical test for point source searches Aart Heijboer contents:
Digtial Image Processing, Spring ECES 682 Digital Image Processing Week 5 Oleh Tretiak ECE Department Drexel University.
Source catalog generation Aim: Build the LAT source catalog (1, 3, 5 years) Jean Ballet, CEA SaclayGSFC, 29 June 2005 Four main functions: Find unknown.
Fermi LAT Monash University Nov 21, 2009 R.DuboisFermi LAT Science Analysis Tutorial1 Issues in a Nutshell LS5039 Low stats: 4k photons in 1 yr Strong.
GLAST LAT Project Catalogs and Diffuse Emissions Working Groups G. Tosti et al.SLAC, May Gino Tosti, Claudia Cecchi INFN Perugia based on Francesca.
1 Channel Coding (III) Channel Decoding. ECED of 15 Topics today u Viterbi decoding –trellis diagram –surviving path –ending the decoding u Soft.
Data Hiding in Image and Video: Part II—Designs and Applications Min Wu, Heather Yu, and Bede Liu.
NICMOS Calibration Challenges in the Ultra Deep Field Rodger Thompson Steward Observatory University of Arizona.
SPI Data Analysis A. Strong MPE Moriond, Les Arcs 2002.
GLAST LAT Project DC2 Closeout Workshop, GSFC, 31 May-2 June Comparisons of Searches for Sources in the DC2 Data S. W. Digel Stanford Linear Accelerator.
A First Look At VERITAS Data Stephen Fegan Vladimir Vassiliev UCLA.
Tim Pearson US Planck Data Analysis Review 9-10 May 2006 US Planck Data Analysis Review Source Extraction Tim Pearson.
Visual Tracking by Cluster Analysis Arthur Pece Department of Computer Science University of Copenhagen
2005 Unbinned Point Source Analysis Update Jim Braun IceCube Fall 2006 Collaboration Meeting.
Source catalog generation for DC2 Aim (in order of priority): 1.Improve on source detection algorithm and error box. 2.Provide a list of source identifications.
Digital Aperture Photometry ASTR 3010 Lecture 10 Textbook 9.5.
1 Giuseppe Romeo Voronoi based Source Detection. 2 Voronoi cell The Voronoi tessellation is constructed as follows: for each data point  i (also called.
T. Burnett: Anagroup 5/24/04 1 Latest PSF and Point-source sensitivity prediction status Anagroup meeting Toby Burnett 24 May 04.
2011, 10th AprilIII Fermi symposium , 10th AprilIII Fermi symposium2.
All-sky source search Aim: Look for a fast method to find sources over the whole sky Selection criteria Algorithms Iteration Simulations Energy information.
GLAST Science Support Center November 8, 2005 GUC Action Item #15 AI#15: Pre-Launch GI Proposal Tools David Band (GSSC/JCA-UMBC)
Planck working group 2.1 diffuse component separation review Paris november 2005.
PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 1: INTRODUCTION.
Source catalog generation Aim: Build the LAT source catalog (1, 3, 5 years) Jean Ballet, CEA SaclaySLAC, 23 May 2005 Four main functions: Find unknown.
Sampling and Sampling Distribution
- photometric aspects of image formation gray level images
Searching for pulsars using the Hough transform
CSC321: Neural Networks Lecture 22 Learning features one layer at a time Geoffrey Hinton.
Monte Carlo Quality Assessment (MC-QA)
Deriving and fitting LogN-LogS distributions An Introduction
20 diffuse catalogue fans
Application of HEALpix Pixelization to Gamma-ray Data
Fermi LAT Limits on High-Energy Gamma Lines from WIMP Annihilation
Watermarking with Side Information
Image Analysis Image Restoration.
First day: Planets, Sun and Moon
Source Detection by Count Excess
Wavelet Analysis for Sources Detection
Source catalogue generation
All-sky source search issues
Relative merits of the algorithms under consideration
Wavelet method for source detection in GLAST photon-counting images
Claudio Bogazzi * - NIKHEF Amsterdam ICRC 2011 – Beijing 13/08/2011
EE513 Audio Signals and Systems
Review and Importance CS 111.
Presentation transcript:

Jean Ballet, CEA Saclay GSFC, 31 May 2006 All-sky source search Aim: Look for a fast method to find sources over the whole sky MR_FILTER Optimal filter Combining energy bands Iteration

All-sky source search. MR_FILTER MR_FILTER is an all-purpose wavelet algorithm developed at Saclay by J.L. Starck. Works on cartesian images. Special mode for Poisson statistics Output is a smoothed image, keeping only significant positive structures 2nd step to locate excesses (SExtractor) Accepts background model in input Currently used as place holder in catalog generation

All-sky source search. Optimal filter Generalization of the idea of convolving an image with the (known) PSF, to account for a structured background Filter is PSF/(1+BKG) in Fourier space Works on cartesian images (same filter over entire image) Accounts for Poisson statistics Sky partitioned into 11 pieces (2 CAR in Galactic plane up to +/- 10°, 4 CAR or AIT at mid-latitudes up to 45°, 2 ARC around the poles above 45°). Avoids too much geometrical distortion, and adapts the filter to local conditions

Optimal filter 2 Variance is computed at each point, knowing the background shape (use number of photons from the image under the filter when larger). But not Gaussian distribution. Signal / dispersion at each point is converted into an effective gaussian significance depending on the local density of counts and the filter shape (same principle as is used in wavelet methods for each coefficient). Entire image can be converted assuming background is locally flat (then same conversion everywhere)

Putting energy bands together Simplest solution is to run algorithm over each energy band separately and merge source lists. Merging source lists Estimate position error. In the checkout 3 simulation, it was found that the formula 1.8 HWHM / significance + pixelsize / 2.5 provides a reasonable estimate of the (1 σ) position error, where HWHM is the half width at half maximum of the PSF in the band Start from high energy (best PSF), identify with lower energy sources using tolerance 3 times larger, keep only unambiguous associations. Combine positions and errors using as weight 1/sigma^2, where sigma is the position error itself.

All-sky source search. Iteration Methods based on filtering have trouble finding weak sources in the wings of bright ones (because they generate ripples around sources). The solution is to iterate. After the bright sources have been detected, they can be modelled and entered into the diffuse emission. Start with merged source lists Feed to likelihood pipeline, to weed out non significant sources Run the band likelihood pipeline, to get accurate flux in each band even for sources which do not have a power law spectrum Run gtmodelmap on the large images used by the source detection methods, readjusting the diffuse emission to account for the bright sources All those steps take quite long

All-sky source search. Comparison Energy band from 100 to 300 MeV, toward North Galactic pole gtmodelmap on the basis of the result of the band likelihood pipeline (sources only) Map with coordinate grid is with MR_FILTER source list Map without coordinates is with optimal filter source list Differences in source position, and a few faint sources

Iteration: MR_FILTER Energy band from 3 to 100 GeV, toward (l,b) = (90,0) in the Galactic plane. Size of the image is about 60 x 20° Same color coding before and after iteration Many excesses not confirmed by likelihood, bright sources leave secondaries

Iteration: optimal filter Energy band from 3 to 100 GeV, toward the Galactic center. Size of the image is about 40 x 20° Same color coding before and after iteration (0 to 5 sigma) Very bright sources removed already, fainter sources go away nicely

Putting energy bands together 2 A better solution is to add log(likelihood) values (before applying threshold). Galactic center region, 40 x 30° 4 bands Several scales are visible Transform significance maps into probability, add log(probability), correct the distribution for the number of bands, transform back to significance The broad PSF at low energy adds a complication. A true source can induce false detections in its vicinity (via its low energy wings). Therefore do it only after all 1st pass sources have been removed

Source detection studies Jean Ballet, CEA Saclay GSFC, 31 May 2006 Source detection studies Investigated 2 imaging based methods MR_FILTER improved. Works well (in combination with SExtractor), but does not provide source significance. Optimal filter works all right. Finds fewer sources (hopefully fewer spurious sources), but returns source significance. Energy band combination is promising Is iteration worth the cost in computing time ?