All-sky source search Aim: Look for a fast method to find sources over the whole sky Selection criteria Algorithms Iteration Simulations Energy information.

Slides:



Advertisements
Similar presentations
A Crash Course in Radio Astronomy and Interferometry: 4
Advertisements

November 12, 2013Computer Vision Lecture 12: Texture 1Signature Another popular method of representing shape is called the signature. In order to compute.
NASSP Masters 5003F - Computational Astronomy Lecture 5: source detection. Test the null hypothesis (NH). –The NH says: let’s suppose there is no.
The General Linear Model Or, What the Hell’s Going on During Estimation?
1Andrea Caliandro Search of Optimized Cuts for Pulsar Detection Andrea Caliandro - INFN Bari DC2 CloseOut May Goddard Space Flight Center.
GLAST Science Support CenterAugust 9, 2004 Likelihood Analysis of LAT Data James Chiang (GLAST SSC – SLAC)
GLAST LAT Project Astrostatistics Workshop, HEAD meeting, 10 September 2004 James Chiang (GSSC/UMBC) 1 Gamma-ray Large Area Space Telescope Challenges.
7 June 06 1 UW Point Source Detection and Localization: Compare with DC2 truth Toby Burnett University of Washington.
1 Search for Dark Matter Galactic Satellites with Fermi-LAT Ping Wang KIPAC-SLAC, Stanford University Representing the Fermi LAT Collaboration.
Edge detection. Edge Detection in Images Finding the contour of objects in a scene.
Error Propagation. Uncertainty Uncertainty reflects the knowledge that a measured value is related to the mean. Probable error is the range from the mean.
GLAST LAT ProjectDC1 Closeout Workshop, Feb , Statistical Issues in Likelihood Analysis of LAT Data Seth Digel (HEPL/Stanford Univ.) & Guillaume.
A Search for Point Sources of High Energy Neutrinos with AMANDA-B10 Scott Young, for the AMANDA collaboration UC-Irvine PhD Thesis:
GLAST Science Support Center February 12, 2004 DC1 Closeout Detecting Gamma-Ray Bursts in the DC1 Data David Band (GSSC)
G. Cowan Lectures on Statistical Data Analysis 1 Statistical Data Analysis: Lecture 8 1Probability, Bayes’ theorem, random variables, pdfs 2Functions of.
P. NolanGLAST LAT DC1: 2003 December 81 DC1 Scientific Data Analysis: Likelihood Patrick Nolan Stanford University.
Source detection at Saclay Look for a fast method to find sources over the whole sky Provide list of positions, allowing to run maximum likelihood locally.
C&A 10April06 1 Point Source Detection and Localization Using the UW HealPixel database Toby Burnett University of Washington.
THB Source Catalog Meeting 12/21/05 1 Healpixels and Wavelets Toby Burnett and Bruce Lesnick University of Washington.
Column rejection in the MOS  The core of soft sources is removed by the standard emchain.  Due to very large fluctuations in count rate from one column.
Despeckle Filtering in Medical Ultrasound Imaging
The Statistical Properties of Large Scale Structure Alexander Szalay Department of Physics and Astronomy The Johns Hopkins University.
Scientific objectives for XEUS: Galaxies Groups and Clusters at z~2 Study of the Evolution of clusters in the mass range kT > 2 keV up to z=2. Dynamics,
PACS NHSC SPIRE Point Source Spectroscopy Webinar 21 March 2012 David Shupe, Bernhard Schulz, Kevin Xu on behalf of the SPIRE ICC Extracting Photometry.
Medical Image Analysis Image Reconstruction Figures come from the textbook: Medical Image Analysis, by Atam P. Dhawan, IEEE Press, 2003.
Page 1 PACS NHSC Data Processing Workshop – Pasadena 26 th - 30 th Aug 2013 Overview of SPIRE Photometer Pipeline Kevin Xu NHSC/IPAC on behalf of the SPIRE.
Adam Zok Science Undergraduate Laboratory Internship Program August 14, 2008.
School of Biomedical Engineering, Science and Health Systems APPLICATION OF WAVELET BASED FUSION TECHNIQUES TO PHYSIOLOGICAL MONITORING Han C. Ryoo, Leonid.
December 9, 2014Computer Vision Lecture 23: Motion Analysis 1 Now we will talk about… Motion Analysis.
A statistical test for point source searches - Aart Heijboer - AWG - Cern june 2002 A statistical test for point source searches Aart Heijboer contents:
Point Source Search with 2007 & 2008 data Claudio Bogazzi AWG videconference 03 / 09 / 2010.
Source catalog generation Aim: Build the LAT source catalog (1, 3, 5 years) Jean Ballet, CEA SaclayGSFC, 29 June 2005 Four main functions: Find unknown.
Counting individual galaxies from deep mid-IR Spitzer surveys Giulia Rodighiero University of Padova Carlo Lari IRA Bologna Francesca Pozzi University.
23 November Md. Tanvir Al Amin (Presenter) Anupam Bhattacharjee Department of Computer Science and Engineering,
Fermi LAT Monash University Nov 21, 2009 R.DuboisFermi LAT Science Analysis Tutorial1 Issues in a Nutshell LS5039 Low stats: 4k photons in 1 yr Strong.
The IceCube Neutrino Observatory is a cubic kilometer detector at the geographic South Pole. We give an overview of searches for time-variable neutrino.
1 8. One Function of Two Random Variables Given two random variables X and Y and a function g(x,y), we form a new random variable Z as Given the joint.
Lecture 24: Quantitative Traits IV Date: 11/14/02  Sources of genetic variation additive dominance epistatic.
Application of multi-resolution method on flow measurement in CBM Vojtech Petracek GSI – CBM week.
Pure Path Tracing: the Good and the Bad Path tracing concentrates on important paths only –Those that hit the eye –Those from bright emitters/reflectors.
GLAST LAT Project DC2 Closeout Workshop, GSFC, 31 May-2 June Comparisons of Searches for Sources in the DC2 Data S. W. Digel Stanford Linear Accelerator.
1 Introduction to Statistics − Day 4 Glen Cowan Lecture 1 Probability Random variables, probability densities, etc. Lecture 2 Brief catalogue of probability.
Lecture 8 Source detection NASSP Masters 5003S - Computational Astronomy
A bin-free Extended Maximum Likelihood Fit + Feldman-Cousins error analysis Peter Litchfield  A bin free Extended Maximum Likelihood method of fitting.
A First Look At VERITAS Data Stephen Fegan Vladimir Vassiliev UCLA.
Data Analysis Algorithm for GRB triggered Burst Search Soumya D. Mohanty Center for Gravitational Wave Astronomy University of Texas at Brownsville On.
Source catalog generation for DC2 Aim (in order of priority): 1.Improve on source detection algorithm and error box. 2.Provide a list of source identifications.
G. Cowan Lectures on Statistical Data Analysis Lecture 9 page 1 Statistical Data Analysis: Lecture 9 1Probability, Bayes’ theorem 2Random variables and.
Hiroyasu Tajima Stanford Linear Accelerator Center Kavli Institute for Particle Astrophysics and Cosmology October 26, 2006 GLAST lunch Particle Acceleration.
June 27-29, DC2 Software Workshop - 1 Tom Stephens GSSC Database Programmer GSSC Data Servers for DC2.
T. Burnett: Anagroup 5/24/04 1 Latest PSF and Point-source sensitivity prediction status Anagroup meeting Toby Burnett 24 May 04.
In conclusion the intensity level of the CCD is linear up to the saturation limit, but there is a spilling of charges well before the saturation if.
REDUCTION OF GALFACTS DATA AND VARIABLE RADIO SOURCES Scott Barenfeld with Tapasi Ghosh and Chris Salter.
Planck working group 2.1 diffuse component separation review Paris november 2005.
PACS Hitchhiker’s Guide to Herschel Archive Workshop – Pasadena 6 th – 10 th Oct 2014 Overview of SPIRE Photometer Data Reduction Pipeline Kevin Xu NHSC/IPAC.
Source catalog generation Aim: Build the LAT source catalog (1, 3, 5 years) Jean Ballet, CEA SaclaySLAC, 23 May 2005 Four main functions: Find unknown.
Yun, Hyuk Jin. Theory A.Nonuniformity Model where at location x, v is the measured signal, u is the true signal emitted by the tissue, is an unknown.
Jean Ballet, CEA Saclay GSFC, 31 May 2006 All-sky source search
20 diffuse catalogue fans
Application of HEALpix Pixelization to Gamma-ray Data
Source Detection by Count Excess
Wavelet Analysis for Sources Detection
Source catalogue generation
All-sky source search issues
UW “Source Detection” Status
Relative merits of the algorithms under consideration
Basics of Photometry.
Wavelet method for source detection in GLAST photon-counting images
Time-Dependent Searches for Neutrino Point Sources with IceCube
21 cm Foreground Subtraction in the Image Plane and in the uv-Plane
Presentation transcript:

All-sky source search Aim: Look for a fast method to find sources over the whole sky Selection criteria Algorithms Iteration Simulations Energy information Variable and extended sources Jean Ballet, CEA SaclaySLAC, 23 May 2005

All-sky source search. Selection Aim: Define criteria for selecting a source search algorithm Difficulty is that criteria are best applied on final output (after maximum likelihood). Because of computing requirements, can be done only after most parameters of a given method have been optimized (projection, pixel size, energy bands, …) Criteria in approximate order of importance for source search itself: 1.Detection power (no new source will be found after that) 2.Resolving power (sources close to each other) 3.Flux and position estimate (to start later steps) 4.False detection rate (can be controlled later) 5.Computing time (of entire pipeline. Many false detections bear on this)

All-sky source search. Algorithms 1.Wavelet algorithm developed at Perugia (next talk) 2.Wavelet algorithm developed at Saclay (MR_filter by J.L. Starck, presented in September 2004). On DC1, was quite comparable to 1. 3.Optimal filter PSF/(1+BKG) in Fourier space (myself, presented in September 2004). On DC1, did not find as many sources as 1 or 2 but returns source significance. 4.Multichromatic wavelet method developed by S. Robinson and T. Burnett. Tries using the PSF at the energy of each photon. On DC1, did not find as many sources as 1 or 2 but still interesting for localization. 5.Aperture photometry tried by T. Stephens as a reference. On DC1, did not find as many sources as the other methods but useful exercise. 6.Voronoi algorithm proposed by J. Scargle (later today). Was not ready for DC1.

Algorithms. Recent developments Few since DC1. At Saclay, we have concentrated on building a pipeline prototype. Optimal filter method now provides an (approximate) all-sky significance map in the Poisson regime. This can be used to combine energy bands. Variance is easy to get at each point. Signal / dispersion at each point is converted into an effective gaussian significance depending on the local density of counts and the PSF shape (same principle as is used in wavelet methods for each coefficient).

All-sky source search. Iteration Methods based on filtering have trouble finding weak sources in the wings of bright ones (because they generate a negative ring around sources). The solution is to iterate. After the bright sources have been detected, they can be modelled and entered into the diffuse emission. Issue is whether this may be done internally (independently of the other energy bands) or must be done globally (via likelihood). Internal solution is simpler Global solution is probably more accurate (because the bright source position can be accurately determined at high energy)

All-sky source search. Simulations The DC1 data has provided a rich resource for testing the algorithms. The DC2 data will improve on it. They have however several limitations : 1.It is only a particular trial. It is useful to be able to simulate the same model many times, to test robustness. 2.The point spread function that the sources follow is representative, but not well reproduced by the Science Analysis Environment (for DC1 at least). 3.It does not allow to study in detail particular aspects, like sources close to each other at varying flux ratio. We don’t actually need a full instrument simulation for testing source detection algorithms. It is more important to control carefully the conditions of the simulation. Points 1 and 2 are best addressed by gtobssim, with a smoothly varying PSF as a function of energy and off-axis angle (like the one used for the 30 days simulation of the recent Science Tools checkout). Point 3 is best addressed by local simulations (with known PSF).

All-sky source search. Energy bands Background limits source detectability by its Poisson fluctuations, even if the diffuse emission model is accurate. Approximate signal to noise (for weak sources) is S / √B, where S and B are taken over 1 PSF. All sources do not have the same spectrum. Soft sources will be better seen above the diffuse emission at low energy, hard sources at high energy. PSF varies enormously from low energy (> 4° below 100 MeV) to high energy (< 0.2° above 1 GeV). This means that low energy photons from bright sources act as background to nearby fainter sources. Splitting into several energy bands is better than summing everything. Example for optimal filter method (just from source lists): 105 sources in GeV band, 109 in (51) (89). 4 energy bands (32 MeV / 100 MeV / 316 MeV / 1 GeV / 10 GeV) was all right for DC1. For longer integration time (like 1 year) shift to higher energy (confusion at low energy). Cannot split indefinitely (more degrees of freedom). Pixel size should be adapted to PSF in each band.

Putting energy bands together Simplest solution is to run algorithm over each energy band separately and merge source lists. This is better than using a single band, but not very powerful. A better solution is to add likelihood images (before applying threshold). Can be done also on a full significance map, as presented before for the optimal filter method. If S is the significance (in sigma units), and i an index for energy bands, then Σ i S i 2 is expected to follow a χ 2 distribution with N (number of energy bands) degrees of freedom. Excesses can be detected on the combination directly. The broad PSF at low energy adds a complication. A true source can induce false detections in its vicinity (via its low energy wings).

All-sky source search. Special cases Variable sources (blazars mostly). This covers two different things: Identify as variable sources which have been detected over the entire time period. Detect variable sources which have been missed over the entire time period (because of dilution). Can be done by repeating the source search over shorter time intervals (like one week), or by a specific algorithm (like looking for variability systematically in sky ‘pixels’). Extended sources (external galaxies, supernova remnants, interstellar structures). This covers two different things: Identify as extended sources which have been detected by the point-source algorithm. Can be done by comparing source shape with PSF convolved with a Gaussian of variable width. Detect extended sources which have been missed by the point-source algorithm. Can be done by wavelet algorithms, or simply by looking for excesses in residual photon map (sources and diffuse emission subtracted).

Source detection studies Several open points: 1.How to deal best with the energy information ? Will be addressed at Saclay. 2.Is cartesian geometry all right (paving the sky with large pieces) ? Is it worth working in spherical geometry ? 3.How best to detect variable sources ? 4.How best to detect extended sources ? We have several viable options ! Jean Ballet, CEA SaclaySLAC, 23 May 2005