Data Reduction and Analysis Techniques

Slides:



Advertisements
Similar presentations
A Crash Course in Radio Astronomy and Interferometry: 4
Advertisements

NAIC-NRAO School on Single-Dish Radio Astronomy. Arecibo, July 2005
Calibration Ron Maddalena NRAO – Green Bank November 2012.
ALMA Pipeline Heuristics F2F Meeting 2006 in Paris 1 SD Pipeline Heuristics Status Report ALMA Project, NAOJ George KOSUGI.
Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array Whoever North American.
EOR Detection Strategies Somnath Bharadwaj IIT Kharagpur.
Wed. 17th Sept Hamburg LOFAR Workshop.  Extract a cosmological signal from a datacube, the three axes of which are x and y positions, and frequency.
3mm amplitude test by Cheng-Jiun Ma. Observation Source : Orion SiO Frequency: GHz 256 channels within 64MHz bandwidth Ant 3 & Ant 4 no Tsys correction.
Interferometric Spectral Line Imaging Martin Zwaan (Chapters of synthesis imaging book)
Visual Tracking: Case Study CMPUT 615 Nilanjan Ray.
BDT Radio – 1b – CMV 2009/09/04 Basic Detection Techniques 1b (2009/09/04): Single pixel feeds Theory: Brightness function Beam properties Sensitivity,
The SMA CO(6-5) & 690 GHz Continuum Observations of Arp 220 Satoki Matsushita (ASIAA) D. Iono (CfA), C.-Y. Chou (ASIAA), M. Gurwell (CfA), P.-Y. Hsieh.
Star Formation Studies Using AST/RO Student: Desika Narayanan Mentor: Dr. Sung Kim Center for Astrophysics Cambridge, Massachusetts Summer 2001.
Lecture 4 Measurement Accuracy and Statistical Variation.
Paul Alexander Dynamic RangeAAVP 2010 Overview of Calibration and Dynamic Range Challenges Paul Alexander.
Single-Dish Radio Telescopes Dr. Ron Maddalena National Radio Astronomy Observatory Green Bank, WV.
6-1 EE/Ge 157b Week 6 EE/Ae 157 a Passive Microwave Sensing.
Spectral Line Calibration Techniques with Single Dish Telescopes K. O’Neil NRAO - GB.
KAT-7/MeerKAT Commissioning SPT and Commissioning teams * * Bennett, T., Blose, S., Booth, R., de Villiers,
GBT Spectral Baselines – Tuesday, 11 March 2003 GBT Spectral Baseline Investigation Rick Fisher, Roger Norrod, Dana Balser (G. Watts, M. Stennes)
GBT radio recombination lines (GBT-5) Single Dish Summer School July 2009.
Slide 1 25-Jan-10Huib Intema Recent low-frequency developments at NRAO Charlottesville and some other USA institutes.
Calibration Ron Maddalena NRAO – Green Bank July 2009.
Calibration and Data reduction Strategies Cormac Purcell & Ned Ladd Mopra Training Weekend May 2005.
Wideband Imaging and Measurements ASTRONOMY AND SPACE SCIENCE Jamie Stevens | ATCA Senior Systems Scientist / ATCA Lead Scientist 2 October 2014.
HIFI Tutorial 3: Getting some basic science out A.P.Marston ESAC 27 June 2013.
Spectral Line VLBI Chris Phillips JIVE The Netherlands Chris Phillips JIVE The Netherlands.
Spectral Line Calibration Techniques with Single Dish Telescopes K. O’Neil NRAO - GB.
Molecular Gas and Dust in SMGs in COSMOS Left panel is the COSMOS field with overlays of single-dish mm surveys. Right panel is a 0.3 sq degree map at.
J. Hibbard Spectral Line II: Calibration & Analysis 1 Spectral Line II: Calibration and Analysis Bandpass Calibration Flagging Continuum Subtraction Imaging.
PACS NHSC SPIRE Point Source Spectroscopy Webinar 21 March 2012 David Shupe, Bernhard Schulz, Kevin Xu on behalf of the SPIRE ICC Extracting Photometry.
Page 1 PACS NHSC Data Processing Workshop – Pasadena 26 th - 30 th Aug 2013 Overview of SPIRE Photometer Pipeline Kevin Xu NHSC/IPAC on behalf of the SPIRE.
Making MOPRA go! Lucyna Kedziora-Chudczer Friend of the telescope (UNSW)
NIRSpec Operations Concept Michael Regan(STScI), Jeff Valenti (STScI) Wolfram Freduling(ECF), Harald Kuntschner(ECF), Robert Fosbury (ECF)
Ninth Synthesis Imaging Summer School Socorro, June 15-22, 2004 Spectral Line II John Hibbard.
PACS NHSC Data Processing Workshop – Pasadena 10 th - 14 th Sep 2012 Measuring Photometry from SPIRE Observations Presenter: David Shupe (NHSC/IPAC) on.
Мulti-frequency VLA observations of M87. Observations’ parameters Test VLA observations (configuration D) of M87 (RA=12:28, Dec=12:40) took place on November.
PACS NHSC Data Processing Workshop – Pasadena 10 th - 14 th Sep 2012 The SPIRE Destriper Bernhard Schulz NHSC/IPAC on behalf of the SPIRE ICC 1.
Outline Transmitters (Chapters 3 and 4, Source Coding and Modulation) (week 1 and 2) Receivers (Chapter 5) (week 3 and 4) Received Signal Synchronization.
Observing Strategies at cm wavelengths Making good decisions Jessica Chapman Synthesis Workshop May 2003.
Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array Radio Frequency Interference.
Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array Observing Scripts Basic.
Starring Kim Arvidsson Matthew Povich Jamie Riggs Directed by B. Murray Lewis Limits on OH 5 GHz Maser Emission from an OH/IR Star and a Proto-Planetary.
L. Young, Synthesis Imaging Summer School, 19 June Spectral Line I Lisa Young This lecture: things you need to think about before you observe After.
PACS NHSC Data Processing Workshop Aug 26-30, 2013 Page 1 SPIRE Spectrometer Data: Calibration Updates, User Data Reprocessing, and Other Issues Nanyao.
New SPIRE features in HIPE 9.1 NHSC; Nov 28, 2012 PACS Page 1 What’s New in HIPE 9.1 ( SPIRE FTS) Nanyao Lu NHSC/IPAC (on behalf of the SPIRE ICC)
M.P. Rupen, Synthesis Imaging Summer School, 18 June Cross Correlators Michael P. Rupen NRAO/Socorro.
ATNF Synthesis Workshop - September Single-dish spectral-line observing Lister Staveley-Smith, ATNF  Why use a single-dish?  Analogy with interferometer.
PACS Hitchhiker’s Guide to Herschel Archive Workshop – Pasadena 6 th – 10 th Oct 2014 Overview of SPIRE Photometer Data Reduction Pipeline Kevin Xu NHSC/IPAC.
IF processor and Spectrometer
MWA imaging and calibration – early science results
Direction dependent effects: Jan. 15, 2010, CPG F2F Chicago: S. Bhatnagar 1 Direction-dependent effects S. Bhatnagar NRAO, Socorro RMS ~15  Jy/beam RMS.
MECH 373 Instrumentation and Measurement
A.Zanichelli, B.Garilli, M.Scodeggio, D.Rizzo
Observing Strategies for the Compact Array
Introduction to Using Radio Telescopes
Results of the LHC Prototype Chromaticity Measurement
Velocity Estimation from noisy Measurements
G. Mevi1,2, G. Muscari1, P. P. Bertagnolio1, I. Fiorucci1
Data Reduction and Analysis Techniques
Arecibo Spectral line observing demo - basic concepts -- [Slides have been borrowed from talks by Frank Ghogo and Karen O’Neil of Green Bank, NRAO]
Strategies for Eliminating Interferences in Optical Emission Spectroscopy Best practices to optimize your method and correct for interferences to produce.
Polarization Calibration
What’s New in HIPE 10.0 (SPIRE FTS)
Telecommunications Engineering Topic 2: Modulation and FDMA
Image Error Analysis Fourier-domain analysis of errors.
From Russia with love!!!.
KFPA CDR R. Norrod Feb 27, 2008.
SKAMP Square Kilometre Array Molonglo Prototype
Molecular Imager: Focal Plane Array
Presentation transcript:

Data Reduction and Analysis Techniques Ronald J. Maddalena

Existing Analysis Systems

Continuum - Point Sources On-Off Observing

Continuum - Point Sources On-Off Observing

Continuum - Point Sources On-Off Observing Known: Equivalent temperature of noise diode or calibrator (Tcal) = 3 K Bandwidth (BW) = 10 MHz Gain = 2 K / Jy Desired: Antenna temperature of the source (Tsrc) Flux density (S) of the source. System Temperature(Tsys) Accuracy of antenna temperature (σsrc)

Continuum - Point Sources On-Off Observing

Continuum - Point Sources Assumptions: Narrow bandwidths, Linear power detector, Source intensity << Tsys, Noise diode temperature << Tsys, treference = tsignal tcal_on = tcal_off Blanking time << tsignal

Phases of a Observation Total Power

Phases of a Observation Total Power

Continuum - Point Sources Total Power

Phases of a Observation Switched Power

Phases of a Observation Switched Power

Continuum - Point Sources Beam-Switched Observation

Continuum - Point Sources On-The-Fly Observation

Continuum - Point Sources On-The-Fly Observation If total power: If beam-switching (switched power):

Baseline Fitting Polynomials Set order of polynomial Define areas devoid of emission. --------------------------- Creates false features Introduces a random error to an observation,

Continuum - Point Sources Gaussian Fitting Restrict data to between the half power points, Define initial guesses Set flags to fit or hold constant each parameter Set number of iterations Set convergence criteria ---------------------------- Fitted parameters Chi-square of the fit Parameter standard deviations.

Template Fitting Create a template: --------------- Sufficient knowledge of the telescope beam, or Average of a large number of observations. --------------- Convolve the template with the data => x-offset. Shift by the x-offset. Perform a linear least-squares fit of the template to the data:

Template Fitting

Averaging Data Tsys changes due to atmosphere emission. Tant changes due to atmosphere opacity. -------------------- Use weighted average Weights: 1/σ2.

Continuum - Extended Sources On-The-Fly Mapping Telescope slews A few samples /sec. Highly oversampled. Could be beam switching ---------------------- Convert Power into Tant. Fit baseline to each row? Grid into a matrix

Continuum - Extended Sources On-The-Fly Mapping - Common Problems Striping (Emerson 1995; Klein and Mack 1995). If beam-switched, Emerson, Klein, and Haslam (1979) to reconstruct the image. Make multiple maps with the slew in diferent direction.

Spectral-Line - Point Sources Position-Switched Observing

Spectral-Line - Point Sources Position-Switched Observing SIGNAL REFERENCE Avrg Tsys

Spectral-Line - Point Sources Frequency-Switched Observing - In band Tsys(REF)*[(SIG-REF)/REF - (SIG’-REF’)/REF’

Spectral-Line - Point Sources Frequency-Switched Observing - In Band Tsys(REF)*(SIG-REF)/REF + Tsys(SIG)*(REF’-SIG’)/SIG’

Spectral-Line Baseline Fitting Polynomial: same as before Sinusoid

Spectral-Line Ripples

Spectral-Line Other Algorithms Averaging: Weighted by 1/σ2 Velocity Calibration Velocity/Frequency Shifting Doppler tracking limitations Gaussian fitting Multi-component fits should be done simultaneosuly Smoothing Decimating vs. non-decimating routines Moments for Integrated Intensities; Velocity centroids, ….

Spectral-Line RFI Excision

Spectral-Line Mapping Grid and On-the-Fly Velocity DEC RA

Spectral-Line Mapping Grid and On-the-Fly (If V1=V2 => Channel Map) Velocity For {v=vmin} {v <=vmax} {v++} { if T(α,δ,v) > Tmin then W(α,δ)=W(α,δ)+ T(α,δ,v) endif endfor DEC RA

Spectral-Line Mapping Grid and On-the-Fly Velocity (Position-velocity map) DEC RA

Spectral-Line Mapping Rudimentary Analysis

Conclusion The Future of Single-Dish Data Analysis Increase in the use of RDBMS. Support the analysis of archived data. Sophisticated visualization tools. Sophisticated, robust algorithms (mapping). Data pipelining for the general user. Automatic data calibration using sophisticated models of the telescope. Algorithms that deal with data sets. Analysis systems supported by cross-observatory groups