Physics 114: Lecture 8 Measuring Noise in Real Data Dale E. Gary NJIT Physics Department.

Slides:



Advertisements
Similar presentations
Welcome to the University of Michigan – Dearborn Observatory Founded 2007.
Advertisements

Video cameras and photometry Dave Herald. Background Occultations are usually step events When video introduced, it overcame issues of Personal Equation,
Institute for Gravitational Research
Institute for Gravitational Research
By Kevin Saunders.  tml tml.
Kevin Kelly Mentor: Peter Revesz.  Importance of Project: Beam stability is crucial in CHESS, down to micron-level precision  The beam position is measured.
Optical Astronomy Imaging Chain: Telescopes & CCDs.
Physics 114: Lecture 9 Probability Density Functions Dale E. Gary NJIT Physics Department.
CCD Imaging Dale E. Gary New Jersey Institute of Technology 2010 Feb 13 Amateur Astronomers Inc. 1 / 51.
Manufacturing Variation Plotting a Normal Distribution.
Detecting Digital Image Forgeries Using Sensor Pattern Noise presented by: Lior Paz Jan Lukas, jessica Fridrich and Miroslav Goljan.
CCDs. CCDs—the good (+)  Linear response  photometry is “simple” +High efficiency, compared to other detectors +Sensitive to many wavelengths +2-D arrays.
The standard error of the sample mean and confidence intervals
SDW20051 Vincent Lapeyrère LESIA – Observatoire de Paris Calibration of flight model CCDs for CoRoT mission.
The standard error of the sample mean and confidence intervals How far is the average sample mean from the population mean? In what interval around mu.
PROBABILITY AND SAMPLES: THE DISTRIBUTION OF SAMPLE MEANS.
Statistics 800: Quantitative Business Analysis for Decision Making Measures of Locations and Variability.
CCD Image Processing: Issues & Solutions. Correction of Raw Image with Bias, Dark, Flat Images Flat Field Image Bias Image Output Image Dark Frame Raw.
Charge-Coupled Device (CCD)
Signal vs Noise: Image Calibration First… some terminology:  Light Frame: The individual pictures you take of your target.  Dark Frame: An image taken.
Physics 114: Lecture 11 Error Analysis
CCD testing Enver Alagoz 12 April CCD testing goals CCD testing is to learn how to – do dark noise characterization – do gain measurements – determine.
Your Observing Challenge: White Dwarfs in Open Star Clusters.
Galaxy number count by using Optical images Supervisor :川崎涉 (Kawasaki Wataru) 潘國全 (Pan Kuo-Chuan)
Different sources of noise in EM-CCD cameras
Physics 114: Lecture 15 Probability Tests & Linear Fitting Dale E. Gary NJIT Physics Department.
AST3 detector properties
Photon Transfer Method 1. Using two identical flat field exposures it is possible to measure the read noise of a CCD with the Photon Transfer method. Two.
Physics 114: Lecture 10 PDFs Part Deux Dale E. Gary NJIT Physics Department.
Measurement Uncertainties and Inconsistencies Dr. Richard Young Optronic Laboratories, Inc.
Physics 114: Exam 2 Review Lectures 11-16
CCD Detectors CCD=“charge coupled device” Readout method:
General Confidence Intervals Section Starter A shipment of engine pistons are supposed to have diameters which vary according to N(4 in,
Sampling and Sample Size Part 1 Cally Ardington. Course Overview 1.What is Evaluation? 2.Outcomes, Impact, and Indicators 3.Why Randomise? 4.How to Randomise?
Asteroids Image Calibration and Setup Making a Lightcurve What is a Lightcurve? Cole Cook  Physics and Astronomy  University of Wisconsin-Eau Claire.
1 Leonardo Pinheiro da Silva Corot-Brazil Workshop – October 31, 2004 Corot Instrument Characterization based on in-flight collected data Leonardo Pinheiro.
Physics 114: Lecture 14 Mean of Means Dale E. Gary NJIT Physics Department.
Error Propagation. Errors Most of what we know is derived by making measurements. However, it is never possible to measure anything exactly (eventually.
ME Mechanical and Thermal Systems Lab Fall 2011 Chapter 3: Assessing and Presenting Experimental Data Professor: Sam Kassegne, PhD, PE.
A Search For New Planets Matthew Livas Science, Discovery, and the Universe Computer Science Introduction My capstone was to observe.
NICMOS Calibration Challenges in the Ultra Deep Field Rodger Thompson Steward Observatory University of Arizona.
INTRODUCTORY LECTURE 3 Lecture 3: Analysis of Lab Work Electricity and Measurement (E&M)BPM – 15PHF110.
14 January Observational Astronomy SPECTROSCOPIC data reduction Piskunov & Valenti 2002, A&A 385, 1095.
NIRISS NRM bad pixel tolerance analysis David Lafrenière 2012 February 21.
CCD Image Processing: Issues & Solutions. CCDs: noise sources dark current –signal from unexposed CCD read noise –uncertainty in counting electrons in.
Normal Distributions. Probability density function - the curved line The height of the curve --> density for a particular X Density = relative concentration.
In conclusion the intensity level of the CCD is linear up to the saturation limit, but there is a spilling of charges well before the saturation if.
Analysis of denoising filters for photo response non uniformity noise extraction in source camera identification Irene Amerini, Roberto Caldelli, Vito.
Review Design of experiments, histograms, average and standard deviation, normal approximation, measurement error, and probability.
1 Core Data Processing Software Plan Review – University of Washington, Seattle, WA – Sept th Data Management XXVIII IAU General Assembly.
Binomial Distribution Possion Distribution Gaussian Distribution Lorentzian Distribution Error Analysis.
Astroschool: Image Calibration February 20 th,
The Reduction and Reporting of Data On Proto-Planetary Nebulae From Two Observatories. By Wesley Cheek With Mr. Wen Lu & Prof. Bruce Hrivnak.
CCD Calibrations Eliminating noise and other sources of error.
Physics 114: Lecture 11-a Error Analysis, Part III
Announcements After a short lecture we will adjourn to the Farm. Tonight is a Dark Sky make-up night. Class will meet Thursday night. If clear: meet at.
Physics 114: Lecture 5 Uncertainties in Measurement
NAC flat fielding and intensity calibration
Charge Transfer Efficiency of Charge Coupled Device
CCD Image Processing …okay, I’ve got a bunch of .fits files, now what?
Physics 114: Lecture 6 Measuring Noise in Real Data
Sample vs Population comparing mean and standard deviations
Sampling Distribution
Sampling Distribution
Physics 114: Lecture 11 Error Analysis, Part II
Photometric Analysis of Asteroids
Announcements HR Diagram lab will be extended for one week. I’ll talk about it today. Homework: Chapter 9 # 1, 2 & 3 Next week is a Dark Sky Night. If.
Karen Meech Institute for Astronomy TOPS 2003
Image calibration Geoff Smith, September 2018.
Sampling Distribution of the Mean
Presentation transcript:

Physics 114: Lecture 8 Measuring Noise in Real Data Dale E. Gary NJIT Physics Department

February 12, 2010 Mean and Standard Deviation  Sample Mean  Parent population mean  Standard Deviation from sample mean  Standard Deviation from parent population mean

Homework 1 Data  The HAT-P-6 b transit data are shown at the right.  If in MatLAB you type mean(a(:,6)) and std(a(:,6)), you will find that the data have a mean of 10.50, and standard deviation of  The plot at lower right shows the histogram of the measurements with an overlay of a Gaussian (normal distribution) bell curve using the parameters above. February 12, 2010 Note, “data” is plural

February 12, 2010 Homework 1 Data  As an example of evaluating data in a real application, consider the HAT-P-6 data from homework 1.  This is data taken during an eclipse of a star by a planet (that is, the planet is crossing in front of the star, causing a very small decrease in light level). Unfortunately, I could not get everything set up in time, and I only got the time at the end of the eclipse (egress).  The data came from images of the star field, and there are several steps to obtaining the light curve. Two examples of eclipses by others, with more complete lightcurves.

February 12, 2010  Here is a fit to the measurements that you read in. The curve is the expected eclipse lightcurve obtained from “forward fitting” using a model for the eclipse.  Note the “trend removed” curve, which is an example of a systematic error. Homework 1 Data

February 12, 2010 Homework 1 Data  The magnitude measurements are themselves made with images from a CCD camera, which have their own systematic and random errors.  The systematic errors can be removed through calibration, and as mentioned before, they include both additive and multiplicative errors.  To remove such systematic errors, we want to make the random errors in the calibration data as small as possible.  Let’s go through the process and introduce CCD cameras.

2010 Feb 13 How CCDs Work Photons to Analog/Digital Units (Counts) These 2 parameters give conversion of photons to counts mm mm One photon has 73% chance to cause release of an electron (e - ). It takes 1.6 e - to give 1 count. So 100 photons will result in 100*0.73/1.6 = 45 counts. Each well can hold 120,000 e - = counts

2010 Feb 13 How CCDs Work Bias (additive) These 2 parameters give noise output mm mm Even with 0 s exposure, just reading out the image gives (on average) 17 e -, or about 10 counts. This is called bias, and is neither temperature nor time dep.

2010 Feb 13 How CCDs Work Dark Current (additive) These 2 parameters give noise output mm mm With a time exposure, say a 1 min exposure at -30 C, will have 19 more counts. This is BOTH temperature and time dep.

2010 Feb 13 Imaging First Principles The last step is to take calibration frames: Bias, Dark, and Flat frames. I take 20 Bias and 20 Dark (set camera cooler to temperature first, and take dark frames for same duration as imaging frames). I take flat frames (need even illumination—set duration for mid-range exposure). Bias frames are instantaneous, for subtraction of read noise. Dark frames are same duration as imaging frames, for subtraction of dark current and correction of hot pixels. Flat frames are for removal of non-uniform illumination (vignetting and dust). Images are divided by flat frames.

2010 Feb 13 Imaging First Principles Noise is the enemy, so average calibration frames.

2010 Feb 13 Imaging First Principles Image without calibration Flat field light box Image with Calibration