Astro-WISE workshop, 31/03 – 03/04 2008 1 Ewout Helmich Image Stacking in Astro-WISE ➢ Why this talk? ➢ Infrared data: lots of short exposures to stack.

Slides:



Advertisements
Similar presentations
Advanced CCD Workshop Arne A. Henden
Advertisements

Astro-WISE Tutorial, Leiden August 2008 Adapting Code Introduction to OOP Code, what code? What & where Why adapt code anyway? How?
By Kevin Saunders.  tml tml.
Lecture Objectives: 1)List the 5 classical components of a computer and show their relationships graphically. 2)Define instruction set architecture. 3)Define.
3-D Computer Vision CSc83020 / Ioannis Stamos  Revisit filtering (Gaussian and Median)  Introduction to edge detection 3-D Computater Vision CSc
Pre-Processing of CCD Data ASTR 3010 Lecture 9 Textbook Chap 9.
Implementing the Probability Matrix Technique for Positron Emission Tomography By: Chris Markson Student Adviser: Dr. Kaufman.
Tablet Computers Georgia 4- H Cotton Boll and Consumer Judging 2013.
XLDB -Lyon Aug 2009 Astro-WISE -> TarGet OmegaCEN – TarGet Kapteyn Astronomical Institute University of Groningen 28 August 2009 UU OmegaCEN – TarGet Kapteyn.
7. Neighbourhood operations A single pixel considered in isolation conveys information on the intensity and colour at a single location in an image, but.
MMT Real-Time-Reconstructor. Hardware CPU: Quad-core Xeon 2.66 GHz RAM: 2GB OS: CentOS with RTAI real-time extensions Frame Grabber: EDT PCI-DV.
Cosmos Data Products Version Peter Capak (Caltech) May, 23, 2005 Kyoto Cosmos Meeting.
Image Filtering. Problem! Noise is a problem, even in images! Gaussian NoiseSalt and Pepper Noise.
Tablet Computers Georgia 4- H Cotton Boll and Consumer Judging 2013.
Signal vs Noise: Image Calibration First… some terminology:  Light Frame: The individual pictures you take of your target.  Dark Frame: An image taken.
Sampling and Antialiasing CMSC 491/635. Abstract Vector Spaces Addition –C = A + B = B + A –(A + B) + C = A + (B + C) –given A, B, A + X = B for only.
Harris Corner Detector on FPGA Rohit Banerjee Jared Choi : Parallel Computer Architecture and Programming.
Convolutional Neural Networks for Image Processing with Applications in Mobile Robotics By, Sruthi Moola.
Beating Noise Observational Techniques ASTR 3010 Lecture 11 Textbook.
The Astro-wise pipeline Python Data processing - the low-level interfaces Data administration - persistent objects.
A Metadata Based Approach For Supporting Subsetting Queries Over Parallel HDF5 Datasets Vignesh Santhanagopalan Graduate Student Department Of CSE.
CCD Detectors CCD=“charge coupled device” Readout method:
NASSP Masters 5003F - Computational Astronomy Lecture 3 First, a bit more python. Then some noise statistics.
1. ARCHIVE (camera capture file) 2. MASTER (corrected & adjusted) 3. MR SID (wavelet compressed) 4. ‘LARGE’ (full-frame P’Point) 5. ‘SMALL’ (1/2 frame.
UCF REU: Weeks 1 & 2. Gradient Code Gradient Direction of the Gradient: Calculating theta.
CGMB214: Introduction to Computer Graphics
What’s in a sum? Simon Dawes CMHAS. Should you stack frames using Mean, Median or Sum?
Convolution and Filtering
How to use galfit (and galphot)
1 Groningen, November 2003 ASTROWISE OAC TEAM The ASTRO-WISE project: status at OAC The OAC AW team: J.M. Alcalà, F. Getman, A. Grado, M. Pavlov,
Conversion of Stackfit to LSST software stack Status as of Feb 20, 2012.
CSC508 Convolution Operators. CSC508 Convolution Arguably the most fundamental operation of computer vision It’s a neighborhood operator –Similar to the.
April 2001 OPTICON workshop in Nice 1 The PSF homogenization problem in large imaging surveys Emmanuel BERTIN (TERAPIX)
CSSE463: Image Recognition Day 5 Lab 2 due Wednesday, 1:30. Lab 2 due Wednesday, 1:30. Tip: by Tues 1:30  + 1 late day to use on: Tip: by Tues 1:30 
Photometric Redshifts in Astro-Wise PhotRedCatalog Astro-Wise Workshop Leiden 2008 Jan Snigula, MPE.
Exam2 : Oct 25, 2012 Exam2 : Lecture note #8 through #18.
Spatiotemporal Saliency Map of a Video Sequence in FPGA hardware David Boland Acknowledgements: Professor Peter Cheung Mr Yang Liu.
Visual Computing Computer Vision 2 INFO410 & INFO350 S2 2015
1 Leiden, November 20-21, 2001OAC ASTROWISE TEAM OAC WP4: OAC BeoWulf Hardware choice criteria : physical space problem flexible configuration cope with.
Sejong Univ. CH3. Area Processes Convolutions Blurring Sharpening Averaging vs. Median Filtering.
Implementing Fast Image Processing Pipelines in a Codesign Environment Accelerate image processing tasks through efficient use of FPGAs. Combine already.
Spotting the life of stars „Pi of the Sky” Project Katarzyna Kwiecińska UKSW-SNŚ on behalf of the Pi of the Sky collaboration.
Astro-Wise prompt ● awe is a shell with uses such as: – Python – data reduction (parallel, “dpu”) – interactive analysis (eclipse) – calculator – plotting.
Filtering (II) Dr. Chang Shu COMP 4900C Winter 2008.
Astro-WISE. an Astronomical Wide-field Imaging System for Europe E v e r y o n e John P. McFarland OmegaCEN, Kapteyn Astronomical Institute Groningen,
HIGH-SPEED LASER LOCALIZATION FOR MOBILE ROBOTS - Kai Lingemann, Andreas Nuchter -Robotics and Autonomous Systems (2005)
Astroschool: Image Calibration February 20 th,
CCD Calibrations Eliminating noise and other sources of error.
Basic Principles Photogrammetry V: Image Convolution & Moving Window:
CSC391/691 Intro to OpenCV Dr. Rongzhong Li Fall 2016
Hardware specifications
A Difference Imaging Tool
Image Pre-Processing in the Spatial and Frequent Domain
Astrometric Calibration
VUMC Soil Worm Activity Monitor
CSSE463: Image Recognition Day 5
SPHERE Spectro-Polarimetric High-contrast Exoplanet REsearch
Comparison Between Deep Learning Packages
A galaxy at redshift 10? Brigitta Eder Vera Könyves
Kurt Soto Advisor : Keivan Stassun
Static Image Filtering on Commodity Graphics Processors
Image Processing, Lecture #8
Announcements HR Diagram lab will be extended for one week. I’ll talk about it today. Homework: Chapter 9 # 1, 2 & 3 Next week is a Dark Sky Night. If.
Image Processing, Lecture #8
CSSE463: Image Recognition Day 5
Elecbits Electronic shade.
CSSE463: Image Recognition Day 5
CSSE463: Image Recognition Day 5
CSC 578 Neural Networks and Deep Learning
Lecture 7 Spatial filtering.
Presentation transcript:

Astro-WISE workshop, 31/03 – 03/ Ewout Helmich Image Stacking in Astro-WISE ➢ Why this talk? ➢ Infrared data: lots of short exposures to stack ➢ Stacking with Eclipse ➢ Stacking with SWarp ➢ Future: stacking with DARMA

Astro-WISE workshop, 31/03 – 03/ Ewout Helmich Eclipse ➢ Interface to C-code from Python ➢ Fast ➢ Not scalable for taking median of cube ➢ Images must be of equal dimensions ➢ No longer developed ➢ Weighting not incorporated in C-code

Astro-WISE workshop, 31/03 – 03/ Ewout Helmich What do we use Eclipse for? ➢ Bias (average with sigma-rejection) ➢ median() is used as first approx. of average ➢ Flat-fields ➢ Master dome and twilight (average with sigma- rejection) ➢ Nightsky flats (median) ➢ Fringe maps (median)

Astro-WISE workshop, 31/03 – 03/ Ewout Helmich Eclipse: average of cube awe> filenames = ['image1.fits', 'image2.fits', 'image3.fits'] awe> cube = eclipse.cube.cube([eclipse.image.image(f) for f in filenames]) awe> average = cube.average() # do-it-yourself, scalable awe> im1 = eclipse.image.image('image1.fits') awe> for f in filenames[1:]: im1 += eclipse.image.image(f) awe> im1 /= len(filenames) awe> im1.save('average.fits')

Astro-WISE workshop, 31/03 – 03/ Ewout Helmich Eclipse: median of cube # Calculate the median of a cube of images awe> cube = eclipse.cube.cube([eclipse.image.image(filename) for filename in filenames]) awe> med = cube.median() awe> med.save('median.fits')

Astro-WISE workshop, 31/03 – 03/ Ewout Helmich Eclipse: image difference awe> im1 = eclipse.image.image('image1.fits') awe> im2 = eclipse.image.image('image2.fits') awe> im3 = im1-im2 awe> im3.save('diff.fits')

Astro-WISE workshop, 31/03 – 03/ Ewout Helmich Abstraction in object model awe> bias = (BiasFrame.filename != '').max('creation_date') awe> bias.load_image() awe> bias.image awe> sci.image = sci.image - bias.image

Astro-WISE workshop, 31/03 – 03/ Ewout Helmich SWarp ➢ Fast (slower than Eclipse (bagage)) ➢ Meant to use world coordinates ➢ Coadd with or without resampling ➢ Integer pixel shifts by changing CRPIX1, CRPIX2 etc. ➢ Pads output image with zeros

Astro-WISE workshop, 31/03 – 03/ Ewout Helmich What do we use SWarp for? ➢ Resampling images to the same grid ➢ Coadd images ➢ Can be (ab)used to stack images to create fringe map

Astro-WISE workshop, 31/03 – 03/ Ewout Helmich SWarp example awe> from astro.external import Swarp awe> from astro.main.Config import SwarpConfig awe> config = SwarpConfig() awe> config.WEIGHT_TYPE = 'NONE' awe> config.BACK_SIZE = 64 awe> Swarp.swarp(['image1.fits', 'image2.fits'], config=config)

Astro-WISE workshop, 31/03 – 03/ Ewout Helmich SWarp abstraction in object model ➢ RegriddedFrame ➢ result of swarp with COMBINE=”N” and RESAMPLE = “Y” ➢ CoaddedRegriddedFrame ➢ result of swarp with COMBINE=”Y” and RESAMPLE = “N”

Astro-WISE workshop, 31/03 – 03/ Ewout Helmich SWarp: in pipeline # using the DPU awe> dpu.run('Regrid', d=' ', i='WFI', f='#843', o='Science1_?-*') # local processing awe> task = RegridTask(date=' ', chip='ccd50', filter='#843', object='Science1_?-*') awe> task.execute()

Astro-WISE workshop, 31/03 – 03/ Ewout Helmich SWarp to make FringeFrame COMBINE = Y COMBINE_TYPE = MEDIAN RESAMPLE = N > swarp -c swarp.conf

Astro-WISE workshop, 31/03 – 03/ Ewout Helmich DARMA ➢ PyFITS interface, much like Eclipse interface ➢ Uses NumPy ➢ Not fast enough for some number crunching operations: ➢ Convolution, Hough-transform (satellite detection) ➢ NumPy extension (C-code) to speed up

Astro-WISE workshop, 31/03 – 03/ Ewout Helmich DARMA examples awe> filenames = ['image1.fits', 'image2.fits', 'image3.fits'] awe> cube = darma.cube.cube([darma.image.image(f) for f in filenames]) # Calculate the average awe> average = cube.average() # Calculate the median awe> median = cube.median()

Astro-WISE workshop, 31/03 – 03/ Ewout Helmich Performance overview ➢ hardware: P4 2.8 Ghz, 1GB RAM ➢ data: ISAAC Hawaii CCD images (4.1Mb) STACKING MEDIAN #frames Computing time Comments ECLIPSESWARP sec limited by RAM sec sec sec AVERAGE #frames Computing time DARMA sec sec