Data Pipeline Wei Zheng Johns Hopkins University.

Slides:

Advertisements

Similar presentations

ADASS XVII Sep 2007The NOAO Pipeline Applications Francisco Valdes (NOAO) Robert Swaters (UMd) Derec Scott (NOAO) Mark Dickinson (NOAO)

Advertisements

Optimal Photometry of Faint Galaxies Kenneth M. Lanzetta Stony Brook University.

ACS/WFC Geometric Distortion and CTE V. Kozhurina-Platais & ACS team.

Towards Creation of a JWST Astrometric Reference Field: Calibration of HST/ACS Absolute Scale and Rotation Roeland van der Marel Jay Anderson, Colin Cox,

How Does WFC3 Geometric Distortion Vary with Time ? Kozhurina-Platais.

CLASH: Cluster Lensing And Supernova survey with Hubble An HST Multi-Cycle Treasury Program designed to place new constraints on the fundamental components.

CLASH: Cluster Lensing And Supernova survey with Hubble ACS Parallels WFC3 Parallels 6 arcmin. = 2.2 z=0.5 Footprints of HST Cameras: ACS FOV in.

10Tb 100Tb 1000Tb. WFCAM processing summary semesters: 05A, 05B, 06A, 06B, 07A nights: 81, 166, 95, 157, 50 (68%) 50 Tbytes raw data 17 Tbytes compressed.

Probabilistic Cross-Identification of Astronomical Sources Tamás Budavári Alexander S. Szalay María Nieto-Santisteban The Johns Hopkins University.

Cosmos Data Products Version Peter Capak (Caltech) May, 23, 2005 Kyoto Cosmos Meeting.

PSF Reconstruction: Part I The PSF “Core” Primary Goal: Derive PSFs for point source detection and PSF fitting photometry. Secondary Goal: Derive PSFs.

Introduction to Spitzer and some applications Data products Pipelines Preliminary work K. Nilsson, J.M. Castro Cerón, J.P.U. Fynbo, D.J. Watson, J. Hjorth.

Hubble Legacy Archive Lee Quick - TIPS meeting July 19, 2012 Goals Data History Current Work Demo.

S. Baggett, J. Anderson, K. S. Long, J. W. MacKenty, K. Noeske, J. Biretta, and the WFC3 team (STScI) WFC3 : Understanding and mitigating UVIS charge.

Memorandam of the discussion on FMOS observations and data kicked off by Ian Lewis Masayuki Akiyama 14 January 2004 FMOS Science Workshop.

Pipeline calibrations of ACS data Max Mutchler Hubble Space Telescope Calibration Workshop October 2005.

NGC 6217 in DSI mode with F658N Mosaic before new superbias why we don’t release images until after SMOV! ACS CCD monitoring and pipeline calibration review.

Background Estimation and Matching for Strip82 Coadds Yusra AlSayyad University of Washington DM Review September 6, 2012.

Distortion in the WFC Jay Anderson Rice University

Dec 2, 2014 Hubble Legacy Archive and Hubble Source Catalog Rick White & Brad Whitmore Current teams: HLA: Michael Dulude, Mark Kyprianou, Steve Lubow,

Cosmic Ray + Bright Stars Masking S. Desai E. Bertin J. Mohr H. Lin DES Algorithms meeting.

“CLASH”: A Multi-Cycle Treasury Program to Study the Dark Universe Marc Postman Space Telescope Users Committee November 2, 2010 MACS z = 0.57.

Graphic material for HSC FAQ – March 23, Five things you should know about the Hubble Source Catalog (HSC) 1. Coverage can be very non-uniform,

Detection of H-alpha emission from z>3.5 galaxies with AKARI-FUHYU NIR spectroscopy Chris Sedgwick Stephen Serjeant Chris Pearson The Open University on.

+ AstroDrizzle Products for HST & JWST 2014 STScI Calibration Workshop Jennifer Mack, STScI.

Full strength of (weak) Cluster lensing Advisors: Tom Broadhurst, Yoel Rephaeli Collaborators: Keiichi Umetsu, Narciso Benitez, Dan Coe, Holland Ford,

DC2 Post-Mortem/DC3 Scoping February 5 - 6, 2008 DC3 Goals and Objectives Jeff Kantor DM System Manager Tim Axelrod DM System Scientist.

ACS Drizzling Overview J. Mack; DA Training 10/5/07 Distortion Dither Strategies MultiDrizzle ‘Fine-tuning’ Data Quality Photometry.

The Planet Pipeline (and Citizen Science) Data curation and mining of Solar System images from WFPC2 Hubble Cycle 18 Legacy Archival Research proposal.

Wide-Field Slitless Spectr scopy with NIRISS Van Dixon STScI TIPS/JIM 2012 September 20.

Data products of GuoShouJing telescope(LAMOST) pipeline and current problems LUO LAMOST Workshop.

WFPC2 UPDATE TIPS : August 15, 2002 L.M. Lubin New WFPC2 Documentation 1.Cycle 12 Instrument Handbook (V7.0, Biretta et al.)  Updated information on the.

Welcome to the First CLASH Science Team Meeting September 20 – 21, 2010 Granada, Spain.

Search for High- Redshift Galaxies Wei Zheng Johns Hopkins University.

The Quest for Ultra compact dwarfs (UCDs) Guillermo, Melanie, Emanuela, Micaela Tutor: Steffen Mieske Guillermo, Melanie, Emanuela, Micaela Tutor: Steffen.

Data Analysis Software Development Hisanori Furusawa ADC, NAOJ For HSC analysis software team 1.

Welcome! CLASH Science Team Meeting Heidelberg, Germany Oct 17 – 19, 2011.

ACS/WFC CTE correction for point source photometry Marco Chiaberge ACS Team STScI.

The Hubble Space Telescope explores the limits of “roundness”: Ceres and Vesta Max Mutchler (Space Telescope Science Institute), Lucy McFadden, Jian-Yang.

Modeling and Correcting the Time- Dependent ACS PSF for Weak Lensing Jason Rhodes, JPL With: Justin Albert (Caltech) Richard Massey (Caltech) HST Calibration.

Photometric Redshifts in Astro-Wise PhotRedCatalog Astro-Wise Workshop Leiden 2008 Jan Snigula, MPE.

CLASH/HST photoz estimation: the challenges & their quality Stephanie Jouvel, Ofer Lahav, Ole Host.

From photons to catalogs. Cosmological survey in visible/near IR light using 4 complementary techniques to characterize dark energy: I. Cluster Counts.

Overall ArchitectureOverall Architecture Use of AssociationsUse of Associations Outline of ProcessingOutline of Processing Reuse of CALACS and CALNIC CodeReuse.

Overall ArchitectureOverall Architecture Outline of ProcessingOutline of Processing Reuse of CALACS and CALNIC CodeReuse of CALACS and CALNIC Code Processing.

HLA WFPC2 Source List Photometric Quality Checks Version: August 25, 2008 Brad Whitmore 1.Introduction 2.Comparison with Ground-based Stetson Photometry.

Difference Image Analysis at OAC Groningen, 1st Dec 2004 AW-OAC team.

IPHAS Early Data Release E. A. Gonzalez-Solares IPHAS Consortium AstroGrid National Astronomy Meeting, 2007.

The First Galaxies in the Hubble Frontier Fields Rachana Bhatawdekar, Christopher Conselice The University of Nottingham.

The First Galaxies in the Hubble Frontier Fields Rachana Bhatawdekar, Christopher Conselice The University of Nottingham.

July 21, 2004 Natalia Kuznetsova NICMOS Analysis of ACS ● Data Inventory ● Calibration ● Bad pixel mask ● Extracting photometry ● Next steps 1.

Selection and Characterization of Interesting Grism Spectra Gerhardt R. Meurer The Johns Hopkins University Gerhardt R. Meurer The Johns Hopkins University.

WFC3 slitless spectroscopy

Faculty meeting - 13 Dec 2006 The Hubble Legacy Archive Harald Kuntschner & ST-ECF staff 13 December 2006.

SMOVSMOV  ACS has now completed SMOV Program –Transitioned to interim calibration plan  Final SMOV programs –Further coronagraph calibration –Coronagraph.

STScI TIPS, 15 January 2004MultiDrizzle Overview - Anton Koekemoer1 MultiDrizzle Status and Development Overview Anton Koekemoer, ACS+WFPC2 Branch Project.

Ariel Bowers (Baltimore Polytechnic Institute) Max Mutchler (Space Telescope Science Institute) Version 21 Dec 2007 Hubble imaging of the Carina Nebula.

Improved ACS Geometrical Distortion Correction Richard Hook TIPS Meeting, STScI, 18th December 2003.

WFC3 SMOV UVIS and IR Geometric Distortion Calibration and Multidrizzle Vera Kozhurina-Platais and WFC3 team.

Team Discussion: CLASH DATA RELEASE PLAN September 2013 London.

Validation of HLA Source Lists Feb. 4, 2008 Brad Whitmore 1.Overview 2.Plots 3.Summary.

SINFONI data reduction using the ESO pipeline. Instrument design and its impact on the data (I) integral field spectrometer using mirrors brickwall pattern.

The Hubble Legacy Archive (HLA) Slitless Spectroscopy Project

JWST Pipeline Overview

The art of imaging with Hubble

A galaxy at redshift 10? Brigitta Eder Vera Könyves

Imaging data obtained with the

Lecture 10 Image sharpening.

An Investigation of Densities of Transit Detected Exoplanets

The Image The pixels in the image The mask The resulting image 255 X

Presentation transcript:

Data Pipeline Wei Zheng Johns Hopkins University

Requirements Science images for ACS/WFC, WFC3/UVIS and WFC3/IR Detection image over all bands Filter Images with a common WCS grid Source catalogs Photometric redshift catalogs September 20, 2010Granada

APSIS Image registration Sky subtraction Distortion correction Cosmic ray rejection Edge mask Astrometric correction Detection image September 20, 2010Granada Extinction correction Extractor source catalogs Multicolor catalog BPZ catalog

Modification ACEX: ACS image drizzling WFEX: WFC3 image (UVIS and IR) drizzling DREX: Register images of different passbands September 20, 2010Granada

Check data on CLASH central storage via fast-track ftp No All data present? Flowchart Yes WFC3 or ACS? Run ACEX Run WFEX ACS WFC3 Run ACEX Run WFEX Image Align Image Combine.felt files Image Align Image Combine Run DREX (0.065”) Master Detection Image Co-added images in native resolution Extractor Source Catalogs in each passband Multi-color catalog PHOTO-Z Code(s) Co-added images on common pixel grid PHOTO-Z Catalog CLASH Science Team Data Archive

Astrometric Accuracy September 20, 2010Granada WFEXWFC3RED

Pipeline Output: Images Detection Image (0.065” scale) Combined images in each band (0.065” scale) Combined UVIS and WFC images in original scale September 20, 2010Granada

Pipeline Output: Catalogs Running Sextractor Source catalogs in each band Multicolor catalog Photometric redshifts Mag_iso, mag_auto, and mag_aper at various sizes. September 20, 2010Granada

Processing Plan One run for every visit Accumulated data for each version Typically eight versions of processed data per cluster The final version has the best quality September 20, 2010Granada

Further improvements Slight alignment on drizzled images Flag and mask consolidation CTE correction for ACS Data server September 20, 2010Granada

Summary A working pipeline Need more in-depth comparisons and quality checks Need to accommodate new science requirements September 20, 2010Granada

Many Thanks! Amit Saraff John Blakeslee, Larry Bradley Warren Hack, Andy Fruchter September 20, 2010Granada