ADMIT: ALMA Data Mining Toolkit  Developed by University of Maryland, University of Illinois, and NRAO (PI: L. Mundy)  Goal: First-view science data.

Slides:



Advertisements
Similar presentations
Classification & Your Intranet: From Chaos to Control Susan Stearns Inmagic, Inc. E-Libraries E204 May, 2003.
Advertisements

JobTracker™ A Job Tracking System for Architects & Engineers Produced by LA Solutions.
Test Case Management and Results Tracking System October 2008 D E L I V E R I N G Q U A L I T Y (Short Version)
CAPTURE SOFTWARE Please take a few moments to review the following slides. Please take a few moments to review the following slides. The filing of documents.
CAPTURE SOFTWARE Please take a few moments to review the following slides. Please take a few moments to review the following slides. The filing of documents.
Data Analysis Plan GBT IDL Workshop October 15, 2004.
JWST IFUs and Data Tool Development Plans Tracy Beck JWST NIRSpec Instrument Scientist.
ISI Web of Knowledge Update July New features ISI Web of Knowledge new features: Address searching on the All Databases screen Sort All Databases.
NOAO/Gemini Data workshop – Tucson,  Hosted by CADC in Victoria, Canada.  Released September 2004  Gemini North data from May 2000  Gemini.
FASR-A 6 Gb/s x 2 x GB/s 400 GB/day 50 GB/day ~1 GB/day X xxx FASR Data Analysis Plan 22-May-2005 Simplified Data Pipeline.
Components and Architecture CS 543 – Data Warehousing.
Diffusion Tensor Imaging (DTI) is becoming a routine technique to study white matter properties and alterations of fiber integrity due to pathology. The.
Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array.
Introduction to eValid Presentation Outline What is eValid? About eValid, Inc. eValid Features System Architecture eValid Functional Design Script Log.
November 2011 At A Glance GREAT is a flexible & highly portable set of mission operations analysis tools that increases the operational value of ground.
Selenium – Testing Tool. What is Selenium? Selenium is a robust set of tools that supports rapid development of test automation for web-based applications.
Sourcing Event Tool Kit Solicitation Archiving User Guide.
SQL Server Reporting Services
PopMedNet Software Development Life Cycle Chayim Herzig-Marx Harvard Pilgrim Health Care Institute Daniel Dee Lincoln Peak Partners.
Xpantrac connection with IDEAL Sloane Neidig, Samantha Johnson, David Cabrera, Erika Hoffman CS /6/2014.
With Internet Explorer 9 Getting Started© 2013 Pearson Education, Inc. Publishing as Prentice Hall1 Exploring the World Wide Web with Internet Explorer.
In-Line Cell Manager Configuration and Loading Date: Octobre2014.
From Baan and ERP Ln to Excel, Word, PDF, HTML, XML & Notepad in one click! B2Win 6.6.
Danielle Baldwin, ITS Web Services CMS Administrator Application Overview and Joomla 1.5 RC 1 Highlights.
KPI Business Pack Christa Fine Sr. Product Manager, Information Delivery.
11 Chapter 3: Getting Started with Tasks 3.1 Introduction to Tasks and Wizards 3.2 Creating a Frequency Report 3.3 Generating HTML, PDF, and RTF Output.
Tim Leung SQL Bits October  Features and Advantages  Architecture  Installation  Creating Reports.
1 The Problem Do you have: A legacy ABL system with millions of Lines of ABL Code? Years and years of modifications to your ABL code? System documentation.
Fall, Privacy&Security - Virginia Tech – Computer Science Click to edit Master title style Design Extensions to Google+ CS6204 Privacy and Security.
1998 PI System Users’ Conference PI on the Web: A Primer for PI Users Omicron Consulting 1998 PI System Users’ Conference.
Siemens Power Generation, Instrumentation &Controls
1 ANASAC Meeting – May 20, 2015 ALMA Pipeline Brian Glendenning (for Jeff Kern)
McMullinEVLA Advisory Committee Meeting December 14-15, 2004 EVLA Data Post-processing: SSG (AIPS++/CASA) Development J. McMullin.
WebFOCUS InfoAssist Demonstration
Virtual Ice Charting System Archive Browser Interface Distribution IngestProduction Ice Analyst Application Database Click on the boxes for more information.
SunGuide® Software Development Project Release 4.3 Express Lanes Enhancements Design Review December 15, 2009 December 15, 20091R4.3 Design Review.
CPSC1301 Computer Science 1 Overview of Dr. Java.
From Baan and ERP Ln to Excel, Word, PDF, HTML, XML & Notepad in one click! B2Win 7.
Tutorial 7 Working with Multimedia. New Perspectives on HTML, XHTML, and XML, Comprehensive, 3rd Edition 2 Objectives Explore various multimedia applications.
Historic Digimap service Ancient Roam Screen share Historic Download Questions Historic Digimap.
06-1L Suzaku Suzaku UG - 13 Dec, 2007 Suzaku processing and archive Lorella Angelini/HEASARC.
SOFTWARE TOOLS FOR DATA QUALITY ANALYSIS The Science Data Analysis Tool (SDAT) is the primary tool used by the DQA team. SDAT can access all raw and processed.
Archive Access Tool Review of SSS Readiness for EVLA Shared Risk Observing, June 5, 2009 John Benson Scientist.
SSC SI Data Processing Pipeline Plans Tom Stephens USRA Information Systems Development Manager SSSC Meeting – Sept 29, 2009.
Elliott Links Edward M. Kwang President. Elliott Notes, Attributes & Links Notes & Attributes –Expand Elliott database without modification –They are.
1 KFPA Critical Design Review – Fri., Jan. 30, 2009 KFPA Data Pipeline Bob Garwood- NRAO-CV.
Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array Data Processing Progress.
March 2004 At A Glance autoProducts is an automated flight dynamics product generation system. It provides a mission flight operations team with the capability.
1 ANASAC Meeting – May 20, 2015 Mark Lacy ALMA archive status and plans.
Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array The ALMA Observing.
VIRGINIA TECH BLACKSBURG CS 4624 MUSTAFA ALY & GASPER GULOTTA CLIENT: MOHAMED MAGDY IDEAL Pages.
ADMIT: ALMA Data Mining Toolkit  Developed by University of Maryland, University of Illinois, and NRAO (PI: L. Mundy)  Goal: First-view science data.
ASP. ASP is a powerful tool for making dynamic and interactive Web pages An ASP file can contain text, HTML tags and scripts. Scripts in an ASP file are.
ESO, 17 April 2007ESAC meeting1 ALMA offline User Test 5 Silvia Leurini, ESO.
EOVSA Pipeline Processing System J. McTiernan EOVSA Prototype Review 24-Sep-2012.
TROI – SPC Database Walkthrough Training Presentation Doc. USTP0213 Rev4.
Implementation Review1 Archive Ingest Redesign March 14, 2003.
The Earth Information Exchange. Portal Structure Portal Functions/Capabilities Portal Content ESIP Portal and Geospatial One-Stop ESIP Portal and NOAA.
THE ALMA ORION BAND 6 SCIENCE VERIFICATION DATA SPECTRAL LINE SURVEY - CONTENT AND DISCOVERY AVAILABLE FOR ALL SCIENCE Anthony J. Remijan ALMA Program.
EOVSA Data and Database System J. McTiernan EOVSA Technical DesignMeeting 7-Nov-2011.
Labcheck Next Generation Quick Start Guide Equipment Management.
New SPIRE features in HIPE 9.1 NHSC; Nov 28, 2012 PACS Page 1 What’s New in HIPE 9.1 ( SPIRE FTS) Nanyao Lu NHSC/IPAC (on behalf of the SPIRE ICC)
EVLA Data Processing PDR Pipeline design Tim Cornwell, NRAO.
IT Desktop Management GoToMeeting – Online Meeting Service Attendee Guide May 2007 Prepared by Angela Mars IT Education and Training.
Maintaining and Updating Windows Server 2008 Lesson 8.
Visualizing data from Galaxy
SNS Integrated Control System ORACLE –JERI DB Generation April 27, 2004 Coles Sibley Jeff Patton.
Active HTML Rediscovered
Tips on Online Help Tharun Unni.
Producing Conservation Business Plans from Miradi
Presentation transcript:

ADMIT: ALMA Data Mining Toolkit  Developed by University of Maryland, University of Illinois, and NRAO (PI: L. Mundy)  Goal: First-view science data products into archive: spectra, line ID, moment maps, etc  Goal: Python Toolkit allows user to generate their own science products from cubes. Identification of common lines Moment maps for lines Moment 0 Moment 1 Moment 2 Example Spectrum for line ID ADMIT Products shown from automated flow Galaxy NGC 253

ADMIT  Operates on data cubes only; cubes can be FITS or casa image format  Compatible with CASA environment and utilizes CASA routines where possible  Products are self-documenting with XML; compatible with future ingestion by a database Moment 0 Serpens Main Mosaic Image Moment 1 Moment 2 C 34 S CS H2CO Spectra based on peak flux and noise in each channel Blue and green spectra highlight impact of missing flux Two spectra used in line ID of CS J=5-4 Each data cube get a full set of products See: admit.astro.umd.edu/admit-M4 and click on and xxx.admit directory

ADMIT Two modes of Operation: In-line (pipeline mode producing standard set of products): – ADMIT runs after QA2 and before archive ingestion (ideally as a pre-step to the archive ingest process) – details being worked with ALMA Project – ALMA archive user can select to download ADMIT tarball (20-40Mb) XML, PNG, and HTML files; limited FITS files – details to be decided with ALMA Project – Browser-based viewer allows user inspect products once downloaded – ADMIT summary XML file allows user to recreate the ADMIT products Off-line (user created data products): – The ADMIT Toolkit “add-on” available from the CASA download page – Flow-model for creating and re-creating products - viewable in the browser – Environment for expanded exploration of data sets: Principle component analysis of emission Overlap integrals Comparisons across multiple windows and multiple sources New tools for examining large data cubes ASAC 2015 October3

ADMIT  Automated line ID which allows line-based operations: moment maps, PV slices, etc  Pipeline produces set products for users which can be determine by ALMA  Users can create their own custom products locally, which can be applied across sources Moment 0 Line for P-V slice Spectrum: peak emission over noise per channel Velocity Position along line Position-Velocity Slice Conservative automated line ID: do no bad ID 4

ADMIT Timeline for Science users: November 2015: Requested start date for testing of Cycle 3 data from imaging pipeline at ARCS. – Needed for robustness testing against operational products in April 2016 – Allows interaction with interested scientists to verify/improve products TBD: Deployment of ADMIT pipeline within ALMA to create products for archive ingestion. – Date and final design to be decided in discussion with the ALMA project May : Delivery of completed software system – End of funded ALMA Development Project is April 30, 2016 – Contract requires delivery of all software and documentation – Options for continued support will be explored with ALMA/NRAO ASAC 2015October5