Nicolas Rothbacher University of Puget Sound

Slides:



Advertisements
Similar presentations
RECOVERING HARDWARE INJECTIONS IN LIGO S5 DATA Ashley Disbrow Carnegie Mellon University Roy Williams, Michele Vallisneri, Jonah Kanner LIGO SURF 2013.
Advertisements

LIGO-G v2 Recovering Burst Injections in LIGO S5 Data Alex Cole Data Analysis Meeting May 6, 2014.
INTRODUCTION TO ASP.NET MVC AND EXAMPLE WALKTHROUGH RAJAT ARYA EFECS - OIM DAWG – 4/21/2009 ASP.NET MVC.
Development of a Web-based, Multimedia Database for Collection, Organization and Analysis of Biomedical Signals M.S.C.S. Problem Report Defense Lan Guo.
LIGO Reduced Data Sets E7 standard reduced data set RDS generation for future runs decimation examples LIGO-G Z Isabel Leonor (w/ Robert Schofield)
LHCbPR V2 Sasha Mazurov, Amine Ben Hammou, Ben Couturier 5th LHCb Computing Workshop
Direct Congress Dan Skorupski Dan Vingo. Inner workings Reminder: MVC design pattern Procedural view: From request to response o Request passed to a view.
GLAST LAT ProjectOnline Peer Review – July 21, Integration and Test L. Miller 1 GLAST Large Area Telescope: I&T Integration Readiness Review.
Operational Dataset Update Functionality Included in the NCAR Research Data Archive Management System 1 Zaihua Ji Doug Schuster Steven Worley Computational.
1 Archive-It Training University of Maryland July 12, 2007.
Microsoft SharePoint 2010 Upgrade Preview FSU SharePoint Users Group Presents: Thursday, December 1 st, 2011.
1 Spidering the Web in Python CSC 161: The Art of Programming Prof. Henry Kautz 11/23/2009.
Ori Calvo, 2010 “If people want to have maximum reach across *all* devices then HTML will provide the broadest reach” Scott Guthrie,
INTRODUCTION TO DHTML. TOPICS TO BE DISCUSSED……….  Introduction Introduction  UsesUses  ComponentsComponents  Difference between HTML and DHTMLDifference.
M. Taimoor Khan * Java Server Pages (JSP) is a server-side programming technology that enables the creation of dynamic,
RMG Study Group Session I: Git, Sphinx, webRMG Connie Gao 9/20/
LIGO-G Z Coherent Coincident Analysis of LIGO Burst Candidates Laura Cadonati Massachusetts Institute of Technology LIGO Scientific Collaboration.
CFT Offline Monitoring Michael Friedman. Contents Procedure  About the executable  Notes on how to run Results  What output there is and how to access.
Selecting and Combining Tools F. Duveau 02/03/12 F. Duveau 02/03/12 Chapter 14.
Server-side Scripting Powering the webs favourite services.
NODEJS, THE JOOMLA FRAMEWORK, AND THE FUTURE IAN MACLENNAN.
Rsv-control Marco Mambelli – Site Coordination meeting October 1, 2009.
ISpheres Project. Project Overview iSpheresCore iSpheresImage Demonstration References.
Magnetic Field Measurement System as Part of a Software Family Jerzy M. Nogiec Joe DiMarco Fermilab.
Support.ebsco.com Basic Searching for K-12 School Libraries Tutorial.
Acknowledgements The work presented in this poster was carried out within the LIGO Scientific Collaboration (LSC). The methods and results presented here.
Tracker data quality monitoring based on event display M.S. Mennea – G. Zito University & INFN Bari - Italy.
Characterization of Hardware Injections in LIGO Data
Mar. 13 th, 2014 Geant4 Physicslist and Validation Working Group Meeting 1 Hans Wenzel Mar 13 th 2014 Physics validation display Webapplication.
Calibration in the Front End Controls Craig Cahillane LIGO Caltech SURF 2013 Mentors: Alan Weinstein, Jamie Rollins Presentation to Calibration Group 8/21/2013.
Web Design and Development. World Wide Web  World Wide Web (WWW or W3), collection of globally distributed text and multimedia documents and files 
TSS Database Inventory. CIRA has… Received and imported the 2002 and 2018 modeling data Decided to initially store only IMPROVE site-specific data Decided.
MODELING THE CALIBRATED RESPONSE OF THE ADVANCED LIGO DETECTORS Luke Burks 2013 LIGO Caltech SURF Mentors: Alan Weinstein, Jameson Rollins Final Presentation.
Introduction and Principles Web Server Scripting.
What is Firefly (1) A web UI framework for web applications
LIGO-G Z Confidence Test for Waveform Consistency of LIGO Burst Candidate Events Laura Cadonati LIGO Laboratory Massachusetts Institute of Technology.
Oct HPS Collaboration Meeting Jeremy McCormick (SLAC) HPS Web 2.0 OR Web Apps and Databases (Oh My!) Jeremy McCormick (SLAC)
Oct. 16 th, 2013 Geant4 hadronic Meeting 1 Hans Wenzel Oct 16 th 2013 Status of physics validation tool.
LIGO-G v1 Searching for Gravitational Waves from the Coalescence of High Mass Black Hole Binaries 2014 LIGO SURF Summer Seminar August 21 st, 2014.
WebScan: Implementing QueryServer 2.0 Karl Geiger, Amgen Inc. BRS NA UG August 1999.
Simulation Production System Science Advisory Committee Meeting UW-Madison March 1 st -2 nd 2007 Juan Carlos Díaz Vélez.
General Architecture of Retrieval Systems 1Adrienn Skrop.
The Anatomy of a Large-Scale Hypertextual Web Search Engine (The creation of Google)
LIGO-G Z The Q Pipeline search for gravitational-wave bursts with LIGO Shourov K. Chatterji for the LIGO Scientific Collaboration APS Meeting.
Arklio Studija 2007 File: / / Page 1 Automated web application testing using Selenium
THIS MORNING (Start an) informal discussion to -Clearly identify all open issues, categorize them and build an action plan -Possibly identify (new) contributing.
Calibration in the Front End Controls Craig Cahillane Luke Burks LIGO Caltech SURF 2013 Mentors: Alan Weinstein, Jamie Rollins Presentation to Calibration.
SOFTWARE TESTING TRAINING TOOLS SUPPORT FOR SOFTWARE TESTING Chapter 6 immaculateres 1.
Gridpp37 – 31/08/2016 George Ryall David Meredith
Magento Development Company
Simulation Production System
Cruz Roja Tijuana Final Presentation.
Athanasios Topaloudis 3rd Forum 15/02/2017
Project Objectives Publish to a remote server
z/Ware 2.0 Technical Overview
The Use of AMET and Automated Scripts for Model Evaluation
LCG Generator Services project
LIGO Scientific Collaboration meeting
Lesson 11: Web Services & API's
Accessing Spatial Information from MaineDOT
Applied Software Implementation & Testing
A Brief Introduction to the Internet
Chapter 23 – ASP.NET Outline 23.1 Introduction NET Overview
Operational Dataset Update Functionality Included in the NCAR Research Data Archive Management System Zaihua Ji Doug Schuster Steven Worley Computational.
S2 Inspiral Hardware Injections
Objective Understand web-based digital media production methods, software, and hardware. Course Weight : 10%
Coherent Coincident Analysis of LIGO Burst Candidates
Simulating the Advanced LIGO Interferometer Using the Real Control Code Juan F. Castillo.
SharePoint Foundation 2010
OPeNDAP/Hyrax Interfaces
Presentation transcript:

Extending a Plotting Application and Finding Hardware Injections for the LIGO Open Science Center Nicolas Rothbacher University of Puget Sound Mentors: Eric Fries, Jonah Kanner, Alan Weinstein LIGO Laboratory

Outline: Two Projects Introduction to the LIGO Open Science Center Extending an online plotting application Searching for hardware injections in O1 data LIGO Laboratory

The LIGO Open Science Center Publicly accessible data repository Bulk strain data and documentation S5 and S6 datasets Data around events Variety of analysis tools Python tutorials Timelines Quickview O1 dataset to be released Full documentation necessary All of this at losc.ligo.org LIGO Laboratory

The Online Plotting Application splot – instantly generates plots from web form Input Output Static images Cumbersome for data examination Stored on server statically Releasing for public problematic Web form HTTP POST Python data processing Plot Images https://losc-dev.ligo.org/splot/s6/ https://losc-dev.ligo.org/s/splot/ff8cbd0754b1bedb885f9d7db55fcd.html Redirect Random output link New plot LIGO Laboratory

Plotly.js Open source JavaScript library Rich Interactivity Box to zoom Pan, select, hover to show data Download plots to disk as png Plot types needed built in Heatmap Linked scatter plot Image source: plot.ly website LIGO Laboratory

Bringing it all together Finished product uses one URL splot on losc-scratch Plotly library enables interactive use Box zoom most relevant feature Web framework links form to plots without disk use JavaScript links plots on the front end Working version here: https://losc-scratch.ligo.caltech.edu/splot/ Hope to release to public soon. https://losc-scratch.ligo.caltech.edu/splot/ LIGO Laboratory

What are hardware injections? Simulated signals injected using control actuators Mirrors moved to same strain as real GWs Injections used for testing Detector characterization Search pipelines CBC Burst Stochastic O1 LOSC release HWI need record LIGO Laboratory

FINDCHIRP: A Matched Filter Searches for signal based on template Filter output is un-normalized SNR Applies the filter independently of time Works in the frequency domain Normalization factor function of template and noise Source: Allen, et. al. 2011 LIGO Laboratory

State of Hardware Injection Documentation Documentation spread over multiple sources Wiki pages aLogs Hardware injection schedules Documentation must be collected for public release Information on each injection necessary to avoid confusion LIGO Laboratory

Matched Filter Results Schedule file used for input Determined to be most complete documentation Burst and CBC injections scanned Detchar and stochastic injections still need recovery Small majority of injections failed to reach data 20% occurred with the detector not recording data 34% had less than 6 SNR recovered Successful injections recovered at close to 1 to 1 Table created with results and injection parameters LIGO Laboratory

Match Filter Results LIGO Laboratory These look good! These probably did not succeed… LIGO Laboratory

Next steps for HW Injections Clean up edge cases Verify that low recovery injections failed Validate injection catalog resources Missing parameter files Search over injections from other groups Check results against injection channels Stream of data used for injections – must be complete Could contain undiscovered injections Generalize code for use on future science runs LIGO Laboratory

Acknowledgements My mentors: Eric Fries, Jonah Kanner and Alan Weinstein Mykyta Hulko and The SURF Pen The Hardware Injection team LIGO SURF Program LIGO Laboratory Caltech NSF LIGO Laboratory

References https://losc.ligo.org https://plot.ly/javascript/ https://plot.ly/~fowler.brady/41/decibels-and-decimals-spotify-related-artists/#plot https://docs.djangoproject.com/en/1.9/ https://arxiv.org/abs/gr-qc/0509116 LIGO Laboratory

The Python web framework: Django Full stack Python web framework Makes web programming accessible to Python coder Unifies Python in backend with HTML views URLs parsed to call Python methods Data passed between backend and HTML as Python objects splot written in Python, easily adaptable User’s link urls.py HTML form Python module HTML template LIGO Laboratory

Future work on splot Expand education opportunities Further description of plots and processing Elaborate hardware injection information Prepare for public release Strengthen error checking Prep for O1 dataset release Implement other plots or more interactive resources? Active parameter changes? Real time data analysis? LIGO Laboratory