EUDAQ Status Report Emlyn Corrin, 29 September 2010

Slides:



Advertisements
Similar presentations
GCT Software Jim Brooke GCT ESR, 7 th November 2006.
Advertisements

David Notkin Autumn 2009 CSE303 Lecture 22 Subversion is an open source version control system. Social Implications Friday version control system.
What's New in the CVS-EEP Entry Tool This document points out some the new features and improvements we've made in recent versions. version by Michael.
Low level CASE: Source Code Management. Source Code Management  Also known as Configuration Management  Source Code Managers are tools that: –Archive.
Source Code Management Or Configuration Management: How I learned to Stop Worrying and Hate My Co-workers Less.
Maintaining and Updating Windows Server 2008
Source Control Repositories for Enabling Team Working Svetlin Nakov Telerik Corporation
Desktop Security: Worms and Viruses Brian Arkills, C&C NDC-Sysmgt.
Version Control with Subversion. What is Version Control Good For? Maintaining project/file history - so you don’t have to worry about it Managing collaboration.
Subversion. What is Subversion? A Version Control System A successor to CVS and SourceSafe Essentially gives you a tracked, shared file system.
Sumedha Rubasinghe October,2009 Introduction to Programming Tools.
Emlyn Corrin, DPNC, University of Geneva EUDAQ Status of the EUDET JRA1 DAQ software Emlyn Corrin, University of Geneva 1.
Introduction to Hall-D Software February 27, 2009 David Lawrence - JLab.
Designing For Testability. Incorporate design features that facilitate testing Include features to: –Support test automation at all levels (unit, integration,
Subversion (SVN) Tutorial for CS421 Dan Fleck Spring 2010.
Version control Using Git Version control, using Git1.
Object-Oriented Analysis & Design Subversion. Contents  Configuration management  The repository  Versioning  Tags  Branches  Subversion 2.
Computer Science and Engineering The Ohio State University  Widely used, especially in the opensource community, to track all changes to a project and.
Introduction Advantages/ disadvantages Code examples Speed Summary Running on the AOD Analysis Platforms 1/11/2007 Andrew Mehta.
Jan Hatje, DESY CSS GSI Feb. 2009: Alarm System, Authorization, Remote Management XFEL The European X-Ray Laser Project X-Ray Free-Electron.
T Project Review Sotanorsu I3 Iteration
DEPARTEMENT DE PHYSIQUE NUCLEAIRE ET CORPUSCULAIRE JRA1 Parallel - DAQ Status, Emlyn Corrin, 8 Oct 2007 EUDET Annual Meeting, Palaiseau, Paris DAQ Status.
DEPARTEMENT DE PHYSIQUE NUCLEAIRE ET CORPUSCULAIRE JRA1 DAQ Status Daniel Haas DPNC Genève Status DAQ board INFN Strasbourg DAQ boards TLU Bristol Software.
DEPARTEMENT DE PHYSIQUE NUCLEAIRE ET CORPUSCULAIRE JRA1 - Data Acquisition Status Report Daniel Haas DPNC Genève Extended SC Meeting 1 Sep 2008.
L.T.E :: Learning Through Experimenting Using google-svn for MtM Docs Development Denis Thibault Version 3.2 Mar 12 th, 2009.
MICE CM28 Oct 2010Jean-Sebastien GraulichSlide 1 Detector DAQ o Achievements Since CM27 o DAQ Upgrade o CAM/DAQ integration o Online Software o Trigger.
David Cussans, 18 th October 2006 JRA1 Beam Telescope DAQ and Trigger.
TDAQ Experience in the BNL Liquid Argon Calorimeter Test Facility Denis Oliveira Damazio (BNL), George Redlinger (BNL).
Version Control and SVN ECE 297. Why Do We Need Version Control?
SPI NIGHTLIES Alex Hodgkins. SPI nightlies  Build and test various software projects each night  Provide a nightlies summary page that displays all.
TELL1 command line tools Guido Haefeli EPFL, Lausanne Tutorial for TELL1 users : 25.February
October Test Beam DAQ. Framework sketch Only DAQs subprograms works during spills Each subprogram produces an output each spill Each dependant subprogram.
DEPARTEMENT DE PHYSIQUE NUCLEAIRE ET CORPUSCULAIRE FACULTÉ DES SCIENCES UNIVERSITÉ DE GENÈVE EUDET JRA1 Meeting Munich October 2006 DAQ Status Emlyn Corrin.
Subversion (SVN) Tutorial for CS421 Dan Fleck Spring 2010.
DEPARTEMENT DE PHYSIQUE NUCLEAIRE ET CORPUSCULAIRE JRA1 DAQ Emlyn Corrin.
BE-com.eu Brussel, 26 april 2016 EXCHANGE 2010 HYBRID (IN THE EXCHANGE 2016 WORLD)
Fermilab Scientific Computing Division Fermi National Accelerator Laboratory, Batavia, Illinois, USA. Off-the-Shelf Hardware and Software DAQ Performance.
Anjana & Shankar September,2010 Introduction to Programming Tools.
Emdeon Office Batch Management Services This document provides detailed information on Batch Import Services and other Batch features.
Troubleshooting Directories and Files Debugging
THIS MORNING (Start an) informal discussion to -Clearly identify all open issues, categorize them and build an action plan -Possibly identify (new) contributing.
SOFTWARE TESTING TRAINING TOOLS SUPPORT FOR SOFTWARE TESTING Chapter 6 immaculateres 1.
SQL Database Management
Architecture Review 10/11/2004
Welcome POS Synchronize Concept 08 Sept 2015.
Compatible with the latest browsers; Chrome, Safari, Firefox, Opera and Internet Explorer 9 and above.
Information Systems and Network Engineering Laboratory II
Unit Testing.
Subversion Reasons to use How it works Subversion important commands
Getting Started with R.
Chapter 2: System Structures
Jonathan W. Duggins; James Blum NC State University; UNC Wilmington
LCGAA nightlies infrastructure
Remaining Online SW Tasks
Concurrent Version Control
PIC + TransNet.
AIDA (mini) Trigger/Timing Logic Unit (mini TLU)
Quick Guide for Offline Reports
Online Software “To Do” List
Printer Admin Print Job Manager
slides borrowed and adapted from Alex Mariakis and CSE 390a
JENKINS TIPS Ideas for making your life with Jenkins easier
Testing, debugging, and using support libraries
Diagnostics Analytical 920 LC Semi-Prep 940 LC
EXAMINE THE CHANGES.
Chapter 2: Operating-System Structures
CS 240 – Advanced Programming Concepts
The Troubleshooting theory
Chapter 2: Operating-System Structures
Presentation transcript:

EUDAQ Status Report Emlyn Corrin, 29 September 2010 Emlyn Corrin, EUDET Annual Meeting, Hamburg, 29 Sept 2010 EUDAQ Status Report Emlyn Corrin, 29 September 2010 Recent Improvements Future of EUDAQ Summary Some Statistics

Recent Improvements Future of EUDAQ Summary Code Statistics Emlyn Corrin, EUDET Annual Meeting, Hamburg, 29 Sept 2010 Recent Improvements Log Message Sorting Run Control Status Display Stability TLU Synchronization User Manual Future of EUDAQ Summary Code Statistics

Emlyn Corrin, EUDET Annual Meeting, Hamburg, 29 Sept 2010 Log Message Sorting Log message sorting was by time sent, needing all clocks to be well synchronised Now sort by arrival time, not send time Also take date into account, so running over midnight does not loop around Double-click a message to show more info

Run Control Status Display Emlyn Corrin, EUDET Annual Meeting, Hamburg, 29 Sept 2010 Run Control Status Display Run Control shows state of all Producers If re-configuring, there was no feedback (state did not change) Added new state (Wait) while configuring Also display state of all DUT connectors in TLU, helps debug when run hangs

Emlyn Corrin, EUDET Annual Meeting, Hamburg, 29 Sept 2010 Stability Early this season DAQ would crash at start of new run with ~50% probability Caused by resetting TLU timestamp counter at beginning of run Now back to state where it can be left to run unattended overnight (and have a reasonable expectation of some data in the morning) Still a few crashes, but seem to be due to hardware (fixed by reprogramming sensors)

Emlyn Corrin, EUDET Annual Meeting, Hamburg, 29 Sept 2010 TLU Synchronization TLU Handshake should protect against a DUT missing a trigger But it can happen that a DUT sees a spurious trigger (e.g. due to noise) Data files then get out of sync Tool written to correct this offline Either as a separate step Or during the conversion to LCIO

User Manual Finished (at last) early this year Emlyn Corrin, EUDET Annual Meeting, Hamburg, 29 Sept 2010 User Manual Finished (at last) early this year Recommended reading for anyone interested in EUDAQ EUDET Memo 2010-01 http://www.eudet.org/e26 /e28/e86887/e86890/ EUDET-Memo-2010-01.pdf

Recent Improvements Future of EUDAQ Summary Code Statistics Monitoring Emlyn Corrin, EUDET Annual Meeting, Hamburg, 29 Sept 2010 Recent Improvements Future of EUDAQ Monitoring JTAG Programming Sensors Data Collector Others Summary Code Statistics

Monitoring Separate histogramming from UI Emlyn Corrin, EUDET Annual Meeting, Hamburg, 29 Sept 2010 Monitoring Separate histogramming from UI One process receives a subset of data from Data Collector and generates histos Separate process(es) can connect and display the histograms Plugin-like mechanism for adding new plots

JTAG Programming Currently in a completely separate GUI Emlyn Corrin, EUDET Annual Meeting, Hamburg, 29 Sept 2010 JTAG Programming Currently in a completely separate GUI JTAG settings are not stored in the run Should implement a process that listens to Run Control for the config command Wouldn’t need separate VNC window for configuring sensors JTAG configuration would then be stored in each run

Emlyn Corrin, EUDET Annual Meeting, Hamburg, 29 Sept 2010 Data Collector Currently just blindly takes all events in the order they arrive without looking at them Can get desynchronised At end of run some producers can have extra events remaining in the buffer Should at least check for errors Could also fix the most obvious problems At least combine the EOREs properly

Others Configure script Testing framework Emlyn Corrin, EUDET Annual Meeting, Hamburg, 29 Sept 2010 Others Configure script Installation currently requires some manual editing of Makefiles Testing framework Allow automated checking of the code Prevent regressions of bugs once fixed Distributed version control (git/mercurial?) Explicit license terms (GPL?)

Recent Improvements Future of EUDAQ Summary Code Statistics Emlyn Corrin, EUDET Annual Meeting, Hamburg, 29 Sept 2010 Recent Improvements Future of EUDAQ Summary Code Statistics

Summary Limited new functionality Some improvements still needed Emlyn Corrin, EUDET Annual Meeting, Hamburg, 29 Sept 2010 Summary Limited new functionality Concentrated on Usability/Stability User Manual at last! Some improvements still needed Monitoring needs rewriting JTAG should be integrated into DAQ Data Collector could be more intelligent Configure script Automated testing framework?

Recent Improvements Future of EUDAQ Summary Code Statistics Emlyn Corrin, EUDET Annual Meeting, Hamburg, 29 Sept 2010 Recent Improvements Future of EUDAQ Summary Code Statistics

Emlyn Corrin, EUDET Annual Meeting, Hamburg, 29 Sept 2010 Code Statistics First checked in to subversion repository in Feb 2007 (~30 source files) Now more than 350 source files in trunk (containing > 30 kloc) More than 1000 revisions 6 Developers registered (+ more changes by email) Author Commits LOC corrin 775 45263 killenb 82 3933 phdgc 50 1448 renz 43 2132 dhaas 39 449 rubinsky 12 119 svn log https://svn.hepforge.org/eudaq --quiet | awk '/^r/ {print $3}' | sort | uniq -c | sort –r svn ls -R | grep -i -e "\.[ch][a-z]*$” | wc -l svn ls -R | grep -i -e "\.[ch][a-z]*$” | xargs svn blame | awk '{print $2}' | sort | uniq -c | sort –r

Real Development Starts Emlyn Corrin, EUDET Annual Meeting, Hamburg, 29 Sept 2010 Mimosa26 Integrated Towards Final System TLU v0.2 User Manual? Plug-in Mechanism Real Development Starts

Emlyn Corrin, EUDET Annual Meeting, Hamburg, 29 Sept 2010

Emlyn Corrin, EUDET Annual Meeting, Hamburg, 29 Sept 2010

Emlyn Corrin, EUDET Annual Meeting, Hamburg, 29 Sept 2010