Introduction Advantages/ disadvantages Code examples Speed Summary Running on the AOD Analysis Platforms 1/11/2007 Andrew Mehta.

Slides:



Advertisements
Similar presentations
Michigan State University 4/15/ Simulation for Level 2 James T. Linnemann Michigan State University NIU Triggering Workshop October 17, 1997.
Advertisements

TU/e Processor Design 5Z032 1 Processor Design 5Z032 The role of Performance Henk Corporaal Eindhoven University of Technology 2009.
Software Language Levels Machine Language (Binary) Assembly Language –Assembler converts Assembly into machine High Level Languages (C, Perl, Shell)
ATLAS Analysis Model. Introduction On Feb 11, 2008 the Analysis Model Forum published a report (D. Costanzo, I. Hinchliffe, S. Menke, ATL- GEN-INT )
1 Web Wizards Guide To PHP David Lash Chapter 1 Introduction to PHP.
Copyright © 1998 Wanda Kunkle Computer Organization 1 Chapter 2.1 Introduction.
Chapter 4 Assessing and Understanding Performance
Compilers and Interpreters. Translation to machine language Every high level language needs to be translated to machine code There are different ways.
1 Chapter 4. 2 Measure, Report, and Summarize Make intelligent choices See through the marketing hype Key to understanding underlying organizational motivation.
Regression testing Tor Stållhane. What is regression testing – 1 Regression testing is testing done to check that a system update does not re- introduce.
Instructions Slides 3,4,5 are general questions that you should be able to answer. Use slides 6-27 to answer the questions. Write your answers in a separate.
© Janice Regan, CMPT 128, Jan CMPT 128 Introduction to Computing Science for Engineering Students Creating a program.
Copyright © 2003 Pearson Education, Inc. Slide 1-1 Web Design & Development PHP.
Recent and Proposed Changes to ZOOM Recent entries Intended future additions Possibilities –D0 and CDF users can affect which new “possible” additions.
Systems Software & Operating systems
Topics Introduction Hardware and Software How Computers Store Data
Introduction and Overview Questions answered in this lecture: What is an operating system? How have operating systems evolved? Why study operating systems?
Copyright © 2012 Pearson Education, Inc. Chapter 1: Introduction to Computers and Programming 1.
Status of the Cuore software Marco Pallavicini Cuore Co-Software coordinator with M. Pavan (Milano) Università di Genova & INFN.
Algorithms and Programming
03/27/2003CHEP20031 Remote Operation of a Monte Carlo Production Farm Using Globus Dirk Hufnagel, Teela Pulliam, Thomas Allmendinger, Klaus Honscheid (Ohio.
Event View G. Watts (UW) O. Harris (UW). Philosophy EventView Goals Object Identification & Interpretation Is that a jet or an electron? Is that jet a.
Just as there are many human languages, there are many computer programming languages that can be used to develop software. Some are named after people,
Silberschatz, Galvin and Gagne  2002 Modified for CSCI 399, Royden, Operating System Concepts Operating Systems Lecture 7 OS System Structure.
1 CS/EE 362 Hardware Fundamentals Lecture 9 (Chapter 2: Hennessy and Patterson) Winter Quarter 1998 Chris Myers.
David Adams ATLAS DIAL status David Adams BNL November 21, 2002 ATLAS software meeting GRID session.
G53SEC 1 Reference Monitors Enforcement of Access Control.
Alexander Richards, UCL 1 Atlfast and RTT (plus DCube) Christmas Meeting 18/12/2007.
I Power Higher Computing Software Development Development Languages and Environments.
Unified scripts ● Currently they are composed of a main shell script and a few auxiliary ones that handle mostly the local differences. ● Local scripts.
ASP (Active Server Pages) by Bülent & Resul. Presentation Outline Introduction What is an ASP file? How does ASP work? What can ASP do? Differences Between.
Karsten Köneke October 22 nd 2007 Ganga User Experience 1/9 Outline: Introduction What are we trying to do? Problems What are the problems? Conclusions.
LHC Physics Analysis and Databases or: “How to discover the Higgs Boson inside a database” Maaike Limper.
Argonne Jamboree January 2010 Esteban Fullana AOD example analysis.
Introduction Selenium IDE is a Firefox extension that allows you to record, edit, and debug tests for HTML Easy record and playback Intelligent field selection.
Program Development Cycle
Operating Systems: Wrap-Up Questions answered in this lecture: What is an Operating System? Why are operating systems so interesting? What techniques can.
Integration of the ATLAS Tag Database with Data Management and Analysis Components Caitriana Nicholson University of Glasgow 3 rd September 2007 CHEP,
Efficient SAS programming with Large Data Aidan McDermott Computing Group, March 2007.
September 10 Performance Read 3.1 through 3.4 for Wednesday Only 3 classes before 1 st Exam!
Combined HEC/EMEC testbeam data can be read and analyzed within the ATLAS Athena framework A “cookbook” gives an introduction for how to access the data.
OSes: 2. Structs 1 Operating Systems v Objective –to give a (selective) overview of computer system architectures Certificate Program in Software Development.
SPI NIGHTLIES Alex Hodgkins. SPI nightlies  Build and test various software projects each night  Provide a nightlies summary page that displays all.
The single most important skill for a computer programmer is problem solving Problem solving means the ability to formulate problems, think creatively.
AliRoot survey: Analysis P.Hristov 11/06/2013. Are you involved in analysis activities?(85.1% Yes, 14.9% No) 2 Involved since 4.5±2.4 years Dedicated.
Copyright 2014 – Noah Mendelsohn Performance Analysis Tools Noah Mendelsohn Tufts University Web:
Software. Introduction n A computer can’t do anything without a program of instructions. n A program is a set of instructions a computer carries out.
Thomas Ruf, CERN EP Experience with C++ and ROOT used in the VX Beam Test Thomas Ruf, CERN, EP  Why? Event structure for VX-data rather complex: raw hits.
Wouter Verkerke, NIKHEF 1 Using ‘stoomboot’ for NIKHEF-ATLAS batch computing What is ‘stoomboot’ – Hardware –16 machines, each 2x quad-core Pentium = 128.
OCR A Level F453: The function and purpose of translators Translators a. describe the need for, and use of, translators to convert source code.
I/O aspects for parallel event processing frameworks Workshop on Concurrency in the many-Cores Era Peter van Gemmeren (Argonne/ATLAS)
ATLAS Physics Analysis Framework James R. Catmore Lancaster University.
Some of the utilities associated with the development of programs. These program development tools allow users to write and construct programs that the.
3rd April Richard Hawkings Analysis models in the top physics group  A few remarks …  What people are doing now  Where we are going - Top reconstruction.
Edexcel OnCourse Databases Unit 9. Edexcel OnCourse Database Structure Presentation Unit 9Slide 2 What is a Database? Databases are everywhere! Student.
Analysis Model Zhengyun You University of California Irvine Mu2e Computing Review March 5-6, 2015 Mu2e-doc-5227.
Starting Analysis with Athena (Esteban Fullana Torregrosa) Rik Yoshida High Energy Physics Division Argonne National Laboratory.
Mini-Workshop on multi-core joint project Peter van Gemmeren (ANL) I/O challenges for HEP applications on multi-core processors An ATLAS Perspective.
ATLAS Distributed Computing Tutorial Tags: What, Why, When, Where and How? Mike Kenyon University of Glasgow.
ANALYSIS TRAIN ON THE GRID Mihaela Gheata. AOD production train ◦ AOD production will be organized in a ‘train’ of tasks ◦ To maximize efficiency of full.
AOD example analysis Argonne Jamboree January 2010
Topic: Programming Languages and their Evolution + Intro to Scratch
September 2 Performance Read 3.1 through 3.4 for Tuesday
FileStager test results
Tree based validation tool for track reconstruction
Database Systems Unit 16.
Topics Introduction Hardware and Software How Computers Store Data
User feedback on SAN Alan Barr
Introduction to Athena
Programming language translators
Presentation transcript:

Introduction Advantages/ disadvantages Code examples Speed Summary Running on the AOD Analysis Platforms 1/11/2007 Andrew Mehta

Introduction: AOD is the basic data repository for physics analysis at ATLAS Analysis frameworks generally take information from the AOD and make a copy (e.g. Liverpool NTUPLE), or make some modifications (e.g. EVENTVIEW) and make a new NTUPLE Other possibility is to use AOD itself and run analyses directly on that Possible either by using `Analysis Tools’ within ATHENA or by direct ROOT access My aim is to produce code a la Liverpool NTUPLE for high Pt analyses with intelligent overlap removal and simple instructions for new users including working examples Next aim would be to set up a common framework to incorporate systematic errors, histogram managers etc. Would be great if we could all use same software. Probably only possible with direct AOD access

Running on AOD Code easily portable between different people even if they use different analysis models All the variables are always there. No need to remake NTUPLES if extra information needed Only one set of code. No separate NTUPLE production code and analysis code One format for all analyses. No multiple copies of same data with slightly different NTUPLE formats. Could save disk space in long run. Access to low level objects and reconstruction code much easier e.g. rerunning b tagging algorithms possible Particle masking to avoid double counting done non-persistently so easily adaptable if cuts change Code all written in c++ not in PYTHON/c++ mixture Advantages:

Running on AOD Disadvantages: Code needs to be run in ATHENA environment even in RootAccess mode Not very straight forward to set up code from scratch even following ‘help’ pages More disk space needed for the AOD than an NTUPLE dedicated to a specific analysis Each new class seems to require an abstract base class in which each function must be implemented Compile time rather slow 1.5 m In RootAccess mode a very long wait running PYTHON scripts to set up root Run time slower?

Find Electrons Get Good Electrons Make Mass User Code Z Mass:

Electrons on AOD Select electron categories Basic Code: e Selection

Steering: List of input AOD files Must list modules used in code Histogram output file Can change selection cuts without rerunning Change debug level

Speed Version 12 is supposed to be slow, but we can run jobs of 1M events in 30m CPU, 1h real time At Liverpool we seem to have slower real times for unknown reasons This presumably affects all analyses not just ATHENA Version 13 should be quicker still Can also speed jobs up even further with use of the TAG database Obviously for quick test jobs at present direct AOD access much slower than NTUPLE based analyses due to long compile and setup times

Summary Direct analysis on AOD has several advantages over derived NTUPLE code Some annoying teething problems at present, but none that means analysis can’t be done now Fast enough for most analyses at present if disk access problems overcome Future software versions should make this approach faster and more user friendly