Analysis Model Migration Plan Accessing the Mini Converting to the New (dual-read) Micro Producing the Skims Cleaning up the Tag Beta Development.

Slides:



Advertisements
Similar presentations
Web Trnsport Implementation TEA/TUG October 1-9, 2008 Saratoga Springs, NY.
Advertisements

P4 Tagging Software and MRR Data Model Preview John Tenney, Nicole Tancreto and Craig White Pacific States Marine Fisheries Commission A Presentation for.
22nd January 2003Tim Adye1 Summary of Bookkeeping discussions at RAL Workshop Tim Adye Rutherford Appleton Laboratory Kanga Phone Meeting 22 nd January.
BurrellesLuce MediaContent Portal Work Plan for Fall 2008 Doug Smith.
D. Düllmann - IT/DB LCG - POOL Project1 POOL Release Plan for 2003 Dirk Düllmann LCG Application Area Meeting, 5 th March 2003.
Engaging networks can help you to grow your online community Outreach top 10.
Status of analysis & MC farms 30/08/2002 Concezio Bozzi INFN Ferrara.
ATLAS Analysis Model. Introduction On Feb 11, 2008 the Analysis Model Forum published a report (D. Costanzo, I. Hinchliffe, S. Menke, ATL- GEN-INT )
Normalization of Database Tables
Introduction to Database Development. 2-2 Outline  Context for database development  Goals of database development  Phases of database development.
Data Migration Process
Implementation/Acceptance Testing / 1 Implementation and Acceptance Testing Physical Implementation Criteria: 1. Data availability 2. Data reliability.
MultiJob PanDA Pilot Oleynik Danila 28/05/2015. Overview Initial PanDA pilot concept & HPC Motivation PanDA Pilot workflow at nutshell MultiJob Pilot.
10 March Setup Users. 10 March Setup Users Window Allows you to perform several user tasks –Enroll users –Enable/disable users –Set user access.
Hands-On Microsoft Windows Server 2008 Chapter 5 Configuring, Managing, and Troubleshooting Resource Access.
Database System Development Lifecycle © Pearson Education Limited 1995, 2005.
Introduction to RUP Spring Sharif Univ. of Tech.2 Outlines What is RUP? RUP Phases –Inception –Elaboration –Construction –Transition.
SIUE Injury Tracking System Project Plan. Team Members: Robbie Marsh Robbie Marsh –Project Manager/Webmaster Ken Metcalf Ken Metcalf –Lead Programmer.
Software testing basic. Main contents  Why is testing necessary?  What is testing?  Test Design techniques  Test level  Test type  How to write.
Usability Issues Documentation J. Apostolakis for Geant4 16 January 2009.
SRM 2.2: status of the implementations and GSSD 6 th March 2007 Flavia Donno, Maarten Litmaath INFN and IT/GD, CERN.
Jean-Yves Nief CC-IN2P3, Lyon HEPiX-HEPNT, Fermilab October 22nd – 25th, 2002.
5 1 Chapter 5 Normalization of Database Tables Database Systems: Design, Implementation, and Management, Sixth Edition, Rob and Coronel.
Portal User Group Meeting June 13, Agenda I. Welcome II. Updates on the following: –Migration Status –New Templates –DB Breakup –Keywords –Streaming.
Database System Development Lifecycle 1.  Main components of the Infn System  What is Database System Development Life Cycle (DSDLC)  Phases of the.
David N. Brown Lawrence Berkeley National Lab Representing the BaBar Collaboration The BaBar Mini  BaBar  BaBar’s Data Formats  Design of the Mini 
21 st October 2002BaBar Computing – Stephen J. Gowdy 1 Of 25 BaBar Computing Stephen J. Gowdy BaBar Computing Coordinator SLAC 21 st October 2002 Second.
Introduction Advantages/ disadvantages Code examples Speed Summary Running on the AOD Analysis Platforms 1/11/2007 Andrew Mehta.
Processing of Transparencies Michaela Marx, DESY JACoW Team Meeting October 2007, Knoxville, USA.
Rational Unified Process Mr Hisham AlKhawar. Iterative versus Waterfall  We need to use a life cycle model in order to approach developing a system easily,
19th September 2003Tim Adye1 RAL Tier A Status Tim Adye Rutherford Appleton Laboratory BaBar UK Collaboration Meeting Royal Holloway 19 th September 2003.
CSN1, Nov. 2002J. Walsh, INFN-Pisa 1 BABAR: il nuovo modello di calcolo J. Walsh INFN-Pisa 1.Computer Model Working Group 2.Analysis Model 3.Event Store.
25th October 2006Tim Adye1 RAL Tier A Tim Adye Rutherford Appleton Laboratory BaBar UK Physics Meeting Queen Mary, University of London 25 th October 2006.
Web Z: A Non-Programmers Perspective Sandy Card State University of New York at Binghamton March 23, 1999.
SkimData and Replica Catalogue Alessandra Forti BaBar Collaboration Meeting November 13 th 2002 skimData based replica catalogue RLS (Replica Location.
August 2005 TMCOps TMC Operator Requirements and Position Descriptions Phase 2 Interactive Tool Project Presentation.
Cmpe 589 Spring 2006 Lecture 2. Software Engineering Definition –A strategy for producing high quality software.
Andrei Gheata, Mihaela Gheata, Andreas Morsch ALICE offline week, 5-9 July 2010.
A B A B AR InterGrid Testbed Proposal for discussion Robin Middleton/Roger Barlow Rome: October 2001.
26 September 2000Tim Adye1 Data Distribution Tim Adye Rutherford Appleton Laboratory BaBar Collaboration Meeting 26 th September 2000.
BaBar -Overview of a running (hybrid) system Peter Elmer Princeton University 5 June, 2002.
Grand Challenge in MDC2 D. Olson, LBNL 31 Jan 1999 STAR Collaboration Meeting
Portals and Web Standards Lessons Learned and Applied David Cook Copyright The University of Texas at Austin This work is the.
STAR C OMPUTING Plans for Production Use of Grand Challenge Software in STAR Torre Wenaus BNL Grand Challenge Meeting LBNL 10/23/98.
LHCbComputing LHCC status report. Operations June 2014 to September m Running jobs by activity o Montecarlo simulation continues as main activity.
Avanade Confidential – Do Not Copy, Forward or Circulate © Copyright 2014 Avanade Inc. All Rights Reserved. For Internal Use Only SharePoint Insights (BETA)
© 2008, Renesas Technology America, Inc., All Rights Reserved 1 Introduction Purpose  This course explains how to use Mapview, a utility program for the.
Storage Classes report GDB Oct Artem Trunov
Overview Using Plugins Developing Plugins Basic Examples / Demo Outlook Overview Using Plugins Developing Plugins Basic Examples / Demo Outlook Plugin.
TAGS in the Analysis Model Jack Cranshaw, Argonne National Lab September 10, 2009.
M. Gheata ALICE offline week, October Current train wagons GroupAOD producersWork on ESD input Work on AOD input PWG PWG31 (vertexing)2 (+
Mahindra Satyam Confidential Quality Management System Software Defect Prevention.
ROOT Based CMS Framework Bill Tanenbaum US-CMS/Fermilab 14/October/2002.
The ATLAS Computing & Analysis Model Roger Jones Lancaster University ATLAS UK 06 IPPP, 20/9/2006.
David Nathan Brown, LBNL New Analysis Model Why Revise BaBar’s Analysis Model? Conceptual Overview of the New Model Requirements Summary Implementation.
Analysis Performance and I/O Optimization Jack Cranshaw, Argonne National Lab October 11, 2011.
Targeting Audiences Plus: Reliability & Performance Updates.
20 October 2005 LCG Generator Services monthly meeting, CERN Validation of GENSER & News on GENSER Alexander Toropin LCG Generator Services monthly meeting.
5 1 Chapter 5 Normalization of Database Tables Database Systems: Design, Implementation, and Management, Sixth Edition, Rob and Coronel.
DADDS New Features Tuesday, May 3, 2016Sioux Falls, SD Letecia Reeves, GOES DCS Customer Service Specialist NOAA/NESDIS/OSPO/SPSD.
Scribe Technical Workshop Adapter for OLE DB Import-Export Wizard September 13, 2007.
Chapter 9 Database Planning, Design, and Administration Transparencies © Pearson Education Limited 1995, 2005.
11th September 2002Tim Adye1 BaBar Experience Tim Adye Rutherford Appleton Laboratory PPNCG Meeting Brighton 11 th September 2002.
ANALYSIS TRAIN ON THE GRID Mihaela Gheata. AOD production train ◦ AOD production will be organized in a ‘train’ of tasks ◦ To maximize efficiency of full.
TK2023 Object-Oriented Software Engineering
SuperB and its computing requirements
Systems Analysis and Design
Core Capability Drive-Through Workshop
Kanga Tim Adye Rutherford Appleton Laboratory Computing Plenary
Presentation transcript:

Analysis Model Migration Plan Accessing the Mini Converting to the New (dual-read) Micro Producing the Skims Cleaning up the Tag Beta Development

David Nathan Brown2 CMWG2 Workshop October 2002 Accessing the Mini  Having a complete Mini is the biggest underlying change WRT the old model  Resources must be split between Mini and Micro  Mini data will appear with the 12 series (~now!)  Provide adequate resources for the (few) early people accessing the Mini  Allocate a reasonable staging space at Tier-A sites  Turn on HPSS staging for these databases What should non-HPSS Tier-A sites do?  What should non-Objy (RAL) sites do?  Continue BetaMini development in the 12 series  Efficiency improvements and bug fixes  Persistent Composites  BetaMini redesign in series  Make Beta work naturally with the Mini  Improve staging tools in series

David Nathan Brown3 CMWG2 Workshop October 2002 New (Dual-Read) Micros  The main migration issue is to get people to accept using New Micro instead of ntuples  Use Eric’s MicroK implementation to make this transition  Some development is needed to make this production-quality  Save Full Micro information in AllEvents collection  Migrate with the 12 series data  Convert the reprocessed data as it arrives  Keep both formats at first to test and compare  Set a date for switching the reprocessing to the new format  End of the year?  Discourage the generation of AWG ntuples on this data  Provide help converting macros to the new format  Reduce disk space available for this purpose  Refine the implementation in the series  Reduce the content of AllEvents (if necessary)  Base the persistence on a (Kanga) Reduced Mini?

David Nathan Brown4 CMWG2 Workshop October 2002 Skims  Skims need more support in the New Model  Core development to support AWG customization  Manpower to increase the skim frequency  Resources to hold deep copy skims  convert AWG ‘ntuple’ space ?  Convert 12 series reprocessing skims to New Micro format when that becomes available  Objy skims are still needed for the Mini  Produce New Model skims early (March?) 2003  Support deep copy or pointer copy  Support content reduction and customization  Support Mini or New Micro output  AWGs should validate the content and size of their skims  Code development in the 12 series?

David Nathan Brown5 CMWG2 Workshop October 2002 Tag  New Model Tag is a subset of the existing tag  Use the existing tag with 12 series data  Develop a reduced Tag in the series  Jim Smith is already collecting data on Tag usage  Encourage user migration by disabling functions in 12 series which will not be available in  Annoying messages -> job abort

David Nathan Brown6 CMWG2 Workshop October 2002 Beta Development  Not really a migration issue  Affects performance, not functionality  New Model will not really ‘work’ without it  Core redesign effort should have high priority  Leverage existing BetaMini redesign effort  Develop in series  Organize AWGs to improve physics code  Provide a profiling service (user provides code, gets profile)  Organize training for code optimization  Develop in series