1. 0 Fermilab SW&C Internal Review Oct 24, 2000 David Stickland, Princeton University CMS Software and Computing Status The Functional Prototypes

2. DPS Oct/3/2000 Milestones l Functional Prototype Milestones exist for: è Simulation p OSCAR è Reconstruction and Analysis Framework p CARF è Detector Reconstruction p ORCA è Physics Object Reconstruction p ORCA and PRS Analyses è User Analysis p IGUANA è Event Storage and Reading from an ODBMS p GIOD; MONARC; ORCA Production

3. DPS Oct/3/2000 Deliverables for each of the Software Functional Prototypes l Documented set of use-cases / scenarios / requirements è These are not (yet) very formal l Suite of software packages / prototypes è Public releases of associated software è Documentation of components (user-level and reference) l Software infrastructure è Public software repository è Build / release / distribution / documentation systems è Multi-platform support both centrally and in remote institutes, …etc... l Proposal for a baseline è recommendations on main design and technology choices l Proposed project plan for next phase

4. DPS Oct/3/2000 Simulation l Current simulation by our GEANT3 product: CMSIM l Migration underway to GEANT4 è We require GEANT4 for its Physics processes and OO implementation l FAMOS project underway for Fast Simulation è Will be vital to complete many topics in the Physics TDR è The FAMOS project is preparing for its first release this autumn

5. DPS Oct/3/2000 OSCAR (CMS G4 Simulation) l OSCAR project for CMS implementation of GEANT4 è Proof of concept reached in July 1998 p Built barrel geometry è Functional Prototype: originally due Dec 1999, slipped by 6 months p Delayed due to manpower problems Persistent hits not yet implemented Geometries for most sub-detectors ready Many performance tune-ups completed p June 2000, milestone passed but with severely limited functionality CMS recognizes that this project is slipping such that it would become a critical path item and is addressing these issues now

6. DPS Oct/3/2000 ORCA l Object Reconstruction for CMS Analysis è Project started in Sept. ‘98 è Currently in fourth major release (4_3_0) l Based on CARF framework l Large base of detector code è Detailed digitization with Pileup. Persistent storage è L1 trigger simulation è Clusters, Tracks, Muons, Jets, Vertices p Being used by physicists in their studies p Not yet persistent p Much tuning remains to be done, but the groundwork is in place è Very little Fortran code remaining (mostly associated with the GEANT3/CMSIM interface) Has been major focus of SW activity for last two years

7. DPS Oct/3/2000 Use of ORCA l Physics/Trigger results related to HLT. See TRIDAS session. è Digitization is resource intensive stage p 200 events pileup for each signal event è Trial production in Oct 99 è Major Production in Spring 2000 p Simulation Worldwide p Digitization and reconstruction at CERN 200 CPUs, 2 weeks production, 70TB data transferred p 2 million events with full pileup at 10 34 luminosity p ~4TB of data stored and analyzed è Third production now underway p 5 million events (ie. Pileup: 1 Billion events!) p Simulation and Reconstruction Worldwide p GLOBUS/GRID based tools for Database import/export Digitization of one CMS event at full luminosity requires (from first principles) about 400 times more computing than one Run II event

8. DPS Oct/3/2000 ORCA Production 2000 Signal Zebra files with HITS ORCA Digitization (merge signal and MB) Objectivity Database HEPEVT ntuples CMSIM HLT Algorithms New Reconstructed Objects MC Prod. ORCA Prod. HLT Grp Databases ORCA ooHit Formatter Objectivity Database MB Objectivity Database Catalog import Objectivity Database Objectivity Database ytivitcejbOesabataD Mirrored Db’s (US, Russia, Italy..)

9. DPS Oct/3/2000 Production Farm (Spring 2000) Shift 20 Digit DB’s Pileup “Events” Lockserver eff031 jetmet FDDB eff032 jetmet journal eff103 muon FDDB eff104 muon journal 70 CPUS used for jetmet production 70 CPUS used for muon production 24 nodes serving Pileup “Hits” eff001-10,33-39,76-78,105-108 6 nodes serving all other DB Files from HPSS eff073-75,79-81 HPSS Objectivity communication Data Flow On loan from EFF

10. DPS Oct/3/2000 Performance l More like an Analysis facility than a DAQ facility è 140 jobs reading asynchronously and chaotically from 30 AMS server’s, writing to a high speed SUN server è Non disk-resident data being staged from tape è 70 jetmet jobs at ~60 seconds/event and 35MB IO/event è 70 muon jobs at ~90 seconds/event and 20MB IO/event è Best Reading rate out of Objectivity ~ 70MB/sec è Continuous 50MB/sec reading rate è 1million jetmet events, ~ 10 days è 1million muon events, ~15 days l Extensive monitoring was deployed, significant statistics were accumulated and analyzed } in parallel

11. DPS Oct/3/2000 Feedback to MONARC Simulations Mean measured Value ~48MB/s Measurement Simulation These productions are a source of high statistics information to calibrate the simulation tools (MONARC)

12. DPS Oct/3/2000 User Analysis Software Strategy l Core software “User Analysis Environment” should: è Ensure coherence with framework and data handling p Coherent across all CMS software as much as possible p Filtering of data sets, user collections, user tags, etc. è Emphasize generic toolkits (not monolithic applications) p Histogramming, fitting, tag analysis,…. p Graphical user interfaces, plotting, etc. p Interactive detector and event visualization è Include supporting infrastructure p Support for remote deployment and installation p Building against CMS, HEP, and non-HEP software p Documentation,...

13. DPS Oct/3/2000 IGUANA Software Strategy è Strongly emphasize generic toolkits (not monolithic applications) è Core philosophy: “Beg, borrow, and exploit” software from many sources IGUANA LHC++ or HEP Public- domain Commercial Event Display Graphical User Interfaces Histograms, persistent tags Interactive plotting Fitting and Statistical analysis

14. DPS Oct/3/2000 IGUANA: GUI / Analysis Components

15. DPS Oct/3/2000 IGUANA Event Display with ORCA

16. DPS Oct/3/2000 IGUANA “Functional Prototype” CMS / LHCC Milestone of June 2000 è This milestone was delayed by 4 months for two reasons: è 1) Two software engineers were required in 1999 and only one was hired. The second engineer joined the project in May 2000. è 2) The functional prototype should include the Lizard interactive analysis software of the CERN/IT/API group, the first major release of which is scheduled for 15 October 2000. Rescheduled milestone in October 2000 will be satisfied

17. DPS Oct/3/2000 Current Analysis Chain Current Analysis Chain l CMSIM (Geant3) Simulation l ORCA Hit formatting into ODBMS l ORCA Pileup and Digitization of some subset of detectors l Selection of events for further processing l Create new collection è shallow (links), or deep (data) to existing objects è add new objects (ie. Tk Digits) è replace existing objects if required l After ooHit stage, all combinations of è Transient - (Persistent) è Persistent - Transient è Persistent - Transient - Persistent are possible l User collections of events of interest è Collections can span datasets, navigation back from event data to run data can be used to get correct setups Full ODBMS functionality being used Organization of the Meta- data and production issues, are typically much more technically complex than the simple issues of persistent objects! Prod. Users

18. DPS Oct/3/2000 Data Handling l We already have more data (  10TB) than disk space è use MSS systems (HPSS at CERN, ENSTORE at FNAL) è automatic staging by hooks in Objectivity code l Tools are in place to replicate federations è Shallow (catalog and schema files only) è Meta-deep (plus meta-data) è Deep (plus Database files) è LAN and WAN l “Request Redirection Protocols” being prototyped and field tested è allows to “hide” actual data location from users p disk goes down, single change on a central server redirects user requests to a new server p A powerful place to hook into Objectivity to give us the required control Leverage products like Objectivity to reduce the amount of SW we have to write

19. DPS Oct/3/2000 Product- and Project- ize Moving from system-scale to enterprise-scale. l Productize è Make Software products that: p are capable of running at all regional centers, p give consistent, repeatable and verifiable results p have well understood quality p have been tested rigorously p have controlled change... è Rate of increase of new features will reduce as more work goes onto quality l Projectize è General milestones were satisfactory for the prototype stage è Now require a more detailed planning, è Attachment of milestones to critical (in-project and off- project) items è Filling in of short-term milestones è More detailed manpower planning

20. DPS Oct/3/2000 5% and 20% Data Challenges l In 2002/2003 we have 5% and 20% data challenges specified è In fact these are just part of a steady process l The % we refer to is the % of complexity, rather than the genuine 5% of the data, or 5% of the CPU… l Farm sized (in boxes) at 5/20% è processing speed whatever it is è run for a period of a month or so to see the whole system in operation: p first pass reconstruction p roll data out to users continuously (no scheduled downtimes) p selected “streams” (collections) in operation p user offline selection -> user collections p replication between sites p timely “results”

21. DPS Oct/3/2000 Conclusions l Technically we are on course è Most aspects of the computing model are already being tested in detail è User acceptance is big and growing è The collaboration is fully engaged in this process l Schedules are just being met è But detailed planning for the next phase may uncover new critical items l Slippage will happen in the absence of more skilled-manpower è Both in Core Application Software and in the development of the User Facilities there are vital roles for qualified engineers.