Physics Performance. EM Physics: Observations Two apparently independent EM physics models have led to user confusion: –Different results for identical.

Slides:



Advertisements
Similar presentations
Configuration management
Advertisements

Introduction to Maven 2.0 An open source build tool for Enterprise Java projects Mahen Goonewardene.
Stefan Roesler SC-RP/CERN on behalf of the CERN-SLAC RP Collaboration
Maria Grazia Pia, INFN Genova 1 Part V The lesson learned Summary and conclusions.
Simulation Project Major achievements (past 6 months 2007)
14 User Documents and Examples I SLAC Geant4 Tutorial 3 November 2009 Dennis Wright Geant4 V9.2.p02.
Automated Tests in NICOS Nightly Control System Alexander Undrus Brookhaven National Laboratory, Upton, NY Software testing is a difficult, time-consuming.
Simulation Project Organization update & review of recommendations Gabriele Cosmo, CERN/PH-SFT Application Area Internal.
Simulation Project Organization update & review of recommendations Gabriele Cosmo, CERN/PH-SFT Application Area Internal.
Summary of Parallel Session 3A : Hadronic Validation J. Yarba Fermilab 17th Geant4 Collaboration Workshop 9/14/
C. Seez Imperial College November 28th, 2002 ECAL testbeam Workshop 1 Offline software for ECAL test beam The pre-processing model The offline software.
Workload Management WP Status and next steps Massimo Sgaravatto INFN Padova.
 To explain the importance of software configuration management (CM)  To describe key CM activities namely CM planning, change management, version management.
User Documents and Examples I Sébastien Incerti Slides thanks to Dennis Wrigth, SLAC.
Usability Issues Documentation J. Apostolakis for Geant4 16 January 2009.
A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 Software Process panel SPI GRIDPP 7 th Collaboration Meeting 30 June – 2 July 2003 A.Aimar -
Geant4 Acceptance Suite for Key Observables CHEP06, T.I.F.R. Mumbai, February 2006 J. Apostolakis, I. MacLaren, J. Apostolakis, I. MacLaren, P. Mendez.
EM physics progress20 January Geant4 Electromagnetic Physics Progress S.Incerti and V.Ivanchenko for Geant4 electromagnetic groups 20 January 2008.
Maria Grazia Pia, INFN Genova Test & Analysis Project aka “statistical testing” Maria Grazia Pia, INFN Genova on behalf of the T&A team
User Documents and Examples II Geant4 Tutorial at Marshall Space Flight Center 18 April 2012 Dennis Wright (SLAC) Geant4 V9.5.
5 May 98 1 Jürgen Knobloch Computing Planning for ATLAS ATLAS Software Week 5 May 1998 Jürgen Knobloch Slides also on:
A Short Course on Geant4 Simulation Toolkit How to learn more?
ROOT Application Area Internal Review September 2006.
Fabiola Gianotti, 31/8/’99 PHYSICS and SOFTWARE ATLAS Software Week 31/8/’99 Fabiola Gianotti Software requirements of physics groups What should Detector.
Fabiola Gianotti, 30/07/2003 ATLAS HO HB ECal Beam Line CMS LHCb ALICE Goals and plans Examples of work done so far and first results Examples of on-going.
Computing Performance Recommendations #13, #14. Recommendation #13 (1/3) We recommend providing a simple mechanism for users to turn off “irrelevant”
Overall Goal of the Project  Develop full functionality of CMS Tier-2 centers  Embed the Tier-2 centers in the LHC-GRID  Provide well documented and.
1 Status and Plans for Geant4 Physics Linear Collider Simulation Workshop III 2-5 June 2004 Dennis Wright (SLAC)
FLUKA dose and fluence simulations for CBM experiment I.Kadenko, O.Bezshyyko, V.Pluyko, V.Shevchenko National Taras Shevchenko University of Kiev.
Feedback from the POOL Project User Feedback from the POOL Project Dirk Düllmann, LCG-POOL LCG Application Area Internal Review October 2003.
LCG Generator Meeting, December 11 th 2003 Introduction to the LCG Generator Monthly Meeting.
Geant4 in production: status and developments John Apostolakis (CERN) Makoto Asai (SLAC) for the Geant4 collaboration.
Release Validation J. Apostolakis, M. Asai, G. Cosmo, S. Incerti, V. Ivantchenko, D. Wright for Geant4 12 January 2009.
TPS & Simulations within PARTNER D. Bertrand, D. Prieels Valencia, SPAIN 19 JUNE 2009.
Hadronic Physics Validation II Dennis Wright Geant4 Review CERN April 2007.
New Hadr02 test for Ion-Ion simulation Ivantchenko V., Ivantchenko A.
The CMS Simulation Software Julia Yarba, Fermilab on behalf of CMS Collaboration 22 m long, 15 m in diameter Over a million geometrical volumes Many complex.
Introduction What is detector simulation? A detector simulation program must provide the possibility of describing accurately an experimental setup (both.
Mar. 13 th, 2014 Geant4 Physicslist and Validation Working Group Meeting 1 Hans Wenzel Mar 13 th 2014 Physics validation display Webapplication.
CASE (Computer-Aided Software Engineering) Tools Software that is used to support software process activities. Provides software process support by:- –
Documentation Gunter Folger / CERN Geant4 School, Annecy 2008.
Firmware - 1 CMS Upgrade Workshop October SLHC CMS Firmware SLHC CMS Firmware Organization, Validation, and Commissioning M. Schulte, University.
Why A Software Review? Now have experience of real data and first major analysis results –What have we learned? –How should that change what we do next.
Users contributions, documentation J. Apostolakis.
G.Govi CERN/IT-DB 1 September 26, 2003 POOL Integration, Testing and Release Procedure Integration  Packages structure  External dependencies  Configuration.
A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 SPI Software Process & Infrastructure for LCG Project Overview LCG Application Area Internal.
Computing Performance Recommendations #10, #11, #12, #15, #16, #17.
Geant4 CPU performance : an update Geant4 Technical Forum, CERN, 07 November 2007 J.Apostolakis, G.Cooperman, G.Cosmo, V.Ivanchenko, I.Mclaren, T.Nikitina,
Fabiola Gianotti, 13/05/2003 Simulation Project Leader T. Wenaus Framework A. Dell’Acqua WP Geant4 J.Apostolakis WP FLUKA Integration A.Ferrari WP Physics.
LCG – AA review 1 Simulation LCG/AA review Sept 2006.
Dec 2004 Simulation of Low Energy backgrounds in the TESLA IR Impact on feedback BPMs FONT collaboration  QMUL: P Burrows, G Christian, C Clarke, G White,
Oct. 16 th, 2013 Geant4 hadronic Meeting 1 Hans Wenzel Oct 16 th 2013 Status of physics validation tool.
Luciano Pandola, INFN Gran Sasso Luciano Pandola INFN Gran Sasso Genova, July 18 th, 2005 Geant4 and the underground physics community.
Marina Golubeva, Alexander Ivashkin Institute for Nuclear Research RAS, Moscow AGeV simulations with Geant4 and Shield Geant4 with Dpmjet-2.5 interface.
Atlas Software May, 2000 K.Amako Status of Geant4 Physics Validation Atlas Software Week 10 May, Katsuya Amako (KEK)
Geant4 Training 2003 A Short Course on Geant4 Simulation Toolkit How to learn more? The full set of lecture notes of this Geant4.
MONTE CARLO TRANSPORT SIMULATION Panda Computing Week 2012, Torino.
Gunter Folger / CERN MC-PAD, DESY/Hamburg Jan 2010
Simulation Project Structure and tasks
A Short Course on Geant4 Simulation Toolkit How to learn more?
User Documents and Examples I
Linear Collider Simulation Tools
Simulation Framework Subproject cern
A Short Course on Geant4 Simulation Toolkit How to learn more?
A Short Course on Geant4 Simulation Toolkit How to learn more?
Simulation Project Structure and tasks
Simulation Project Structure and tasks
Linear Collider Simulation Tools
Chapter 2: Building a System
Building a “System” Moving from writing a program to building a system. What’s the difference?! Complexity, size, complexity, size complexity Breadth.
Presentation transcript:

Physics Performance

EM Physics: Observations Two apparently independent EM physics models have led to user confusion: –Different results for identical geometry New heavy ion stopping models not fully available. Documentation hard to find for: –Validation papers for various models. –Comparisons to data. –Trade off between accuracy and speed for various range cuts and models.

EM Physics: Recommendations Provide guidance on selection between the two models for specific species, energies, etc. Integrate models into a single package for EM physics, similar to the situation with hadronics; thus allowing the possibility of using one model in one energy range and the other in another energy range. Encourage the rapid integration of ICRU 73 heavy ion stopping Setup a validation webpage for EM physics –Provide detail references for validation papers for various models –Comparisons to data etc… Provide guidance about trade off between accuracy and speed for various range cuts.

Hadronics The FLUKA hadronic physics package has been identified by many users as a mature and carefully benchmarked code, best suited for their specific applications. –Some HEP experiments that would like to use GEANT4 have not done so because of the absence of FLUKA physics in GEANT4. On the other hand, FLUKA is more difficult to use than GEANT4 for detailed full detector simulation due to –the missing standard user interface for hit generation –the combinatorial geometry which make coding of complex geometries difficult.

Geant4 / FLUKA relation A possible solution to the previous problems is the FLUKA Virtual Monte Carlo (VMC) implementation developed by the ALICE collaboration. However, many existing HEP experiments have already Geant4 based simulation frameworks. It is impossible to combine the FLUKA physics model with GEANT4 physics models. As in the previous two Geant4 reviews the committee notes that there is a strong request to use the FLUKA hadronic model with Geant4.

Geant4/FLUKA The Committee recommends to talk to the FLUKA collaboration to find a cooperative way to provide the user with the best features of GEANT4 and FLUKA. –For example, implement a loosely coupled interface between Geant4 and FLUKA hadronic physics.

G4 Hadronic Physics Since the last review a serious effort has been undertaken by the Geant4 collaboration and the LCG Physics Validation group to test and validate the Geant4 hadronic transport models. –Thin and thick target validation –Ongoing full set-up simulations –Comparison to calorimeter test beam data (ATLAS, CMS)

G4 Hadronic Physics In particular the comparison to test beam data has pointed to important shortcomings of the G4 hadronic models in the low and intermediate momentum region (0.1 – 5 GeV) –Wrong description of the longitudinal shower shapes “starts too early stops too early” –Wrong description of the radial shower shapes too narrow

G4 Hadronic Physics Although possible solutions have been sketched during the review the committee is concerned not to see a detailed planning (milestones, manpower) for an improvement of the hadronic package. The committee recommends to put in place a set of simple hadronic benchmarks which allow to identify such very basic problems like disagreement with well- known shower shapes.

Other Hadronics Issues The space community has a strong need to have accurate prediction of triple differential cross sections (energy, mass, and angle) for recoiling particles from all interactions, including heavy mass ion-ion reactions. We recommend that the Geant4 developers accelerate the physics model development to address this need.

Computing Performance

Observations CPU optimization is critical for LHC experiments and other heavy users such as medical and space applications. Saving CPU time is saving real money (and effort). Multi-prong approach is needed. –Optimization of GEANT4 toolkit. Computing professionals have made an impact in some areas. –Trade-off between CPU time and simulation detail. This is a user choice. However, help from GEANT4 is crucial in choosing physics models, parameter values, optimizing geometry, etc. –Variance reduction techniques (VRT). It can greatly enhance the impact of CPU power. A number of VRT are available in GEANT4.

Recommendations (1) Systematically track code performance, separately for each part of the code, and model by model. Perform systematic checks on –Architecture, compiler/options –Memory usages –Multi core CPUs/advanced instructions Encourage users to do the same and provide feedback. Extend the work of computing professionals to review and optimize other parts of the code.

Recommendations (2) Provide a plan regarding the expected performance in the next few years. Create a document on performance optimization guides. This information probably already exists and just needs to be collected. Educate users on the most efficient way to use GEANT4 for his application. Provide a simple mechanism for users to turn off “irrelevant” processes for a given region. This can potentially save significant CPU time with little or no impact on physics.

Documentation, Validation and Usability

Documentation: Observations (1) GEANT4 has provided among others –Application Developers Guide. –Installation Guide. –Getting Started. –Users Guide for Toolkit Developers. –LXR reference guide. –FAQ. –Tutorial. Effort underway to move into DocBook format, and to use MathXML for the physics manual.

Documentation: Observations (2) Application Developers Guide can be “user unfriendly”. Not all documentation is up to date. A number of web links are broken. No clear recommendation about the validity ranges for the many physics models (e.g. the two EM models) and the different Physics Lists. Limited number of references to validation and benchmarking papers are available on the GEANT4 web. Limited information about the connection between the physics models and how they are implemented.

Documentation: Recommendations (1) Provide clear recommendations when the different packages and Physics Lists should be used and their validity ranges. Document the limitations, and validity and applicability ranges of the different hadronic and EM models. When models have overlapping validity ranges, as in the case of the two EM models, document the tradeoffs. Update the documentation on the web. Periodically review the web site to keep it up to date.

Documentation: Recommendations (2) Accomplish the migration to DocBook and MathXML. Improve code documentation. For example, replace current software reference manual with: –DOXYGEN. –Improved documentation in README which can be browsed in LXR. –Other solutions. Describe the connection between physics models and how they are implemented. Provide greater details in release notes. Reduce the number of documents by combining some documents, as planned.

Validation: Observations Many different Physics Lists with different physics models. Testing for a planned release lasts 3 weeks with validation tests and Q/A checks. Regular new releases: one major and a minor per year. –Beta tested. Different computer platforms and compilers are supported. Started a database of experimental data for physics validation. Limited systematic comparisons with available experimental data. Limited systematic comparisons with other MC transport codes. No blind tests.

Validation: Recommendations Create a common validation procedure, possibly automated, to be run at every release. Define a procedure that quantifies the validation results, and make them easily available to users. For example, –Timing checks with the most relevant results incorporated into release notes. –Benchmarking against other MC transport codes. –“Recruit” additional beta testers from different user communities. –Provide repository for experimental data and validation results provided by others. –Insure information transfer with other code developers and experimentalists. –Provide references of validation and benchmarking on the web.

Usability: Observations GEANT4 provides many tutorials and workshops. This is very much appreciated by the user community. Insufficient exchange among users, and particularly from different user groups. Response to user questions occasionally have significant delays.

Usability: Recommendations Provide better support to implement user driven physics models. Consider a user community supported Wiki as a collaborative tool where users can contribute. Simplify the installation procedure particularly for novice users, e.g. –Standard installation with default values. –A template spec file for RPM installation. –Better documentation.

Other Issues

Manpower Manpower stretched very thin. –Core S/W. –Physics models. –Infrastructure, validation, user manual, etc. Some can be recruited from user community, e.g. physics models. Others necessarily dedicated GEANT4. Provide a plan for manpower need over the next few years. Encourage GEANT4 to seek additional funding and support for such personnel as needed.