1. Geant4-INFN (Genova-LNS) Team Validation of Geant4 electromagnetic and hadronic models against proton data Validation of Geant4 electromagnetic and hadronic models against proton data G.A.P. Cirrone 1, G. Cuttone 1, F. Di Rosa 1, S. Guatelli 1, B. Mascialino 2, M.G. Pia 1, G. Russo 2 1 INFN LNS, Catania, Italy 2 INFN Genova, Italy IEEE Nuclear Science Symposium San Diego, 30 October – 4 November 2006

2. Geant4-INFN (Genova-LNS) Team Geant4 Toolkit objective criteria Provide objective criteria to evaluate Geant4 physics models precision –Document their precision against experimental data allsystematically –Test all Geant4 physics models systematically –Quantitative statistical methods –Quantitative tests with rigorous statistical methods Wide set of physics processes and models Versatility of configuration according to use cases How to choose most appropriate model the most appropriate model for my simulation?

3. Geant4-INFN (Genova-LNS) Team Adopt the same method also for hadronic physics validation –address all modeling options –start from the bottom (low energy) –progress towards higher energy based on previous sound assessments –statistical analysis of compatibility with experimental data Guidance to users based on objective ground –not only “educated-guess” PhysicsLists K. Amako et al., Comparison of Geant4 electromagnetic physics models against the NIST reference data IEEE Trans. Nucl. Sci., Vol. 52, Issue 4, Aug. 2005, pp. 910-918 Statistical Toolkit Goodness-of-Fit test Quantitatitative comparison of experimental - simulated distributions

4. Geant4-INFN (Genova-LNS) Team Proton Bragg peak Compare various Geant4 electromagnetic models Assess lowest energy range of hadronic interactions – elastic scattering –pre-equilibrium + nuclear deexcitation to build further validation tests on solid ground Results directly relevant to various experimental use cases Oncological radiotherapy Medical Physics LHC Radiation Monitors High Energy Physics Space Science Astronauts’ radiation protection

5. Geant4-INFN (Genova-LNS) Team Relevant Geant4 physics models Standard Low Energy – ICRU 49 Low Energy – Ziegler 1977 Low Energy – Ziegler 1985 Low Energy – Ziegler 2000 New “very low energy” models Parameterized (à la GHEISHA) Nuclear Deexcitation –Default evaporation –GEM evaporation –Fermi break-up Pre-equilibrium –Precompound model –Bertini model Elastic scattering –Parameterized models –Bertini Intra-nuclear cascade –Bertini cascade –Binary cascade Hadronic Electromagnetic Subset of results shown here Full set of results in publication coming shortly

6. Geant4-INFN (Genova-LNS) Team Experimental data CATANA hadrontherapy facility in Catania, Italy –high precision experimental data satisfying rigorous medical physics protocols –Geant4 Collaboration members Validation measurements Markus Ionization chamber 2 mm Sensitive Volume = 0.05 cm 3 Resolution 100  m Markus Chamber

7. Geant4-INFN (Genova-LNS) Team Geant4 simulation Accurate reproduction of the experimental set-up quantitative This is the most difficult part to achieve a quantitative Geant4 physics validation Geometrybeam Geometry and beam characteristics must be known in detail and with high precision Ad hoc beam line set-up for Geant4 validation to enhance peculiar effects of physics processes E proton = 63.5 MeV  E = 300 keV

8. Geant4-INFN (Genova-LNS) Team Electromagnetic processes Electromagnetic options  Standard EM  Low Energy EM – ICRU 49  Low Energy EM – Ziegler 1977  Low Energy EM – Ziegler 1985  Low Energy EM – Ziegler 2000

9. Geant4-INFN (Genova-LNS) Team Electromagnetic processes Standard EM: p, ions, , e- e+p-value CvMKSAD Left branch 0.418 Right branch 0.736 Whole curve 0.438 CvM Cramer-von Mises test KS Kolmogorov-Smirnov test AD Anderson-Darling test 1 M events mm Geant4 Experimental data Standard EM

10. Geant4-INFN (Genova-LNS) Team Electromagnetic processes Low Energy EM – ICRU49: p, ions Low Energy EM – Livermore: , e- Standard EM:e+p-value CvMKSAD Left branch 0.530 Right branch 0.985 Whole curve 0.676 CvM Cramer-von Mises test KS Kolmogorov-Smirnov test AD Anderson-Darling test 1 M events mm Geant4 Experimental data LowE EM – ICRU49

11. Geant4-INFN (Genova-LNS) Team Electromagnetic processes Low Energy EM – Ziegler 1977: p, ions Low Energy EM – Livermore: , e- Standard EM:e+ 1 M events mm Geant4 Experimental datap-value CvMKSAD Left branch 0.420 Right branch 0.985 Whole curve 0.547 LowE EM – Ziegler 1977 CvM Cramer-von Mises test KS Kolmogorov-Smirnov test AD Anderson-Darling test

12. Geant4-INFN (Genova-LNS) Team Electromagnetic processes LowE EM – Ziegler 1985 Low Energy EM – Ziegler 1985: p, ions Low Energy EM – Livermore: , e- Standard EM:e+ Subject to further investigation 1 M events mm Geant4 Experimental data

13. Geant4-INFN (Genova-LNS) Team Electromagnetic processes Low Energy EM – Ziegler 2000: p, ions Low Energy EM – Livermore: , e- Standard EM:e+ Subject to further investigation 1 M events mm Geant4 Experimental data LowE EM – Ziegler 2000

14. Geant4-INFN (Genova-LNS) Team Electromagnetic processes Summary p-value LowE ICRU49 LowE Ziegler 1977 Standard Left branch (CvM) 0.5300.4200.418 Right branch (KS) 0.985 0.736 Whole curve (AD) 0.6760.5470.438 CvM Cramer-von Mises test KS Kolmogorov-Smirnov test AD Anderson-Darling test LowE – ICRU49 Best EM option: LowE – ICRU49 Selected for further EM + Hadronic tests

15. Geant4-INFN (Genova-LNS) Team Electromagnetic processes + Elastic scattering Elastic scattering options  HadronElastic process with LElastic model  HadronElastic process with BertiniElastic model  UHadronElastic process with HadronElastic model

16. Geant4-INFN (Genova-LNS) Team EM + Elastic scattering Low Energy EM – ICRU49: p, ions Low Energy EM – Livermore: , e- Standard EM:e+ LElastic HadronElastic with LElasticp-value CvMKSAD Left branch 0.522 Right branch 0.985 Whole curve 0.697 LowE EM – ICRU49 LElastic CvM Cramer-von Mises test KS Kolmogorov-Smirnov test AD Anderson-Darling test 1 M events mm Geant4 Experimental data

17. Geant4-INFN (Genova-LNS) Team EM + Elastic scattering Low Energy EM – ICRU49: p, ions Low Energy EM – Livermore: , e- Standard EM:e+ HadronElastic UHadronElastic with HadronElasticp-value CvMKSAD Left branch 0.490 Right branch 0.735 Whole curve 0.669 LowE EM – ICRU49 HadronElastic CvM Cramer-von Mises test KS Kolmogorov-Smirnov test AD Anderson-Darling test 0.5 M events mm Geant4 Experimental data

18. Geant4-INFN (Genova-LNS) Team Electromagnetic processes + Elastic scattering + Hadronic inelastic scattering Hadronic Inelastic options  Precompound with Default Evaporation  Precompound with GEM Evaporation  Precompound with Default Evaporation + Fermi Break-up  Bertini

19. Geant4-INFN (Genova-LNS) Team EM + hadronic physics Low Energy EM – ICRU49: p, ions Low Energy EM – Livermore: , e- Standard EM:e+ LElastic HadronElastic with LElastic Precompound Default Evaporation Precompound with Default Evaporationp-value CvMKSAD Left branch 0.836 Right branch 0.985 Whole curve 0.946 LowE EM – ICRU49 LElastic CvM Cramer-von Mises test KS Kolmogorov-Smirnov test AD Anderson-Darling test 1 M events mm Geant4 Experimental data Precompound default

20. Geant4-INFN (Genova-LNS) Team EM + hadronic physics Standard EM: p, ions, , e- e+ LElastic HadronElastic with LElastic Precompound Default Evaporation Precompound with Default Evaporationp-value CvMKSAD Left branch 0.648 Right branch 0.760 Whole curve 0.666 CvM Cramer-von Mises test KS Kolmogorov-Smirnov test AD Anderson-Darling test 1 M events mm Geant4 Experimental data Standard EM LElastic Precompound default

21. Geant4-INFN (Genova-LNS) Team EM + hadronic physics Low Energy EM – ICRU49: p, ions Low Energy EM – Livermore: , e- Standard EM:e+ HadronElastic Precompound Default Evaporation UHadronElastic with HadronElastic Precompound with Default Evaporationp-value CvMKSAD Left branch 0.973 Right branch 0.985 Whole curve 0.982 LowE EM – ICRU49 HadronElastic CvM Cramer-von Mises test KS Kolmogorov-Smirnov test AD Anderson-Darling test 0.5 M events mm Geant4 Experimental data Precompound default

22. Geant4-INFN (Genova-LNS) Team EM + hadronic physics Low Energy EM – ICRU49: p, ions Low Energy EM – Livermore: , e- Standard EM:e+ LElastic HadronElastic with LElastic Precompound GEM Evaporation Precompound with GEM Evaporationp-value CvMKSAD Left branch 0.667 Right branch 0.985 Whole curve 0.858 LowE EM – ICRU49 LElastic CvM Cramer-von Mises test KS Kolmogorov-Smirnov test AD Anderson-Darling test 0.5 M events mm Geant4 Experimental data Precompound with GEM Evaporation

23. Geant4-INFN (Genova-LNS) Team EM + hadronic physics Low Energy EM – ICRU49: p, ions Low Energy EM – Livermore: , e- Standard EM:e+ LElastic HadronElastic with LElastic Precompound Fermi Break-up Precompound with Fermi Break-upp-value CvMKSAD Left branch 0.814 Right branch 0.985 Whole curve 0.945 LowE EM – ICRU49 LElastic CvM Cramer-von Mises test KS Kolmogorov-Smirnov test AD Anderson-Darling test 0.5 M events mm Geant4 Experimental data Precompound with Fermi Break-up

24. Geant4-INFN (Genova-LNS) Team EM + hadronic physics Low Energy EM – ICRU49: p, ions Low Energy EM – Livermore: , e- Standard EM:e+ LElastic HadronElastic with LElastic Bertini Inelastic p-value CvMKSAD Left branch 0.790 Right branch 0.985 Whole curve 0.936 LowE EM – ICRU49 LElastic CvM Cramer-von Mises test KS Kolmogorov-Smirnov test AD Anderson-Darling test 1 M events mm Geant4 Experimental data Bertini Inelastic

25. Geant4-INFN (Genova-LNS) Team EM + hadronic physics Low Energy EM – ICRU49: p, ions Low Energy EM – Livermore: , e- Standard EM:e+ HadronElastic with BertiniElastic Bertini Inelastic p-value CvMKSAD Left branch 0.977 Right branch 0.985 Whole curve 0.994 LowE EM – ICRU49 BertiniElastic CvM Cramer-von Mises test KS Kolmogorov-Smirnov test AD Anderson-Darling test 0.5 M events mm Geant4 Experimental data Bertini Inelastic

26. Geant4-INFN (Genova-LNS) Team Electromagnetic + Hadronic Summary p-value Standard LElastic Precompound LowE ICRU49 LElastic Precompound GEM LowE ICRU49 LElastic Bertini Inelastic LowE ICRU49 LElastic Precompound Fermi Break-up LowE ICRU49 LElastic Precompound LowE ICRU49 HadronElastic Precompound LowE ICRU49 Bertini Elastic Bertini Inelastic Left branch (CvM) 0.6480.6670.7900.8140.8360.9730.977 Right branch (KS) 0.7600.985 Whole curve (AD) 0.6660.8580.9360.9450.9460.9820.994 Key ingredients electromagnetic  Precise electromagnetic physics elastic scattering  Good elastic scattering model pre-equilibrium  Good pre-equilibrium model

27. Geant4-INFN (Genova-LNS) Team Conclusion Publication coming soon with complete results Selection of Geant4 physics models (aka PhysicsList) based on quantitative experimental validation, rather than just “educated guess”...2-year project to get there Systematicquantitativeall Systematic, quantitative validation of all Geant4 electromagnetic and hadronic models in the energy range < 100 MeV against high precision experimental data Document Geant4 simulation accuracy Provide guidance for Geant4 use based on objective ground