Geant4-INFN (Genova-LNS) Team Validation of Geant4 electromagnetic and hadronic models against proton data Validation of Geant4 electromagnetic and hadronic models against proton data G.A.P. Cirrone 1, G. Cuttone 1, F. Di Rosa 1, S. Guatelli 1, B. Mascialino 2, M.G. Pia 1, G. Russo 2 1 INFN LNS, Catania, Italy 2 INFN Genova, Italy IEEE Nuclear Science Symposium San Diego, 30 October – 4 November 2006

Geant4-INFN (Genova-LNS) Team Geant4 Toolkit objective criteria Provide objective criteria to evaluate Geant4 physics models precision –Document their precision against experimental data allsystematically –Test all Geant4 physics models systematically –Quantitative statistical methods –Quantitative tests with rigorous statistical methods Wide set of physics processes and models Versatility of configuration according to use cases How to choose most appropriate model the most appropriate model for my simulation?

Geant4-INFN (Genova-LNS) Team Adopt the same method also for hadronic physics validation –address all modeling options –start from the bottom (low energy) –progress towards higher energy based on previous sound assessments –statistical analysis of compatibility with experimental data Guidance to users based on objective ground –not only “educated-guess” PhysicsLists K. Amako et al., Comparison of Geant4 electromagnetic physics models against the NIST reference data IEEE Trans. Nucl. Sci., Vol. 52, Issue 4, Aug. 2005, pp Statistical Toolkit Goodness-of-Fit test Quantitatitative comparison of experimental - simulated distributions

Geant4-INFN (Genova-LNS) Team Proton Bragg peak Compare various Geant4 electromagnetic models Assess lowest energy range of hadronic interactions – elastic scattering –pre-equilibrium + nuclear deexcitation to build further validation tests on solid ground Results directly relevant to various experimental use cases Oncological radiotherapy Medical Physics LHC Radiation Monitors High Energy Physics Space Science Astronauts’ radiation protection

Geant4-INFN (Genova-LNS) Team Relevant Geant4 physics models Standard Low Energy – ICRU 49 Low Energy – Ziegler 1977 Low Energy – Ziegler 1985 Low Energy – Ziegler 2000 New “very low energy” models Parameterized (à la GHEISHA) Nuclear Deexcitation –Default evaporation –GEM evaporation –Fermi break-up Pre-equilibrium –Precompound model –Bertini model Elastic scattering –Parameterized models –Bertini Intra-nuclear cascade –Bertini cascade –Binary cascade Hadronic Electromagnetic Subset of results shown here Full set of results in publication coming shortly

Geant4-INFN (Genova-LNS) Team Experimental data CATANA hadrontherapy facility in Catania, Italy –high precision experimental data satisfying rigorous medical physics protocols –Geant4 Collaboration members Validation measurements Markus Ionization chamber 2 mm Sensitive Volume = 0.05 cm 3 Resolution 100  m Markus Chamber

Geant4-INFN (Genova-LNS) Team Geant4 simulation Accurate reproduction of the experimental set-up quantitative This is the most difficult part to achieve a quantitative Geant4 physics validation Geometrybeam Geometry and beam characteristics must be known in detail and with high precision Ad hoc beam line set-up for Geant4 validation to enhance peculiar effects of physics processes E proton = 63.5 MeV  E = 300 keV

Geant4-INFN (Genova-LNS) Team Electromagnetic processes Electromagnetic options  Standard EM  Low Energy EM – ICRU 49  Low Energy EM – Ziegler 1977  Low Energy EM – Ziegler 1985  Low Energy EM – Ziegler 2000

Geant4-INFN (Genova-LNS) Team Electromagnetic processes Standard EM: p, ions, , e- e+p-value CvMKSAD Left branch Right branch Whole curve CvM Cramer-von Mises test KS Kolmogorov-Smirnov test AD Anderson-Darling test 1 M events mm Geant4 Experimental data Standard EM

Geant4-INFN (Genova-LNS) Team Electromagnetic processes Low Energy EM – ICRU49: p, ions Low Energy EM – Livermore: , e- Standard EM:e+p-value CvMKSAD Left branch Right branch Whole curve CvM Cramer-von Mises test KS Kolmogorov-Smirnov test AD Anderson-Darling test 1 M events mm Geant4 Experimental data LowE EM – ICRU49

Geant4-INFN (Genova-LNS) Team Electromagnetic processes Low Energy EM – Ziegler 1977: p, ions Low Energy EM – Livermore: , e- Standard EM:e+ 1 M events mm Geant4 Experimental datap-value CvMKSAD Left branch Right branch Whole curve LowE EM – Ziegler 1977 CvM Cramer-von Mises test KS Kolmogorov-Smirnov test AD Anderson-Darling test

Geant4-INFN (Genova-LNS) Team Electromagnetic processes LowE EM – Ziegler 1985 Low Energy EM – Ziegler 1985: p, ions Low Energy EM – Livermore: , e- Standard EM:e+ Subject to further investigation 1 M events mm Geant4 Experimental data

Geant4-INFN (Genova-LNS) Team Electromagnetic processes Low Energy EM – Ziegler 2000: p, ions Low Energy EM – Livermore: , e- Standard EM:e+ Subject to further investigation 1 M events mm Geant4 Experimental data LowE EM – Ziegler 2000

Geant4-INFN (Genova-LNS) Team Electromagnetic processes Summary p-value LowE ICRU49 LowE Ziegler 1977 Standard Left branch (CvM) Right branch (KS) Whole curve (AD) CvM Cramer-von Mises test KS Kolmogorov-Smirnov test AD Anderson-Darling test LowE – ICRU49 Best EM option: LowE – ICRU49 Selected for further EM + Hadronic tests

Geant4-INFN (Genova-LNS) Team Electromagnetic processes + Elastic scattering Elastic scattering options  HadronElastic process with LElastic model  HadronElastic process with BertiniElastic model  UHadronElastic process with HadronElastic model

Geant4-INFN (Genova-LNS) Team EM + Elastic scattering Low Energy EM – ICRU49: p, ions Low Energy EM – Livermore: , e- Standard EM:e+ LElastic HadronElastic with LElasticp-value CvMKSAD Left branch Right branch Whole curve LowE EM – ICRU49 LElastic CvM Cramer-von Mises test KS Kolmogorov-Smirnov test AD Anderson-Darling test 1 M events mm Geant4 Experimental data

Geant4-INFN (Genova-LNS) Team EM + Elastic scattering Low Energy EM – ICRU49: p, ions Low Energy EM – Livermore: , e- Standard EM:e+ HadronElastic UHadronElastic with HadronElasticp-value CvMKSAD Left branch Right branch Whole curve LowE EM – ICRU49 HadronElastic CvM Cramer-von Mises test KS Kolmogorov-Smirnov test AD Anderson-Darling test 0.5 M events mm Geant4 Experimental data

Geant4-INFN (Genova-LNS) Team Electromagnetic processes + Elastic scattering + Hadronic inelastic scattering Hadronic Inelastic options  Precompound with Default Evaporation  Precompound with GEM Evaporation  Precompound with Default Evaporation + Fermi Break-up  Bertini

Geant4-INFN (Genova-LNS) Team EM + hadronic physics Low Energy EM – ICRU49: p, ions Low Energy EM – Livermore: , e- Standard EM:e+ LElastic HadronElastic with LElastic Precompound Default Evaporation Precompound with Default Evaporationp-value CvMKSAD Left branch Right branch Whole curve LowE EM – ICRU49 LElastic CvM Cramer-von Mises test KS Kolmogorov-Smirnov test AD Anderson-Darling test 1 M events mm Geant4 Experimental data Precompound default

Geant4-INFN (Genova-LNS) Team EM + hadronic physics Standard EM: p, ions, , e- e+ LElastic HadronElastic with LElastic Precompound Default Evaporation Precompound with Default Evaporationp-value CvMKSAD Left branch Right branch Whole curve CvM Cramer-von Mises test KS Kolmogorov-Smirnov test AD Anderson-Darling test 1 M events mm Geant4 Experimental data Standard EM LElastic Precompound default

Geant4-INFN (Genova-LNS) Team EM + hadronic physics Low Energy EM – ICRU49: p, ions Low Energy EM – Livermore: , e- Standard EM:e+ HadronElastic Precompound Default Evaporation UHadronElastic with HadronElastic Precompound with Default Evaporationp-value CvMKSAD Left branch Right branch Whole curve LowE EM – ICRU49 HadronElastic CvM Cramer-von Mises test KS Kolmogorov-Smirnov test AD Anderson-Darling test 0.5 M events mm Geant4 Experimental data Precompound default

Geant4-INFN (Genova-LNS) Team EM + hadronic physics Low Energy EM – ICRU49: p, ions Low Energy EM – Livermore: , e- Standard EM:e+ LElastic HadronElastic with LElastic Precompound GEM Evaporation Precompound with GEM Evaporationp-value CvMKSAD Left branch Right branch Whole curve LowE EM – ICRU49 LElastic CvM Cramer-von Mises test KS Kolmogorov-Smirnov test AD Anderson-Darling test 0.5 M events mm Geant4 Experimental data Precompound with GEM Evaporation

Geant4-INFN (Genova-LNS) Team EM + hadronic physics Low Energy EM – ICRU49: p, ions Low Energy EM – Livermore: , e- Standard EM:e+ LElastic HadronElastic with LElastic Precompound Fermi Break-up Precompound with Fermi Break-upp-value CvMKSAD Left branch Right branch Whole curve LowE EM – ICRU49 LElastic CvM Cramer-von Mises test KS Kolmogorov-Smirnov test AD Anderson-Darling test 0.5 M events mm Geant4 Experimental data Precompound with Fermi Break-up

Geant4-INFN (Genova-LNS) Team EM + hadronic physics Low Energy EM – ICRU49: p, ions Low Energy EM – Livermore: , e- Standard EM:e+ LElastic HadronElastic with LElastic Bertini Inelastic p-value CvMKSAD Left branch Right branch Whole curve LowE EM – ICRU49 LElastic CvM Cramer-von Mises test KS Kolmogorov-Smirnov test AD Anderson-Darling test 1 M events mm Geant4 Experimental data Bertini Inelastic

Geant4-INFN (Genova-LNS) Team EM + hadronic physics Low Energy EM – ICRU49: p, ions Low Energy EM – Livermore: , e- Standard EM:e+ HadronElastic with BertiniElastic Bertini Inelastic p-value CvMKSAD Left branch Right branch Whole curve LowE EM – ICRU49 BertiniElastic CvM Cramer-von Mises test KS Kolmogorov-Smirnov test AD Anderson-Darling test 0.5 M events mm Geant4 Experimental data Bertini Inelastic

Geant4-INFN (Genova-LNS) Team Electromagnetic + Hadronic Summary p-value Standard LElastic Precompound LowE ICRU49 LElastic Precompound GEM LowE ICRU49 LElastic Bertini Inelastic LowE ICRU49 LElastic Precompound Fermi Break-up LowE ICRU49 LElastic Precompound LowE ICRU49 HadronElastic Precompound LowE ICRU49 Bertini Elastic Bertini Inelastic Left branch (CvM) Right branch (KS) Whole curve (AD) Key ingredients electromagnetic  Precise electromagnetic physics elastic scattering  Good elastic scattering model pre-equilibrium  Good pre-equilibrium model

Geant4-INFN (Genova-LNS) Team Conclusion Publication coming soon with complete results Selection of Geant4 physics models (aka PhysicsList) based on quantitative experimental validation, rather than just “educated guess”...2-year project to get there Systematicquantitativeall Systematic, quantitative validation of all Geant4 electromagnetic and hadronic models in the energy range < 100 MeV against high precision experimental data Document Geant4 simulation accuracy Provide guidance for Geant4 use based on objective ground