1. GRID Deployment Status and Plan at KEK ISGC2007 Takashi Sasaki KEK Computing Research Center

2. ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 2 Who we are? KEK (High Energy Accelerator Research Organization) Inter University Research Institute Corporation since 2004 National Institute previously Still 100% funded by the government Mission Carry out research related accelerator science Particle Physics, Material Science, Life Science and so on Supporting collaborating universities Universities have a freedom for the choice and they can be independent of us

3. ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 3 KEK Nagoya U. U. Tokyo Tokyo Inst. of Tech. Tsukuba U. Osaka U. ICRR/Tpkyo Kyoto U. JAEA Tokai Waseda U. Hiroshima U Niigata U. Nara Women U. Osaka city U. Shinshu U. RIKEN Okayama U. Kobe U. Kanazawa U. Kamioka SuperSINET nodes SINET nodes High Energy Physics in Japan ATLAS at LHC CDF at FNAL KEK BELLE J-PARC KamLand SuperKamiokande Tohoku U. Tokyo Metropolitan U. Major High Energy Activities in Japan Terminated in the JFY2005 K2K Experiment at Kamiokande and KEK Active Experiments Belle Experiment at KEK KamLAND at Kamioka CDF at FermiLab/USA Under construction J-PARC T2K Experiment at Tokai and Kamioka ATLAS and ALICE at LHC Future Plan SuperB Factory International Linear Collider (ILC) HEPnet-J: High Energy Physics Network in Japan KEK provides the network facility, NEPnet-J, on the SINET/SuperSINET (NII) 。

4. ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 4 Tsukuba Tokai High Energy Accelerator Research Organization J-PARC B-Factory Photon-Factory LC-Test Facility Narita Airport

5. ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 5 KEKB e + e - Collider e + source Ares RF cavity SCC RF(HER) ARES (LER) 3.5 GeV e + 8 GeV e - B 0  J/  K S Observation of CPV in the B meson system Observation of CPV in the B meson system Belle Experiment 13 countries, 57 institutes, ~400 collaborators

6. ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 6 Strategy on GRID deployment Highest priority is support on Belle and ILC LCG deployment Help Universities to start over R&D Preparing for ILC Japan has strong will to host ILC NAREGI Japanese flagship project on developing a GRID middleware May substitute LCG/gLite in the future GRID interoperability is the key

7. ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 7 LCG at KEK Computer Systems related Central Information System since Feb. 20. 2006 Central Computer System ■ GRID System ■ Mail System, etc. B Factory Computer System since Mar. 23. 2006 CPU : 45,662 SI2K rate ■ Disk : 1 PB ■ Tape : 3.5 PB 1 st Phase KEK Grid CA approved by APGRID PMA and has been in operation since Jan. 2006. The third official Grid CA in Japan NAREGI CA software was modified to use at KEK. KEK employee and their collaborators are eligible for this service. LCG and SRB for production usage are available on the GIRD System not for public usage, but for supporting projects WN: 36 nodes x 2 =72 CPU Storage: Disk (2TB) + HPSS(~200TB) Supported VO: Belle, APDG, Atlas_J in operation since May 2006 2 nd Phase since Jan. 2007, LCG is going to be deployed in the Belle production.

8. ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 8 LCG Sites at KEK JP-KEK-CRC-01JP-KEK-CRC-01 since Nov. 2005. since Nov. 2005. Site Role: Site Role: Experimental Experimental Resource and Component: Resource and Component: SL-3.0.5 w/ gLite-3.0 later SL-3.0.5 w/ gLite-3.0 later CPU: 14, Storage: ~1.5TB CPU: 14, Storage: ~1.5TB FTS, FTA, RB, MON, BDII, LFC, CE, SE FTS, FTA, RB, MON, BDII, LFC, CE, SE Supported VOs: Supported VOs: belle, apdg, g4med, ppj, dteam, ops and ail belle, apdg, g4med, ppj, dteam, ops and ail JP-KEK-CRC-02JP-KEK-CRC-02 since early 2006. since early 2006. Site Role: Site Role: Production Production Resource and Component: Resource and Component: SL or SLC w/ gLite-3.0 later SL or SLC w/ gLite-3.0 later CPU: 48, Storage: ~1TB (w/o HPSS) CPU: 48, Storage: ~1TB (w/o HPSS) Full components Full components Supported VOs: Supported VOs: belle, apdg, g4med, atlasj, ppj, ilc, dteam, ops and ail belle, apdg, g4med, atlasj, ppj, ilc, dteam, ops and ail 8 We depends on services by APROC members in ASGC, Taiwan.

9. ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 9 Belle GRID LCG services are provided by the Central Computer system Only storage system is used in B Factory computer system Almost the same size of LHC tier-1 centers CPU’s are served in the future JP-KEK-CRC-02 is the production site Belle data is exported by SRB-DSI Very useful to export existing data SRB-SRM is desirable still iRODs?

10. ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 10 LCG at KEK (2) Data Trans in Belle Grid CRC-01 CRC-02 HPSS Disk/HSM AS(Taiwan) Melbourne LCG/gLite SRB-DSI B Factory-system SRB MCAT SRB server File servers WS Kracow CPUs SRB filesLocal files Nagoya Grid files Grid-system

11. ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 11 11 B Factory Computer System - New B Factory Computer System since March 23. 2006 - History of B Factory Computer System Moore’s Law: 1.5y=x2.0 4y=x~6.3 5y=x~10

12. ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 12 Total Number of Jobs at KEK in 2006 12 JP-KEK-CRC-01JP-KEK-CRC-01JP-KEK-CRC-02JP-KEK-CRC-02 200 700 400 1,000 1,400 BELLEBELLEBELLEBELLE

13. ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 13 Total CPU Time at KEK in 2006 (Normalized by 1kSI2K) 13 JP-KEK-CRC-01JP-KEK-CRC-01JP-KEK-CRC-02JP-KEK-CRC-02 4,000 3,000 1,000 [hrs kSI2K] 12,000 10,000 4,000 BELLEBELLEBELLEBELLE

14. ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 14 JLCG Sponsored by the s-Science promotion program of National Institute of Informatics LCG federation among Japanese Universities and KEK Nagoya: ATLAS, Belle University of Tohoku :ILC, KamLand University of Tsukuba :ATLAS, ILC Kobe University: ATLAS, ILC Hiroshima Institute of Tech.: ATLAS, Information science KEK: Belle, ILC, ATLAS… KEK behaves as GOC

15. ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 15 NAREGI at KEK NAREGI National Research GRID Initiative What we expect? Better quality Better functionality Job submissions with NAREGI is almost 3times faster than gLite3 now Better support We may substitute LCG/gLite with NAREGI if NAREGI works as advertised GRID interoperability is the key We are working together with NAREGI for this issue Support on operation and application adoption is necessary LCG is very excellent in support on deployment and operations

16. ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 16 NAREGI at KEK (2) NAREGI-beta test bed 6nodes+3nodes(DG) Installation Naregi-beta 1.0 : Nov. 2006 Information, PSE, WFT, GVS Naregi-DG : Feb 2007 Test by Application P152 (Heavy ion) experiment Data analysis data processing, then stored the results to SRB through SRB-DSI gate way Belle event simulation We found several inconvenient differences between gLite and NAREGI ask NAREGI group to improve nrg05 nrg00 nrg03 nrg01 nrg09 nrg02 nrg04 Portal node: Super Scheduler:SS Inforamtion Server:IS Grid VM Sever:GVM GridVM engine node-1 GridVM engine node-2 User Manag. Serv.: VOMS nrg10 nrg11 Gfarm FS DG MCS (Metadata) DG RMS (Resource Manag.)

17. ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 17 GRID at KEK GRID environment at KEK gLite/ CRC-01 gLite/ CRC-02 HPSS gLite/EGEE SRB-DSI SRB MCAT SRB server CPUs SRB files Local files Grid files Naregi-kek 2007.2.9

18. ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 18 Plan More production use of LCG Belle Collaboration with ASGC, National Central Univeristy(Taiwan), U. of Melborne, Krakow and so on ILC GRID Collaboration with CC-IN2P3 Start with CALICE NAREGI-LCG(gLite) interoperability More tests locally and discussion with NAREGI Seeking a possible scenario to have a tier-1 center in Japan in the future (2012?) Good practice for hosting the tier-0 center of ILC

19. ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 19 Collaboration in Asia Pacific Belle GRID was established by the collaboration of people in Asia Pacific ASGC. KNU Korea, NCU Taiwan and U. of Melbourn We depends on efforts of ASGC very much for the operation of LCG We sent our stuffs to ASGC for their training We seek further collaboration in this region LCG operation Anyone who has interests in NAREGI deployment? (anybody, not only people in this region)

20. ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 20 Summary KEK Grid CA (member of APGRID PMA) LCG JP-KEK-CRC-01 and 02 Belle Experiment B Factory Computer System Size ： Tier1 level LCG deployment share the simulation data among the collaborating institutions near future: share the experimental data and mutual job submission JLCG Tohoku U. / Tsukuba U./ Kobe U./ Hiroshima Tech. / Nagoya U. / KEK NAREGI at KEK NAREGI-beta Test bed Test by the data analysis program Usage of SRB through SRB-DSI Installation of NAREGI-DG in progress From now on Test of NAREGI-DG Test of Interoperability between gLite and NAREGI

21. ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 21 Acknowledgements We thank ASGC for their great support on the LCG/gLite operation A.E. Chen, Hide Nakazawa (NCU Taiwan), Glenn Moloney, Marco La Rosa (U. of Melbourne), Simon Lin and his stuffs at ASGC helped us for Belle GRID. We appreciate very much for them. We thank people in NAREGI for their supports on us