Status of UTA IAC + RAC Jae Yu 3 rd DØSAR Workshop Apr. 7 – 9, 2004 Louisiana Tech. University.

Slides:



Advertisements
Similar presentations
4/2/2002HEP Globus Testing Request - Jae Yu x Participating in Globus Test-bed Activity for DØGrid UTA HEP group is playing a leading role in establishing.
Advertisements

Southwest Tier 2 Center Status Report U.S. ATLAS Tier 2 Workshop - Harvard Mark Sosebee for the SWT2 Center August 17, 2006.
McFarm: first attempt to build a practical, large scale distributed HEP computing cluster using Globus technology Anand Balasubramanian Karthik Gopalratnam.
Amber Boehnlein, FNAL D0 Computing Model and Plans Amber Boehnlein D0 Financial Committee November 18, 2002.
Duke Atlas Tier 3 Site Doug Benjamin (Duke University)
HEP Prospects, J. Yu LEARN Strategy Meeting Prospects on Texas High Energy Physics Network Needs LEARN Strategy Meeting University of Texas at El Paso.
Report : Zhen Ming Wu 2008 IEEE 9th Grid Computing Conference.
DOSAR SURA Cyberinfrastructure Workshop: "Grid Application Planning & Implementation" Texas Advanced Computing Center (TACC) University of Texas at Austin.
High Energy Physics At OSCER A User Perspective OU Supercomputing Symposium 2003 Joel Snow, Langston U.
Remote Production and Regional Analysis Centers Iain Bertram 24 May 2002 Draft 1 Lancaster University.
UTA Site Report Jae Yu UTA Site Report 4 th DOSAR Workshop Iowa State University Apr. 5 – 6, 2007 Jae Yu Univ. of Texas, Arlington.
TechFair ‘05 University of Arlington November 16, 2005.
November 7, 2001Dutch Datagrid SARA 1 DØ Monte Carlo Challenge A HEP Application.
UTA Site Report Jae Yu UTA Site Report 2 nd DOSAR Workshop UTA Mar. 30 – Mar. 31, 2006 Jae Yu Univ. of Texas, Arlington.
DØSAR, State of the Organization Jae Yu DOSAR, Its State of Organization 7th DØSAR (3 rd DOSAR) Workshop University of Oklahoma Sept. 21 – 22, 2006 Jae.
Status of DØ Computing at UTA Introduction The UTA – DØ Grid team DØ Monte Carlo Production The DØ Grid Computing –DØRAC –DØSAR –DØGrid Software Development.
DOSAR Workshop Sept , 2007 J. Cochran 1 The State of DOSAR Outline What Exactly is DOSAR (for the new folks) Brief History Goals, Accomplishments,
High Energy Physics at UTA UTA faculty Andrew Brandt, Kaushik De, Andrew White, Jae Yu along with many post-docs, graduate and undergraduate students investigate.
The Texas High Energy Grid (THEGrid) A Proposal to Build a Cooperative Data and Computing Grid for High Energy Physics and Astrophysics in Texas Alan Sill,
DOSAR VO ACTION AGENDA ACTION ITEMS AND GOALS CARRIED FORWARD FROM THE DOSAR VI WORKSHOP AT OLE MISS APRIL 17-18, 2008.
A Design for KCAF for CDF Experiment Kihyeon Cho (CHEP, Kyungpook National University) and Jysoo Lee (KISTI, Supercomputing Center) The International Workshop.
Jan. 17, 2002DØRAM Proposal DØRACE Meeting, Jae Yu 1 Proposal for a DØ Remote Analysis Model (DØRAM) IntroductionIntroduction Remote Analysis Station ArchitectureRemote.
DØ RAC Working Group Report Progress Definition of an RAC Services provided by an RAC Requirements of RAC Pilot RAC program Open Issues DØRACE Meeting.
DOSAR Workshop at Sao Paulo Dick Greenwood What’s Next for DOSAR? Dick Greenwood Louisiana Tech University 1 st DOSAR Workshop at the Sao Paulo, Brazil.
DØ RACE Introduction Current Status DØRAM Architecture Regional Analysis Centers Conclusions DØ Internal Computing Review May 9 – 10, 2002 Jae Yu.
International Workshop on HEP Data Grid Nov 9, 2002, KNU Data Storage, Network, Handling, and Clustering in CDF Korea group Intae Yu*, Junghyun Kim, Ilsung.
Status of Grid-enabled UTA McFarm software Tomasz Wlodek University of the Great State of TX At Arlington.
Spending Plans and Schedule Jae Yu July 26, 2002.
RAL Site Report John Gordon IT Department, CLRC/RAL HEPiX Meeting, JLAB, October 2000.
26SEP03 2 nd SAR Workshop Oklahoma University Dick Greenwood Louisiana Tech University LaTech IAC Site Report.
DØSAR a Regional Grid within DØ Jae Yu Univ. of Texas, Arlington THEGrid Workshop July 8 – 9, 2004 Univ. of Texas at Arlington.
Sep 02 IPP Canada Remote Computing Plans Pekka K. Sinervo Department of Physics University of Toronto 4 Sep IPP Overview 2 Local Computing 3 Network.
ISU DOSAR WORKSHOP Dick Greenwood DOSAR/OSG Statement of Work (SoW) Dick Greenwood Louisiana Tech University April 5, 2007.
From DØ To ATLAS Jae Yu ATLAS Grid Test-Bed Workshop Apr. 4-6, 2002, UTA Introduction DØ-Grid & DØRACE DØ Progress UTA DØGrid Activities Conclusions.
High Energy Physics & Computing Grids TechFair Univ. of Arlington November 10, 2004.
LTU Site Report Dick Greenwood LTU Site Report Dick Greenwood Louisiana Tech University 1 st DOSAR Workshop at Sao Paulo September 16-17, 2005.
THEGrid Workshop Jae Yu THEGrid Workshop UTA, July 8 – 9, 2004 Introduction An Example of Existing Activities What do we want to accomplish at the workshop?
U.S. ATLAS Computing Facilities Bruce G. Gibbard GDB Meeting 16 March 2005.
DØRACE Workshop Jae Yu Feb.11, 2002 Fermilab Introduction DØRACE Progress Workshop Goals Arrangements.
UTA MC Production Farm & Grid Computing Activities Jae Yu UT Arlington DØRACE Workshop Feb. 12, 2002 UTA DØMC Farm MCFARM Job control and packaging software.
DCAF (DeCentralized Analysis Farm) Korea CHEP Fermilab (CDF) KorCAF (DCAF in Korea) Kihyeon Cho (CHEP, KNU) (On the behalf of HEP Data Grid Working Group)
Feb. 14, 2002DØRAM Proposal DØ IB Meeting, Jae Yu 1 Proposal for a DØ Remote Analysis Model (DØRAM) Introduction Partial Workshop Results DØRAM Architecture.
Outline  Higgs Particle Searches for Origin of Mass  Grid Computing  A brief Linear Collider Detector R&D  The  The grand conclusion: YOU are the.
CD FY09 Tactical Plan Status FY09 Tactical Plan Status Report for Neutrino Program (MINOS, MINERvA, General) Margaret Votava April 21, 2009 Tactical plan.
International Workshop on HEP Data Grid Aug 23, 2003, KNU Status of Data Storage, Network, Clustering in SKKU CDF group Intae Yu*, Joong Seok Chae Department.
The State of DOSAR DOSAR VI Workshop at Ole Miss April Dick Greenwood Louisiana Tech University.
Computing Issues for the ATLAS SWT2. What is SWT2? SWT2 is the U.S. ATLAS Southwestern Tier 2 Consortium UTA is lead institution, along with University.
MC Production in Canada Pierre Savard University of Toronto and TRIUMF IFC Meeting October 2003.
DOSAR Roadmap Jae Yu DOSAR Roadmap 5 th DOSAR Workshop Louisiana Tech University Sept. 27 – 28, 2007 Jae Yu Univ. of Texas, Arlington LHC Tier 3 Efforts.
Feb. 13, 2002DØRAM Proposal DØCPB Meeting, Jae Yu 1 Proposal for a DØ Remote Analysis Model (DØRAM) IntroductionIntroduction Partial Workshop ResultsPartial.
UTA Site Report Jae Yu UTA Site Report 7 th DOSAR Workshop Louisiana State University Apr. 2 – 3, 2009 Jae Yu Univ. of Texas, Arlington.
Jianming Qian, UM/DØ Software & Computing Where we are now Where we want to go Overview Director’s Review, June 5, 2002.
LTU Site Report Dick Greenwood LTU Site Report Dick Greenwood Louisiana Tech University DOSAR II Workshop at UT-Arlington March 30-31, 2005.
Apr. 25, 2002Why DØRAC? DØRAC FTFM, Jae Yu 1 What do we want DØ Regional Analysis Centers (DØRAC) do? Why do we need a DØRAC? What do we want a DØRAC do?
July 10, 2002DØRACE Status Report, Jae Yu DØ IB Meeting, OU Workshop 1 DØ RACE Status Report Introduction Software Distribution (DØRACE Setup) Hardware.
OSG All Hands Meeting P. Skubic DOSAR OSG All Hands Meeting March 5-8, 2007 Pat Skubic University of Oklahoma Outline What is DOSAR? History of DOSAR Goals.
6th DOSAR Workshop University Mississippi Apr. 17 – 18, 2008
Southwest Tier 2 Center Status Report
5th DOSAR Workshop Louisiana Tech University Sept. 27 – 28, 2007
DOSAR: State of Organization
Preparations for the CMS-HI Computing Workshop in Bologna
High Energy Physics at UTA
High Energy Physics at UTA
DØ MC and Data Processing on the Grid
News p has no fetchpkgs.sh and fetchprod.sh shell script in the .../D0reltools/ These are missing due to the switch over to the new distribution.
DØ Internal Computing Review
News Learned at the OU workshop that we need further split of releases
DØ RAC Working Group Report
Proposal for a DØ Remote Analysis Model (DØRAM)
HEP Data Grid for DØ and Its Regional Grid, DØ SAR
Presentation transcript:

Status of UTA IAC + RAC Jae Yu 3 rd DØSAR Workshop Apr. 7 – 9, 2004 Louisiana Tech. University

Apr. 7, 2004UTA Status, J. Yu 3 rd DØSAR Workshop, LTU 2 UTA IAC MC Farm and Analysis Resources Have two independent farms –Swift farm (HEP) 22 dual P3 900MHz 250Mbyte/cpu A total of.6TB disk space Generated a total of 3.6M events w/ mcp14 –CSE Farm 10 P3 900MHz cpu’s w/ 128M memory Retired  Split into two separate farms for CSE Grid computing project Generated ~1M events w/ mcp14 Analysis Machines –Four desktop machines of ~2GHz + 0.5GB each –Storage space ~0.4TB

Apr. 7, 2004UTA Status, J. Yu 3 rd DØSAR Workshop, LTU 3 The UTA-DØ Grid Team We’ve been working well with CSE colleagues Faculty: 2 HEP + 1 CSE Senior Research Associate: 0.1 FTE Research Associate: 1 FTE at FNAL Software Program Consultant: ½ FTE Engineering MS Students: 1 Physics Undergraduate Student: 2

Apr. 7, 2004UTA Status, J. Yu 3 rd DØSAR Workshop, LTU 4 UTA Software Products McFarm Job control (Drew Meyer) –As of this workshop, McFarmDST’s re-processed output are certified Ganglia resource monitoring (D. Jenkins) –Contains 7 farms (>350 CPU’s), including Tata institute, India McFarmGraph: Simulation production job monitoring system using gridftp (Aditya Nishanda, Sankalp Jain) –Provides detailed information for a MC request McPerM: MC Farm Performance Monitoring –Langston took this over Job Manager McFarm (JMM) for SAM/Grid interface (HyunWoo Kim)

Apr. 7, 2004UTA Status, J. Yu 3 rd DØSAR Workshop, LTU 5 UTA – RAC 100 P4 Xeon 2.6GHz CPU = 260 GHz 64TB of Disk space 84 P4 Xeon 2.4GHz CPU = 202 GHz 7.5TB of Disk space Total CPU: 462 GHz Total disk: 73TB Total Memory: 168Gbyte Network bandwidth: 68Gb/sec

Apr. 7, 2004UTA Status, J. Yu 3 rd DØSAR Workshop, LTU 6 UTA – RAC Joint HEP and CSE project –HEP DØ Regional Analysis Center –ATLAS DC Production –Grid 2003 test bed –Video streaming –Database research –Skin resin image database Brought online at the end of October, 2003 DØ MC Production begun at the end of Nov Generated and delivered over 7M events  1.75M/Mo (Double the DØ capacity in 2003)

Apr. 7, 2004UTA Status, J. Yu 3 rd DØSAR Workshop, LTU 7 Future Projects Through the end of May: Participate in TMBfix #2 –20% of the total will be fixed at DPCC –First step toward the analysis at UTA – RAC –The fixed TMB will be 100% stored at UTA McFarm (Meyer + Jenkins) –Incorporate TMB fix –Test RAW reprocessing in the summer –Improve performances –Develop utilities

Apr. 7, 2004UTA Status, J. Yu 3 rd DØSAR Workshop, LTU 8 Future Projects Inclusion of JMM into SAM/Grid regular release Installation of calibration database proxy at UTA Participate in DØSAR grid MC production MySQL McFarm Monitoring Database for both McFramGraph and McPerM (Jenkins) Automated MC Request download and production Storage and refreshment of TMB data at RAC Prepare for regional analysis

Apr. 7, 2004UTA Status, J. Yu 3 rd DØSAR Workshop, LTU 9 Conclusions DØSAR has been the driving force for the great progress last 6 mo McFarm improvement is in its mature state –Ready to participate in any DØ activities SAM/Grid and McFarm are interfaced –Official request is being processed Some analyses have been performed at UTA IAC + RAC UTA – RAC has been online for the past four months  Immediately doubled the entire DØ 2003 capacity We are ready for grid based MC production First proposal (PHANTOM) as the collaborative effort went in  Must try for more