Jefferson Lab Site Report Sandy Philpott Thomas Jefferson National Accelerator Facility (formerly CEBAF - The Continuous Electron Beam Accelerator Facility) Newport News, Virginia USA HEPiX -RAL, 4/14/99

FS1,2,7 - NetApp /home,/apps, /group,/site FS3/4,5/6 - Symbios /work SUN E4000 OSM Symbios /stage CIFS (NetApp) NFS JLABN* NT Domain JLABA/H/S Central Computing IFARMA/H/L/S Interactive farm FARMA/L/S Batch farm - LSF Jefferson Lab Common User Environment (CUE) STK Redwoods Mass Storage DAQ Specialized Workgroup Clusters NFS Central Fileservers OS: A-AIX H-HP-UX L-Linux RH5.2 N-NT 4.0 S-Solaris 2.6 GP EP both Network: RAServer jput/jget DLT jukebox jexport

Systems Common User Environment –UNIX Solaris - stable; 2.6 Linux - growing; farm and user desktop; RH 5.2 HP-UX - no new systems; (still a lot around) AIX - no new systems; (very few) Ultrix - gone! –NT still no physics computing; desktop only Password synchronization? –Syntunix Technologies’ Passync? –(DCE)

Software /usr/local/bin - local to each node - still required? /apps/bin - in user’s path; platform specific; can be local or from central fileservers; lots of links –./command -> /apps/package/bin/command /apps/package –./v1/bin –./v2/bin –PRO -> v1 –bin -> PRO/bin –lib -> PRO/lib “use package/v1” to change between versions Only the PRO link needs to be changed to change between software versions

Physics Computing RAID - Total of 3TB - Symbios hardware Farming –20 additional Linux dual-processors –LSF licensing an issue Mass Storage –CA OSM upgrade for Y2K - tested - OK CA support ends 9/99 - follow on? –STK silo last 2 Redwoods, total of 8; follow-on? Media problems - tape copies?

JLab Batch Farm Quad SUN E GB 270GB Redwood Tape Drives Gigabit Ethernet SCSI-2 FWD SCSI-2 UWD stage Fast Ethernet Gigabit Ethernet SCSI2 FWD SCSI2 UWD Fast Ethernet Dual IBM RS6000 Qty. 4 18GB FWD 18GB FWD Dual PII 300MHz Qty. 11 Dual PII 400MHz Qty GB UWS Dual Sun Ultra2 Qty. 4 18GB FWD Dual PII 450MHz Qty GB UWS Cisco Cat 5500 Fast Ethernet Dual Sun E3000 Qty. 2 18GB FWD

Data Path from Halls A and C Cisco Cat 5500 Cisco Cat 5500 SUN E4000 SUN Ultra2300 SUN Ultra2300 4X18GB 324GB 270GB Redwood tape drives Gigabit Ethernet Fast Ethernet SCSI-2 FWD SCSI-2 UWD HallA DAQHallC DAQ stage 1) Write raw data locally 2) Copy raw data to MSS stage disk 3) Copy staged raw data files to tape Fast Ethernet Gigabit Ethernet SCSI2 FWD SCSI2 UWD

Data Path to the SILO from HallB Cisco Cat 5500 Cisco Cat 5500 SUN E4000 SUN E3000 4X30GB Redwood tape drives Gigabit Ethernet Fast Ethernet SCSI-2 FWD CLAS DAQ Fibre Channel Fast Ethernet Gigabit Ethernet SCSI2 FWD Fibre Channel ) Write raw data locally on the DAQ system 2) Unmount the full raw data disk from the DAQ system 3) Mount the full raw data disk on the MSS system 4) Copy raw data files to tape 5) Unmount the raw data disk on the MSS system 6) Mount the raw data disk on DAQ system 2,5,6

Security SSH, Secure IMAP –get rid of clear-text passwords! DMZ almost complete –limited Internet access to machines Host monitoring scripts widely implemented –runs on ALL standalone machines –no privilege required Network Intrusion Detector –from US DOE CIAC

Monitoring Project is underway to consolidate and unify system and network monitoring using –HP Openview Network Node Manager –Mon Web interface –Regular UNIX system accounting –locally developed security scripts for standalone systems

High Performance Computing New computing department 20 single-processor Alpha XP1000 initially RH 5.2 “cluster supercomputing” commodity hardware next generation parallel software development Lattice QCD, simulation, data analysis applications

Looking Ahead... Replacements for –OSM –Redwoods –LSF High Performance Computing project Hall D: 40MB/sec (4x Hall B data rate)