Advanced Computing and Grid Infrastructure in Australia ISGC April 2005 Taiwan John O’Callaghan Executive Director Australian Partnership for Advanced Computing

Australian Partnership for Advanced Computing Partners: Australian Centre for Advanced Computing and Communications (ac3) in NSW CSIRO Queensland Parallel Supercomputing Foundation (QPSF) Interactive Virtual Environments Centre (IVEC) in WA South Australian Partnership for Advanced Computing (SAPAC) The Australian National University (ANU) The University of Tasmania (TPAC) Victorian Partnership for Advanced Computing (VPAC) “providing advanced computing and grid infrastructure for e-Research”

Usage –mainly biology, chemistry, physics –currently 247 projects and 722 users (27 universities) Computing Systems –SGI Altix 3700 Bx2 system (mid-2005) 1680 processors –HP AlphaServer SC ES processors –Dell Linux cluster 150 processors Mass Data Storage System (MDSS) –Hierarchical Storage Management SAM-FS –Storagetek (robotic silo) tape library Capable of a petabyte (10 15 bytes) of storage Visualisation Systems –Virtual reality systems –Access Grid rooms Staff –User support –Systems support –Computational tools and techniques –Large-scale data collection management APAC National Facility

APAC National Grid allow easier access to APAC facilities –one virtual system of computational facilities –single ‘sign-on’ to the computing systems –portals and workflow to access applications software and data –secure infrastructure authorisation, authentication, accounting support participation in international programs –compatibility with grids in other countries significant human resource investment –involves about 100 people –started in 2004…….

APAC Grid Interfaces Other Grids: Institutional National International Other Grids: Institutional National International Data Centres Instruments Research Teams Sensor Networks VPAC QPSF TPAC IVEC APAC NATIONAL FACILITY ANU CSIRO SAPAC AC3

Astronomy Grids APAC National Grid Infrastructure APAC National Grid Infrastructure Context of APAC Grid International Infrastructure International Infrastructure Institutional Infrastructure Institutional Infrastructure Bio-Grids Earth Systems Grids Geosciences Grids HEP Grids

Australia is well-connected

APAC Grid Infrastructure Computing Infrastructure –APAC certificate authority –VDT middleware (Globus) –meta-scheduling (PBS-based) –system monitoring and management –job distribution for parameter searches (NIMROD/G) Information Infrastructure –storage resource broker (SRB) –metadata management support (XML-based) –resource discovery User Interfaces and Visualisation Infrastructure –Gridsphere-based portals –workflow engines –collaborative visualisation tools (RVS,…)

APAC Grid Application Projects High-Energy Physics Astronomy Earth Systems Science Computational Chemistry Bioinformatics Geosciences

Experimental High-Energy Physics Belle Experiment –K.E.K. B-factory –Australian grid for Belle data exploiting Globus 2.x, SRB data grid based at APAC National Facility move to APAC Grid infrastructure Atlas Experiment –Large Hadron Collider (LHC) at CERN –Deployed LCG toolkit, will follow EGEE –Plan for Tier 2 facility in Australia –more in Glenn Moloney’s talk tomorrow….. APAC Grid

Astronomy MACHO Project –Largest on-line astrophysical data set in Australia ~10TB Data collected over ~10 years –Hosted on APAC MDSS and part of IVO collection Currently using Z39.50 metadata standard –Mapping metadata to VOTable 1.0 standard Emerging IVO metadata standard –wwwmacho.anu.edu.au Australian Virtual Observatory –efficient, uniform access to key astronomical data collections 2dFGRS, HIPASS, ATCA-OA, SUMSS, MACHO, TNO, ROTSE-III, WFI, S4, … – International Virtual Observatory –SIAP service for ATCA Phoenix Deep Field Survey (PDFS) SIAP is an International Virtual Observatory Alliance (IVOA) access protocol – APAC Grid

Earth Systems Science Data Products –CSIRO Inter-governmental Panel Climate Change scenarios (3Tb) –Ocean Colour Products of Australasian and Antarctic region MODIS and SeaWIFS (10Tb) –TPAC 1/8 degree ocean simulations (2-4Tb) –BMRC research products (~1-4Tb) –ACE CRC Earth Systems Simulations –Terrestrial Land Surface Data Grid Services –Globus based version of OPeNDAP –analysis tools for OPeNDAP data sets GRADS OPeNDAP server, NOMADS –Client side visualisation from OPeNDAP servers –THREDDS (catalogues of OPeNDAP repositories) APAC Grid

Chemistry Portal to chemistry software packages –Gridsphere-based portal to APAC Grid –Gaussian, Amber, Gamess-US, Gromacs, Mopac and Molpro APAC Grid

APAC Grid Architecture NETWORKS COMPUTING, STORAGE, VISUALISATION SYSTEMS SECURITY GENERIC GRID MIDDLEWARE APPLICATION GRID MIDDLEWARE WORKFLOW PORTALS ?