High Performance Computing (HPC) at Center for Information Communication and Technology in UTM.

Slides:



Advertisements
Similar presentations
SCARF Duncan Tooke RAL HPCSG. Overview What is SCARF? Hardware & OS Management Software Users Future.
Advertisements

Beowulf Supercomputer System Lee, Jung won CS843.
Publishing applications on the web via the Easa Portal and integrating the Sun Grid Engine Publishing applications on the web via the Easa Portal and integrating.
Setting up of condor scheduler on computing cluster Raman Sehgal NPD-BARC.
Dinker Batra CLUSTERING Categories of Clusters. Dinker Batra Introduction A computer cluster is a group of linked computers, working together closely.
Types of Parallel Computers
Information Technology Center Introduction to High Performance Computing at KFUPM.
LinkSCEEM-2: A computational resource for the development of Computational Sciences in the Eastern Mediterranean Mostafa Zoubi SESAME SESAME – LinkSCEEM.
Job Submission on WestGrid Feb on Access Grid.
HIGH PERFORMANCE COMPUTING ENVIRONMENT The High Performance Computing environment consists of high-end systems used for executing complex number crunching.
K.Harrison CERN, 23rd October 2002 HOW TO COMMISSION A NEW CENTRE FOR LHCb PRODUCTION - Overview of LHCb distributed production system - Configuration.
Astronomical GRID Applications at ESAC Science Archives and Computer Engineering Unit Science Operations Department ESA/ESAC.
CPP Staff - 30 CPP Staff - 30 FCIPT Staff - 35 IPR Staff IPR Staff ITER-India Staff ITER-India Staff Research Areas: 1.Studies.
STRATEGIES INVOLVED IN REMOTE COMPUTATION
The BioBox Initiative: Bio-ClusterGrid Gilbert Thomas Associate Engineer Sun APSTC – Asia Pacific Science & Technology Center.
© 2008 The MathWorks, Inc. ® ® Parallel Computing with MATLAB ® Silvina Grad-Freilich Manager, Parallel Computing Marketing
WORK ON CLUSTER HYBRILIT E. Aleksandrov 1, D. Belyakov 1, M. Matveev 1, M. Vala 1,2 1 Joint Institute for nuclear research, LIT, Russia 2 Institute for.
Cloud Computing 1. Outline  Introduction  Evolution  Cloud architecture  Map reduce operation  Platform 2.
ISG We build general capability Introduction to Olympus Shawn T. Brown, PhD ISG MISSION 2.0 Lead Director of Public Health Applications Pittsburgh Supercomputing.
Introduction to the HPCC Jim Leikert System Administrator High Performance Computing Center.
HPC at HCC Jun Wang Outline of Workshop1 Overview of HPC Computing Resources at HCC How to obtain an account at HCC How to login a Linux cluster at HCC.
1b.1 Types of Parallel Computers Two principal approaches: Shared memory multiprocessor Distributed memory multicomputer ITCS 4/5145 Parallel Programming,
BalticGrid-II Project MATLAB implementation and application in Grid Ilmars Slaidins, Lauris Cikovskis Riga Technical University AHM Riga May 12-14, 2009.
March 3rd, 2006 Chen Peng, Lilly System Biology1 Cluster and SGE.
Introduction to the HPCC Dirk Colbry Research Specialist Institute for Cyber Enabled Research.
:: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :: GridKA School 2009 MPI on Grids 1 MPI On Grids September 3 rd, GridKA School 2009.
17-April-2007 High Performance Computing Basics April 17, 2007 Dr. David J. Haglin.
Common Practices for Managing Small HPC Clusters Supercomputing 12
Batch Scheduling at LeSC with Sun Grid Engine David McBride Systems Programmer London e-Science Centre Department of Computing, Imperial College.
Grid MP at ISIS Tom Griffin, ISIS Facility. Introduction About ISIS Why Grid MP? About Grid MP Examples The future.
14 Aug 08DOE Review John Huth ATLAS Computing at Harvard John Huth.
Resource Brokering in the PROGRESS Project Juliusz Pukacki Grid Resource Management Workshop, October 2003.
HPC for Statistics Grad Students. A Cluster Not just a bunch of computers Linked CPUs managed by queuing software – Cluster – Node – CPU.
CCS Overview Rene Salmon Center for Computational Science.
PARALLEL COMPUTING overview What is Parallel Computing? Traditionally, software has been written for serial computation: To be run on a single computer.
CLUSTER COMPUTING TECHNOLOGY BY-1.SACHIN YADAV 2.MADHAV SHINDE SECTION-3.
Technology Vocabulary Words. Understanding the meaning A motherboard is the main circuit board of the computer. Why do you think it is called a motherboard.
Virtualization Technology and Microsoft Virtual PC 2007 YOU ARE WELCOME By : Osama Tamimi.
Tier 3 Status at Panjab V. Bhatnagar, S. Gautam India-CMS Meeting, July 20-21, 2007 BARC, Mumbai Centre of Advanced Study in Physics, Panjab University,
ClinicalSoftwareSolutions Patient focused.Business minded. Slide 1 Opus Server Architecture Fritz Feltner Sept 7, 2007 Director, IT and Systems Integration.
ISG We build general capability Introduction to Olympus Shawn T. Brown, PhD ISG MISSION 2.0 Lead Director of Public Health Applications Pittsburgh Supercomputing.
Running Mantevo Benchmark on a Bare-metal Server Mohammad H. Mofrad January 28, 2016
CIP HPC CIP - HPC HPC = High Performance Computer It’s not a regular computer, it’s bigger, faster, more powerful, and more.
NGS computation services: APIs and.
Microsoft ® Official Course Module 6 Managing Software Distribution and Deployment by Using Packages and Programs.
Evangelos Markatos and Charalampos Gkikas FORTH-ICS Athens, th Mar Institute of Computer Science - FORTH Christos.
FESR Consorzio COMETA Giuseppe Andronico INFN Sez. CT & Consorzio COMETA Workshop Grids vs. Clouds Beijing, Consorzio.
Claudio Grandi INFN Bologna Virtual Pools for Interactive Analysis and Software Development through an Integrated Cloud Environment Claudio Grandi (INFN.
Multicore Applications in Physics and Biochemical Research Hristo Iliev Faculty of Physics Sofia University “St. Kliment Ohridski” 3 rd Balkan Conference.
A Web Based Job Submission System for a Physics Computing Cluster David Jones IOP Particle Physics 2004 Birmingham 1.
CNAF - 24 September 2004 EGEE SA-1 SPACI Activity Italo Epicoco.
CFI 2004 UW A quick overview with lots of time for Q&A and exploration.
Advanced Computing Facility Introduction
High Performance Computing (HPC)
Compute and Storage For the Farm at Jlab
Brief introduction about “Grid at LNS”
HPC Roadshow Overview of HPC systems and software available within the LinkSCEEM project.
Introduction to Parallel Computing: MPI, OpenMP and Hybrid Programming
HPC usage and software packages
White Rose Grid Infrastructure Overview
LinkSCEEM-2: A computational resource for the development of Computational Sciences in the Eastern Mediterranean Mostafa Zoubi SESAME Outreach SESAME,
Grid Computing.
Constructing a system with multiple computers or processors
Overview Introduction VPS Understanding VPS Architecture
CCR Advanced Seminar: Running CPLEX Computations on the ISE Cluster
Advanced Computing Facility Introduction
Overview of HPC systems and software available within
Information Technology Ms. Abeer Helwa
Introduction to High Performance Computing Using Sapelo2 at GACRC
H2020 EU PROJECT | Topic SC1-DTH | GA:
Presentation transcript:

High Performance Computing (HPC) at Center for Information Communication and Technology in UTM

Definition 1)High-performance computing (HPC) uses supercomputers and/or computer clusters to solve advanced computation problems. 2)A computer cluster is a group of linked computers, working together closely thus in many respects forming a single computer. Clusters are usually deployed to improve performance and availability over that of a single computer.

CICT HPC Infrastructure 1) SUN Cluster:  CPU Types = 2 AMD Opteron 2356 (2.3Ghz)  The Number of Nodes (Machine) = 8 units  Memory Size for Each Node = 8GB  The Number of CPUs for Each Node = 6 CPUs  Total Number of CPUs = 8 x 6 = 48 CPUs  Total Storage Size = 11TB  Connections = High Speed Infiniband  Operation Systems = Scientific Linux 5.4  Middleware = Glite 3.2

CICT HPC Infrastructure 2) IBM Cluster:  CPU Types = Intel Xeon DP (3.0GHz)  The Number of Nodes (Machine) = 16 Units  Memory Size on Each Node = 3GB  The Number of CPUs for Each Node = 4 CPUs  Total Number of CPUs = 4 x 16 = 64 CPUs  Total Storage Size = 800GB  Connections = High Speed Myrinet  Operation Systems = Scientific Linux 5.5  Middleware = Glite 3.2

CICT HPC Networking Worldwide Grid Computing

CICIT HPC Connected to Worldwide Grids

Software on CICT HPC Installed: OpenMPI - Message Passing Interface (MPI) library Abaqus – For finite element analysis and computer-aided engineering. – 3 Cores. Matlab Distributed Computing Server 5 – Allows users to submit sequential or parallel Matlab code from their personal machine to a cluster. – 120 Concurrent Users (Basic). – 16 Cores. BNFinder – For Bayesian Network reconstruction in dynamic and static networks. Intel Fortran Composer XE Build high-performance serial and parallel applications for multicore.

Software on CICT HPC Will be installed soon: OpenFoam – Computational fluid dynamics toolbox. Blast - Basic local alignment search tool. ANSYS/Fluent: – Computational fluid dynamics for optimization of product development and processes. – 5 concurrent license, includes 25 Ansys Academic Research HPC licenses. License server. – Number of node limits (CFX & Fluent) : limited by hardware License server. Abaqus – For finite element analysis and computer-aided engineering. – 24 Cores. – Packaged for 20 users with unlimited research license. Gromacs A molecular dynamics package primarily designed for biomolecular systems.

Services Provided by CICT HPC 1) CPU 2) Storage 3) Software

Policy on CICT HPC User Account: 1.Each user is required to have ACID account before applying to use the HPC and Grid. 2.Every application needs to be included letter of support supervisor. 3.This facility is provided according to the duration of the project application. Storage: a.The CICT did not provide large storage to users. So, this storage space is limited to processes related to their applications, like data, programs and software. b.Saving running result (output) in the storage is temporary. Users need to quickly download the output results after job has been processed. c.Data which is no longer used need to be removed immediately.

Policy on CICT HPC Submit and Run Jobs: Job that you wish to submit is only the job that related to the projects in Universiti Teknologi Malaysia and gives benefits to the university. If the job is submitted does not related to the university, we are entitled to terminate your use of HPC and Grid facilities. Maximum 1 running job is one week. If more, need to ask special request. Maximum for each user, can submit only 10 jobs on a particular time. Consumer need to always check the job status to prevent a long pending job in case of the job has an error. Output stored in storage is for temporary, the users need to immediately store the output backups on elsewhere after the job processing has been completed. CICT will not be responsible on output and backups loss.

Policy on CICT HPC Software: 1) Install software/tool in your user directory a.Users are allowed to install their own software in their own respective directories on the condition of installed software is related to applications that use or wish to be used. b.Users need to download the software and install it by theirselves. 2) Install software / tool in directory which requires superuser access: a.Users have to fill up and complete an installing software application form that could be downloaded online. This form contains complete information about the software that wish to be installed such as, software name, version, website and so on. b.Users need to download the software and installation guide before handing over the next task of installing it to the CICT party.

Policy on CICT HPC Acknowledgment: 1.Please put CICT UTM name in your publication that used CICT HPC services as follows (for example): We would like to thank Center for Information and Communication Technology (CICT) in Universiti Teknologi Malaysia for supporting and providing facilities and services of high performance computing.

Access CICT HPC INTERNET / VPN / LAN Clients / Users CICT HPC

Access CICT HPC Job 1 Job 2 Job 3 Manager Processing Job 1 Processing Job 2 Processing Job 3 Heavy job 1 Manager Processing Sub-Job 1 Clients / Users CICT HPC

Access CICT HPC 1) Grid User Account Example form 2)HPC User Account Apply user account:

Procedure to Apply Grid User Accounts

Access CICT HPC 1) Using Putty software To submit jobs and give Linux/Unix commands Download at 2)Using WinSCP software To upload and download files/folders Download at Option 1: Address to access (grid user): ui.utmgrid.utm.my Option 2: Address to access (HPC user): ce.utmgrid.utm.my

Access CICT HPC Using Putty to access CICT HPC

Access CICT HPC Using WinSCP to access CICT HPC

Thank you