DoSon Grid Computing School, Current State of Grid Computing Researches and Applications in Vietnam Vu Duc Thi 1, Nguyen Thanh Thuy 2, Tran Van Lang 3 Vu Duc Thi 1, Nguyen Thanh Thuy 2, Tran Van Lang 3 1 Institute of Information Technology 2 Hanoi University of Technology 3 Institute of Information Technology HCMC On behalf of the members of the VNGrid Project

2 Outline Researches on grid computing in Vietnam Researches on grid computing in Vietnam –Centers for High Performance Computing –HPC/GC Research activities Towards a grid infrastructure for Vietnam Towards a grid infrastructure for Vietnam –VNGrid project –The aims –Planed activities Initial results: Initial results: –data grid for meteorology –data grid for bioinformatics Conclusion Conclusion

3 Grid computing in Vietnam Initial step Initial step –since a few last years –several HPC centers in Hanoi and HCM City  Hanoi University of Technology, 1999  Institute of Information Technology, HCM City, 1996 research, 2000 system  Vietnam National University, Hanoi, 2005  Vietnamese Institute of Mathematics, 2004  HCM City University of Technology, 2003  Le Quy Don University of Technology, 2001 Centers for HPC

4 Milestones First center for HPC at HUT 300 GFlops computing center at VNU (max) Other HPC centers are founded First national conference on HPC and grid computing in HCM city BK Grid Group at HUT BioGrid Group at IOIT-HCM TEIN2-VN Project (Trans-Eurasia Information Network) VNGrid Project University of Technology

5 Encountered Issues Encountered Issues Not yet HPC centers of Tera Flops Not yet HPC centers of Tera Flops Not yet a common networking infrastructure to connect HPC centers Not yet a common networking infrastructure to connect HPC centers High performance Computing and Grid computing rest in academic researches. High performance Computing and Grid computing rest in academic researches. Not yet HPC/GC large scale applications. Not yet HPC/GC large scale applications.

6 Activities done Building grid portals Building grid portals –BKGrid (HUT) –Grid iPortal (VNU-HCM) Experimenting with applications on Experimenting with applications on –Meteorology (HUT, VNU-Hanoi) –Bioinformatics (IOIT-HCM) –Geology (Vietnamese Institute of Mathematics) Participating in international grids Participating in international grids –Pragma (IOIT-HCM 2006, HUT soon) –APGrid (Vietnamese Institute of Mathematics) Participating in international HPC/GC workshops, conf. Participating in international HPC/GC workshops, conf. - APAN - APAN - PRAGMA - PRAGMA

7 VNGrid Project Financed by Ministry of Science and Technology of Vietnam A two year project, to be finished in partners in the project – –IOIT in Hanoi – –IOIT in HCM City – –HUT – –VNU in Hanoi – –Le Quy Don University of Technology

8 The aims of VNGrid (1) Building a cyber-infrastructure to connect five partners in VN-Grid Building a cyber-infrastructure to connect five partners in VN-Grid Deploying advanced grid technologies to improve the performance Deploying advanced grid technologies to improve the performance –Resource monitoring and discovering –Scheduling and brokering  hard to reach the objective!

9 The aims of VNGrid (2) Experimenting grid-based applications on Experimenting grid-based applications on – –Bioinformatics, – –Meteorology, – –Virtual Reality, – –Cryptography. Being connected to other grid systems in the region and over the world

10 Planned activities Selecting the common technology solution for the whole VNGrid – –suitable for the infrastructure in Vietnam – –Via TEIN2 Establishing necessary security policy Developing and deploying some grid applications Building a VNGrid Portal Connecting VNGrid to PRAGMA and some others

11 Attended results Establishing VNGrid initial infrastructure for Grid RD and application community in Vietnam Establishing VNGrid initial infrastructure for Grid RD and application community in Vietnam Assembling separated HPC centers in Vietnam Assembling separated HPC centers in Vietnam Reinforcing researches on grid computing in Vietnam Reinforcing researches on grid computing in Vietnam Towards applying GC in industrial domains Towards applying GC in industrial domains Opening a new opportunity for collaboration with partners outside Vietnam: HPC, storage and content resources!!! Opening a new opportunity for collaboration with partners outside Vietnam: HPC, storage and content resources!!!

12 Apllication 1: Bioinformatics Deploying grid technologies for Gene Mapping (IOIT-HCM) – –Use Haplotype Pattern Mining (HPM), and Density Based Spatial Clustering of Application with Noise (DBSCAN) to specify the locations of genetic diseases Performing Blast and gene prediction in Grid computing environment using iGridPortal (HCM City College of Natural Sciences)

13 Apllication 2: Meteorological Forecast Using agent technologies to deploy grid services Using agent technologies to deploy grid services –An agent has responsible for calling appropriate services following user requirements Globus Toolkit GRAMMDS 3Grid FTP Cluster PBS Cluster PBS BKGrid Portal Security Service Information Service Weka Resource Broker Agent HPC Service Fedora Core 1

14 Application 2: BKGrid and Meteorological Forecast (cont) Applying the HPC and Grid Computing for climate forecast (HUT, VNU-Hanoi) – –Deploying the MM5 model Vietnamese Institute of Mathematics Exploiting resources on APGrid to run a model for climate forecast (Vietnamese Institute of Mathematics) – –Deploying the HRM model

15 Intial results: data grid for meteorology at HUT Weather forecasting plays an important role in the society Weather forecasting plays an important role in the society –for agriculture, commerce, catastrophe preventing, etc. There are different institutions in Vietnam working on the meteorology problems but the cooperation is not easy for There are different institutions in Vietnam working on the meteorology problems but the cooperation is not easy for –sharing local observation data –sharing hardware and software resources on computing weather forecast data

16 A data grid portal for meteorology Building a data grid for sharing meteorological datasets is a suitable solution in Vietnam for: Building a data grid for sharing meteorological datasets is a suitable solution in Vietnam for: –Exploiting resources from different HPC centers –Providing a central and easy access point to all meteorological data via a grid portal –Offering a reliable mean for storing and sharing meteorological data for research purpose –Public access to climate forecast website

17 System architecture

18 Weather forecast modeling Model used for weather forecasting: MM5. Model used for weather forecasting: MM5. It can be run on a cluster for the high performance It can be run on a cluster for the high performance

19 Deployment of MM5 model MM5 model already deployed automatically in a cluster with 3 datasets each day MM5 model already deployed automatically in a cluster with 3 datasets each day –Downloading periodically global meteorology data from the AVN site –Combining with local observation data on modeling –Configuring easily the modeling process via a configuration file –Fault tolerance implemented to make the service more reliable

20 Data grid services Data grid as a virtual container for storing data and easy access later Data grid as a virtual container for storing data and easy access later Basic services provided: Basic services provided: –Replicating data in several nodes –Searching data based on metadata –Transferring data between nodes

21 Prototype

22 Conclusion Grid Computing brings chances to developing countries as Vietnam. We need: Grid Computing brings chances to developing countries as Vietnam. We need: –Computing Resources and HPC –Storage Resources and Data in applications, –QoS networking service. –Grid tools –Collaboration Shortage of resources and only initial steps done, more co-operations needed!

23 Conclusion We would like to join grid computing communities in We would like to join grid computing communities in –APAN –TEIN -EGEE GRid -PRAGMA It is important to have more and more Grid-based applications! It is important to have more and more Grid-based applications!

DoSon Grid Computing School, Thank you very much for your attention!