1. “ National Knowledge Network and Grid
- A DAE Perspective ”
B.S. Jagadeesh
Computer Division
BARC.
Discuss as to how they have influenced the development of Novel Applications in general and at BARC in particular.
India and CERN: Visions for future Collaboration /March/2011

2. Our Approach to Grids has been an evolutionary approach
Anupam Supercomputers
To Achieve Supercomputing Speeds
At least 10 times faster than the available sequential machines in BARC
To build a General Purpose Parallel Computer
Catering to wide variety of problems
General Purpose compute nodes and interconnection network
To keep development cycle short
Use readily available, off-the-shelf components

3. ANUPAM Performance over the years

4. ‘ANUPAM-ADHYA’ 47 Tera Flops

5. Complete solution to scientific problems by exploiting parallelism for
Processing ( parallelization of computation)
I/O ( parallel file system)
Visualization (parallelized graphic pipeline/
Tile Display Unit)

6. Snapshots of Tiled Image Viewer

7. We now have , Large tiled display
Rendering power with distributed rendering
Scalable to many many pixels and polygons
An attractive alternative to high end graphics
system
Deep and rich scientific visualization system

8. Post-tsunami: Nagappattinam, India (Lat: 10.7906° N Lon: 79.8428° E)
This one-meter resolution image was taken by Space Imaging's IKONOS satellite on Dec. 29, 2004 —
just three days after the devastating tsunami hit.
1M IKONOS Image Acquired: 29 December 2004 Credit "Space Imaging"

9. So, We Need Lots Of Resources Like High Performance
Computers, Visualization Tools, Data Collection Tools, Sophisticated Laboratory Equipments Etc.
“ Science Has Become Mega Science”
“Laboratory Has To Be A Collaboratory”
Key Concept is “Sharing By Respecting
Administrative Policies”

10. GRID CONCEPT
User Access Point
Result
Resource
Broker
Grid Resources

11. Grid concept (another perspective)
Many jobs per system
One job per system
Two systems per JOB
Many systems per JOB
View all of the above as Single unified resource
-- Early days of Computation
-- Risc / Workstation Era
-- Client-Server Model
-- Parallel / Distributed Computing
-- Grid Computing

12. LHC Computing
LHC (Large Hadron Collider) has become operational and is churning out data.
Data rates per experiment of >100 Mbytes/sec.
>1 Pbytes/year of storage for raw data per experiment.
Computationally problem is so large that can not be solved by a single computer centre
World-wide collaborations and analysis.
Desirable to share computing and analysis throughout the world.

13. LEMON architecture

14. QUATTOR
Quattor is a tool suite providing automated installation, configuration and management of clusters and farms
Highly suitable to install, configure and manage Grid computing clusters correctly and automatically
At CERN, currently used to auto manage nodes >2000 with heterogeneous hardware and software applications
Centrally configurable & reproducible installations, run time management for functional & security updates to maximize availability

15. Please visit: http://gridview.cern.ch/GRIDVIEW/

16. National Knowledge Network
Nationwide networks like ANUNET, NICNET,SPACENET did exist
Idea is to Synergize, Integrate and leverage to form National Information Highways
Take everyone onboard (5000 institutes of learning)
. Provide quality of service
.Outlay of Rs 100 crores for Proof of Concept
Envisaged applications are:
Countrywide Classrooms,
Telemedicine, E-Governance,
Grid Technology …..

17. NKN TOPOLOGY
All pops are covered by atleast Two NLDs

18. Core NKN Topology EDGE EDGE EDGE Distribution Distribution EDGE
Current status
15 POPS
78 Institutes have been connected
Distribution
Work in progress for
27 POPS
550+ Institutes
EDGE
EDGE
EDGE

19. Achieve Higher Availability

20. NKN Educational Institutions NTRO Cert-IN EDUSAT National Internet
Research Labs
CSIR/DAE/ISRO/ICAR
NKN
EDUSAT
National
Internet
Exchange
Points (NIXI)
MPLS
Clouds
INTERNET
Broad Band
Clouds
Connections to
Global Networks
(e.g. GEANT)
National / State
Data Centers

21. DAE-wide Applications on NKN
DAE-Grid : Grid resources at BARC, IGCAR, RRCAT and VECC
WLCG and GARUDA
Videoconferencing: with NIC, IITs, IISc
Collab-CAD : Collaborative design of sub assembly of the prototype 500 MW Fast Breeder Reactor from NIC, BARC & IGCAR
Remote classrooms : Amongst different Training schools

22. ANUNET WIDE AREA NETWORK
Quarter Transponder
9 MHz
INSAT 3C
8 Carriers of
768 Kbps each
BARC,
Trombay
AERB
NPCIL
HWB
BRIT
CTCRS, BARC
Anushaktinagar ,
Mumbai
BARC
NFC
CCCM
ECIL,
Hyderabad
TIFR
IRE
TMC
DAE,
Mumbai
Hosp.
CAT,
Indore
BARC,
Mysore
Gauribidnur
Tarapur
Mt.Abu
AMD,
Secund’bad
Shillong
SAHA INST.
VECC,
Kolkata
IGCAR,
Kalpakkam
BARC
FACL
IMS,
Chennai
MRPU
UCIL-I
Jaduguda
UCIL-II
UCIL-III
HWB,
Manuguru
Kota
IOP
Bhubaneshwar
TMH
Navi
Mumbai
HRI,
Allahabad
IPR,
Ahmedabad
Notes: Sites shown in yellow oblong are connected over dedicated landlines.
ANUNET WIDE AREA NETWORK

23. ANUNET Leased Links Plan for 11th Plan
Delhi
Shilong
Allahabad
Mount Abu
Kota
Jaduguda
Indore
Gandhinagar
Kolkata
Tarapur
Bhubneshwar
Mumbai
Hyderabad
Vizag
Manguru
Mysore
Gauribidunir
Chennai
Existing
Kalpakkam
Proposed
Leased Links Plan All over India

24. DAE & NKN Applications …
BARC CONDUCTED THE FIRST NKN WORKSHOP TO TRAIN NETWORK ADMINISTRATORS IN DEC, 2008
DAE-GRID
COUNTRYWIDE CLASSROOMS OF HBNI
SHARING OF DATABASES
DISASTER RECOVERY SYSTEMS (planned)
DAE GETS ACCESS TO RESOURCES IN THE COUNTRY
DAE STANDS TO GAIN IN THAT WE GET ACCESS TO RESOURCES ON GEANT(34 EUROPEAN COUNTRIES),
GLORIAD ( RUSSIA,CHINA,USA,NETHERLANDS,CANADA ..),
TIEN3 (AUSTRALIA,CHINA,JAPAN,SINGAPORE,…..)
Applications …

25. Logical Communication Domains Through NKN
WLCG Collaboration
NKN-General
(National Collaborations)
NKN-Internet (Grenoble-France)
Logical Communication Domains Through NKN
NKN Router
Intranet
segment of
BARC
Internet
segment of
BARC
Anunet (DAE units)
BARC – IGCAR
Common Users Group (CUG)
National Grid Computing
CDAC, Pune

26. LAYOUT OF VIRTUAL CLASSROOM
Projection Screen
55“ LED
55“ LED
Elevation Front
HD Camera
Teacher
HD Camera
55“ LED
55“ LED
Elevation Back
LAYOUT OF VIRTUAL CLASS ROOM

27. An Example of High bandwidth Application

28. A Collaboratory (ESRF, Grenoble)

29. Depicts a one degree oscillation photograph on crystals of HIV-1 PR M36I mutant recorded by remotely operating the FIP beamline at ESRF, and OMIT density for the mutation residue I. (Credits: Dr. Jean-Luc Ferrer, Dr. Michel Pirochi & Dr. Jacques Joley, IBS/ESRF, France, Dr. M.V. Hosur & Colleagues, Solid State Physics Division & Computer Division, BARC)
E-Governance?

31. Collaborative design of reactor components
Credits : IGCAR, Kalpakkam, NIC-Delhi, Comp Divn, BARC

32. DAEGrid 4 Sites 6 Clusters 800 Cores UTKARSH
Utkarsh – dual processor-quad core 80 node (BARC)
Aksha-itanium – dual processor 10 node (BARC)
Ramanujam – dual core dual processor 14 node (RRCAT)
Daksha – dual processor 8 node (RRCAT)
Igcgrid-xeon – dual processor 8 node (IGCAR)
Igcgrid2-xeon – quad core 16 node (IGCAR)
DAEGrid Connectivity is through NKN – 1 Gbps
4 Sites
6 Clusters
800 Cores
DAEGrid

33. Categories of Grid Applications
Category
Examples
Characteristics
Distributed Supercomputing
Ab-initio
Molecular Dyn
Large CPU / memory reqd
High
Throughput
Cryptography
Harness Idle
cycles
On Demand
Remote Experiments
Cost
effectiveness
Data Intensive
CERN LHC
Info from Large Data sets / Provenance
Collaborative
Data
Exploration
Support communication
  
  
  
  
   33

34. Moving Forward ……
“ ‘Fire and Forget’ to ‘Assured quality of service’ ”
Effect of Process Migration in distributed environments
A Novel Distributed Memory file system
Implementation of Network Swap for Performance Enhancement
Redundancy issues to address the failure of resource brokers
Service center concept using Glite Middleware
Development of Meta-brokers to direct jobs amongst middlewares
All of the above lead towards ensuring Better quality of service and imparting simplicity in Grid usage… clouds?

35. Acknowledgements
All colleagues from Computer Division, BARC for help in preparing the presentation material are gratefully acknowledged. We also Acknowledge NIC-Delhi, IGCAR-Kalpakkam and IT-Division, CERN, Geneva.
THANK YOU 35