1. KUAS.EE Parallel Computing at a Glance

2. KUAS.EE History Parallel Computing

3. KUAS.EE What is Parallel Processing ? Processing of multiple tasks simultaneously on multiple Processors is called parallel processing. D1D2D3 P1P2P3 R Pm

4. KUAS.EE Why Parallel Processing ?. Computational requirements are ever increasing, both in the area of scientific and business. grand challenge problems. Sequential architecture reaches physical limitation.. Hardware improvements in pipelining, superscalar are non-scalable and requires sophisticated complier technology.. Vector processing works well for certain of problems.. The technology of parallel processing is mature.. Significant development in networking technology is paving a way for heterogeneous computing.

5. KUAS.EE Hardware Architecture for Parallel Processing ? 1.Single instruction single data (SISD) 2.Single instruction multiple data (SIMD) 3.Multiple instruction and single data (MISD) 4.Multiple instruction and multiple data (MIMD)

6. KUAS.EE Single instruction single data (SISD) Sequential computer : PC, Macintosh, Workstation

7. KUAS.EE Single instruction multiple data (SIMD) Vector machines CRAY, Thinking Machines

8. KUAS.EE Multiple instruction and single data (MISD)

9. KUAS.EE Multiple instruction and multiple data (MIMD) work asynchronously

10. KUAS.EE Shared Memory MIMD Machine Tightly-couple multiprocessor Silicon Graphics machines Sun ’ s SMP address shared memory single address space real address vs. virtual address thread NUMA v.s UMA Message passing v.s shared memory

11. KUAS.EE Distributed Shared Memory MIMD Machine Loosely-coupled multiprocessor C-DAC ’ s PARAM IBM ’ s SP/2 Intel ’ s Paragaon

12. KUAS.EE Comparison between Shared Memory MIMD and Distributed Shared MIMD Shared Memory MIMD Distributed Memory MIMD (MPP) ManufacturabilityEasy ProgrammabilityEasySlightly difficult ReliabilityPoorGood Extensibility Scalability DifficultEasy

13. KUAS.EE Approaches to Parallel Programming.Data Parallelism (SIMD).Process Parallelism.Farmer and Worker Models (Master and Slaves)

14. KUAS.EE PARAM Supercomputers

15. KUAS.EE PARAS Operating Environment It is a complete parallel programming environment. 1.OS kernel 2.Host servers 3.Compliers 4.Run-time environment 5.Parallel file system 6.On-line debugger and profiling tool 7.Graphics and visualization support 8.Networking interface 9.Off-line parallel processing tools 10.Program restructures 11.libraries Program development environment Program run-time environment Utilities

16. KUAS.EE PARAS Programming Model. PARAS Microkernel. CONcurrent threads Environment(CORE). POSIX threads interface. Popular Message Passing interface such as. MPI. PVM. Parallelizing Compliers. Tools and debuggers for parallel programming. Load balancing and distribution tools

17. KUAS.EE Levels of Parallelism

18. KUAS.EE Levels of Parallelism