1. Cheating The School of Network Computing, the Faculty of Information Technology and Monash as a whole regard cheating as a serious offence. Where assignments or other work are submitted which have evidence of cheating, those concerned will be required to attend an interview with the subject lecturer and the course leader. On establishing that cheating has occurred, the matter may be referred to the Faculty Discipline Committee for further action. Penalties that may be imposed for cheating include: the awarding of zero marks for the piece of work and the the subsequent failing of the subject, suspension from the university and exclusion from the university. Students who provide their work for others to copy are also subject to the same penalties as those who copy. FIT5174 Parallel and Distributed Systems Introduction & Overview

2. Cheating The School of Network Computing, the Faculty of Information Technology and Monash as a whole regard cheating as a serious offence. Where assignments or other work are submitted which have evidence of cheating, those concerned will be required to attend an interview with the subject lecturer and the course leader. On establishing that cheating has occurred, the matter may be referred to the Faculty Discipline Committee for further action. Penalties that may be imposed for cheating include: the awarding of zero marks for the piece of work and the the subsequent failing of the subject, suspension from the university and exclusion from the university. Students who provide their work for others to copy are also subject to the same penalties as those who copy. FIT5174 Parallel & Distributed Systems 2013 Lecturer: Dr. Ronald Pose e-mail:Ronald.Pose@monash.edu but please include “FIT5174” in the subject lineRonald.Pose@monash.edu home phone:03 9527 1331 Consutation time:5-6pm Wednesdays in H7.87 or contact me by telephone or e-mail.

3. Cheating The School of Network Computing, the Faculty of Information Technology and Monash as a whole regard cheating as a serious offence. Where assignments or other work are submitted which have evidence of cheating, those concerned will be required to attend an interview with the subject lecturer and the course leader. On establishing that cheating has occurred, the matter may be referred to the Faculty Discipline Committee for further action. Penalties that may be imposed for cheating include: the awarding of zero marks for the piece of work and the the subsequent failing of the subject, suspension from the university and exclusion from the university. Students who provide their work for others to copy are also subject to the same penalties as those who copy. FIT5174 Information FIT5174 web page http://www.csse.monash.edu.au/~rdp/FIT5174 Students should check the web page often since that is where I will leave useful information, files for assignments and lab sessions. Moodle will also contain links to these and other resources. Just be patient while I set things up.

4. Cheating The School of Network Computing, the Faculty of Information Technology and Monash as a whole regard cheating as a serious offence. Where assignments or other work are submitted which have evidence of cheating, those concerned will be required to attend an interview with the subject lecturer and the course leader. On establishing that cheating has occurred, the matter may be referred to the Faculty Discipline Committee for further action. Penalties that may be imposed for cheating include: the awarding of zero marks for the piece of work and the the subsequent failing of the subject, suspension from the university and exclusion from the university. Students who provide their work for others to copy are also subject to the same penalties as those who copy. OVERVIEW Distributed and Parallel Systems is a very broad description. Many modern computing systems are distributed in that their processing resources and their data resources may be scattered over various networks. These resources may or may not be used in parallel. Modern computer systems contain parallelism in both hardware and software.

5. Cheating The School of Network Computing, the Faculty of Information Technology and Monash as a whole regard cheating as a serious offence. Where assignments or other work are submitted which have evidence of cheating, those concerned will be required to attend an interview with the subject lecturer and the course leader. On establishing that cheating has occurred, the matter may be referred to the Faculty Discipline Committee for further action. Penalties that may be imposed for cheating include: the awarding of zero marks for the piece of work and the the subsequent failing of the subject, suspension from the university and exclusion from the university. Students who provide their work for others to copy are also subject to the same penalties as those who copy. OVERVIEW continued This unit covers distributed systems and also parallelism in both general purpose and application specific computer architectures and the programming paradigms that allow parallelism to be exploited in software. The unit examines both shared memory and message passing paradigms in both hardware and software; concurrency, multithreading and synchronicity; parallel, clustered and distributed computing models and languages. Students will program in these paradigms.

6. Cheating The School of Network Computing, the Faculty of Information Technology and Monash as a whole regard cheating as a serious offence. Where assignments or other work are submitted which have evidence of cheating, those concerned will be required to attend an interview with the subject lecturer and the course leader. On establishing that cheating has occurred, the matter may be referred to the Faculty Discipline Committee for further action. Penalties that may be imposed for cheating include: the awarding of zero marks for the piece of work and the the subsequent failing of the subject, suspension from the university and exclusion from the university. Students who provide their work for others to copy are also subject to the same penalties as those who copy. OBJECTIVES: A knowledge and understanding of: a variety of distributed and parallel architectures, such as bus-based, massively parallel, cluster, vector; a variety of parallel programming paradigms, synchronisation and parallelisation primitives, message passing, data parallel, tuple space; concurrency, synchronicity and parallelism; the design issues of distributed and parallel systems.

7. Cheating The School of Network Computing, the Faculty of Information Technology and Monash as a whole regard cheating as a serious offence. Where assignments or other work are submitted which have evidence of cheating, those concerned will be required to attend an interview with the subject lecturer and the course leader. On establishing that cheating has occurred, the matter may be referred to the Faculty Discipline Committee for further action. Penalties that may be imposed for cheating include: the awarding of zero marks for the piece of work and the the subsequent failing of the subject, suspension from the university and exclusion from the university. Students who provide their work for others to copy are also subject to the same penalties as those who copy. Contact Time: The subject is taken over 12 weeks: Lectures: 2 hours each week (Wednesdays 6-8pm) Lab / Tutorial Sessions: 2 hours per week. Consultations: the hour prior to the lecture in H7.87

8. Cheating The School of Network Computing, the Faculty of Information Technology and Monash as a whole regard cheating as a serious offence. Where assignments or other work are submitted which have evidence of cheating, those concerned will be required to attend an interview with the subject lecturer and the course leader. On establishing that cheating has occurred, the matter may be referred to the Faculty Discipline Committee for further action. Penalties that may be imposed for cheating include: the awarding of zero marks for the piece of work and the the subsequent failing of the subject, suspension from the university and exclusion from the university. Students who provide their work for others to copy are also subject to the same penalties as those who copy. Essential Background Knowledge Programming experience in C (C++ or Java programmer will need to allocate extra time to get used to the C programming style) Co-requisites: None. Prohibition: FIT4001, CSE4333

9. Cheating The School of Network Computing, the Faculty of Information Technology and Monash as a whole regard cheating as a serious offence. Where assignments or other work are submitted which have evidence of cheating, those concerned will be required to attend an interview with the subject lecturer and the course leader. On establishing that cheating has occurred, the matter may be referred to the Faculty Discipline Committee for further action. Penalties that may be imposed for cheating include: the awarding of zero marks for the piece of work and the the subsequent failing of the subject, suspension from the university and exclusion from the university. Students who provide their work for others to copy are also subject to the same penalties as those who copy. Handouts and other Resource Materials: Available on subject page for download Attendance Policy: Highly recommended Course Work: This component will be assessed by way of two assignments (25% each), a class test (25% during final lecture), and laboratory work (25%).

10. Cheating The School of Network Computing, the Faculty of Information Technology and Monash as a whole regard cheating as a serious offence. Where assignments or other work are submitted which have evidence of cheating, those concerned will be required to attend an interview with the subject lecturer and the course leader. On establishing that cheating has occurred, the matter may be referred to the Faculty Discipline Committee for further action. Penalties that may be imposed for cheating include: the awarding of zero marks for the piece of work and the the subsequent failing of the subject, suspension from the university and exclusion from the university. Students who provide their work for others to copy are also subject to the same penalties as those who copy. Assessment Distributed Part Assignment 1: 25% Parallel Part Assignment 2: 25% Class Test covering the whole curriculum: 25% Assessed Lab work: 25% No End of Semester Exam

11. Cheating The School of Network Computing, the Faculty of Information Technology and Monash as a whole regard cheating as a serious offence. Where assignments or other work are submitted which have evidence of cheating, those concerned will be required to attend an interview with the subject lecturer and the course leader. On establishing that cheating has occurred, the matter may be referred to the Faculty Discipline Committee for further action. Penalties that may be imposed for cheating include: the awarding of zero marks for the piece of work and the the subsequent failing of the subject, suspension from the university and exclusion from the university. Students who provide their work for others to copy are also subject to the same penalties as those who copy. HD80% - 100%High Distinction D70% - 79%Distinction C60% - 69%Credit P50% - 59%Pass N0% - 49%Fail Grades

12. Cheating The School of Network Computing, the Faculty of Information Technology and Monash as a whole regard cheating as a serious offence. Where assignments or other work are submitted which have evidence of cheating, those concerned will be required to attend an interview with the subject lecturer and the course leader. On establishing that cheating has occurred, the matter may be referred to the Faculty Discipline Committee for further action. Penalties that may be imposed for cheating include: the awarding of zero marks for the piece of work and the the subsequent failing of the subject, suspension from the university and exclusion from the university. Students who provide their work for others to copy are also subject to the same penalties as those who copy. Plagiarism The Faculty of Information Technology and Monash as a whole regard cheating as a serious offence. Where assignments or other work are submitted which have evidence of cheating, those concerned will be required to attend an interview with the subject lecturer and the course leader. On establishing that cheating has occurred, the matter may be referred to the Faculty Discipline Committee for further action. Penalties that may be imposed for cheating include: the awarding of zero marks for the piece of work and the the subsequent failing of the subject, suspension from the university and exclusion from the university. Students who provide their work for others to copy are also subject to the same penalties as those who copy. You Must Read the UNIT GUIDE

13. Cheating The School of Network Computing, the Faculty of Information Technology and Monash as a whole regard cheating as a serious offence. Where assignments or other work are submitted which have evidence of cheating, those concerned will be required to attend an interview with the subject lecturer and the course leader. On establishing that cheating has occurred, the matter may be referred to the Faculty Discipline Committee for further action. Penalties that may be imposed for cheating include: the awarding of zero marks for the piece of work and the the subsequent failing of the subject, suspension from the university and exclusion from the university. Students who provide their work for others to copy are also subject to the same penalties as those who copy. Unit Contents Distributed Systems (50%) Parallel Systems (50%) FIT5174

14. Cheating The School of Network Computing, the Faculty of Information Technology and Monash as a whole regard cheating as a serious offence. Where assignments or other work are submitted which have evidence of cheating, those concerned will be required to attend an interview with the subject lecturer and the course leader. On establishing that cheating has occurred, the matter may be referred to the Faculty Discipline Committee for further action. Penalties that may be imposed for cheating include: the awarding of zero marks for the piece of work and the the subsequent failing of the subject, suspension from the university and exclusion from the university. Students who provide their work for others to copy are also subject to the same penalties as those who copy. Schedule of Lectures / Topics The following is a preliminary schedule for topics to be covered in lectures. This will most likely change after I learn more about students background knowledge and skills. Updates will be posted on the web site and Moodle. All material presented in lectures will be made available on-line.

15. Cheating The School of Network Computing, the Faculty of Information Technology and Monash as a whole regard cheating as a serious offence. Where assignments or other work are submitted which have evidence of cheating, those concerned will be required to attend an interview with the subject lecturer and the course leader. On establishing that cheating has occurred, the matter may be referred to the Faculty Discipline Committee for further action. Penalties that may be imposed for cheating include: the awarding of zero marks for the piece of work and the the subsequent failing of the subject, suspension from the university and exclusion from the university. Students who provide their work for others to copy are also subject to the same penalties as those who copy. Part I The objective of this part is to introduce characteristics of distributed systems, and to examine distributed system architectures and software structure, and to learn algorithms for distributed systems. The discussion will emphasize on fundamental concepts in distributed systems, such as communications, synchronisation, processes, and file services. We will also look at advantages and disadvantages of distributed systems including: –Performance –Reliability –Robustness –Scalability –Cost –Legal issues

16. Cheating The School of Network Computing, the Faculty of Information Technology and Monash as a whole regard cheating as a serious offence. Where assignments or other work are submitted which have evidence of cheating, those concerned will be required to attend an interview with the subject lecturer and the course leader. On establishing that cheating has occurred, the matter may be referred to the Faculty Discipline Committee for further action. Penalties that may be imposed for cheating include: the awarding of zero marks for the piece of work and the the subsequent failing of the subject, suspension from the university and exclusion from the university. Students who provide their work for others to copy are also subject to the same penalties as those who copy. Topics Week 1: Introduction: What is a distributed system? Evolution of Distributed Systems Distributed Systems Models Design issues of Distributed Systems Week 2: Communication in Distributed Systems Desirable features Message Passing Failure Handling RPC Group Communication

17. Cheating The School of Network Computing, the Faculty of Information Technology and Monash as a whole regard cheating as a serious offence. Where assignments or other work are submitted which have evidence of cheating, those concerned will be required to attend an interview with the subject lecturer and the course leader. On establishing that cheating has occurred, the matter may be referred to the Faculty Discipline Committee for further action. Penalties that may be imposed for cheating include: the awarding of zero marks for the piece of work and the the subsequent failing of the subject, suspension from the university and exclusion from the university. Students who provide their work for others to copy are also subject to the same penalties as those who copy. Topics Week 3: Message Passing Library (MPI) Week 4: Synchronization in Distributed Systems Clock sync Mutual Exclusion Deadlock Election algorithm etc. Week 5: Distributed Transaction and Concurrency Control Week6: Faults, Distributed Consensus, Security and Parallel Computing

18. Cheating The School of Network Computing, the Faculty of Information Technology and Monash as a whole regard cheating as a serious offence. Where assignments or other work are submitted which have evidence of cheating, those concerned will be required to attend an interview with the subject lecturer and the course leader. On establishing that cheating has occurred, the matter may be referred to the Faculty Discipline Committee for further action. Penalties that may be imposed for cheating include: the awarding of zero marks for the piece of work and the the subsequent failing of the subject, suspension from the university and exclusion from the university. Students who provide their work for others to copy are also subject to the same penalties as those who copy. Part 2 Fundamental concepts in parallel computing hardware design and operation. Low level programming support for parallelism with knowledge of parallel architectures.

19. Cheating The School of Network Computing, the Faculty of Information Technology and Monash as a whole regard cheating as a serious offence. Where assignments or other work are submitted which have evidence of cheating, those concerned will be required to attend an interview with the subject lecturer and the course leader. On establishing that cheating has occurred, the matter may be referred to the Faculty Discipline Committee for further action. Penalties that may be imposed for cheating include: the awarding of zero marks for the piece of work and the the subsequent failing of the subject, suspension from the university and exclusion from the university. Students who provide their work for others to copy are also subject to the same penalties as those who copy. Topics Week7 Instruction Level Parallelism Week8 Vector Architecture Week9 Data Parallel Architectures and SIMD Week10 Introduction to MIMD, Distributed Memory Architectures Week11 Super-Scalar Processing Week12 Class Test

20. Cheating The School of Network Computing, the Faculty of Information Technology and Monash as a whole regard cheating as a serious offence. Where assignments or other work are submitted which have evidence of cheating, those concerned will be required to attend an interview with the subject lecturer and the course leader. On establishing that cheating has occurred, the matter may be referred to the Faculty Discipline Committee for further action. Penalties that may be imposed for cheating include: the awarding of zero marks for the piece of work and the the subsequent failing of the subject, suspension from the university and exclusion from the university. Students who provide their work for others to copy are also subject to the same penalties as those who copy. References and Software Prescribed text(s) and readings as listed in the unit guide. –NB: Students who attend fewer than 80% of the lectures will need to rely on the prescribed text and the reading list. Virtual Machine Appliance available on the UNIT WEBSITE (for home use) Software required, –VMPlayer or VM Workstation (Windows, Linux) –VMWare Fusion (Mac) or Mac userscan simply run programs directly.