1. CIS5930: Advanced Topics in Parallel and Distributed Systems
Instructor: Xin Yuan, 168 Love,
Office hour: 10:00am-11:30am Tuesday and Thursday, or by appointment
Course website: blackboard and
CIS5930 Advanced Topics in Parallel and Distributed Systems Florida State University

2. Course objectives
Bringing the students up-to-date in research in extreme scale parallel and distributed systems
Introducing software, algorithmic, and analytical tools and techniques that are necessary to perform research in this area.
At the end of the course, the students should be able to
Explain current research issues in extreme scale parallel and distributed systems.
Apply techniques to investigate, model, and simulate extreme scale parallel and distributed systems.
CIS5930 Advanced Topics in Parallel and Distributed Systems Florida State University

3. Topics covered Programming paradigms
You should know some of the paradigms such as client/server, p2p.
MPI, GPU/MIC, Mapreduce, hybrid
Interconnect design, model, and evaluation
Topology, routing, flow control, congestion control
New networking technologies: InfiniBand, 100G Ethernet, Openflow
Modeling and simulation methods
System software and communication sub-systems
The implementation of the communication sub-systems (e.g. MPI)
Application tracing issues
Resilience, Power, and Security
CIS5930 Advanced Topics in Parallel and Distributed Systems Florida State University

4. Textbook and course materials
Required: none
Course materials
Mostly papers from recent top conferences in PDS or HPC
Some from online tutorials
MPI:
OpenMP:
CUDA: NVIDIA CUDA Programming Guide
OpenCL: OpenCL Programming Guide for the CUDA Architecture
CIS5930 Advanced Topics in Parallel and Distributed Systems Florida State University

5. Course schedule (tentative)
Week 1: Syllabus and introduction
Week 2: Programming paradigm (MPI, GPU/MIC, Mapreduce, hybrid)
Week 3: Programming paradigm (MPI, GPU/MIC, Mapreduce, hybrid)
Week 4: Programming paradigm (MPI, GPU/MIC, Mapreduce, hybrid)
Week 5: Interconnect basics
Week 6: Interconnect technology: Infiniband, 100G Ethernet, Openflow
Week 7: New interconnect proposals
Week 8: Interconnect modeling and simulation methods
Week 9: System software and communication sub-systems
Week 10: Spring break
Week 11: System software and communication sub-systems
Week 12: Resilience, power, and security
Week 13: Resilience, power, and security
Week 14: Resilience, power, and security
Week 15: Term project presentation
Week 16: Term project presentation
CIS5930 Advanced Topics in Parallel and Distributed Systems Florida State University

6. Prerequisite COP 4610: Operating systems
No requirement for background knowledge of parallel and distributed computing
You should have one of the following (not official, but …)
CDA5125
COP5570
CNT5505
CIS5930 Advanced Topics in Parallel and Distributed Systems Florida State University

7. Grading Always groups of 2 students (unless you prefer to be alone)
10 % - classroom participation
Read the papers before coming to class.
20% - classroom presentation
10% - homework, paper critics, programming assignments.
40% - course project
20% final exam (take home)
CIS5930 Advanced Topics in Parallel and Distributed Systems Florida State University

8. Course policies Attendance: required.
Late assignments: not accepted without a valid excuse.
Missed exam: following the university rules.
Let me know when you need to miss an exam ASAP.
Incomplete grade:
Miss the final with an accepted excuse
Due to extraordinary circumstances with appropriate documentation.
CIS5930 Advanced Topics in Parallel and Distributed Systems Florida State University

9. Academic Integrity Violation No copying from anywhere
Don’t ask others for solutions and don’t give solutions to others.
Violation
The university requires all violations to be reported.
First violation with level 1 agreement:
0 for the particular assignment/exam and the lowering of one letter (A->B) for course final grade.
Second violation: resolved through the office of the Dean and the Faculties
CIS5930 Advanced Topics in Parallel and Distributed Systems Florida State University

10. Accommodation for Disabilities
Register with and provide documentation to the Student Disability Resource Center (SDRC).
Bring a letter to me from the SDRC `indicating you need academic accomodations. This should be done within the first week of class
CIS5930 Advanced Topics in Parallel and Distributed Systems Florida State University