Presentation is loading. Please wait.

Presentation is loading. Please wait.

ADIOS IO introduction Yufei Dec 10. System at Oak Ridge 672 OSTs 10 Petabytes of storage 60 GB/sec = 480 Gbps aggregate performance (theoretical) 225,000.

Similar presentations


Presentation on theme: "ADIOS IO introduction Yufei Dec 10. System at Oak Ridge 672 OSTs 10 Petabytes of storage 60 GB/sec = 480 Gbps aggregate performance (theoretical) 225,000."— Presentation transcript:

1 ADIOS IO introduction Yufei Dec 10

2

3 System at Oak Ridge 672 OSTs 10 Petabytes of storage 60 GB/sec = 480 Gbps aggregate performance (theoretical) 225,000 compute cores

4 Prior Work Driver-level work for disk access System-level strategies for effective buffering Alternative file organizations (striping as Lustre) Novel method data staging alternative file formats or organizations better ways to organize and update file metadata

5 Interference

6 Adaptive I/O Dynamic and proactive methods for managing IO interference shift work from heavily used areas of the storage system to those that are more lightly loaded. IO Middleware

7 Internal Interference Effect

8 External Interference Effect

9 Imbalanced Concurrent Writers

10 Adaptive IO

11 Components Writer Sub-Coordinator Coordinator

12 Experimental Evaluation MPI-IO vs Adaptive IO

13 FAQ


Download ppt "ADIOS IO introduction Yufei Dec 10. System at Oak Ridge 672 OSTs 10 Petabytes of storage 60 GB/sec = 480 Gbps aggregate performance (theoretical) 225,000."

Similar presentations


Ads by Google