Download presentation
Presentation is loading. Please wait.
Published byEleanor Holt Modified over 7 years ago
1
© 2010 Pittsburgh Supercomputing Center Lustre WAN ExTENCI Kickoff Meeting August 19, 2010 Josephine Palencia J. Ray Scott
2
© 2010 Pittsburgh Supercomputing Center Project Summary Evaluation of a Global Widearea File System for: –Performance –Robustness Leverage Work from Teragrid Software Support –PSC –Josephine Palencia, Brian Johanson Hardware Support –UF Testing –UF, FSI, FIU, PSC, others
3
© 2010 Pittsburgh Supercomputing Center Project Approach Secure Infrastructure Installation Support Authentication Mapping Network Performance Measurement Application Integration Assessment and Project Support
4
© 2010 Pittsburgh Supercomputing Center Secure Infrastructure Kerberos security infrastructure Lustre 2.0 Installation Packages –Ease the software installation –Hide Kerberos from site administration
5
© 2010 Pittsburgh Supercomputing Center Example Site Configuration MDS1 CLIENT UF KERBEROS REALM UF OST Pool UFPSC.UF.EDU.PSC.EDU PSC OST Pool.PSC.EDU MGS MDS2 OST1 OST2 OST3 OSS1 OSS2 OSS3
6
© 2010 Pittsburgh Supercomputing Center Kerberized scp/kftp/gridftp: konFUSEd
7
© 2010 Pittsburgh Supercomputing Center Installation Support – RPM Packaging 1.10.0.40 Lustre 2.0 Beta 1 VM client/server rpms
8
© 2010 Pittsburgh Supercomputing Center Authentication Mapping UID Mapping Using IU Developed Code Only Necessary Across Administrative Domains –Without UID synchronization
9
© 2010 Pittsburgh Supercomputing Center Network Performance Testing Pre-Production Baseline Testing Ongoing Production Testing
10
© 2010 Pittsburgh Supercomputing Center Performance Measurement –Internal Testing
11
© 2010 Pittsburgh Supercomputing Center Performance Measurement – Internal Testing
12
© 2010 Pittsburgh Supercomputing Center Performance Measurement –TeraGrid
13
© 2010 Pittsburgh Supercomputing Center On Going Network Performance Testing
14
© 2010 Pittsburgh Supercomputing Center Application Integration Largely Invisible to Application Performance –Large Metadata Operations –Data Locality Independent Assessment for LQCD, CMS services to include: – data integrity –accessibility –usability
15
© 2010 Pittsburgh Supercomputing Center Application Integration, cont. –maintainability –ability to troubleshoot/isolate problems –namespace –IO performance –Metrics and Assessment evaluate acceptabiity as production storage for LHC physics –compare with Hadoop20 implementation –test with SCEC and Protein Structure applications
16
© 2010 Pittsburgh Supercomputing Center Assessment and Project Support
17
© 2010 Pittsburgh Supercomputing Center Project WIKI
18
© 2010 Pittsburgh Supercomputing Center Teragrid WIKI http://teragridforum.org/mediawiki/index.php?title =JWAN:_lustre-wan_advanced_features_testing
19
© 2010 Pittsburgh Supercomputing Center Thank You Josephine Palencia – Josephin@psc.edu– Josephin@psc.edu J. Ray Scott – Scott@psc.edu
Similar presentations
© 2024 SlidePlayer.com Inc.
All rights reserved.