Presentation on theme: "Academic and Research Technology (A&RT)"— Presentation transcript:
1 Academic and Research Technology (A&RT) QUEST OverviewQUEST Support TeamAcademic and Research Technology (A&RT)NUITDavid Chen, Ph.D.
2 Quest Workshop Schedule Other topics in preparation:- Understanding parallel performance- QUEST1 and QUEST2 performance comparison- TotalView, Performance Counters,- Intel Hyperthreading Technology, etc2
3 What is Quest? Hardware Layout Who is involved? AgendaWhat is Quest?HardwareLayoutWho is involved?What’s inside?Operating SystemSupported softwareJob schedulerHow to Get AccessWho gets access, and how?How do allocations work?Important DatesWhat are we doing here?What is QuestWhat Can it do for me?How do I get access?Where to go for more info/help?Quest websiteQuest announcement listMOTD – message of the day3
4 What is Quest ?Quest is Northwestern University's large-scale, shared, high performance computing system providing University researchers with a clustered computing platform in support of research.The implementation of Quest reflects University's multi-year high performance computing initiative to maintain Northwestern's reputation as a leading research institution.How much do I need to pay to use Quest?Can I add my hardware to Quest? Can I align my grant or proposal with Quest? Access to Quest is allocation driven (more about this later!)4Have feedback?
8 Quest Compute Node Specifications PartitionNodeNameQuantityIBM Product NameProcessorIntel Xeon(2 Sockets/node)Memory(DDR3)Internal Diskquest1qnode504Dx360 M22.26 GHzquad coreNehalem E552048 GB1333 MHz(12 X 4GB)nonequest2qnode256Dx360 M32.66 GHz6 coreWestmere X5650(6 X 8GB)(In 126 nodes)1 TB7200 RPMSATAApplication; length, pages, content. how does it work?8Have feedback?
9 Quest OS Operating System: Stateless OS image Redhat 5.3 We boot from remote storage and the image lives in memory.Software stack is uniform, nodes boot quicklyHard disks are #1 source of failure (memory is #2, Power Supply #3)Less power, less heat, tastes great, less filling.Is there a downside?Application; length, pages, content. how does it work?9Have feedback?
10 Quest Software What's already installed? Compilers/debuggers: gcc, intel, totalview (c, c++, fortran)MPI - OpenMPI (What? No MPICH or IntelMPI?)Commonly used applications - Matlab/Mathematica, etcA more complete list of installed software is online: What about my application software?We encourage users to install application software at own directoryWhy?A&RT will help10Have feedback?
11 Job Scheduler What is it and why should I care? A popular restaurant has many of the same challenges and solutionsSome people show up with lots of friends and stay for a long timeSome people are just there for a quick mealSome people are part owners and have faster access to some tablesEveryone wants to eat right now!11Operators are standing by:
12 Job Scheduler (a few details) Moab is the SchedulerQuest uses queues (and partitions, advanced reservations, etc) to organize jobs according tonumber of cores a job usesamount of wall clock time the job is expected to takeother considerations maybe neededThe more accurate the request, the better the scheduler can do its job.Torque is the Resource manager Torque keeps track of all resources, job requests and running jobs.12Have feedback?
14 So, who can use Quest?Any Northwestern University researcher or educator may request an allocation as a computational investigator (CI) for the purpose of research or education.CI must first complete an on-line account application which includes the following information:- a project proposal including description of intended work - amount of CPU time needed during the allocation term- amount of storage space to be shared by project team, and- some supplemental information to support your requestAllocations will cover 1-year terms (Until April 2011)Allocations will cover 6-month terms (After June 2011)14Have feedback?
16 Allocation Review Cycle For Research and Special AllocationsQuarterPeriod ofSubmission DeadlineFallOct 1st - December 31stSeptember 1stWinterJanuary 1st - March 31stDecember 1stSpringApril 1st - June 30thMarch 1stSummerJuly 1st - Sept 30June 1stFor All Other AllocationsTypeReview FrequencyAllocation SizeDevelopmentMonthly25,000 HoursEducationWeekly10,000 HoursTestShort Notice2,500 HoursWorkshop1,000 Hours16Have feedback?
17 Where to Get Help? On line instructions Still stuck? Quest support team (A&RT) can helpJob submission problemsSystem problems, software installationsNeed help fitting into the schedulerPerformance issues with an applicationAccess to licenses external to Quest 17Have feedback?