Quality Assurance (QA) Working Group Update February 11, 2010 Kate Ericson (SDSC) Shava Smallen (SDSC)

Start of Quality Assurance Working Group After focused efforts with user groups (e.g. LEAD) and NSF direction, funding was allocated towards both Quality Assurance (QA) and Common User Environment (CUE) to improve TG user experience Initial charter for QA developed late Included CUE for a short time QA led by Doru Marcusiu at NCSA, CUE led by Shawn Brown at PSC

Original QA WG Vision To identify and implement ways in which TeraGrid software components/services and production deployments can be improved to reduce the number of failures requiring operator intervention that are encountered at TeraGrid resource provider sites.

Original QA Goals/Milestones Initially to increase availability of CTSS services: Improve time from detected failure to notification –Reviewed Inca error notification configuration and policies –Created web page view of who gets notified for each CTSS test Map errors to potential problem resolution procedures –Linked Inca test failures to TG knowledge base articles and added method for admins to share problem resolution information –Improve description of error and map to lower level failures to reduce admin time hunting for error interpretation

Original QA Goals/Milestones Later planned to increase reliability of services: Organize and identify priorities and timelines for new QA testing cycle –Which services are most widely used –Which services fail most often (created Inca page view to start on this) Identify existing tests to be used and/or develop new tests –Started evaluating existing Inca tests Develop HPC testbed

Current QA WG Status Group leadership changed in November 2009 to Shava and Kate at SDSC in preparation for Doru’s retirement Continue effort started by the group Spent time to re-identify staff and match to PY5 funding ParticipantSite Shava SmallenSDSC Kate EricsonSDSC Joe InsleyANL Lukasz LacinskiLONI Mike LoweIU Rick MohrNICS Rich RaymondPSC Derek SimmelPSC Andy HowardPurdue Kenneth YoshimotoSDSC David CarverTACC

QA Goals Short term deliverables from 2009: –reviewed existing Inca tests for need –documented possible Inca test solutions in Knowledge Base –edited and will advertise TG Grid admin guide Until TAIS begins: –prioritizing testing/debugging of CTSS services that we think are the most relevant for users – so far focusing on GRAM and GridFTP –evaluating potential sources of usage information: log mining, existing collections of use information, feedback from users, user services, ticketing system, existing tests Work with CUE to coordinate groups and test functionality as requested After TAIS begins, build a transition plan for the rest of PY5