Miron Livny Center for High Throughput Computing Computer Sciences Department University of Wisconsin-Madison Open Science Grid (OSG)

Big Picture › Starting year six of the ‘original’ five year project and year 12 of early ‘grid’ projects – PPDG (DOE), GriPhyN (NSF-ITR) and iVDGL (NSF). › Proposal for the next five years under joint review of DOE and NSF › Over all funding 30+ FTEs › 10+ institutions involved

“The members of the OSG are united by a commitment to promote the adoption and to advance the state of the art of distributed high throughput computing (DHTC) – shared utilization of autonomous resources where all the elements are optimized for maximizing computational throughput.”

“ The OSG project is organized into five technical areas− Production, Technology, Software, Security, and User Support− with each area having a lead, and a support area that includes the following activities- Education, Documentation and Training, Communication, International Outreach and Assessment.”

“ As a focal point, Production is positioned to enhance this economy in other areas: by working toward interoperability with other CIs, and by replicating the DHTC pattern so that any interested university can benefit. We begin by helping universities build out their own local fabric of shared DHTC services to support a local community of students and faculty. ”

Open Science Grid (OSG)OSG HTC at the National Level

Overlay Resource Managers Ten years ago we introduced the concept of Condor glide-ins as a tool to support ‘just in time scheduling’ in a distributed computing infrastructure that consists of recourses that are managed by (heterogeneous) autonomous resource managers. By dynamically deploying a distributed resource manager on resources allocated (provisioned) by the local resource managers, the overlay resource manager can implement a unified resource allocation policy. In other words, we use remote job invocation to get resources allocated.

Subject: [Chtc-users] Daily CHTC OSG glidein usage From: Date: 9/5/ :15 AM To: Total Usage between and Group Usage Summary User Hours Pct Morgridge_Thomson % 2 Biochem_Attie % 3 Chemistry_Schmidt % 4 Chemistry_Cui % 5 ChE_dePablo % TOTAL % Info:

“The vision of the OSG partnership centers around enabling scientific research and discovery through DHTC. We aspire to be open towards the broadest possible range of stakeholders in terms of diversity of science and organizational structure.”