Computing in Atmospheric Sciences Workshop: 2003 Challenges of Cyberinfrastructure Alan Blatecky Executive Director San Diego Supercomputer Center

Computing in Atmospheric Sciences Workshop: 2003 Driving Factor 1: Technology Pull Continuing exponential advances in sensor, computer, storage and network capabilities will occur Sensor networks are creating new experimental facilities PetaByte databases are in-place; ExaByte databases will become feasible Increase in numerical and computer modeling capabilities and capacities will continue to broaden the base of science disciplines Increase in network speeds makes it feasible to connect distributed resources as never before

Computing in Atmospheric Sciences Workshop: 2003 Technology Curves Optical Fiber (bits per second) (Doubling time 9 Months) Silicon Computer Chips (Number of Transistors) (Doubling time 18 Months) Data Storage (bits per square inch) (Doubling time 12 Months)

Computing in Atmospheric Sciences Workshop: 2003 Driving Factor 2: Science Problem Push New classes of scientific problems are now being pursued More difficult research, more complex requirements Coupling of expertise, collaboration, and disciplines encourage the development of new science and research –High energy physicists are planning to harness tens of thousands of CPUs in a worldwide data grid –On-line digital sky survey requires mechanisms for data federation and effective navigation –Geoscientists are planning to interlink and share multi-disciplinary data sets to understand the complex dynamics of Earth Systems

Computing in Atmospheric Sciences Workshop: 2003 Initial Observations Emerging technologies are enabling new types of collaboration and possibilities in Science Recent changes in the nature of science are creating an urgent requirement for a new class of distributed science infrastructure E-science has some unique requirements that will not be addressed by industry Current Grid/Middleware technology and software development is being done via a patchwork of diverse, short-term projects and programs around the globe Infrastructure now extends far beyond just technologies and capabilities

Computing in Atmospheric Sciences Workshop: 2003 Hardware NSF Model: Integrated CI System meeting the needs of a community of communities Grid Services & Middleware Development Tools & Libraries Applications Environmental Science High Energy Physics Proteomics/Genomics … Domain- specific Cybertools (software) Shared Cybertools (software) Distributed Resources (computation, communication storage, etc.) Education and Training Discovery & Innovation

Computing in Atmospheric Sciences Workshop: 2003 Data & Storage Networks & Middleware Instruments & Labs Domain Expertise & Disciplines Institutions & Communities Computers & Grids E-Science Collaboration Knowledge Applications Cyberinfrastructure

Computing in Atmospheric Sciences Workshop: 2003 Cultural Challenges I Nature of science and engineering enabled by cyberinfrastructure is fundamentally different from traditional approaches Sharing becomes a fundamental tenet for science –New traditions of competing and cooperation need to be developed –Remote participation and management of distributed control Who “owns” research that is shared and collaborative? –What about derivative rights, credit in terms of publication and exploration?

Computing in Atmospheric Sciences Workshop: 2003 Cultural Challenges II Conceptual models and frameworks to understand cyberinfrastructure are limited –NSF is in process of defining –What are Virtual Organizations? Social conventions, folkways and mores for science & research need to change What are the incentives? What does key contributor mean in truly distributed and open collaborations?

Computing in Atmospheric Sciences Workshop: 2003 Technical Challenges Standard setting is wishful thinking due to swiftness of technology change More players, more heterogeneity, design must scale System must be production-ready – SW must be bullet-proof, useful, usable Most interesting programming models (real-time, on-demand, adaptive, etc.) still require considerable research Useful cyber tools, useful domain tools, required

Computing in Atmospheric Sciences Workshop: 2003 Logistical, Legal Challenges Who maintains the Software? Who fixes the bugs? Who documents the code? Who answers the phone? Who wears the pager? How do we do accounting over multiple administrative and discipline domains? How do we allocate resources over multiple sites? How do we deal with varying organizational IP policies, open source policies, licensing policies, etc. What authority and responsibility will or should Virtual Organizations have?

Computing in Atmospheric Sciences Workshop: 2003 Ideological Challenges What organizational framework promotes development of stable, persistent infrastructure? How do we integrate different institutional approaches and cultures for administration of resources, operations, software development and deployment, etc. How do we develop metrics and incentives for meaningful cooperation, coordination, community collections, etc What is shared/private, free/charged for, centralized/distributed, etc.

Computing in Atmospheric Sciences Workshop: 2003 International Challenges How do you share resources across national boundaries? How do we do global allocations? Who make decisions? Who enforces decisions? What mechanisms should be used to select/support applications? How do we ensure stability and interoperability? What about national security?

Computing in Atmospheric Sciences Workshop: 2003 Some Support Issues Inadequate funding of Grid and middleware in general A recognition that long-term, sustained, and persistent efforts to develop and support grid and middleware must be established as soon as possible A recognition that international coordination, cooperation and collaboration has to be enabled Inadequate funding of pipelines to produce expertise for future

Computing in Atmospheric Sciences Workshop: 2003 End