The Future of Volunteer Computing David P. Anderson U.C. Berkeley Space Sciences Lab UH CS Dept. March 22, 2007.

Slides:



Advertisements
Similar presentations
BOINC: A System for Public-Resource Computing and Storage David P. Anderson University of California, Berkeley.
Advertisements

BOINC Berkeley Open Infrastructure for Network Computing An open-source middleware system for volunteer and grid computing (much of the images and text.
David P. Anderson Space Sciences Laboratory University of California – Berkeley Volunteer Computing.
High-Performance Task Distribution for Volunteer Computing Rom Walton
Volunteer Computing David P. Anderson Space Sciences Lab U.C. Berkeley May 2, 2007.
Scientific Computing on Smartphones David P. Anderson Space Sciences Lab University of California, Berkeley April 17, 2014.
Volunteer Computing and Hubs David P. Anderson Space Sciences Lab University of California, Berkeley HUBbub September 26, 2013.
Public-resource computing for CEPC Simulation Wenxiao Kan Computing Center/Institute of High Physics Energy Chinese Academic of Science CEPC2014 Scientific.
Achievements and Opportunities in Volunteer Computing David P. Anderson Space Sciences Lab U.C. Berkeley 18 April 2008.
Volunteer Computing David P. Anderson Space Sciences Lab U.C. Berkeley May 7, 2008.
Volunteer Computing with BOINC David P. Anderson Space Sciences Laboratory University of California, Berkeley.
Scientific Computing in the Consumer Digital Infrastructure David P. Anderson Space Sciences Lab University of California, Berkeley The Austin Forum November.
David P. Anderson Space Sciences Laboratory University of California – Berkeley Designing Middleware for Volunteer Computing.
Exa-Scale Volunteer Computing David P. Anderson Space Sciences Laboratory U.C. Berkeley.
David Cameron Claire Adam Bourdarios Andrej Filipcic Eric Lancon Wenjing Wu ATLAS Computing Jamboree, 3 December 2014 Volunteer Computing.
David Cameron Riccardo Bianchi Claire Adam Bourdarios Andrej Filipcic Eric Lançon Efrat Tal Hod Wenjing Wu on behalf of the ATLAS Collaboration CHEP 15,
07:44:46Service Oriented Cyberinfrastructure Lab, Introduction to BOINC By: Andrew J Younge
BOINC.
David P. Anderson Space Sciences Lab U.C. Berkeley Exa-Scale Volunteer Computing.
Volunteer Computing with GPUs David P. Anderson Space Sciences Laboratory U.C. Berkeley.
and Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley.
BOINC: Progress and Plans David P. Anderson Space Sciences Lab University of California, Berkeley BOINC:FAST August 2013.
David P. Anderson Space Sciences Laboratory University of California – Berkeley Designing Middleware for Volunteer Computing.
David P. Anderson Space Sciences Laboratory University of California – Berkeley Public and Grid Computing.
TEMPLATE DESIGN © BOINC: Middleware for Volunteer Computing David P. Anderson Space Sciences Laboratory University of.
Dr Jukka Klem CHEP06 1 Public Resource Computing at CERN – Philippe Defert, Markku Degerholm, Francois Grey, Jukka Klem, Juan Antonio.
David P. Anderson Space Sciences Laboratory University of California – Berkeley Public Distributed Computing with BOINC.
BOINC: An Open Platform for Public-Resource Computing David P. Anderson Space Sciences Laboratory U.C. Berkeley.
David P. Anderson Space Sciences Laboratory University of California – Berkeley Public Distributed Computing with BOINC.
A Tour of Citizen Cyber-Science David P. Anderson Space Sciences Laboratory U.C. Berkeley.
Exa-Scale Volunteer Computing David P. Anderson Space Sciences Laboratory U.C. Berkeley.
Volunteer Computing Involving the World in Science David P. Anderson Space Sciences Lab U.C. Berkeley 13 December 2007.
Volunteer Computing David P. Anderson Space Sciences Lab U.C. Berkeley 14 Sept 2007.
Volunteer Computing: SETI and Beyond David P. Anderson University of California, Berkeley 7 June 2007.
Volunteer Computing and BOINC Dr. David P. Anderson University of California, Berkeley Dec 3, 2010.
Frontiers of Volunteer Computing David Anderson Space Sciences Lab UC Berkeley 30 Dec
Volunteer Computing in the Next Decade David Anderson Space Sciences Lab University of California, Berkeley 4 May 2012.
Volunteer Computing in Biology David P. Anderson Space Sciences Lab U.C. Berkeley 10 Sept 2007.
David P. Anderson Space Sciences Laboratory University of California – Berkeley A Million Years of Computing.
Volunteer Computing: Involving the World in Science David P. Anderson U.C. Berkeley Space Sciences Lab February 16, 2007.
Volunteer Computing: the Ultimate Cloud Dr. David P. Anderson University of California, Berkeley Oct 19, 2010.
A Brief History of (CPU) Time -or- Ten Years of Multitude David P. Anderson Spaces Sciences Lab University of California, Berkeley 2 Sept 2010.
David P. Anderson Space Sciences Laboratory University of California – Berkeley Supercomputing with Personal Computers.
The Limits of Volunteer Computing Dr. David P. Anderson University of California, Berkeley March 20, 2011.
All the computers in the world (~1 billion) BOINC: high-level goal Computational science biology, medicine Earth sciences, physics, astronomy, math, A.I.,...
Volunteer Computing Involving the World in Science David P. Anderson Space Sciences Lab U.C. Berkeley 13 December 2007.
Volunteer Computing and Large-Scale Simulation David P. Anderson U.C. Berkeley Space Sciences Lab February 3, 2007.
Using volunteered resources for data-intensive computing and storage David Anderson Space Sciences Lab UC Berkeley 10 April 2012.
Technology for Citizen Cyberscience Dr. David P. Anderson University of California, Berkeley May 2011.
Volunteer Computing David P. Anderson U.C. Berkeley Space Sciences Lab Nov. 15, 2006.
Volunteer Computing with BOINC: a Tutorial David P. Anderson Space Sciences Laboratory University of California – Berkeley May 16, 2006.
Volunteer Computing David P. Anderson U.C. Berkeley Space Sciences Lab January 30, 2007.
An Overview of Volunteer Computing
Volunteer Computing and BOINC
The Future of Volunteer Computing
Status of WLCG FCPPL project
University of California, Berkeley
Building a Global Brain David P. Anderson U. C
Volunteer computing PC owners donate idle cycles to science projects
Volunteer Computing: Planting the Flag David P
Volunteer Computing: SETI and Beyond David P
Volunteer Computing for Science Gateways
Designing a Runtime System for Volunteer Computing David P
A Roadmap for Volunteer Computing in the U.S.
Exa-Scale Volunteer Computing
David P. Anderson Space Sciences Lab UC Berkeley LASER
The Global Status of Citizen Cyberscience
University of California, Berkeley
Ivan Reid (Brunel University London/CMS)
Exploring Multi-Core on
Presentation transcript:

The Future of Volunteer Computing David P. Anderson U.C. Berkeley Space Sciences Lab UH CS Dept. March 22, 2007

What is “Volunteer computing”? Internet Projects Volunteers ● Helps science ● Involves public in science

Volunteer computing is not... ● Grid computing ● Peer-to-peer computing

Volunteer computing software Application Infrastructure Manage work Transfer files Security Screensaver Accounting Do scientific computation BOINC (Berkeley Open Infrastructure for Network Computing)

Communication: “Pull” model client scheduler I’m a Windows/x86 computer with 512 MB RAM 20GB free disk 2.5 GFLOPS CPU Here are three jobs. Job 1 has application files A,B,C, input files C,D,E and output file F...

BOINC (Volunteer’s view) ● 1-click install, zero configuration ● All platforms ● Invisible, autonomic

Creating a BOINC project ● Get a server (Linux; ~$5K) ● BOINC-enable application ● Compile for various platforms ● Develop programs to generate and handle work ● Test ● Create web pages about your research ● Publicize ● Keep volunteers informed

What applications can use BOINC? ● Should be resource-intensive – 1 CPU year: do it yourself – 10,000 CPU years: use BOINC ● Lots of independent tasks ● Low data/compute ratio Examples: - Physical simulations (molecule, Earth, universe) - CPU-intensive data analysis - Search of large spaces (math)

Example: ClimatePrediction.net ● Application: UK Met Office Unified Model ● State-of-the-art global climate model – 1 million lines of FORTRAN ● High-dimensional search space – model parameters – boundary conditions – perturbed initial conditions

ClimatePrediction.net ● Using supercomputers: – 1 day per run – total runs ● Using BOINC: – 6 months per run – 50,000 active hosts – 171,343 runs completed – Nature papers – 60-fold savings

Other BOINC-based projects ● – LIGO; gravitational wave astronomy ● – U. Washington; protein study ● – U.C. Berkeley; SETI ● – CERN; accelerator simulation ● – STI, U. of Geneva; malaria epidemiology ● IBM World Community Grid – several biomedical applications ●...and about 30 others

Computing power ● Today: 450,000 active computers, 500 TFLOPS – 450 million more PCs out there! ● Future: game consoles – Sony Playstation 3: 100 GFLOPS – ExaFLOP computing feasible

The hard problems ● How to increase the number of volunteers? – currently 1 in 1000 PC owners ● How to increase the number of projects? – currently stuck at about 50 ● How to get volunteers to diversify?

How to attract and retain volunteers? ● Retention – reminder s – frequent science updates ● Recruitment – Software-based ● “ a friend” mechanism ● credit-based pyramid scheme? – Organizational ● World Community Grid: “partner” program – Media coverage ● need more discoveries – Commercial (bundling) Active hosts:

Why aren’t there more projects? ● Lack of PR among scientists ● IT antipathy ● Creating a BOINC project is expensive: Science App development Experiment design Paper writing Research group Software/IT Port/debug apps workflow tools server admin Communications Web site development message board admin public relations

Meta-projects ● Virtual Campus Supercomputing Center – Deployment and publicity: ● PC labs, staff/faculty desktops ● students ● alumni ● public ● IBM World Community Grid Science App development Experiment design Paper writing Research groups Software/IT Port/debug apps workflow tools server admin Communications Web site development message board admin public relations e Existing UCB staff

Growing a healthy computational ecosystem ● Cross-project credit accounting system – encourage competition in total credit, not per-project ● Account Managers – Make it easier to discover/attach/detach projects – GridRepublic, BAM! ● Scientific Mutual Funds? – e.g. American Cancer Society BOINC “portfolio” ● Science Stock Market? – encourage participation in new high-potential projects

What else can volunteers do? ● Testing ● Translation ● Program optimization ● Message-board moderation ● Online customer support ● Skilled tasks –

Conclusion ● Volunteer computing – new paradigm for scientific computing – more/cheaper computing power – public involvement in science – enabling technology: BOINC ● Talk to or me about: – Using BOINC for your research – Organizational use of BOINC – Other uses of volunteers to help research