Objectives Functionalities and services Architecture and software technologies Potential Applications –Link to research problems.

Slides:



Advertisements
Similar presentations
Abstraction Layers Why do we need them? –Protection against change Where in the hourglass do we put them? –Computer Scientist perspective Expose low-level.
Advertisements

SLA-Oriented Resource Provisioning for Cloud Computing
The Case for Enterprise Ready Virtual Private Clouds Timothy Wood, Alexandre Gerber *, K.K. Ramakrishnan *, Jacobus van der Merwe *, and Prashant Shenoy.
High Performance Computing Course Notes Grid Computing.
CLOUD COMPUTING AN OVERVIEW & QUALITY OF SERVICE Hamzeh Khazaei University of Manitoba Department of Computer Science Jan 28, 2010.
Using DSVM to Implement a Distributed File System Ramon Lawrence Dept. of Computer Science
SDN and Openflow.
Some contributions to the management of data in grids Lionel Brunie National Institute of Applied Science (INSA) LIRIS Laboratory/DRIM Team – UMR CNRS.
Notes to the presenter. I would like to thank Jim Waldo, Jon Bostrom, and Dennis Govoni. They helped me put this presentation together for the field.
Managing Data Resources
Automatic Run-time Adaptation in Virtual Execution Environments Ananth I. Sundararaj Advisor: Peter A. Dinda Prescience Lab Department of Computer Science.
Introduction and Overview “the grid” – a proposed distributed computing infrastructure for advanced science and engineering. Purpose: grid concept is motivated.
Distributed Application Management Using PLuSH Jeannie Albrecht, Christopher Tuttle, Alex C. Snoeren, and Amin Vahdat UC San Diego CSE {jalbrecht, ctuttle,
Ch 12 Distributed Systems Architectures
CS294-6 Reconfigurable Computing Day 3 September 1, 1998 Requirements for Computing Devices.
Page 1Prepared by Sapient for MITVersion 0.1 – August – September 2004 This document represents a snapshot of an evolving set of documents. For information.
Middleware for P2P architecture Jikai Yin, Shuai Zhang, Ziwen Zhang.
New Challenges in Cloud Datacenter Monitoring and Management
Introduction to Databases Transparencies 1. ©Pearson Education 2009 Objectives Common uses of database systems. Meaning of the term database. Meaning.
DESIGN OF A PLATFORM OF VIRTUAL SERVICE CONTAINERS FOR SERVICE ORIENTED CLOUD COMPUTING Carlos de Alfonso Andrés García Vicente Hernández.
FI-WARE – Future Internet Core Platform FI-WARE Interface to Networks and Devices (I2ND) July 2011 High-level description.
©Ian Sommerville 2006Software Engineering, 8th edition. Chapter 12 Slide 1 Distributed Systems Architectures.
RUNNING PARALLEL APPLICATIONS BEYOND EP WORKLOADS IN DISTRIBUTED COMPUTING ENVIRONMENTS Zholudev Yury.
German National Research Center for Information Technology Research Institute for Computer Architecture and Software Technology German National Research.
Introduction and Overview Questions answered in this lecture: What is an operating system? How have operating systems evolved? Why study operating systems?
Parallel Programming Models Jihad El-Sana These slides are based on the book: Introduction to Parallel Computing, Blaise Barney, Lawrence Livermore National.
DISTRIBUTED DATABASES IN ADBMS Shilpa Seth
Master Thesis Defense Jan Fiedler 04/17/98
Grid Security Issues Shelestov Andrii Space Research Institute NASU-NSAU, Ukraine.
Towards a Grid-based DBMS Craig Thompson University of Arkansas In certain high-end data-centric applications, practitioners are discovering that traditional.
The Grid System Design Liu Xiangrui Beijing Institute of Technology.
Virtual Private Ad Hoc Networking Jeroen Hoebeke, Gerry Holderbeke, Ingrid Moerman, Bard Dhoedt and Piet Demeester 2006 July 15, 2009.
The roots of innovation Future and Emerging Technologies (FET) Future and Emerging Technologies (FET) The roots of innovation Proactive initiative on:
1 4/23/2007 Introduction to Grid computing Sunil Avutu Graduate Student Dept.of Computer Science.
 Three-Schema Architecture Three-Schema Architecture  Internal Level Internal Level  Conceptual Level Conceptual Level  External Level External Level.
Lecture # 3 & 4 Chapter # 2 Database System Concepts and Architecture Muhammad Emran Database Systems 1.
DISTRIBUTED SYSTEMS Principles and Paradigms Second Edition ANDREW S
Scenarios for a Learning GRID Online Educa Nov 30 – Dec 2, 2005, Berlin, Germany Nicola Capuano, Agathe Merceron, PierLuigi Ritrovato
The Replica Location Service The Globus Project™ And The DataGrid Project Copyright (c) 2002 University of Chicago and The University of Southern California.
1 Integrating security in a quality aware multimedia delivery platform Paul Koster 21 november 2001.
Data Management in Large-scale P2P Systems
Chapter 2 Database System Concepts and Architecture Dr. Bernard Chen Ph.D. University of Central Arkansas.
The Knowledge Grid Methodology  Concepts, Principles and Practice Hai Zhuge China Knowledge Grid Research Group Chinese Academy of Sciences.
Scalable Grid system– VDHA_Grid: an e-Science Grid with virtual and dynamic hierarchical architecture Huang Lican College of Computer.
Introduction to Grids By: Fetahi Z. Wuhib [CSD2004-Team19]
Plethora: Infrastructure and System Design. Introduction Peer-to-Peer (P2P) networks: –Self-organizing distributed systems –Nodes receive and provide.
Scalable Group Communication for the Internet Idit Keidar MIT Lab for Computer Science Theory of Distributed Systems Group.
High-Speed Policy-Based Packet Forwarding Using Efficient Multi-dimensional Range Matching Lakshman and Stiliadis ACM SIGCOMM 98.
© Chinese University, CSE Dept. Distributed Systems / Distributed Systems Topic 1: Characterization of Distributed & Mobile Systems Dr. Michael R.
Architecture View Models A model is a complete, simplified description of a system from a particular perspective or viewpoint. There is no single view.
Distributed Database Management Systems. Reading Textbook: Ch. 1, Ch. 3 Textbook: Ch. 1, Ch. 3 For next class: Ch. 4 For next class: Ch. 4 FarkasCSCE.
GRID ANATOMY Advanced Computing Concepts – Dr. Emmanuel Pilli.
Peer-to-Peer Systems: An Overview Hongyu Li. Outline  Introduction  Characteristics of P2P  Algorithms  P2P Applications  Conclusion.
©Ian Sommerville 2000, Tom Dietterich 2001 Slide 1 Distributed Systems Architectures l Architectural design for software that executes on more than one.
1 Ji Wang and Dongsheng Li National Lab for Parallel and Distributed Processing Introduction of iVCE ( Internet-based V irtual C omputing E nvironment.
1 Chapter 2: Operating-System Structures Services Interface provided to users & programmers –System calls (programmer access) –User level access to system.
Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved DISTRIBUTED SYSTEMS.
Towards a High Performance Extensible Grid Architecture Klaus Krauter Muthucumaru Maheswaran {krauter,
DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING CLOUD COMPUTING
Building Distributed Educational Applications using P2P
PROGRAM STUDI TEKNIK INFORMATIKA FAKULTAS ILMU KOMPUTER
University of Technology
Overlay Networking Overview.
Mobile Computing.
CLUSTER COMPUTING.
Database Systems Instructor Name: Lecture-3.
Cloud Computing: Concepts
The Anatomy and The Physiology of the Grid
The Anatomy and The Physiology of the Grid
Presentation transcript:

Objectives Functionalities and services Architecture and software technologies Potential Applications –Link to research problems

What What is overlay computer –PC with virtualised resources –Exploit the aggregate power of Internet machines How sensor networks fit in the picture ?

Functionality of the overlay computer (1) Build a very large ‘file system’ out of many machines What is new with respect to previous projects in the area ? And how we leverage the science we do in Aeolus ?

Functionality of the overlay computer (2) Run a parallel application –Distribute processes to different machines –Issue: Matching Configuration and Execution Context How does this differs from GRID ?

Architecture Note – there should be a distinction between services available to the programmer and those used by the overlay computer only Transparency or ‘opaqueness’ of the platform –Should the platform expose information such as performance, trust, etc. to the programmer or

Functionalities - discussion We discuss and describe more functionalities than we implement The operating system metaphore is a long term challenge, providing some common context to research –We do not aim at design of a complete operating system What are the assumptions related to the environment the overlay computer –Dynamicity –Etherogeneity

Functionalities – discussion (2) What are the primitives (pino) of the overlay computer –Sort of system calls There should be a perspective on QoS –Programmer should be able to specify the desired QoS ? –Should the OC be able to provide different levels of service (e.g. trust, reliability etc) ? –Or should the overlay computer be just ‘best-effort’ ? What is the minimum service guarantees that the system provides ?

Functionalities – discussion (3) Should we have as input figures on reliability and availability ? –Should we assume high availability (e.g. 85 – 90 %) of the constituent PCs or very low (e.g. laptops, or personal PCs) ? –How much dynamics and what type ? Join/ leave Up/ Down In other words –Are we assuming network of servers e.g. university servers, company servers etc or home PCs ?

Functionalities – discussion (3).. And as a consequence –Are we looking for a flat p2p architecture or a hierarchical/ super-peer architecture ? Which degree of selfishness should we expect ? –I.e. fully cooperative or partially selfish

Functionalities – top level

System model Real machine –??? Missing decision about what types of machines are used, the dynamicity, the selfishness ??? Virtual machine –Overlay with the following abstractions (next slide) Applications –Use the VM

Main abstractions (also ‘toplevel functionalities’) What are the main abstractions of the General Purpose Computing –Files –Processes –Communication Primitives Application Level Multicast e.g. I3 ?subset synchronization?

Data Management (‘Files’) File storage –Blocks, chunks or entire file as unit of distribution ? –Possible answer Low-level storage as blocks Virtual File System (?) File system/ name space functionalities Record or ‘tuple’ oriented storage –Direct access to records by key Indexes –Complex queries

Data Management (‘Files’) What is for the programmer and what to support other functionalities of the platform (e.g. trust/ reputation, resource advertisement and discovery..) ?

Load Management (‘processes’)

Resource Negotiation and Allocation

Functionalities (security) Secure authentication –Some in jxta already –Role base authentication –Anonimity in authentication Trust/ reputation management Defense against misbehaving entities Certified information access –(access to databases) –Anonimization Function evaluation –E.g. secure auctions

More functionality Resource Advertisement and Discovery –Would benefit from DHT Access / Membership Functionality –Rules for being accepted by the system –Is this distinct from authentication/ role based authentication/ reputation management ? Keep a (dynamic) model of the global computer ? –E.g. to allocate a computation to a machine close to the data –Ability to reason about load –Mechanisms for dissemination of management information (e.g. load) should be part of the system –Network awareness – ability to reason about topology, latency of communication

Actions – Next steps For each functionality –Proposer provide a concise definition of functionality –Proposer provide exemplary APIs for functionality