Olston, Ailamaki, Garrod, Maggs, Manjhi, Mowry, Carnegie Mellon University Conference on Innovative Data System Research, 2005 A Scalability Service for.

Slides:



Advertisements
Similar presentations
Law Awareness in a Norm-regulated MAS Alberto Sardinha Gustavo Robichez de Carvalho Rodrigo Paes Pedro Cunha.
Advertisements

Indications in green = Live content Indications in white = Edit in master Indications in blue = Locked elements Indications in black = Optional elements.
Consistency and Replication Chapter 7 Part II Replica Management & Consistency Protocols.
1 Content Delivery Networks iBAND2 May 24, 1999 Dave Farber CTO Sandpiper Networks, Inc.
Distributed Systems Fall 2010 Replication Fall 20105DV0203 Outline Group communication Fault-tolerant services –Passive and active replication Highly.
A Taxonomy and Survey of Content Delivery Networks Meng-Huan Wu 2011/10/26 1.
Dept. of Computer Science & Engineering, CUHK1 Trust- and Clustering-Based Authentication Services in Mobile Ad Hoc Networks Edith Ngai and Michael R.
Prefix Caching assisted Periodic Broadcast for Streaming Popular Videos Yang Guo, Subhabrata Sen, and Don Towsley.
1 CAPS: A Peer Data Sharing System for Load Mitigation in Cellular Data Networks Young-Bae Ko, Kang-Won Lee, Thyaga Nandagopal Presentation by Tony Sung,
An Authentication Service Against Dishonest Users in Mobile Ad Hoc Networks Edith Ngai, Michael R. Lyu, and Roland T. Chin IEEE Aerospace Conference, Big.
EEC-681/781 Distributed Computing Systems Lecture 3 Wenbing Zhao Department of Electrical and Computer Engineering Cleveland State University
Distributed Systems Fall 2009 Replication Fall 20095DV0203 Outline Group communication Fault-tolerant services –Passive and active replication Highly.
@ Carnegie Mellon Databases 1 Invalidation Clues for Database Scalability Services Amit Manjhi* 1, Phillip B. Gibbons z, Anastassia Ailamaki *, Charles.
Overview  Strong consistency  Traditional approach  Proposed approach  Implementation  Experiments 2.
Caching And Prefetching For Web Content Distribution Presented By:- Harpreet Singh Sidong Zeng ECE Fall 2007.
@ Carnegie Mellon Databases 1 Simultaneous Scalability and Security for Data-Intensive Web Applications Amit Manjhi *, Anastassia Ailamaki *, Bruce M.
Web Caching Schemes For The Internet – cont. By Jia Wang.
A Gateway For SIP Event Interworking - Sasu Tarkoma & Thalainayar Balasubramanian Ramya.
World Wide Web Caching: Trends and Technology Greg Barish and Katia Obraczka USC Information Science Institute IEEE Communications Magazine, May 2000 Presented.
A Scalability Service for Dynamic Web Applications Anastassia Ailamaki Joint work with Christopher Olston, Amit Manjhi, Charles Garrod, Bruce M. Maggs,
A Secure Scalability Service for Dynamic Content Bruce Maggs Carnegie Mellon University and Akamai Technologies Joint work with Charlie Garrod and Amit.
Client-Server Computing in Mobile Environments
Construction of efficient PDP scheme for Distributed Cloud Storage. By Manognya Reddy Kondam.
Achieving Load Balance and Effective Caching in Clustered Web Servers Richard B. Bunt Derek L. Eager Gregory M. Oster Carey L. Williamson Department of.
Word Wide Cache Distributed Caching for the Distributed Enterprise.
Where in the world is my data? Sudarshan Kadambi Yahoo! Research VLDB 2011 Joint work with Jianjun Chen, Brian Cooper, Adam Silberstein, David Lomax, Erwin.
On P2P Collaboration Infrastructures Manfred Hauswirth, Ivana Podnar, Stefan Decker Infrastructure for Collaborative Enterprise, th IEEE International.
Zhen Feng, Mingwei Xu, Yu Wang and Qing Li Tsinghua University, Beijing, China, Globalcom2013 – NGN Symposium Katto Lab Hiroto Kisara AN ARCHITECTURE FOR.
An Integrated QoS, Security and Mobility Framework for Delivering Ubiquitous Services Across All IP-based Networks Haitham Cruickshank University of Surrey.
Web Caching By Neeraj Agrawal. Caching Caching is widely used for improving performance in many context( e.g processor caches in hardware, buffer pool.
Peer-to-Peer Distributed Shared Memory? Gabriel Antoniu, Luc Bougé, Mathieu Jan IRISA / INRIA & ENS Cachan/Bretagne France Dagstuhl seminar, October 2003.
1 CS6320 – Performance L. Grewe. Number of requests a website receives is unpredictable CNN, NY Times, ABC News unavailable from 9-10 AM (Eastern Time)
Consistent and Efficient Database Replication based on Group Communication Bettina Kemme School of Computer Science McGill University, Montreal.
Strong Cache Consistency Support for Domain Name System Xin Chen, Haining Wang, Sansi Ren and Xiaodong Zhang College of William and Mary, Williamsburg,
ECO-DNS: Expected Consistency Optimization for DNS Chen Stephanos Matsumoto Adrian Perrig © 2013 Stephanos Matsumoto1.
Advanced Computer Networks Topic 2: Characterization of Distributed Systems.
Understanding the Performance of Web Caching System with an Analysis Model and Simulation Xiaosong Hu Nur Zincir-Heywood Sep
Architecture for Caching Responses with Multiple Dynamic Dependencies in Multi-Tier Data- Centers over InfiniBand S. Narravula, P. Balaji, K. Vaidyanathan,
Fast Searching in Peer-to-Peer Networks Self-Organizing Parallel Search Clusters Rocky Dunlap.
An IP Address Based Caching Scheme for Peer-to-Peer Networks Ronaldo Alves Ferreira Joint work with Ananth Grama and Suresh Jagannathan Department of Computer.
Distributed Systems Principles and Paradigms Chapter 12 Distributed Coordination-Based Systems 01 Introduction 02 Communication 03 Processes 04 Naming.
@ Carnegie Mellon Databases 1 Simultaneous Scalability and Security for Data-Intensive Web Applications Amit Manjhi *, Anastassia Ailamaki *, Bruce M.
Web Cache Consistency. “Requirements of performance, availability, and disconnected operation require us to relax the goal of semantic transparency.”
Computer Science Lecture 14, page 1 CS677: Distributed OS Last Class: Concurrency Control Concurrency control –Two phase locks –Time stamps Intro to Replication.
MOBILITY Beyond Third Generation Cellular Feb
Distributed File Systems
Caching Consistency and Concurrency Control Contact: Dingshan He
Doc.: IEEE /0310r0 Submission Sept 2007 Srinivas Sreemanthula Slide 1 IEEE MEDIA INDEPENDENT HANDOVER DCN: MIH-Security-Options.ppt.
Content Delivery Networks: Status and Trends Speaker: Shao-Fen Chou Advisor: Dr. Ho-Ting Wu 5/8/
Ad insertion at proxies to improve cache hit rates Amit Gupta and Geoffrey baehr, Sun Microsystems Laboratories 901 San Antonio Road Palo Alto,CA
System Software Lab. A Scalable Web Cache Consistency Architecture Kim Sangyup SSLAB. EE. KAIST SIGCOMM ’ 99 Haobo Yu, Lee Breslau.
Highly Available Services and Transactions with Replicated Data Jason Lenthe.
Tzu-Han Wu Yi-Chi Chiang Han-Yang Ou
/ Fast Web Content Delivery An Introduction to Related Techniques by Paper Survey B Li, Chien-chang R Sung, Chih-kuei.
The Distributed Object Consistency Protocol Version 1.0 John Dilley, Martin Arlitt, Stephane Perret, Tai Jin Hewlett-Packard Laboratories Palo Alto, CA.
WCDP: A protocol for web cache consistency Renu Tewari IBM Almaden Research Thirumale Niranjan IBM Software Group
CS6320 – Performance L. Grewe.
Client Behavior and Feed Characteristics of RSS
Providing Secure Storage on the Internet
MAC Address Hijacking Problem
CS6320 – Performance L. Grewe.
Consistency and Replication
Outline Announcements Lab2 Distributed File Systems 1/17/2019 COP5611.
Indirect Communication Paradigms (or Messaging Methods)
Indirect Communication Paradigms (or Messaging Methods)
Author: Ikeda, H.   Sugawa, J.   Ashi, Y.   Sakamoto, K.  From:
Outline Review of Quiz #1 Distributed File Systems 4/20/2019 COP5611.
Existing CDNs Fail to Address these Challenges
SIENA: Wide-Area Event Notification Service
Data Dissemination and Management (3)
Presentation transcript:

Olston, Ailamaki, Garrod, Maggs, Manjhi, Mowry, Carnegie Mellon University Conference on Innovative Data System Research, 2005 A Scalability Service for Dynamic Web Applications Raihan Al-Ekram University of Waterloo October 11, 2006

2 Outline  Scalability Problem  A Solution  Challenges  Proposed System  Architecture  Operation  Consistency Management  Channel-By-Query  Channel-By-Update  View Invalidation Strategies  Conclusion  Discussion

3 Scalability Problem  Sudden Popularity Spikes  Slashdot effect  Civic Emergency  9/11, Hurricane Katrina

4 A Solution  Scalability as a Third Party Service  Content Distribution Network

5 Challenges  Strong Consistency  Inconsistency could cost lives  Precludes TTL based caching  Ownership of Data  Security concerns  Data corruption risks  Precludes distributed data replication  Invalidate cache instead of updating

6 Observations  Read domination  Modifications only in Home Servers  Predefined Query and Update Templates  Cache invalidation based on query/update independence analysis  Strong cache consistency

7 System Architecture

8 System Operation  Fixed set of query and update templates at the proxy servers  Statically analyze the templates for conflicting query templates for each update template  When an update template is instantiated, all proxies containing an instantiation of a conflicting query template is notified for invalidation  Query template instantiations are organized in multicast groups and notifications are sent to only to proper multicast groups

9 Consistency Management  Update Templates 1.insert into inv values (name=?, id=?, qty=?, date=now()) 2.update inv set qty=? Where id=?  Query Templates 1.select qty from inv where name=? 2.Select * from inv where date>? 3.select * from inv where qty<?

10 Channel-By-Query  Multicast Channels  One per query template, parameter independent oQ1-PI, Q2-PI, Q3-PI  One per parameter binding of an equality comparison oQ1-PS1, Q1-PS2, Q1-PS3 …  Query Template Instantiation  Subscribe own channels oQ1: Q1-PI, Q1-PSx oQ2: Q2-PI oQ3: Q3-PI  Update Template Instantiation  Notify conflicting query channels oU1: Q1-PSx, Q2-PI, Q3-PI oU2: Q1-PI, Q2-PI, Q3-PI  Receive Notification  Unsubscribe channels

11 Channel-By-Update  Multicast Channels  One per update template, parameter independent oU1-PI, U2-PI  One per parameter binding oU1-PS1, U1-PS2, …, U2-PS1, U2-PS2, …  Query Template Instantiation  Subscribe conflicting update channels oQ1: U1-PSx, U2-PI oQ2: U1-PI, U2-PI oQ3: U1-PI, U2-PI  Update Template Instantiation  Notify own channels oU1: U1-PSx, U1-PI oU2: U2-PI  Receive Notification  Unsubscribe to channels

12 Comparison  Channel-By-Query  Fewer channel subscriptions  More multicast messages  Channel-By-Update  More channel subscriptions  Fewer multicast messages

13 View Invalidation  Strategies  Black-box, only query and update available  View-Inspection, access to cache data is also available  Full-Access, access to base data is also available  Example  Books (Title, Author, Subject)  Authors (Author, Award, Country)

14 View Invalidation  View  create view MyView (Author, Award) as select A.Author, B.Award from Authors A, Books B where A.Author=B.Author and A.Country=“USA” and B.Subject=“History”  Updates 1.update Authors set Country=“France” whereAuthor=“Tocqueville” 2.update Books set Subject=“Fiction” whereTilte=“Napoleon’s Television”  Can benefit from view- inspection if there is no Author=“Tocqueville”  Can benefit from full- access if before the update Subject “History”

15 Conclusion  Ongoing work  Scalable and consistent data caching  Co-operative caches  Minimal home server involvement

16 Discussion  How are the updates in the home servers propagated to the proxies?  How do the proxies determine if the client requested data is in the cache?  Can this scheme provide 1SR or SI guarantee?