Publisher Mobility in Distributed Publish/Subscribe Systems Vinod Muthusamy, Milenko Petrovic, Dapeng Gao, Hans-Arno Jacobsen University of Toronto June.

Slides:

Advertisements

Similar presentations

Dynamic Replica Placement for Scalable Content Delivery Yan Chen, Randy H. Katz, John D. Kubiatowicz {yanchen, randy, EECS Department.

Advertisements

Efficient Event-based Resource Discovery Wei Yan*, Songlin Hu*, Vinod Muthusamy +, Hans-Arno Jacobsen +, Li Zha* * Chinese Academy of Sciences, Beijing.

Alex Cheung and Hans-Arno Jacobsen August, 14 th 2009 MIDDLEWARE SYSTEMS RESEARCH GROUP.

1 Cycle Detection in Publish/Subscribe Overlay Networks Reza Sherafat Alex Cheung Prof. Cristiana Amza ECE1747 – Course Project University of Toronto.

Management of Uncertainty in Publish/Subscribe Systems Haifeng Liu Department of Computer Sceince University of Toronto.

Multicast in Wireless Mesh Network Xuan (William) Zhang Xun Shi.

Partition-Tolerant Distributed Publish/Subscribe Systems

Rumor Routing in Sensor Networks David Braginsky and Deborah Estrin LECS – UCLA Modified and Presented by Sugata Hazarika.

Small-Scale Peer-to-Peer Publish/Subscribe

Transactional Mobility in Distributed Content-Based Publish/Subscribe Systems Songlin Hu*, Vinod Muthusamy +, Guoli Li +, Hans-Arno Jacobsen + * Chinese.

MIDDLEWARE SYSTEMS RESEARCH GROUP A Taxonomy for Denial of Service Attacks in Content-based Publish/Subscribe Systems Alex Wun, Alex Cheung, Hans-Arno.

SCAN: A Dynamic, Scalable, and Efficient Content Distribution Network Yan Chen, Randy H. Katz, John D. Kubiatowicz {yanchen, randy,

Subscription Subsumption Evaluation for Content-Based Publish/Subscribe Systems Hojjat Jafarpour, Bijit Hore, Sharad Mehrotra, and Nalini Venkatasubramanian.

Distributed Mobile Event Systems Sasu Tarkoma MiNEMA Workshop.

©NEC Laboratories America 1 Hui Zhang Samrat Ganguly Sudeept Bhatnagar Rauf Izmailov NEC Labs America Abhishek Sharma University of Southern California.

M ERCURY : A Scalable Publish-Subscribe System for Internet Games Ashwin R. Bharambe, Sanjay Rao & Srinivasan Seshan Carnegie Mellon University.

Beneficial Caching in Mobile Ad Hoc Networks Bin Tang, Samir Das, Himanshu Gupta Computer Science Department Stony Brook University.

Carnegie Mellon University Complex queries in distributed publish- subscribe systems Ashwin R. Bharambe, Justin Weisz and Srinivasan Seshan.

Minema 1 From chemical signals to event dissemination in a mobile system EPFL Distributed Programming Laboratory Sébastien Baehni, Chirdeep S. Chhabra,

Design and Evaluation of a Wide-Area Event Notification Service Antonio Carzaniga David S. Rosenblum Alexander L. Wolf.

1 AINA 2006 Wien, April th 2006 DiVES: A DISTRIBUTED SUPPORT FOR NETWORKED VIRTUAL ENVIRONMENTS The IEEE 20th International Conference on Advanced.

ICNP'061 Benefit-based Data Caching in Ad Hoc Networks Bin Tang, Himanshu Gupta and Samir Das Department of Computer Science Stony Brook University.

Hermes: A Distributed Event- Based Middleware Architecture Peter Pietzuch and Jean Bacon 1st DEBS Workshop, Vienna,

A Gateway For SIP Event Interworking - Sasu Tarkoma & Thalainayar Balasubramanian Ramya.

Peer-to-peer Multimedia Streaming and Caching Service by Won J. Jeon and Klara Nahrstedt University of Illinois at Urbana-Champaign, Urbana, USA.

Fuego Event Service: Towards Modularity in Event Routing Sasu Tarkoma Rutgers-Helsinki Workshop

Distributed Publish/Subscribe Network Presented by: Yu-Ling Chang.

Alex King Yeung Cheung and Hans-Arno Jacobsen University of Toronto June, 24 th 2010 ICDCS 2010 MIDDLEWARE SYSTEMS RESEARCH GROUP.

Effects of Routing Computations in Content-Based Routing Networks with Mobile Data Sources Vinod Muthusamy, Milenko Petrovic, Hans-Arno Jacobsen University.

MIDDLEWARE SYSTEMS RESEARCH GROUP Denial of Service in Content-based Publish/Subscribe Systems M.A.Sc. Candidate: Alex Wun Thesis Supervisor: Hans-Arno.

Gil EinzigerRoy Friedman Computer Science Department Technion.

Navneet Kumar Pandey 1 Stéphane Weiss 1 Roman Vitenberg 1 Kaiwen Zhang 2 Hans-Arno Jacobsen 2 2 University of Toronto 1 University of Oslo Minimizing the.

Planning the Transformation of Network Topologies Young Yoon 1, Nathan Robinson 2, Vinod Muthusamy 3, Sheila McIlraith 2, Hans-Arno Jacobsen 2 1 Samsung.

Supporting Disconnected Operations in Publish/Subscribe Systems Vinod Muthusamy Joint work with Milenko Petrovic, Ioana Burcea, H.-Arno Jacobsen, Eyal.

Content-Based Routing in Mobile Ad Hoc Networks Milenko Petrovic, Vinod Muthusamy, Hans-Arno Jacobsen University of Toronto July 18, 2005 MobiQuitous 2005.

Socially-aware pub-sub system for human networks Yaxiong Zhao Jie Wu Department of Computer and Information Sciences Temple University Philadelphia

MIDDLEWARE SYSTEMS RESEARCH GROUP Middleware A Policy Management Framework for Content-based Publish/Subscribe Middleware Hans-Arno Jacobsen Department.

DISTRIBUTED EVENT AGGREGATION FOR CONTENT-BASED PUBLISH/SUBSCRIBE SYSTEMS Navneet Kumar Pandey 1 Stéphane Weiss 1 Roman Vitenberg 1 Kaiwen Zhang 2 Hans-Arno.

Dynamic Load Balancing in Distributed Content-based Publish/Subscribe Alex K. Y. Cheung & Hans-Arno Jacobsen University of Toronto November 30 th, 2006.

MIDDLEWARE SYSTEMS RESEARCH GROUP MSRG.ORG Total Order in Content-based Publish/Subscribe Systems Joint work with: Vinod Muthusamy, Hans-Arno Jacobsen.

Distributed Automatic Service Composition in Large-Scale Systems Songlin Hu*, Vinod Muthusamy +, Guoli Li +, Hans-Arno Jacobsen + * Chinese Academy of.

Classification and Analysis of Distributed Event Filtering Algorithms Sven Bittner Dr. Annika Hinze University of Waikato New Zealand Presentation at CoopIS.

PhD Candidate: Alex K. Y. Cheung Supervisor: Hans-Arno Jacobsen PhD Thesis Presentation University of Toronto March 28, 2011 MIDDLEWARE SYSTEMS RESEARCH.

MIDDLEWARE SYSTEMS RESEARCH GROUP Adaptive Content-based Routing In General Overlay Topologies Guoli Li, Vinod Muthusamy Hans-Arno Jacobsen Middleware.

Minimal Broker Overlay Design for Content-Based Publish/Subscribe Systems Naweed Tajuddin Balasubramaneyam Maniymaran Hans-Arno Jacobsen University of.

ICDCS Beijing China Routing of XML and XPath Queries in Data Dissemination Networks Guoli Li, Shuang Hou Hans-Arno Jacobsen Middleware Systems Research.

VLDB2005 CMS-ToPSS: Efficient Dissemination of RSS Documents Milenko Petrovic Haifeng Liu Hans-Arno Jacobsen University of Toronto.

András Belokosztolszki, David M Eyers, Peter R Pietzuch, Jean Bacon and Ken Moody Role-Based Access Control for Publish/Subscribe.

Analysis and algorithms of the construction of the minimum cost content-based publish/subscribe overlay Yaxiong Zhao and Jie Wu

Information-Centric Networks10b-1 Week 10 / Paper 2 Hermes: a distributed event-based middleware architecture –P.R. Pietzuch, J.M. Bacon –ICDCS 2002 Workshops.

Peer-to-Peer Result Dissemination in High-Volume Data Filtering Shariq Rizvi and Paul Burstein CS 294-4: Peer-to-Peer Systems.

Information-Centric Networks Section # 10.2: Publish/Subscribe Instructor: George Xylomenos Department: Informatics.

Peter R Pietzuch and Jean Bacon Peer-to-Peer Overlay Networks in an Event-Based Middleware DEBS’03, San Diego, CA, USA,

1 State-of-the-art in Publish/Subscribe Middleware for Supporting Mobility Sumant Tambe EECS Preliminary Examination December 11, 2007 Vanderbilt University,

Distributed Automatic Service Composition in Large-Scale Systems Songlin Hu*, Vinod Muthusamy +, Guoli Li +, Hans-Arno Jacobsen + * Chinese Academy of.

MIDDLEWARE SYSTEMS RESEARCH GROUP MSRG.ORG Distributed Ranked Data Dissemination in Social Networks Joint work with: Mo Sadoghi Vinod Muthusamy Hans-Arno.

Community Clustering in Distributed Publish/Subscribe System Wei Li 1,2,Songlin Hu 1, Jintao Li 1, Hans-Arno Jacobsen 3 1 Institute of Computing Technology,

Using Ant Agents to Combine Reactive and Proactive strategies for Routing in Mobile Ad Hoc Networks Fredrick Ducatelle, Gianni di caro, and Luca Maria.

Improving Fault Tolerance in AODV Matthew J. Miller Jungmin So.

1 Data Overhead Impact of Multipath Routing for Multicast in Wireless Mesh Networks Yi Zheng, Uyen Trang Nguyen and Hoang Lan Nguyen Department of Computer.

Congestion Avoidance with Incremental Filter Aggregation in Content-Based Routing Networks Mingwen Chen 1, Songlin Hu 1, Vinod Muthusamy 2, Hans-Arno Jacobsen.

1 Towards Scalable Pub/Sub Systems Shuping Ji 1, Chunyang Ye 2, Jun Wei 1 and Arno Jacobsen 3 1 Chinese Academy of Sciences 2 Hainan University 3 Middleware.

A Framework for Object-Based Event Composition in Distributed Systems

Navneet Kumar Pandey1 Stéphane Weiss1 Roman Vitenberg1

Project Demo Mehdi Sadri Jamshid Esmaelnezhad Spring 2012

Distributed Publish/Subscribe Network

Small-Scale Peer-to-Peer Publish/Subscribe

Indirect Communication Paradigms (or Messaging Methods)

Indirect Communication Paradigms (or Messaging Methods)

Presentation transcript:

Publisher Mobility in Distributed Publish/Subscribe Systems Vinod Muthusamy, Milenko Petrovic, Dapeng Gao, Hans-Arno Jacobsen University of Toronto June 10, th International Workshop on Distributed Event-Based Systems (DEBS'05)

June 10, 2005 (DEBS ’05) Mobile-ToPSS (University of Toronto) 2 Motivation Explosion of information producers  Blogs, wikis, podcasting, photo sharing Mobility of users  Cell phones, PDAs, sensors Mobile information producers  Traditionally wired publishers can increasingly be mobile  New types of publishers SMS, camera phones, location based services Pub/sub data dissemination  Well suited to mobile clients Decoupling, filtering Mobility of information producer has not been studied in pub/sub  Breaks common pub/sub assumption

June 10, 2005 (DEBS ’05) Mobile-ToPSS (University of Toronto) 3 Publisher Mobility Scenarios Journalists with blogs  Update blogs on location  Upload pictures from camera phone Police patrol car  Send status updates Traffic, accidents, parts failures Mail delivery  Track delivery status, location updates Publisher 12

June 10, 2005 (DEBS ’05) Mobile-ToPSS (University of Toronto) 4 Agenda Background  Context  Subscriber mobility Publisher mobility  Problem  Solutions Evaluation  Setup  Results Conclusions

June 10, 2005 (DEBS ’05) Mobile-ToPSS (University of Toronto) 5 Context Part of Toronto Publish/Subscribe System (ToPSS)  Improve expressiveness Approximate matching, location queries, XML, RDF, composite subscriptions, historic subscriptions, etc.  Distributed issues Fault tolerance, load balance, reliability  New environments MANETs, P2P overlays, sensor networks Mobile-ToPSS project  Subscriber mobility [MDM’04] Based on JEDI, SIENA work  Publisher mobility [DEBS’05]  Effects of routing computations [Mobicom’05]  Content based routing in MANET [Mobiquitous’05]

June 10, 2005 (DEBS ’05) Mobile-ToPSS (University of Toronto) 6 Distributed Publish/Subscribe Advertisements flooded  Create adv tree Subscriptions along reverse adv path  Create multicast tree Publications along reverse sub path Publisher Subscriber...  Advertisements  Subscriptions  Publications

June 10, 2005 (DEBS ’05) Mobile-ToPSS (University of Toronto) 7 Subscriber Mobility Problem Matching publications during disconnection  Stored by broker  Replayed upon reconnection “State” transfer is expensive  Double message load with only 10% of mobile subscribers [MDM’04] No state lost when publishers are disconnected  No problem with mobile publishers? 12 Subscriber

June 10, 2005 (DEBS ’05) Mobile-ToPSS (University of Toronto) 8 Publisher Mobility Problem Adv and sub trees Moveout: both trees torn down Movein: both trees rebuilt Expensive  Network load: May be # ads > # subs  No delivery until tree constructed Distinguish temporary disconnections t1t1 At Old Broker t3t3 DisconnectedAt New Broker t5t5 t4t4 Can publish new events Connect (movein) Disconnect (moveout) t2t2 moveout Publisher 12...

June 10, 2005 (DEBS ’05) Mobile-ToPSS (University of Toronto) 9 Publisher Mobility Problem Adv and sub trees Moveout: both trees torn down Movein: both trees rebuilt Expensive  Network load: May be # ads > # subs  No delivery until tree constructed Distinguish temporary disconnections t1t1 At Old Broker t3t3 DisconnectedAt New Broker t5t5 t4t4 Can publish new events Connect (movein) Disconnect (moveout) t2t2 movein Publisher 12...

June 10, 2005 (DEBS ’05) Mobile-ToPSS (University of Toronto) 10 Prefetching Optimization Exploits knowledge of future mobility patterns Concurrent  Construction at new broker  Teardown at old broker Tree construction time hidden from user t1t1 At Old Broker t3t3 DisconnectedAt New Broker t5t5 t4t4 Can publish new events Connect (movein) Disconnect (moveout) t2t2 moveout Publisher 12...

June 10, 2005 (DEBS ’05) Mobile-ToPSS (University of Toronto) 11 Prefetching Optimization Exploits knowledge of future mobility patterns Concurrent  Construction at new broker  Teardown at old broker Tree construction time hidden from user t1t1 At Old Broker t3t3 DisconnectedAt New Broker t5t5 t4t4 Can publish new events Connect (movein) Disconnect (moveout) t2t2 movein Publisher 12...

June 10, 2005 (DEBS ’05) Mobile-ToPSS (University of Toronto) 12 Proxy Optimization Maintain trees from several brokers Advantageous if restricted mobility region t1t1 At Old Broker t3t3 DisconnectedAt New Broker t5t5 t4t4 Can publish new events Connect (movein) Disconnect (moveout) t2t2 moveout Publisher movein Publisher

June 10, 2005 (DEBS ’05) Mobile-ToPSS (University of Toronto) 13 Delayed Optimization Maintain trees at old broker for some time Allow new tree to graft onto old tree Remove extraneous portions of old tree t1t1 At Old Broker t3t3 DisconnectedAt New Broker t5t5 t4t4 Can publish new events Connect (movein) Disconnect (moveout) t2t2 moveout Publisher movein Publisher

June 10, 2005 (DEBS ’05) Mobile-ToPSS (University of Toronto) 14 Evaluation: Setup Simulation Environment  ns-2 network simulator  Implemented mobility optimizations Parameters  Topology Metropolitan Area Network 4 levels of degree 4  64 leaf brokers  Subscribers: 500  Publishers: 50  Locality: random, 30%, 60%, 90%  Mobility Static subscribers, mobile publishers Random speeds (5km/h, 50km/h, 100km/h) Metrics  Tree rebuild load  Tree rebuild time, delivery ratio 64 1

June 10, 2005 (DEBS ’05) Mobile-ToPSS (University of Toronto) 15 Publisher Scalability Standard and Prefetching >> Proxy and Delayed Prefetching worse due to extra control messages Delayed better due to smaller tree deltas

June 10, 2005 (DEBS ’05) Mobile-ToPSS (University of Toronto) 16 Publisher Scalability Probe tree completion Prefetching is fastest  Starts early Standard is slowest  Almost 4s Delayed close to Prefetching Note: time is not known to publisher

June 10, 2005 (DEBS ’05) Mobile-ToPSS (University of Toronto) 17 Publisher Scalability Tree rebuilding cost  Best: Delayed, Proxy  Worst: Standard, Prefetching Tree rebuilding time  Best: Prefetching, Delayed  Worst: Standard Prefetching  Good for the user  Bad for the network Delayed  Good for user and network  Practical

June 10, 2005 (DEBS ’05) Mobile-ToPSS (University of Toronto) 18 Publication Locality 250 publishers Vary publication similarity Standard and Prefetching approach Proxy and Delayed

June 10, 2005 (DEBS ’05) Mobile-ToPSS (University of Toronto) 19 Publication Locality Time from publish to notification Again, Standard and Prefetching approach Proxy and Delayed

June 10, 2005 (DEBS ’05) Mobile-ToPSS (University of Toronto) 20 Publication Locality With sufficient publication similarity, optimizations have diminishing benefit  Tree rebuilding cost  Delivery latency

June 10, 2005 (DEBS ’05) Mobile-ToPSS (University of Toronto) 21 Conclusions The publish/subscribe model is well suited to mobile applications  But publisher mobility has not been evaluated Publisher mobility is expensive  Breaks conventional assumptions  Tree rebuilding imposes large cost Must distinguish temporary vs. permanent disconnection  Delayed has best performance and is most practical Future Work  Other scenarios: realistic traces, mobile subscribers  Develop more optimizations

June 10, 2005 (DEBS ’05) Mobile-ToPSS (University of Toronto) 22 Publisher Mobility in Distributed Publish/Subscribe Systems Thank you