Session 2a, 10th June June 2008 ICT-MobileSummit 2008 Copyright E3 project, BUPT An Autonomic Protocol Graph Management Architecture for Reconfigurable Systems Beijing University of Posts and Telecommunications China

Session 2a, 10th June June 2008 ICT-MobileSummit 2008 Copyright E3 project, BUPT Motivation, problem area In the future wireless communication environment, many radio access technologies will coexist in the same areas to provide users with ubiquitous access. The heterogeneous infrastructure makes reconfigurability an important characteristic which is very necessary in the mobile terminals. In order to realize the reconfigurability of future wireless mobile systems, the design of flexible and multi-mode protocol stacks is highlighted in many important European projects. The concept of component-based protocol stack and some related management mechanisms are investigated in the E2R and WINNER projects.

Session 2a, 10th June June 2008 ICT-MobileSummit 2008 Copyright E3 project, BUPT Research Objectives In this paper, we propose a general architecture for autonomic protocol graph management. The term “protocol graph” is used here to represent the interrelationship between different protocol components. –The consideration of protocol reconfiguration is not limited in the single component perspective, but on behalf of the protocol graph. –A comprehensive autonomic management characteristic is introduced in the protocol graph management. –The proposed mechanism can make protocol stack more individualized, which means that protocol stacks could be diverse in different terminals according to different communication characteristics of users.

Session 2a, 10th June June 2008 ICT-MobileSummit 2008 Copyright E3 project, BUPT Research approach, Methodology System Architecture –Some similar functional entities like Protocol Stack Reconfiguration Control Module and Protocol Component Management Supporting Module have already been investigated in E 2 R project. –The Autonomic Protocol Graph Management Plane (APGMP) is our new defined part for the automatic protocol graph management mechanism. APGMP

Session 2a, 10th June June 2008 ICT-MobileSummit 2008 Copyright E3 project, BUPT Research approach, Methodology Autonomic Protocol Graph Management Plane –Protocol Graph Repository (PG_R) that is responsible for the storage of protocol graph information. –Protocol Graph Registration Module (PG_RM) that undertakes the construction and registration for protocol graphs. –Protocol Graph Performance Evaluation Module (PG_PEM) that is responsible for the evaluation of a running protocol graph. –Protocol Graph Selection and Decision-Making Module (PG_SDM) is responsible for the selection of the most suitable protocol graph to use in a given situation. –Protocol Graph Performance Prediction Module (PG_PPM) that undertakes the prediction for the performance of new designed protocol graphs to guarantee their feasibility and stability.

Session 2a, 10th June June 2008 ICT-MobileSummit 2008 Copyright E3 project, BUPT Research approach, Methodology Data Structure for the Representation of Protocol Graphs C ID_1, C ID_2, C ID_3, C ID_4, C ID_i, C ID_j, all represent the components that compose an integrated protocol graph. R i-j represents the I/O relationship between the component with the ID i and that with the ID j. If R i-j is 1, it indicates that there is an interface between these two components. Specifically, data stream comes out from C ID_i, and goes into C ID_j. Otherwise, R i-j with the value 0 represents that there is no data stream with such a direction.

Session 2a, 10th June June 2008 ICT-MobileSummit 2008 Copyright E3 project, BUPT Research approach, Methodology Goal: select the MOST appropriate protocol graph according to different communication characteristics of users. Tool: Reinforcement Learning Standard RL model –State set: S={s 1,s 2,…,s n } –Action set: A={a 1,a 2,…,a m } –Policy:  : S→A –Reward: r(s,a) –Target : Iterative Process –Observation –Calculation –Decision –Evaluation –Update

Session 2a, 10th June June 2008 ICT-MobileSummit 2008 Copyright E3 project, BUPT Research approach, Methodology Problem Modeling Reinforcement Learning model with MFNN- based generalization States: –Link conditions –Requirements of services –Terminal capabilities –Time and location information when initiating or processing specific services Actions: –Selection for the most suitable protocol graph(s) Rewards: –Utility value

Session 2a, 10th June June 2008 ICT-MobileSummit 2008 Copyright E3 project, BUPT Conclusion and outlook This paper proposes a general architecture for the autonomic protocol graph management in reconfigurable systems. An implementation paradigm within which reinforcement learning is used to realize the autonomic approach is provided. The major advantage of the proposed protocol graph management schemes is that a high success rate of protocol stack reconfiguration is guaranteed. Introducing intelligence to protocol graph management will also allow users to enjoy a better QoS due to the protocol reconfigurability.

Session 2a, 10th June June 2008 ICT-MobileSummit 2008 Copyright E3 project, BUPT Thank You!