1. Web Services Registry for Quality Assurance 14 th Oct. 2008 Youngkon Lee

2. contents Introduction Implementation of WSQMS Quality Data of WSQMS Connect WSQMS with WS Registry Update WS Registry Quality Classification for WS Registry Modification of WS Registry Classification Conclusions

3. eAC ITG WG 33 Question Introduction  We implemented Korea e-Government Web service framework, but..  How to guarantee quality of Web services?  How to evaluate Web services?  How to store the quality of Web services?  How to search Web service on quality information? Answer  Implement Web Service Quality Management System (WSQMS)  Store quality data in WSQMS  Connect WSQMS with WS Registry  Modify a part of WS Registry data structure

4. eAC ITG WG Web service provider 44 Quality Test Implementation of WSQMS  Automatic test by agent  Reference to TAD(Test Assertion Document)  XML type report  Test of performance, conformability, message reliability, and security WSQMS TAD (test assertion document)  distribute test program  request quality test  auto execution  refer TAD  perform quality test  send quality test result  inspect quality test report Quality test report(XML) TAD response time and throughput conformability message reliability security Web service system

5. eAC ITG WG Qualitycontents Business Value Frequency of service use(month/day/hour) frequency of service use per customer use(month/day/hour) reputation Service Level performance(response time, throughput) reliability(usability, accessability, successability) Interoperability conformability(WSDL, SOAP) WS-I Basic Profile e-Government WS Basic Profile Business Processing message reliability(WS-Reliability) collaborativeness of WS (WSBPEL) 55 Quality Monitoring Implementation of WSQMS  Monitoring WS periodically  Measuring of business value, service level, business processing and interoperability Web service Use service  message notification  refer TAD TAD Interoperability conformability message reliability collaborability of WS  quality analysis Web service associate  provide quality report  request quality report Agent  message notification WSQMS

6. eAC ITG WG TypeInformation Support type Web service number of request number of success/failure operating time max/min response time Axis Plug-in Servlet Filter Proxy WS containe r usable memory number of HTTP requests number of HTTP failure data amount of HTTP request/response max/min number of HTTP threads number of current operating HTTP threads Tomcat 5.x Sun Application Server 8.x IIS 5.x OS CPU usage real memory usable virtual memory usable Page In/Out/Fault disk usage Solaris 8/9 HP-UX 11/11i Windows 2000/XP/200 3 66 Operation Monitoring Implementation of WSQMS  Real time monitoring WS, WS container, OS  Provide quality and operating report  Use WSDM spec and agent architecture Web service system Install agent Request to subscribe operation information WSQMS Agent Notify operation information System manager Register manager and service Download agent Reports Provide the operation information Real-time monitoring for Web service resource      

7. eAC ITG WG 77 Quality Factor Measurable Factor Evaluation Factor Availability Accessability Successability Response time Throughput Eval. Criteria No Eval. Criteria Security Interoperability Biz Process Management Biz Value price service suitability use effect service brand Single Criteria Complex Criteria WSQDL for quality classification  Follows the criteria of WSQM for quality classification  Composed of 4 major quality factors Quality Data of WSQMS

8. eAC ITG WG 88 WSQDL(Web Service Quality Description Language) Quality Data of WSQMS  Composed of factor, subfactor, property, subproperty, function, and performance  Concept of quality chain (connected factors) Target Web services Quality Factor Biz process factor Eval factor Biz value factor Measure factor PropertySub propertyFunctionPerformance Sub factor PropertyAppraisal Sub factorPropertyFunctionPerformance Metric

9. eAC ITG WG 99 Why? Connect WSQMS with WS Registry  User wants to search on quality data  Quality data is variable -> should be synchronized  WSQMS and WS Registry is complementary for each other How?  Preserve functional independency  Sharing quality data  Implement API of SOAP-based  Automatic operation

10. eAC ITG WG 10 Method 1: WS registry has a reference to WS quality data in WSQMS How to share Quality Data?  Need no synchronization process for quality data between WS registry and WSQMS  Restriction in use of quality data at WS registry Method 2: WS registry has copy of WSQDL from WSQMS  Need the synchronization process  Possible to search WS on WS quality data Connect WSQMS with WS Registry

11. eAC ITG WG 11 Scenario of Method 1 Connect WSQMS with WS Registry  WSQMS initiates WS quality activity  WS Registry provides WSDL  WSQMS provides quality information Web service provider  register Web service  request new Web service info  provide WSDL of new Web service  test with agent  store quality data Connection API  store reference of quality data  provide reference of quality info WS Registry Web Service Quality Management System Web service Quality info

12. eAC ITG WG 12 WS Provider  provide WSDL of new WS + request info of quality context Web service  test with agent Connection API  provide info of quality context WS Registry WS Registry manager  register quality context  register WS Scenario of Method 2  WS Registry requests the data of quality context of a new WS  WSQMS provides WSQDL after testing  WS registry parses it and store the quality value as quality context Web Service Quality Management System  store value of WS quality context Web service Quality info  store quality data Connect WSQMS with WS Registry

13. eAC ITG WG 13 Connection APIs classificationAPI nameFunction description Search new WS find_newBusinessesSearch new biz entity find_newServicesSearch new biz service find_newBindingsSearch new binding find_newtModelsSearch new tModel Save WS quality data save_refOfWSQDL save_qualityContext Write reference to quality data in tModel Store the quality context inform. Modify&delete WS quality data delete_qualityData update_qualityData Delete WSQDL tModel Modify WSQDL tModel Synch WS inform synch_WSDL Synch periodically WSDL between WSQMS and WS registry Time inform of updating quality data get_lastUpdateTimeQD get_lastUpdateTimeQC Last update time of WSQDL Last update time for quality context Messaging I/F Security I/F Registry Service Receiver Quality Data Query Manager Quality Data LC Manager Quality Data Sender Registry Service Requester WSQMS Messaging I/F Security I/F Registry Service Sender Quality Data Requester Quality Data LC Requester Quality Data Receiver Registry Service Request Receiver Web Registry  For connection, quality data processing, WS registry service, and messaging & security APIs are required.  Each module is composed of necessary functions, used by SOAP I/F. Connect WSQMS with WS Registry

14. eAC ITG WG 14 Question Update WS Registry  How to preserve the current implementation as possible as?  How to connect with WSQMS seamlessly?  How to organize the quality classification scheme? Answer  Follow UDDI spec as possible as  Provide APIs for connection in SOAP style  Devise a new data structure such as categoryBag and quality context

15. eAC ITG WG 15 Method 1: modify overviewDoc  Add tag in  Easy to understand, but difficult to process quality data flexibly Update WS Registry

16. eAC ITG WG 16 Method 2: add qualityBag  Add tag in tModel such as, storing quality data reference in tModel.  Possible independent processing for quality reference Update WS Registry

17. eAC ITG WG 17 Method 3: add qualityContext  Add tag in tModel such as method 2 for representing Update WS Registry

18. eAC ITG WG 18 Purpose Quality Classification for WS Registry  Enable user to search WS on quality data.  Enable high-level composite search on quality data. For example: Search WS satisfying WS-I interoperability with 128 encryption key for DSIG, responding 0.01 sec. Issues  How to compose the quality classification scheme?  How to update the value of quality classification item up-to-date?

19. eAC ITG WG 19 WSQDL MetricEvalBiz ProcBiz Val InteropSecManage keySizeencAlg WSQMS UDDI tModel Concept of quality context  Path for representing quality factor according to WSQDL quality chain  Represented as a set in Quality Classification for WS Registry

20. eAC ITG WG 20 WSDL 1 Quality context 1 value Quality context 2 value Quality context 3 value WSDL 2 Quality context 1 value Quality context 2 value Quality context 3 value WSDL 3 Quality context 1 value Quality context 2 value Quality context 3 value Quality Context WSquality /eval/sec/keySize 128: WS1, WS2 64: WS3 /eval/sec/encAlg RSA: WS1 DES: WS2, WS3 /eval/int/ratioWSI 99: WS1 < 97: WS3 98: WS2 Quality classification  Compose quality classification scheme with quality context  Get a quality value on the quality context Quality Classification for WS Registry

21. eAC ITG WG 21 After completion of these systems, WSQMS and WS registry, they could contribute to enhance WS quality more rapidly. WSQMS has been implemented. trying to implement connection APIs plan to modify national WS registry Classification scheme is critical for WS dissemination. It needs continuous modification efforts. Further research for connection between national WS registries Conclusions

22. eAC ITG WG 22 Thank you Youngkon Lee: yklee777@kpu.ac.kr