Knowledge-Based Service Quality Assurance for Korea e-Government 29 th April 2008 Youngkon Lee (NIA/WSQM TC)

contents Introduction Implementation of WSQMS Quality Data of WSQMS Connect WSQMS with WS Registry Update WS Registry Quality Classification for WS Registry Modification of WS Registry Classification Conclusions

WSQM TC 33 Question Introduction  We implemented Korea e-Government Web service framework, but..  How to guarantee quality of Web services?  How to evaluate Web services?  How to store the quality of Web services?  How to search Web service on quality information? Answer  Implement Web Service Quality Management System (WSQMS)  Store quality data in WSQMS  Connect WSQMS with WS Registry  Modify a part of WS Registry data structure

WSQM TC Web service provider 44 Quality Test Implementation of WSQMS  Automatic test by agent  Reference to TAD(Test Assertion Document)  XML type report  Test of performance, conformability, message reliability, and security WSQMS TAD (test assertion document)  distribute test program  request quality test  auto execution  refer TAD  perform quality test  send quality test result  inspect quality test report Quality test report(XML) TAD response time and throughput conformability message reliability security Web service system

WSQM TC Qualitycontents Business Value Frequency of service use(month/day/hour) frequency of service use per customer use(month/day/hour) reputation Service Level performance(response time, throughput) reliability(usability, accessability, successability) Interoperability conformability(WSDL, SOAP) WS-I Basic Profile e-Government WS Basic Profile Business Processing message reliability(WS-Reliability) collaborativeness of WS (WSBPEL) 55 Quality Monitoring Implementation of WSQMS  Monitoring WS periodically  Measuring of business value, service level, business processing and interoperability Web service Use service  message notification  refer TAD TAD Interoperability conformability message reliability collaborability of WS  quality analysis Web service associate  provide quality report  request quality report Agent  message notification WSQMS

WSQM TC TypeInformation Support type Web service number of request number of success/failure operating time max/min response time Axis Plug-in Servlet Filter Proxy WS containe r usable memory number of HTTP requests number of HTTP failure data amount of HTTP request/response max/min number of HTTP threads number of current operating HTTP threads Tomcat 5.x Sun Application Server 8.x IIS 5.x OS CPU usage real memory usable virtual memory usable Page In/Out/Fault disk usage Solaris 8/9 HP-UX 11/11i Windows 2000/XP/ Operation Monitoring Implementation of WSQMS  Real time monitoring WS, WS container, OS  Provide quality and operating report  Use WSDM spec and agent architecture Web service system Install agent Request to subscribe operation information WSQMS Agent Notify operation information System manager Register manager and service Download agent Reports Provide the operation information Real-time monitoring for Web service resource      

WSQM TC 77 Quality Factor Measurable Factor Evaluation Factor Availability Accessability Successability Response time Throughput Eval. Criteria No Eval. Criteria Security Interoperability Biz Process Management Biz Value price service suitability use effect service brand Single Criteria Complex Criteria WSQDL for quality classification  Follows the criteria of WSQM for quality classification  Composed of 4 major quality factors Quality Data of WSQMS

WSQM TC 88 WSQDL(Web Service Quality Description Language) Quality Data of WSQMS  Composed of factor, subfactor, property, subproperty, function, and performance  Concept of quality chain (connected factors) Target Web services Quality Factor Biz process factor Eval factor Biz value factor Measure factor PropertySub propertyFunctionPerformance Sub factor PropertyAppraisal Sub factorPropertyFunctionPerformance Metric

WSQM TC 99 Why? Connect WSQMS with WS Registry  User wants to search on quality data  Quality data is variable -> should be synchronized  WSQMS and WS Registry is complementary for each other How?  Preserve functional independency  Sharing quality data  Implement API of SOAP-based  Automatic operation

WSQM TC 10 Method 1: WS registry has a reference to WS quality data in WSQMS How to share Quality Data?  Need no synchronization process for quality data between WS registry and WSQMS  Restriction in use of quality data at WS registry Method 2: WS registry has copy of WSQDL from WSQMS  Need the synchronization process  Possible to search WS on WS quality data Connect WSQMS with WS Registry

WSQM TC 11 Scenario of Method 1 Connect WSQMS with WS Registry  WSQMS initiates WS quality activity  WS Registry provides WSDL  WSQMS provides quality information Web service provider  register Web service  request new Web service info  provide WSDL of new Web service  test with agent  store quality data Connection API  store reference of quality data  provide reference of quality info WS Registry Web Service Quality Management System Web service Quality info

WSQM TC 12 WS Provider  provide WSDL of new WS + request info of quality context Web service  test with agent Connection API  provide info of quality context WS Registry WS Registry manager  register quality context  register WS Scenario of Method 2  WS Registry requests the data of quality context of a new WS  WSQMS provides WSQDL after testing  WS registry parses it and store the quality value as quality context Web Service Quality Management System  store value of WS quality context Web service Quality info  store quality data Connect WSQMS with WS Registry

WSQM TC 13 Connection APIs classificationAPI nameFunction description Search new WS find_newBusinessesSearch new biz entity find_newServicesSearch new biz service find_newBindingsSearch new binding find_newtModelsSearch new tModel Save WS quality data save_refOfWSQDL save_qualityContext Write reference to quality data in tModel Store the quality context inform. Modify&delete WS quality data delete_qualityData update_qualityData Delete WSQDL tModel Modify WSQDL tModel Synch WS inform synch_WSDL Synch periodically WSDL between WSQMS and WS registry Time inform of updating quality data get_lastUpdateTimeQD get_lastUpdateTimeQC Last update time of WSQDL Last update time for quality context Messaging I/F Security I/F Registry Service Receiver Quality Data Query Manager Quality Data LC Manager Quality Data Sender Registry Service Requester WSQMS Messaging I/F Security I/F Registry Service Sender Quality Data Requester Quality Data LC Requester Quality Data Receiver Registry Service Request Receiver Web Registry  For connection, quality data processing, WS registry service, and messaging & security APIs are required.  Each module is composed of necessary functions, used by SOAP I/F. Connect WSQMS with WS Registry

WSQM TC 14 Question Update WS Registry  How to preserve the current implementation as possible as?  How to connect with WSQMS seamlessly?  How to organize the quality classification scheme? Answer  Follow UDDI spec as possible as  Provide APIs for connection in SOAP style  Devise a new data structure such as categoryBag and quality context

WSQM TC 15 Method 1: modify overviewDoc  Add tag in  Easy to understand, but difficult to process quality data flexibly Update WS Registry

WSQM TC 16 Method 2: add qualityBag  Add tag in tModel such as, storing quality data reference in tModel.  Possible independent processing for quality reference Update WS Registry

WSQM TC 17 Method 3: add qualityContext  Add tag in tModel such as method 2 for representing Update WS Registry

WSQM TC 18 Purpose Quality Classification for WS Registry  Enable user to search WS on quality data.  Enable high-level composite search on quality data. For example: Search WS satisfying WS-I interoperability with 128 encryption key for DSIG, responding 0.01 sec. Issues  How to compose the quality classification scheme?  How to update the value of quality classification item up-to-date?

WSQM TC 19 WSQDL MetricEvalBiz ProcBiz Val InteropSecManage keySizeencAlg WSQMS UDDI tModel Concept of quality context  Path for representing quality factor according to WSQDL quality chain  Represented as a set in Quality Classification for WS Registry

WSQM TC 20 WSDL 1 Quality context 1 value Quality context 2 value Quality context 3 value WSDL 2 Quality context 1 value Quality context 2 value Quality context 3 value WSDL 3 Quality context 1 value Quality context 2 value Quality context 3 value Quality Context WSquality /eval/sec/keySize 128: WS1, WS2 64: WS3 /eval/sec/encAlg RSA: WS1 DES: WS2, WS3 /eval/int/ratioWSI 99: WS1 < 97: WS3 98: WS2 Quality classification  Compose quality classification scheme with quality context  Get a quality value on the quality context Quality Classification for WS Registry

WSQM TC 21 Background  Adopt UN/SPSC classification scheme for WS classification scheme, but  UN/SPSC classification is too complex to use WS classification.  55 segments, 350 families, 3600 classes, commodities  There are similar classification item and items with no clear criteria for classification.  Most items in UN/SPSC is for industry of manufacturing. Need an Advanced classification architecture Modification of WS Registry Classification

WSQM TC 22 Modification of WS Registry Classification Method1: caching classification data Preserve cache storage for an item of classification scheme accessed once. Give priority number to the cached data according to its access number Issues –Performance degradation due to abnormal access Classification Scheme for WS Registry  request search  search  return result  cache data result Cache storage segment family class commodity

WSQM TC 23 Method 2: make synonym dictionary Implement synonym dictionary on the classification scheme. Issues: –Objective criteria for deciding synonymy of classification items segment family class commodity  Refer synonym  search  return result Synonym dictionary Classification Scheme for WS Registry Modification of WS Registry Classification

WSQM TC segment family class commodity Classification Scheme for WS Registry 24 Method 3: tagging accessed classification items by user User tags classification items accessed with tag named by the user. User can search more easily based on the tag data Issues: –Obstacle of tag data named wrongly.  request search  Return result Tag classification Modification of WS Registry Classification

WSQM TC 25 Method 4: implement knowledge ontology for classification Define knowledge ontology classification item frequently asked. For example, –If a public project related with energy, then find out energy saving, measuring usage of energy, district heating. Issues –Difficult to make knowledge rule –Require additional knowledge search system. Modification of WS Registry Classification

WSQM TC segment family class commodity Classification Scheme for WS Registry 26 Method 5: user classification with mapping script Make user classification scheme (industry, service, usage,…) By mapping script, user classification should be synchronized with master classification. Issues: –How to expand user classification flexibly  request search  Return result User classification Mapping script Modification of WS Registry Classification

WSQM TC 27 After completion of these systems, WSQMS and WS registry, they could contribute to enhance WS quality more rapidly. WSQMS has been implemented. trying to implement connection APIs plan to modify national WS registry Classification scheme is critical for WS dissemination. It needs continuous modification efforts. Further research for connection between national WS registries Conclusions

WSQM TC 28 Thank you Youngkon Lee: