Performance of Networked XML-Driven Cooperative Applications S. Ghandeharizadeh, C. Papadopoulos M. Cai, K. Chintalapudi, Parakshit Pol, S. Song, R. Schmidt, R. Zhou

A Shift in Computing Server-centricDistributed Dumb clientsSmart clients Hardware-drivenSoftware-driven User to appUser to app; app to app Information accessInformation action One-wayTwo-way Monolithic islandspeer-to-peer Integration an afterthoughtIntegration by design Worry: scaleWorry: value Internet

Future Vision In the future, any two IT components will automatically integrate and “communicate” with one another, even though they were not specifically designed to interoperate In the future, any two IT components will automatically integrate and “communicate” with one another, even though they were not specifically designed to interoperate How? How?  Semantics  Standards  Concept of “software and data” as a service, web services, e.g.,  Google web service tool set  Microsoft Teraserver web service tool set  Experian (TRW) credit report web service tool set  Etc.

XML A standard for data interoperability among web services A standard for data interoperability among web services  Language independent  Sun’s Java, Microsoft’s C#  Device and software platform independent Motorola i85s Motorola i85s J2ME J2ME Compaq iPAQ Compaq iPAQ Windows CE Windows CE StrongARM StrongARM PERL PERL Apache 2.0 Apache 2.0 MySQL MySQL Linux Linux.NET.NET SQL 2000 SQL 2000 Commerce server Commerce server Windows 2000 Windows 2000

Query10 Result 9.5MB Query10 Result 9.5MB SOAP message 25MB SOAP message 25MB ServerClient Internet Producer.NET Consumer Microsoft.NET

.NET Formatters SOAP formatted messages are larger than their binary counter-part, e.g., Query 10 of TPC-H benchmark: SOAP formatted messages are larger than their binary counter-part, e.g., Query 10 of TPC-H benchmark: Binary 9.47 MB SOAP MB

.NET Formatters Compression (Zip) reduces message size: Compression (Zip) reduces message size: Binary 9.47 MB Zip-Binary 3.85 MB SOAP MB Zip-SOAP 4.12 MB

.NET Formatters XMill-SOAP messages might be smaller than Zip-binary [LS00, CGSS02]: XMill-SOAP messages might be smaller than Zip-binary [LS00, CGSS02]: Binary 9.47 MB Zip-Binary 3.85 MB SOAP MB Zip-SOAP 4.12 MB XMill-SOAP 3.21 MB

Compression Factor

A Comparison

Transmission Times (msec) 450 MHz1 GHz2 GHz Binary100,14874,84935,655 Zip-Binary113,18775,64537,694 XML183,902112,20064,365 Zip-XML184,062113,93064,276 XMill-XML296,311176,27891,547 Query 10

Transmission Times (msec) 450 MHz1 GHz2 GHz Binary100,14874,84935,655 Zip-Binary113,18775,64537,694 XML183,902112,20064,365 Zip-XML184,062113,93064,276 XMill-XML222,927146,01170,009 Query 10

A.NET Middleware Compress messages with the objective to minimize response time: Compress messages with the objective to minimize response time: InternetApplicationMiddleware.NET ClientApplicationMiddleware.NET Server Response Time

A.NET Middleware Overhead of compression should not outweigh its savings in transmission time Overhead of compression should not outweigh its savings in transmission time Factors contributing to transmission time: Factors contributing to transmission time:  Network bandwidth  Loss rate  Latency

A.NET Middleware, e.g., By applying XMill to a SOAP formatted result set produced by query 10: By applying XMill to a SOAP formatted result set produced by query 10:  response time improves by a factor of 3 when:  Processor speed = 2 GHz  Network bandwidth = 100 Kbps  Network latency = 1 ms  Loss rate = 0  response time degrades by 30% with a 10 Mbps network bandwidth

Summary DEXA 2002 Paper shows the impact of processor speed (450 MHz, 1 GHz, 2 GHz) on Xmill & Zip using TPC-H benchmark. DEXA 2002 Paper shows the impact of processor speed (450 MHz, 1 GHz, 2 GHz) on Xmill & Zip using TPC-H benchmark. CIC workshop paper shows the compression tradeoff using a variety of network parameters. CIC workshop paper shows the compression tradeoff using a variety of network parameters. Current status: A heuristic that decides when to compress messages with the objective to minimize response time (in preparation for submission) Current status: A heuristic that decides when to compress messages with the objective to minimize response time (in preparation for submission)

Network Adaptible Middleware Compress messages with the objective to minimize response time: Compress messages with the objective to minimize response time: InternetApplicationNAM.NET ClientApplicationNAM.NET Server Response Time

NAM Heuristic NAM (byte[ ] M, Client C1) { S = M.Length(); S C = Size of M when compressed T Comp = Time to compress M at server T decomp = Time to decompress M at C 1 T U = Time to uncompress M at C 1 Bandwidth b, round-trip time d, and loss rate for network connection between server and C 1 RT U = transmission time (S, b, d, ) RT C = transmission time (S C, b, d, ) + T comp + T decomp if (RT U < RT C ) return “transmit uncompressed”, else “transmit compressed” }

NAM Heuristic NAM (byte[ ] M, Client C1) { S = M.Length(); S C = Size of M when compressed T Comp = Time to compress M at server T decomp = Time to decompress M at C 1 T U = Time to uncompress M at C 1 Bandwidth b, round-trip time d, and loss rate for network connection between server and C 1 RT U = transmission time (S, b, d, ) RT C = transmission time (S C, b, d, ) + T comp + T decomp if (RT U < RT C ) return “transmit uncompressed”, else “transmit compressed” } Estimations!

Current Research Streaming XML Streaming XML

Query10 Result 9.5MB Query10 Result 9.5MB SOAP message 25MB SOAP message 25MB ServerClient Internet Producer.NET Consumer No Streaming

Query10 Result 9.5MB ServerClient Internet Producer.NET Consumer Streaming

ServerClient 2MB Internet Producer.NET Consumer Streaming Query10 Result 1 SOAP message 5MB 1

ServerClient Internet Producer.NET Consumer Streaming SOAP message 5MB 1 Query10 Result 2MB 2

ServerClient Internet SOAP message 5MB 2MBProducer.NET Consumer Streaming Query10 Result 2MB 1 1 SOAP message 5MB 2 2 Query10 Result

ServerClient Internet Producer.NET Consumer Streaming Query10 Result 2MB SOAP message 5MB 2 Query10 Result 2MB 3

ServerClient Internet Query10 Result 2MB SOAP message 5MBProducer.NET Consumer Streaming Query10 Result 4MB 2 SOAP message 5MB 3 3 2

ServerClient Internet Query10 Result 4MBProducer.NET Consumer Streaming SOAP message 5MB 3 Query10 Result 2MB 4

SOAP message 5MB ServerClient Internet Query10 Result 2MBProducer.NET Consumer Streaming Query10 Result 6MB 3 SOAP message 5MB 4 4 3

ServerClient Internet Query10 Result 6MBProducer.NET Consumer Streaming SOAP message 5MB 4 Query10 Result 2MB 5

SOAP message 5MB ServerClient Internet Producer.NET Consumer Streaming Query10 Result 6MB 4 SOAP message 5MB 5 4

ServerClient Internet Producer.NET Consumer Streaming Query10 Result 8MB SOAP message 5MB 5

SOAP message 5MB ServerClient Internet Producer.NET Consumer Streaming 5 Query10 Result 9.5MB 5

Publications 1. S. Ghandeharizadeh, F. Sommers, J. Kuntal, and E. Alwagait. A Document as a Web Service: Two Complementary Frameworks. In the Second International Workshop on Multimedia Data Document Engineering, March A Document as a Web Service: Two Complementary Frameworks. A Document as a Web Service: Two Complementary Frameworks. 2. S. Thakkar, C. A. Knoblock, J. L. Ambite, and C. Shahabi. Composing Web Service from On-line Sources. In AAAI-02 Workshop on Intelligent Service Integaration, July Composing Web Service from On-line Sources. Composing Web Service from On-line Sources. 3. S. Ghandeharizadeh, C. Papadopoulos, M. Cai, K. Chintalapudi. Performance of Networked XML Driven Cooperative Applications. In the Second International Workshop on Cooperative Internet Computing, August Performance of Networked XML Driven Cooperative Applications Performance of Networked XML Driven Cooperative Applications 4. M. Cai, S. Ghandeharizadeh, R. Schmidt, and S. Song. A Comparison of Alternative Encoding Mechanisms for Web Services. In the 13 th International Conference on Database and Expert Systems Applications, September A Comparison of Alternative Encoding Mechanisms for Web Services. A Comparison of Alternative Encoding Mechanisms for Web Services. 5. S. Ghandeharizadeh, E. Alwagait, and S. Song. A “nine11” Registry: A Component of Scalable Web Services. Submitted for publication.

References [CGSS02] M. Cai, S. Ghandeharizadeh, R. Schmidt, and S. Song. A Comparison of Alternative Encoding Mechanisms for Web Services. In the 13 th International Conference on Database and Expert Systems Applications, September [LS00] H. Liefke and D. Suciu. XMill: an efficient compressor for XML data. In SIGMOD 2000, [GFKA02] S. Ghandeharizadeh, F. Sommers, J. Kuntal, and E. Alwagait. A Document as a Web Service: Two Complementary Frameworks. In the Second International Workshop on Multimedia Data Document Engineering, March [GPCC02] S. Ghandeharizadeh, C. Papadopoulos, M. Cai, K. Chintalapudi. Performance of Networked XML Driven Cooperative Applications. In the Second International Workshop on Cooperative Internet Computing, August [TKAS02] S. Thakkar, C. A. Knoblock, J. L. Ambite, and C. Shahabi. Composing Web Service from On-line Sources. In AAAI-02 Workshop on Intelligent Service Integaration, July 2002.