Presentation is loading. Please wait.

Presentation is loading. Please wait.

Transaction Processing Discussion

Similar presentations


Presentation on theme: "Transaction Processing Discussion"— Presentation transcript:

1 Transaction Processing Discussion

2 Discussion Question 1: eBay and Amazon have been competing with each other for some time. Between the two companies, one observation is that Amazon has continued to innovate and adapt, while eBay has basically held steady. Discuss eBay’s opportunities over its rivals. What areas it should span, or what technology it should invest, in order to maintain its strength and growth?                                                                                             EXPANSION QUEEN The core auction and retail businesses, which account for the majority of revenue, are showing signs of weakness. The number of active users has been flat for three quarters, at 83 million. The number of new products listed on the site has inched up only 4% from a year ago. And the number of stores selling goods at fixed prices on eBay has actually declined from a year earlier, to 532,000. Some sellers have discovered it's often easier and more efficient to sell their wares on rival sites such as Amazon.com (AMZN). Amazon's investments in technology have made it easier for buyers to find what they want from sellers. There's also more of a sense of trust among its users because Amazon stands behind most third-party transactions. On eBay, it can be extremely difficult to get your money back if you're burned by a seller or buyer. "Sellers are growing like crazy over [at Amazon]," says Scott Wingo, CEO of ChannelAdvisor, which helps sellers manage their merchandise on eBay, Amazon, and other e-commerce channels. Whitman's focus on expansion and profits pushed eBay's stock to its earlier heights. During her 10 years at the helm, she transformed the San Jose-based company from a simple auction site into a global e-commerce giant by pushing into MAKING EBAY "EASIER AND SAFER TO USE" But expansion and diversification have their limits. As Whitman looked for new opportunities, rival Web sites, particularly Amazon, made inroads into the core e-commerce business. "Competition has eroded much of the advantage that eBay once had," says Derek Brown, a research analyst at Cantor Fitzgerald. Whitman has made some of the investments that sellers and buyers want. Late last year, eBay began rolling out new search technology in certain categories that enables shoppers to look for specific items based on relevancy and to narrow their results by color, brand, size, and other features. The site also launched a new photo-focused service that allows users essentially to window shop for things, rather than read through long descriptions beside small thumbnail images. Donahoe will certainly benefit from those investments. But he will have to build on them to bring the old vibrancy back to eBay's marketplace. EBay plans to announce additional steps in coming weeks, including a loyalty program for sellers. In addition, Donahoe says eBay will come down hard on fraudulent sellers and offer buyers more protection. "We are going to get very aggressive about making eBay easier and safer to use," he says. "While we have made strides in these areas, we need to do much more." 2017/4/21

3 The World of Internet Business
                                              2017/4/21

4 eBay's New Tough Love CEO
John Donahoe assumed the role of CEO on March 31, 2008 "The market is saying that they are in real big trouble,“ Buyers and sellers are trying out rival Web sites, Amazon, Google, Etsy Investors has grown as the company's shares have lost half their value over the past three years Donahoe is planning major investments in technology, including ways that will make it easier for buyers to browse and find goods. "We need to aggressively change our product, our customer approach, and our business model“ The core auction and retail businesses, which account for the majority of revenue, are showing signs of weakness. The number of active users has been flat for three quarters, at 83 million. The number of new products listed on the site has inched up only 4% from a year ago. And the number of stores selling goods at fixed prices on eBay has actually declined from a year earlier, to 532,000. Need to push eBay to be more innovative. "EBay has to be more aggressive and think about strategic planning five to 10 years down the line" John Donahoe will concentrate on winning back users, even at investors' expense by Catherine Holahan For three years, as the stock of eBay (EBAY) has slid, Chief Executive Meg Whitman has asked investors for patience. On Jan. 23, when the online auction site announced that John Donahoe would take over the top job, he had a clear message for investors: 2008 isn't going to be your year, either. Managing eBay is one of the toughest jobs in the tech industry. The CEO at the online auction site has the daunting responsibility of trying to keep happy three vocal, and often opposing, factions: eBay's investors, shoppers, and sellers. While Whitman did a stellar job of balancing the conflicting interests for years, she struggled more recently to keep any of the groups satisfied. Buyers and sellers are trying out rival Web sites, and investors' ire has grown as the company's shares have lost half their value over the past three years. "The market is saying that they are in real big trouble," says analyst Tim Boyd of American Technology Research. INVESTORS WILL NEED PATIENCE Donahoe made it clear his first priority as CEO will be revitalizing eBay's core business, even at the expense of investors. He plans to slice some of the fees that eBay charges sellers on the site to draw in more users and to persuade them to offer a greater array of products. He's also planning major investments in technology, including ways that will make it easier for buyers to browse and find goods. "We need to aggressively change our product, our customer approach, and our business model," Donahoe said in his first conference call as CEO designate. The strategy will put a damper on eBay's financial results, at least for the short term. The company says it expects revenues of $2 billion to $2.05 billion for the first quarter, below the $2.1 billion to $2.2 billion that analysts had expected. After the financials were released on Jan. 23, eBay's stock dropped 6% in post-market trading, giving up almost all of the day's gains. Donahoe may have no choice but to rankle investors as he focuses on the long-term health of the company. EBay reported solid results for the fourth quarter, with net income rising 53%, to $531 million, while revenues increased 27%, to $2.2 billion. But much of that growth came from its newer and smaller businesses, particularly the PayPal online payment operation and the Internet calling service Skype. EXPANSION QUEEN The core auction and retail businesses, which account for the majority of revenue, are showing signs of weakness. The number of active users has been flat for three quarters, at 83 million. The number of new products listed on the site has inched up only 4% from a year ago. And the number of stores selling goods at fixed prices on eBay has actually declined from a year earlier, to 532,000. Some sellers have discovered it's often easier and more efficient to sell their wares on rival sites such as Amazon.com (AMZN). Amazon's investments in technology have made it easier for buyers to find what they want from sellers. There's also more of a sense of trust among its users because Amazon stands behind most third-party transactions. On eBay, it can be extremely difficult to get your money back if you're burned by a seller or buyer. "Sellers are growing like crazy over [at Amazon]," says Scott Wingo, CEO of ChannelAdvisor, which helps sellers manage their merchandise on eBay, Amazon, and other e-commerce channels. Whitman's focus on expansion and profits pushed eBay's stock to its earlier heights. During her 10 years at the helm, she transformed the San Jose-based company from a simple auction site into a global e-commerce giant by pushing into 2017/4/21 EBay's New Tough Love CEO Business Week, January 23, 2008, Forbes, Feb. 2008

5 Source: EBAY INC. REPORTS FIRST QUARTER 2008 RESULTS
Net Revenue by Type 2017/4/21 Source: EBAY INC. REPORTS FIRST QUARTER 2008 RESULTS

6 Supplemental Operating Data
2017/4/21 Source: EBAY INC. REPORTS FIRST QUARTER 2008 RESULTS

7 How about Amazon & Google ?
Amazon's investments in technology have made it easier for buyers to find what they want from sellers. There's also more of a sense of trust among its users because Amazon stands behind most third-party transactions. Google has its own payment system called Checkout On eBay, it can be extremely difficult to get your money back if you're burned by a seller or buyer. eBay needs to better integrate its auctions with the fixed price shopping convenience offered at sites like Amazon.com Keep the excitement of winning an auction while providing the easy, convenient option of buying at a set price 2017/4/21

8 Pick A Strategic Path Focus on the one thing that it does best and penetrate new markets Credit card use is increasing in China and India In 2003, eBay acquired Chinese company Eachnet to launch its operations in the country. However, in 2006, when eBay put its Chinese operation into a joint venture with Tom Online(掏寶網), a local wireless Internet company, analysts viewed the move as a retreat for eBay. Take its core competencies and expand into related businesses where its auctions are a complement Expanding into new but auction-related businesses through acquisition PayPal and Shopping.com EBay can use the social nature of its site to create new tools that could improve the rate of purchases, gain more "wallet share" from its existing customers. Pick A Strategic Path Amit suggests another key chore for Donahoe is to outline a strategic plan. EBay has two alternatives typically faced by companies that grow quickly and then mature: "It can either have total focus on the one thing that it does best and penetrate new markets, or ... it can take its core competencies and expand into related businesses where its auctions are a complement." If eBay were to focus on taking its core auction business to new markets, two obvious choices would be China and India, Amit says. Ebay has already ventured into China--but with mixed results. In 2003, eBay acquired Chinese company Eachnet to launch its operations in the country. However, in 2006, when eBay put its Chinese operation into a joint venture with Tom Online, a local wireless Internet company, analysts viewed the move as a retreat for eBay. What's different this time? Amit says credit card use is increasing in China and India, thereby making eBay's business model--which depends on electronic payment systems--more feasible. In that sense, eBay's first effort in China was too early, says Amit. There will be challenges in both China and India, but eBay could sustain growth for years in those markets. Hosanagar agrees that eBay has to expand abroad, but acknowledges such moves are tricky to pull off. "EBay must figure out ways to have an impact elsewhere, like it did in the United States. While eBay made significant investments in both China and India, both efforts were largely unsuccessful," he says, adding that trust is a major impediment to eBay's business in countries like India and China. But those issues could be overcome if eBay partners with local banks, insurance firms and even competitors to establish best practices. "EBay needs to do more in these countries to develop the market itself." The other strategic approach sees eBay expanding into new but auction-related businesses through acquisition, says Amit. The auction giant already has a blueprint for this strategy, created for its acquisitions of PayPal and Shopping.com. Using this approach, eBay could emulate companies like Cisco Systems and Oracle (nasdaq: ORCL - news - people ), which have completed dozens of acquisitions. The acquisition route could be risky, however, if eBay tries to diversify into unrelated businesses. According to Hsu, another risk to any acquisition strategy is the drain on management time. If eBay were to start making larger acquisitions, it would require upper management's attention to integration plans. A better route may be to focus on smaller deals. "The acquisition route is tough," says Hsu. "The question [eBay will have to face] is whether it wants to devote CEO time to integration or to making smaller bets. It's best to go the targeted route." Hosanagar suggests that before Donahoe focuses on any specific strategic plan, he needs to figure out what the company does best, then better thread together its existing businesses. "EBay must articulate a clear long-term positioning and core competence, and use that to guide its acquisition strategy." Can EBay Restore Past Glory? Experts at Wharton say Donahoe will have his challenges managing eBay and boosting growth, but the company has resources at its disposal. Perhaps the biggest asset eBay has (aside, obviously, from $4.9 billion in cash and short-term investments as of Dec. 31) is its community, Amit says. "Donahoe has a lot to work out, but he is sitting on enormous, valuable assets, such as community and reputation." EBay can use the social nature of its site to create new tools that could improve the rate of purchases, he adds. "In many ways, the eBay community is a social network." By utilizing social networking and pursuing related businesses to complement auctions, eBay could gain more "wallet share" from its existing customers. Meanwhile, eBay's business model is far from broken. For the year ending Dec. 31, 2007, eBay reported net income of $348 million on revenues of $7.67 billion. What's different, however, is that eBay now has more competition than ever. On Amazon's fourth-quarter conference call, Chief Financial Officer Thomas Szkutak said Amazon has been successful attracting outside merchants to use the company's e-commerce platform. Amazon's third-party merchant services resemble eBay's, with features such as seller ratings. The big difference is that Amazon's merchants sell at a fixed price, while eBay conducts auctions. "Our seller business globally is very strong," Szkutak noted during the call. "We are continuing to try to work on that experience for sellers, to make it even better. Certainly, our goal is to have sellers increase their sales on our platform, and so we continue to do a number of different things to make it easier for them" to accomplish that. Google has its own payment system, Google Checkout, to compete with eBay's PayPal--making the Internet giant another competitive threat, according to Hosanagar. But eBay has an excellent brand, and can compete with its rivals. "EBay starts as a favorite," he says. "This is eBay's game to lose." 2017/4/21

9 Making eBay "Easier And Safer to Use"
Competition has eroded much of the advantage that eBay once had Roll out new search technology in certain categories that enables shoppers to look for specific items based on relevancy and to narrow their results by color, brand, size, and other features Launched a new photo-focused service that allows users essentially to window shop for things, rather than read through long descriptions beside small thumbnail images Address few areas--including fraud, the difficulties some have in navigating through the site and the need for better search tools. MAKING EBAY "EASIER AND SAFER TO USE" But expansion and diversification have their limits. As Whitman looked for new opportunities, rival Web sites, particularly Amazon, made inroads into the core e-commerce business. "Competition has eroded much of the advantage that eBay once had," says Derek Brown, a research analyst at Cantor Fitzgerald. Whitman has made some of the investments that sellers and buyers want. Late last year, eBay began rolling out new search technology in certain categories that enables shoppers to look for specific items based on relevancy and to narrow their results by color, brand, size, and other features. The site also launched a new photo-focused service that allows users essentially to window shop for things, rather than read through long descriptions beside small thumbnail images. Donahoe will certainly benefit from those investments. But he will have to build on them to bring the old vibrancy back to eBay's marketplace. EBay plans to announce additional steps in coming weeks, including a loyalty program for sellers. In addition, Donahoe says eBay will come down hard on fraudulent sellers and offer buyers more protection. "We are going to get very aggressive about making eBay easier and safer to use," he says. "While we have made strides in these areas, we need to do much more." 2017/4/21

10 EBay's New Tough Love CEO Business Week, January 23, 2008,
Perfect The Basics Marry the value-selection fun created by auctions with the convenience and opportunity inherent in fixed price Rework search abilities, making it easier to add pictures to listings, and is changing its web site to improve the company's merchant rating system EBay's challenge is to launch innovative new services, either through acquisitions or experimentation within the company 2017/4/21 EBay's New Tough Love CEO Business Week, January 23, 2008,

11 eBay Disruptive Innovation
Both sides of eBay marketplace Attracting and retaining continued stream of buyers Internet era, consumer is always evolving What’s new? why innovation? Posted by Rolf Skyberg on December 14, 2007 at 3:31 PM UTC A few weeks ago I had the opportunity to go on a home research visit with one of our powersellers. When we are developing new products we find it helpful to go out and ask our members what they think, and how it might be improved. We discussed many things as she walked us through how she uses the site and how she runs her business. The comment I found most interesting was her response to some Innovation projects we were near to launching. While she found them interesting, it was clear we hadn’t hit it “out of the park” for her. Investigating this further, she asked why we do all this “stuff” and spend money on it when she doesn’t see how it is going to bring her more buyers. I returned to the office, her comment ringing in my head, wondering if she might be right. My very job title, “Disruptive Innovator” could possibly be seen as someone who directly threatens a steady revenue stream. So why would eBay employ a (very) small team of Disruptive Innovators to think up and build projects where the “value” isn’t readily apparent? The question rattled in my head over the following weeks, popping up to be considered here and there as I worked. Eventually the idea came to me in the shower one morning: the eBay marketplace was created by eBay, Inc. but it only exists as long as sellers are willing to list their items there. Both sides of the table must cooperate in equity. The sellers provide inventory and eBay provides the buyers for those items. In order to ensure a continued stream of buyers, eBay is obligated to explore new ways of attracting them and better ways of retaining them. Because the internet consumer is always evolving, part of our responsibility is to make sure that we are following “what’s new” and even thinking it up ourselves is possible. So why do we innovate? Because it would be irresponsible not to. Many base their livelihood on eBay, and we can’t let our offering become “stale” for buyers. While it may sometimes seem that all this “stuff” is a little “out there”, it puts us in a position where we can re-use that knowledge when the market is more clearly defined. Innovation is our way of saying, “we know the world is changing, but don’t worry, we’ve got it covered.” 2017/4/21

12 Fun Projects 2017/4/21 eBay Desktop 1.0 (February 26, 2008)
the enhanced eBay Desktop application that lets users search, bid/receive alerts, and more eBay Flyer (December 21, 2007) print out your awesome auction in an easy to read format, ready for posting on a local bulletin board eBay Marketplace on Facebook (August 21, 2007) eBay + your Facebook friends = sheer genius. Post, brag and peek at your favorite eBay friends and items. alerts, and more eBay Countdown (July 20, 2007) watch, bid and win auctions using a live clock and instant bidding with eBay Countdown Bid Assistant (May 17, 2007) having trouble winning an item? create a group of items you’re interested in, set your maximum bids, and Bid Assistant will bid on your behalf until you win one item from the group eBay ToGo (April 30, 2007) show off eBay listings on any web page About Innovation.eBay.com The innovation site is our place to show off some of the fun projects and experiments we're working on and to share insights into innovation we see across the Internet. Look around, kick the tires on our projects and tell us what you think. If you have any innovation-related questions or comments, drop us a line at ( A downloadable eBay Desktop application allows users to bid and get streaming price updates without opening a web browser. Three new widgets can be used on blogs and social networks outside eBay's walls: eBay To Go, GiftBay and eBay Marketplace for Facebook. Bid Assistant automatically places bids for a buyer. eBay Countdown is an easier (read: more in-your-face) way to keep track of auctions that are just about to close. eBay Deal Finder helps you seek out items that will close soon but have no bids entered yet. This fall, eBay also unveiled a site redesign with sleeker, simplified graphical interfaces and new pathways to search for items. On eBay Playground (a version of the site where eBay tests new features), for example, the "snapshot view" of items displays search returns as a tiled wall of photos. Mouse over them, and pricing info pops up. Other discovery features hop on the social-network bandwagon. Neighborhoods, a forum for like-minded collectors to network, got buzz when it launched in early October, and the still-unpublicized EKG allows users to curate their favorite items and share them with others, a concept similar to craft-commerce site Etsy's Treasury. Rolf Skyberg, whose title at eBay is "disruptive innovator," frames the new social features using the "hierarchy of needs" theory proposed by psychologist Abraham Maslow in Retail stores, he points out, frequently sell hot dogs. Why? Because they meet shoppers' basic need for food, thereby enabling them to shop longer. If eBay can meet a shopper's social needs, perhaps she will spend more time on the site. (Skyberg recently gave an amusing presentation on the subject.) eBay Deal Finder (November 8, 2006) use eBay eBay Deal Finder to discover valuable items that others haven't including items with zero bids MapIt (October 1, 2006) find eBay items near you by plotting search results on a map eBay Matchups (September 1, 2006) pit your favorite items, celebrities, or concepts against each other in a popularity contest powered bye eBay 2017/4/21

13 Fun Facts About eBay 110 Million items for sale on the site $59 Billion in gross merchandize value (GMV) per year Approx $2,039 worth of goods traded on the site every second 309 Million registered users 2 Billion URL requests per day 6,000 application servers with 12,000 Java processes 40 Billion database requests per day 300 different databases (over 700 instances) 9 PB of data storage 13 million lines of source code (In 2008 will surpass Windows NT 4.0 O/S 16 million lines) eBay’s vision is to help people everywhere connect, discover and interact with each other through commerce 2008 MySQL Application of the Year • FaceBook - Social Network • Virgin Mobile France - Mobile Operator • eBay - ECommerce Site According to Chris, he and his Kernel Framework team “sought to provide a technology platform that would enable eBay to have a richer and more effective personalized experience. The vision was to provide each of the several thousand application servers running the eBay site the ability to access and leverage an instantly updateable, globally shared, personalization data system on every URL request.” As a result, eBay collaborated with MySQL starting back in the Summer of In my discussions with Chris and James it was agreed that eBay had been traditionally close-to-the-chest with its technology and application implementation, so getting an award for leveraging the power of open source software was impressive indeed. Chris went on to say, “although not advertised very much, eBay is a technology company at its core, providing internally developed technology solutions for one of the largest scale sites in the world. This particular cache system is built to handle over 4 billion requests per day!” Source: MySQL in eBay’s Personalization Platform Chris Kasten, eBay Kernel Framework Group April 16, 2008 eBay 2007 Annual Meeting of Stockholders June 14, 2007 2017/4/21

14 Find – Buy - Pay 2017/4/21

15 Improve the Finding Experience
New Search Result 2017/4/21

16 Improve the Finding Experience
New Search Result New Search Landing Pages 2017/4/21

17 Improve the Finding Experience
New Search Result New Search Landing Pages New Relevancy Based Listing Sort – Best Match 2017/4/21

18 Improve the Shopping Experience
Bid Assistant 2017/4/21

19 Improve the Shopping Experience
Bid Assistant Detailed Seller Ratings – Feedback 2.0 2017/4/21

20 Improve the Shopping Experience
Bid Assistant Detailed Seller Ratings – Feedback 2.0 Improved eBay Checkout 2017/4/21

21 Improve the Shopping Experience
Bid Assistant Detailed Seller Ratings – Feedback 2.0 Improved eBay Checkout Motors 2.0 2017/4/21

22 Extend offering eBay Express Convenience oriented buyer
New search engine Shopping cart 2017/4/21

23 Extend offering Tickets -StubHub
A leading secondary tickets marketplace Best in class buying/selling experience 2017/4/21

24 Improve Trust & Safety Safeguarding Member ID’s
Selling limits on items favored by counterfeiters Enhanced buyer protection 2017/4/21

25 Background Further distinguish the eBay shopping experience
Provide a more relevant and even better user experience Provide users with a more rich experience with greater continuity Provide users with the best selection tailored to their interests/profile Provide better user experience through real time personalization data feedback loop that is immediately available Provide users with tailored alternatives Further distinguish the eBay business value proposition Advertising shown to more relevant buyers More effective merchandizing and marketing of items Increase conversion rates through better buyer experience and greater relevancy of items presented to the buyer 2017/4/21 Source: MySQL in eBay’s Personalization Platform Chris Kasten, eBay Kernel Framework Group April 16, 2008

26 eBay Architecture Lesson Learned
eBay Serves 5 Billion API Calls Each Month. More and more traffic driven by mashups composed on top of open APIs Everyday 26 billion SQL queries and keeps tabs on 100 million items available for purchase. 1 billion page views a day, 105 million listings, 2 petabytes of data, 3 billion API calls a month The database is virtualized and spans 600 production instances residing in more than 100 server clusters 15,000 application servers, all J2EE. About 100 groups of functionality aka "apps". Notion of a "pool": "all the machines that deal with selling".. Lessons Learned l Scale Out, Not Up • Horizontal scaling at every tier. • Functional decomposition. l Prefer Asynchronous Integration • Minimize availability coupling. • Improve scaling options. l Virtualize Components • Reduce physical dependencies. • Improve deployment flexibility. Lesson Learned Virtualize Components • Reduce physical dependencies. • Improve deployment flexibility. Scale Out, Not Up • Horizontal scaling at every tier. • Functional decomposition. Prefer Asynchronous Integration • Minimize availability coupling. • Improve scaling options. 2017/4/21

27 The Architecture Scaling only horizontal, not vertical: many parallel boxes. Architectures is strictly divided into layers: data tier, application tier, search, operations, Split databases by primary access path, modulo on a key. Every database has at least 3 on-line databases. Distributed over 8 data centers Some database copies run 15 min behind, 4 hours behind Databases are segmented by function: user, item account, feedback, transaction, over 70 in all. No stored procedures, simple triggers Move out cpu-intensive work to application layer No client-side transactions, no distributed transactions Uses reliable multicast from primary database to search nodes, in-memory search index, horizontal segmentation, N slices, load-balances over M instances, cache queries. l Everything is planned with the question "what if load increases by 10x". Scaling only horizontal, not vertical: many parallel boxes. l Architectures is strictly divided into layers: data tier, application tier, search, operations, l Leverages MSXML framework for presentation layer (even in Java) l Oracle databases, WebSphere Java (still 1.3.1) l Split databases by primary access path, modulo on a key. l Every database has at least 3 on-line databases. Distributed over 8 data centers l Some database copies run 15 min behind, 4 hours behind l Databases are segmented by function: user, item account, feedback, transaction, over 70 in all. l No stored procedures are used. There are some very simple triggers. l Move cpu-intensive work moved out of the database layer to applications applications layer: referential integrity, joins, sorting done in the application layer! Reasoning: app servers are cheap, databases are the bottleneck. l No client-side transactions. no distributed transactions l J2EE: use servlets, JDBC, connection pools (with rewrite). Not much else. l No state information in application tier. Transient state maintained in cookie or scratch database. l App servers do not talk to each other -- strict layering of architecture l Search, in 2002: 9 hours to update the index running on largest Sun box available -- not keeping up. l Average item on site changes its search data 5 times before it is sold (e.g. price), so real-time search results are extremely important. l "Voyager": real-time feeder infrastructure built by eBay.. Uses reliable multicast from primary database to search nodes, in-memory search index, horizontal segmentation, N slices, load-balances over M instances, cache queries. 2017/4/21

28 Background eBay needed to expand its real time personalization capabilities eBay needed to be able to associate more data with sessions Both personalization and session data were constrained by technology Cookies limitation Client side cookie limit of 4KB data Long term scalability issue of sending all cookie data, whether needed or not High cost of traditional server side solutions using an OLTP database eBay’s very large scale quickly multiplies costs in to a very large number Throughput of OLTP’s decrease with high write ratio of approximately 50% Large number of licenses/servers needed for throughput was cost prohibitive High cost of other commercial alternatives at eBay’s very large scale These constraints were limiting business decisions and had to be solved 2017/4/21 Source: MySQL in eBay’s Personalization Platform Chris Kasten, eBay Kernel Framework Group April 16, 2008

29 eBay Personalization System General Vision
Every Application Server Can Access Data For Every URL Request (All 2 Billion of them!) Session Data Personalization Data Many large scale web site architects and developers have long felt the constraints of living in the 4 KB limit imposed upon the cookie space in a browser. The desire and business need to associate valuable data with a session or user as they traverse through your web site can open many doors of opportunity for a web site, including the notion of personalization. Personalization’s goal is to deliver a highly relevant and optimized user experience in order to provide a better user experience and achieve increases in conversion and revenue. Historically, tidbits of information have been squirreled away in cookies as the most scalable way of associating rapidly changing data with a user’s session, as most server side solutions that attempted to store and share this rapidly changing session state across several thousand stateless applications servers have had significant scalability issues for large scale sites like eBay, which require a stateless architecture for scalability and manageability. Approaches using traditional OLTP systems like Oracle have also suffered from significant scalability issues from the high transaction rate of write operations that lead to excessive cost in hardware and software licenses to support the load of a large scale site like eBay with over 2 billion URL requests per day. eBay’s Kernel Framework team sought to provide a technology platform that would enable eBay to have a more rich and effective personalization strategy. The vision was to provide each of the several thousand application servers running the eBay site the ability to access and leverage an instantly updateable, globally shared, personalization data system on every URL request. This system would have to be both cost effective and highly scalable for future growth in both data size and number of transactions. The eventual solution implemented by eBay was a system built upon the MySQL Memory Engine as the core cache engine. MySQL’s Memory Engine with its rich SQL capabilities and flexibility, along with its ability to perform significantly more read/write operations per second (loosely transactions per second) on a low cost hardware platform than several other technologies considered, while also having a very attractive price point, was a clear choice for eBay. This presentation will discuss the challenges of attempting to provide such a large scale personalization technology platform and how eBay leveraged the MySQL Memory Engine and collaboration with MySQL AB (eBay leveraged the power of open source and donated a significant enhancement it had developed to MySQL, which MySQL productionalized) to produce a robust and scalable system. 2017/4/21 Chris Kasten : Bay Kernel Framework Group April 16, 2008

30 eBay Personalization System
Application Servers MySQL Memory Engine Cache Tier Browser Persistent Database 2017/4/21 Chris Kasten : Bay Kernel Framework Group April 16, 2008

31 eBay Personalization System
Application Servers MySQL Memory Engine Cache Tier 5 min Batched Write Back Replication Read/Write Cache Miss Read Persistent Database 2017/4/21 Chris Kasten : Bay Kernel Framework Group April 16, 2008

32 eBay Personalization System Overview
Replication optional based on criticality of data loss for past 5 min Trade-off between data criticality versus double the memory cost Some personalization data may not be critical enough for the additional hardware cost Single threaded MySQL replication is generally problematic Once replication falls behind it stays behind with continued traffic Replication can be achieved via dual writes from the application server performed transparently by the framework Second write to replica can be asynchronous Automatic redistribution of data when node failure or draining a node 2017/4/21 Chris Kasten : Bay Kernel Framework Group April 16, 2008

33 eBay Personalization System Overview
Write back to persistent database performed by batch process Evictions performed by batch process based on target free memory Buffering space is set aside in case persistent database is unavailable Special techniques used to minimize table lock duration during write back and eviction operations 2017/4/21 Chris Kasten : Bay Kernel Framework Group April 16, 2008

34 Chris Kasten : Bay Kernel Framework Group April 16, 2008
Results A business critical system running on MySQL Enterprise for one of the largest scale websites in the world Highly scalable and low cost system that handles all of eBay’s personalization and session data needs Ability to handle 4 billion requests per day of 50/50 read/write operations for approximately 40KB of data per user / session Approx 25 Sun 4100’s running 100% of eBay’s personalization and session data service (2 CPU, Dual core Opteron, 16 GB RAM, Solaris 10 x86) 2017/4/21 Chris Kasten : Bay Kernel Framework Group April 16, 2008

35 Chris Kasten : Bay Kernel Framework Group April 16, 2008
Results Highly manageable system for entire operational life cycle Leveraging MySQL Dashboard as a critical tool in providing insight into system performance, trending, and identifying issues Adding new applications to ebay.com domain that previously would have been in a different domain because of cookie constraints Creating several new business opportunities that would not have been possible without this new low cost personalization platform Leveraging MySQL Memory Engine for other types of caching tiers that are enabling new business opportunities 2017/4/21 Chris Kasten : Bay Kernel Framework Group April 16, 2008

36 How eBay Searches and Updates 100 Million Listings in 60 Seconds
The search infrastructure at eBay eBay featured up to 100 million listings, and 60,000 changes per minute, now it takes only a minute or two for a new item to show up in the search engine Instead of searching the entire database at once, eBay looks at nearly two dozen slices. Conducting smaller searches simultaneously at data centers in San Jose and Phoenix and elsewhere is much faster. The trick is then combining those sets of results to look like a single query. As I described in the magazine recently, eBay is pursuing a new strategy, catering to buyers instead of sellers. It's the biggest and most urgent change to the site in years. Although the number of listings and gross merchandise sales have continued climbing, buyer activity has slowed down dramatically. Despite the mind-blowing number of registered users worldwide million, or the equivalent of three-quarters of the U.S. population - only about a third bid, bought, or listed an item in the previous 12 months. Those active buyers increased at the smallest rate in four years, a dangerous trend. eBay has been overhauling its site to make shopping easier and enjoyable, with features such as windowshopping, auction-countdown, and eBay-to-Go. But one of the keys to improving the overall experience remains behind the scenes: the search technology. Meet Randy Shoup, the main architect for search infrastructure at eBay. Search infrastructure may not sound exciting, but it certainly is to him. Shoup comes across as someone who can't believe his good fortune, like a pilot who finds himself in the cockpit of the Boeing 787 Dreamliner. "There are only a handful of e-commerce sites that operate at this level," he said. "Yahoo, Amazon, Google, and eBay." The search challenge for eBay is not only indexing and searching an enormous database, but keeping up with the latest changes to that database - about 1,000 per second. A bid. A purchase. A new listing. The inventory and prices are in constant flux. Now you see what's exciting about search infrastructure? Several years ago, eBay featured 12 million listings on average. Now it's up to 100 million listings. iPhones. Used cars. The new Madden. DVDs on the 1964 New York World's Fair (more on that later). In the old days, it would take as long as nine hours for a new item to appear in a search, not the sort of time lag that does sellers or buyers any good. "It was pretty unpleasant," says Shoup, "but now it takes only a minute or two for a new item to show up in the search engine." How do you search 100 million items and 60,000 changes per minute in such a short time? The same way any team tackles a big job: by breaking it down. Instead of searching the entire database at once, eBay looks at nearly two dozen slices. Conducting smaller searches simultaneously at data centers in San Jose and Phoenix and elsewhere is much faster. The trick is then combining those sets of results to look like a single query. And that is how I did part of my Christmas shipping this year. I searched eBay for DVDs showing historical footage of the 1964 New York World's Fair, my parents' first trip to New York. When they opened the DVD, they gave me one of those priceless "Where in the world did you find this?" looks. I'd love to take the credit. But it wasn't me. It was Shoup and eBay's algorithms. 2017/4/21

37 Randy Shoup, eBay Distinguished Architect
Architectural Forces Scalability Resource usage should increase linearly with load Design for 10x growth in data, traffic, users, rtc. Availability Resilience of failure Graceful degradation Recoverability from failure Latency User experience latency Data Latency Manageability Simplicity Maintainability Diagnostics Cost Development effort and complexity Operational cost (TCO) 2017/4/21 Randy Shoup, eBay Distinguished Architect

38 Architectural Strategies
Strategy 1: Partition Everything How do you eat an elephant?... One bite at a time Strategy 2: Async Everywhere Good things come to those who wait Strategy 3: Automate Everything Give a man a fish and he eats for a day… teach a man to fish and he eats for a lifetime Strategy 4: Remember Everything Fails Be prepared 2017/4/21 Randy Shoup, eBay Distinguished Architect

39 Randy Shoup, eBay Distinguished Architect
Partition Database Segment database into functional areas Group data using standard modeling technique Cardinality (1:1, 1:N, M:N) Relationships Usage characteristics Logical hosts Abstract application’s logical representation from host’s physical location Support combining and splitting without code change User Item Transaction Product Account Feedback 2017/4/21 Randy Shoup, eBay Distinguished Architect

40 Randy Shoup, eBay Distinguished Architect
Horizontal Split Split database horizontally along primary access path Multiple split approaches for different use cases Modulo on key (item id, user id, etc.) Aggregation / routing in Data Access Layer (DAL) Application Server DAL ItemHost 0 ItemHost 2 ItemHost 1 ItemHost 19 2017/4/21 Randy Shoup, eBay Distinguished Architect

41 Randy Shoup, eBay Distinguished Architect
Search Read-only search decoupled from write-intensive transactional database Horizontal split, aggregate parallelizes query over N slices, load-balances over M instances Aggregator Col 1 Col 2 Col 3 Col 4 Col 5 Col 6 Col 7 Col 8 2017/4/21 Randy Shoup, eBay Distinguished Architect

42 Randy Shoup, eBay Distinguished Architect
Async Everywhere Message Dispatch Image Processing ItemHost N Selling Summary Update User Metrics 2017/4/21 Randy Shoup, eBay Distinguished Architect

43 eBay Flyer 2017/4/21 eBay Flyer
eBay is an amazing marketplace, connecting millions of buyers and countless sellers. But how can you reach those buyers who might not be checking eBay day and night? eBay Flyer to the rescue! Sometimes, the people most likely to buy your stuff are the people around you. Maybe they shop at the same grocery store you do, attend the same church, or live down the hall in your dorm. eBay Flyer is a great way to let them know that you have something begging to be theirs. How does it work? Nothing fancy here folks, just print your flyer, cut the strips and tape, staple or pin it up where you think it will be noticed. Curious humans will be drawn like moths to a porch light and investigate your new poster. If interested, they’ll grab a little tear-strip for future reference. When they return home, entering the URL on the tear-strip will take them directly to your auction. It’s free, right? Of course it is! Just another service from eBay Innovation to drive more customers to you. Consider it a holiday gift. What should I make a flyer for? What works best? Well, that’s really up to you. Large, awkward or locale-specific items might do well because who wants to pay shipping? Couches, TV’s, cars, furniture and anything else you don’t want to drag to the post office are perfect candidates. OK, so how do I get started? First, list your item on eBay. Once you’ve listed your item for sale on eBay, creating your flyer is just 3 simple steps: Choose: visit and enter your Item ID or User ID to select your item Edit: we’ll start you off with what we think you’ll want, but feel free to change what you like Print: click “Print” to send it to your printer or “Save as PDF” to download it for later use, don’t forget to cut the tear-strips! 2017/4/21

44 Bid Assistant http://innovation.ebay.com/?p=12 2017/4/21
Bid Assistant Why spend valuable time bidding when Bid Assistant can do it for you? No more bidding on similar items over and over trying to win one. Designed for busy buyers, Bid Assistant eliminates the need to bid on multiple items one at a time. Think of Bid Assistant as your own personal bidding aide. Just tell it what to bid on and your highest bid. Bid Assistant will blaze through your list -- automatically bidding for you. You can bid on a group of similar items, but win just one! It's free, so why not give it a try? Bid Assistant Bid Assistant allows you to create a group of items you’re interested in, set your maximum bids, and have Bid Assistant bid on your behalf until you win one item from the group. It’s easy to set up your bidding group and have Bid Assistant do the work for you: Create your group. Add items to your Items I’m Watching list. Then, select the checkbox next to any item you want to add to your group, and click the Bid with Bid Assistant button. Place your bids. You can set one maximum bid that will apply to each item in your group, or enter a different maximum bid for each item. Track your status. View the status of your group by clicking the “Bid Assistant” link in the left column in My eBay. Bid Assistant will move through your group (starting with the item that ends first), and place bids on your behalf. Bid Assistant will continue bidding until you win one item, or until you reach the end of your group.Once you’ve won an item, your bidding activity will stop, and your group will be closed. Only one bid in your group will be active at any time. If you get outbid on an item, eBay will wait until that item closes before bidding on the next item in your group. 2017/4/21

45 eBay Countdown 2017/4/21 eBay Countdown
What is eBay Countdown? eBay Countdown is a brand new way to track and bid on your eBay auctions. It provides a persistent way to stay reminded of your saved items and searches. Countdown includes: Real time alerts: reminders pushed out to your browser when you are outbid or when a watched item is about to end; alerts include both visual and sound reminders. On screen bidding: no need to wait for pages to reload to bid. Bidding is fast and easy inside Countdown. Instant access to My eBay Buying: get quick access to items bid on or watched. Favorites ticker: a scrolling ticker displays results to your saved searches so you can watch or bid on saved search results quickly Do I have to download or install anything? Nope! No download is required. You just need a web browser that supports Flash. 2017/4/21

46 eBay To Go (beta)! Showcase your favorite eBay discoveries directly on your website or blog! Setting up eBay To Go™ is both easy and free. Create your widget now and make your website stand out! eBay ToGo Have you ever found something on eBay that you really wanted to let your friends know about? If so, eBay To Go is for you. It’s a fun and easy way for you to share the interesting things you’ve discovered on eBay and personalize your blog, social networking page or website. Q. Who can create an eBay To Go? A. Anyone can create their own eBay To Go widget, even non-eBay users. Q. Is eBay To Go free? A. Yes - it’s free and its fun. Try it out yourself! Q. I have a great feature idea I’d like to share. How can I contact you? A. We would love to hear from you! Please send your recommendations to Q. Is eBay To Go only for listings? A. You can create an eBay To Go for a single item, multiple items (up to 10) or for a favorite search. We’re working on getting more versions built for you too — send us an if you have ideas for a version you’d like to see! Q. What happens if the item I display expires? A. Good question - it’s up to you! When you create an eBay To Go, we ask you what search results you want to display after the item expires. Q. Why is it called “eBay To Go”? A. Because eBay is full of entertaining and fun items and we want you to have the ability to take a piece of eBay with you. 2017/4/21

47 eBay Deal Finder 2017/4/21 eBay Deal Finder
Looking for a bargain on eBay? Use eBay Deal Finder to discover valuable items that others haven’t. All eBay items returned have zero bids, less than 4 hours left, no reserve price, free or fixed rate shipping and a total price that includes shipping costs. What items appear in Deal Finder? Deal Finder only displays items that have: zero bids no reserve price less than four hours left free or fixed rate shipping a total price that is below the selected criteria been listed on eBay.com in US currency Why don’t some items show up in Deal Finder? Not all items found on eBay.com are displayed in Deal Finder. For an item to be displayed in Deal Finder it must meet the keyword and category constraints as well as have zero bids, no reserve price, less than four hours left, free or fixed rate shipping and a total price that is below the selected criteria. Does Deal Finder include items located outside the US? Deal Finder only includes items listed in US currency. Does Deal Finder include items with variable shipping? Deal Finder only includes items with free or fixed shipping. We are looking to include variable rate shipping, stay tuned… How does a seller qualify to have his/her items appear on Deal Finder? Any seller’s items can appear on Deal Finder. The only requirement is that the item meets the keyword and category constraints as well as have zero bids, no reserve price, less than four hours left, free or fixed shipping rate shipping and a total price that is below the selected criteria. All the items have ended. How do I view active items? If all the items displayed have ended, click on the See active items link in the bottom right hand corner. How do I see all of the items on eBay that match my search criteria? To see all of the items that match your keywords and category constraints, click on the See all link in the bottom left hand corner. Where can I provide feedback or suggestions for Deal Finder? We would love to hear what you think of Deal Finder and if you have any suggestions. To do so, click on the “Tell us what you think” link on the search results page, right below the Popular deals. 2017/4/21

48 Where did Map It go? Map It was a prototype site designed to make it easy to find eBay items close to you. Unfortunately, the eBay Map It prototype is no longer available. What is was Map It? Map It is a prototype site that is designed to make it easy to find eBay items near to you. It features a prominent zip code box as well as search results that are plotted on a map. Why did eBay build Map It? Map It was built by a couple of eBay’s internal developers as an example of what can be done using eBay’s APIs (which can be accessed publicly through the eBay Developers Program). Map It provides an entirely different way to look at eBay. 2017/4/21

49 Sorry! eBay Matchups is closed
What we used to say about Matchups: Have you ever wanted to put two things side by side and determine which is better? That’s a Match Up. And that’s what eBay Match Ups lets you do: create a Match Up, vote for the winners, and interact with other eBay members! Launched in September of 2006, eBay Matchups has grown from a private beta project built off of the eBay API to being home to one of most thriving and eccentric communities on eBay. 2017/4/21


Download ppt "Transaction Processing Discussion"

Similar presentations


Ads by Google