IBM Software Group Outline Performance and Reliability are important The Grid is an important component of business computing, today, and for the future On Demand – the drive for ultimate flexibility and integration Leads us to Grid The Grid in business Typical Examples of commercial Grid applications A different kind of example Trends, Consequences, Questions for Performability
IBM Software Group Performance, Reliability are important Reliability, Quality A growing part of software development budget is spent on performance, test and service Problem rates on new technologies (e.g., J2EE) are high and climbing New solutions are required.
IBM Software Group An on demand business is an enterprise whose business processesintegrated end-to-end across the company and with key partners, suppliers and customerscan respond with speed to any customer demand, market opportunity or external threat. On Demand Business – The Why
IBM Software Group Present Reality: Functional Automation Limitations of Tight Vertical Integration: Monolithic applications cant be reused economically, efficiently Ad hoc integration creates connections that are difficult to change/maintain Lack of standards limits ability to deliver meaningful interoperability Marketing Partners Web Partners Sales Partners
IBM Software Group Marketing Partners Web Partners Sales Partners What Business needs: Horizontal Process Integration Advances that make it possible: Standards for creating services and enabling them to communicate are agreed upon by major vendors Infrastructure that supports self-defined, loosely coupled services has emerged Tools to incorporate existing assets are available Automation and virtualization of systems resources readily available Need to Integrate
IBM Software Group Marketing Partners Web Partners Sales Partners What Business needs: Horizontal Process Integration Need to Integrate Business Flexibility IT Simplification Increased focus on business flexibility Relentless use of open standards to enable communication and integration across the value net Partner to sharpen focus and respond to opportunities and threats Requires an on demand IT environment Ability to repurpose application functionality in order to support horizontal processes Automation and virtualization of resources
IBM Software Group Business process decision-making Rigid organizational structure Slow and steady economic growth Long-term product lifecycles Passive operational risk management Fixed costs Proprietary systems Labor-intensive Users adapt to technology Collaborative, integrated value nets Dynamic, adaptive, learning Unpredictable fluctuations Shortening product lifecycles Proactive risk management; increased focus on privacy and security Variable costs Open, integrated systems Self-healing, self-managing systems Technology adapts to users Business Technology Static On Demand IBMs On Demand model is a fundamental shift in the business model and technology
IBM Software Group Focus on Virtualization and Grids On Demand Operating Environment Transactional Processes Application Development, Deployment & Maintenance Collaboration Information Management Integration: People – Process – Information Anywhere, any time, from any device SecurityOptimization Provisioning Policy-based Orchestration Availability Business Objectives and Policies Virtualization Engine StorageServers Distributed Systems Network Open Standards-based Business Objectives and Policies Grids
IBM Software Group Grid – is it commercially real? Several commercial examples Charles Schwab Hewitt Associates A somewhat different example Games
IBM Software Group Charles Schwab Reduce the processing time on an existing wealth-management application to improve customer service. IBM Linux Globus Toolkit IBM Infrastructure Technology Services IBM Research Challenge Solution Technology Benefits: Business Benefits: Increased customer satisfaction by responding to inquiries in real time Enabling Schwab to move from a low-cost transactional broker to an advice-based wealth manager We believe that Grid computing … has the potential to greatly improve our quality of service and be a truly disruptive technology. Oren Leiman, Managing Director, Charles Schwab We believe that Grid computing … has the potential to greatly improve our quality of service and be a truly disruptive technology. Oren Leiman, Managing Director, Charles Schwab Technology Benefits: Reduced processing time from four minutes to 15 seconds Leverages existing infrastructure Grid-enabling many more applications Business Analytics
IBM Software Group Hewitt Associates LLC Challenge Create Grid Computing environment to: Contain expenses for CalcEngine valuations Maintain or improve availability, response time & scalability Insure personal-data security Capitalize on existing application code Cooperate with z/OS Sysplex CICS Calling Environment Enable smooth and orderly migration to change Solution Grid Computing environment includes: IBM zSeries® server IBM eServer BladeCenterTM servers Linux Red Hat v8.0 Business Partner: DataSynapse GridServer Business Analytics Benefits: Efficiently uses of the combined processing power of their heterogeneous environment Experienced an immediate 10% faster response time with the first application deployment Open architecture enables Hewitt to easily deploy additional applications Increased processing speed reduced cost per transaction Reduced operational costs improves competitiveness in their industry segment
IBM Software Group HR Outsourcer Business Background Real time policy calculation Valuate participant scenario with respect to employer constructs Policies defined by corporate plans and governmental rules Custom interpretive language worksheet creation Valuations are an expensive business COBOL CICS applications serialize person data through VSAM Smalltalk Operations can take 1-50 seconds of zSeries computing Arrival rate is erratic, causing divergent response time Grid cost is justified by the flexibility for new deployment zSeries Model 900 CICS AAA COBOL BA0111 COBOL CaIcEngine Smalltalk zSeries Sysplex 16000 Mips 71 CPs 4 CPs for CalcEngine More CPs for development
IBM Software Group Integrating Smalltalk Into A Grid Grid Servers (xSeries) Linux VMWare or Blades Binding App. Linux Smalltalk CaIcEngine Smalltalk zSeries Model 900 CICS AAA COBOL Binding App. IBM VisualAge Smalltalk Connectors Support for APPC, CICS, CPI-C, MQI and TCP/IP (sockets and RPC) Version 6.0.1 became a pre-req Required DB2 access from Engines Prototype Selection Tried OGSA v3 in February, but… Keep it simple! Use Java socket code Provide enough middle points to be able to watch/debug request flow
IBM Software Group OptimalGrid A Research project at IBM Almaden Researcher Center Makes developing and running grid application easy by hiding the complexity of using the grid A different approach from the API or Toolkit application development environments – no need to educate developers on complicated grid technologies Application code, Management Infrastructure, and Manager written in Java so it runs anywhere Java runs Non-Java application integration possible via JNI and MathShell
IBM Software Group What if….? You could create a NEW GENRE of massive player online game… Where you can FLY through a huge game world Where you can SEE objects in the other server Where you can INTERACT with the entities on the other servers Range of sight For player #1 Range of sight For player #2 Server 1 Server 2 Server 3 Server 4 Server 6 Server 7 Server 8 Interacting with Entities in other servers
IBM Software Group What if….? You could create a MASSIVE multi-player online game Where the number of players are NOT LIMITED by the server hardware Where everybody is in ONE WORLD, not several different shards Where massive battles with over 10,000 PLAYERS are possible #1 Game world server ( 2000 players ) #2 Game world server ( 1000 players ) #3 Game world server (MAX: 3000 players) Outage due to sudden increase in players In the other game world. ONE Gridified Game World Game environment not limited by server hardware Hello Player ABC Hello player XYZ Three separate Parallel Game Worlds Come join the big battle! I got disconnected! Where are you?
IBM Software Group What if….? Your game servers could load balance the game DYNAMICALLY Where the servers will allocate resources AUTOMATICALLY Where the servers will partition the game for OPTIMAL PERFORMANCE Game map zone : BlueGame map zone : RedGame map zone : Yellow Huge User Movement From Map Zone BLUE To Map Zone RED Grid Resource Dynamically Re-allocated with Optimal configuration
IBM Software Group 870 unique total client code downloads 67 IBM domains worldwide 18% Linux clients 82% windows Massively Multiplayer Online Game (mmog) Demonstration Based on Quake2
IBM Software Group For Game Developers, Hosts, and Aggregators of MMOG OptimalGrid can: - Automatically partitions and distributes any game world - Seamlessly moves players and objects between servers - Game migration is easy - Original game design is preserved OptimalGrids Autonomic feature hides the complexity of Grid from the Application Developer, while resolving pain points Player now in GameGrid Server As Zone Player now in GameGrid Server Bs Zone
IBM Software Group Performability in an on demand world Performance Reliability
IBM Software Group Flexibility and Responsiveness drive On Demand Flexibility Componentisation Reuse Simplification Virtualisation at all levels of Resources Autonomic control Reliability (predictability) Finer modularity Security Responsiveness Open Stds Performance And they, in turn, drive Virtualisation (Grid) And also have consequences for Performability
IBM Software Group Trends, their Consequences, and Questions Security A classic antithesis for performance A critical and growing requirement for business But a growing problem we all face, e.g., Viruses 6.5M in 2003 Antivirus scans - 3 hours of downtime Overhead for J2EE security managers --------------------------------- This will continue to grow 6M Viruses so far in 2004
IBM Software Group Performance Reliability Security - Typically drives performance down - pathlength goes up - scalability is constrained -Typically enhances reliability -Availability also goes down with virus scans, etc. Security Open, Grid environments scale up security issues, and mandate more attention. Do we need to model these interactions explicitly? Are present techniques adequate? Appropriate? e.g., to capture viral spreading patterns, containment Trends, their Consequences, and Questions
IBM Software Group Trends, their Consequences, and Questions Scalability Whatever we think is large and complex now, wont be in the future. We see this in some of the grid examples we are familiar with Games motivates another jump in scale 10,000 users at a time Communities of 500,000s of users Wireless gaming will drive server demand, and strain adaptive capabilities even harder Security issues will multiply profoundly Gaming is real commerce People buy virtual things – e.g., castles, etc., on ebay!
IBM Software Group Trends, their Consequences, and Questions Complexity A growing concern for software in general New technologies/disciplines – e.g., componentisation, Aspect Oriented Software Development - must help, but for now, we are faced with: One factor that contributes to growing security overhead Also to resulting models of reliability and overall fragility
IBM Software Group Trends, their Consequences, and Questions Componentisation and Reuse Demands modularity and reuse in models Demands incremental, scalable, composable models Autonomic Systems What is a failure in a self-healing system? What are the reliability characteristics of a system that is adaptive? How is this to be characterised, measured, modelled? Lotus WebSphere DB2 Tivoli Re-factor to SWG Product Offerings Componentization Lotus TivoliWebSphere DB2 New or Enhanced Capabilities New or Enhanced Capabilities New or Enhanced Capabilities New or Enhanced Capabilities New or Enhanced Capabilities Shared Components Product Offerings Product Specific Investment Shared Capabilities Initial Base Product
IBM Software Group Trends, their Consequences, and Questions Autonomic Systems What is a failure in a self-healing system? What are the reliability characteristics of a system that is adaptive? How is this to be characterised, measured, modelled?
IBM Software Group Trends, their Consequences, and Questions Business focus is needed Growing Recognition of the importance to IT of Business Events, Business Processes For deeply technical people this is a hard concept But, technology exists to solve business problems There are some interesting opportunities for performability as well. E.g., Reliability as a factor in service level objectives, agreements Dynamic, operational performability Measuring and Characterising Business Performance; Business Reliability. The Reliability of Services. Business Performance Management monitors and visualizes the behaviour of business processes by correlating IT events and business activities, thus enabling performance optimization according to business goals
IBM Software Group Summary Performance, Reliability are growing business concerns The Grid solves real business problems and is part of the overall solution in delivering increasing flexibility and responsiveness. Dependency on Software is growing in all levels of IT solutions Complexity is growing Security is a growing requirement, and the tradeoffs between security and performance need to be better understood The IT focus is moving increasingly higher up the software stack; indeed, beyond the software into the business domain. Reliability, Performance and Availability are more complex with dynamic provisioning and autonomic control
IBM Software Group Getting OptimalGrid Available for download on Alphaworks www.alphaworks.ibm.com/tech/optimalgrid Project pages www.almaden.ibm.com/software/ds/OptimalGrid E-week: http://www.eweek.com/article2/0,3959,1227299,00.asp Slashdot: http://games.slashdot.org/article.pl?sid=03/08/22/0351229&mode=thread&tid=112&tid=127&tid=136&tid=186&tid=187&tid=206http://games.slashdot.org/article.pl?sid=03/08/22/0351229&mode=thread&tid=112&tid=127&tid=136&tid=186&tid=187&tid=206) MIT Technology Review Researchers James Kaufman email@example.com@almaden.ibm.com Toby Lehmantoby@firstname.lastname@example.org Glenn Deenglenn@almaden.ibm.com Text slide with film strip images
IBM Software Group Trademarks Hewitt is a trademark of Hewitt Associates, LLC Charles Schwab is a trademark of The Charles Schwab Corporation. Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both. Microsoft, Windows, Windows NT, BizTalk, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both. Gartner is a registered trademark of Gartner, inc., or its Affiliates Solaris is a trademark of Sun Microsystems, Inc. in the United States, other countries, or both. UNIX is a registered trademark of The Open Group in the United States and other countries. Intel, Pentium, Pentium Pro, Pentium II, Pentium III are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the US and other countries. HP-UX is a registered trademark of Hewlett Packard Company. Linux is a registered trademark of William R. Della Croce, Jr. (last listed previous owner was Linus Torvalds) "SAP is the trademark of SAP AG in Germany and in several other countries. AIX, AS/400, Blue Gene, BlueDrekar, Lotus, Tivoli, Rational, XDE, Z/OS, DB2, Deep Blue, Deskstar, Discoverylink, IBM, Microdrive, OS/390, Scrollpoint, ServeRAID, Thinkpad, TransNote, Travelstar, Ultrastar, Websphere, Workpad, are all trademarks and registered trademarks of International Business Machines Corporation in the United States and/or other countries.