2. Improving Maintenance and Reducing Patching Downtime in 11i Ric Ginsberg Vice President Applications Release Engineering Oracle Corporation

3. Topics  Patching Best Practices  Enhancements In Release 11i  Maintenance Initiatives

4. Best Practices (#1)  Schedule periodic downtime for proactive maintenance  Keep up-to-date on latest AD code  Keep your test system current with production  Perform “uptime” maintenance – Gather schema stats – Patch help system – Apply translation database updates

5. Best Practices (#2)  Use a shared APPL_TOP and Distributed AD  Avoid extent allocation errors with autoextend  Combine patches with AD Merge Patch  Use AD Patch ‘novalidate’ option (default as of AD.H)  Use a staged APPL_TOP

6. Enhancements In Release 11i

7. 11i Installation Enhancements  Eliminates error prone OUI/ORCA based install  Uses Cloning architecture  Installs in about an hour  Installs translation filesystem (11.5.9)  Rapid Install “-techstack” option – iAS 1.0.2.2.2

8. 11i Performance Enhancements (#1)  Faster driver read (50x faster)  Faster prereq checking  Faster file copy  Faster Patch History processing  Reduced worker idle time  Increased worker parallelism

9. 11i Performance Enhancements (#2)  Create PL/SQL packages directly  Generate reports in parallel  Significant performance tuning for: – FNDLOAD – AKLOAD – Multi-Lingual Synch  Synchronize Multi-lingual tables in parallel  Tuning based on large volume upgrade tests

10. 11i Patch Utility Enhancements (#1)  Checkfile feature – Activated with database drivers – Records file and version information in the database – Executes commands only if they have not executed previously for the highest onsite version of the file – Eliminates need for package revision cache  Automatic job deferral – Re-tries failed jobs at the end of the phase – Replaces auto restart

11. 11i Patch Utility Enhancements (#2)  Unified Driver – Requires a single AD Patch run  AD Merge Patch improvements – Can merge all patch types and driver types – Characterset is converted during merge – Significant performance improvement  Automated Pre-requisite checking – AD Patch confirms prerequisite is satisfied – Allows for smaller patches, less overhead – Duplicate patch avoidance

12. 11i Patch Utility Enhancements (#3)  Password Hider – Passwords automatically removed from log files  Manual Step Elimination – Automatically compiles Apps – Automatically Maintains MRC – Automatically compiles JSP  Technology Stack Validation Utility – Confirms minimum techstack requirements – Refers to appropriate MetaLink notes

13. 11i Patch Utility Enhancements (#4) Distributed AD – Apply patches using all your middle tier horsepower to significantly reduce downtime adworker16 … adworker20 adworker11 … adworker15 adworker06 … adworker10 adpatch adworker01 … adworker05

14. Case Study  11.5.5(+) to 11.5.9  300 GB database  Languages: US English & German  Characterset: UTF8

15. Case Study 11.5.5 to 11.5.9 FunctionUS GermanReduction File system update 3.5 hours2.5 hours Database update 20 hours 10 hours MultiLingual Synchn/a 9 hours File Generation 3 hours 3 hours Total 51 hours FunctionUS GermanReduction File system update 3.5 hours2.5 hours Database update 20 hours 10 hours MultiLingual Synchn/a 9 hours File Generation 3 hours 3 hours Total 51 hours

16. Case Study 11.5.5 to 11.5.9 FunctionUS GermanReduction File system update 2 hours.5 hour60% Database update 20 hours 10 hours MultiLingual Synchn/a 9 hours File Generation 3 hours 3 hours Total 51 hours 3.5 hour reduction for file system update: reduced AD overhead faster driver read prior charset conversion FunctionUS GermanReduction File system update 2 hours.5 hour60% Database update 20 hours 10 hours MultiLingual Synchn/a 9 hours File Generation 3 hours 3 hours Total 51 hours 3.5 hour reduction for file system update: reduced AD overhead faster driver read prior charset conversion

17. Case Study 11.5.5 to 11.5.9 FunctionUS GermanReduction File system update 2 hours.5 hour60% Database update 14.5 hours3 hours40% MultiLingual Synchn/a 9 hours File Generation 3 hours 3 hours Total 51 hours 12.5 hour reduction for database update: checkfileloader performance direct PL/SQLincreased parallelism reduced overhead reduced worker idle FunctionUS GermanReduction File system update 2 hours.5 hour60% Database update 14.5 hours3 hours40% MultiLingual Synchn/a 9 hours File Generation 3 hours 3 hours Total 51 hours 12.5 hour reduction for database update: checkfileloader performance direct PL/SQLincreased parallelism reduced overhead reduced worker idle

18. Case Study 11.5.5 to 11.5.9 FunctionUS GermanReduction File system update 2 hours.5 hour60% Database update 14.5 hours3 hours40% MultiLingual Synchn/a 1 hour90% File Generation 3 hours 3 hours Total 51 hours 8 hour reduction MultiLingual Synch: runs in parallel performance improvements FunctionUS GermanReduction File system update 2 hours.5 hour60% Database update 14.5 hours3 hours40% MultiLingual Synchn/a 1 hour90% File Generation 3 hours 3 hours Total 51 hours 8 hour reduction MultiLingual Synch: runs in parallel performance improvements

19. Case Study 11.5.5 to 11.5.9 FunctionUS GermanReduction File system update 2 hours.5 hour60% Database update 14.5 hours3 hours40% MultiLingual Synchn/a 1 hour90% File Generation 2 hours 2 hours35% Total 51 hours 2 hour reduction file generation: parallel report generation less overhead FunctionUS GermanReduction File system update 2 hours.5 hour60% Database update 14.5 hours3 hours40% MultiLingual Synchn/a 1 hour90% File Generation 2 hours 2 hours35% Total 51 hours 2 hour reduction file generation: parallel report generation less overhead

20. Case Study 11.5.5 to 11.5.9 FunctionUS GermanReduction File system update 2 hours.5 hour60% Database update 14.5 hours3 hours40% MultiLingual Synchn/a 1 hour90% File Generation 2 hours 2 hours35% Total 25 hours50% 26 hour total reduction. FunctionUS GermanReduction File system update 2 hours.5 hour60% Database update 14.5 hours3 hours40% MultiLingual Synchn/a 1 hour90% File Generation 2 hours 2 hours35% Total 25 hours50% 26 hour total reduction.

21. Case Study 11.5.5 to 11.5.9 FunctionUS GermanReduction File system update 2 hours.5 hour60% Database update 5 hours.5 hour80% MultiLingual Synchn/a 1 hour90% File Generation.5 hour.5 hour85% Total 10 hours80% Additional 15 hour reduction using distributed AD. FunctionUS GermanReduction File system update 2 hours.5 hour60% Database update 5 hours.5 hour80% MultiLingual Synchn/a 1 hour90% File Generation.5 hour.5 hour85% Total 10 hours80% Additional 15 hour reduction using distributed AD.

22. Case Study 11.5.5 to 11.5.9 FunctionUS GermanReduction File system update nonenone100% Database update 5 hours.5 hour90% MultiLingual Synchn/a 1 hour90% File Generation none none100% Total 6.5 hours87% Additional 3.5 hour reduction using staged APPL_TOP. FunctionUS GermanReduction File system update nonenone100% Database update 5 hours.5 hour90% MultiLingual Synchn/a 1 hour90% File Generation none none100% Total 6.5 hours87% Additional 3.5 hour reduction using staged APPL_TOP.

23. Case Study 11.5.5 to 11.5.9 FunctionUS GermanReduction File system update nonenone100% Database update 5 hours none90% MultiLingual Synchn/a none100% File Generation none none100% Total 5 hours90% Additional 1.5 hour reduction “hot patching” translation. FunctionUS GermanReduction File system update nonenone100% Database update 5 hours none90% MultiLingual Synchn/a none100% File Generation none none100% Total 5 hours90% Additional 1.5 hour reduction “hot patching” translation.

24. 11i Patch Process Enhancements 50% step reduction in 11.5.9 Recreate Grants and Synonyms Compile Apps Schema Maintain MRC Compile Java Server Pages Compile Flexfield Data ² Gather Schema Statistics ¹ ² Generate Message Files ¹ Run multiple patch drivers ¹ 45% reduction in product steps ¹ ¹Maintenance Pack only ²Concurrent Request 50% step reduction in 11.5.9 Recreate Grants and Synonyms Compile Apps Schema Maintain MRC Compile Java Server Pages Compile Flexfield Data ² Gather Schema Statistics ¹ ² Generate Message Files ¹ Run multiple patch drivers ¹ 45% reduction in product steps ¹ ¹Maintenance Pack only ²Concurrent Request

25. 11i Quality Improvements (#1)  Generated database drivers  Internal standards compliance checker – Automatically checks over 200 standards  SQL Repository – Parses over 400,000 SQL statements per release – Explain plans created against 5 volume databases  Automated testing – WinRunner based infrastructure – 400% increase in coverage

26. 11i Quality Improvements (#2)  Release Engineering process changes – Earlier testing of  Product integration  Pseudo-translations – Additional pre-release testing of  Translations (by countries)  OCS business flows  EBSO customer business flows  Internal production instances  Release Engineering Internal Early Access Program

27. 11i Translation Improvements  Simultaneous release of all languages for: – Maintenance Packs – Family Packs/Minipacks  Translation escalation process – Usually available next day  Merged translations – Immediate availability with no translation regression  Translation quality improvements – 97% reduction in translation bugs 2001 - 2003

28. Configuration Management OAM Context Editor AutoConfig Rapid Install config.txt Applications Context File.xml Applications Configuration Templates Generated Configuration Files jserv.properties appsweb.cfg httpd.conf Generated Database Updates APPS_WEB_AGENT ICX_FORMS_LAUNCHER TCF:PORT TCF:HOST

29. Oracle Applications Manager OAM Configuration Context Editor

30. Oracle Applications Manager Configuration History

31. Oracle Applications Manager Compare and Restore Settings

32. Oracle Applications Manager Search Patches

33. Oracle Applications Manager Search Patches – Advanced

34. Oracle Applications Manager Patch Summary

35. Oracle Applications Manager Files Copied by a Patch

36. Oracle Applications Manager Database Driver Actions

37. Oracle Applications Manager File History

38. Oracle Applications Manager Patch Advisor

39. Oracle Applications Manager Create Patch Filter

40. Oracle Applications Manager View Advice

41. Oracle Applications Manager View Patch Details

42. Oracle Applications Manager View Patch Impact

43. Oracle Applications Manager Patch Impact Details

44. MetaLink Patch Search 2.0 Simple Patch Search

45. MetaLink Patch Search 2.0 Product/Family Search

46. MetaLink Patch Search 2.0 Saved Search

47. MetaLink Patch Search 2.0 Advanced Search

48. MetaLink Patch Search 2.0 Product Name Search

49. MetaLink Patch Search 2.0 Product Hierarchy Search

50. MetaLink Patch Search 2.0 Search Results

51. MetaLink Patch Search 2.0 Saved Searches

52. MetaLink Patch Search 2.0 Superseded Patch Details

53. MetaLink Patch Search 2.0 Quick Links

54. MetaLink Patch Search 2.0 Quick Links Mouseover

55. MetaLink Patch Search 2.0 Server/Tools Quick Links

56. Maintenance Initiatives

57. MetaLink Patch Search  Improved flow to download patches  Automated notifications  Translation escalation/merge requests  Electronic Product Delivery

58. Install/Cloning Technology  Rapid Install “-techstack” option – RDBMS 9.2.0.3 / 9.2.0.4  RAC Install  Complex cloning – Multi-node to single-node – RAC support  iSetup Integration

59. Patching Enhancements  Parallel index creation  In progress patch status  Improved patch reporting  Improved Patch Advisor  Additional impact analysis  Eliminate MRC schema  Concurrent AD sessions

60. CP A, BWeb A, BForms A, B Admin Multi-Node Environment One Admin Node Two Forms Nodes Two Web Nodes Two Concurrent Processing Nodes Not using Shared APPL_TOP

61. CP A, BWeb A, BForms A, B Admin 1) C driver on Admin node 2) C driver on Forms node A 3) C driver on Forms node B 4) C driver on Web node A 5) C driver on Web node B 6) C driver on CP node A 7) C driver on CP node B 8) D driver on Admin node 9) G driver on Forms node A 10) G driver on Forms node B 11) G driver on Web node A 12) G driver on Web node B 13) G driver on CP node A 14) G driver on CP node B Standard AD

62. CP A, BWeb A, BForms A, B Admin 1) C driver on ALL nodes simultaneously 2) D driver on admin node and G driver on all nodes simultaneously AD Concurrent Sessions

63. Linux Migration Utility  Quickly (~8 hours) and easily (~9 steps) migrate middle-tier to Linux  Can cut over with only a few minutes of downtime  Retains current patch level  Retains many customizations  Includes tech stack upgrade

64. Linux Migration Utility Old System (Windows/Unix) New Linux Middle Tier ARU/MetaLink Rapid Install Techstack CDs Generic files Tech stack Port-specific files

65. Long-term Initiatives  Fully Distributed AD  “Pre-downtime” patching – Schema Clone to pre-stage PL/SQL and view changes  Granular linking & generation  Manual step infrastructure  AutoConfig Integration with OEM

66. For more Information… MetaLink Information Note ID Cloning Oracle Applications 11i 230672.1 Using Autoconfig 165195.1 Oracle Applications Manager 166762.1 Using a Shared APPL_TOP 233428.1 Distributed AD 236469.1 Using a Staged APPL_TOP 242480.1 Linux Migration Utility 238276.1 Maintaining Apps FAQ ( coming soon) MetaLink Information Note ID Cloning Oracle Applications 11i 230672.1 Using Autoconfig 165195.1 Oracle Applications Manager 166762.1 Using a Shared APPL_TOP 233428.1 Distributed AD 236469.1 Using a Staged APPL_TOP 242480.1 Linux Migration Utility 238276.1 Maintaining Apps FAQ ( coming soon)

67. A Q & Q U E S T I O N S A N S W E R S