1. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.1 Here We Go Again! Upgrading to 11.5.10 Jeff Slavitz Computer Creations Inc. Jeff@OracleAppsPro.com (415) 388-3003

2. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.2 Planning an upgrade Staging Rapid Install Installing the Vision database Upgrading using the Maintenance Pack Lessons learned Questions Agenda

3. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.3 Planning the Upgrade Check required operating system patches Review Maintenance Pack Installation instructions, Metalink note 259484.1 Develop upgrade and problem blog Request LOTS of disk space for intermediate backups

4. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.4 Plan the Upgrade Timetable Plan on a minimum of three test upgrades Testing How long will it take? Determine the best Production downtime window Document customizations Plan major milestone dates

5. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.5 Technology Stack Decisions Minimum for Maintenance Pack Rapid Install Oracle 9.2.0.4Oracle 9.2.0.5 9iAS 1.0.2.2.2 JDK 1.3.1JDK 1.4.2 JInitiator 1.1.8.16JInitiator 1.3.1.18 Discoverer 4.1.46Discoverer 4.1.48 Developer 6.0.8.24

6. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.6 Stage Rapid Install Three ways to stage Rapid Install: Rapid Install manual – use adautostg.pl OR manually copy Rapid Install from 11.5.10 media –Copy Start Here – Disk 1 to stage/startCD –Copy APPL_TOP Disk 1 – 2 to stage/oraApps –Copy RDBMS – Disk 1 to stage/oraDB –Copy Tools – Disk 1 to stage/oraiAS –Copy Databases – Disk 1-3 to stage/oraAppsDB

7. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.7 Stage Rapid Install OR use electric download, Metalink note 287281.1 –Download zip files –Unzip files as for manual copy Apply latest Rapid Install patch, currently 4132885

8. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.8 Installing the Vision Database Follow Oracle Applications Installation manual Disk space requirement: 86 gig 9.2.0.5 Oracle Home3 gig APPL_TOP COMMON_TOP 8.0.6 Oracle Home iAS Oracle Home 26 gig Datafiles57 gig

9. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.9 Installing the Vision Database Enable X-windows on your PC In Rapid Install stage area: cd startCD/Disk1/rapidwiz Start Rapid Install: rapidwiz

10. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.10 Installing the Vision Database When prompted to select database, choose Vision Rapid Install does the rest!

11. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.11 The 11.5.10 Maintenance Pack Rapid Install used to install: –Vision –New database and technology stack –Upgrade pre-11i database 11.5.10 Maintenance Pack, patch 3140000 –Used to upgrade an existing 11i instance –11.5.10 Install media or download from Metalink Maintenance Pack instructions, Metalink note 259484.1

12. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.12 Maintenance Pack Overview Pre-Upgrade steps –AD minipack I.1 –Latest AutoConfig template –Configure database for new products and tablespace requirements –Technology stack upgrade –Many smaller patches Apply patch 3140000 Post-upgrade steps

13. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.13 Technology Stack Upgrade Technology Stack Validation Utility –Run on database and all application tiers –Must pass all checks before upgrading! Install new technology stack: –Manually –Rapid Install techstack option

14. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.14 Technology Stack Decisions Minimum for Maintenance Pack Rapid Install Oracle 9.2.0.4Oracle 9.2.0.5 9iAS 1.0.2.2.2 JDK 1.3.1JDK 1.4.2 JInitiator 1.1.8.16JInitiator 1.3.1.18 Discoverer 4.1.46Discoverer 4.1.48 Developer 6.0.8.24

15. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.15 Rapid Install Tech Stack Installs 9.2.0.5 Oracle Home Installs 9iAS 1.0.2.2.2 Oracle Home Installs 8.0.6 Oracle Home You must manually do necessary product upgrade steps Will not install JDK 1.4.2

16. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.16 Rapid Install Tech Stack New tech stack code installed to new path To retain existing tech stack path install it twice. For example: –Original 8.0.6 and iAS ORACLE_HOME at /ora01/PROD/… –Install new tech stack to /ora01/PRODupg –Use new OUI to remove Oracle Home at /ora01/PROD –Install new tech stack again to /ora01/PROD –Use OUI to remove tech stack at /ora01/PRODupg

17. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.17 Rapid Install Tech Stack From stage area: rapidwiz –techstack For details, Rapid Install manual chapter 5

18. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.18 Upgrading JDK and JInitiator Oracle recommends using JDK 1.4.2 with 11.5.10 Download JDK 1.4.2 for your operating system, Metalink note 130091.1 Upgrade to JInitiator 1.3.1 using Metalink note 124606.1 Requires users to download new JInitiator

19. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.19 Tips for Applying Maintenance Pack Correct errors found by pre-upgrade validation scripts Turn off custom triggers and applications before applying patch 3140000 Save time and apply custom AutoConfig changes after upgrade is complete Work in parallel with Oracle Support

20. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.20 Tips for Applying Maintenance Pack Skip adpatch workers that fail for applications you are not using Open a tar to confirm no cross-application issues Manually re-run script that failed when problem resolved

21. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.21 Skipping Adpatch Workers Select option 8 on adctrl menu to skip adpatch workers

22. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.22 Hung Adpatch Workers Most workers end in a few minutes. If one runs abnormally long it may be hung. Confirm with ‘top’ Use adctrl option 3 to shutdown all workers Hung workers will not shutdown kill -9 `ps –ef | grep adwork | cut –c 9-14` You may also need to kill adpatch job

23. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.23 Hung Adpatch Workers Hung workers still show status of ‘Running’ Use adctrl option 4 to fail all jobs Then adctrl option 2 to restart all failed jobs Restart adpatch

24. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.24 Maintenance Pack Problems Adpatch.log: FAILED: file MTL_COPY_ORG_REPORT_TEMP.xdf Adworker.log: Error in executing statement ALTER TABLE INV.MTL_COPY_ORG_REPORT_TEMP MODIFY... ORA-00600: internal error code, arguments: [25012], [68], [0], [], [], [], [], [] Work-around is to set "_disable_multiple_block_sizes" = true in the database init.ora

25. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.25 Maintenance Pack Problems Adpatch.log: FAILED: file aftcm049.sql Adworker.log: ORA-20000: Oracle Error Mkr4= -904 ORA-00904: "RULESET_NAME": invalid identifier Problem caused by Advanced Queue corruption that occurs when upgrading to 9.2.0.x from 8.1.7.x. Follow note 231074.1 and run the three patch scripts provided.

26. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.26 Maintenance Pack Problems For errors uploading.ldt files, upload manually using adodfcmp: adodfcmp userid=jtf/xxx touser=apps/xxx priv_schema=system/xxx changedb=yes mode=tables odffile=xxx.odf logfile=xxx Specifying ‘changedb=no’ will show changes without making them

27. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.27 Maintenance Mode New feature with 11.5.10/AD.I Adpatch requires maintenance mode Use adadmin option 5

28. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.28 Maintenance Mode

29. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.29 Maintenance Mode Be sure to disable Maintenance Mode or users cannot login to Financials

30. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.30 Adpatch Hotpatch If you want to apply a patch without enabling maintenance mode and disabling user access: adpatch options=hotpatch The Maintenance Utilities manual indicates this causes severe performance degradation

31. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.31 Helpful Tips Transfer setups between instances using FNDLOAD, Metalink note 274667.1 –Concurrent program definitions –Responsibilities –Menus –Profile Options –Value Sets –And more!

32. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.32 Pre-Compiling JSPs Java Server Pages (JSP) compiled when user first accesses a page May result in noticeable delay Perceived as ‘performance’ problem Pre-compile all or first used JSPs

33. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.33 Pre-Compiling JSPs Compiled JSPs normally stored on web tier at $OA_HTML/_pages/_oa__html Unix command ‘ls –ltr’ shows: –Pages used –Order pages are compiled Use ojspCompile.sh as explained in Metalink note 215268.1

34. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.34 Pre-Compiling JSPs Compile JSPs using a regular expression $JTF_TOP/admin/scripts/ojspCompile.pl --compile -s \ 'OA%' -log $LOGFILE --flush $JTF_TOP/admin/scripts/ojspCompile.pl --compile -s \ 'Apps%' -log $LOGFILE --flush Compile an individual JSP $JTF_TOP/admin/scripts/ojspCompile.pl --compile -s \ 'jtflogin.jsp' -log $LOGFILE --flush

35. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.35 Managing AutoConfig AutoConfig re-writes: –Oracle 9i init.ora, tnsnames.ora, listener.ora, sqlnet.ora –Oracle 8.0.6 listener.ora, tnsnames.ora Make your system AutoConfig independent using ifiles: –ifile last line in above files –ifile name defined in context file

36. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.36 OATM Convert database to Oracle Application Tablespace Model. See Metalink note 248857.1 –Reduces over 300 datafiles to 12 –Saves a lot of disk space! –Easier to manage –Migrate tablespaces incrementally –Large tablespaces can take a LONG time to migrate

37. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.37 Summary Spend the time to plan your upgrade before starting it Long for the days of \ Row Erase? Keep careful notes of what you’ve done Use the tools Oracle provides to make your system easier to upgrade and maintain

38. 03/07/05 NorCal OAUG Training Day Paper v1.0 Jeff Slavitz, Computer Creations Inc.38 Questions? Other tips and techniques? Feel free to email or call me … Jeff Slavitz Jeff@OracleAppsPro.com (415) 388 - 3003