Presentation is loading. Please wait.

Presentation is loading. Please wait.

© 2005 IBM Corporation IMS Tools ………Reorganization Janet LeBlanc Silicon Valley Lab

Similar presentations


Presentation on theme: "© 2005 IBM Corporation IMS Tools ………Reorganization Janet LeBlanc Silicon Valley Lab"— Presentation transcript:

1 © 2005 IBM Corporation IMS Tools ………Reorganization Janet LeBlanc Silicon Valley Lab

2 IMS Tools – Overview / Mission Overview –DM Tools is unique business model within IBM –Operates as entrepreneurial business –High focus on return on investment / profitability –Customer requirements driven Mission –Deliver IMS based solutions that: Are profitable to IBM Meet customer expectations and needs

3 IMS Tools – New Products, Versions, Releases

4 IBM Application Recovery Tool for IMS and DB2 Databases IMS Database Recovery Facility IMS DataPropagator MS DEDB Fast Recovery IMS High Perf Image Copy IMS High Perf Change Accumulation MS Batch Terminal Simulator IMS Batch Backout Manager IMS Connect Extensions IMS MFS Reversal Utilities IMS Program Restart Facility Fast Path IMS High Performance Fast Path Utilities Full Function IMS High Performance Load, IMS High Performance Pointer Checker IMS High Performance Prefix Resolution IMS High Performance Unload IMS Index Builder IMS Parallel Reorganization IMS Online Reorganization Facility Administration IMS Database Control Suite IMS Command Control Facility IMS ETO Support IMS HP Sysgen Tools IMS Queue Control Facility IMS Workload Router IBM Data Encryption for IMS and DB2 Databases IMS Database Repair Facility IMS HALDB Conversion and Maintenance Aid IMS HD Compression- Extended IMS Library Integrity Utilities IMS Parameter Manager IMS Sequential Randomizer Generator IMS Buffer Pool Analyzer IMS Network Compression Facility IMS Performance Analyzer IMS Problem Investigator IMS Sysplex Manager IBM Tivoli OMEGAMON XE for IMS Data Base Administration Utility ManagementRecovery Management End to End Management Performance Management IMS DATA BASE TOOLS Application ManagementTM Management

5 IMS Tools – Utilities Management Fast Path –IMS High Performance Fast Path Utilities Full Function –IMS High Performance Load –IMS High Performance Unload –IMS Index Builder –IMS High Performance Prefix Resolution –IMS Parallel Reorganization –IMS Online Reorganization Facility –IMS High Performance Pointer Checker Administration –IMS Database Control Suite Data Base Administration Utility ManagementRecovery Management End to End Management Performance Management IMS DATA BASE TOOLS Application ManagementTM Management

6 IMS High Performance Fast Path Utilities High Performance FP Advanced Reorganization Tool DEDB Unload/Reload DEDB Analyze DEDB Change Fast Path Basic Tools DEDB Unload/Reload DEDB Pointer Checker DEDB Tuning Aid Fast Path Online Tools Online Pointer Checker Online Data Extract Online Area Extender

7 z/OS IMS Online IMS Control Region IMS Dependent Region IMS High Performance Fast Path Utilities Fast Path Utility Region FP Online Tools Online Pointer Checker Online Data Extract Online Area Extender OS Batch FP Basic Tools DEDB Unload/Reload DEDB Pointer Checker DEDB Tuning Aid FP Advanced Tool DEDB Unload/Reload DEDB Analyze DEDB Change IMS HPFP Utilities

8 Highlights of FP Advanced Tool JCL ease of use –Increase the productivity of database support personnel Minimize steps for completing database Analyze, Change, Reload and Unload Minimize DD statements Single driver program with command language Integrity with IMS –Increase the application availability –Multiple area data sets (ADSs) support High performance –Reduce the consuming time for the maintenance and database conversion

9 JCL ease of use : Minimize JCL DD statements FP Advanced Tool dynamically allocates : –DEDB area data sets for Input of the analyze, change, and unload process Output of the reload and change process (with space allocation) –ACB libraries –DBRC RECON data sets –Data sets of unloaded segment records for Output of the unload process Input of the reload process –HFPPRINT data set –HFPRPTS data set –SORT work data sets Above DD statements are no longer required in JCL! Operators need not care about these data set allocations !

10 JCL ease of use : Command language Single driver program with unified command language for all functions Simplified JCL structure //HFP EXEC PGM=HFPMAIN0 //HFPSYSIN DD * GLOBAL DBRC=YES UNLOAD DBD=DEDBJN22 /* //HFP EXEC PGM=HFPMAIN0 //HFPSYSIN DD * GLOBAL DBRC=YES UNLOAD DBD=DEDBJN22 /* //HFP EXEC PGM=HFPMAIN0 //HFPSYSIN DD * GLOBAL DBRC=YES ANALYZE DBD=DEDBJN22 /* //HFP EXEC PGM=HFPMAIN0 //HFPSYSIN DD * GLOBAL DBRC=YES ANALYZE DBD=DEDBJN22 /* //HFP EXEC PGM=HFPMAIN0 //HFPSYSIN DD * GLOBAL DBRC=YES RELOAD DBD=DEDBJN22 /* //HFP EXEC PGM=HFPMAIN0 //HFPSYSIN DD * GLOBAL DBRC=YES RELOAD DBD=DEDBJN22 /* //HFP EXEC PGM=HFPMAIN0 //HFPSYSIN DD * GLOBAL DBRC=YES CHANGE DBD=DEDBJN22 /* //HFP EXEC PGM=HFPMAIN0 //HFPSYSIN DD * GLOBAL DBRC=YES CHANGE DBD=DEDBJN22 /*

11 JCL ease of use : Command language Simple language structure –Commands ANALYZE CHANGE GLOBAL RELOAD UNLOAD –Subcommands ALLOCATE FILECTL IRENAME LOADCTL REPORT THRESHOLD – Keywords many…

12 JCL ease of use : Command language Nice features –Advanced data set name specification Masks can be used for data set names e.g.) IMSVS.USERFILE.&AREA Generate data set groups (GDG) –Command syntax check without run GLOBAL SCAN=YES

13 High performance : Technical topics Reduce I/O and CPU –Internal sort No SORTIN and SORTOUT I/O for sorting –MMcall Asynchronous I/O Concurrent processing of multiple UOWs –Data space For IOVF and SDEP Multi-tasking –Parallel processing for multiple DEDB areas Multiple subtasks for analyze, change, reload, and unload –The number of concurrent processes can be specified by control statement

14 Unload/Reload/Change functions Unload: –Unloads a single DEDB area or multiple DEDB areas to QSAM data sets Reload: –Reloads a single DEDB area or multiple DEDB areas from QSAM data sets If necessary, the analyze function can be included in the reload process Change: –Reorganizes or restructures a single DEDB or multiple DEDB areas with single job step If necessary, the analyze function can be included in the change process

15 Unload/Reload/Change: Minimize manual steps Fast Path Basic Tools Unload/Reload EXEC steps RELOAD OLD ACB library OLD AREAS UNLOAD (one job) (multi-task) RELOAD (one or multiple jobs) (single task) SORT (optional) (NEW ACB library) Sort Control data set IOVF Work data set or data space (SDEP Work data set) IDCAMs DELETE/ DEFINE DBRC utility Set RN on Control statements (NEW Randomizer) RECON IC REORGANIZED AREAS

16 IOVF/SDEP Work data set or data space Unload : Minimize manual steps RELOAD (one job) (multi-task) Sort Control data set (SDEP Work data set) IDCAMs DELETE/ DEFINE DBRC Utility Set RN on Control Statements IC RECON SORT (optional) OLD ACB library OLD AREAS (NEW ACB library) Control statements (NEW randomizer) UNLOAD (one job) (multi-task)1 HPFP Unload

17 (SDEP Work data set) IC Reload : Minimize manual steps Sort Control data set HPFP Reorganization Tool Unload/Reload EXEC steps SORT (optional) OLD ACB Library OLD AREAS (NEW ACB Library) Control Statements (NEW Randomizer) UNLOAD (one job) (multi-task) RECON RELOAD (one job) (multi-task) IOVF/SDEP Work data set or data space Control statements IDCAMs DELETE/ DEFINE DBRC utility Set RN on HPFP Reload 2 REORGANIZED AREAS

18 Reorganized AREAs Change: Minimize manual steps HPFP Reorganization Tool Change EXEC Step for reorganization RECON ACB library Old AREAs HFPSYSIN Change (one job) (multi-task) SORTIDCAMS Reload Unload Buffer

19 Restructured AREAs Change: Minimize manual steps HPFP Reorganization Tool Change EXEC step for restructuring RECON Old ACB library Old AREAs Change New ACB library (NEW Randomizer) SORTIDCAMS Reload Unload Buffer HFPSYSIN

20 RAP Reload/Change: Place certain segments into overflow CIs DOVF BASE IOVFSDEP DEDB AREA ROOT DD1 DD2 DD1 //HFP EXEC PGM=HFPMAIN0 //HFPSYSIN DD * RELOAD DBD=DEDBJN22 LOADCTL SEGMENT=DD2,LOCATION=IOVF /* //HFP EXEC PGM=HFPMAIN0 //HFPSYSIN DD * RELOAD DBD=DEDBJN22 LOADCTL SEGMENT=DD2,LOCATION=IOVF /* The LOADCTL subcommand controls the place to insert dependent segments, which is either DOVF or IOVF.

21 Sample JCLs You can see: –How easy JCL are –Examples of control statements 4 sample JCLs –Unload an area registered with DBRC –Reload an area registered with DBRC –Reorganize an area registered with DBRC –Restructure an area registered with DBRC

22 //HFPUNL EXEC PGM=HFPMAIN0 //STEPLIB DD DISP=SHR,DSN=HFP220.SHFPMOD0 // DD DISP=SHR,DSN=IMSVS.SDFSRESL // DD DISP=SHR,DSN=IMSVS.PGMLIB //IMSACB DD DISP=SHR,DSN=IMSVS.ACBLIB //IMSDALIB DD DISP=SHR,DSN=IMSVS.MDALIB //HFPRPTS DD SYSOUT=* //HFPPRINT DD SYSOUT=* //HFPSYSIN DD * GLOBAL DBRC=YES UNLOAD DBD=DEDBJN22, IAREA=(DB22AR0), OAREA=(DB22AR0), ODSNMASK=IMSVS.USRFILE.&AREA /* //HFPUNL EXEC PGM=HFPMAIN0 //STEPLIB DD DISP=SHR,DSN=HFP220.SHFPMOD0 // DD DISP=SHR,DSN=IMSVS.SDFSRESL // DD DISP=SHR,DSN=IMSVS.PGMLIB //IMSACB DD DISP=SHR,DSN=IMSVS.ACBLIB //IMSDALIB DD DISP=SHR,DSN=IMSVS.MDALIB //HFPRPTS DD SYSOUT=* //HFPPRINT DD SYSOUT=* //HFPSYSIN DD * GLOBAL DBRC=YES UNLOAD DBD=DEDBJN22, IAREA=(DB22AR0), OAREA=(DB22AR0), ODSNMASK=IMSVS.USRFILE.&AREA /* Unloading an area registered with DBRC

23 //HFP EXEC PGM=HFPMAIN0 //STEPLIB DD DISP=SHR,DSN=HFP220.SHFPMOD0 // DD DISP=SHR,DSN=IMSVS.SDFSRESL // DD DISP=SHR,DSN=IMSVS.PGMLIB //IMSACB DD DISP=SHR,DSN=IMSVS.ACBLIB //IMSDALIB DD DISP=SHR,DSN=IMSVS.MDALIB //HFPRPTS DD SYSOUT=* //HFPPRINT DD SYSOUT=* //HFPSYSIN DD * GLOBAL DBRC=YES RELOAD DBD=DEDBJN22, IAREA=(DB22AR0), IDSNMASK=IMSVS.USRFILE.&AREA', OAREA=(DB22AR0) /* //HFP EXEC PGM=HFPMAIN0 //STEPLIB DD DISP=SHR,DSN=HFP220.SHFPMOD0 // DD DISP=SHR,DSN=IMSVS.SDFSRESL // DD DISP=SHR,DSN=IMSVS.PGMLIB //IMSACB DD DISP=SHR,DSN=IMSVS.ACBLIB //IMSDALIB DD DISP=SHR,DSN=IMSVS.MDALIB //HFPRPTS DD SYSOUT=* //HFPPRINT DD SYSOUT=* //HFPSYSIN DD * GLOBAL DBRC=YES RELOAD DBD=DEDBJN22, IAREA=(DB22AR0), IDSNMASK=IMSVS.USRFILE.&AREA', OAREA=(DB22AR0) /* Reloading an area registered in DBRC PTRCHKLVL=FULL REPORT /*

24 Reorganizing an area registered in DBRC //HFP EXEC PGM=HFPMAIN0 //STEPLIB DD DISP=SHR,DSN=HFP220.SHFPMOD0 // DD DISP=SHR,DSN=IMSVS.SDFSRESL // DD DISP=SHR,DSN=IMSVS.PGMLIB //IMSACB DD DISP=SHR,DSN=IMSVS.ACBLIB //IMSDALIB DD DISP=SHR,DSN=IMSVS.MDALIB //IAREA001 DD DISP=SHR,DSN=HPFP.OLD.DB22AR0.ADS1 //HFPRPTS DD SYSOUT=* //HFPPRINT DD SYSOUT=* //HFPSYSIN DD * GLOBAL DBRC=YES CHANGE DBD=DEDBJN22, IAREA=(DB22AR0), OAREA=(DB22AR0) /* //HFP EXEC PGM=HFPMAIN0 //STEPLIB DD DISP=SHR,DSN=HFP220.SHFPMOD0 // DD DISP=SHR,DSN=IMSVS.SDFSRESL // DD DISP=SHR,DSN=IMSVS.PGMLIB //IMSACB DD DISP=SHR,DSN=IMSVS.ACBLIB //IMSDALIB DD DISP=SHR,DSN=IMSVS.MDALIB //IAREA001 DD DISP=SHR,DSN=HPFP.OLD.DB22AR0.ADS1 //HFPRPTS DD SYSOUT=* //HFPPRINT DD SYSOUT=* //HFPSYSIN DD * GLOBAL DBRC=YES CHANGE DBD=DEDBJN22, IAREA=(DB22AR0), OAREA=(DB22AR0) /* PTRCHKLVL=FULL REPORT /*

25 Restructuring an area registered in DBRC //HFP EXEC PGM=HFPMAIN0 //STEPLIB DD DISP=SHR,DSN=HFP220.SHFPMOD0 // DD DISP=SHR,DSN=IMSVS.SDFSRESL // DD DISP=SHR,DSN=IMSVS.PGMLIB //OLDACB DD DISP=SHR,DSN=IMSVS.OLDACB //IMSACB DD DISP=SHR,DSN=IMSVS.ACBLIB //IMSDALIB DD DISP=SHR,DSN=IMSVS.MDALIB //IMSRESLB DD DISP=SHR,DSN=IMSVS.SDFSRESL //IAREA001 DD DISP=SHR,DSN=HPFP.OLD.DB22AR0.ADS1 //HFPRPTS DD SYSOUT=* //HFPPRINT DD SYSOUT=* //HFPSYSIN DD * GLOBAL DBRC=YES CHANGE DBD=DEDBJN22, IAREA=(DB22AR0), OAREA=(DB22AR0) /* //HFP EXEC PGM=HFPMAIN0 //STEPLIB DD DISP=SHR,DSN=HFP220.SHFPMOD0 // DD DISP=SHR,DSN=IMSVS.SDFSRESL // DD DISP=SHR,DSN=IMSVS.PGMLIB //OLDACB DD DISP=SHR,DSN=IMSVS.OLDACB //IMSACB DD DISP=SHR,DSN=IMSVS.ACBLIB //IMSDALIB DD DISP=SHR,DSN=IMSVS.MDALIB //IMSRESLB DD DISP=SHR,DSN=IMSVS.SDFSRESL //IAREA001 DD DISP=SHR,DSN=HPFP.OLD.DB22AR0.ADS1 //HFPRPTS DD SYSOUT=* //HFPPRINT DD SYSOUT=* //HFPSYSIN DD * GLOBAL DBRC=YES CHANGE DBD=DEDBJN22, IAREA=(DB22AR0), OAREA=(DB22AR0) /*

26 Reorganization Toolsets …Two Integrated IMS Tools choices Reorg Utility Set Parallel Reorg HP Unload HP Load Index Builder HP Prefix Resolution HP Image Copy HP Pointer Checker Program Restart Facility Online Reorg Utility Set Online Reorg Facility HP Unload HP Load HP Prefix Resolution HP Image Copy HP Pointer Checker Program Restart Facility

27 HP Unload –Unloads HDAM, HIDAM, HISAM and SHISAM databases With IMS V7, support of the new HALDB database types PHDAM, PHIDAM –Provides an IMS application program interface For stand-alone batch program Assembler, COBOL, or PL/1 Transparent to programmer –Contains a high-performance DB retrieval engine The HSSR Engine High speed buffering technique similar to OSAM SB Different from DL/I Buffering Sequential Subset Randomizer –Creates randomizing module for fast sequential processing of record subset –Allows physical clustering of database records in same subset IMS High Performance Unload v E06

28 IMS HP Unload in the Reorganization Process Database unload utilities –Unload a database in compressed or uncompressed format –Unload a broken HIDAM, HDAM, or HISAM database Skip invalid HD pointers or invalid records –Create unloaded sequential data sets for use by application programs Multiple unload formats –Use dynamic allocation of DB datasets Easy to read output reports and statistics –DB statistics report or Randomizing statistics report Pre-tuned with defaults that should be adequate for most databases Full support for HALDB –Unload one, several or all partitions –Migration/fallback support –New function for user exit FABHEXTR Specify that n records are to be unloaded from each HALDB Partition –PARTEXTR control statement

29 > 71% reduction in elapse time > 92% reduction in CPU time (over base IMS load utility) IMS High Performance Load v M26 HP Load Utility – Performance replacement of IMS HD Reorganization Load utility (DFSURGL0) –Complement to IMS High Performance Unload Tool compressed/uncompressed input in various formats dynamic allocation of DB datasets –Full support for HALDB –Self Optimization Except for DATASPACE option where the default is N and use of Y is better –SORT=YES Integrated Load SORT HDAM Physical Sequence Sort for Reload (PSSR) Utility –Previously in DBTools SMU –Sorts the unloaded database data set before reload Used with HALDB, when changing partition boundaries during reorg –Avoids cascading on Reload New

30 IMS HP Load in the Reorganization Process Support of IMS HDAM, HIDAM, PHDAM and PHIDAM databases –Supports reloading of compressed segments without calling compression routine –Initializes empty HDAM and HIDAM databases DFSUINPT DD Dummy statement –SEQERROR=ACCEPT option Support of HISAM and SHISAM thru maintenance –DB Reload and DB Initialisation Support of logical relationship or secondary indexes –Creates a DFSURWF1 data set that can be used by: Index Builder (IB) product IMS High Performance Prefix Resolution IMS Prefix Resolution utility (DFSURG10) Support of HALDB –Automatically initializes HALDB partition data set before reload –Provides a performance replacement for IMS Partition Initialization Utility –Creates ILDS –When changing partition boundaries during reorg of HALDB PSSR may be used prior load to sort segments by RAP within partitions for PHDAM.

31 IMS HP Load in the Reorganization Process... User exit facility for additional processing of each segment –Assembler, COBOL or PL/1 –Edit segment –Delete segment (or this and subsequent segments of DB record) –Force segment into overflow (HDAM or PHDAM) –Force segment to start new block (HIDAM or PHIDAM) Load API –Used in application for intial load processing Bitmap Resetter –Adjust the bitmap of HDAM/HIDAM/PHDAM/PHIDAM database to accommodate denser packing of the database blocks. Statistics reports to aid in tuning the database –Reporting on space use and segment pointer statistics New

32 IMS HP Prefix Resolution v M27 Enables you to resolve and update prefixes of IMS databases involved in logical relationships as a single job step Functions: –Eliminates the WF2 and WF3 data sets –Executes prefix resolution and prefix update functions as replacements for the existing IMS Prefix Resolution and IMS Prefix Update utilities –Supports IMS Parallel Reorganization, V3 single job step execution of database reorganization, prefix resolution, and prefix update tasks Your Value: –Better performance and faster running prefix resolution and prefix updates –Significant performance improvements when used in place of existing IMS utilities –Use to maintain all logically related IMS databases and is required after the databases are loaded or reorganized

33 To rebuild indices after reorganization process To recover damaged secondary indices and avoid full reorganization process To avoid taking IC of secondary indices To minimize elapsed time.... Support for Full-Function non-partitioned DB and HALDB –Easy-to-use one step procedure Creating New Secondary Indexes Rebuilding Secondary Indexes –Using as input output from initial load or reload after a reorg (DFSURWF1) –Using as input a DL/I scan of the IMS database –Using as input the output from prefix resolution (DFSURIDX) Creating Input for IMS HP Prefix Resolution –Split Function Initializing Empty Secondary Indexes Rebuilding a HIDAM Primary Index Using IMS IB for Recovery of Secondary Indices –Change in the GENJCL.RECOV skeleton IMS Index Builder - Major Functions

34 IMS Parallel Reorganization IPR is an umbrella product or higher level framework for execution of the following tools –IMS High Performance Unload –IMS High Performance Load –IMS Index Builder –IMS High Performance Image Copy –IMS High Performance Pointer Checker Functions are –Parallel reorganization –High Speed alternative to serial use of HP Unload –High Speed alternative to serial use of HP Load –Enhanced Data Base Scan (for logical relationships) using HP Unload IMS Parallel Reorganization provides the infrastructure to operate the reorganization utilities in parallel (or independently), allowing a significant reduction in the reorganization time. New Version

35 Sep. 21 Announcement Single Step Execution IMS Tools New Versions/Release IPR Driver V3 DB (Shadow) Sec. Index (Shadow) DB Secondary Index Reports and DB Statistics DB Admin Index Image Copies Database Image Copy Online Read Access Database Health Check Concurrent Database Backup Automated DBRC Processing New in v3 New in V3 IPR Driver V3 – Big Picture Prefix Update for Internal Logical Relationship New in V3 - IMS Parallel Reorganization V3 - IMS High Performance Unload V1 - IMS High Performance Load V2 - IMS Index Builder V2.3 - IMS High Performance Image Copy V3.2 - IMS High Performance Pointer Checker V2 - IMS High Performance Prefix Resolution V3

36 IPR Driver V3 Functions Stopping the database or making it read-only before reorg –IMS /DBR or /DBD DATABASE command is issued by IPR Driver Reorganizing database data sets into shadow data sets –Unload, Reload, and Index-Builder tasks run concurrently –Image copies can be taken during reorg, with optional HASH pointer check Type-A Image Copy Updating segment prefixes after the database reload –For the database that has internal logical relationship Concurrent Prefix Update Taking image copies with optional HASH check after the prefix update Type-B Image Copy Stopping the database at the completion of READ-ONLY reorg –IMS /DBR DATABASE command is issued by IPR Driver Performing post-reorganization process –Original and shadow data sets names are swapped –DBRC is notified of the reorg completion and the image copy New

37 //IPR EXEC PGM=HPSGMAIN,PARM='DBD=SAMPLEDB,DBRC=Y' //STEPLIB DD DISP=SHR,DSN=TOOLS.LIBRARY // DD DISP=SHR,DSN=IMS.SDFSRESL //IMS DD DISP=SHR,DSN=IMS.DBDLIB //IMSDALIB DD DISP=SHR,DSN=IMS.DALIB //DFSURCDS DD DISP=SHR,DSN=DFSURCDS //DFSURWF1 DD DISP=(NEW,PASS,DELETE),DSN=&&DFSURWF1, // UNIT=SYSALLDA,SPACE=(CYL,(n,m)), // DCB=(RECFM=VB,LRECL=800,BLKSIZE=2400) //HPSIN DD * (REORG) IMSCMD=YES DBSHARE=YES IC=YES INDEXBLD=YES NAMESWAP=YES PREFIXRES=YES DELOLDDS=YES (PREFIXRES) UPDLPC=NO /* //ICEIN DD * GLOBAL HDPC=Y,ICHLQ=IMSICA /* //IPR EXEC PGM=HPSGMAIN,PARM='DBD=SAMPLEDB,DBRC=Y' //STEPLIB DD DISP=SHR,DSN=TOOLS.LIBRARY // DD DISP=SHR,DSN=IMS.SDFSRESL //IMS DD DISP=SHR,DSN=IMS.DBDLIB //IMSDALIB DD DISP=SHR,DSN=IMS.DALIB //DFSURCDS DD DISP=SHR,DSN=DFSURCDS //DFSURWF1 DD DISP=(NEW,PASS,DELETE),DSN=&&DFSURWF1, // UNIT=SYSALLDA,SPACE=(CYL,(n,m)), // DCB=(RECFM=VB,LRECL=800,BLKSIZE=2400) //HPSIN DD * (REORG) IMSCMD=YES DBSHARE=YES IC=YES INDEXBLD=YES NAMESWAP=YES PREFIXRES=YES DELOLDDS=YES (PREFIXRES) UPDLPC=NO /* //ICEIN DD * GLOBAL HDPC=Y,ICHLQ=IMSICA /* Sample JCL Statements for a Parallel Reorg with Secondary Indexes and Internal Logical Relationships. If IC=YES and PREFIXRES=YES are specified and the database has an internal logical relationship, ICTYPE=B is implicitly set.

38 IMS DB Reorg. – Online Solutions IMS Version 9 HALDB OnLine Reorg. (OLR) –Integrated OnLine Reorganization (OLR) of HALDBs –HALDB OLR provides 100% availability of the largest databases in the world! –OLR provides non-disruptive reorganization of HALDB PHDAM and PHIDAM partitions Concurrent IMS updates are allowed while OLR is active –Scheduled data outage not required IMS Online Reorganization Facility (Tool) –For non-HALDB and HALDB With restrictions –For IMS V7 or above New

39 Reorganization Toolsets …Two Integrated IMS Tools choices Reorg Utility Set Parallel Reorg HP Unload HP Load Index Builder HP Prefix Resolution # HP Image Copy # HP Pointer Checker # Program Restart Facility # Online Reorg Utility Set Online Reorg Facility HP Unload HP Load HP Prefix Resolution HP Image Copy HP Pointer Checker 1 2

40 Features Data sharing environments fully supported Allows DBD changes to be implemented and does not require manual intervention after reorganization –Automatic online change implementation Complete restart-ability once in the Takeover Phase Controlling Takeover –Delay, Abend, Window Interface to PRF/Region controller front-end for pausing BMPs Internal Logical Relationships –HDAM and HIDAM –HALDB All partitions in single job Reorg Index Only –Primary or secondary for non- HALDB –Secondary for HALDB –Can be single partition if PSINDEX Near Online Unload –Create HD Unload data set while DB still online Reorganize a Database while still online

41 Copy Phase Original Primary Database Reorg Phase Unload Reload Rebuild Sec. Indexes PreReorg/Prefix Res/Update Image Copy/Pointer Checker Temporary Unload File IMS Control Region(s) Copy Phase Capture log updates Reorg & Apply Phases Capture application update calls Online Reorg Facility (ORF) Shadow Primary DB & Primary Index Reorganized Shadow DB, Primary & Secondary Indexes Image Copies Apply Phase Takeover Phase /DBR original DB Load new DMB /STA DB Takeover Phase Request /DBR DB DBRC notifications Rename shadows to originals ACBGEN, Online change Request /STA DB Reorganized Database and Indexes Batch LOG Online Reorganization Completed Verification Phase Completion Phase

42 IMS Online Reorganization Facility for z/OS Online Reorganization –DBD Changes permittedDBD Changes permitted –Controlling Takeover PhaseControlling Takeover Phase –Managing BMPs during Takeover PhaseManaging BMPs during Takeover Phase –New FunctionsNew Functions

43 Increased Data Availability –Outage reduced from hours to seconds Minimal Overhead Added to Control Regions Automation of DBA tasks –Single step Reorg Automatic determination of necessary reorganization steps –Same JCL for all databases –Changes implemented across all online systems Better DB performance –Can reorganize when needed Improved DBA Efficiency –No coding/maintenance of IDCAMS statements –No manual intervention required after reorganization process IMS Online Reorganization Facility for z/OS …BENEFITS

44 Reorganization Toolsets …Two Integrated IMS Tools choices Reorg Utility Set Parallel Reorg HP Unload HP Load Index Builder HP Prefix Resolution HP Image Copy HP Pointer Checker Program Restart Facility Online Reorg Utility Set Online Reorg Facility HP Unload HP Load HP Prefix Resolution HP Image Copy HP Pointer Checker

45 © 2005 IBM Corporation IMS Tools ………Whats new and exciting Janet LeBlanc Silicon Valley Lab

46 Additional Slides

47 Reorg Slides

48 Rich in Function …….Unload Formats Unload FormatDescriptionHP UnloadIPR Unload HD/ULHD Unload compatibleYY CSYY F1YY F2YY F3YY HSHSAM Unload compatibleYN VBVariable Block formatYN VNVB + segment nameYN A1NY A2NY A3NY A4NY F6NY SHNY NONo unload dataset createdNY User FormatNY

49 HD/SH Format

50 F1 Format

51 F2 Format

52 F3 Format

53 CS Format

54 A1 Format

55 A2 Format

56 A3 Format

57 A4 Format

58 F6 Format

59 User Header Element NameField Length Field TypeDescription DBDNAME8CharacterDBD Name FILLERnn1-999IntegerNn suffix determines length HDRLEN2BinaryREQ if SEGKEY, SEGCKEY or ROOTKEY used ROOTKEYvariablevariesSequence field of root segment ROOTRBA4BinaryRBA of root segment SEGCKEYVariableVariesConcatenated key SEGCKYSZ2BinaryLength of segment concatenated key SEGCODE1binarySegment code of segment SEGDATSZ2BinaryLength of segment data SEGDBYTE1BinaryDelete byte of segment SEGKEYVariableVariesSequence Field SEGKEYOF2BinaryOffset of segment key SEGKEYSZ2BinaryLength of segment key SEGLEV11BinaryHierarchical level of segment SEGLEV22CharacterHierarchical level of semgnet SEGNAME8CharacterName of Segment SEGRBA4BinaryDatabase RBA of segment

60 Rich in Function ……Multiple DB Type Support Supports reorganization of: –HDAM, –HIDAM, –PHDAM, –PHIDAM, –HISAM and –SHISAM databases

61 Rich in Function ……Compression Support Unload –Options to unload either compressed or uncompressed data Load –Automatic recognition of status of unload data – compressed/uncompressed

62 Rich in Function …..HALDB Support Reorganization: –By Partition –Range of partitions –All partitions Rebuild ILDS Rebuild Secondary Indexes Conversion Support –Unload with migration option Load has integrated partition initialization

63 Rich in Function …..Fault Tolerance Unload –Continue Processing after sequence errors –Handle Corrupt Databases Incorrect HD pointers can be bypassed Processing of incorrect HISAM record can be skipped Root segments of HIDAM or PHIDAM can be processing using Index instead of pointers Load –Reject/Save/Accept Sequence Errors

64 Rich in Function …..User Exits Unload Record Formatting exit & Return Code Edit exit –Assembler, COBOL or PL/1 –Edit segment –5 std record format routines provided Run-Time Environment Exit Buffer Handler Initialization Exit Load User exit facility for additional processing of each segment –Assembler, COBOL or PL/1 –edit segment –delete segment (or this and subsequent segments of DB record) –force segment into overflow (HDAM or PHDAM) –force segment to start new block (HIDAM or PHIDAM)

65 Rich in Function …..Application Program Interface Unload For stand-alone batch program Assembler, COBOL, or PL/1 Transparent to programmer Load Assembler Language, COBOL for OS/390 and VM PL/I for z/OS and OS/390

66 Rich in Function ….Additional utilities Sequential Subset Randomizer –Creates randomizing module for fast sequential processing of record subset –Allows physical clustering of database records in same subset Physical Sequence Sort for Reload (PSSR) Utility –Sorts the unloaded database data set before reload Used with HALDB, when changing partition boundaries during reorg –Avoids cascading on Reload Bitmap Resetter –The bitmap resetter can be used to adjust the bitmap of HDAM/HIDAM/PHDAM/PHIDAM database to accommodate denser packing of the database blocks.

67 © 2005 IBM Corporation IBM GLOBAL SERVICES © IBM Corporation 2005 IMS Online Reorg Facility

68 Verification Phase Before we get started – verify we have what we need –DBD Structure Do we support current DBD definitions? If changes, can we implement all changes? –DBRC definitions –Data sets Can shadow datasets be allocated? Can image copy data sets be allocated? Can work/temp files be allocated? –Software Are all necessary utilities available? Are these utilities at the proper level? Are online systems at compatible level?

69 DBD Changes –Specify a library with the new DBD –Limited to non-HALDB –No changes in hierarchical structure –No changes in DBRC –Examples: Change of randomizing parameter Addition of segment types Segment length increase –New DBD may be copied to primary DBD library during Takeover

70 Copy Phase Activate capture of log updates to primary database in online systems –STOP/START primary database to create sync point Copy original database data sets to shadow data sets Apply log updates to shadow data sets Switch from log updates to application updates in online systems –STOP/START primary database to create transition point Build shadow primary index

71 Reorg Phase Unload shadow database –Temporary unload data set –Optionally create permanent HD unload Pre-reorganization –if logical relationship –DBR Reload into shadow data sets –USEREXIT support (also used in Apply Phase ) Build secondary indexes –Sparse routines and NULLVAL supported –Shared secondary indexes supported Prefix Resolution & Update –if logical relationships Image copy all recoverable data sets –Optional Pointer Checker (of shadow data sets) –IC COMP/COMPRTN supported –Dynamic allocation or predefined image copy data sets – Registered to DBRC as batch IC during Takeover Phase

72 Apply Phase Replicate captured application update calls against shadow data sets –Reload userexit support When almost caught up… –CHANGE.DB NOAUTH –Request online IMS systems to DBR DBDs for primary DB and indexes Finish replicating captured application update calls Verify DBs are DBRd –Deactivate capturing application update calls in online IMS system(s) –Replicate any additional update calls if needed Transition from Apply to Takeover Phase can be delayed until a specific time of day

73 Takeover Phase 1.Checkpoint restart data –We are now restartable 2.DBRC notifications –NOTIFY.REORG –NOTIFY.IC –NOTIFY.PRILOG & SECLOG (in ERROR) Captured changes applied to shadows –NOTIFY.ALLOC –All timestamps adjusted to after DBR and before START 3.Rename Data Sets –Rename originals to.T –Rename shadows to originals –Delete or rename.T to.S –Copy changed DBDs to original DBD library 4.Implement Online Change –Perform ACBGEN for any changed DBDs –Copy new ACBs to all online systems ACBLIBA and ACBLIBB libraries –Request DMB to be replaced on all online IMS systems –Can be turned off DB will remain stopped and in NOAUTH status Return code will be set to 4 5.Change.DB AUTH 6.Request online IMS systems to START DBs 7.Additional checkpoints occur after each step is completed (for restart)

74 Controlling Takeover DELAY – Allows for manual steps –Job stops after restart data saved –DB is left DBRd and PROHIBIT AUTH –Restart can be used to initiate takeover process NO – Test mode –Stops after Apply Phase –No changes implemented in online system –No DBRC notifications –No affect on original databases Window – Only perform takeover during certain time –Begin time - Earliest time of day that takeover will start ORF job idles with DB still online –End time - Latest time of day that takeover will start –End Action - Action to take if end time has passed and job hasnt reached takeover point yet WTOR NEXTDAY CANCEL

75 Completion Phase All of the final reports and messages are written. Shadow data sets are deleted if you have DELETE(Y) specified. Data sets are deallocated. Miscellaneous cleanup tasks are performed. The IMS Online Reorganization Facility batch job ends.

76 Controlling BMPs Problem – BMPs must be stopped when ORF needs to STOP or DBR a DB –Interface with Program Restart Facility or ORF region controller front-end New BMPs are paused until DB is restarted Existing BMPs – next CHKP –HALDB – BMP is paused until DB is restarted –Non-HALDB – >pseudo U3303 >Job restarted from last checkpoint after DB is restarted

77 New Transactions When DB is Offline Problem – New transaction arrives when DB is DBRd –Transaction placed on suspend queue Exit/Automation to process suspend queue and reissue transaction –Takeover WINDOW to reduce impact

78 New Functionality Interface to PRF/Region controller front-end for pausing BMPs Internal Logical Relationship for HALDB –All partitions in single job Reorg Index Only –Primary or secondary for non-HALDB –Secondary for HALDB –Can be single partition if PSINDEX Near Online Unload –Create HD Unload data set while DB still online

79 © 2005 IBM Corporation IMS Tools ………Whats new and exciting Janet LeBlanc Silicon Valley Lab


Download ppt "© 2005 IBM Corporation IMS Tools ………Reorganization Janet LeBlanc Silicon Valley Lab"

Similar presentations


Ads by Google