1. Strength. Strategy. Stability.

2. Progress Performance Monitoring and Tuning Dan Foreman Progress Expert BravePoint BravePoint 20112

3. 3 Introduction – Dan Foreman Progress User since 1984 Author of: Progress Performance Tuning Guide Progress DB Administration Guide Progress Virtual System Tables ProMonitor Pro Dump&Load And other miscellaneous stuff

4. Introduction - Audience Progress Version? V8 V9 V10? DB Operating System: *ix or Windows Largest Single Database One of BravePoint’s customer’s has a Six Terabyte database BravePoint 2011 4

5. Monitoring Categories Progress Databases Progress Clients Character Graphical AppServers & WebSpeed SQL Clients Operating System Application – beyond the scope of this presentation BravePoint 2011 5

6. Monitoring - Database Monitoring - Database GrowthI/O Record Locking After Imaging Before Imaging Resource Contention Latches Semaphores BravePoint 2011 6

7. Monitoring - Database Database Health Log File Blocks & Chains Pointers (Index  Data) Database Structure Database “Demographics” ReplicationBackups BravePoint 2011 7

8. Monitoring Tools promon Virtual System Tables Other Progress utilities 3d Party ProMonitor (BravePoint) OpenEdge Management (Progress)Other BravePoint 2011 8

9. Monitoring Tools - promon Old faithful Character interface Doesn’t record any history No Alerting Somewhat poorly documented See Dan Foreman’s Performance Tuning Guide Takes a ‘snapshop’ of DB Shared Memory BravePoint 2011 9

10. Monitoring Tools – VSTs Access Shared Memory using System Tables Doesn’t have everything promon does Poorly documented Dan Foreman’s VST Guide Must write the code yourself Some tables are hazardous to good performance: _lock BravePoint 2011 10

11. DB Monitoring - Growth DB Extends Goal: zero – i.e. all growth occurs in fixed size extents Not as important as it used to be IF there is a very high quality disk storage system BravePoint 2011 11

12. DB Monitoring – I/O DB Requests - # of block accesses DB Reads - # of reads from DB on disk required to satisfy DB Requests DB Level Individual Client Level Continued… BravePoint 2011 12

13. DB Monitoring – I/O Hit Ratio – Ratio of DB Requests:DB Reads Goal: find as many blocks in Buffer Cache (-B) as possible; i.e. High Hit Ratio Fix: Dump&Load Fix: Increase Buffer Cache Fix: Avoid ‘stupid’ queries (no good index, ODBC reporting, etc.) BravePoint 2011 13

14. DB Monitoring – Before Image Buffers Flushed Goal: Zero (or near zero) Fix: BI Cluster Size Fix: Async Page Writers (APWs) Empty Buffer Waits Goal: Zero Fix: BI Buffers and/or BI Writer (BIW) BravePoint 2011 14

15. DB Monitoring – Before Image Long Duration Transactions Goal:60 minutes maximum Fix: good code BI Size Goal: “reasonable” – typically 1-4gb max Fix: good code BravePoint 2011 15

16. DB Monitoring – After Image Empty Buffer Waits Not running After Imaging – don’t be a fool Goal: Zero Fix: AI Buffers and/or AI Writer (AIW) BravePoint 2011 16

17. DB Monitoring – Record Locking Lock Table High Water Mark (HWM) Goal:don’t hit the HWM Fix: larger Lock Table (-L) – be careful!!! Fix: fix the code Record Waits Goal: Zero Fix: fix the code BravePoint 2011 17

18. DB Monitoring - Contention Latch Contention – Latch Timeouts Goal: Low (zero is impossible) Fix: adjust –spin parameter Semaphore Contention – Semaphore Waits Goal: Low (zero is impossible) Fix: adjust –semsets parameter BravePoint 2011 18

19. DB Monitoring - Health Log (.lg) File Monitoring for Warnings & Errors Blocks & Chains proutil -C dbanalys Avoid running during production hours Run against a copy of production DB Several other health checking options existContinued… BravePoint 2011 19

20. DB Monitoring - Health Pointers (Indexes  Data) proutil idxcheck proutil idxfix BravePoint 2011 20

21. DB Monitoring - Structure Tables or Indexes in the Schema Area Indexes in Table Areas Tables in Index Areas Type 2 Areas!!! Sorry but some QAD staff are just plain wrong about T2 Areas BravePoint 2011 21

22. DB Monitoring - Demographics Scatter Factor proutil dbanalys/tabanalys 4+ for large, heavily used tables is EVIL Bug in early V10 Scatter FactorsContinued… BravePoint 2011 22

23. DB Monitoring - Demographics Fragmentation proutil dbanalys/tabanalys Fragmented Records require a minimum of 2X more I/O to read and writeContinued… BravePoint 2011 23

24. DB Monitoring - Demographics Tables getting large enough to warrant migration to a dedicated Storage Area proutil dbanalys/tabanalys Index Utilization Percent proutil dbanalys/ixanalys BravePoint 2011 24

25. Progress Client Monitoring I/O _tablestat & _indexstat VSTs _usertablestat & _userindexstat VSTs Code Efficiency Progress Application Profiler – undocmented What Program is being executed _connect VST (since V10.1C) BravePoint 2011 25

26. SQL Client Monitoring I/O – same as Progress Clients Query Plan UPDATE STATISTICS – not really monitoring but tuning BravePoint 2011 26

27. Monitoring - Other Memory consumption Progress Clients Java AppServers & WebSpeedTomcat Does it respond? BravePoint 2011 27

28. Conclusion Questions? If you need further assistance: Dan Foreman Publications ProMonitor www.BravePoint.com danf@prodb.com Thank You For Coming! Don’t forget your Conference Evaluations! BravePoint 2011 28