1. © 2006 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice Database Growth: Problems & Solutions Thomas Boyd Hewlett-Packard

2. 3/19/20162 Agenda The Data Explosion Effects of Database Explosion −End User −IT Operations −Lab Tests −Real-world experiences Solutions Q & A

3. 3/19/20163 The Data Explosion “Data Explosion”: 166,000 Google Hits “Information Life Cycle Management”: 1.3M Google Hits Numerous analyst papers Archiving vendors

4. 3/19/20164 Data Explosion: Largest OLTP on Unix Databases Source: Winter Corporation; Top 10 Survey (www.wintercorp.com) 2003: Max: 5.4 TB, Average 2.5 TB 2005: Max: 16.4 TB, Average 6.8 TB

5. 3/19/20165 Drivers for Data Explosion Increased regulatory retention requirements Increased business intelligence and trend analysis Increased detail with-in business transactions Consolidation of systems Underlying growth in business volume

6. 3/19/20166 Data Explosion: Extremes India: 6.6 new mobile subscribers for month of October, 2006 USA: 25-35% growth in 2006 holiday online retails sales, industry-wide Europe: BASEL II Hewlett-Packard: Consolidating 85 data centers into 6

7. 3/19/20167 Data Explosion: Types of Data Structured, semi-structured, and unstructured Enterprise Information Messaging ( Semi-structured) Files ( Unstructured) Database (S tructured) Business Applications

8. 3/19/20168 Data has a Lifecycle High Low Access / SLA Requirements Time Retrieval Activity Customer inquiry Internal audit Sales order booked Change order Partial shipments Complete shipment Customer invoices generated Sales order closed Regulatory data retention period ends Corporate data retention period

9. 3/19/20169 Inactive Data Large Small Database Size Time Retrieval Activity Customer inquiry Internal audit Sales order booked Change order Partial shipments Complete shipment Customer invoices generated Sales order closed Inactive Data Active Data

10. 3/19/201610 Agenda The Data Explosion Effects of Database Explosion −End User −IT Operations −Lab Tests −Real-world experiences Solutions Q & A

11. 3/19/201611 Effects of Database Growth End-User −Declining application performance −Decreased application availability −Information overload Is your application presenting irrelevant information to end-user, causing extra work?

12. 3/19/201612 Effects of Database Growth IT Operations −Storage requirements −Server requirements −Backup and recovery windows −Maintenance and upgrades windows −Cloning operations −Database and Application Tuning

13. 3/19/201613 Lab Tests Single Table Query, non-unique index range scan (good selectivity) Table RowsConsistent Gets 200,000? 400,000? 2,000,000?

14. 3/19/201614 Lab Tests: Future Single Statement Testing −Track all relevant statistics −Insert and delete statements −Complex joins Full scale stress testing −Simulate Oracle EBS load −Varying machine and storage configurations Redo, Rollback analysis Backup (RMAN) analysis

15. 3/19/201615 Real World: Data Growth vs. Performance Application Data (GB) 1300 1200 1100 1000 900 800 700 600 500 400 Total Batch Run Time (Hrs/Month) Application Data Batch Run Time Data Growth Impact Phase I Tuning

16. 3/19/201616 Real World: Data Growth versus Performance Total Batch Run Time (Hrs/Month) Application Data (GB) Data Growth Impact Sustained Predictable Performance Archiving Phase II Tuning

17. 3/19/201617 Agenda The Data Explosion Effects of Database Explosion −End User −IT Operations −Lab Tests −Real-world experiences Solutions Q & A

18. 3/19/201618 Solutions: Control Data Generation Look for setups or configurations that are contributing to data growth −Persistent failures in interfaces −Persistent failures/notifications from Workflow −Excess use of Oracle Alerts −Inappropriate inventory tracking levels Monitor

19. 3/19/201619 Solutions: Purging Some data is not subject to regulatory requirements and has no ongoing business value Candidates: −Concurrent request data −MRP runs −Workflows −Temporary and Interface Tables −Others

20. 3/19/201620 Solutions: Hardware Upgrades Storage Server −Scale up −Scale out (RAC) Network

21. 3/19/201621 Solutions: No Consolidation Sometimes managing two medium sized databases is easier than managing one large database Gives up on all the advantages of consolidation −IT Operations −Consolidating reporting, etc…

22. 3/19/201622 Solutions: Partitioning Powerful Oracle feature for managing large tables Improves performance if queries are able to use partition keys “Life cycle” of data may leave active data in same partition as inactive data

23. 3/19/201623 Solutions: Archiving Remove data from OLTP Databases while retaining ability to access −Database Backups/Snapshots −Exports, CSV files −XML Files or other self-describing format −Relocation to secondary database Access via reporting tools or business analytics Access via native application

24. 3/19/201624 Agenda The Data Explosion Effects of Database Explosion −End User −IT Operations −Lab Tests −Real-world experiences Solutions Q & A

25. 3/19/201625 Conclusion Plan for it! Understand its effects COLLABORATE 07: Updated Presentation and White Paper −Full lab results