RETURN TO MAIN Surviving Disaster Presented by: Wayne Lyle, Project Manager Dilworth Paxson LLP Jenn Steele, Director of Information Technology Donovan Hatem LLP Moderator: Ivaylo Nikolov, Director of IT Davies Ward Phillips & Vineberg LLP

RETURN TO MAINAgenda Jenn’s Story: Waterfall! Wayne’s Story: Great Flood of ‘07 Panel Discussion/Q&A Lessons Learned

RETURN TO MAIN First, Some Information 75 Attorneys 3 Offices Centralized in Boston Founded March 1, 2001 Moved to Current Location Memorial Day Weekend, 2002

RETURN TO MAIN Once Upon a Time…

RETURN TO MAIN Sunday, December 2, 2006, 6:45 PM

RETURN TO MAIN Order of Events: Waterfall 1 12/7/2006 6:45 PM Systems Go; Finally Went Home 12/2/2006 6:45 PM Initial Call 11:00 PM Finished Dismantling Equipment 12/3/2006 7:00 PM Reassembled Equipment 12/4/2006 4:30 AM Essential Equipment Up & Running HVAC Turned Back On 12/5/2006 5:00 PM

RETURN TO MAIN Thursday, December 7, 2006, 7:00 PM

RETURN TO MAIN Order of Events: Waterfall 2 12/9/2006 7:12 PM Most Systems Go 12/7/2006 7:00 PM Initial Call 11:30 PM Dismantled Equipment & Set up Sneakernet 12/8/2006 7:00 AM Supported Firm on Sneakernet 12/8/2006 6:00 PM Expert Sealed in Kitchen with Equipment Started Reassembling Equipment 12/9/ :00 AM

RETURN TO MAINConsequences Data Loss Client data on one NAS only Sent for recovery Equipment Loss Expert cleaning/assessment Surprisingly low Sanity Loss None to begin with…

RETURN TO MAIN About that DR/BC Plan… Pre-flood DR/BC Plan Backup tapes & online backup Cross fingers & pray Post-flood DR/BC Plan Backup tapes & online backup VMWare Implementation as full BC solution in progress Cross fingers & pray “Well, we were fine the first time without one…”

RETURN TO MAIN New Set-Up

RETURN TO MAIN January 18, All Wet From: Wayne J. Lyle Sent: Thursday, January 18, :30 AM To: Jennifer E. Steele Jenn: Now I know how you felt the day you got rained on. We had a major flood on our 6th floor which has our communications room (Phone / Network Hub) as a couple hundred gallons of hot water came falling out of the ceiling. Did your incident include any dealing with paper files? If so did you bring in someone special to deal with recovering wet documents and books? Wayne

RETURN TO MAIN Wayne’s Story Background Information IS Director for a law firm in Portland ME. Approximately 80 Attorneys 4 Offices January 16, 2007 Just your average winter day But then ……

RETURN TO MAIN “The Great Flood of January 07”

RETURN TO MAIN What Happened A Major HVAC Failure Frozen VAV Boxes System Reset – Ooops VAV Units Burst Thousands on Gallons Went on for 20 minutes Standing water

RETURN TO MAINImpact Major loss of facilities Floor was deemed uninhabitable 30%+ Loss office space Minor loss of equipment Mostly monitors and telephones Service Losses Financial System offline for 4 hours Phone System down for 15 minutes

RETURN TO MAIN Business Continuity Re-Establish Location Vendor Rehab Reclaiming the office Recovery Communicate Internally Externally Return Never Again Lessons

RETURN TO MAIN About the DR / BC Plans Before the Flood Distributed Assets Multi-Site Disk Based Backup Threat Matrix After Flood Virtualization Investigate Automated Failover Enhance Threat Matrix

RETURN TO MAIN Panel Discussion/Q&A

RETURN TO MAIN Lessons Learned 1.Communications both internally and externally are crucial to restoration 2.Delegate even the most minor issues 3.Work the problem. Establish milestones for restoration. 4.Manage your personnel assets 5.Consider the risks to the personnel

RETURN TO MAIN Lessons Learned 6.Prior planning—both while designing and later 7.Know what vendors to call 8.Think about the insurance claims 9.Understand short tempers and other emotional effects 10.Maintain perspective