1. Veeam Roadshow - Better together: Veeam Backup & Replication & NetApp – full Performance with Snapshots
Andreas Neufert, Solutions Architect Central EMEA Veeam Software GmbH
Dieter Unterseher Solutions Architect Data Protection NetApp Germany
Abstract:
The always-on business requires strict and demanding uptimes, together with great protection and recovery performances. To fulfill these service levels with their stakeholders, IT departments need to leverage any modern technology able to improve their data availability. But this is not an easy task; protection activities during working hours have an impact on production performances, snapshots and their remote copies are powerful but sometimes cumbersome for restores, and application consistency is not always easy to obtain. As long as the different components of the datacenter are siloed and not deeply integrated, this is hardly going to change. A tight integration between the Data Availability solution and the storage is the best solution to solve these problems, and to dramatically improve the level of Data Availability. Veeam Backup & Replication v8 has introduced support for Netapp FAS and FlexArray storage arrays, and with this technical integration it can execute storage-assisted data protection operations: backups directly from storage snapshots can be executed more frequently, with less impact, even during production hours; and at the same time, Veeam technology offers a complete set of restore capabilities to dramatically minimize downtimes, and easily restore entire virtual machines, virtual disks, single files, or application items. The integration is complete, and can be used in any Netapp deployment scenario: both block (iSCSI, FC) and NFS volumes are supported, with 7-mode or Clustered-mode arrays. And the integration is seamless: Veeam Backup & Replication can read and run restores from primary snapshots, SnapMirror and SnapVault volumes, and also save its backups into SnapVault. A comprehensive integration to leverage all the power of Netapp and Veeam.
In this session, you will learn about:
how Veeam Backup & Replication integrates with Netapp arrays
Veeam Backup from Storage Snapshots
Veeam Explorer for Storage Snapshots
Veeam Backup Vaulting

2. NetApp Data ONTAP Storage & Data Protection Techniques
11. Mar 2014 (collected by Dieter Unterseher, no guarantee)

3. NetApp Integrated Data Protection and Business Continuity Solutions
Continuous Operations
Availability
Asynchronous Replication
Synchronous
Clusters
MetroCluster™
Block-Level Incremental Backups
Asynchronous SnapMirror®
Cost
SnapVault®
Application Recovery
SnapRestore® (currently not usable by Veeam)
Daily
Backup
NetApp Software Architecture
This slide shows that NetApp has data protection and business continuity solutions for all levels of availability requirements.
Snapshot™ Copies
Local Restore
Remote Restore
Remote Recovery – Low RTO
Capability
11. Mar 2014 (collected by Dieter Unterseher, no guarantee)

4. Policy-Based Data Management
NetApp Clustered ONTAP: Data Agility & Always on
Non-virtualized
Servers
Virtualized Servers
Big Data Content Servers
Workloads & Users A A B B C C D D E E
Policy-Based Data Management
Performance Issue
Resolved
System Upgrade Needed
Replication Copy Creation
- Workload A
All Actions Occur Without
Disruption to Users
Performance Issue
- Workload D
Backup Copy Creation
- Workload C
Unexpected Growth
in Workload B
Capacity Expansion Needed
Unexpected Growth
-Workload E
Growth Issue Resolved
Unified Data Network
FCP FCoE iSCSI CIFS/SMB NFS/pNFS
Clustered ONTAP A1 C1

5. The Era of the Always-On Business
Employees departing nine-to-five
Operations across time zones
Connected along the value chain
Customers online
Internet of Things
Access to all data and applications anytime
Zero tolerance for data loss
Recovery Time & Recovery Point Objective (RTPO) < 15min
Data Center
Applications, Data, Infrastructure
Why we need a deep integration with storage? Because it’s the era of always-on business. This means zero tolerance for data loss, and the need to satisfy demanding RPO and RTO for all workloads, not only Tier-1 applications. This can only be achieved by joining forces of a modern data availability solution (Veeam) with a modern storage solution (Netapp).

6. Backup VMware VMware Backup Server Administration Load balancing
No Agents on VMs and VMware!!!
Application-Aware-Consistency +VSS +Pre-/Post-Scripts
+ Application Restore switches
+ Logfile Truncation after Backup
Backup Server
VMware
ESX(i) vSphere vCD
Administration
VMware Change-Block-Tracking Info
Load balancing
SureBackup – automatic restore tests
Repository Server
VMware VADP API based Data Transport Direct SAN / Hotadd / Network
Block Level Incremental Forever Backup
Deduplication +Compression +Parallel Processing
+I/O Control + Encryption
Proxy Server
VM Snapshot

7. Lower RPO times

8. RPO ? At Backup you need to transport data and
consistency processing reduce performance of applications
Veeam Backup Processing only 1-4x a day
Solution: Use Storage Snapshots between the Backups
8 PM
Backup
1 PM
Snap
2 PM
3 PM
4 PM
5 PM
8 AM
9 AM
10 AM
11 AM
12 PM

9. Veeam Explorer for Storage Snapshots (VMware)
Low RPO Snapshot
Explorer for Storage Snapshots
Full VM (array based)
Guest files (17 file systems)
Exchange Items
SharePoint Items
Active Directory Objects
SQL Server Databases
FAS Series
Restore
SnapMirror SnapVault
Efficient Replication
Low RTO
Veeam Restore
FAS Series
Combine low RPOs of NetApp snapshot copies with low RTOs of Veeam Explorer for Storage Snapshots
Fastest RTO
File-level recovery for 17 different file systems
Item-level restores for four Microsoft applications
Support for
NetApp Snapshot
NetApp SnapMirror
NetApp SnapVault
This feature is included in Veeam Backup Free Edition. Application Items are limited for export only in Free Edition. Each and any NetApp Customer can use it for VMware Restore out of NetApp Scheduled Snapshots

10. Multiple restores from snapshots

11. Minimal VMware Snapshot lifetimes

12. Backup VMware with Storage Snapshots
No Agents on VMs and VMware!!!
Application-Aware-Consistency +VSS +Pre-/Post-Scripts
+ Application Restore switches
+ Logfile Truncation after Backup
Backup Server
VMware
ESX(i) vSphere vCD
Administration
VMware Change-Block-Tracking Info
Load balancing
SureBackup – automatic restore tests
Repository Server
Block Level Incremental Forever Backup
Direct out of Storage Snapshot
with use of VMware Change-Block-Tracking
Deduplication +Compression +Parallel Processing
+I/O Control + Encryption
Proxy Server X
VM Snapshot
Storage Snapshot

13. VMware Snapshot challenges
Standard VM Backup
With NetApp Integration
VM snap lifetime
VM snap lifetime
I/O
I/O
Backup
Backup t t
VM snap
VM snap commit
VM snap
VM snap commit
Storage Snap
Delete Storage Snap
High Load at Snapshot committ at Storage
Take a long time, sometime hours/days
Faster commit with less data. Nearly instant VM Snapshot committ. Use of Storage Snapshot for Backup

14. Example of a standard VMware API backup from a slow storage
~34 min open VMware VM Snapshot at this example.
Veeam uses parallel Disk backup to reduce time window but the Snapshot is open for a long time.
This leads in a ~28min Snapshot commit with high IO at Storage and performance impact on the VM
What happens when a VMware backup is executed on a Veeam+NetApp environment?
A vSphere snapshot is created to guarantee application consistency
Volume containing the virtual disk is identified
NetApp snapshot of the volume is created
vSphere snapshot is committed
Backup starts from the NetApp snapshot, while the VM runs in Vmware without any snapshot open affecting its performances

15. With Veeam Backup from Storage Snapshots
VM Snapshot is open for some seconds and can committed in some seconds. This works with FC/iSCSI … AND… NFS Datastores.
What happens when a VMware backup is executed on a Veeam+NetApp environment?
A vSphere snapshot is created to guarantee application consistency
Volume containing the virtual disk is identified
NetApp snapshot of the volume is created
vSphere snapshot is committed
Backup starts from the NetApp snapshot, while the VM runs in Vmware without any snapshot open affecting its performances

16. One console for Backup and Snapshot Orchestration

17. Veeam Snapshot Orchestrator
Use Veeam as a NetApp Console
Create manual snapshots directly from Veeam interface
Schedule Snapshot-only “backup” jobs (lowest RPO)
SnapMirror and SnapVault orchestration for single-pass backup into two destinations (instant “Backup Copy”)
It is important to not hit the max number of Snapshots per NetApp Volume (hard limit 255, never plan more than 250) with multiple Veeam Jobs. So the following recommendations should be considered:
VMware Datastore Level Scope is recommended for Veeam Jobs if you want to use Veeam NetApp Snapshot Orchestration.
It is recommended to place only 1 VMware Datastore on a NetApp volume.
If only Veeam Snapshot Orchestration is used, follow the NetApp recommendations for Datastore Size and VM count. But if Veeam Backups are created on top of Veeam NetApp Snapshot Orchestration, we highly suggest to use not more than 15TB of VMware used data on a single VMware Datastore, which lead in not more than 8TB Veeam single full backup files. It is technically possible to grow beyond that.
If you process Application Consistent Snapshots, keep an eye on the processing time for it, it can take a while for volume snapshot creation. Less VM count (round about 40-60VMs) per Datastore is helpful.

18. Create manual snapshot
Create a manual snapshot of a LUN or NFS export directly from the Veeam console

19. Scheduled snapshot creation
Create a manual snapshot of a LUN or NFS export directly from the Veeam console

20. Configure secondary destination
Create a manual snapshot of a LUN or NFS export directly from the Veeam console

21. Browse snapshot content
Create a manual snapshot of a LUN or NFS export directly from the Veeam console

22. 3-2-1 Backup Concept

23. Backup Concept 1 – ONTAP Storage + Veeam v8
SnapMirror SnapVault
VMware
Any standard storage incl. ONTAP
Tape
ONTAP
Veeam Backup (v8)
Every 1 day for 1 month
Veeam Backup (= 30 Restore Points)
+ optional Grandfather- Father-Son (GFS) retention weekly 5 restore points monthly 12 restore points yearly 2 restore points to disk or tape
Veeam Backup & Replication
(Orchestration of NetApp Snapshots and Veeam Backup from Storage Snapshot)
Every 10 min for 1 day crash consistent Snapshots (= 144)
Every 4h for 1 week Application- Consistent & Application- Aware Snapshots (= 42)
*.vbk
Every 4h for 1 month SnapMirror/ SnapVault update (= 180 Snapshots)
*.vbk

24. Restore from Snapshot/Backup
Restore Source
Restorable Objects
Snapshot with VMware VMs
Primary Snapshot
SnapMirror/SnapVault Snapshot
Crash Consistent or Application Consistent
Veeam Backups
On Disk
On Tape (with Disk staging)
Instant VM Recovery
VM Recovery
Win/Linux/Unix Instant File Level Recovery
AD/Exchange/Sharepoint Single Object Restore
SQL DB Restore …
Same as above +
MS SQL Single DB Restore with logfile roll forward (with enabled Veeam logfile backup)
SureBackup (OnDemand Labs + automatic restore tests)
Universal Application Item Recovery
*.vbk
You can use NetApp SnapManager and/or NetApp SnapCreator to complement Veeam for additional applications like Oracle, SAP, SAP HANA, DB2, Informix and others

25. Technical Recommendations for ONTAP+Veeam setups
It is important to not hit the max number of Snapshots per NetApp Volume (hard limit 255, never plan more than 250) with multiple Veeam Jobs. So the following recommendations should be considered:
VMware Datastore Level Scope is recommended for Veeam Jobs if you want to use Veeam NetApp Snapshot Orchestration.
It is recommended to place only 1 VMware Datastore on a NetApp volume.
If only Veeam Snapshot Orchestration is used, follow the NetApp recommendations for Datastore Size and VM count. But if Veeam Backups are created on top of Veeam NetApp Snapshot Orchestration, we highly suggest to use not more than 15TB of VMware used data on a single VMware Datastore, which lead in not more than 8TB Veeam single full backup files. It is technically possible to grow beyond that.
If you process Application Consistent Snapshots, keep an eye on the processing time for it, it can take a while for volume snapshot creation. Less VM count (round about 40-60VMs) per Datastore is helpful.

26. NetApp System Requirements
Firmware Data ONTAP 8.1 or higher (NetApp FAS, FlexArray (V-Series), Edge VSA and IBM N series) Supported Access Protocols NFS, iSCSI or Fibre Channel (FC) ONTAP-Modes 7-Mode or Clustered-ONTAP Cloning Use of traditional LUN Cloning possible, but FlexClone Licenses are recommended for 7 mode systems. SnapVault/SnapMirror Licenses If you want to use SnapVault or SnapMirror relevant NetApp licenses are needed. Data Plattform VMware VMDK

27. Veeam Licensing
Licensed per virtualization host socket Restore out of NetApp Snapshot (Primary/SnapMirror/SnapVault) known as Veeam Explorer for NetApp SAN Snapshots (VMware) Veeam Backup Free Edition including Application Single Object Export (Enterprise Edition includes Application Single Object Restore to original places). Snapshots can be triggered manual or by non Veeam scheduler. Veeam Backup from NetApp Storage Snapshot and Veeam NetApp Snapshot Orchestration (VMware) Veeam Backup & Replication Enterprise Plus Edition or Veeam Essentials Enterprise Plus Edition or Veeam Availability Suite Enterprise Plus Edition

28. Virtualization backup from any storage to NetApp E-Series with Veeam

29. E-Series Storage as target for Veeam Backup & Replication
E-Series EF-Series
E-Series
Tape
VMware/ Hyper-V
Veeam Backup
Veeam Backup Copy Job
Any Storage
Daily Backup 30 RestorePoints
+ optional GFS retention weekly 5 restore points monthly 12 restore points yearly 2 restore points
Veeam Backup & Replication
(Veeam VMware VADP API based backup)
Daily Backup 30 RestorePoints
*.vbk
*.vbk
+ optional Tape retention weekly 5 restore points monthly 12 restore points yearly 2 restore points
*.vbk
*.vbk

30. Restore from Backup Restore Source Restorable Objects *.vbk
Veeam Backups
On Disk
On Tape (with Disk staging)
*.vbk
Instant VM Recovery
VM Recovery
Win/Linux/Unix Instant File Level Recovery
AD/Exchange/Sharepoint Single Object Restore
MS SQL Single DB Restore with Logfile Rollforward (with enabled Veeam logfile backup)
SureBackup (OnDemand Labs + automatic restore tests)
Universal Application Item Recovery

31. NetApp E-Series Lab Test (Munich)
A lab performance test of the Availability for the Modern Data Center™ program at NetApp® Labs Munich shows backup speed does not serve as a limiting factor for the modern data center when customers use Veeam® Backup & Replication™ in combination with NetApp EF- or E-Series storage.
EF-Series
*.vbk
VMware ESXi
LAN (1Gbps)
FibreChannel (16Gbps)
B&R Server
Proxy/Repository
E- Series
Read Direct SAN
Write Dedup/Compr.

32. NetApp E-Series Lab Test (Munich)
A single Veeam Backup & Replication server (2 year old Hardware) was able to scale to 700MB/s. A nearly linear performance increase was achieved when additional Veeam proxy/repository servers were added.
Backup
Speed
2100 MB/s
1400 MB/s
700 MB/s …
Proxy/Repository #
10h 5h
3,3h
Backup time window for 24TB

33. NetApp System Requirements
E-Series (or EF-Series) as Backup Target. 10k Disks or faster are suggested as Veeam use many random read/write streams. Use RAID5 or RAID10 for less than 16 drives. If you have more than 16 drives, use one big Dynamic Disc Pool (DDP) with all drives and create multiple (min4) Raid6 volumes (8+2) on this pool. DDP increases performance for Veeam workloads, because the load is spread over all disks. On the same time it reduces critical Raid status time when a disk failure occurs, because all disks are holding spare capacity and are used for fast RAID rebuilds.

34. Veeam Licensing
Licensed per virtualization host socket. E-Series or EF-Series can be used as Backup Target with all Veeam Backup & Replication Versions.

35. Hyper-V

36. Hyper-V + Veeam + NetApp
Veeams Backup processing is able to use Storage Snapshots of NetApp ONTAP and E/EF-Series Storage Systems. It uses NetApp Hardware VSS Provider Veeams own Change Block Tracking Technology for Hyper-V can be used for Change Block Tracking based Incremental Forever Backups (and VM Replicas). All Restore possibilities possible out of Veeam Hyper-V Backups (like VMware), but it is not possible to restore out of a NetApp Snapshot that contains Hyper-V VMs. All Veeams Advanced Features (SureBackup/OnDemand Labs/Selfe Service/…) are available, too.

37. Q&A
Andreas Neufert, Solutions Architect Central EMEA Veeam Software GmbH
Dieter Unterseher Solutions Architect NetApp Germany
Abstract:
The always-on business requires strict and demanding uptimes, together with great protection and recovery performances. To fulfill these service levels with their stakeholders, IT departments need to leverage any modern technology able to improve their data availability. But this is not an easy task; protection activities during working hours have an impact on production performances, snapshots and their remote copies are powerful but sometimes cumbersome for restores, and application consistency is not always easy to obtain. As long as the different components of the datacenter are siloed and not deeply integrated, this is hardly going to change. A tight integration between the Data Availability solution and the storage is the best solution to solve these problems, and to dramatically improve the level of Data Availability. Veeam Backup & Replication v8 has introduced support for Netapp FAS and FlexArray storage arrays, and with this technical integration it can execute storage-assisted data protection operations: backups directly from storage snapshots can be executed more frequently, with less impact, even during production hours; and at the same time, Veeam technology offers a complete set of restore capabilities to dramatically minimize downtimes, and easily restore entire virtual machines, virtual disks, single files, or application items. The integration is complete, and can be used in any Netapp deployment scenario: both block (iSCSI, FC) and NFS volumes are supported, with 7-mode or Clustered-mode arrays. And the integration is seamless: Veeam Backup & Replication can read and run restores from primary snapshots, SnapMirror and SnapVault volumes, and also save its backups into SnapVault. A comprehensive integration to leverage all the power of Netapp and Veeam.
In this session, you will learn about:
how Veeam Backup & Replication integrates with Netapp arrays
Veeam Backup from Storage Snapshots
Veeam Explorer for Storage Snapshots
Veeam Backup Vaulting