Nutanix Veeam Backup Replication Best Practices
Nutanix Veeam Backup Replication Best Practices
Replication 9.5
Nutanix Best Practices
Copyright
Copyright 2019 Nutanix, Inc.
Nutanix, Inc.
1740 Technology Drive, Suite 150
San Jose, CA 95110
All rights reserved. This product is protected by U.S. and international copyright and intellectual
property laws.
Nutanix is a trademark of Nutanix, Inc. in the United States and/or other jurisdictions. All other
marks and names mentioned herein may be trademarks of their respective companies.
Copyright | 2
Veeam Backup & Replication 9.5
Contents
1. Executive Summary.................................................................................4
2. Introduction.............................................................................................. 5
2.1. Audience.........................................................................................................................5
2.2. Purpose.......................................................................................................................... 5
2.3. Synergistic Technologies................................................................................................5
5. Conclusion..............................................................................................26
Appendix..........................................................................................................................27
About Veeam....................................................................................................................... 27
About Nutanix...................................................................................................................... 27
List of Figures................................................................................................................ 28
List of Tables.................................................................................................................. 29
3
Veeam Backup & Replication 9.5
1. Executive Summary
Veeam is the Premier Availability solution provider for Nutanix, which offers a highly scalable
virtualization platform for desktop, server, and big data deployments. This document makes
recommendations for the optimization and scaling of Veeam Backup & Replication 9.5, part of
the Veeam Availability Suite, with Nutanix. It shows the scalability of the Nutanix Enterprise Cloud
and provides configuration information on the scale-out capabilities of both Veeam Backup &
Replication and Nutanix.
Veeam Backup & Replication 9.5 and later versions support features that can increase backup
performance and reduce backup windows. For vSphere, Veeam Backup & Replication supports
the Direct NFS backup method to minimize network bandwidth consumption. For Hyper-V 2016
environments, resilient change tracking (RCT) is available with Nutanix storage. Most recently,
Veeam has also added support for AHV environments, using snapshots, Changed Block Tracking
(CBT), and per-VM parallel processing.
1. Executive Summary | 4
Veeam Backup & Replication 9.5
2. Introduction
2.1. Audience
This best practice document is part of the Nutanix Solutions Library. We intend it for individuals
responsible for the architecture, design, management, and support of Veeam Backup &
Replication on Nutanix systems. Consumers of this document should be familiar with VMware
vSphere, Microsoft Hyper-V, Veeam Backup & Replication, and Nutanix, including AHV.
2.2. Purpose
This document covers the high-level best practices for Veeam Backup & Replication 9.5 with
Nutanix, using VMware vSphere 5.5 through 6.7, Microsoft Hyper-V 2012 R2 and 2016, and
AHV.
This best practice guide focuses on an optimized disk-to-disk backup architecture. Veeam
Backup & Replication has several architecture options, and this guide covers the best practices
jointly developed by Veeam and Nutanix.
Unless otherwise stated, the solution described in this document is valid on all supported AOS
releases.
2. Introduction | 5
Veeam Backup & Replication 9.5
Version
Published Notes
Number
1.0 September 2017 Original publication.
Updated for AOS 5.5 and Veeam Backup & Recovery
1.1 January 2018
9.5 U3.
Updated recommendations regarding Enable Same
1.2 February 2018
Host Direct NFS mode.
Updated solution overview and added best practices
2.0 February 2019
for Nutanix AHV.
2. Introduction | 6
Veeam Backup & Replication 9.5
Component Description
Nutanix Controller VM The Nutanix Controller VM (CVM) runs the Acropolis DSF
and serves all the I/O operations for the hypervisor and VMs
running on that host. The CVM pools and exports storage to the
hypervisor using the appropriate protocol.
Veeam Backup Server As the “brain” of the solution, Veeam Backup Server is
responsible for job management and scheduling, indexing
tasks, and general orchestration of the backup and replication
environment. The Backup Server can be virtualized.
Veeam Backup Proxy A backup proxy is a lightweight Veeam architecture component
that sits between the data source and the backup target,
processing jobs and delivering backup traffic. Backup proxy
tasks include retrieving VM data from production storage,
then compressing, deduplicating, and sending that data to the
backup repository. Using more than one virtualized (or physical)
backup proxy lets you easily scale your backup infrastructure
based on the size of your Nutanix system.
Component Description
Veeam Repository These systems provide the memory, storing backup archives
and their related metadata for future restores. A repository may
be a Windows or Linux server, a third-party NAS device, or a
deduplication appliance. Repositories can be virtual or physical,
depending on requirements and available hardware. If the
repository is virtual, create fault domain isolation by storing it
separately from the Nutanix cluster that holds production data.
Technology Description
VMware VADP Available in all licensed editions, VMware vStorage APIs for
Data Protection (VADP) is a framework that enables efficient
agent-free backups. Veeam Backup & Replication 9.5 uses the
VADP framework for high-performance backups.
vSphere CBT Changed Block Tracking (CBT) is a component of VADP that
enables efficient incremental VM backups. It enables Veeam
Backup & Replication to back up only changed data blocks,
thus greatly increasing backup performance and reducing
network bandwidth. Read operations occur locally, eliminating
the load on the network and on other Nutanix nodes.
Hyper-V 2016 RCT New to Hyper-V 2016 is native resilient change tracking
(RCT) for VHDX virtual disks. RCT enables Veeam Backup &
Replication 9.5 to back up VMs efficiently and minimize backup
windows. RCT offers a major improvement over Hyper-V 2012
R2, where incremental backups on Nutanix needed a full disk
scan to identify changed blocks, thus requiring additional I/O
and much more time.
Microsoft VSS Microsoft VSS is the framework for application-consistent
backups for Windows OS. Built into the operating system, VSS
enables the creation of a consistent snapshot of application
data, such as Microsoft Exchange, SQL, Active Directory,
or the NTFS file system. Veeam can use VSS to ensure
application-consistent backups for VSS-aware applications. All
hypervisors support enabling VSS in backup jobs. Veeam uses
VSS in a completely agentless fashion, using the hypervisor
communication stack to the benefit of the guest OS.
Note: For additional and more detailed sizing considerations, please refer to the
official Veeam best practices, available at https://bp.veeam.expert/.
Physical backup proxies are supported, but not ideal. A general rule for a physical proxy is one
core per 50 VMs, but this number greatly depends on VM size and the number of concurrent
backups. Proper testing for your environment is critical to ensure that you can meet backup
windows and RPOs. You may need to upsize the Veeam Backup & Repository server for your
environment.
Direct NFS
Direct NFS has several advantages over other transport modes and offers the best performance
and shortest possible backup windows. Each Nutanix node needs a local Veeam backup
proxy VM, as shown in the diagram above. The backup proxy is dual homed, with one NIC on
the internal Nutanix vSwitch, and the other NIC on the same network or VLAN that the ESXi
management network uses. The Nutanix whitelist then allows the backup proxy to access the
NFS datastores via the 192.168.5.0 network. Finally, within Veeam Backup & Replication, you
can configure the “preferred networks” rule to use the Nutanix 192.168.5.0 network for backups.
See Veeam’s Specifying Preferred Networks for Data Transfer article for more details.
We recommend using DRS “should” rules to pin each backup proxy VM to its respective host. In
addition, each backup proxy VM should have a unique 192.168.5.x address. This unique address
ensures that there is no IP conflict on the internal network during maintenance operations where
two proxy VMs may be on the same host.
During backup jobs, the Veeam Backup & Replication status screen displays a message
like “Using backup proxy VMware Backup Proxy for disk hard disk 1 [nfs]” (see the figure
below). If you look at the more verbose backup log file, you should see “Connected to NFS
server: 192.168.5.2, port 2049” and some additional NFS information. If you have completed
the configuration steps above and set the EnableSameHostDirectNFSMode registry key
appropriately, you shouldn’t need to do anything else. For additional information, refer to Veeam
DirectNFS documentation.
To optimize backup traffic within the NFS backend of Nutanix, we recommend implementing a
Veeam proxy for each ESXi host and enabling Veeam’s Same Host Direct NFS mode (value = 2,
as described below) in the registry.
HKEY_LOCAL_MACHINE\SOFTWARE\Veeam\Veeam Backup and Replication
Key: EnableSameHostDirectNFSMode
Type: REG_DWORD
Value = 2
Value options:
• 0 (default): Disabled.
• 1: Preferred Same Host. If a Direct NFS proxy exists on same host, Veeam waits for a free
task slot there. If a proxy on same host does not exist, Veeam uses another Direct NFS proxy
(on another host or physical server) or falls back to virtual appliance (hot-add) and finally to
network (NBD) mode. This mode is not recommended with Nutanix.
• 2: Same Host Direct NFS mode. Recommended for Nutanix. If there is no Direct NFS proxy on
the same host as the VM, it falls back to network mode (NBD).
that is on the same production management network that the ESXi hosts and CVMs share (for
example, 10.10.10.x).
For the best performance of network transport mode, the ESXi management VMkernel port
must use the dual 10 GbE NIC interfaces. Managing the ESXi host through the 1 GbE NICs
severely degrades backup performance. Rather than using the 1 GbE NICs, consider creating
an additional VMkernel port over an available 10 GbE NIC interface, then configuring the Veeam
preferred backup network to use this network.
• Always use the VMXNET3 NIC for Veeam Backup & Replication VMs.
• Use the latest VM hardware version for Veeam Backup & Replication VMs.
• If you are using the VMware Distributed Switch (recommended), use LBT load balancing.
• Right-size the proxy VM according to Veeam best practices for your environment.
• Connect the ESXi VMkernel, CVM, backup proxy, and repository via 10 GbE on the same
layer-2 network.
• Use Direct NFS. Do not use network transport mode unless the environment is very small with
small VM change rates.
• Do not use virtual appliance backup mode.
• Do not enable NBDSSL unless required. If NBDSSL is required, be prepared for the
performance impact. See the screenshot below.
• When configuring the Veeam VMware proxy, select Direct storage access and enable
Failover to network mode, as shown in the screenshot below.
• Configure a Veeam Backup & Replication global traffic rule to use the 192.168.5.0 network for
backups.
• Review Veeam logs to confirm that backup jobs really are using Direct NFS.
As with VMware environments, it’s critical for performance that the Hyper-V management
interface use the dual 10 GbE NICs. Nutanix requires that the Hyper-V management interface
and CVMs use the same layer-2 network. In addition, the Veeam Repository (VM or physical)
should also use the same layer-2 network for best performance. Introducing routing or other
network devices, such as a firewall, between the proxy agents and the repository can negatively
impact performance. The figure below shows the orange management network (10.10.10.x) on
which the Hyper-V management, CVM, and Veeam Repository reside.
Microsoft Hyper-V 2016 has built-in RCT. Using this feature, Veeam Backup & Replication 9.5
can greatly reduce backup windows after completing the first full backup job.
Note: Because Hyper-V 2012 R2 does not have a native RCT mechanism, every
backup job on Hyper-V 2012 R2 performs a full disk scan, no matter how small the
deltas from the last backup.
As the cluster uses more storage, more data moves to the cold tier in hybrid Nutanix clusters. In
Hyper-V 2012 R2 environments, this cold tier utilization can lead to reduced backup performance
over time.
Veeam Backup & Replication has its own CBT mechanism for Hyper-V 2012 R2, but this
mechanism is not available with Nutanix storage. We encourage customers to use Hyper-
V 2016, which is fully supported by Nutanix. Check the Nutanix Support Portal for the latest
supported hypervisors and AOS versions. Refer to the Veeam Backup & Replication 9.5 Hyper-V
documentation for the requirements to enable RCT.
When backup products such as Veeam Backup & Replication start a backup, the process
engages VSS at the file share (container) level. To ensure reliable VSS performance at the share
level, Nutanix supports 50 or fewer VMs per container during backup operations. If you are
backing up more than 50 VMs, create additional containers as needed with fewer than 50 VMs
each. If a container does not have VMs to back up (as in a VDI environment), the 50 VM limit
does not apply, as such a backup does not invoke VSS on the container.
Note: This VSS support policy does not apply to in-guest VSS usage, which is
transparent to Nutanix. You can configure backup jobs for in-guest application
consistency as needed without restriction.
Networking
• For ease of deployment, connect the appliance to a network with an accessible DHCP
scope. You can assign a static IP during the appliance initialization phase or at any time after
deployment.
• For cases where this kind of networking is not practical, you can configure the IP via the Prism
console for the appliance. Refer to Veeam product documentation for specific configuration
steps.
Application-Consistent Backups
• Without Nutanix Guest Tools (NGT), VM backups are crash-consistent.
• NGT can help facilitate application-consistent backups. If the level of consistency achievable
with NGT meets your requirements, no additional steps are necessary.
• If you need fully featured application consistency, (for example, log truncation for SQL), deploy
Veeam agents instead of or in addition to agentless AHV backups. Note that Veeam AHV
support includes agent licensing.
5. Conclusion
The Nutanix and Veeam Backup & Replication 9.5 solution provides the best of multiple worlds:
industry-leading performance with the ability to scale out your backup solution as you grow
your Nutanix clusters. Nutanix offers robust support of AHV, VMware vSphere, and Hyper-V
environments, allowing the customer to choose which hypervisor best meets their requirements.
Nutanix simplicity is a natural fit with the rapid deployment and architecture flexibility of Veeam
Backup & Recovery 9.5.
5. Conclusion | 26
Veeam Backup & Replication 9.5
Appendix
About Veeam
Veeam recognizes the new challenges companies across the globe face in enabling the Always-
On Enterprise, a business that must operate 24.7.365. To address this, Veeam has pioneered a
new market of Availability for the Always-On Enterprise by helping organizations meet recovery
time and point objectives (RTPO) of less than 15 minutes for all applications and data. Veeam
Availability Suite, which includes Veeam Backup & Replication, leverages virtualization, storage,
and cloud technologies that enable the modern data center to help organizations save time,
mitigate risks, and dramatically reduce capital and operational costs, while always supporting the
current and future business goals of Veeam customers.
About Nutanix
Nutanix makes infrastructure invisible, elevating IT to focus on the applications and services that
power their business. The Nutanix Enterprise Cloud OS leverages web-scale engineering and
consumer-grade design to natively converge compute, virtualization, and storage into a resilient,
software-defined solution with rich machine intelligence. The result is predictable performance,
cloud-like infrastructure consumption, robust security, and seamless application mobility for a
broad range of enterprise applications. Learn more at www.nutanix.com or follow us on Twitter
@nutanix.
Appendix | 27
Veeam Backup & Replication 9.5
List of Figures
Figure 1: Nutanix Enterprise Cloud................................................................................... 7
28
Veeam Backup & Replication 9.5
List of Tables
Table 1: Document Version History................................................................................... 6
29