h18241.8 Dell Powerstore Best Practices Guide
h18241.8 Dell Powerstore Best Practices Guide
July 2024
H18241.8
White Paper
Abstract
This document provides best practices for installing and configuring Dell PowerStore
for optimal performance and availability.
The information in this publication is provided as is. Dell Inc. makes no representations or warranties of any kind with respect
to the information in this publication, and specifically disclaims implied warranties of merchantability or fitness for a particular
purpose.
Use, copying, and distribution of any software described in this publication requires an applicable software license.
Copyright © 2020-2024 Dell Inc. or its subsidiaries. Published in the USA July 2024 H18241.8.
Dell Inc. believes the information in this document is accurate as of its publication date. The information is subject to change
without notice.
Contents
Executive summary ........................................................................................................................ 4
Introduction ..................................................................................................................................... 4
Network considerations.................................................................................................................. 9
Conclusion ..................................................................................................................................... 17
References ..................................................................................................................................... 18
Executive summary
Overview This white paper provides best practices guidance for using Dell PowerStore in a mixed-
business environment. It focuses on optimizing system performance and availability, and
on maximizing the usability of the automated storage features.
These guidelines are intended to cover most use cases. They are recommended by Dell
Technologies but are not strictly required. Some exception cases are addressed in this
white paper. Less common edge cases are not covered by these general guidelines and
are addressed in use case-specific white papers.
For questions about the applicability of these guidelines in a specific environment, contact
your Dell Technologies representative to discuss the recommendations.
Audience This document is intended for IT administrators, storage architects, partners, and Dell
Technologies employees. This audience also includes any individuals who may evaluate,
acquire, manage, operate, or design a Dell networked storage environment using
PowerStore systems.
Introduction
Document This document introduces specific configuration recommendations that enable optimal
purpose performance from PowerStore.
PowerStore PowerStore achieves new levels of operational simplicity and agility. It uses a container-
overview based microservices architecture, advanced storage technologies, and integrated
machine learning to unlock the power of your data. PowerStore is a versatile platform with
Terminology The following table provides definitions for some of the terms that are used in this
document.
Table 1. Terminology
Term Definition
Base enclosure Refers to the enclosure that contains both nodes (node A and
node B) and 25 NVMe drive slots.
Embedded module Connectivity card in the PowerStore node that provides ports
for Ethernet connections, and various service and
management ports.
Internet SCSI (iSCSI) Provides a mechanism for accessing block-level data storage
over network connections.
Term Definition
Network File System (NFS) An access protocol that allows data access from Linux/UNIX
hosts on a network.
NVMe over Fibre Channel Allows hosts to access storage systems across a Fibre
(NVMe/FC) Channel network fabric using the NVMe protocol.
NVMe over TCP (NVMe/TCP) Allows hosts to access storage systems across a TCP network
fabric using the NVMe protocol.
PowerStore Command Line An interface that allows a user to perform tasks on the storage
Interface (PSTCLI) system by typing commands instead of using the user interface
(UI).
Server Message Block (SMB) An access protocol that allows remote file data access from
clients to hosts on a network. This protocol is typically used in
Microsoft Windows environments.
Thin clone A read/write copy of a volume, volume group, file system, NAS
server, or snapshot that shares blocks with the parent
resource.
Virtual Volumes (vVols) A VMware storage framework that allows VM data to be stored
on individual VMware vSphere Virtual Volumes (vVols). This
framework allows for data services to be applied at a VM-
granularity level while using Storage Policy Based
Management (SPBM).
We value your Dell Technologies and the authors of this document welcome your feedback on this
feedback document. Contact the Dell Technologies team by email.
Note: For links to other documentation for this topic, see the PowerStore Info Hub.
Hardware considerations
Introduction At the highest level, design for optimal performance follows a few simple rules. The main
principles of designing a PowerStore system for performance are:
• Distribute workloads across available resources
• Simplify the configuration
• Design for resilience
• Maintain the latest-released PowerStoreOS version
Hardware components are the foundation of any storage system. This section discusses
some key hardware differences between PowerStore models that help determine
performance. It also explains how different configuration options can result in different
performance from the same hardware.
PowerStore The PowerStore platform consists of eleven different models, from the PowerStore 500
deployment model through the PowerStore 9200 model. PowerStoreOS 1.0 launched with the
modes PowerStore 1000T, 3000T, 5000T, 7000T, and 9000T. PowerStoreOS 2.0 introduced the
entry-level 500. PowerStoreOS 3.0 introduced a platform refresh, with the 1200T, 3200T,
5200T, and 9200T models. PowerStoreOS 4.0 introduced the 3200Q model appliance. All
models use a common base enclosure and I/O modules. The models differ by CPU core
count and speed, memory size, and number of NVMe NVRAM drives. These hardware
differences give each model a unique performance profile.
Besides the hardware differences between the models, PowerStore can be installed in
one of two different deployment modes. Each deployment mode has different capabilities,
as detailed in Table 2. Choose the deployment mode that provides the required
capabilities.
External block
Deployment mode External file access
access
Unified ✓ ✓
Block optimized ✓ X
In general, the IOPS capability of the PowerStore models scales linearly from PowerStore
500 up to 9200 models. As mentioned previously, deployment mode also impacts
performance capability. A PowerStore T model in block optimized mode can deliver more
block IOPS than the same model in unified mode.
Except for PowerStore 500, PowerStore systems use NVMe NVRAM drives to provide
persistent storage for cached write data. PowerStore 1000 up to 3200 model arrays have
two NVRAM drives per system, while PowerStore 5000 up to 9200 model arrays have
four NVRAM drives per system. The extra drives mean that these systems can provide
higher MBPS for large-block write workloads.
PowerStore cluster
PowerStore systems can be clustered. A PowerStore cluster combines multiple
PowerStore appliances into a single grouping that is managed as a single storage system.
A PowerStore cluster delivers aggregate performance from all appliances in the cluster,
but a single volume is serviced by only one appliance at any given time. While not
required, it is recommended that all appliances in a cluster be of the same model and
have similar physical capacities to provide consistent performance across the cluster.
PowerStore T models and PowerStore Q models can be mixed within the same cluster.
Drive PowerStore can be configured with NVMe solid-state devices (SSDs) or NVMe storage
configuration class memory (SCM) drives for user data. The 3200Q model only supports QLC NVMe
SSDs, while all other PowerStore model appliances support TLC NVMe SSDs. Mixing
QLC and TLC drives within a single appliance is not supported. SSD-based systems can
be expanded with additional drives to increase the amount of available storage capacity.
PowerStore 1000, 3000, 5000, 7000, and 9000 models can be expanded with SAS SSD-
based expansion shelves. Starting in PowerStoreOS 3.0, all PowerStore models,
including the 3200Q, can be expanded with NVMe SSD-based expansion shelves if they
meet the necessary hardware prerequisites defined in the white paper Dell PowerStore:
Introduction to the Platform. It is recommended that all drives within a PowerStore system
be the same size, which can maximize the usable capacity of each drive.
PowerStore Dynamic Resiliency Engine (DRE) is used to manage the drives in the
system. All drives are automatically used to provide storage capacity. DRE groups the
drives into resiliency sets to protect against drive failure. User configuration of the drives
is not necessary, and dedicated hot spare drives are not required in PowerStore. Spare
space for rebuilds is automatically distributed across all drives within each resiliency set.
This configuration provides better resource utilization and enables faster rebuilds if there
is a drive failure.
At initial installation of the PowerStore system, DRE can be configured with either single-
or double-drive failure tolerance. To provide the greatest usable capacity from the same
number of drives, it is recommended to initially install PowerStore with a minimum of ten
drives for single-drive failure tolerance, or nineteen drives for double-drive failure
tolerance. PowerStore 3200Q models require a minimum of eleven drives, and double-
drive failure tolerance is enforced on the appliance.
SCM drives
PowerStore can use SCM drives either by having only SCM drives installed in the system,
or, with PowerStoreOS 2.0 or higher, by mixing SCM and TLC model SSD drives.
Systems with all SCM drives are recommended for small-block workloads that require the
absolute lowest latencies. A system with all SCM drives will place both data and metadata
on the SCM drives.
Systems with mixed SSD and SCM drives will use the SCM drives for metadata
acceleration; the SCM drives will store metadata for faster lookups. This can reduce
latency on read operations in systems with large physical capacities. When mixing SCM
and SSDs, it is recommended that at least 5 percent of the system’s physical capacity
should be SCM.
Network considerations
Introduction External hosts send and receive data from PowerStore through Fibre Channel, Ethernet,
or both networks. These networks play a large role in determining the performance
potential of PowerStore. This section discusses considerations for the external network,
and for the PowerStore network ports.
General network It is recommended to use redundant switch hardware between the PowerStore system
performance and and external clients. For more details about configuring a redundant network, see the
high availability document PowerStore Host Configuration Guide on Dell.com/powerstoredocs.
For performance, load balancing, and redundancy, each host should have at least two
paths to each PowerStore node (four paths per PowerStore appliance). It is
recommended that a host should have no more than eight paths per volume.
Ethernet networks
For Ethernet connectivity, use multiple switches that connect to Virtual Link Trunking
interconnect (VLTi) and Link Aggregation Control Protocol (LACP) or equivalent
technologies. Each PowerStore node should have connectivity to all linked switches.
The first two ports of the embedded module 4-port card on each PowerStore node are
bonded together within the PowerStoreOS. For the highest performance and availability
from these ports, it is recommended also to configure link aggregation across the
corresponding switch ports.
With the introduction of PowerStoreOS 3.0, user-defined link aggregations are supported
for Ethernet ports. Link aggregations can include 2 to 4 different Ethernet ports. The ports
must be on the same node and operate at the same speed. A mirror link aggregation will
automatically be created on the peer node. In PowerStoreOS releases prior to 4.0, user-
defined link aggregations only support NAS server interfaces. In PowerStoreOS 4.0 and
later, user-defined link aggregations also support iSCSI host connectivity and replication.
When using Ethernet for block access to PowerStore volumes (by means of iSCSI and/or
NVMe over TCP), each host should have at least two paths to each PowerStore node
(four paths per PowerStore appliance). It is recommended that a host should have no
more than eight paths per volume.
PowerStore PowerStore supports Ethernet connectivity through ports on the embedded module, and
front-end ports on optional I/O modules. PowerStore supports Fibre Channel connectivity through ports
on optional I/O modules.
The fastest I/O module should be installed in slot 0. On PowerStore 1000 – PowerStore
9200 models, I/O module slot 0 is 16-lane PCIe Gen3 while I/O module slot 1 is 8-lane. If
the system is configured with a 100 GbE I/O module, it should be installed in slot 0 to
enable the highest bandwidth. If a second 100 GbE I/O module is required, it can be
installed in slot 1. Both I/O module slots on PowerStore 500 models are 8-lane PCIe, and
the 100 GbE I/O module is not supported on this platform.
When a 32Gb Fibre Channel I/O module is being installed, it is recommended to always
use I/O module slot 0 first unless the system currently contains or in the future will contain
a 100 GbE I/O Module. In this case, the Fibre Channel I/O module can be installed in slot
1.
Fibre Channel ports are available on I/O modules that are inserted into I/O module slots
on the nodes. The Fibre Channel I/O module is 16-lane PCIe Gen3. On PowerStore 1000
– 9200 models, I/O module slot 0 is also 16-lane while I/O module slot 1 is 8-lane. If Fibre
Channel I/O modules are installed in both I/O module slots, it is recommended to cable
the ports in I/O module slot 0 first, due to the PCIe difference. The PCIe lanes in I/O
module slot 1 are only a limiting factor for total MBPS, and only when all four ports on the
Fibre Channel I/O module are operating at 32 Gb/s. Both I/O module slots on PowerStore
500 are 8-lane PCIe and therefore, there is no slot preference.
With PowerStoreOS 3.0, a new 2-Port Ethernet card is introduced that supports speeds of
up to 100 Gb/s. This 100 GbE card is supported on PowerStore 1000-9200 models in I/O
Module 0 slot.
Jumbo frames (MTU 9000) are recommended for increased network efficiency. Jumbo
frames must be supported on all parts of the network between PowerStore and the host.
The embedded module 4-port card and the optional network I/O modules are 8-lane PCIe
Gen3. When more than two 25 GbE ports are used, these cards are oversubscribed for
MBPS. To maximize MBPS scaling in the system, consider cabling and mapping the first
two ports of all cards in the system first. Then, cable and map other ports as needed.
When PowerStore models that are in unified mode are used for both iSCSI and file
access, it is recommended that you use different physical ports for both NAS and iSCSI.
The embedded module 4-port card and the optional network I/O modules are 8-lane PCIe
Gen3. When more than two 25 GbE ports are used, these cards are oversubscribed for
MBPS. To maximize MBPS scaling in the system, consider cabling and mapping the first
two ports of all cards in the system first. Then, cable and map other ports as needed.
When PowerStore models that are in unified mode are used for both NVMe/TCP and file
access, it is recommended that you use different dedicated physical ports for both NAS
and NVMe/TCP.
Enable Jumbo frames for NAS by setting the cluster MTU to 9000.
Introduction PowerStore allows access to block, file, or both storage types. This section provides
recommendations for the different types of storage resources.
Block storage Block storage resources are accessed through Fibre Channel, NVMe over Fibre Channel,
resources iSCSI, or NVMe over TCP protocols. A host should only access a block resource using
one of these protocols at a time. It is not supported for the same host to access the same
block resource using more than one protocol.
This feature works on block resources that have not had the node affinity manually set by
means of PSTCLI or REST. If the node affinity was manually set, the volume must be
unmapped and then remapped to the host, which will reset the affinity back to “system
selected”. This impacts multipathing only; the system does not need to trespass any
volume between nodes.
This feature is designed to be transparent and seamless to clients. The goal is to achieve
an even throughput, bandwidth, and CPU utilization balance across both nodes within an
appliance, regardless of resource type. The system makes changes automatically without
requiring any admin interaction. This provides balanced hardware utilization, optimizes
performance, and adapts dynamically as workloads change.
Performance policy
All block storage resources in a PowerStore system have a defined performance policy.
By default, this policy is set to Medium. The performance policy does not have any impact
on system behavior unless some volumes have been set to Low Performance Policy, and
other volumes are set to Medium or High. During times of system resource contention,
PowerStore devotes fewer compute resources to volumes with Low Performance Policy.
Reserve the Low policy for volumes that have less critical performance needs.
As this feature is an I/O limiting feature, host performance can be impacted. The impact
on host I/O depends directly on the amount of I/O to the resource and the limit configured.
Having a limit too low can cause performance-related issues, which can be seen as
longer than usual response times and queued I/Os on the host. If the performance impact
is too severe, the QoS limit may need to be adjusted.
Maximum limits are enforced only from I/O that arrives from an external host. These limits
are not enforced on internal synchronous or asynchronous replication or migration I/O.
QoS policies are also not replicated to a remote system. When replication is configured, it
is suggested to configure the same QoS limits on each end of the replication session.
Having different limits in a metro volume configuration may change the pattern of I/O, as a
host may prefer paths that have a higher QoS limit.
Dell Technologies recommends setting QoS on workloads that might monopolize system
resources and starve other applications of their required performance. Consider some of
the following opportunities to utilize PowerStore QoS:
File storage File storage resources are accessed through NAS protocols, such as NFS and SMB. A
resources NAS server can provide access to a file system using all NAS protocols simultaneously if
configured for multiprotocol access.
NAS servers can be manually moved from one node to the other. This action can be done
to balance the workload if one node is busier than the other. All file systems that are
served by a given NAS server move with the NAS server to the other node.
Introduction This section discusses the features and layered applications available with
PowerStoreOS.
Data reduction PowerStore provides data-reduction capabilities such as zero-detect, compression, and
deduplication. Data reduction is integrated into the PowerStore architecture and is always
active. During periods of high write activity, PowerStore may defer the deduplication of
data, and devote those resources to servicing the client workload. During periods of low
activity, PowerStore will use excess resources to re-examine any data written during
these periods for duplicates, to regain any space savings that were not initially realized.
When configuring replication, it is recommended that you use different physical ports for
replication and front-end Ethernet storage traffic. A specific storage network for replication
can be created and mapped to the desired physical ports for replication.
Metro and synchronous replication also require a low latency network (<5ms). As all host
I/O must be written to the local and remote system before acknowledging the host,
network speeds and the performance of the peer system can impact the latency
encountered by the host. It suggested that the local and remote system models be equal
in case a failover of I/O must occur.
Metro Volume In PowerStoreOS 3.0 and higher, PowerStore appliances support native metro volume
replication. This provides synchronous replication of spanned block storage volumes
exclusively for VMware VMFS Datastores in an active/active configuration across two
PowerStore clusters in metro distance. In PowerStoreOS 4.0, volume group support has
been added, along with Windows and Linux support. For more information about Metro
Volume support, see the white paper Dell PowerStore: Replication Technologies. For best
practices for Metro Volume (latency, distance, uniform/non-uniform configurations, and so
on), see the white paper Dell PowerStore: Metro Volume. Both are available on the
PowerStore Info Hub.
Snapshots and All storage resources in PowerStore are thinly provisioned and space-efficient, including
thin clones snapshots and thin clones. Creation of a snapshot or thin clone requires only a quick
duplication of pointers. After this action, they behave as independent storage resources
and do not impact the performance of the source resource.
Secure In PowerStoreOS 3.5 and later, the optional secure snapshot setting allows you to create
snapshots snapshots for volumes and volume groups. When the secure snapshot setting is enabled,
the snapshot is protected from deletion until the retention period expires. This provides a
cost-effective line of defense against ransom attacks and accidental deletion of
snapshots, volumes, or volume groups. Note that after it is set, the retention period cannot
be reduced by the user. It is therefore important to keep this in mind when defining it.
Secure snapshots can only be terminated after they expire or by customer-authorized Dell
Support.
Storage Direct In PowerStoreOS 3.5 and later, Storage Direct is available. With Storage Direct, users
can back up volumes and volume groups directly to a PowerProtect DD series appliance
running on-premises or in the cloud. This feature eliminates the requirement of a backup
host because all backup traffic is offloaded to the storage appliances. PowerStore uses
the replication tagged storage ports to connect and transfer data to the PowerProtect DD
appliance leveraging the DD Boost protocol. As with replication, it is recommended that
you use different physical ports for data protection and front-end Ethernet storage traffic.
(iSCSI), Storage (NVMe/TCP), and Replication. This feature allows storage networks for
host connectivity and dedicated networks for replication. When using Storage Direct, it is
required that the Replication purpose only be added to a single storage network within the
cluster. The Storage (iSCSI) purpose must be assigned to the network with the
Replication purpose and be configured on a port/network that has connectivity to the
remote PowerProtect appliance.
Cluster Block storage resources that are migrating between appliances in a cluster may see
migrations impacted performance from the migration activity. It is recommended to run migrations at
a time when the resource is less busy.
PowerStoreOS New versions of the PowerStoreOS are applied using a nondisruptive upgrade process.
upgrades Because half of the system hardware resources are unavailable during parts of the
upgrade, it is recommended to perform upgrades during planned maintenance windows.
Alternately, perform upgrades when the system is less busy to minimize the impact to
clients. Users should execute a Pre-Upgrade Health Check before their scheduled
maintenance window to ensure that any issues can be resolved.
Introduction This section highlights host configuration changes that may be necessary to access
PowerStore volumes efficiently. For details about the appropriate settings for a host type,
see the Host Connectivity Guides on E-Lab Navigator.
Host Because PowerStore is a new class of storage, host operating systems may not natively
configuration recognize PowerStore volumes and apply the appropriate settings. For optimal
performance, check that the appropriate configuration changes have been applied to all
hosts that are connected to a PowerStore. The Host Connectivity Guides on E-Lab
Navigator have recommendations for the following:
• MPIO settings: Path checker and timeout values
• iSCSI settings: Time-out and queue depth values; disabling delayed ACK
• Fibre Channel settings: Queue depth values
• Network settings: Jumbo frames and flow control
• Unmap operations
• VMware ESXi claim rules
For other recommended configurations for VMware ESXi and vSphere, see the document
Dell PowerStore: Virtualization Integration.
Host file systems When a host is attached to a PowerStore block volume, the host can use this volume as a
raw device, or it can create a local file system on the volume first. When a local file
system is being created, it is recommended to disable SCSI unmap. When PowerStore
creates a volume, all space is already unmapped; the host-based unmap is redundant
and generates unnecessary load on PowerStore.
When creating a local file system, it is recommended to use a file system block size
(allocation unit) that is an even multiple of 4 KB.
It is typically not necessary to perform alignment when creating a local file system. If
alignment is performed, it is recommended to use an offset of 1 MB.
For other recommended configurations for VMware ESXi and vSphere, see the document
Dell PowerStore: Virtualization Integration.
Application PowerStore is well integrated with the most widely used enterprise applications. For best
considerations practice recommendations for specific applications, see the solutions-focused white
papers available on the PowerStore Info Hub.
Conclusion
Summary This white paper provides configuration and usage recommendations for PowerStore in
general use cases. For a detailed discussion of the reasoning or methodology behind
these recommendations, or for additional guidance around more specific use cases,
contact your Dell Technologies representative.
References
Dell The Dell Technologies Info Hub > Storage site provides expertise that helps to ensure
Technologies customer success with Dell Technologies storage platforms.
documentation
Dell.com/powerstoredocs provides detailed documentation about how to install, configure,
and manage PowerStore systems.