Pages

Tuesday, March 1, 2011

Symmetrix Virtual Provisioning (VP) Migrations and Space Reclamation

Pre-2018 post from old blog...please check support.emc.com for latest information.

So I've put on a bit of weight over the last few years and when I talk about thick to thin in a storage context I wish I could apply a thin migration plan to myself but alas the only solution for that is exercise which I don't do enough of at the moment!

Anyhow - migrating to thin pools is something that comes up in discussion on a regular basis and over the last few months I've been privileged enough to author migration plans for and use in anger most of the great tools that EMC have to ensure customers get the very best out of that minuscule 768KB sub-extent size utilized by the Symmetrix VMAX!

Typical migrations usually consist of loads of traditionally provisioned storage arrays that are being consolidated into a new EMC Symmetrix VMAX which in most environments these days is being configured with VP pools were customers are leveraging other technologies such as Virtual-LUN and FAST VP or just simply VP itself.

For those who intend to or are leveraging virtual provisioning pool over-subscription the chances are that you're going to want to strip out the unused zeroes during any inbound data migration......and EMC provide a range of array and host level tools to facilitate this objective.

Array-based migrations to thin pools

On the VMAX itself there are currently two migration methods that you can use to strip out those unwanted zeroes and the products that facilitate this are SRDF and Open Replicator. For those of you who have been around Symms these products have been available for years and are probably the most tried and tested replication products in the enterprise storage market and in VMAX the developers have added the ability to reclaim zeroed space in flight with a few caveats. With SRDF, you must currently use adaptive copy mode and with Open Replicator the control volumes must exist on the Symmetrix VMAX and these methods are the perfect fit for migration purposes.


Host-based Migrations to thin pools

If your migration plan can't leverage an array based method then you're going to ask the host to move the data, which is not ideal as the array should do this for you but is sometimes a necessity for one reason or another. EMC have the tools in this space to help and these are currently Open Migrator/LM and PowerPath Migration Enabler (Host Copy).

Open Migrator/LM is a very powerful product that in its simplest form copies an existing volume to a new VMAX volume and once in sync you choose a time to swap the target device over to be the new source - simple as that. If you are migrating Windows Server 2003 or 2008 machines to your new VMAX and need to correct partition alignment and/or NTFS cluster size then this product can do both - with the applications online.

PowerPath Migration Enabler (Host Copy) is a great feature of PowerPath. Assuming you've PowerPath patched to supported levels you can leverage PowerPath to facilitate an online migration for any device managed by PowerPath irrespective of whether its a LUN from an HP, IBM, EMC or any supported array.

It's also worth noting that many third party vendors at this point including VMware and Symantec support thin reclamation initiatives and recent versions of Storage Foundations and ESXi support various thin-aware features like SmartMove and Storage vMotion that can remove unsed zeros during migrations.

Conclusion

Some of the benefits behind reclaiming contiguous zeroes in flight during a migration are that it minimizes capacity consumption and reduces the load on the array as only extents with data are actually being written to disk. All in all these migration methods can be used to reduce or eliminate the downtime usually associated with such migration activities and reclaim valuable unused capacity.

Those who can't take advantage of these thin friendly migration tools to Symmetrix VMAX you do have the option to run an online Zero Space Reclaim (ZSR) post traditional migration methods which releases blocks of contiguous unused extents back into the pool for reuse.

Sunday, January 2, 2011

vSphere and EMC Symmetrix port flags

Pre-2018 post from old blog...please check support.emc.com for latest information.


My first experience of Symmetrix and VMware host connectivity and provisioning was back in the days of ESX 3.0.0 and DMX-3s running 5771 code and things have changed since then.

On the ESX side no more manual VMFS partition alignment and numerous other changes enabled by the vStorage APIs that are a great show of maturity and integration on both the VMware and storage vendor fronts. On the Symmetrix side we now have VP, FAST-DP, FAST-VP, Virtual LUN, Auto-Provisioning and other significant integration improvements made available via the excellent EMC Virtual Storage Integrator (VSI) plug-ins for vSphere.

What hasn't really changed that much (if you've been through the SPC-2 enablement with ESX 3.x) is the bit settings on the FA ports and with the release of vSphere 4.1 a few months back I revisited the Fibre Channel SAN Configuration Guide that notes the bit settings (or flags) that are required on Symmetrix.

If you are lucky enough to have VMAX and not DMX then the change you'll love is that device masking or 'fibrepath enabled' has changed to Auto-Provisioning groups.  Administrators of large clusters will love this feature as it will save so much time when presenting out new devices or introducing new nodes into the cluster.

My notes on the bit settings are below.

Notes on Symmetrix bit settings for vSphere

NOTE
Always check the EMC E-lab Navigator or EMC Support Matrix for up to date support info.

Requirement copied verbatim from the vSphere 4.1 Fibre Channel SAN Configuration Guide
EMC Symmetrix storage systems work with ESX/ESXi hosts in FC SAN configurations.  Generally, you use the EMC software to perform configurations.  The following settings are required on the Symmetrix networked storage system.  For more information, see the EMC documentation.
  • Common serial number (C)
  • Auto negotiation (EAN) enabled
  • Fibrepath enabled on this port (VCM)
  • SCSI 3 (SC3) set enabled
  • Unique world wide name (UWN)
  • SPC-2 (Decal) (SPC2) SPC-2 flag is required
The ESX/ESXi host considers any LUNs from a Symmetrix storage array with a capacity of 50MB or less as management LUNs. These LUNs are also known as pseudo or gatekeeper LUNs. These LUNs appear in the EMC Symmetrix Management Interface and should not be used to hold data.

The settings in the bullet points are FA port flags and are split into two categories - SCSI port flags and Fibre port flags.

Currently the VMware vSphere 4.1 Fibre Channel SAN Configuration Guide does not note that the ACLX flag is required to enable Auto-Provisioning groups on VMAX nor does not note that the OS2007 bit is optional.

SCSI port flags 

Common_Serial_Number [C] enabled
  • Provides a unique serial number on multiple paths for the same Symmetrix device.
  • Needs to be enabled if multipathing is being used.
SCSI_3 [SC3] enabled 
  • Alters the INQUIRY data to to report that any device on the port supports ANSI version 'SCSI-3 SPC' (0x3).
  • For WSFC guests the SCSI-3 persistent reservation (or [PER] bit) must still be set on the devices it uses that are under cluster control.
  • Required to make use of SPC2.
SPC2_Protocol_Version [SPC2] enabled
  • Alters the ID of the LUN to contain the network address authority (NAA) identifier.
  • The LUN serial number is stored on page 0x80 and the NAA ID is stored on page 0x83.
  • ESX/ESXi 3.x and higher read the INQUIRY data from page 0x83 (NAA id) as opposed to 0x80 (LUN serial number). 
  • In ESX/ESXi, the NAA ID is persistent through reboots whereas the runtime name of the device is not.
  • Required for advanced SAN-aware applications such as VMware Site Recovery Manager and the EMC Virtual Storage Integrator suite.
    SCSI_Support1 [OS2007] enabled (optional for vSphere 4.0 and higher) 
    • From the VMware documentation: "When enabled, this flag provides stricter compliance with SCSI standards for managing device identifiers, multiport targets, unit attention reports, and the absence of a device at LUN 0."

    Fibre Protocol port flags

    ACLX or Fibre path enabled on this port [ACLX] enabled (VMAX 5874 and higher only)
    • Enables Auto-Provisioning Groups on the port.
    VCM_State or Fibre patch enabled on this port [VCM] enabled (DMX3/4 577x only) 
    • Enabled for device masking or volume logix.
    Auto_Negotiate or Auto Negotiation [EAN] enabled
    • Enables a handshake between two ports for optimal data transfer.
    Unique_WWN or Unique world wide name [UWN] enabled
    • Ensures unique World Wide Names in the fibre environment for the array components by using the Symmetrix serial number and port numbers.

    References