Monday, September 19, 2011

Microsoft's Hyper-V R2 vs. VMware's vSphere: A feature comparison


Microsoft's Hyper-V R2 vs. VMware's vSphere: A feature comparison

By Scott Lowe
Takeaway: VMware and Microsoft are ramping up their virtualization games with relatively new releases. Scott Lowe compares and contrasts some of the major features in vSphere and Hyper-V R2.
Microsoft was late to the virtualization game, but the company has made gains against its primary competitor in the virtualization marketplace, VMware. In recent months, both companies released major updates to their respective hypervisors: Microsoft’s Hyper-V R2 and VMware’s vSphere. In this look at the hypervisor products from both companies, I’ll compare and contrast some of the products’ more common features and capabilities. I do not, however, make recommendations about which product might be right for your organization.
Table A compares items in four editions of vSphere and three available editions of Hyper-V R2. Below the table, I explain each of the comparison items. (Product note: With the release of vSphere, VMware has released an Enterprise Plus edition of its hypervisor product. Enterprise Plus provides an expanded set of capabilities that were not present in older product versions. Customers have to upgrade from Enterprise to Enterprise Plus in order to obtain these capabilities.)
Table A
Click the image to enlarge.
Max host processors. Indicates the number of physical host processors that can be recognized by the system. Bear in mind that the Windows columns are Windows limits and not necessarily Hyper-V limits.
Max cores/processor. How many processor cores per physical processor are recognized?
Max virtual SMP. In an individual virtual machine, this indicates the maximum number of supported virtual processors. Note: This is a maximum value; not every guest operating system can support the maximum number of virtual processors.
Max host RAM (GB). The maximum amount of RAM recognized by the hypervisor.
Max RAM/vm. The maximum amount of RAM that can be allocated to an individual virtual machine.
Failover nodes. The maximum number of physical hosts that can be clustered together. N/A indicates that failover clustering is not supported for that particular hypervisor edition.
Memory overcommit. Does the hypervisor support memory overcommit? Memory overcommitment is a technique available in vSphere that allows administrators to allocate more RAM to virtual machines than is physically available in the host. There are numerous pro and conarticles about this topic, but it’s clear that having the ability to allocate more resources than are physically available increases overall virtual machine density. The decision to use memory overcommit in a production environment is up to each organization. That said, in my opinion, when used in the right circumstances, I can see great benefit in this feature.
Transparent page sharing. Transparent page sharing is one method by which memory overcommitment is achieved. With this technique, common code shared between virtual machines is, itself, virtualized. Let’s say that you have 100 virtual machines running Windows XP for VDI. Using transparent page sharing, RAM isn’t necessarily a major limiting factor when it comes to desktop density on the server. VMware has an excellent example of this technique in action.
Live Migration/VMotion. The ability for the hypervisor to migrate virtual machines between host servers without significant downtime. This is considered one of the most significant availability benefits provided by virtualization solutions.
Simultaneous Live Migration. Can the product utilize its Live Migration capabilities to move multiple virtual machines simultaneously between nodes?
Live guests per host. The number of virtual machines that can be powered on for a maxed-out host. In the real world, I’d be extraordinarily surprised to see anyone getting close to these limits. Virtualization is a great way to lower costs, but there are limits.
Live guests/HA cluster node. If you’re running your hypervisor in a cluster, this is the maximum number of virtual machines that can be active on any single host in the cluster. For vSphere with update 1, if you have eight or fewer cluster hosts, you can run up to 160 VMs per host. With nine or more cluster hosts, that number drops to 40.
Distributed Resource Scheduler. DRS is a technology that enables the migration of virtual machines between hosts based on business rules. This can be a boon for organizations with strict SLAs.
Snapshots per VM. The maximum number of snapshots that can be taken of an individual virtual machine. A snapshot is a point-in-time image of a virtual machine that can be used as part of a backup and recovery mechanism. I find snapshots incredibly useful, particularly on the workstation side of the equation, where a lot of “playing” takes place.
Thin Provisioning. One decision that has to be made early on in the life of any server (virtual or physical) is how much storage to allocate to the system. Too much storage and you waste valuable disk space — too little storage and services crash. In order to maintain reliable services, most IT shops overprovision storage to make sure that it doesn’t run out; but that conservatism adds up over time. Imagine if you have 100 VMs all with 4 or 5 GB of “wiggle room” going unused. With thin provisioning, you can have the best of both worlds. You can provision enough disk space to meet your comfort level, but under the hood, the hypervisor won’t allocate it all. As space begins to run low, the hypervisor will make more space available up to the maximum volume size. Although thin provisioning shouldn’t be used for massive workloads, it can be a huge boon to organizations that want conservatism without breaking the bank.
Storage Live Migration. This feature enables the live migration of a virtual machine’s disk files between storage arrays and adds an additional level of availability potential to a virtual environment.
Distributed Switch. VMware and Microsoft have virtual switches in their products, but only VMware has taken it one step further with the introduction of vSphere Enterprise Plus’ Distributed Switch. According to VMware, “Distributed Switch maintains network runtime state for VMs as they move across multiple hosts, enabling inline monitoring and centralized firewall services. It provides a framework for monitoring and maintaining the security of virtual machines as they move from physical server to physical server and enables the use of third party virtual switches such as the Cisco Nexus 1000V to extend familiar physical network features and controls to virtual networks.” In short, this new capability increases VMware’s availability and security capabilities.
Direct I/O. The ability for a virtual machine to bypass the hypervisor layer and directly access a physical I/O hardware device. There is limited support for this capability in vSphere; the product supports direct I/O operations to a few storage and networking controllers. Called VMDirectPath I/O, this feature can improve overall performance since it eliminates the “virtualization penalty” that can take place when hardware access is run through the hypervisor. There are some major disadvantages to VMDirectPath; for example, VMotion can’t work anymore because of the hardware need. (Note: This feature is different than direct access to disks, which Hyper-V does support.)
Max. partition size (TB). What is the largest partition supported by the hypervisor? Although VHD-based volumes, such as those used by Hyper-V R2, can be up to 2 TB in size, read this blog by Brian Henderson for insight into maximum Windows partition sizes, particularly if you bypass the VHD option altogether and use disks directly.
Application firewall (vShield). According to VMware “VMware vShield Zones enables you to monitor, log and block inter-VM traffic within an ESX host or between hosts in a cluster, without having to divert traffic externally through static physical chokepoints. You can bridge, firewall, or isolate virtual machine between multiple zones defined by your logical organizational and trust boundaries. Both allowed and blocked activities are logged and can be graphed or analyzed to a fine-grained level.” In other words, you don’t need to run traffic through external switches and routers to protect applications from one another.
Virtual instance rights. This is a Microsoft-only right that can seriously lower the overall cost of running Hyper-V R2 in a Windows-only environment. If you use the Data Center edition of Windows, you can run as many Windows Server-based virtual machines as you like without incurring additional sever licensing costs.
Hypervisor licensing. The method by which the product is licensed. Either per host or per processor.

My school’s hypervisor of choice

At Westminster College, we continue to run VMware for its virtualization services. Why? Mainly because it’s tried and true. That said, budget pressure forces us to constantly reevaluate services and priorities. VMware’s total cost is beginning to become more of an issue. As Microsoft continues to improve Hyper-V R2, we will monitor its progress to determine if and when it might be able to replace VMware, although a possible investment in VMware’s VDI product might lock us into VMware for the long haul.
I like VMware’s memory overcommitment capabilities and believe that, if used right, the feature can be a boon when it comes to density, particularly as we look at virtualizing desktop computers. On the other hand, for very Microsoft-centric organizations, Hyper-V R2 makes Microsoft’s hypervisor offering extremely compelling.

Sunday, September 18, 2011

VMware vs. Red Hat: Whose PaaS will rule?


VMware vs. Red Hat: Whose PaaS will rule?

VMware vs. Red Hat: Whose PaaS will rule?

2011
In this week's episode of Cloud Cover TV, the PaaS Master at Red Hat talks about why his company has better credentials than VMware for the Platform as a Service game.
We discuss:
  • The differences between Infrastructure as a Service (IaaS) and Platform as a Service (PaaS) at Red Hat
  • Where are the enterprise developers on PaaS?
  • What applications are being developed on PaaS?
  • Red Hat OpenShift versus VMware Cloud Foundry
  • Owning the whole cloud stack
  • Microsoft's advantage in the cloud platform world

Sunday, September 11, 2011

Creating, configuring, and deleting vSwitches & Port Groups

Before I get started it’s important to understand that, for the most part, the information in this article applies only to VMware ESX. VMware ESXi doesn’t have a Linux-based Service Console like VMware ESX, and therefore doesn’t have a readily-accessible CLI from which to run these sorts of commands. There is a remote CLI available, which I’ll discuss in a future post, but for now I’ll focus only on VMware ESX.
The majority of all the networking configuration you will need to perform on VMware ESX boils down to just a couple commands:
  • esxcfg-vswitch: You will use this command to manipulate virtual switches (vSwitches) and port groups.
  • esxcfg-nics: You will use this command to view (and potentially manipulate) the physical network interface cards (NICs) in the VMware ESX host.
Configuring VMware ESX networking boils down to a couple basic tasks:
  1. Creating, configuring, and deleting vSwitches
  2. Creating, configuring, and deleting port groups
I’ll start with creating, configuring, and deleting vSwitches.

Creating, Configuring, and Deleting vSwitches

You’ll primarily use the esxcfg-vswitch command for the majority of these tasks. Unless I specifically indicate otherwise, all the commands, parameters, and arguments are case-sensitive.
To create a vSwitch, use this command:
esxcfg-vswitch -a <vSwitch Name>
To link a physical NIC to a vSwitch—which is necessary in order for the vSwitch to pass traffic onto the physical network or to receive traffic from the physical network—use this command:
esxcfg-vswitch -L <Physical NIC> <vSwitch Name>
In the event you don’t have information on the physical NICs, you can use this command to list the physical NICs:
esxcfg-nics -l (lowercase L)
Conversely, if you need to unlink (remove) a physical NIC from a vSwitch, use this command:
esxcfg-vswitch -U <Physical NIC> <vSwitch Name>
To change the Maximum Transmission Unit (MTU) size on a vSwitch, use this command:
esxcfg-vswitch -m <MTU size> <vSwitch Name>
To delete a vSwitch, use this command:
esxcfg-vswitch -d <vSwitch Name>

Creating, Configuring, and Deleting Port Groups

As with virtual switches, the esxcfg-vswitch is the command you will use to work with port groups. Once again, unless I specifically indicate otherwise, all the commands, parameters, and arguments are case-sensitive.
To create a port group, use this command:
esxcfg-vswitch -A <Port Group Name> <vSwitch Name>
To set the VLAN ID for a port group, use this command:
esxcfg-vswitch -v <VLAN ID> -p <Port Group Name> <vSwitch Name>
To delete a port group, use this command:
esxcfg-vswitch -D <Port Group Name> <vSwitch Name>
To view the current list of vSwitches, port groups, and uplinks, use this command:
esxcfg-vswitch -l (lowercase L)
There are more networking-related tasks that you can perform from the CLI, but for a new user these commands should handle the lion’s share of all the networking configuration. Good luck!

VMware vCenter Server Heartbeat 6.3

VMware vCenter Server Heartbeat 6.3 

vCenter Server Heartbeat Quick Start Guide

vCenter Server Heartbeat Reference Guide

Video Download  

Click on the above Links to download.

Features

  • Manage multiple vCenter Server Heartbeat deployments in groups from a single UI.
    • Distributed vCenter and SQL servers can now be grouped as a pair of servers providing the single business application
    • Group vCenter servers providing management of vSphere infrastructure by Organizational Unit
    • Create groups of vCenter servers by physical location
    • The new tree-structure UI and dashboard view shows rolled up status of the health of the applications and servers within a group. If vCenter Server Heartbeat protection in a group flags the application as unhealthy, then Administrators can quickly drill down to the appropriate server, application, or component to identify the problem.
    • Detailed on-screen logging of switchover / failover status and progress.
    • Improved Management screen layout. All related functions and configuration are now more logically grouped together.
    • Simpler visualization and roll-up status of application and performance monitoring rules and events through collapsible display options for memory, disk, processor, etc.
    • Simpler visualization of alerts, now classified and grouped by alert type.
    • User customizations now can be disabled for diagnostic and support purposes.
  • License for vCenter Server Heartbeat added during Setup — License serial numbers for vCenter Server Heartbeat can be added during Setup and if left blank automatically installs in the 60-day evaluation mode.
  • Support for vCenter Server 4.0 Update 2 — VMware vCenter Server Heartbeat now supports vCenter Server 4.0 Update 2
  • Support for vCenter Server 4.1 — VMware vCenter Server Heartbeat now supports vCenter Server 4.1
  • Native x 64 Support — This release of VMware vCenter Server Heartbeat now provides native x64 support
  • Support for Windows Server 2008 R2 — VMware vCenter Server Heartbeat now supports running on Windows Server 2008 R2 operating system
  • Support for View Composer — This release of VMware vCenter Server Heartbeat now provides support for View Composer v1.1 and v2.0
  • Support for installs on German, Simplified Chinese, and Japanese Windows OS — German, Simplified Chinese, and Japanese language localization for deployments of vCenter Server 4.0 and 4.1
  • Auto-switchover event causes the newly passive server to shut down — See vCenter Server Heartbeat Switchover and Failover Processes in the vCenter Server Heartbeat Reference Guide for more information about this feature.
  • Auto-failover is disabled in a WAN environment — Deploying vCenter Server Heartbeat in a WAN will now disable automatic failover to prevent failover when WAN links are lost.
  • Note: The term vSphere Client is applicable to both vSphere Client and VI Client except where VI Client is specifically stated.

Learning about vCenter Server Heartbeat

VMware provides you with manuals that show you how to work with vCenter Server Heartbeat. Additionally, you can view a video that introduces you to the product and demonstrates a sample installation. To download and play the video:
  1. Click Video Download and save the .zip file to a folder on your computer.
  2. Extract the files into a directory on your system and navigate to the vCSHB_QuickStart_VideoInstall subdirectory.
  3. Double-click the vCSHB_QuickStart_VideoInstall.html file to start the video.

Prior Releases of vCenter Server Heartbeat

Features and known issues from prior releases of vCenter Server Heartbeat are described in the release notes for each release. To view release notes for a prior release of vCenter Server Heartbeat, click the appropriate link:
vCenter Server Heartbeat releases

Before You Begin

Before installing this release, review the vCenter Server Heartbeat Quick Start Guide for important information about environmental requirements and the selection of options during the installation process.

vCenter Server Heartbeat and vCenter Server Compatibility

The vCenter Server Heartbeat Reference Guide provides details on the compatibility of current and previous versions of vCenter Server.
This release of vCenter Server Heartbeat operates on the following platforms:
  • Windows Server 2003 x86 Standard SP2
  • Windows Server 2003 x86 Enterprise SP1 and SP2
  • Windows Server 2003 x64 Enterprise SP2
  • Windows Server 2008 x86 SP1 and SP2
  • Windows Server 2008 x64 SP1 and SP2
  • Windows Server 2008 R2
This release of vCenter Server Heartbeat supports the following versions of SQL Server
  • SQL Server 2005 SP1–SP3
  • SQL Server 2008 including SP1
This release of vCenter Server Heartbeat only supports vCenter Converter Enterprise. This version of vCenter Server Heartbeat does not support vCenter Converter 3.0.3 (Starter edition) or vCenter Converter Standalone 4.0.

Installation Notes for This Release

See the vCenter Server Heartbeat Guides before installing this software. You must verify that your server environment meets the minimum requirements for the network option (LAN or WAN) selected. These guides also address minimum hardware/software requirements and scaling recommendations associated with this release. To view a guide, click one of the following links:
  • vCenter Server Heartbeat Quick Start Guide (PDF)
  • vCenter Server Heartbeat Reference Guide (PDF)
Read the vCenter Server Heartbeat Reference Guide for step-by-step guidance on installing and configuring vCenter Server Heartbeat.

Upgrading to vCenter Server Heartbeat 6.3

This release of vCenter Server Heartbeat 6.3supports upgrades only from previously supported versions. The vCenter Server Heartbeat 6.3 Installer prompts you to perform an upgrade only when a previously supported version of vCenter Server Heartbeat is found. See the Reference Guide for installation requirements and VMware Knowledge Base article 1014435 (vCSHB-Ref-1815) for the upgrade procedures. When downgrading to a previous version of vCenter Server Heartbeat, do not use Setup to uninstall plug-ins. For information about performing plug-in installs/uninstalls please VMware Knowledge Base article 1014435 (vCSHB-Ref-1815).
Note: If upgrading from an Evaluation Version of vCenter Server Heartbeat to a Production Version, refer to VMware Knowledge Base article 1010792 (vCSHB-Ref-1767) for the upgrade procedure.
Upgrading vCenter Server 2.5 and its updates to vCenter Server 4.0 when protected by vCenter Server Heartbeat.
This release of vCenter Server Heartbeat supports upgrading to the latest version of vCenter Server. Perform the Upgrade to vCenter Server Heartbeat 5.5 Update 2 before upgrading vCenter Server. See VMware Knowledge Base article 1010479 (vCSHB-Ref-1764) if protecting vCenter Server only or VMware Knowledge Base article 1010483 (vCSHB-Ref-1765) if protecting vCenter Server with a local SQL database for instructions on how to upgrade vCenter Server 2.5 and its updates to a later version.

Known Issues

This section contains known issues for this release in the following subject areas:

vCenter Server Heartbeat Setup

  • Setup — The recommended minimum display resolution for Setup and vCenter Server Heartbeat Console is 1024 X 768.
    Prior to starting Setup or launching the vCenter Server Heartbeat Console, set the display to a minimum of 1024 X 768.
  • Setup — Installing vCenter Server Heartbeat using the local Administrator account rather than the Domain Administrator account.
    If you intend to install vCenter Server Heartbeat using a local Administrator account rather than a Domain Administrator account, please see VMware Knowledge Base article 1022867 (vCSHB-Ref-1916).
  • Setup — vCenter Server Heartbeat does not support the ` (grave accent) character
    vCenter Server Heartbeat does not support usernames and passwords that use the ` (grave accent) character. Change the vCenter Server password before configuring vCenter Server Heartbeat rules.
  • Setup — If 10GB Mellanox network cards are present, TCP Offload Engine (TOE) must be disabled on all network cards before installation
    If 10GB Mellanox network cards are present, TCP Offload Engine (TOE) must be disabled on all network cards before installing vCenter Server Heartbeat. See VMware Knowledge Base article 1024066 (vCSHB-Ref-1919) for more information about this environment.
  • Install Clone — Prior to starting Setup on the Secondary server, the WebClient service must be set to Manual or Automatic
    If VMware License Server is installed, before starting vCenter Server Heartbeat Setup you must set the WebClient service to Manual or Automatic. Failing to do so will result in an error preventing Setup from progressing.
  • Install Clone — During installation, the backup fails with the error "no drives included in the backup" if command-line tools are missing
    During installation, when the backup is taken, it fails with the error "No drives included in the backup" unless both the Windows Backup Features and Command-line Tools are installed.
    Workaround: Install both the Windows Backup Features and Command-line Tools and then attempt the backup again.
  • Install Clone — During installation on Windows Server 2008 SP2, the restore process may fail with the error "System writer is not found in the backup"
    During installation, when the restore process runs, it may fail with the error "System writer is not found in the backup". This is caused by a problem with permissions on the %windir%\winsxs\filemaps folder contents.
    Workaround: See Microsoft Knowledge Base article http://social.technet.microsoft.com/Forums/en-US/windowsbackup/thread/b5236028-4bfe-400c-90e2-b6d40b08e776 to reset the permissions.
  • Install Clone — Installing vCenter Server Heartbeat in a P2V using the install clone technique with differing disk subsystems may cause the Operating System to fail.
    During installation, with the Primary and Secondary servers having different disk subsystems, the operating system may fail when the restore process runs. This is caused when the restore process overwrites the registry settings for the disk subsystem type on the Secondary server with the values of the Primary server.
    Workaround: Prior to performing the restore process, see VMware Knowledge Base article 1014436 (vCSHB-Ref-1819) to prevent this issue.
  • Upgrade of vCenter Server 2-5 to 4.0 — After switchover, managed ESX hosts enter a 'Not responding' state on vCenter Server 4.0 upgraded from vCenter Server 2.5 when vCenter Server Heartbeat is installed
    During the upgrade procedure from vCenter Server 2.5 and its updates to vCenter Server 4.0, the vSphere Client Managed IP Address field was not cleared.
    Workaround: Launch the vSphere Client and navigate to Administration > vCenter Server Settings > Runtime settings and clear the vCenter Server Managed IP field in the Managed IP Address pane and click OK. See VMware Knowledge Base article 1010483 (vCSHB-Ref-1765).

vCenter Server Heartbeat Administration

  • After a switchover, vCenter Service status displays an Alert with a red status
    After a switchover, vCenter Service reports red for com.vmware.vcIntegrity and displays the alert message "Health data retrieved is invalid".
    Workaround: Manually update vci-integrity.xml file with the correct IP address or Fully Qualified Domain Name (FQDN).
  • When deployed in a WAN configuration, after a switchover or failover, the Update Manager Server starts with a wrong IP address
    This issue appears in WAN deployments, when the network identification of VMware Update Manager Server is configured using the vCenter Server Heartbeat Primary server's Principal (Public) IP address, rather than Fully Qualified Domain Name (FQDN). After a switchover or failover, the Principal (Public) IP address is changed to the Secondary server's while Update Manager Server remains configured with the Primary server's Principal (Public) IP address.
    Workaround: Change the network address and then re-register Update Manager Server according to VMware Knowledge Base article 1013222.
  • DB Files Allocated Space check fails because of a missing performance object
    The VMware SQL Server Plug-in does not evaluate performance counters on 32-bit versions of SQL Server installed on 64-bit Windows Operating Systems.
    Workaround: To prevent alerts from being raised, disable the rule.
  • vCenter Server Heartbeat does not start on Secondary server with the following error message: "VMware vCenter Server Heartbeat failed to initialize: Failed to set packet filter loadstate".
    This error may be accompanied by an IP conflict and can occur after a P2V Install Clone on Windows 2008 R2 if the packet driver fails to install because of a permissions error during driver installation.
    Workaround:
    Manually install the packet filter on the Secondary server. See VMware Knowledge Base article 1009567 (vCSHB-Ref-353) for instructions on how to manually install the packet filter.
  • VCWanUtility may cause the CPU to spike to 50%-100% when executing vCenter health checks.
    This is a know issue with .Net SOAP stack.
    Workaround: To reduce the impact, using the vCenter Server Heartbeat Console, click Applications > Rules. Select the rule and click Edit to increase the default polling interval. Click OK.
  • VCWanUtility may fail to update ESX 3.5 hosts when these are managed by vCenter Server 4.0 and 4.1.
    ESX hosts version 3.5 managed by a vCenter Server 4.0 or 4.1 may fail to successfully reconnect following a failover or switchover.
    Workaround: Re-register the ESX 3.5 hosts against the vCenter Server.
  • VMware License Server service cannot be added to protected set if any of its dependencies are disabled on the passive server.
    When running vCenter Server Heartbeat v4.x with License Server installed on Windows 2008, VMware recommends that the Computer Browser service be changed from Disabled to Manual.
  • vSphere Client left running on the passive server may cause a sweep sync during a switchover.
    When the license server and vSphere Client are installed under C:\program files (x86)\vmware\ or C:\program files\vmware\ then the vSphere Client should not be left running on the passive server when performing a switchover.

vCenter Server Heartbeat Plug-ins

  • State of vSphere Client plug-in not replicated from active server to passive server
    The enabled / disabled state of plug-ins in the vSphere Client are not replicated from the active server to the passive server.
  • Incorrect network configuration might cause vSphere Client Plug-in installation errors
    Installing vCenter Plug-ins through the vSphere Client requires the vSphere Client to connect and download the plug-ins through the Principal (Public) IP address. The Principal (Public) network adapter must be first in the bind order. If vSphere Client is configured with any other IP address, then the installation will fail.

vCenter Server Heartbeat Uninstall/Modify

  • Cannot uninstall Client Tools using the desktop shortcut on Windows 7 if UAC is set to default.
    Workaround: Right-click the Uninstall shortcut and select Run As Administrator.

Resolved Issues

This release includes fixes in the following subject areas:

vCenter Server Heartbeat Setup

  • vCenter Server Heartbeat installation stops when an Oracle service is detected.

vCenter Server Heartbeat Administration

  • UAC on Windows Vista blocks the user from adding server pairs.
  • The Message "Incompatible product: unable to connect to server" when vCenter Server Heartbeat is shutting down.
  • Uninstalling the 5.5.3086 Service Pack removes the R2\logs folder.
  • The Server Configuration wizard reports "License Key valid" when it has in fact expired 60 days after the installation date.
  • After a reboot of the active server, .Net components registering in WMI may cause a delay in the startup of vCenter Server.

vCenter Server Heartbeat Plug-ins

  • Configuring a plug-in user that has spaces in its name requires double quotes to work
  • Setup copies the vCenter Server, SQL Server and System Plug-ins to a location accessible from vCenter Server Heartbeat Console for use during the upgrade procedures.

vCenter Server Heartbeat Rules

  • Some vCenter Server Heartbeat server performance counters are missing when installed on Windows 2008 servers.

Saturday, September 10, 2011

NetApp vStorage Integration: Intelligent Data Management for VMware

NetApp vStorage Integration:
Intelligent Data Management for VMware

http://www.netapp.com/us/communities/tech-ontap/tot-vstorage-0309.html

As the many Tech OnTap articles about VMware over the past several years attest, NetApp and VMware are long-time partners. Our goal is to provide close integration with VMware to aim for the highest possible functionality for anyone deploying VMware® with NetApp® storage. Ongoing integration projects cover a number of areas, including:
In this article, I focus on intelligent data management. Much of the discussion is based on a presentation I gave at VMworld Europe 2009 in conjunction with Scott Davis, Chief data center architect at VMware. (Here is the presentation slide set. For those with access to the VMworld site, you can view the presentation here.)
At VMworld 2008, VMware announced vStorage, an initiative to provide deeper levels of integration with storage functionality provided by partners such as NetApp. NetApp has been working closely with VMware to refine the vStorage APIs and to develop technologies that take advantage of them. (See the sidebar.)
This article focuses on three areas:
  • FlexClone® capabilities for file cloning
  • Thin provisioning
  • Intelligent data copy
In each area, I’ll try to explain what capabilities are available now as well as provide a glimpse of the level of integration you can expect in the future. Where appropriate, I’ll provide links to the technology demos that we showed at VMworld Europe.

Smart Cloning

The use of NetApp FlexClone with VMware has been discussed in a number of previous articles, including a case study about fast provisioning at North Carolina State University. A companion article in this month’s issue discusses rapid provisioning of VMware virtual desktops by using the NetApp Rapid Cloning Utilities (RCU) version 1.
The ability to clone files quickly obviously has great potential utility in a VMware environment. The standard virtual machine (VM) provisioning process requires a full data copy, which can take 5 to 20 minutes, depending on the size of the template VM. By comparison, a file can be cloned by using FlexClone in a matter of seconds. Cloning a VMDK file is just the first step. To make a bootable clone of a virtual machine, you must perform all of the following steps:
  • Identify the source VM to be cloned.
  • Clone the source virtual disk file with FlexClone.
  • Create unique VMs, attaching a newly cloned virtual disk to each VM.
  • Customize each VM to create a unique Windows® instance using a Virtual Center customization specification.
  • Start each VM
RCU is a new tool that helps manage and automate these steps. RCU takes advantage of the new FlexClone capability in Data ONTAP® 7.3.1: the ability to clone individual files. With this new capability, FlexClone can now be used to clone individual VMDK files or entire data stores, resulting in the ability to create thousands of virtual machines in minutes, while using only a small amount of storage capacity beyond that required to store a single virtual machine image.
NetApp TR-3705: NetApp and VMware VDI Best Practices provides complete details of the process for using RCU version 1 to rapidly clone virtual machines in a virtual desktop environment; the process is the same for a virtual server environment.
Individual iSCSI and FCP RDMs and VMDK files in NFS datastores can currently be cloned. Full vStorage integration enhances performance for these use cases and adds the ability to clone VMFS datastores on both iSCSI and FCP LUNs.
RCU version 2 is due out soon. This enhanced version includes a plug-in for VMware Virtual Center. The following demonstration shows the functionality it provides.
Figure 1) Demonstration of NetApp Rapid Cloning Utilities (RCU) integrated with VMware Virtual Center. (Runtime: 5 minutes)
You may be aware that VMware has introduced its own space-efficient cloning capability for virtual desktop environments called “linked clones.” In the future, through the vStorage APIs, this capability will be plumbed directly to the NetApp file FlexClone capability whenever the ESX host is connected to NetApp storage.
Figure 2) Animation illustrating the advantage of NetApp integration for cloning operations.

Thin Provisioning

Thin provisioning is a part of the core NetApp DNA. When NetApp entered the SAN market it was the first major storage vendor to offer thinly provisioned LUNs. However, there are two challenges involved with thin provisioning, with SAN in general, and with VMware in particular.
  • SAN protocols don’t return any error codes when a storage container runs out of space; therefore there’s no defined behavior for what a storage system should do. If a volume runs out of space, a VM may crash.
  • Guest OS file systems are built inside of LUNs on SAN storage. As the file system grows in size, it slowly consumes space in the LUN. However, file systems may also shrink in terms of the space they need, but there is no mechanism for a guest OS to tell an array that blocks are no longer in use and can be returned to the pool of free space.
Improved error handling. With regard to the first challenge, NetApp has a good understanding of how to handle running out of space and how to do thin provisioning in complex environments. At NetApp’s urging, NetApp and VMware approached the SCSI standards community about creating protocol extensions to enable the SCSI protocol to better support thin provisioning.
This standard is now in place and VMware will be enhancing how it operates in thinly provisioned environments. When implemented, VMware will pause a virtual machine when it receives an “End of Space” error, giving the administrator a chance to resume a VM when more space is made available.
As an alternative, a thinly provisioned volume on NetApp storage can currently be configured to “autogrow.” With this feature you can set constraints on how big a LUN or volume can get; when a set threshold is crossed, the LUN automatically receives incrementally more space so that the operation of critical virtual machines is not interrupted.
Typical approaches to improve application performance
Figure 3) Thin provisioning in a VMware environment. Individual volumes share space from the same pool of storage. With the proposed extensions, VMware will pause operations and allow volume size to be increased. NetApp allows space to be increased without interruption.
Space reclamation. The second challenge was described in detail in a previous Tech OnTap article. Briefly, if you have a client file system in a thinly provisioned LUN and—for instance—you create a large file and then delete it, the client file system considers that space free and available; but from the perspective of the storage system that space is still allocated to the client. By running the space reclamation procedure from within NetApp SnapDrive® running on the client operating system, you can periodically free up such space and return it to the free storage pool on the storage system, where it becomes available for use by any thinly provisioned volume. This process works today on physical Windows systems, and it also works in VMware environments in which individual VMs mount LUNs directly by using NetApp SnapDrive.
To further enhance capabilities for thin provisioning, NetApp and VMware are working on a number of additional enhancements:
  • The ability to identify thinly provisioned LUNs using VMware Virtual Center (This prevents the use of VMware thin provisioning on a LUN that is already thin provisioned by the storage system).
  • High utilization alerts that are sent from the storage system to Virtual Center
In addition, NetApp and VMware are exploring the following:
  • The ability to automatically free up space when VMDK files get deleted from thinly provisioned volumes
  • The ability to do space reclamation on VMFS datastores and NFS datastores

Data Copying and Storage vMotion

Storage vMotion is the storage analog of virtual machine vMotion—data in active use by an ESX host can be transparently migrated from one storage pool to another. This provides zero-downtime data migration and simplifies storage maintenance, tiering, load balancing upgrades, and other storage-related tasks.
In the standard VMware storage vMotion, this is accomplished by copying the data from the source storage pool through the ESX server and writing it out to the target storage. This process is time consuming and can have significant performance impact on hosts, storage, and networks.
NetApp has a long history of moving data efficiently during data protection operations by using NetApp SnapMirror® or SnapVault® software, NDMP, and so on. We are working with VMware to connect the existing Data ONTAP data movement engines to storage vMotion so that data can be copied directly from the source storage to the target storage, bypassing the ESX host. If the source and destination storage are on the same storage system, FlexClone is automatically used (when appropriate) to accomplish the desired task.
Figure 4) Animation showing the advantages of integrating storage vMotion with NetApp storage.

Conclusion

In today’s business climate, doing more with less is a necessity. NetApp’s goal is that whenever VMware needs to copy, clone, or move a block of data, an ESX host can simply pass a NetApp storage system the request and it will figure out the most efficient way to accomplish the operation—freeing ESX server CPU cycles and bandwidth for production work. NetApp FlexClone makes it possible to accomplish many tasks that would otherwise require a full data copy in a fraction of the time, using only incremental additional space. Closely integrating NetApp’s advanced thin provisioning capabilities with VMware further boosts storage efficiency for VMware virtual server and virtual desktop environments.
Got opinions about vStorage and VMware data management?

Ask questions, exchange ideas, and share your thoughts online in NetApp communities.

Jamon Bowen
Arthur Lent
Technical Director
NetApp

Arthur is the chief architect for the NetApp Virtualization and Grid Infrastructure Business Unit. As an expert in storage for virtual environments, he is responsible for defining and driving NetApp product capabilities for server virtualization technologies, including VMware ESX, Microsoft® Hyper-V®, and Citrix XenServer. Previously, Arthur was the lead architect responsible for the development of NetApp FC SAN and iSCSI products, providing the technology foundation that enabled NetApp to become a leading iSCSI and FC SAN vendor.