EMC DMX w/VP as Storage Utility for MSIT SQL

If you are wondering how SQL might work in a virtual environment, consider the following paper from Microsoft.

Green IT in Practice: SQL Server Consolidation in Microsoft IT

To sum it up, SQL has been thought (incorrectly) to be one of the few databases that are best kept on physical, but here Microsoft IT has displayed a sensible approach to identifying and consolidating the right virtualization candidates, through a process they call RightSizing. The Microsoft IT application portfolio consists of about 2,700 applications. There are approximately 100,000 databases on 5,000 SQL Server Instances, most of which are on dedicated hosts. Approximately 20 percent of those hosts reach end-of-life each year and are replaced. Average CPU utilization across these hosts is below 10 percent, indicating significant opportunity for host consolidation.

Microsoft IT developed the RightSizing initiative to ensure effective utilization of servers in the data center and in managed labs. Because significant underutilization occurs, one of the initiative’s first tasks was for Microsoft IT to identify underutilized servers that might be good candidates for virtualization (for more information on RightSizing, see Resources). The Capacity Management team relies on RightSizing data.

To accurately compare the performance of server platforms of varying architectures, Microsoft IT has developed a Compute Unit (CU) formula for each server platform that utilizes an industry standard, architecture-agnostic, benchmark suite from the Standard Performance Evaluation Corporation (SPEC). The SPEC benchmarks are developed in such a way to allow a repeatable test with strict result submission requirements. The Microsoft IT CU formula uses a baseline (not peak) benchmark that measures the rate of integer calculation work a server platform can perform in a given amount of time.

They compare a lot of before and after scenario’s in the paper.

  • “Before” is mostly an app on a server with direct attached storage.
  • “After” is the new storage utility based model.

The new model places all of these SQL-based app’s atop an EMC DMX-based storage utility that dramatically raises the performance, scalability, and availability needs they had previously offered their users.   They use the DMX Virtual Provisioning (our implementation of thin provisioning) to preallocate (400) 300GB drives and eliminate the need for host additions and re-zoning and all that junk. It’s a perfect use case for DMX VP.  I attached a whitepaper on this at the end of this post.

Some highlights from the paper:

Their storage utility and virtualization approach, in comparison to their older DAS/legacy environment, is quite GREEN: it saves power and money.

legacy-vs-new

Some performance tips for virtualizing SQL with Hyper-V:

  1. Crawl, walk, run. Don’t go for the maximum host consolidation ratio right away. Begin with the smaller workloads, validate your deployment, and refine the plan. Maximize your resource utilization in phases after establishing and evaluating your actual utilization.
  2. Use Hyper-V pass-through disk or fixed Virtual Hard Disks (VHDs) for storage (Figure 6). Fixed VHDs offer some manageability benefits but provide slightly lower performance. Moving a guest to another host, for example, is simplified when using VHDs.
  3. Do not overcommit processors for SQL Server guests. Begin with one logical processor for one physical processor. Verify your performance and refine your configuration as needed. At some point, this may include overcommitment, but begin without overcommitment to manage risks.
  4. Avoid the use of emulated devices in Hyper-V. Favor synthetic devices which provide better performance and lower processor overhead.
  5. Establish an operating level agreement (OLA) with performance requirements for your storage provider if they are a separate service. Microsoft IT SQL Server Utility has requirements for 1ms average disk/second read/write for log and 8ms for OLTP data.msit-storage-utility

Their Approach (build a solid foundation):

The Storage Utility service provides shared or dedicated SAN storage to which data center servers can connect. The service provides the SAN storage and all hardware required to connect a server to the SAN, as well as all maintenance and management functions, but does not provide the server itself.

An effect of the Storage Utility was that instead of engineering and purchasing small, medium, large servers with anticipated DAS for SQL Server and other server types, Microsoft IT was able to modify the standard builds so that minimal DAS was included in the purchase. This means that application support teams no longer had to anticipate disk capacity over the life of the server which usually resulted in underutilization.

Their Storage Utility Configuration:

san-sql-utility

You can learn more about EMC DMX Virtual Provisioning in this paper:

Implementing Virtual Provisioning on EMC Symmetrix DMX with Microsoft SQL Server 2005

Advertisements

One thought on “EMC DMX w/VP as Storage Utility for MSIT SQL

  1. Pingback: Thin/Virtual Provisioning and Windows 2008 Formatting Confusion « Brian’s Power Windows Blog

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s