Hybrid Cloud: The Preferred Approach

I've been a big believer for awhile now that 'Hybrid cloud' was where the industry needs to be going.  It's the big idea that truly allows companies and their IT organizations to seamlessly knit together their internal resources with those of their technology vendors.  And I'm a little biased these days working for a networking company, where it has been painfully obvious for some time that the Network is the key to unlocking a lot of latent demand in external cloud computing... with concerns over data Security, Availability and Performance as the biggest barriers to adopting externally-based Cloud services.

But aren't these insurmountable barriers, only leaving companies able to do 'Private Clouds'?  Well what is a Private cloud?  Some would say it doesn't exist - it's just a new label for what a lot of companies have been trying to accomplish within their data centers for some time now, with key capabilities being Server Virtualization, Automation, Self-service provisioning, and Chargeback for usage-based cost allocation.  Gartner called this Real Time Infrastructure. Others termed it Data Center Automation.  Others Utility Computing. 

The reality is that Hybrid cloud computing is already the preferred approach for organizations as seen in this chart from The Info Pro.  Almost 60% of companies expect to be using Both external cloud services as well as developing internal cloud capabilities.


Hybrid computing is getting top vendor support from the likes of Intel, Microsoft and others.  So we can expect to see the ability to connect across data centers -- safely, efficiently and in a manageable way -- becoming an embedded capability within the component resources that we purchase in the future.

The move to Cloud computing is happening today and the only question is at what rate. A recent Brocade study showed that 60 percent of enterprises expect to have started the planning and migration to a cloud computing model within the next two years, with key business drivers being to reduce cost (30 percent), improve business efficiency (21 percent) and enhance business agility (16 percent).  Other interesting Cloud findings included:

• More than a quarter of large organizations are planning to migrate a cloud model within the next two years; 11 percent within one year
• A quarter of organizations stated that the ability to consolidate the number of data centers was also a critical driver
• The availability of bandwidth was also a deciding factor amongst 14 percent of respondents

Conclusion: Embrace the concept of the Hybrid Cloud, and team with technology vendors that are delivering a roadmap allowing you to execute on that vision as soon as possible.

Cloud Network Optimization validated

With the explosive growth of the Cloud Services market, exceeding $68 billion this year, it was obvious to expect lots of innovation in and around this space.  I had been mostly blogging about efforts in the Cloud Infrastructure and Storage space, and was seeing a microcosm of this opportunity with new classes of optimized gear to speed and secure the links from the customer to the cloud.

We recently have witnessed the emergence of Cloud gateways that appear as local NAS but act as intelligent controllers that cache, optimize, encrypt and convert data from the LAN out to the Storage cloud. Along with TwinStrata, Cirtas, StorSimple, and Nasuni, we can now add Panzura to this vendor list.

But I still expected to see a pure-play Cloud Network product in this area.  A device that performed the caching, dedupe, and encryption of a WAN opt. appliance but specifically aimed at datacenter-to-cloud traffic, where the protocols and acceleration are tweaked for storage data and larger pipes. It would be a network device, not a storage device, thus complementing new products such as EMC VPLEX to speed storage virtualization between data centers and enabling use cases such as VMotion over distance.  I had assumed an established network player would be first to meet this need, but a new player, Infineta, took the brass ring.

Infineta has been very distinct in their positioning, focusing on datacenter to datacenter and not branch office traffic which is the established realm of Riverbed and traditional WAN optimization.  And they released a cool new video on youtube. 

It's ultimately up to the analysts as to how the markets get defined, but with this latest product entry, I'm considering Cloud Storage Networking to be a validated market.  For IT organizations, now's the time to start thinking how you can use these new products to safely and cost-effectively transition archival and nearstore data out to the Cloud.

Cloud Storage Optimization market

A new product category is shaping up in direct response to a new customer need.  As seen in recent stories like "What's keeping Data Storage Out of the Cloud?", companies want to use new Cloud Storage services from providers such as IBM, but they are concerned about the security, availability and cost of the required network connection.  Enter Cloud Storage Optimization.

To bridge this network gap customers face a number of sub-optimal alternatives:

1. Don't worry about it -- probably the most popular approach, which only works if you don't care about your job, or the value of the data going across the wire is so low that it's not a big deal if it takes forever for the transit, or it's hacked, or both.
2. Lease a private connection -- this is an option for 'too big to fail banks' or other major organizations where cost isn't an issue.  But for most companies, the incremental cost of the circuit eliminates the economic savings of the Cloud service.
3. Use a generic WAN optimization box -- Not a great solution as these are software-based appliances designed for lower-bandwidth branch-office connections and a broad mix of transactional data.  The Cloud Storage connection is really a SAN-like 'channel' which will be very data intensive, and will benefit from hardware-based compression and offload processing.  And similar to the private circuit, the cost of the WAN optimization appliance that supports the higher throughput needed for the Cloud storage will cost you more than your annual Cloud storage bill.

What we're seeing in response is an initial first step towards closing this market gap: a new category of Cloud Storage Optimization solutions, or Cloud Storage Gateways.  Representative companies include Cirtas, Twinstrata, Nasuni and StorSimple.  These are all start-ups who seem to be quickly gaining awareness and traction with companies and Cloud Service Providers.

The anatomy of a Cloud Storage Gateway is made of software that either resides within an x86 server (i.e. an appliance) or completely as software that can be deployed within a VM.  They typically are asymmetric (i.e. single-device) solutions often positioned as a NAS filer.  Typical capabilities include NAS-to-Cloud API emulation, WAN Optimization, Caching, In-transit Encryption and Data management features such as snapshots.  As software-based solutions they are flexible, and meant to be affordable and targeted to a more mid-market customer.  Similarly they are intended for not-overly-demanding throughput needs, as there is no purpose-built processor offload. 

For mid-market companies looking to add a Cloud tier of archival or similar offline data storage, these are products to consider.  For enterprises or companies who want to leverage Cloud storage as a nearstore alternative, you will want to wait for next-gen 'Cloud Networking' products built for high-throughput, hardware-assisted optimization, symmetric caching/network de-dupe capabilities, and that integrate with your existing network management framework.

Thank goodness for Twitter

Not sure about you but life is moving pretty fast these days.  And though I have a deep-seated bias against blogs as a medium for serious, thoughtful communication, versus let's say a written letter or a conversation.  Yet, most of the time I can't even muster the time required for a half-way decent blog entry.  

Enter Twitter.  140 characters provide an adequate if staccato means to share an update, a heads up on an event, an interesting Cloud article or just a passing thought.

So if you aren't finding many postings here, then be sure to look for me on Twitter. I'm @mhardi01, and am often posting #cloud related tweets.

One Year in the Cloud

The other day I had the epiphany that I've been working on my company's Cloud effort for a year now.  It was around this time a year ago when a few of us, holed up in a room, were doing some next-gen data center planning with a topic being 'clouds'.  I hadn't given the subject too much thought with regard to our product set up to that point.  But a few promising concepts came out of that meeting and the larger effort took off. 

It's all shaping up to be a big inflection point in the IT business, in some ways a lot like server virtualization, ASPs before that, and the web before that.  Hang on for another great ride.    :)

Share any interesting anecdotes of your experience to date with the Cloud. 

How to Calculate an Accurate Cost of Cloud vs. Cost of Inertia

There was a very helpful article written recently on the 'hidden' costs of using external Cloud storage services.  This is important information when you are sitting down to determine the business case for moving data outside your data center.  The article correctly points out the basic cost for storage from someone like Amazon Web Services can be as little as $0.15 per GB per month, and that volume discounts can bring this down further.  However, additional features to support WORM or information lifecycle management, will increase the pricetag towards $1.00 per GB.

Some services charge to upload data, some to download, some for both.  And if you have too much to send over the wire, you are welcome to send a tape.  But that will cost you, too.

And then there's connectivity costs.  If you are already max-ed out on your internet connection, then moving data to the cloud will require incremental bandwidth.  Some enterprise-class services actually require bundled bandwidth or even direct circuits, in order to provide an SLA.

So if all this sounds daunting, let's look at your current cost of storage.  The rule of thumb is that for any IT capability, the direct cost (i.e. what you buy and deploy) is only 20% of the total cost: the rest is the cost to maintain it.  This indirect cost % appears to be increasing over time -- both a function of improved value in IT products, but also an increase in wages, facilities, energy, etc.  And this is also true for storage.

TCO components of your storage base case need to include the cost of the hardware -- either the entire cost if looking at a 3-year period, or an annual depreciation.  I'd assume you're looking mostly at Arrays, but you may also have servers involved for some supporting application.  Make sure you're comparing apples to apples with the complete outsourced offering.  If this is a decision to buy another NAS filer vs. a contract with someone like Rackspace, then you need to factor-in the complete deployed cost.  Include any installation, training, and related on-site switching expense like for instance local data migration.

Then add system software and/or array-based software licenses.  Add annual maintenance and support fees.  Add the allocated Server Administrator cost for the devices: the annual burdened wages (i.e. salary + 15% or more for taxes, benefits).  This should be a big line item: staff costs are consistently 40% or more of total costs in the data center.  Each admin can manage just so many TBs of storage.  You need to figure this out for your current environment; even if an analyst or vendor study says that one admin FTE can handle 10TB in an ideal world, what really matters is what you are running in your data center today.

We're not done: you can't forget the allocated cost of the data center space.  This includes the rent of the space, and the power, the heating and cooling, and if you need to pay for a set of hands within the facility when changes are made.   I wish I could offer a rule of thumb here, but it depends on whether you have your own data center and what 'tier' of DC it is, or whether you are using a co-lo.  There are variables in terms of wattage density per rack, efficiency of the cooling system, and probably other key variables.  For many companies their problem is that their space is either obsolete or they are out of power, or space, or both.  Anyway, this may take a little work to get to, but you need to add a cost to reflect the data center operations.

Now look at the numbers.  Assuming you are one of the lucky ones who still have the ability to add more storage internally, the business case for using the Cloud should be more compelling, especially where you are talking about a smaller amount of storage, have a smaller (i.e. less scale-efficient) operation, and especially if your needs are more temporary or at least not expected to be consistent over the life of the hardware (e.g. you don't need to use all the storage for all that period of time).

IT is definitely moving thier resources to the cloud, and it's all about the economics.  Sharpen your pencil and make sure you're taking an accurate picture of your internal vs. your expected Cloud storage costs.  Good luck!

Early Cloud Investment makes for a Buyers Market

The $250mil HP-Microsoft deal announced a couple weeks ago speaks to how quickly and seriously the big players have converged on the Cloud opportunity.  Literally before the market has even come to understand what 'Cloud' means, we've seen Cloud deals involving many of the top global IT players including Cisco, EMC, VMware, HP and Microsoft.  Only Oracle-Sun is dialing back their cloud investment.

This is different than the uptake around ASPs many years ago.  Small pure-play start-ups like Corio and Jamcracker were prominent in the market for years with little competition from top IT firms, who instead chose to sit out the market wave and acquire ASP capabilities after the bubble burst. This early involvement of larger players means more vendors with capabilities and expected staying power; in effect two Savvis' for every one GoGrid.  So customers don't have to choose between start-ups who "get it" and dinosaurs who don't.

With more investment, sooner, we can expect the life cycle of the category to be similarly accelerated.  It bodes well for customers looking for validation and future-proofing from leading vendors.  It will probably also shake out the smaller players sooner, as they find themselves competing with established tech brands touting seemingly less-risky solutions.  Perceived security and 'trust' will be key aspects of success, especially in the hosted cloud space.

So with more M&A and investment expected relating to the Cloud, take your time before making big investments, plan with an eye towards federating your external Cloud services with your internal data center environment (rather than creating a hodge-podge of cloud silos), and enjoy a developing buyers market in all things Cloud.