Big Data in Motion

cloud computing big dataOne of the most talked-about new buzzwords in the past year is “big data.” A recent Forbes article points out that big data is not just quantity, but also includes multiple types of data. Having a lot of data sitting around doesn’t really accomplish anything; the real key to big data is being able to analyze large diverse data sets and act on the results. While WAN optimization can’t help you analyze the data, it can help you move the data to the right place as quickly as possible and with the lowest bandwidth cost.

Most of the focus on big data from storage companies concerns how to store, protect and guarantee availability. Analyzing the data is quite a bit more difficult, usually requiring clusters of servers. With large clusters commonly used in enterprise deployments, on-demand cloud computing is typically mentioned in the same breath as big data.

However, there is one problem with analyzing big data in the cloud: moving the data to the cloud.

Journey to the Cloud

Moving big data into the cloud means crossing two big hurdles: location and bandwidth. First, the farther away the cloud data center is from your site, the more latency you have to deal with and the longer it will take for your data transfer. Second, bandwidth is important as well, since insufficient bandwidth means the data transfer will take an excessive amount of time. Add the transfer time to the analysis time and it is possible that the resulting big data analysis will be stale and outdated by the time everything is finished.

As Edd Dumbill from O’Reilly mentioned in a recent article, this brings us to the third hurdle in moving big data to the cloud: velocity. With an exponentially increasing amount of data coming into an organization and skyrocketing analysis requirements (think “streaming data”), incoming data must be analyzed as quickly as possible.

If you are using cloud computing to analyze your big data, and you happen to be located in the same city as the cloud data center, and you have unlimited bandwidth, you are ready to go (and probably aren’t reading this post).

If, however, like most people, you are dealing with latency and limited bandwidth, WAN optimization can help. All of the features that help business move and access data across a WAN also apply to big data movement into the cloud.

Protecting Big Data

Replicating big data over a WAN has the same problems as moving data into a cloud data center. Meeting any replication requirement can be difficult and, as the size of the data grows, so does the complexity. Silver Peak has a long history of optimizing replication over WAN connections, with virtual appliances that scale to 1 gigabit-per-second (Gbps) in WAN capacity and physical appliances that scale to multi-Gbps. Replicating big data is no different. If big data replication is a requirement, Silver Peak can help.

The Last Bit

Whether you are trying to move big data into the cloud or replicate it across a WAN, Silver Peak has a solution that can help. Network Acceleration can overcome the impact of latency, Network Integrity can correct lost and out of order packets, and Network Memory can reduce the amount of bandwidth required to move big data. Big data CAN be moved to the cloud — and Silver Peak can make it a reality.

10 Gig WAN Optimization for Replication

Want to see the world’s highest-performing, highest-capacity WAN optimization appliance in action? Check out this video of the Silver Peak NX-10K optimizing storage replication over a 10 Gbps WAN connection.

Silver Bells for Silver Peak in EMC VNXe Environment

Optimize Celerra replication with EMC VNXe and Silver Peak VX-XpressLast week, I highlighted a cool deployment of the VX-Xpress being quickly and easily installed on HP switches at VMworld Copenhagen. This week, we look at another cool deployment by network and storage systems integrator “SSBrendan,” where he leverages VX-Xpress to help a client optimize Celerra replication with EMC VNXe.

SSBrendan’s client tried to replicate a few NFS volumes between an EMC VNXe located in Charlotte and another located in Atlanta, using the built-in replicator over a private 10Mbps circuit. At first, the client tried to accomplish this without Silver Peak in place. Bad idea. Why? The replication process saturated the link, resulting in a series of disconnects throughout the day.

SSBrendan came to the rescue and deployed Silver Peak’s VX-Xpress virtual WAN optimization appliance at both sites, with an instantaneous improvement in results.  hroughput was much more than the 4 Mbps the transfers consumed, and the reporting charts that accompanied SSBrendan’s Cool Deployment post tell the story. The “Sunday” set of graphics demonstrates how well VX-Xpress helped with the replication of an NFS datastore including about 15 Windows 7 VDI machines. The “Last 4 Hours” set shows replication of a large NFS datastore that contains more than 20 Windows servers of various configurations.

His next step is to encourage his client to buy a pair of VX-2000 10Mbps appliances – smart move!  Maybe Santa will drop them down the chimney for SSBrendan’s client??!!

Birds do it. Fish do it. Let’s all migrate now!

Birds Migrating and data migrationOK. The title of this article is an obscure reference to an old Cole Porter song. And I know it’s a stretch. But hang in there with me.

Have you ever watched a flock of birds migrate in the fall or salmon swim upstream to spawn? It’s amazing to witness. I’m always in awe, wondering how it is that birds and fish travel thousands of miles and arrive in the same destination each year. While I find it amazing, I’m also convinced that this migration is guided by something beyond the birds and fish. Now, strange as it may seem, this example has brought me to the subject of data migration and the role of WAN optimization. Of course! Why wouldn’t it?

If you are responsible for managing data storage, wouldn’t you want to set up your network easily and intuitively to support the migration of data? This is especially true as data is moved to far-away data centers — or into the cloud where network performance can severely limit data throughput. Well, that’s exactly what you can do with Silver Peak’s virtual WAN optimization appliances.

Easing the dangers of data migration

Buffalo and Data Migration similaritiesThere is no doubt that when birds and fish migrate, there are obvious perils and dangers along the way. You’ve also probably seen television programs showing the dangers that water buffaloes face during their migrations. Much in the same way that animals have a driving need to migrate, businesses also have their driving forces for migrating data. Whatever the reasons, there are many challenges that come with migrating data. A couple of obvious examples come to mind: migrating data over networks can be excruciatingly slow, and data can get lost or compromised when sent between locations.

The good news is, just as WAN optimization has proven to improve branch office applications, it also helps avoid many of the risks and costs associated with data migration. Virtual WAN optimization solutions help by moving data faster and more efficiently by de-duping and compressing it, mitigating network latency through protocol acceleration, improving data quality by using Forward Error Correction (FEC) and Packet Order Correction (POC) to overcome dropped and out-of-order packets, and securing data with advanced encryption technologies.

Virtualization makes it especially easy to provision high-capacity WANop technology in support of time-sensitive data migration projects. By supporting any hypervisor, Silver Peak WAN optimization can be deployed in any data center or service provider environment — and on any platform (including routers, switches, servers, blades and storage arrays).  With subscription-based pricing, WANop can be decommissioned at the end of a short-term data migration project, or it can cost-effectively remain in place to support ongoing strategic projects, including data replication. Finally, Silver Peak is the only vendor to support Gbps WAN capacity within a single virtual WANop appliance, making it the ideal solution for large data transfers that accompany many migration projects.

Thomson Snell & Passmore, a UK-based law firm, is a good example of a company that benefited from using Silver Peak’s WAN optimization products to migrate data from their regional offices to a new public cloud offering. The time it took to move data into the cloud was significantly reduced from three and a half weeks to just three days with Silver Peak, saving the company considerable time, resources, and money.

What do you think? Are you ready to heed these examples from nature – and do it? Take advantage of the benefits WAN optimization can bring to your migration initiatives.