hybrid cloud

The Real-Time Data Warehouse for Hybrid Cloud

Gary Orenstein
Gary Orenstein

As companies move to the cloud, the ability to span on-premises and cloud deployments remains a critical enterprise enabler.

In this post, we’ll review the basics of a hybrid cloud model for MemSQL deployments to fit conventional and future needs.

MemSQL Background
MemSQL is a real-time data warehouse optimized for hybrid cloud deployments, and excels at operational use cases. MemSQL users are drawn to the ability to load and persist live data at petabyte scale while simultaneously querying that data in real-time.

MemSQL supports deployment on any cloud including offering a managed service called MemSQL Cloud. Today, nearly half of MemSQL customers use cloud offerings in production or test and development deployments. On-premises MemSQL software can be installed and managed by the enterprise.

An Introduction to the MemSQL Hybrid Cloud Model

The MemSQL model begins with the fundamental design principle of a flexible software footprint. With this principle, MemSQL can be run on-premises and in the cloud.

MemSQL in the Cloud

In the cloud, MemSQL offers a managed service where customers can use the database, but do not have to administer the service. This provides any company with the ability to benefit from MemSQL scale and performance, with MemSQL handling cluster operations. When run in the cloud, MemSQL takes advantage of the cloud platform such as low cost scalable storage to store backups and data, and readily available compute to scale query performance and concurrency. MemSQL can also run on any cloud infrastructure-as-a-service.

MemSQL On-Premises

On-premises MemSQL software runs on any modern Linux operating system. It can run on one or hundreds of nodes. There are no dependencies on any hardware, and no dependencies on any cloud provider.

Building on this architectural premise, MemSQL has evolved to have the most advanced database deployment models available.

Building on the flexible software footprint, MemSQL can be deployed:

  • on any server, with a minimum of 4 cores and 8GB of RAM
  • on any modern version of Linux
  • within a virtual machine
  • within a container for test and development
  • on any public cloud provider’s infrastructure-as-a-service platform
  • as a cloud service, managed by MemSQL

This unparalleled flexibility allows enterprises to make big bets on their analytics infrastructure while simultaneously controlling deployment and cost levers throughout the lifetime of an application.

Sample Hybrid Cloud Scenarios

With hybrid cloud as an umbrella, MemSQL fits on-premises, hybrid-cloud, and multi-cloud deployments. Let’s look at each in further detail.

On-Premises Flexibility

Many sensitive workloads require an on-premises deployment which MemSQL easily accommodates. When large amounts of data are produced locally, like for manufacturing analytics, an on-premises model often makes sense.

In addition to running on any Linux, MemSQL provides multiple capabilities for on-premises deployment to shine.

  • Any industry standard hardware
    • Architects can choose the CPU, memory, flash, and disk options that suit their needs
  • NUMA Optimizations
    • Scale-up, multi-core servers can be put to full use
  • Advanced Vector Extensions (AVX) optimizations
    • MemSQL takes advantage of the latest Intel and AMD features
  • Any standard Linux
    • For flexibility across environments in large organizations
  • Virtual Machine Ready
    • MemSQL can easily run in a virtual machine with local or remote storage
  • Containers
    • MemSQL can easily in a Docker container, an ideal way to do development and testing. Running stateful systems like databases within containers for production workloads is still an emerging area.

Together these deployment characteristics make MemSQL an ideal platform for enterprises looking to streamline data center infrastructure.

End of the Appliance

In particular for on-premises workloads, many companies find MemSQL to be an ideal replacement for proprietary appliances. These appliances may originate from the database side such as with Oracle Exadata or SAP HANA. They also frequently come from the data warehouse side such as Netezza or Vertica. In all cases, these customers can realize immediate cost savings of millions of dollars by moving to a database platform like MemSQL covering these workloads with a pure software approach.

Hybrid Cloud Deployments

MemSQL deployments span from on-premises to cloud. That flexibility begins with the simplicity of the replicate database command.

Replicate Database
MemSQL includes the ability to replicate a database from one MemSQL cluster to another MemSQL cluster with a single command. The two clusters do not have to be the same configuration. However, the receiving cluster must have enough capacity to absorb the data being replicated to it.

High Availability and Disaster Recovery in the Cloud

MemSQL replicates data locally within a single cluster across multiple nodes for instant high availability, but additional layers of availability, including disaster recovery, could be deployed by replicating the MemSQL database to the cloud.

Test and Development

Other cloud uses include test and development where data architects can rapidly deploy MemSQL clusters to test a variety of workloads. Experiments can be run to determine the advantages of one instance type over another. Ultimately those deployments can migrate on-premises with much of the heavy lifting already accomplished.

Multi Cloud

Multi cloud deployments are an extension of hybrid cloud and offer provider flexibility. MemSQL can be deployed across several popular clouds such as Amazon Web Services, Microsoft Azure, Google Compute Platform, Digital Ocean and others. This range of choice leaves companies in an advantageous position to make long-term bets on data infrastructure without being tied to a single provider.

Charting An On-Premises to Cloud Security Plan

One of the reasons often cited against moving to the cloud is the lack of an appropriate security model. Understandably, companies want to have this model in place before moving to the cloud.

MemSQL includes robust security mechanisms such as

  • encryption
  • auditing
  • role based access control
  • data use and database architect separation (to help protect against insider threats)

In addition, MemSQL has passed security audits allowing it to retain the most sensitive data at the world’s largest organizations.

The MemSQL security model exists in any deployment. Organizations that begin with a comprehensive security model for an on-premises deployment have the option to retain that model as they move to the cloud.

Managing MemSQL

MemSQL provides a range of management capabilities for easy administration including

MemSQL Cloud Managed Service
MemSQL offers a managed service where customers can consume the database, but do not have to administer the service. This provides any company with the ability to benefit from MemSQL scale and performance, while MemSQL handles the cluster operations.

MemSQL Ops
To quickly provision, manage, and monitor MemSQL clusters

Cloud formation templates
To quickly deploy MemSQL on services such as AWS

Fit with configuration management tools
MemSQL can easily be deployed using configuration management tools like Puppet or Chef

A Comprehensive Approach for Hybrid Cloud Deployments

MemSQL remains the only scalable, real-time data warehouse to provide for all deployment models

  • on-premises with complete hardware and virtual machine flexibility
  • cloud deployments on any provider’s infrastructure-as-a-service
  • a cloud service management by MemSQL

With large companies spending millions to hundreds of millions on database and data warehouse infrastructure, the opportunities to consolidate to a single platform deployed multiple times for multiple use cases is financially compelling.

Start Your Hybrid Cloud Deployment Today

To get started with MemSQL, please visit www.memsql.com

real-time data warehouse

Introducing MemSQL 6.5
The world’s fastest database.
Just got faster.