Managing Big Data Storage: Intelligent Open Source Software and a Unified Platform

All too often, enterprise IT teams are forced to react to the onslaught of data by creating storage silos, each with its own IT operations model. Traditionally, there is a storage silo for each application workload: database data; a silo for shared file data; a silo for web object data; and so on. This reactive approach can not only increase the capex for storage but can create a huge impact on on-going operational expenses – different management tools, different provisioning tools, different skill sets. Given the size and rapid growth of data, and the prohibitive cost of copying large data sets around the enterprise, enterprises simply cannot afford to build dedicated storage silos.

The ideal approach is to have all the data reside in a general enterprise storage pool and make the data accessible to many enterprise workloads. This provides a unified platform to procure, provision, and manage enterprise storage that is agnostic to the type of data such as files, objects, and semi-structured or unstructured data. By implementing these solutions, organizations will start to realize huge benefits in reduced operating expenses and increased service levels to end users.

In addition, a centralized approach to data management is no longer feasible in the age of big data. Data sets are too large, WAN bandwidth is too limited, and the consequences of a single point of failure are too costly. A big data storage platform must be able to manage data through a single, unified pool distributed across the global enterprise.

And, rather than attempting to protect against failure through the use of proprietary, enterprise-grade hardware, an open big data storage platform can assume that hardware failure is inevitable and offer reliable data availability and integrity through intelligent software. Accomplishing this requires a different approach by storage software vendors – one that is based on community-driven innovation. Community-driven innovation is the hallmark of a true open source approach to solving enterprise storage problems. For example, the emerging area of big data alone has more than 100 distinct open source big data projects with thousands of software developers contributing code, enhancing features, and increasing stability. It is hard to match this pace of innovation when software is being written within a vendor’s four walls.

For more information on how Red Hat Storage helps resolve the big data challenge by creating a unified enterprise storage platform, visit www.redhat.com/liberate.