Lustre File-System


Scaling to tens of petabytes and thousands of clients – considered a best file system for storage by many – Lustre is a high performance storage architecture for clusters. The central component of this architecture is the Lustre shared file system, which is currently available for Linux, providing a POSIX-compliant UNIX® file system interface. RAID Inc. offers custom Lustre solutions with installation & 24/7 support.

Today, HPC is a key technology for enterprises of all sizes. Getting maximum performance from HPC and data-intensive applications is a necessity that requires storage infrastructure that scales endlessly and delivers unmatched I/O levels. In partnering with Intel® Enterprise Edition for Lustre software (Intel® EE for Lustre software), RAID Inc. unleashes the performance and scalability of the Lustre parallel file system for HPC workloads, including technical ‘big data’ applications.

Image

RAID Inc.'s Lustre FS offers unparalleled scalability with tens of petabytes and thousands of clients – a high performance file system virtually without limits.

The scalability offered by Lustre deployments has made them popular in the oil and gas, manufacturing, rich media, and finance sectors. Most interestingly, a Lustre file system is used as a general-purpose, datacenter back-end file system at a variety of sites, from Internet service providers (ISPs) to large financial institutions. With upcoming enhancements to wide-area support in Lustre networking (LNET) and storage software, the deployments in these market segments should become even more important.

Lustre file system high availability features include a robust failover and recovery mechanism, making server failures and reboots transparent. Version interoperability between successive minor versions of the Lustre software enables a server to be upgraded by taking it offline (or failing it over to a standby server), performing the upgrade, and restarting it, while all active jobs continue to run, experiencing a delay while the backup server takes over the storage. Lustre to also reduces the need to deploy many separate file systems, such as one for each cluster.  Lustre HSM provides capability to have a primary tier and an archive tier of storage. The ability to migrate things from the, typically more expensive, primary tier to the, typically less performant, archive tier and leave a stub so that files can be restored to primary is an important part of balancing high availability and performance.


Image
Image
RAID Inc., deployed Lustre FS in production on many large and small clusters, meeting up-time requirements of businesses and national security applications. Lustre FS offers reliability with profound high performance storage management advantages, for example, avoiding the maintenance of multiple copies of data staged on multiple file systems. Indeed, major HPC datacenters claim that for this reason they require much less aggregate storage with a Lustre file system than with other solutions. Hand in hand with aggregating file system capacity with many servers, I/O throughput is also aggregated and scales with additional servers. Moreover, throughput or capacity can be easily adjusted after the cluster is installed by adding servers dynamically.

The Lustre architecture was first developed at Carnegie Mellon University as a research project in 1999 and experienced groundbreaking I/O performance as soon as it went into production. Lustre FS is developed and maintained as open source software with an open networking protocol and POSIX file system semantics, ensuring broad support for industry-standard platforms and heterogeneous networking environments. Because Lustre software is open source software, it has been adopted by a number of other computing companies and integrated with their offerings. Both Red Hat and Novell (SUSE) offer kernels with Lustre patches for easy deployment. Some 10,000 downloads of Lustre software occurs every month. Hundreds of clusters supported Lustre software, with probably many more unsupported installations.


Image

Want to know how we can optimize Lustre file-system for HPC?
Talk to an Expert

Storage Systems with Lustre File-System


Enterprises are focused on addressing challenges with data that is expanding at a faster rate like never before. It has become a challenge for industries to perform data utilization at speeds that help faster innovation. Those that can deliver insights faster while managing rapid infrastructure growth are the leaders in their industry. An organization’s underlying storage must support both new-era big data and traditional applications with security, reliability and high-performance. RAID Inc. storage systems optimizes Lustre FS to meet your specific HPC needs and challenges. As a high-performance solution for managing data at scale with the distinctive ability to perform archive and analytics in place.

Image

Gain performance with Lustre FS and RAID Inc. storage systems.
Request a Quote

Case Studies & Other Resources



So many satisfied
Customers

Our Approach


To deliver our tailored HPC solutions, RAID Inc.'s consultative sales and system design process is customized every step of the way. From the initial sales call to installation day, RAID Inc. works closely with clients to assess their unique computing and storage requirements by examining every facet of their computing needs. To learn more about our
6-Step Holistic Approach, 
click here.

Find

RAID Inc. performs rigorous requirements engineering strategies to develop solutions based on the actual need. It incorporates strategic approaches to find and understand your IO performance requirements when deploying systems and storage while keeping your costs low.

Analyze

RAID Inc. analyzes the best systems and storage solutions based on the requirements elicitation performed. With a wide range of compute and networking products available in the market, we deploy the right servers and networking products along with our storage to meet you actual needs.

Solve

RAID Inc. solves your HPC problems in no time. Being an industry leader, we served 1000s of customers in solving their HPC problems. The areas we covered include but not limited to genomic research, space explorations, weather forecasting, gas and oil explorations, governments, educational institutions, defense, life sciences and many others.