Custom Lustre Storage solutions

High Performance Storage Cluster Solutions in HPC, Cloud and Big Data Centers

Lustre File System
Key Features
  • Unparalleled Scalability
  • Reliable
  • Proven Performance
  • Cost Effective
  • Open Source, Open Standards

Scaling to tens of petabytes and thousands of clients – considered a best filesystem for storage by many – Lustre is a high performance storage architecture for clusters. The central component of this architecture is the Lustre shared file system, which is currently available for Linux, providing a POSIX-compliant UNIX® file system interface. RAID, Inc. offers custom Lustre solutions with installation & 24/7 support.

arrow Interested in Lustre? Get in touch with an expert now.

Lustre Considered One of Best Filesystems for Storage Because of:

  • Unparalleled Scalability: Scales to tens of petabytes and thousands of clients – a high performance file system virtually without limits
  • Reliability: Deployed in production on many large and small clusters, meeting uptime requirements of business and national security applications
  • Proven Performance: Delivers dramatic increase in throughput and I/O by intelligent serialization and separation of metadata operations from data manipulation
  • Cost Effective: Significantly reduces deployment and support costs through support for industry-standard platforms end heterogeneous networking environments
  • Open Source, Open Standards:  Developed and maintained as open source software with an open networking protocol and POSIX file system semantics, ensuring broad support for industry-standard platforms and heterogeneous networking environments.

Lustre Deployments = Ultra Scalable

The scalability offered by Lustre deployments has made them popular in the oil and gas, manufacturing, rich media, and finance sectors. Most interestingly, a Lustre file system is used as a general-purpose, datacenter back-end file system at a variety of sites, from Internet service providers (ISPs) to large financial institutions. With upcoming enhancements to wide-area support in Lustre networking (LNET) and storage software, the deployments in these market segments should become even more important.

The scalability of a Lustre file system reduces the need to deploy many separate file systems, such as one for each cluster or, even worse, one for each NFS file server. This leads to profound high performance storage management advantages, for example, avoiding the maintenance of multiple copies of data staged on multiple file systems. Indeed, major HPC datacenters claim that for this reason they require much less aggregate storage with a Lustre file system than with other solutions. Hand in hand with aggregating file system capacity with many servers, I/O throughput is also aggregated and scales with additional servers. Moreover, throughput or capacity can be easily adjusted after the cluster is installed by adding servers dynamically.

Lustre Integration w/Other Products

Because Lustre software is open source software, it has been adopted by a number of other computing companies and integrated with their offerings. Both Red Hat and Novell (SUSE) offer kernels with Lustre patches for easy deployment. Some 10,000 downloads of Lustre software occurs every month. Hundreds of clusters are supported Lustre software, with probably many more unsupported installations.

Lustre File System History

The Lustre architecture was first developed at Carnegie Mellon University as a research project in 1999. In 2003, Lustre 1.0 was released and was immediately used on many large production clusters with groundbreaking I/O performance. This performance was due in large part to enhancements to the Linux ext3 file system with high-performance enterprise features.