Fermilab Computing Division

CS Document 2996-v3

CHEP 2009 - Lustre File System Evaluation at FNAL

Document #:
Document type:
Submitted by:
Alexander Kulyavtsev
Updated by:
Alexander Kulyavtsev
Document Created:
12 Nov 2008, 15:16
Contents Revised:
19 Mar 2009, 17:19
Metadata Revised:
21 Apr 2009, 16:32
Viewable by:
  • Public document
Modifiable by:

Quick Links:
Latest Version

Other Versions:
As part of its mission to provide integrated storage for a variety of experiments and use patterns, Fermilab's Computing Division examines emerging technologies and reevaluates existing ones to identify the storage solutions satisfying stakeholders' requirements, while providing adequate reliability, security, data integrity and maintainability. We formulated a set of criteria and then analyzed several commercial and open-source storage systems.

In this paper we present and justify our evaluation criteria, which have two variants, one for HEP event analysis and one for HPC applications as found in LQCD and Computational Cosmology. We then examine in detail Lustre and compare it to dCache, the predominant (by byte count) storage system for LHC data.

After a period of testing we released a Lustre system for use by Fermilab's Computational Cosmology cluster in a limited production environment. The Lattice QCD project will prototype a larger Lustre installation on their Infiniband-based clusters.

Finally, we discuss Lustre's fitness for the HEP domain and production environments, and the possible integration of Lustre with GridFTP, SRM, and Enstore HSM.

Files in Document:
Associated with Events:
CHEP 2009 held from 21 Mar 2009 to 27 Mar 2009 in Prague, Czech Republic
DocDB Home ]  [ Search ] [ Authors ] [ Events ] [ Topics ]

DocDB Version 8.8.9, contact Document Database Administrators