Fermilab Computing Division

CS Document 306-v1

Monitoring a Petabyte Scale Storage System

Document #:
Document type:
Submitted by:
JoAnn Larson
Updated by:
Eileen Berman
Document Created:
24 Jun 2004, 18:00
Contents Revised:
23 Sep 2004, 13:54
Metadata Revised:
20 Jan 2005, 10:34
Viewable by:
  • Public document
Modifiable by:
  • Same as Viewable by

Quick Links:
Latest Version

Other Versions:
20 Sep 2004, 17:38
Fermilab operates a petabyte scale storage system, Enstore, which is the primary data store for experiments' large data sets. The Enstore system regularly transfers greater than 15 Terabytes of data each day. It is designed using a
client-server architecture providing sufficient modularity to allow easy addition and replacement of hardware and software components. Monitoring of this system is
essential to insure the integrity of the data that is stored in it and to maintain the high volume access that this system supports.

The monitoring of this distributed system is accomplished
using a variety of tools and techniques that present information for use by a variety of roles (operator, storage system administrator, storage software
developer, user).
All elements of the system are monitored: performance, hardware, firmware, software, network, data integrity.
We will present details of the deployed monitoring tools with an emphasis on the different techniques that have proved useful to each role. Experience with the monitoring tools and techniques, what worked and what did not will be presented.

Files in Document:
  • paper (StoragePaper.pdf, 327.0 kB)
  • poster (storagePoster2.pdf, 1.4 MB)
Notes and Changes:
Fermilab Publication number CONF-04-493-CD
Associated with Events:
CHEP2004 held from 27 Sep 2004 to 01 Oct 2004 in Interlaken, Switzerland
DocDB Home ]  [ Search ] [ Authors ] [ Events ] [ Topics ]

DocDB Version 8.8.9, contact Document Database Administrators