CS Document 306-v1
Monitoring a Petabyte Scale Storage System
- Public document
- Same as Viewable by
- Fermilab operates a petabyte scale storage system, Enstore, which is the primary data store for experiments' large data sets. The Enstore system regularly transfers greater than 15 Terabytes of data each day. It is designed using a
client-server architecture providing sufficient modularity to allow easy addition and replacement of hardware and software components. Monitoring of this system is
essential to insure the integrity of the data that is stored in it and to maintain the high volume access that this system supports. The monitoring of this distributed system is accomplished
using a variety of tools and techniques that present information for use by a variety of roles (operator, storage system administrator, storage software
All elements of the system are monitored: performance, hardware, firmware, software, network, data integrity.
We will present details of the deployed monitoring tools with an emphasis on the different techniques that have proved useful to each role. Experience with the monitoring tools and techniques, what worked and what did not will be presented.
- Notes and Changes:
- Fermilab Publication number CONF-04-493-CD
- Associated with Events:
- CHEP2004 held from 27 Sep 2004 to 01 Oct 2004 in Interlaken, Switzerland