Fermilab Computing Division

CS Document 1823-v1

BEHIND THE SCENES LOOK AT INTEGRITY IN A PERMANENT STORAGE SYSTEM

Document #:
CS-doc-1823-v1
Document type:
Conference
Submitted by:
Gene Oleynik
Updated by:
Gene Oleynik
Document Created:
26 Oct 2006, 20:19
Contents Revised:
26 Oct 2006, 20:19
Metadata Revised:
06 Nov 2006, 09:58
Viewable by:
  • Public document
Modifiable by:

Quick Links:
Latest Version

Abstract:
Fermilab provides a primary and tertiary permanent storage facility for its High Energy Physics program and other world wide scientific endeavors. The lifetime of the files in this facility, which are maintained in automated robotic tape libraries, is typically many years. Currently the amount of data in the Fermilab permanent store facility is 3.6 PB and growing rapidly. The Fermilab "enstore" software provides a file system based interface to the permanent store. While access to files through this interface is simple and straightforward, there is a lot that goes on behind the scenes to provide reliable and fast file access, and to insure file integrity and high availability. This paper discusses the measures enstore takes and the administrative steps that are taken to assure users’ files are kept safe, secure, and readily accessible over their long lifetimes. Techniques such as automated write protection, randomized file and tape integrity audits, tape lifetime strategies, and metadata protection are discussed in detail.
Files in Document:
Authors:
Keywords:
enstore
Associated with Events:
CHEP2006 held from 13 Feb 2006 to 17 Feb 2006 in Mumbai, India
DocDB Home ]  [ Search ] [ Authors ] [ Events ] [ Topics ]

DocDB Version 8.8.9, contact Document Database Administrators