Fermilab Computing Division

CS Document 1651-v1

Distributed Data Access and Resource Management in the D0 SAM System

Document #:
CS-doc-1651-v1
Document type:
Conference
Submitted by:
Igor Terekhov
Updated by:
Igor Terekhov
Document Created:
26 Jul 2006, 13:02
Contents Revised:
26 Jul 2006, 13:02
Metadata Revised:
16 Dec 2008, 13:11
Viewable by:
  • Public document
Modifiable by:

Quick Links:
Latest Version

Abstract:
SAM (Sequential Access through Meta-data) is the data
access and job management system for the D0 high energy
physics experiment at Fermilab. The SAM system is being
developed and used to handle the Petabyte-scale experiment
data, accessed by hundreds of D0 collaborators scattered
around the world. In this paper, we present solutions to
some of the distributed data processing problems from the
perspective of real experience dealing with mission-critical
data. We concentrate on the distributed disk caching, resource
management and job control. The system has elements
of the Grid Computing and has features applicable
to data-intensive computing in general.
Files in Document:
Keywords:
D0 Data Handling SAM
Publication Information:
Journal. page 87???
DocDB Home ]  [ Search ] [ Authors ] [ Events ] [ Topics ]

DocDB Version 8.8.9, contact Document Database Administrators