Fermilab Computing Division

CS Document 505-v1

Managed Data Storage and Data Access Services for Data Grids

Document #:
CS-doc-505-v1
Document type:
Conference
Submitted by:
Marcia A Teckenbrock
Updated by:
Marcia A Teckenbrock
Document Created:
20 Sep 2004, 15:18
Contents Revised:
23 Sep 2004, 16:50
Metadata Revised:
11 Feb 2009, 15:21
Viewable by:
  • Public document
Modifiable by:

Quick Links:
Latest Version

Other Versions:
CS-doc-505-v0
20 Sep 2004, 15:18
Abstract:
The LHC needs to achieve reliable high performance access to vastly distributed storage resources across the network. USCMS has worked with Fermilab-CD and DESY-IT on a storage service that was deployed at several sites. It provides Grid access to heterogeneous mass storage systems and synchronization between them. It increases resiliency by insulating clients from storage and network failures, and facilitates file sharing and network traffic shaping.

This new storage service is implemented as a Grid Storage Element (SE). It consists of dCache as the core storage system and an implementation of the Storage Resource Manager (SRM), that together allow both local and Grid based access to the mass storage facilities. It provides advanced functionalities for managing, accessing and distributing collaboration data.

USCMS is using this system both as Disk Resource Manager at Tier-1 and Tier-2 sites, and as Hierarchical Resource Manager with Enstore as tape back-end at the Fermilab Tier-1. It is used for providing shared managed disk pools at sites and for streaming data between the CERN Tier-0, the Fermilab Tier-1 and U.S. Tier-2 centers

Applications can reserve space for a time period, ensuring space availability when the application runs. Worker nodes without WAN connection can trigger data replication to the SE and then access data via the LAN. Moving the SE functionality off the worker nodes reduces load and improves reliability of the compute farm elements
significantly.

We describe architecture, components, and experience gained in CMS production and the DC04 Data Challenge.

Files in Document:
Notes and Changes:
Fermilab Publication number CONF-04-472-CD
Associated with Events:
CHEP2004 held from 27 Sep 2004 to 01 Oct 2004 in Interlaken, Switzerland
DocDB Home ]  [ Search ] [ Authors ] [ Events ] [ Topics ]

DocDB Version 8.8.9, contact Document Database Administrators