Fermilab Computing Division

CS Document 5009-v1

CernVM-FS - A Scalable and Low Maintenance Software Distribution Service

Document #:
CS-doc-5009-v1
Document type:
Presentation
Submitted by:
Dave Dykstra
Updated by:
Dave Dykstra
Document Created:
08 Feb 2013, 13:52
Contents Revised:
08 Feb 2013, 13:52
Metadata Revised:
08 Feb 2013, 13:52
Viewable by:
  • Public document
Modifiable by:

Quick Links:
Latest Version

Abstract:
The CernVM File System (CernVM-FS) provides a scalable and low maintenance software distribution service. CernVM-FS is used by the 4 LHC experiments to distribute collaboration software to Tier-N centers around the grid.
Internally, CernVM-FS uses a form of content-addressable storage which provides data de-duplication and file system snapshots while the data transfer infrastructure can be built around possibly untrusted networks and stateless, plain HTTP servers.

In contrast to the original use, contained in a CernVM virtual machine, the deployment of the file system client on the grid introduced new challenges that have been addressed by recent developments. This presentation will focus on the lessons learned from large-scale grid deployment. A number of features have been recently developed in order to improve the versatility of the file system client and to reduce maintenance and down-time caused by software failures and network glitches.

The presentation will also touch on a potential future use case for CernVM-FS. Due to the strong requirements on POSIX compliance imposed by High Energy Physics application software, CernVM-FS can be used to host and boot a Linux operating system. This allows the creation of a "micro virtual machine" that comprises only a Linux kernel while the operating system is provided on demand by CernVM-FS. The approach speeds up the initial boot time and reduces virtual machine image sizes by an order of magnitude.

Files in Document:
Authors:
Associated with Events:
CERN VM-FS - A Scalable and Low Maintenance Software Distribution Service held on 07 Feb 2013 in FCC1W
DocDB Home ]  [ Search ] [ Authors ] [ Events ] [ Topics ]

DocDB Version 8.8.9, contact Document Database Administrators