Fermilab Computing Division

CS Document 6197-v1

ACAT 17 - A Conditions Data Management System for HEP Experiments

Document #:
CS-doc-6197-v1
Document type:
Conference
Submitted by:
Dave Dykstra
Updated by:
Dave Dykstra
Document Created:
03 Oct 2017, 12:11
Contents Revised:
03 Oct 2017, 12:11
Metadata Revised:
03 Oct 2017, 12:11
Viewable by:
  • Public document
Modifiable by:

Quick Links:
Latest Version

Abstract:
Conditions data infrastructure for both ATLAS and CMS have to deal with the management of several Terabytes of data. Distributed computing access to this data requires particular care and attention to manage request-rates of up to several tens of kHz. Thanks to the large overlap in use cases and requirements, ATLAS and CMS have worked towards a common solution for conditions data management with the aim of using this design for data-taking in Run 3. In the meantime other experiments, including NA62, have expressed an interest in this cross- experiment initiative. For experiments with a smaller payload volume and complexity, there is particular interest in simplifying the payload storage. The conditions data management model is implemented in a small set of relational database tables. A prototype access toolkit consisting of an intermediate web server has been implemented, using standard technologies available in the Java community. Access is provided through a set of REST services for which the API has been described in a generic way using standard Open API specifications, implemented in Swagger. Such a solution allows the automatic generation of client code and server stubs and further allows changes in the backend technology transparently. An important advantage of using a REST API for conditions access is the possibility of caching identical URLs, addressing one of the biggest challenges that large distributed computing solutions impose on conditions data access, avoiding direct DB access by means of standard web proxy solutions.
Files in Document:
Authors:
Notes and Changes:
Several other non-Fermilab authors. Primary author Paul Laycock, CERN.
Associated with Events:
ACAT 17 held on 21 Aug 2017 in Seattle
DocDB Home ]  [ Search ] [ Authors ] [ Events ] [ Topics ]

DocDB Version 8.8.9, contact Document Database Administrators