Fermilab Computing Division

CS Document 3915-v3

Scaling HEP to Web Size with RESTful Protocols: the Frontier Example

Document #:
Document type:
Submitted by:
Dave Dykstra
Updated by:
Dave Dykstra
Document Created:
17 May 2010, 13:06
Contents Revised:
05 Jan 2011, 10:15
Metadata Revised:
05 Jan 2011, 10:15
Viewable by:
  • Public document
Modifiable by:

Quick Links:
Latest Version

Other Versions:
04 Jan 2011, 16:28
04 Jan 2011, 16:22
The World-Wide-Web has scaled to an enormous size. The largest single
contributor to its scalability is the HTTP protocol, particularly when used in
conformity to REST (REpresentational State Transfer) principles. High Energy
Physics (HEP) computing also has to scale to an enormous size, so it makes sense to
base much of it on RESTful protocols. Frontier, which reads databases with an
HTTP-based RESTful protocol, has successfully scaled to deliver production detector
conditions data from both the CMS and ATLAS LHC detectors to hundreds of
thousands of computer cores worldwide. Frontier is also able to re-use a large amount
of standard software that runs the Web: on the clients, caches, and servers. I discuss
the specific ways in which HTTP and REST enable high scalability and for Frontier. I
also briefly discuss another protocol used in HEP computing that is HTTP-based and
RESTful, and another protocol that could benefit from it. My goal is to encourage
HEP protocol designers to consider HTTP and REST whenever the same information
is needed in many places.
Files in Document:
Associated with Events:
CHEP 2010 held from 18 Oct 2010 to 22 Oct 2010 in Taipei, Taiwan
DocDB Home ]  [ Search ] [ Authors ] [ Events ] [ Topics ]

DocDB Version 8.8.9, contact Document Database Administrators