Fermilab Computing Division

CS Document 6718-v5

WLCG Web Proxy Auto Discovery for Dynamically Created Web Proxies

Document #:
Document type:
Submitted by:
Dave Dykstra
Updated by:
Dave Dykstra
Document Created:
23 Apr 2019, 17:39
Contents Revised:
11 Feb 2020, 09:41
Metadata Revised:
11 Feb 2020, 09:41
Viewable by:
  • Public document
Modifiable by:

Quick Links:
Latest Version

Other Versions:
05 Feb 2020, 13:49
30 Oct 2019, 11:42
29 Oct 2019, 17:43
29 Oct 2019, 17:39
23 Apr 2019, 17:39
The WLCG Web Proxy Auto Discovery (WPAD) service provides a convenient mechanism for jobs running anywhere on the WLCG to dynamically discover web proxy cache servers that are nearby. The web proxy caches are general purpose for a number of different http applications, but different applications have different usage characteristics and not all proxy caches are engineered to work with the heaviest loads. For this reason, the initial sources of information for WLCG WPAD were the static configurations that ATLAS and CMS maintain for the Conditions data that they read through the Frontier Distributed Database system, which is the most demanding popular WLCG application for web proxy caches. That works well for use at traditional statically defined WLCG sites, but now that usage of commercial clouds is increasing, there is also a need for web proxy caches to dynamically register themselves as they are created. A package called Shoal had already been created to manage dynamically created web proxy caches. This paper describes the integration of the Shoal package into the WLCG WPAD system, such that both staticly and dynamically created web proxy caches can be located from a single source. It also describes other improvements to the WLCG WPAD system since the last CHEP publication.
Files in Document:
  • Paper pdf (CHEP19_Paper_WPAD.pdf, 210.7 kB)
  • Talk pdf (CHEP19_Talk_WPAD.pdf, 509.4 kB)
Other Files:
Associated with Events:
CHEP 2019 held on 04 Nov 2019 in Adelaide, Australia
DocDB Home ]  [ Search ] [ Authors ] [ Events ] [ Topics ]

DocDB Version 8.8.9, contact Document Database Administrators