Fermilab Computing Division

CS Document 5907-v1

GRACC: New Generation of the OSG Accounting

Document #:
CS-doc-5907-v1
Document type:
Conference
Submitted by:
Kevin M. Retzke
Updated by:
Kevin M. Retzke
Document Created:
16 Feb 2017, 13:15
Contents Revised:
16 Feb 2017, 13:15
DB Info Revised:
16 Feb 2017, 13:15
Viewable by:
  • Public document
Modifiable by:
Abstract:
Throughout the last decade the Open Science Grid (OSG) has been fielding requests from user communities, resource owners, and funding agencies to provide information about utilization of OSG resources. Requested data include traditional “accounting” - core-hours utilized - as well as user’s certificate Distinguished Name, their affiliations, and field of science. The OSG accounting service, Gratia, developed in 2006, is able to provide this information and much more. However, with the rapid expansion and transformation of the OSG resources and access to them, we are faced with several challenges in adapting and maintaining the current accounting service. The newest changes include, but are not limited to, acceptance of users from numerous university campuses, whose jobs are flocking to OSG resources, expansion into new types of resources (public and private clouds, allocation-based HPC resources, and GPU farms), migration to pilot-based systems, and migration to multicore environments. In order to have a scalable, sustainable and expandable accounting service for the next few years, we are embarking on the development of the next-generation OSG accounting service, GRACC, that will be based on open-source technology and will be compatible with the existing system. It will consist of swappable, independent components, such as Logstash, Elasticsearch, Grafana, and RabbitMQ, that communicate through a data exchange. GRACC will continue to interface EGI and XSEDE accounting services and provide information in accordance with existing agreements. We will present the current architecture and working prototype.
Files in Document:
Associated with Events:
CHEP 2016 held from 10 Oct 2016 to 14 Oct 2016 in San Francisco
DocDB Home ]  [ Search ] [ Authors ] [ Events ] [ Topics ]

DocDB Version 8.7.23, contact Document Database Administrators