Fermilab Computing Division

CS Document 2998-v1

CHEP09 talk: Multi-Core Communications Architecture

Document #:
Document type:
Submitted by:
Philip DeMar
Updated by:
Philip DeMar
Document Created:
12 Nov 2008, 15:26
Contents Revised:
12 Nov 2008, 15:26
Metadata Revised:
12 Nov 2008, 15:26
Viewable by:
  • Public document
Modifiable by:

Quick Links:
Latest Version

Distributed petascale computing involves analysis of massive data sets in a large-scale cluster computing environment. Its major concern is to efficiently and rapidly move the data sets into computation and send results back to users or storage. However, the needed efficiency of data movement has hardly been achieved in practice. Present cluster operating systems are normally general-purpose operating systems, typically Linux or another UNIX variant. UNIX was developed more than three decades ago, when computing systems were all single core. Computation intensive applications and timesharing were the major concerns. Though the UNIX OS family has evolved through the years, Unix OS network services are not well prepared for distributed petascale computing. The proliferation of multi-core system architectures has added a new dimension of parallelism in computer systems. In this paper, we describe a Multi-core Communication Architecture (MCA) for the distributed petascale computing environment. Our goal is to design OS mechanisms that optimize network I/O operations for multi-core systems. In our proposed architecture, MCA vertically partitions CPU cores on a multi-core system, allocating cores for either computation or communication, respectively. Cores dedicated to communication perform “TCP Onloading.” MCA will dynamically adjust core partitioning, based on detected system loads. CPU cores could be dynamically reassigned between communication and computation. Combined with Receive-Side Scaling and flow pinning technologies, MCA would perform flow scheduling to ensure interrupt- and connection-level affinity for TCP/IP processing.

Files in Document:
Associated with Events:
CHEP 2009 held from 21 Mar 2009 to 27 Mar 2009 in Prague, Czech Republic
DocDB Home ]  [ Search ] [ Authors ] [ Events ] [ Topics ]

DocDB Version 8.8.9, contact Document Database Administrators