Fermilab Computing Division

dCache, approaching the Exascale Cloud era

Full Title: dCache, approaching the Exascale Cloud era
Date & Time: 15 Sep 2017 at 13:00
Event Location: DIR/ One West-WH1W - Wilson Hall 1st fl West
Event Topic(s): Computing Techniques Seminar
Event Moderator(s):
Event Info: Speaker:
Dr. Patrick Fuhrmann, DESY

Patrick is a senior scientist and adviser in the IT department at DESY. He holds a PhD degree in physics from the “RWTH Aachen University”. He is working in the area of Big Data and storage access for more than 15 year. Since 2001 he is leading the international dCache collaboration, providing storage solutions for over 70 scientific laboratories worldwide. He has a long history in holding management positions in German national and European projects in the areas of Big Data and Federated Identity, e.g. the European Middleware Inititive, the European Open Science Cloud pilot, the Large Scale Data Management and Analitics project and the extended Data Cloud project. Patrick is member of various international review and advisory boards for Conference, Scientific Computer centers and European projects. At the time being, he has more than 50 papers published in different areas of his interest and he is teaching computer science at the University of Applied Sciences in Berlin.

For over a decade, dCache has been Femilab's workhorse for storing, accessing and managing massive amounts of data. It serves a variety of scientific communities by providing the necessary standard or domain specific data access and authentication mechanisms. Due to its ability to understand the capabilities of different media types, like SSD, regular spinning disks, shingled disks (SMR) or custodial systems, it offers optimal storage cost for a wide range of use cases, from scratch storage to long term archive. Moreover, policy based internal media transfers, including the creation of multiple replicas of data files within or even outside of dCache, protects the system from data losses and at the same time, reducing the cost of operations. The seamless integration between dCache and the Fermilab custodial storage product, Enstore, offers significant advantages over other data management products. Recently a full HA has been added to dCache, allowing the system to run 24/7, surviving single component failure with only little or no degradation of the overall system performance.

As dCache has became popular not only for mass storage applications but also for every day cloud operations, dCache will allow modifying existing files in particular areas of the dCache namespace, and at the same time keeping the immutable option for mass data in the same dCache instance.

Fermilab is benefiting greatly from being a founding partner in the international dCache collaboration by having full control over its technological direction and ability to adjust the dCache software according to its particular needs within short development cycle. Moreover, as dCache is an international Open Source project, Fermilab takes advantage of code contributions from DESY, the Nordic Data Grid Facility (NDGF), the University of Applied Science in Berlin and other highly respected members of the demanding scientific Big Data community. In this context, dCache became part of development stack of initiatives within the European Open Science Cloud.

This presentation will report on the status of the dCache technology, the dCache.org collaboration, its funding and its short and midterm plans.

No talks in agenda

DocDB Home ]  [ Search ] [ Authors ] [ Events ] [ Topics ]

DocDB Version 8.7.23, contact Document Database Administrators
Execution time: 0 wallclock secs ( 0.24 usr + 0.03 sys = 0.27 CPU)