Fermilab Computing Division

Big Data Challenges in the Era of Data Deluge

Simple document list
(1 extra document)

Full Title: Big Data Challenges in the Era of Data Deluge
Date & Time: 26 Feb 2015 at 13:00
Event Location: WH 1 West
Event Topic(s): Computing Techniques Seminar
Event Moderator(s):
Event Info: Speaker: Ilya Volvovski, Lead Architect, Cleversafe

For better or worse, the amount of data generated in the world is growing exponentially. 2012 was dubbed the year of Big Data and Data Deluge. In 2013, the petabyte scale was referenced metaphorically, and in 2014, the exabyte was in the vocabulary of storage providers and large organizations. Traditional copy based technology doesn't scale to this size; relational DBs give up on many billions rows in tables, typical File Systems are not designed to store trillions of objects. Disks fail, and networks are not always available. Yet individuals, businesses, and academic institutions demand 100% availability with no data loss. Is this the final dead end? This seminar will discuss design principles for storage based on IDA (Information Dispersal Algorithm) unlimited in scale, with a high level of reliability, availability, and unbounded scalable indexing and metadata support. We will describe important practical elements of a viable commercial large scale storage system which include dsNet broad set of operational characteristics such as: supported interfaces, rebuilding capabilities, performance characteristics, system installation, upgrade, configurability, expansion, security, monitoring, disk management, disk failure prediction and failure management, limping hardware handling, and the Cleversafe dsNet hardware option.

Ilya Volvovski graduated from the Moscow Institute of Oil and Gas and holds a Master Degree in Applied Mathematics. During his career he has worked for major corporations, including Lucent and Swift, as well as start-up companies including Cleversafe, which he joined eight years ago. Ilya is one of the main Cleversafe storage system architects. He is responsible for the overall architecture and is heavily involved in various phases of implementation including defining the Cleversafe storage protocol, SliceStor software layer and implementation of highly optimized backend storage. Currently, his main interest is performance optimization and adapting Cleversafe’s solution to emerging technologies such as SMR. Ilya is the author of over 25 patents related to distributed storage.

No talks in agenda

Other documents for this event

CS-doc-# Title Author(s) Topic(s) Last Updated
5523-v1 Big Data Challenges in the Era of Data Deluge Tanya Levshina Computing Techniques Seminars
27 Feb 2015

DocDB Home ]  [ Search ] [ Authors ] [ Events ] [ Topics ]

DocDB Version 8.8.9, contact Document Database Administrators
Execution time: 1 wallclock secs ( 0.16 usr + 0.03 sys = 0.19 CPU)