Big Data Challenges in the Era of Data Deluge
Simple document list
(1 extra document)
- Computing Techniques Seminars
- A Case Study In Public Data Release: Flight Path of Malaysia Airlines MH370
- Big Data Challenges in the Era of Data Deluge
- "The Amazon Web Services"
- HDF5 and The HDF Group
|Full Title:||Big Data Challenges in the Era of Data Deluge|
|Date & Time:||26 Feb 2015 at 13:00|
|Event Location:||WH 1 West|
|Event Topic(s):||Computing Techniques Seminar
|Event Info:||Speaker: Ilya Volvovski, Lead Architect, Cleversafe
For better or worse, the amount of data generated in the world is growing exponentially. 2012 was dubbed the year of Big Data and Data Deluge. In 2013, the petabyte scale was referenced metaphorically, and in 2014, the exabyte was in the vocabulary of storage providers and large organizations. Traditional copy based technology doesn't scale to this size; relational DBs give up on many billions rows in tables, typical File Systems are not designed to store trillions of objects. Disks fail, and networks are not always available. Yet individuals, businesses, and academic institutions demand 100% availability with no data loss. Is this the final dead end? This seminar will discuss design principles for storage based on IDA (Information Dispersal Algorithm) unlimited in scale, with a high level of reliability, availability, and unbounded scalable indexing and metadata support. We will describe important practical elements of a viable commercial large scale storage system which include dsNet broad set of operational characteristics such as: supported interfaces, rebuilding capabilities, performance characteristics, system installation, upgrade, configurability, expansion, security, monitoring, disk management, disk failure prediction and failure management, limping hardware handling, and the Cleversafe dsNet hardware option. Bio:
Ilya Volvovski graduated from the Moscow Institute of Oil and Gas and holds a Master Degree in Applied Mathematics. During his career he has worked for major corporations, including Lucent and Swift, as well as start-up companies including Cleversafe, which he joined eight years ago. Ilya is one of the main Cleversafe storage system architects. He is responsible for the overall architecture and is heavily involved in various phases of implementation including defining the Cleversafe storage protocol, SliceStor software layer and implementation of highly optimized backend storage. Currently, his main interest is performance optimization and adapting Cleversafes solution to emerging technologies such as SMR. Ilya is the author of over 25 patents related to distributed storage.