Loading…
Vault 2017 has ended
Be sure to join us at Vault 2017 and register here! 
Back To Schedule
Wednesday, March 22 • 2:50pm - 3:40pm
Refreshing 100+ TB Per Day Across Data Centers with Voldemort - Felix GV, LinkedIn

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
Feedback form is now closed.
Voldemort is an open-source distributed key-value store with the capability to bulk load data from Hadoop.

At LinkedIn, Voldemort is deployed in a geographically distributed environment across hundreds of servers. Each day, 100+ TB of data need to be refreshed, while continuing to serve sub-millisecond read requests.

This talk will describe the Voldemort architecture, with deep dives on the Read-Only storage format, the compression strategies and the bandwidth minimization schemes that it employs. The design choices and tradeoffs of the system will be explained.
Speakers
FG

Felix GV

Data Infrastructure Engineer, LinkedIn
Felix GV is an engineer on LinkedIn's Data Infrastructure. He works on the Voldemort and Venice projects, supporting use cases that need to refresh 100+ TB per day of data in a geographically distributed fashion, while providing low latency random access to local applications. His... Read More →

Wednesday March 22, 2017 2:50pm - 3:40pm EDT
Paul Revere C
  Management

Attendees (18)