Loading…
This event has ended. View the official site or create your own event → Check it out
This event has ended. Create your own
Be sure to join us at Vault 2017 and register here
View analytic
Wednesday, March 22 • 2:50pm - 3:40pm
Refreshing 100+ TB Per Day Across Data Centers with Voldemort - Felix GV, LinkedIn

Sign up or log in to save this to your schedule and see who's attending!

Feedback form is now closed.
Voldemort is an open-source distributed key-value store with the capability to bulk load data from Hadoop.

At LinkedIn, Voldemort is deployed in a geographically distributed environment across hundreds of servers. Each day, 100+ TB of data need to be refreshed, while continuing to serve sub-millisecond read requests.

This talk will describe the Voldemort architecture, with deep dives on the Read-Only storage format, the compression strategies and the bandwidth minimization schemes that it employs. The design choices and tradeoffs of the system will be explained.

Speakers
FG

Felix GV

Data Infrastructure Engineer, LinkedIn
Felix GV is an engineer on LinkedIn's Data Infrastructure. He works on the Voldemort and Venice projects, supporting use cases that need to refresh 100+ TB per day of data in a geographically distributed fashion, while providing low latency random access to local applications. | | His previous speaking engagements include a talk at the SECR in Moscow, Russia, and several talks at BDM and ETS in Montreal, Canada.


Wednesday March 22, 2017 2:50pm - 3:40pm
Paul Revere C

Attendees (19)