Session
BackLessons from building VeniceDB
Date: 2018-09-07
Time: 17:30 - 18:20
Room: Market Street
Level: Intermediate
Feedback: Leave feedback
VeniceDB is an OLAP cluster built on top of Citus/Postgres. Currently it hosts about 60TB of Windows Core measure data set to support a portion of executive decision dashboard named Mission Control for Windows executives and engineers to assess various Windows component qualities on a daily basis. VeniceDB is still young as a service, the demand has already been growing.
Traditionally the Windows device centric measure data servicing is done through OLAP cubes generated via MapReduce batch jobs on Cosmos (Hadoop like). Due to the dimensionality growth, it's not economic feasible to maintain the Cubing jobs. We evaluated various technologies before landing on Postgres.
This talk is going through our journey from MapReduce to MPP, and why choosing Postgres and Citus as the underlying platform.