DATA DISRUPTION
APPROACHING ITS FIFTH birthday , Databricks ’ founders launched the business after the success of Apache Spark – the world ’ s first unified data engine , created in response to a competition set up by Netflix to deliver an algorithm to predict what people would watch next on its streaming service .
Its creator Matei Zaharia developed the software at UC Berkely in 2009 aiming to overcome the challenge between data and compute . On inception , Databricks handed over the software to the Apache Spark open source foundation ( becoming the largest open source community in big data , with over 1,000 contributors from 250-plus organisations ) and tasked itself with accelerating the adoption of Spark around the world across a range of industries .
So how does it work and provide fuel for data hungry dashboards ?
40 June 2018