DATA DISRUPTION
and available within Databricks , have been around for the past 20 years and haven ’ t really changed . What ’ s making them work is the ability to pump a lot of data through the algorithms to get meaningful results . We ’ re at the forefront of that because Databricks has made it so easy to get as much data as you need into your model , get it in the right shape , manage it and access it via data lakes or warehouses .”
Peart cites Spark ’ s flexibility as one of the main reasons for its success with customers across industries keen to glean insights from the ingestion of historical data blended with real time threat analysis and threat detection . At last year ’ s Spark summit in San Francisco , Databricks CEO Ali Ghodsi highlighted the capability for Spark to provide a user interface dashboard in healthcare to analyse x-ray scans . Peart explains : “ You train the model to understand the difference between tissue and bone while detecting a break or fracture . There are terabytes of data that go into training the model and then you make that visually appealing with an interface that ’ s easy for a medical professional to use and highlight anomalies .”
46 June 2018