DIGITAL DISRUPTION
54
In most organisations , the volume of data is too big for it to move quickly through system processing , or it exceeds current processing capacity . Big Data is high volume and high variety : it requires new technologies and techniques to capture , store , and analyse it , it is used to enhance decision making , provide insight and discovery , and support and optimise processes . It is always challenging and costly to collect , manage and use , and it is not necessarily relevant to any specific problem or issue to resolve . Gartner defines Big Data as “ high-volume , high-velocity and high-variety information assets that demand cost-effective , innovative forms of information processing for enhanced insight and decision making ”; we must be aware the data we have is not necessarily the data we really need to drive value .
Data lakes are like fishing in a lake – not as large as an ocean , and with a more concentrated type of data . The data lake storage repository holds a vast amount of raw data ( in its native format ) until it is needed . While a hierarchical data warehouse stores data in files
OCTOBER 2019