YBT Services Pty Ltd

Big Data is an all-encompassing term for any collection of data sets so large or complex that it becomes difficult to process using traditional data processing applications. The challenges include analysis, capture, curation, search, sharing, storage, transfer, visualization, and privacy violations. The trend to larger data sets equates to additional information derivable from analysis of a single large set of related data, as compared to separate smaller sets with the same total amount of data, allowing correlations to be found to "spot business trends, prevent diseases, combat crime and so on." Scientists, Practitioners of Media and Advertising and Governments alike regularly encounter limitations due to large data sets in many areas. The limitations affect Internet search, finance and business informatics.