[School-of-data] BIG data... What is BIG?

Simon Cropper simoncropper at fossworkflowguides.com
Wed Jul 9 14:53:32 UTC 2014


I have been exploring various projects that claim to handle BIG data but 
to be honest most do not qualify what BIG actually means.

I remember the days when programs specified the maximum number of 
records, maximum number of fields and maximum number of tables in a 
database that could be manipulated at any one time. Why don't these 
types of specs get provided for languages and libraries anymore?

What are people's impression of what BIG actually means when used to 
describe large datasets?

To me BIG is millions of records and multiple linked tables.

Cheers Simon

    Simon Cropper - Open Content Creator

    Free and Open Source Software Workflow Guides
    Introduction               http://www.fossworkflowguides.com
    GIS Packages           http://www.fossworkflowguides.com/gis
    bash / Python    http://www.fossworkflowguides.com/scripting

More information about the school-of-data mailing list