Big Data

Synonyms: Data warehouse, Data lakes, Data stores

What is Big Data?

Big Data refers to data that is large, complicated or impossible to process using traditional methods, this was the earliest definition of Big Data. In the early 2000s industry analyst Doug Laney gave a comprehensive definition of Big data. He said Big Data depends on three V’s: Volume, Velocity, and Variety.

Volume: Large volume of data generated from different sources, it could be customer-facing, financial data, equipment data, or logistical data.

Velocity: Operational Data generated from IoT devices, customer interactions with your product, or logistical support for delivery all are high-velocity data that are continuously ingested into data stores.

Variety: Data comes in all formats structured with defined schema and data characteristics to emails, texts, voice messages that are completely unstructured.

Big Data is managed by Chief Data Officer (CDO), Chief Information Officer (CIO), Data managers, Data Admin, Data Scientists, and Data analysts.

Reference Article:

https://nexla.com/resource/introduction-big-data-formats-understanding-avro-parquet-orc/