History of Big Data

 

The term "Big Data" has been used since the early 1990s, The history and evolutions of Big Data can be split into 3 separate phases where each phase was driven by advancements in technology!


Big Data Phase 1- Structured Content


Data Analysis, Analytics and Big Data originate from the domain of database management. It relies heavily on storage, extraction and optimization techniques that are common in data that is stored in Relational Database Management Systems (RDBMS)


Big Data Phase 2 - Web based Unstructured Content 


From the early 2000s, the internet and web applications started to generate large amounts of data, in addition to the data that these web applications stored in relational databases, IP search and interaction logs started to generate web based unstructured data. Unstructured data sources provides these organisations with new knowledge, such as the needs and behaviours of internet users.


Big Data Phase 3 - Mobile and Sensor-Based Content

The third and current phase in the evolution of Big Data is driven by the adoption of mobile technology and devices and the data they generate. The number of mobile devices and tablets surpassed the number of pcs and laptops in 20211 for the first time. Mobile devices not only give the possibility to analyse behavioural data. but they also give the opportunity to store and analyse location based GPS data.






Comments

Post a Comment

Popular posts from this blog

Strategies for limiting the negative effects of big data

Image
 A well-executed big data strategy can streamline operational costs, reduce time to market and enable new products. Below are listed some strategies that some organisations use. 1. Managing large volumes of data: Big data by itself definition typically involves large volumes of data. Once you have a sense of the data that's been collected it is easier to narrow in on insights by making small adjustments. 2. Finding and fixing quality issues:    The analytics algorithms and artificial intelligence applications built on big data can generate bad results when data quality issues creep into big data systems. These problems can become more significant and harder to audit as data management and analytics teams attempt to pull in more and different types of data 3. Dealing with data integration and preparation complexities:   Some enterprises use a data lake as a catch-all repository for sets of big data collected from diverse sources, without thinking through how the dispa...
Read more

Types of problem suited to big data analysis

Image
Generally, most organisations that deal with Big Data have several goals for Big Data projects. While the primary goal for most organisations is to enhance the experience for the customer, other goals are also considered. When considering Big Data organisations will consider a few things. 1. Trying to decide whether there is true value in Big Data or not. 2. Evaluating the size of the market opportunity. 3. Developing new services and products that will use Big Data 4. Already using Big Data solutions, Repositioning existing services and products to utilise big data 5. Already utilizing Big Data solutions
Read more