Skip to main content

Post #3: Growth of Big Data

There was an incredible amount of internet growth in the 1990s, and personal computers became steadily more powerful and more flexible. Internet growth was based both on Tim Berners-Lee’s efforts, CERN’s free access, and access to individual personal computers.
In 2005, Big Data, which had been used without a name, was labelled by Roger Mougalas. He was referring to a large set of data that, at the time, was almost impossible to manage and process using the traditional business intelligence tools available. Additionally, Hadoop, which could handle Big Data, was created in 2005. Hadoop was based on an open-sourced software framework called Nutch, and was merged with Google’s MapReduce. Hadoop is an Open Source software framework, and can process structured and unstructured data, from almost all digital sources. Because of this flexibility, Hadoop (and its sibling frameworks) can process Big Data.
Big Data is revolutionising entire industries and changing human culture and behaviour. It is a result of the information age and is changing how people exercise, create music, and work. The following provides some examples of Big Data use.
  • Big Data is being used in healthcare to map disease outbreaks and test alternative treatments.
  • NASA uses Big Data to explore the universe.
  • The music industry replaces intuition with Big Data studies.
  • Utilities use Big Data to study customer behaviour and avoid blackouts.
  • Nike uses health monitoring wearable' to track customers and provide feedback on their health.
  • Big Data is being used by cyber security to stop cyber crime.

Comments

Popular posts from this blog

FutureLearn Week 2: Post 1 of 4

Open data has been increasing for some time now with data being made open on various sites globally. There are many advantages to having open data, these advantages include being able to share public data sets so that they can be compared. These open data sources can also be used for environmental purposes or even health issues. Disadvantages of open data would include the fact that the site providing the data would be inherently biased and formed in the opinion of the creator.

Post #1: Definition of Big Data

Big Data  is a term that is used to describe a massive volume of both structured and unstructured  data  that is so  large  it is difficult to process using traditional database and software techniques. In most enterprise scenarios the volume of  data  is too  big  or it moves too fast or it exceeds current processing capacity. Big Data  comes from text, audio, video, and images.  Big Data  is analysed by organisations and businesses for reasons like discovering patterns and trends related to human behaviour and our interaction with technology, which can then be used to make decisions that impact how we live,  work , and play. This Big Data can also  be analysed for insights that lead to better decisions and strategic business moves.

Post 11: (Question 7) Limitations of traditional data analysis

As with all things there will always come limitations to data analysis due to the fact that it is created by humans and is subsequently subject to human error. Some of the limitations that you may come across would be that the data may be incomplete, whether it be missing values, or lack of a section of necessary data. This could severely limit the data's usability. Survey data can also be scrutinised due to the human component. People do not always provide accurate information through surveys and many are likely to not answer truthfully. For example if a person were asked how much alcohol they consume within a week they are likely to say less than their actual intake.