Blog For Big Data

Post #21 - As part of this post you need to complete a Research Study. Look at the following Brief and decide which areas interest you the most and start collecting the relevant data. When completed you must post this on your blog (AS Post #21) Choose 4 factors:  Election Backstop Brexit Boris Scandal Generate anomaly dates. The following research study shows anomaly dates using 4 factors relevant to one another over a period of time, these factors include: Election, Backstop, Brexit and Boris Scandal. 

Two types of Traditional statistics in Big data include Descriptive and Inferential. Descriptive means averages and working on sets of numbers. Descriptive statistics is a type of statistic in which a data set is summarised and the characteristics are described. This descriptive data is usually displayed through the use of tables, charts etc. but is most commonly reported as a measure of a central tendency. A central tendency is a typical value for a distribution, it is also been known to be called a location or centre of the distribution. The arithmetic mean is the most common measure of a central tendency, this is the median and the mode. The mean is the average of all the values, the median is the exact middle of the data set while the mode is the most frequent value in the data set.  The goal of traditional statistics is analysing and summarising data, providing tight assumptions about the problem and data distributions as well as using conservative techniques and approaches....

1. Machine Learning Will Be the Next Big Thing in Big Data One of the hottest technology trends today is machine learning and it will play a big part in the future of big data as well. According to  Ovum , Machine learning will be at the forefront of the big data revolution. It will help businesses in preparing data and conduct predictive analysis so that businesses can overcome future challenges easily. 2. Privacy Will Be the Biggest Challenge Whether it is the internet of things or big data, the biggest challenge for emerging technologies has been security and privacy of data. The volume of data we are creating right now and the volume of data that will be created in the future will make privacy even more important as stakes will be much higher. According to  Gartner , more than 50% of business ethics violation by 2018 will be data related. Data security and privacy concerns will be the biggest hurdle for big data industry and if it fails to cope with it in an e...

Big Data is continuously growing, each and every organisation is dealing with more and more data with each passing day and this growth shows no signs of slowing down. There are various reasons for this swift increase in growth, I will now discuss a few of these reasons. Business models are one of the main reasons for this exponential growth through the aggressive and continuous acquisition and permanent retention of data. Google is a perfect example of a business that is retaining vast amounts of data and this is definitely working in their favour as can be seen by their company growth. Infrastructure capacity is another reason for the increase as the cost of data storage has become incredibly low over the past few years while the capacity seems to be increasing almost doubling in the space of a couple of years.  Business analytics has also seen an increased acceleration in the past few years and is now over a 100 billion dollar market and continues to grow year to year. Regul...

There was an incredible amount of internet growth in the 1990s, and personal computers became steadily more powerful and more flexible. Internet growth was based both on Tim Berners-Lee’s efforts, CERN’s free access, and access to individual personal computers. In 2005, Big Data, which had been used without a name, was labelled by Roger Mougalas. He was referring to a large set of data that, at the time, was almost impossible to manage and process using the traditional business intelligence tools available. Additionally, Hadoop, which could handle Big Data, was created in 2005. Hadoop was based on an open-sourced software framework called Nutch, and was merged with Google’s MapReduce. Hadoop is an Open Source software framework, and can process structured and unstructured data, from almost all digital sources. Because of this flexibility, Hadoop (and its sibling frameworks) can process Big Data. Big Data is revolutionising entire industries and changing hum...

Big Data has been described by some Data Management pundits (with a bit of a snicker) as “huge, overwhelming, and uncontrollable amounts of information.” In 1663, John Graunt dealt with “overwhelming amounts of information” as well, while he studied the bubonic plague, which was currently ravaging Europe. Graunt used statistics and is credited with being the first person to use statistical data analysis. In the early 1800's, the field of statistics expanded to include collecting and analysing data. The evolution of Big Data includes a number of preliminary steps for its foundation, and while looking back to 1663 isn’t necessary for the growth of data volumes today, the point remains that “Big Data” is a relative term depending on who is discussing it. Big Data to Amazon or Google is very different than Big Data to a medium-sized insurance organisation, but no less “Big” in the minds of those contending with it. Such foundational steps to the modern conception of...

Big Data  is a term that is used to describe a massive volume of both structured and unstructured  data  that is so  large  it is difficult to process using traditional database and software techniques. In most enterprise scenarios the volume of  data  is too  big  or it moves too fast or it exceeds current processing capacity. Big Data  comes from text, audio, video, and images.  Big Data  is analysed by organisations and businesses for reasons like discovering patterns and trends related to human behaviour and our interaction with technology, which can then be used to make decisions that impact how we live,  work , and play. This Big Data can also  be analysed for insights that lead to better decisions and strategic business moves.