Statistical Analysis of Web Server Logs using Big Data and Hadoop

Today, it is not uncommon to face data deluge that has brought challenges to every sector across all industries. On the other hand, social networks has brought a platform that facilitates human interaction among themselves which is creating a room to everyone to produce huge data sets using computers and smart phones as well. Moreover, data creation rate in variety of formats is yielding real challenges to traditional technologies. Big Data processing and visualization is current challenge due to data growth with high velocity in variety of data type. To tackle Big Data problems, the methodology applied is in detail investigation of current challenges, identification of technology frameworks and ecosystems, design solutions, implementation of the designed solution and test of implemented solution using Big Data set is taken place. Hadoop ecosystem which is starting point of technological shift from traditional technologies to more advanced and different has shown the change of data and technology landscape.