High Impact Factor : 4.396 icon | Submit Manuscript Online icon |

Challenges within Big Data and Big Data Analysis

Author(s):

Suvarna Chandrakant Patil , AGTI?s Dr. Daulatrao Aher College Of Engineering, Karad, Shivaji university Kolhapur, Maharashtra INDIA.; Chavan Dhanshree Sanjay, AGTI?s Dr. Daulatrao Aher College Of Engineering, Karad, Shivaji university Kolhapur, Maharashtra INDIA.; Pawar Trupti Bapurao, AGTI?s Dr. Daulatrao Aher College Of Engineering, Karad, Shivaji university Kolhapur, Maharashtra INDIA.; Kharat Tejuswini Ashok, AGTI?s Dr. Daulatrao Aher College Of Engineering, Karad, Shivaji university Kolhapur, Maharashtra INDIA.; Patil Ashish Nandkumar, BVDUCOE, PUNE.

Keywords:

Apache; Data Analysis; Hadoop

Abstract

This paper gives overviews on the salient features of Big Data analysis and its challenges. We face daily challenges in data network like where to put it, data complexity, data management etc. It is difficult to process and store a large amount of data in Relational Database management system (RDBMS). Methods for querying and mining Big Data are fundamentally different from traditional statistical analysis on small samples. Big Data is often noisy, dynamic, heterogeneous, inter-related and untrustworthy. Nevertheless, even noisy Big Data could be more valuable than tiny samples because general statistics obtained from frequent patterns and correlation analysis usually overpower individual fluctuations and often disclose more reliable hidden patterns and knowledge. Big Data brings new opportunities to modern society and challenges to data scientists.

Other Details

Paper ID: IJSRDV6I11237
Published in: Volume : 6, Issue : 1
Publication Date: 01/04/2018
Page(s): 1692-1695

Article Preview

Download Article