Hadoop and Big Data Framework: A Technological Comparison of Various Techniques and Tools
Manika Manwal1, Amit Gupta2, Sonali Gupta3, Shiv Ashish Dhondiyal4

1Manika Manwal, Department of Computer Science and Engineering, Graphic Era Hill University, Dehradun, India.

2Amit Gupta, Department of Computer Science and Engineering, Graphic Era Hill University, Dehradun, India.

3Sonali Gupta, Department of Computer Science and Engineering, Graphic Era Hill University, Dehradun, India.

4Shiv Ashish Dhondiyal,. Department of Computer Science and Engineering, Graphic Era Deemed  University, Dehradun, India.

Manuscript received on 01 June 2019 | Revised Manuscript received on 07 June 2019 | Manuscript Published on 04 July 2020 | PP: 37-43 | Volume-8 Issue- 4S3 March 2019 | Retrieval Number: D10070384S319/2019©BEIESP | DOI: 10.35940/ijitee.D1007.0384S319

Open Access | Editorial and Publishing Policies | Cite | Mendeley | Indexing and Abstracting
© The Authors. Blue Eyes Intelligence Engineering and Sciences Publication (BEIESP). This is an open-access article under the CC-BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/)

Abstract: BIG DATA is the impactful terms which we hear nowadays but the question arise what it is? So BIG DATA is considered as the data which is rapidly generating huge amount of data but the question arises from where does this colossal amount of data is being generated? The answer is that there is not only one source of data generation but multiple sources are there of colossal data generation like social media e.ginstagram, facebook etc. Big data is featured with three V’s and big data can be classified into data source, content format, data stores,data staging and Data processing. This paper specifies the number of technologies which can be used in Big Data Analysis and discussion liesaround the Hadoop, itscharacteristics, and the technologiesused by Hadoop. This study specifies the comparison of all these techniques and helps the researchers to choose better techniques that can be used to data analysis.

Keywords: Hadoop, Big Data, Map Reduce, PIG, YARN, HBase Sqoop, HDFS.
Scope of the Article: Computer Science and Its Applications