A ML and NLP based Framework for Sentiment Analysis on Bigdata
D. Krishna Madhuri1, R. V. V. S. V PRASAD2
1D.Krishna Madhuri, Assistant Professor, Dept of CSE, GRIET, Hyderabad, Telangana India.
2Dr. R. V. V. S. V Prasad, Professor & Head,Dept of IT, Swarandhra College of Engineering & Technology, Narsapur, India.
Manuscript received on January 13, 2020. | Revised Manuscript received on January 20, 2020. | Manuscript published on February 10, 2020. | PP: 189-200 | Volume-9 Issue-4, February 2020. | Retrieval Number: D9062019420/2020©BEIESP | DOI: 10.35940/ijitee.D9062.029420
Open Access | Ethics and Policies | Cite | Mendeley
© The Authors. Blue Eyes Intelligence Engineering and Sciences Publication (BEIESP). This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/)
Abstract: Big data as multiple sources and social media is one of them. Such data is rich in opinion of people and needs automated approach with Natural Language Processing (NLP) and Machine Learning (ML) to obtain and summarize social feedback. With ML as an integral part of Artificial Intelligence (AI), machines can demonstrate intelligence exhibited by humans. ML is widely used in different domains. With proliferation of Online Social Networks (OSNs), people of all walks of life exchange their views instantly. Thus they became platforms where opinions or people are available. In other words, social feedback on products and services are available. For instance, Twitter produces large volumes of such data which is of much use to enterprises to garner Business Intelligence (BI) useful to make expert decisions. In addition to the traditional feedback systems, the feedback (opinions) over social networks provide depth in the intelligence to revise strategies and policies. Sentiment analysis is the phenomenon which is employed to analyze opinions and classify them into positive, negative and neutral. Existing studies usually treated overall sentiment analysis and aspect-based sentiment analysis in isolation, and then introduce a variety of methods to analyse either overall sentiments or aspect-level sentiments, but not both. Usage of probabilistic topic model is a novel approach in sentiment analysis. In this paper, we proposed a framework for comprehensive analysis of overall and aspect-based sentiments. The framework is realized with aspect based topic modelling for sentiment analysis and ensemble learning algorithms. It also employs many ML algorithms with supervised learning approach. Benchmark datasets used in international Sem Eval conferences are used for empirical study. Experimental results revealed the efficiency of the proposed framework over the state of the art.
Keywords: Big data, NLP, Sentiment Analysis, Machine Learning, Artificial Intelligence, Ensemble Learning, Twitter, Aspect-Based Sentiment Analysis
Scope of the Article: Machine Learning