Decoding Consumer Sentiments: Advanced NLP Techniques for Analyzing Smartphone Reviews
Main Article Content
Abstract
Objectives: this study aims to bridge the gap in effectively analyzing online consumer feedback on smartphones, which is often voluminous and linguistically complex. The ultimate goal is to provide smartphone manufacturers with actionable insights to refine product features and marketing strategies. We propose a dual-model framework using bidirectional encoder representations from transformers (BERT) and
sentence transformers for sentiment analysis and topic modeling, respectively. This approach is intended to enhance the accuracy and depth of consumer sentiment analysis. Method: sentiment analysis and topic modeling are applied to a large dataset of smartphone reviews sourced from Kaggle and Amazon. The BERT model is used to understand the context and sentiment of words, while sentence transformers generate embeddings for clustering reviews into thematic topics. Results: our analysis revealed strong positive sentiments regarding smartphone performance and user experience, while also identifying concerns about camera and battery life. However, while the model effectively captures positive feedback, it may struggle with negative feedback and especially neutral sentiments, due to the dataset’s bias toward positive reviews. Conclusions: the application of BERT and sentence transformers provides a significant technological advancement in the field of text analysis by enhancing the granularity of sentiment detection and offering a robust framework for interpreting complex data sets. This contributes to both theoretical knowledge and practical applications in digital consumer analytics
Download data is not yet available.
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
Since mid-February of 2023, the authors retain the copyright relating to their article and grant the journal RAC, from ANPAD, the right of first publication, with the work simultaneously licensed under the Creative Commons Attribution 4.0 International license (CC BY 4.0), as stated in the article’s PDF document. This license provides that the article published can be shared (allows you to copy and redistribute the material in any medium or format) and adapted (allows you to remix, transform, and create from the material for any purpose, even commercial) by anyone.
After article acceptance, the authors must sign a Term of Authorization for Publication, which is sent to the authors by e-mail for electronic signature before publication.
References
Anoop, V. S., & Asharaf, S. (2019). Aspect-oriented sentiment analysis: A topic modeling-powered approach. Journal of Intelligent Systems, 29(1), 1166-1178. https://doi.org/10.1515/jisys-2018-0299
Anvar Shathik, J., & Krishna Prasad, K. (2020). A literature review on application of sentiment analysis using machine learning techniques. International Journal of Applied Engineering and Management Letters, 4(2), 41-77. http://doi.org/10.5281/zenodo.3977576
Bagheri, A., Saraee, M., & Jong, F. (2014). ADM-LDA: An aspect detection model based on topic modelling using the structure of review sentences. Journal of Information Science, 40(5), 621-636. https://doi.org/10.1177/0165551514538744
Bastani, K., Namavari, H., & Shaffer, J. (2019). Latent Dirichlet allocation (LDA) for topic modeling of the CFPB consumer complaints. Expert Systems with Applications, 127, 256-271. https://doi.org/10.1016/j.eswa.2019.03.001
Blei, D. M., Ng, A. Y., & Jordan, M. I. (2003). Latent Dirichlet allocation. Journal of Machine Learning Research, 3, 993-1022. https://jmlr.csail.mit.edu/papers/v3/blei03a.html
Cambria, E., Schuller, B., Xia, Y., & Havasi, C. (2013). New avenues in opinion mining and sentiment analysis. IEEE Intelligent systems, 28(2), 15-21. https://doi.org/10.1109/MIS.2013.30
Chamlertwat, W., Bhattarakosol, P., Rungkasiri, T., & Haruechaiyasak, C. (2012). Discovering consumer insight from Twitter via sentiment analysis. Journal of Universal Computer Science, 18(8), 973-992. https://doi.org/10.3217/jucs-018-08-0973
Chawla, S., Dubey, G., & Rana, A. (2017, September). Product opinion mining using sentiment analysis on smartphone reviews. In 2017 6th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions)(ICRITO), 377-383. IEEE.
Chen, K., Kou, G., Shang, J., & Chen, Y. (2015). Visualizing market structure through online product reviews: Integrate topic modeling, TOPSIS, and multi-dimensional scaling approaches. Electronic Commerce Research and Applications, 14(1), 58-74. https://doi.org/10.1016/j.elerap.2014.11.004
Chen, P., Sun, Z., Bing, L., & Yang, W. (2017). Recurrent attention network on memory for aspect sentiment analysis. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, 452-461.
Chen, Y.-S, Chen, T.-J., & Lin, C.-C. (2016). The analyses of purchasing decisions and brand loyalty for smartphone consumers. Open Journal of Social Sciences, 4(7), 108-116. http://doi.org/10.4236/jss.2016.47018
Deerwester, S., Dumais, S. T., Furnas, G. W., Landauer, T. K., & Harshman, R. (1990). Indexing by latent semantic analysis. Journal of the American Society for Information Science, 41(6), 391-407. https://doi.org/10.1002/(SICI)1097-4571(199009)41:6%3C391::AID-ASI1%3E3.0.CO;2-9
Devi, N. L., Anilkumar, B., Sowjanya, A. M., & Kotagiri, S. (2024). An innovative word embedded and optimization-based hybrid artificial intelligence approach for aspect-based sentiment analysis of app and cellphone reviews. Multimedia Tools and Applications, 1-34. https://doi.org/10.1007/s11042-024-18510-7
Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2018). BERT: Pre-training of deep bidirectional transformers for language understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), 4171-4186.
DiMaggio, P., Nag, M., & Blei, D. (2013). Exploiting affinities between topic modeling and the sociological perspective on culture: Application to newspaper coverage of U.S. government arts fundingoetics, 41(6), 570-606. https://doi.org/10.1016/j.poetic.2013.08.004
Feldman, R. (2013). Techniques and applications for sentiment analysis. Communications of the ACM, 56(4), 82-89. https://doi.org/10.1145/2436256.2436274
Gregoriades, A., Pantelous, A. A., & Louvieris, P. (2021). Real-time situational awareness for adaptive maritime surveillance. Expert Systems with Applications, 182, 115273. https://doi.org/10.1016/j.eswa.2021.115273
Gondhi, N. K., Sharma, E., Alharbi, A. H., Verma, R., & Shah, M. A. (2022). Efficient long short-term memory-based sentiment analysis of e-commerce reviews. Computational Intelligence and Neuroscience. https://doi.org/10.1155/2022/3464524
Gregory, M., Chinchor, N., Whitney, P., Carter, R., Hetzler, E., & Turner, A. (2006). User-directed sentiment analysis: Visualizing the affective content of documents. In Proceedings of the Workshop on Sentiment and Subjectivity in Text, 23-30.
Hennig-Thurau, T., Gwinner, K. P., Walsh, G., & Gremler, D. D. (2004). Electronic word-of-mouth via consumer-opinion platforms: What motivates consumers to articulate themselves on the Internet? Journal of Interactive Marketing, 18(1), 38-52. https://doi.org/10.1002/dir.10073
Hofmann, T. (1999). Probabilistic latent semantic indexing. In Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 50-57.
Hu, M., & Liu, B. (2004). Mining and summarizing customer reviews. In Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 168-177.
Huang, J., Sun, H., Guo, P., Zhao, M., & Niu, K. (2016). Fine-grained sentimental tendency analysis based on Chinese online commentary of mobile phone. In Proceedings of the 2016 IEEE International Conference on Cloud Computing and Big Data Analysis (ICCCBDA), 319-323.
Jelodar, H., Wang, Y., Yuan, C., Feng, X., Jiang, X., Li, Y., & Zhao, L. (2019). Latent Dirichlet allocation (LDA) and topic modeling: Models, applications, a survey. Multimedia tools and applications, 78, 15169-15211. https://doi.org/10.1007/s11042-018-6894-4
Jeong, B., Yoon, J., & Lee, J.-M. (2019). Social media mining for product planning: A product opportunity mining approach based on topic modeling and sentiment analysis. International Journal of Information Management, 48, 280-290. https://doi.org/10.1016/j.ijinfomgt.2017.09.009
Joung, J., & Kim, H. M. (2021). Automated keyword filtering in latent Dirichlet allocation for identifying product attributes from online reviews. Journal of Mechanical Design, 143(8), 084501. https://doi.org/10.1115/1.4048960
Kaur, G., & Sharma, A. (2023). A deep learning-based model using hybrid feature extraction approach for consumer sentiment analysis. Journal of Big Data, 10(1), 5. https://doi.org/10.1186/s40537-022-00680-6
Kotler, P., & Keller, K. L. (2016). Marketing management (15th ed.). Pearson Education.
Kumar, G., & Parimala, N. (2020). An integration of sentiment analysis and MCDM approach for smartphone recommendation. International Journal of Information Technology & Decision Making, 19(4), 1037-1063. https://doi.org/10.1142/S021962202050025X
Latif, S., Qadir, J., Farooq, S., & Imran, M. A. (2017). How 5G wireless (and concomitant technologies) will revolutionize healthcare?. Future Internet, 9(4), 93. https://doi.org/10.3390/fi9040093
Li, H., & Ma, L. (2020). Charting the path to purchase using topic models. Journal of Marketing Research, 57(6), 1019-1036. https://doi.org/10.1177/0022243720954376
Li, L. (2011). Introduction: Advances in e-business engineering. Information Technology and Management, 12(2), 49-50. https://doi.org/10.1007/s10799-011-0100-y
Li, P., Huang, L., & Ren, G. J. (2020). Topic detection and summarization of user reviews. arXiv preprint. https://doi.org/10.48550/arXiv.2006.00148
Liu, Z. (2024). A financial analysis of Apple based on its external and internal environment. Journal of Education, Humanities and Social Sciences, 30, 97-104. https://doi.org/10.54097/tyj6y326
Mahadevan, A., & Arock, M. (2020). Integrated topic modeling and sentiment analysis: A review rating prediction approach for recommender systems. Turkish Journal of Electrical Engineering and Computer Sciences, 28(1), 107-123. https://doi.org/10.3906/elk-1905-114
Medhat, W., Hassan, A., & Korashy, H. (2014). Sentiment analysis algorithms and applications: A survey. Ain Shams engineering journal, 5(4), 1093-1113. https://doi.org/10.1016/j.asej.2014.04.011
Micu, A., Micu, A. E., Geru, M., & Lixandroiu, R. C. (2017). Analyzing user sentiment in social media: Implications for online marketing strategy. Psychology & Marketing, 34(12), 1094-1100. https://doi.org/10.1002/mar.21049
Neviarouskaya, A., Prendinger, H., & Ishizuka, M. (2011). SentiFul: A lexicon for sentiment analysis. IEEE Transactions on Affective Computing, 2(1), 22-36. https://doi.org/10.1109/T-AFFC.2011.1
Pang, B., & Lee, L. (2008). Opinion mining and sentiment analysis. Foundations and Trends® in Information Retrieval, 2(1-2), 1-135. https://doi.org/10.1561/1500000011
Pang, B., Lee, L., & Vaithyanathan, S. (2002). Thumbs up? Sentiment classification using machine learning techniques. arXiv preprint. https://doi.org/10.48550/arXiv.cs/0205070
Pew Research Center. (2022). Internet, smartphone, and social media use in advanced economies: 2022. https://www.pewresearch.org/global/2022/12/06/internet-smartphone-and-social-media-use-in-advanced-economies-2022/
Paul, M. J., & Dredze, M. (2011). You are what you tweet: Analyzing Twitter for public health. Proceedings of the Fifth International AAAI Conference on Weblogs and Social Media, 265-272.
Prabowo, R., & Thelwall, M. (2009). Sentiment analysis: A combined approach. Journal of Informetrics, 3(2), 143-157. https://doi.org/10.1016/j.joi.2009.01.003
Ramshankar, N., & Prathap, J. (2023). Automated sentimental analysis using heuristic-based CNN-BiLSTM for e-commerce dataset. Data & Knowledge Engineering, 146, 102194. https://doi.org/10.1016/j.datak.2023.102194
Ravi, K., & Ravi, V. (2017). Ranking of branded products using aspect-oriented sentiment analysis and ensembled multiple criteria decision-making. International Journal of Knowledge Management in Tourism and Hospitality, 1(3), 317-359. https://doi.org/10.1504/IJKMTH.2017.086816
Reimers, N., & Gurevych, I. (2019). Sentence-BERT: Sentence embeddings using Siamese BERT-networks. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing.
Salem, M. A., & Maghari, A. Y. (2020). Sentiment analysis of mobile phone products reviews using classification algorithms. In Proceedings of the 2020 International Conference on Promising Electronic Technologies (ICPET), 84–88.IEEE.
Sharm, N., Jain, T., Narayan, S. S., & Kandakar, A. C. (2022). Sentiment analysis of Amazon smartphone reviews using machine learning & deep learning. In Proceedings of the 2022 IEEE International Conference on Data Science and Information System (ICDSIS), 1–4. IEEE.
Sharma, D., Sabharwal, M., Goyal, V., & Vij, M. (2020). Sentiment analysis techniques for social media data: A review. In Proceedings of the First International Conference on Sustainable Technologies for Computational Intelligence: ICTSCI 2019, 75–90. Springer Singapore.
Shayaa, S., Jaafar, N. I., Bahri, S., Sulaiman, A., Wai, P. S., Chung, Y. W., Piprani, A. Z., & Al-Garadi, M. A. (2018). Sentiment analysis of big data: Methods, applications, and open challenges. IEEE Access, 6, 37807–37827.
Singla, Z., Randhawa, S., & Jain, S. (2017). Sentiment analysis of customer product reviews using machine learning. In 2017 International Conference on Intelligent Computing and Control (I2C2). IEEE. https://doi.org/10.1109/I2C2.2017.8321910
Sivakumar, M., & Uyyala, S. R. (2021). Aspect-based sentiment analysis of mobile phone reviews using LSTM and fuzzy logic. International Journal of Data Science and Analytics, 12(4), 355-367. https://doi.org/10.1007/s41060-021-00277-x
Statista. (2023). Global smartphone sales to end users since 2007. https://www.statista.com/statistics/263437/global-smartphone-sales-to-end-users-since-2007/
Sun, C., Huang, L., & Qiu, X. (2019). Utilizing BERT for aspect-based sentiment analysis via constructing auxiliary sentence. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), 380-385.
Time Magazine. (2014). IBM’s Simon was the first smartphone 20 years too soon. https://time.com/3137005/first-smartphone-ibm-simon/.
Turney, P. D. (2002). Thumbs up or thumbs down? Semantic orientation applied to unsupervised classification of reviews. arXiv preprint cs/0212032. https://doi.org/10.48550/arXiv.cs/0212032
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, Ł., & Polosukhin, I. (2017). Attention is all you need. In Proceedings of the 31st International Conference on Neural Information Processing Systems (pp. 6000-6010). Curran Associates Inc. https://doi.org/10.48550/arXiv.1706.03762
Vayansky, I., & Kumar, S. A. (2020). A review of topic modeling methods. Information Systems, 94, 101582. https://doi.org/10.1016/j.is.2020.101582
Wang, F., Yang, Y., Tso, G. K., & Li, Y. (2019). Analysis of launch strategy in cross-border e-commerce market via topic modeling of consumer reviews. Electronic Commerce Research, 19, 863-884. https://doi.org/10.1007/s10660-019-09368-1
Wang, W., Wang, H., & Song, Y. (2017). Ranking product aspects through sentiment analysis of online reviews. Journal of Experimental & Theoretical Artificial Intelligence, 29(2), 227-246. https://doi.org/10.1080/0952813X.2015.1132270
World Economic Forum. (2018). Remembering the world’s first smartphone: Simon. https://www.weforum.org/agenda/2018/03/remembering-first-smartphone-simon-ibm/
Xu, G., Liu, B., Shu, L., & Yu, P. S. (2019). BERT post-training for review reading comprehension and aspect-based sentiment analysis. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), 2324-2335.
Xun, G., Li, Y., Zhao, W. X., Gao, J., & Zhang, A. (2017). A correlated topic model using word embeddings. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI) (Vol. 17, 4207–4213).
Yadav, A., & Vishwakarma, D. K. (2020). Sentiment analysis using deep learning architectures: a review. Artificial Intelligence Review, 53(6), 4335-4385. https://doi.org/10.1007/s10462-019-09794-5
Yang, B., & Cardie, C. (2014). Context-aware learning for sentence-level sentiment analysis with posterior regularization. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) (325–335).
Yiran, Y., & Srivastava, S. (2019). Aspect-based sentiment analysis on mobile phone reviews with LDA. In Proceedings of the 2019 4th International Conference on Machine Learning Technologies (101–105).
Zhai, M., Wang, X., & Zhao, X. (2024). The importance of online customer reviews characteristics on remanufactured product sales: Evidence from the mobile phone market on Amazon.com. Journal of Retailing and Consumer Services, 77, 103677. https://doi.org/10.1016/j.jretconser.2023.103677
Zhai, Z., Liu, B., Xu, H., & Jia, P. (2011). Constrained LDA for grouping product features in opinion mining. In Advances in Knowledge Discovery and Data Mining: 15th Pacific-Asia Conference, PAKDD 2011, Shenzhen, China, May 24-27, 2011, Proceedings, Part I (Vol. 15, pp. 448-459). Springer Berlin Heidelberg.
Zhan, J., Loh, H. T., & Liu, Y. (2009). Gather customer concerns from online product reviews: A text summarization approach. Expert Systems with Applications, 36(2), 2107-2115. https://doi.org/10.1016/j.eswa.2007.12.039
Zhang, L., Wang, S., & Liu, B. (2018). Deep learning for sentiment analysis: A survey. Data Mining and Knowledge Discovery, 8(4), e1253. https://doi.org/10.1002/widm.1253
Zhang, M., Sun, L., Li, Y., Wang, G. A., & He, Z. (2023). Using supplementary reviews to improve customer requirement identification and product design development. Journal of Management Science and Engineering, 8(4), 584-597. https://doi.org/10.1016/j.jmse.2023.03.001
Zheng, L., Wang, H., & Gao, S. (2018). Sentimental feature selection for sentiment analysis of Chinese online reviews. International Journal of Machine Learning and Cybernetics, 9(1), 75-84. https://doi.org/10.1007/s13042-015-0347-4