Customer Sentiments in Product Reviews: A Comparative Study with GooglePaLM

SHOBAYO, Olamilekan, SASIKUMAR, Swethika, MAKKAR, Sandhya and OKOYEIGBO, Obinna (2024). Customer Sentiments in Product Reviews: A Comparative Study with GooglePaLM. Analytics, 3 (2), 241-254. [Article]

Documents
33858:643886
[thumbnail of analytics-03-00014.pdf]
Preview
PDF
analytics-03-00014.pdf - Published Version
Available under License Creative Commons Attribution.

Download (4MB) | Preview
Abstract
In this work, we evaluated the efficacy of Google’s Pathways Language Model (GooglePaLM) in analyzing sentiments expressed in product reviews. Although conventional Natural Language Processing (NLP) techniques such as the rule-based Valence Aware Dictionary for Sentiment Reasoning (VADER) and the long sequence Bidirectional Encoder Representations from Transformers (BERT) model are effective, they frequently encounter difficulties when dealing with intricate linguistic features like sarcasm and contextual nuances commonly found in customer feedback. We performed a sentiment analysis on Amazon’s fashion review datasets using the VADER, BERT, and GooglePaLM models, respectively, and compared the results based on evaluation metrics such as precision, recall, accuracy correct positive prediction, and correct negative prediction. We used the default values of the VADER and BERT models and slightly finetuned GooglePaLM with a Temperature of 0.0 and an N-value of 1. We observed that GooglePaLM performed better with correct positive and negative prediction values of 0.91 and 0.93, respectively, followed by BERT and VADER. We concluded that large language models surpass traditional rule-based systems for natural language processing tasks.
More Information
Statistics

Downloads

Downloads per month over past year

Metrics

Altmetric Badge

Dimensions Badge

Share
Add to AnyAdd to TwitterAdd to FacebookAdd to LinkedinAdd to PinterestAdd to Email

Actions (login required)

View Item View Item