Evaluation and Acceptability of Generative AI Solutions in Online Product Information, Recommendations and Reviews

Simple item page
dc.contributor.authorOburu, George
dc.date.accessioned2025-11-29T19:57:55Z
dc.date.available2025-11-29T19:57:55Z
dc.date.issued2025-11
dc.description.abstractThis quantitative comparative experimental study assessed the performance differences between open-source Generative AI (GenAI) solutions in curating online product information. The research evaluated six Large Language Models (LLMs)—Llama-3, Mistral-3, FalconMamba-7B, Gemma-3, XGen-9B, and DeepSeek-R1—focusing on their capabilities to generate accurate and meaningful product descriptions. The evaluation utilized established Natural Language Processing (NLP) metrics: Recall-Oriented Understudy for Gisting Evaluation (ROUGE), Bilingual Evaluation Understudy (BLEU), Bidirectional Encoder Representations from Transformers (BERT Score), Precision, and Recall (P/F1) scores. Secondary datasets from Amazon and Walmart provided the benchmark for assessing GenAI-generated content. Results indicate statistically significant performance variations among the models for most metrics, except BLEU. The study highlighted the efficacy of NLP metrics in evaluating GenAI content generation, offering insights for businesses seeking to adopt GenAI solutions for marketing and e-commerce. Recommendations for future research include expanding to multimodal GenAI applications covering text, images, and videos.
dc.identifier.urihttps://hdl.handle.net/20.500.11803/5044
dc.language.isoen
dc.publisher.institutionNorthcentral University (NCU)
dc.subjectGenerative AI
dc.subjectNLP Metrics
dc.subjectGenAI Evaluation
dc.titleEvaluation and Acceptability of Generative AI Solutions in Online Product Information, Recommendations and Reviews
dc.typeDissertation
thesis.degree.disciplineComputer Science
thesis.degree.grantorNorthcentral University (NCU)
thesis.degree.levelDoctoral
thesis.degree.nameDoctor of Philosophy in Computer Science
Files
Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
oburugo-dissertation-manuscript.pdf
Size:
2.13 MB
Format:
Adobe Portable Document Format
Download
Collections
NU Masters and Dissertations (Open Access)