BERT-CNN: A Deep Learning Model for Detecting Emotions from Text

Faculty Computer Science Year: 2021
Type of Publication: ZU Hosted Pages: 2943-2961
Authors:
Journal: in CMC-Computers, Materials & Continua Tech Science Press Volume: 71
Keywords : BERT-CNN: , Deep Learning Model , Detecting Emotions    
Abstract:
Due to the widespread usage of social media in our recent daily lifestyles, sentiment analysis becomes an important field in pattern recognition andNatural Language Processing (NLP). In this field, users’ feedback data on a specific issue are evaluated and analyzed.Detecting emotions within the text is therefore considered one of the important challenges of the current NLP research. Emotions have been widely studied in psychology and behavioral science as they are an integral part of the human nature. Emotions describe a state of mind of distinct behaviors, feelings, thoughts and experiences. The main objective of this paper is to propose a new model named BERT-CNN to detect emotions from text. This model is formed by a combination of the Bidirectional Encoder Representations from Transformer (BERT) and the Convolutional Neural networks (CNN) for textual classification. This model embraces the BERT to train the word semantic representation language model. According to the word context, the semantic vector is dynamically generated and then placed into the CNN to predict the output. Results of a comparative study proved that the BERT-CNN model overcomes the state-of-art baseline performance produced by different models in the literature using the semeval 2019 task3 dataset and ISEAR datasets. The BERTCNN model achieves an accuracy of 94.7% and an F1-score of 94% for semeval2019 task3 dataset and an accuracy of 75.8% and an F1-score of 76% for ISEAR dataset.
   
     
 
       

Author Related Publications

  • Ahmed Raafat Abass Mohamed Saliem, "Using General Regression with Local Tuning for Learning Mixture Models from Incomplete Data Sets", ScienceDirect, 2010 More
  • Ahmed Raafat Abass Mohamed Saliem, "On determining efficient finite mixture models with compact and essential components for clustering data", ScienceDirect, 2013 More
  • Ahmed Raafat Abass Mohamed Saliem, "Unsupervised learning of mixture models based on swarm intelligence and neural networks with optimal completion using incomplete data", ScienceDirect, 2012 More
  • Ahmed Raafat Abass Mohamed Saliem, "Adaptive competitive learning neural networks", ScienceDirect, 2013 More
  • Ahmed Raafat Abass Mohamed Saliem, "Using Incremental General Regression Neural Network for Learning Mixture Models from Incomplete Data", ScienceDirect, 2011 More

Department Related Publications

  • Wael Said AbdelMageed Mohamed, "CO-STOP: A robust P4-powered adaptive framework for comprehensive detection and mitigation of coordinated and multi-faceted attacks in SD-IoT networks", Elsevier, 2025 More
  • Ahmed Salah Mohamed Mostafa, "A Time-space Efficient Algorithm for Parallel k-way In-place Merging based on Sequence Partitioning and Perfect Shuffle", ACM, 2020 More
  • Abdallah Gamal abdallah mahmoud, "A hybrid approach of neutrosophic sets and DEMATEL method for developing supplier selection criteria", springer, 2018 More
  • Wael Said AbdelMageed Mohamed, "Proof of Credibility: A Blockchain Approach for Detecting and Blocking Fake News in Social Networks", Science and Information Organization, 2019 More
  • Ahmed Salah Mohamed Mostafa, "Fast computation of 2D and 3D Legendre moments using multi-core CPUs and GPU parallel architectures", Springer, 2019 More
Tweet