Uncertainty-infused Representation Learning Using Neutrosophicbased Transformer Network

Faculty Computer Science Year: 2023
Type of Publication: ZU Hosted Pages:
Authors:
Journal: Neutrosophic Sets and Systemss University of New Mexico Volume: 58
Keywords : Uncertainty-infused Representation Learning Using Neutrosophicbased Transformer    
Abstract:
Uncertainty is an omnipresent aspect of real-world data, necessitating innovative approaches for representation learning. In this paper, we introduce an avant-garde model, namely, the neutrosophic-based transformer network (NTN), which leverages the fusion of neutrosophic logic and transformer architecture to address the multifaceted challenge of modeling and managing uncertainties. The design of NTN includes three primary building blocks, namely, neutrosophic encoding, multipath network, and fusion and decision modules. The neutrosophic encoding module applies a convolving window to map image data into the neutrosophic domain, with three subsets, namely, truth, indeterminacy, and falsehood, which model the inherent uncertainties in pixel attributes. Then, three network paths are built with a transformer encoder to extract rich and adaptive representations from the generated neutrosophic data, making up the multipath network module. Finally, the fusion and decision modules combine diverse knowledge from the paths, enabling comprehensive representation learning. Extensive experimentations on Fashion-MNIST and CIFAR-10 dataset validate the effectiveness and efficiency of NTN, outperforming the cutting-edge vision models under different levels of uncertainties. The NTN paves the way for a new era of representation learning, where uncertainties are harnessed as a valuable resource instead of an impediment, promising broad applicability in real-world settings, in which data are intrinsically uncertain
   
     
 
       

Author Related Publications

  • Mohammed Abdel Basset Metwally Attia, "Discrete greedy flower pollination algorithm for spherical traveling salesman problem", Springer, 2019 More
  • Mohammed Abdel Basset Metwally Attia, "A New Hybrid Flower Pollination Algorithm for Solving Constrained Global Optimization Problems", Natural Sciences Publishing Cor., 2014 More
  • Mohammed Abdel Basset Metwally Attia, "A novel equilibrium optimization algorithm for multi-thresholding image segmentation problems", Springer London, 2021 More
  • Mohammed Abdel Basset Metwally Attia, "An efficient binary slime mould algorithm integrated with a novel attacking-feeding strategy for feature selection", Pergamon, 2021 More
  • Mohammed Abdel Basset Metwally Attia, "An efficient teaching-learning-based optimization algorithm for parameters identification of photovoltaic models: Analysis and validations", Pergamon, 2021 More

Department Related Publications

  • Mohammed Abdel Basset Metwally Attia, "Discrete greedy flower pollination algorithm for spherical traveling salesman problem", Springer, 2019 More
  • Mohammed Abdel Basset Metwally Attia, "A New Hybrid Flower Pollination Algorithm for Solving Constrained Global Optimization Problems", Natural Sciences Publishing Cor., 2014 More
  • Saber Mohamed, "Training and Testing a Self-Adaptive Multi-Operator Evolutionary Algorithm for Constrained Optimization", ELSEVEIR, 2015 More
  • Saber Mohamed, "An Improved Self-Adaptive Differential Evolution Algorithm for Optimization Problems", IEEE, 2013 More
  • Saber Mohamed, "Differential Evolution with Dynamic Parameters Selection for Optimization Problems", IEEE, 2014 More
Tweet