Multi-objective heterogeneous comprehensive learning symbiotic organism search with application to convolutional neural network pruning

Faculty Science Year: 2025
Type of Publication: ZU Hosted Pages:
Authors:
Journal: Cluster Computing springer Volume:
Keywords : Multi-objective heterogeneous comprehensive learning symbiotic organism    
Abstract:
This paper introduces the multi-objective heterogeneous comprehensive learning symbiotic organism search algorithm (MOHCLSOS), designed to overcome the limitations of the multi-objective symbiotic organism search algorithm (MOSOS) when dealing with complex optimization problems. These limitations include improper initial population distribution, lack of diversity, premature convergence, and ineffective archiving of non-dominated solutions. MOHCLSOS enhances the optimization process through several key innovations. Initially, it employs opposition-based learning combined with fast non-dominated sorting to partition the initial population into exploration and exploitation subpopulations based on fitness values. This strategy helps in maintaining a balance between global exploration and local exploitation. Furthermore, MOHCLSOS integrates the heterogeneous comprehensive learning symbiotic organism search algorithm (HCLSOS) learning operators, and introduces a higher dominance level archiving strategy. This strategy expands the range of high quality solutions to be stored in the external archive. Meanwhile, the archive management process utilizes dominance-based sorting, genetic operators and an adaptive crowding distance computation that account for both objective and decision spaces to maintain a diverse and high-quality set of solutions. The efficacy of MOHCLSOS was evaluated using 22 benchmark functions from the ZDT, DTLZ, and UF test suites, as well as 5 real-world problems. Comparative analysis against 12 state-of-the-art algorithms revealed that MOHCLSOS consistently delivers competitive or significantly superior performance to both classical and advanced methods in handling multi-objective optimization problems (MOPs). Moreover, we implemented a binary version of our proposed method called MOHCLSOS-Prune, to solve the convolutional neural network (CNN) filter pruning problem, formulated as a two-objective optimization problem. Experimental results demonstrate that MOHCLSOS-Prune is both effective and competitive in practical applications, further highlighting the versatility and robustness of MOHCLSOS.
   
     
 
       

Author Related Publications

  • Mohamed El Sayed Ahmed Muhamed, "A Grunwald–Letnikov based Manta ray foraging optimizer for global optimization and image segmentation", Elsevier, 2020 More
  • Mohamed El Sayed Ahmed Muhamed, "A novel hybrid gradient-based optimizer and grey wolf optimizer feature selection method for human activity recognition using smartphone sensors", MDPI, 2021 More
  • Mohamed El Sayed Ahmed Muhamed, "Efficient schemes for playout latency reduction in P2P-VOD systems", Springer, 2018 More
  • Mohamed El Sayed Ahmed Muhamed, "a novel algorithm for source localization based on nonnegative matrix factroization using \alpha 'beta divergence in chochleagram", WSEAS, 2013 More
  • Mohamed El Sayed Ahmed Muhamed, "Open cluster membership probability based on K-means clustering algorithm", Springer, 2016 More

Department Related Publications

  • Hany Samih Bayoumi Ibrahim, "Passive and active controllers for suppressing the torsional vibration of multiple-degree-of-freedom system", Sage, 2014 More
  • Ahmed Mohamed Khedr Souliman, "SEP-CS: Effective Routing Protocol for Heterogeneous Wireless Sensor Networks", Ad Hoc & Sensor Wireless Networks, 2012 More
  • Ahmed Mohamed Khedr Souliman, "Minimum connected cover of a query region in heterogeneous wireless sensor networks", Information Sciences, 2013 More
  • Ahmed Mohamed Khedr Souliman, "IBLEACH: intra-balanced LEACH protocol for wireless sensor networks", Wireless Netw, 2014 More
  • Ahmed Mohamed Khedr Souliman, "AGENTS FOR INTEGRATING DISTRIBUTED DATA FOR FUNCTION COMPUTATIONS", Computing and Informatics,, 2012 More
Tweet