New feature selection paradigm based on hyper-heuristic technique

Faculty Science Year: 2021
Type of Publication: ZU Hosted Pages:
Authors:
Journal: Applied Mathematical Modelling Elseveir Volume:
Keywords : , feature selection paradigm based , hyper-heuristic technique    
Abstract:
Feature selection (FS) is a crucial step for effective data mining since it has largest effect on improving the performance of classifiers. This is achieved by removing the irrelevant features and using only the relevant features. Many metaheuristic approaches exist in the literature in attempt to address this problem. The performance of these approaches differ based on the settings of a number of factors including the use of chaotic maps, opposition- based learning (OBL) and the percentage of the population that OBL will be applied to, the metaheuristic (MH) algorithm adopted, the classifier utilized, and the threshold value used to convert real solutions to binary ones. However, it is not an easy task to identify the best settings for these different components in order to determine the relevant fea- tures for a specific dataset. Moreover, running extensive experiments to fine tune these settings for each and every dataset will consume considerable time. In order to mitigate this important issue, a hyper-heuristic based FS paradigm is proposed. In the proposed model, a two-stage approach is adopted to identify the best combination of these com- ponents. In the first stage, referred to as the training stage , the Differential Evolution (DE) algorithm is used as a controller for selecting the best combination of components to be used by the second stage. In the second stage, referred to as the testing stage , the received combination will be evaluated using a testing set. Empirical evaluation of the proposed framework is based on numerous experiments performed on the most popular 18 datasets from the UCI machine learning repository. Experimental results illustrates that the gener- ated generic configuration provides a better performance than eight other metaheuristic algorithms over all performance measures when applied to the UCI dataset. Moreover, The overall paradigm ranks at number one when compared against state-of-the-art algorithms. Finally, the generic configuration provides a very competitive performance for high dimen- sional datasets.
   
     
 
       

Author Related Publications

  • Rehab Aly Ibrahim Muhammed, "Image Denoising using K-SVD Algorithm based on Gabor Wavelet Dictionary", International Journal of Computer Applications, 2012 More
  • Rehab Aly Ibrahim Muhammed, "Cooperative Meta-heuristic Algorithms for Global Optimization Problems", Elseveir, 2021 More
  • Rehab Aly Ibrahim Muhammed, "Efficient artificial intelligence forecasting models for COVID-19outbreak in Russia and Brazil", Elseveir, 2021 More
  • Rehab Aly Ibrahim Muhammed, "Automatic clustering method to segment COVID-19 CT images", ٍٍSpringer, 2021 More
  • Rehab Aly Ibrahim Muhammed, "Fractional Calculus-Based Slime Mould Algorithm for Feature Selection Using Rough Set", IEEE, 2021 More

Department Related Publications

  • Heba Ibrahim Mustafa, "Bi Operation and Rough Sets Generalizations", Dixie W Publishing Corporation, U. S. A., 2008 More
  • Alaa Hassan Attia Hassan, "A New Class of Analytic Functions Defined by Using Salagean Operator", Hindawi Publishing Corporation, USA, 2013 More
  • Usama Abdelhamid Ibrahim, "Fuzzy Pairwise Separation Axioms in fuzzy Bitopological spaces", Jöklarannsóknafélag Íslands, 2013 More
  • Huda Ibrahim Sayed Ahmad, ", Multigrid solution of Three Dimensional Biharmonic Equations With Dirichlet Boundary Conditions of Second Kinds", كوريا, 2010 More
  • Huda Ibrahim Sayed Ahmad, "The two variable (G'/G,1/G) -expansion method for finding exact traveling wave solutions of the (3+1) - dimensional nonlinear potential Yu-Toda-Sasa-Fukuyama equation", الصين, 2013 More
Tweet