INTEGRATION OF LAYER-WISE RELEVANCE PROPAGATION, RECURSIVE DATA PRUNING, AND CONVOLUTIONAL NEURAL NETWORKS FOR IMPROVED TEXT CLASSIFICATION

  • Abubakar Ado
  • Olalekan J. Awujoola
  • Sabiu Danlami Abdullahi Department of Computer Science, Yusuf Maitama Sule university Kano
  • Sulaiman Hashim Ibrahim
Keywords: Natural Language Processing, Layer-wise Relevance Propagation, Convolutional Neural Network

Abstract

This research presents a significant advancement in text classification by integrating Layer-wise Relevance Propagation (LRP), recursive data pruning, and Convolutional Neural Networks (CNNs) with cross-validation. The study addresses the critical limitations of existing text classification methods, particularly issues of information loss and overfitting, which often hinder the efficiency and interpretability of models in natural language processing (NLP). To overcome these challenges, the proposed model employs LRP to enhance the interpretability of the classification process, allowing for precise identification of relevant features that contribute to decision-making. Additionally, the implementation of recursive data pruning optimizes model efficiency by dynamically eliminating irrelevant or redundant data, thereby reducing computational complexity without compromising performance. The effectiveness of the approach is further bolstered by utilizing cross-validation techniques to ensure robust evaluation across diverse datasets. The empirical evaluation of the integrated model revealed remarkable improvements in classification performance, achieving an accuracy of 94%, surpassing the benchmark of 92.88% established by the ReDP-CNN model proposed by Li et al. (2020). The comprehensive assessment included detailed metrics such as precision, recall, and F1-score, confirming the model's robust capability in accurately classifying text data across various categories.

References

Abbasi, A., Chakraborty, C., Nebhen, J., Zehra, W., and Jalil, Z. (2021). Elstream: an ensemble learning approach for concept drift detection in dynamic social big data stream learning. IEEE Access 9, 6640866419. https://doi.org/10.1109/ACCESS.2021.3076264

Abdullah Alqahtani Habib Ullah Khan, Shtwai Alsubai1, Mohemmed Sha, Ahmad Almadhor ,Tayyab Iqbal and Sidra Abbas(2022) An efficient approach for textual data classification using deep learning

Amin, F., & Mahmoud, M. (2022). Confusion matrix in binary classification problems: A step-by-step tutorial. Journal of Engineering Research, 6(5), 0-0.

Bashir, M. F., Javed, A. R., Arshad, M. U., Gadekallu, T. R., Shahzad, W., and Beg, M. O. (2022). Context aware emotion detection from low resource urdu language using deep neural network, in Transactions on Asian and Low-Resource Language Information Processing.

oban, .; zel, S.A.; Inan, A. Deep learning-based sentiment analysis of Facebook data: The case of Turkish users. Comput. J. 2021, 64, 473499.

Dogru, H.B.; Tilki, S.; Jamil, A.; Hameed, A.A. Deep learning-based classification of news texts using doc2vec model. In Proceedings of the 1st International Conference on Artificial Intelligence and Data Analytics (CAIDA), Riyadh, Saudi Arabia, 67 April 2021; IEEE: Riyadh, Saudi Arabia, 2021; pp. 9196.

Hassan, S. U., Ahamed, J., & Ahmad, K. (2022). Analytics of machine learning-based algorithms for text classification. Sustainable Operations and Computers, 3, 238-248.

Hartmann, J.; Huppertz, J.; Schamp, C.; Heitmann, M. Comparing automated text classification methods. Int. J. Res. Mark. 2019, 36, 2038.

Hina, M., Ali, M., Javed, A. R., Srivastava, G., Gadekallu, T. R., and Jalil, Z. (2021b). Email classification and forensics analysis using machine learning, in 2021 IEEE SmartWorld, Ubiquitous Intelligence and Computing, Advanced Trusted Computing, Scalable Computing and Communications, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/IOP/SCI) (Atlanta, GA: IEEE), 630635.

Kim, H., & Jeong, Y. S. (2019). Sentiment classification using convolutional neural networks. Applied Sciences, 9(11), 2347..

Kohlbrenner, M., Bauer, A., Nakajima, S., Binder, A., Samek, W., & Lapuschkin, S. (2020, July). Towards best practice in explaining neural network decisions with LRP. In 2020 International Joint Conference on Neural Networks (IJCNN) (pp. 1-7). IEEE.

Kuyumcu, B.; Aksakalli, C.; Delil, S. An automated new approach in fast text classification (fastText): A case study for Turkish text classification without pre-processing. In Proceedings of the 3rd International Conference on Natural Language Processing and Information Retrieval, ACM, Tokushima, Japan, 2830 June 2019; pp. 14

Lapuschkin, S. (2019). Opening the machine learning black box with layer-wise relevance propagation (Doctoral dissertation, Dissertation, Berlin, Technische Universitt Berlin, 2018).Applied Sciences, 9(11), 2347.

Li, Q.; Peng, H.; Li, J.; Xia, C.; Yang, R.; Sun, L.; Yu, P.S.; He, L. A survey on text classification: From traditional to deep learning. ACM Trans. Intell. Syst. Technol. (TIST) 2022, 13, 141.

Li, Q., Li, P., Mao, K., & Lo, E. Y. M. (2020). Improving convolutional neural network for text classification by recursive data pruning. Neurocomputing, 414, 143-152.

Macukow, B. (2016). Neural networksstate of art, brief history, basic models and architecture. In Computer Information Systems and Industrial Management: 15th IFIP TC8 International Conference, CISIM 2016, Vilnius, Lithuania, September 14-16, 2016, Proceedings 15 (pp. 3-14). Springer International Publishing.

O'Shea, K., & Nash, R. (2015). An Introduction to Convolutional Neural Networks. ArXiv, abs/1511.08458.

Romero, M., Gudria, W., Panetto, H., & Barafort, B. (2022). A hybrid deep learning and ontology-driven approach to perform business process capability assessment. Journal of Industrial Information Integration, 30, 100409.

Salter, C. (2020). Neuronal acts. Performance Research, 25(3), 104-113.

Toofani, A., Singh, L., & Paul, S. (2024). From interpretation to explanation: An analytical examination of deep neural network with linguistic rule-based model. Computers and Electrical Engineering, 117, 109258

Uysal, A.K.; Gunal, S. The impact of preprocessing on text classification. Inf. Process. Manag. 2014, 50, 104112

Vukadin, D., Afri, P., ili, M., & Dela, G. (2024). Advancing Attribution-Based Neural Network Explainability through Relative Absolute Magnitude Layer-Wise Relevance Propagation and Multi-Component Evaluation. ACM Transactions on Intelligent Systems and Technology.

Xiao, Y., Duan, Z., & Lei, P. (2024). Explaining Multiple Types of Crash Injury Severity Predictions with Layer-wise Relevance Propagation in Multi-task Deep Neural Networks.

Yamashita, R., Nishio, M., Do, R. K. G., & Togashi, K. (2018). Convolutional neural networks: an overview and application in radiology. Insights into imaging, 9(4), 611-629

Yldrm, S.; Yldz, T. A comparative analysis of text classification for Turkish language. Pamukkale Univ. J. Eng. Sci. 2018, 24, 879886

Zang, B., Ding, L., Feng, Z., Zhu, M., Lei, T., Xing, M., & Zhou, X. (2021). CNN-LRP: Understanding convolutional neural networks performance for target recognition in SAR images. Sensors, 21(13), 4536.

Zulqarnain, M.; Alsaedi, A.K.Z.; Ghazali, R.; Ghouse, M.G.; Sharif, W.; Husaini, N.A. A comparative analysis on question classification task based on deep learning approaches. PeerJ Comput. Sci. 2021, 7, e570.

Published
2025-02-19
How to Cite
AdoA., AwujoolaO. J., AbdullahiS. D., & IbrahimS. H. (2025). INTEGRATION OF LAYER-WISE RELEVANCE PROPAGATION, RECURSIVE DATA PRUNING, AND CONVOLUTIONAL NEURAL NETWORKS FOR IMPROVED TEXT CLASSIFICATION. FUDMA JOURNAL OF SCIENCES, 9(2), 35 - 41. https://doi.org/10.33003/fjs-2025-0902-3058