Transformer-based hybrid classification for plant leaf disease detection using vision transformer, principal component analysis, and support vector machine

Abstract

Plant diseases remain a critical challenge in agriculture, causing substantial yield losses and threatening food security. In this work, we propose a hybrid deep feature engineering framework that integrates deep learning-based feature extraction with classical machine learning for accurate plant disease detection. A pretrained vision transformer (ViT) model is employed to extract discriminative features from leaf images, effectively capturing complex spatial relationships. To address the curse of dimensionality, principal component analysis (PCA) is applied, retaining 98% of the variance while reducing feature space complexity. The refined features are then classified using a support vector machine (SVM) optimized through hyperparameter tuning. Experimental results on the bean leaf lesions dataset demonstrate strong performance, achieving 92% accuracy and a weighted F1-score of 0.92. The proposed ViT–PCA–SVM pipeline effectively balances accuracy, computational efficiency, and generalization, making it a promising solution for real-time smart farming applications.

Code and data availability

The paper's only qualifying asset is the public Bean Leaf Lesions dataset (leaf images used as phenotyping input for disease classification), explicitly declared in the DATA AVAILABILITY section with a Kaggle URL. No author analysis code, trained models, or checkpoints are released.