3D Vision-based Perception and Length Estimation of Green Asparagus for Selective Harvesting

Abstract

Abstract Green asparagus is a labor-intensive vegetable crop for harvesting. Rising labor costs and seasonal labor shortages are threatening the sustainability and profitability of the asparagus industry in the United States (U.S.), making harvesting automation more urgently needed than ever. A multitude of challenges, however, exist in developing practically variable automated harvesting technology for green asparagus. This study describes a novel effort aimed at the development and evaluation of a 3D vision-based asparagus perception system for selective harvesting of U.S. green asparagus. Three different types of 3D cameras were evaluated indoors for asparagus detection and length estimation. A time-of-flight technology-based camera yielded the best accuracy and was deployed on a mobile vision system for imaging asparagus in diverse field conditions. A new annotated dataset alongside ground-truth length measurements for 1008 spears was created for asparagus perception algorithm development and evaluation. Among three small-scale YOLO (v8, v9, and v10) models, YOLOv8s achieved the best F1 score of 0.849. The YOLOv8s-based pipeline point cloud processing algorithms including segmentation, clustering, and outlier removal, achieved a percentage accuracy of 89.4% (with the corresponding error of about 2.3 cm) in spear length estimation, and the averaged base point localization error of 1.4 cm. The entire algorithm pipeline for spear detection and localization could be run at about 3.3 frames per second on an onboard computer. The harvest eligibility analysis of detected spears showed a detection rate of 95.8% of harvestable spears when only the length criterion (greater than 8 inches or 20.3 cm) was applied and a detection rate of 84.5% when both the length and base point localization (error less than 2 cm) criteria were considered. The 3D vision-based perception system in this study is promising for reliable and real-time asparagus perception in production fields.

Code and data availability

The paper describes a new annotated asparagus dataset (1008 spears with ground-truth lengths), indoor/field RGB-D imagery, and a Python/Open3D analysis pipeline, but no block contains an availability statement, deposit, or authors' public URL for these paper-specific assets. The only URLs given are for generic YOLOv8/v

No evidence-backed public reproduction asset is currently recorded.