From occlusion to 3D: amodal completion-assisted single-view wheat reconstruction

Abstract

Occlusion is a major factor limiting accurate three-dimensional (3D) wheat phenotyping. In natural growth conditions, overlapping spikes, leaves, and stems often make only partial target regions visible in single-view images, hindering complete and reliable 3D reconstruction. To address this problem, this study proposes an amodal completion-assisted, sequential framework for single-view 3D reconstruction of occluded wheat. The framework first uses visible prompts to recover the complete appearance and structural cues of occluded targets, and then feeds the completed images into single-view 3D reconstruction models to generate complete 3D structures. We construct the MMWO (Multi-view Multi-instance Wheat Occlusion) dataset from MMW, which is captured under controlled indoor scenarios, by synthesizing diverse occlusion samples through organ-level cutouts, random geometric transformations, and region-constrained pasting, with annotations including visible masks, occlusion masks, and complete target images. Six representative reconstruction methods, including Direct3D, Real3D, SF3D, Spar3D, TRELLIS.2, and Hunyuan3D, are systematically evaluated. Hunyuan3D achieves the best geometric performance, with the lowest mean CD- \(L_1\) and CD- \(L_2\) values of 0.1286 and 0.0536, and the highest mean F-score of 0.5668. SF3D achieves the best rendering quality in terms of PSNR, SSIM, and LPIPS. In addition, Pix2Gestalt completion reduces the estimation errors of spike length, width, and area from 9.31%, 10.89%, and 32.23% to 4.64%, 9.70%, and 9.45%, respectively. These results demonstrate that amodal completion can effectively alleviate occlusion-induced information loss and provide more complete structural priors for single-view 3D wheat reconstruction. This study offers a feasible solution for 3D wheat phenotyping under occlusion and provides a systematic reference for applying 3D generative models to agricultural phenotyping.

Code and data availability

植物フェノタイピング解析を再現する公開資産であることを、入力本文と直接リンクから確認できなかったため保留しました。

No evidence-backed public reproduction asset is currently recorded.