Highly Detailed and Generalizable Broadleaf Tree Crown Instance Segmentation from UAV Imagery
This work addresses the challenging problem of tree crown delineation in broadleaf forests, providing a generalizable tool for forest monitoring practitioners.
The authors developed a deep-learning model (Mask2Former) for instance segmentation of individual tree crowns in broadleaf forests from UAV imagery, achieving high performance across diverse forests in Japan and tropical rainforests in Borneo using only RGB images. The model was integrated into DF Scanner Pro software for practical forest monitoring.
We present a highly detailed instance segmentation model for delineating individual tree crowns in natural broadleaf forests using aerial imagery acquired by unmanned aerial vehicles (UAVs). Tree crown delineation in broadleaf forests is more challenging than in other forest types due to diversity of crown shapes and the lack of clearly defined treetops. To address this issue, we developed a deep-learning-based crown segmentation model trained on high-quality annotated crown outlines. We manually delineated 18,507 crown polygons from orthomosaic images collected across seven forests in Japan by skilled annotators, and developed a model based on Mask2Former with multiple backbone architectures. The best model achieved high segmentation performance in structurally complex broadleaf forests using only RGB imagery. This performance was maintained when applied to geographically distinct forests within Japan, as well as to biologically distinct tropical rainforests in Borneo. These results demonstrate that using a large number of high-quality annotated datasets is critical for achieving detailed and generalizable crown segmentation across diverse forest ecosystems. The developed model has been integrated into DF Scanner Pro, a software that supports practical forest monitoring using UAVs, and this implementation is expected to enable a wide range of users to analyze tree-level information in broadleaf forest from UAVs.