Towards L-System Captioning for Tree Reconstruction
This work addresses tree reconstruction for applications in fields like botany or computer graphics, but it is incremental as it builds on existing L-System and image captioning techniques.
The authors tackled the problem of tree and plant reconstruction by proposing a method to infer Lindenmayer-System (L-System) word representations directly from images using an image captioning approach, demonstrating applicability on 2D tree topologies with potential for more efficient and accurate reconstruction.
This work proposes a novel concept for tree and plant reconstruction by directly inferring a Lindenmayer-System (L-System) word representation from image data in an image captioning approach. We train a model end-to-end which is able to translate given images into L-System words as a description of the displayed tree. To prove this concept, we demonstrate the applicability on 2D tree topologies. Transferred to real image data, this novel idea could lead to more efficient, accurate and semantically meaningful tree and plant reconstruction without using error-prone point cloud extraction, and other processes usually utilized in tree reconstruction. Furthermore, this approach bypasses the need for a predefined L-System grammar and enables species-specific L-System inference without biological knowledge.