AID4Crops - Automation and AI for Monitoring and Decision Making of Horticultural Crops

AID4Crops - Automation and AI for Monitoring and Decision Making of Horticultural Crops

Deutsche Forschungsgemeinschaft (DFG) - Project number 459376902

February 1, 2023

January 31, 2027

Long-term monitoring of horticultural crops is necessary to realize the forecasting of phenotypes and enable good management decisions. Autonomously, learning 3D models of crops is difficult due to their complex structure, occlusions that naturally occur, and deformation, or growth over time. Typically, multiple viewpoints are required to obtain relevant information of a crop, e.g., the position and shape of flowers, fruits, and the stem; furthermore, the sensing has to be carried out frequently to improve the phenotype forecast. Therefore, we will develop active sensing strategies to measure crops over their life cycle. We will provide methods to enable efficient sensing of relevant features and improve state-of-the-art next-best-view planners. We will make viewpoint planning efficient by considering the required regions of interest, which contain the relevant features for decision making. Furthermore, we will exploit prior information to speed up repeated coverage over time. We will use information about previously perceived crop parts and newly gained knowledge about significant features to speed up the coverage of relevant parts. Finally, we will optimize the sequence of the necessary viewpoints by trading off the cost of sensor data acquisition and the resulting reduced forecast uncertainty. To summarize, project IP3 will provide methods for efficiently obtaining relevant sensor data of horticultural crops and enable efficient decision making for necessary management actions in the other IPs.

ObjView-Bench: Rethinking Difficulty and Deployment for Object-Centric View Planning

ObjView-Bench: Rethinking Difficulty and Deployment for Object-Centric View Planning

S. Pan, H. Hu, X. Huang, B. Wingender, M. Bennewitz

Accepted to the Conference on Neural Information Processing Systems (NeurIPS), 2026

SG-DOR: Learning Scene Graphs with Direction-Conditioned Occlusion Reasoning for Pepper Plants

SG-DOR: Learning Scene Graphs with Direction-Conditioned Occlusion Reasoning for Pepper Plants

R. Menon, N. Mueller-Goldingen, S. Pan, G.K.G. Chenchani, M. Bennewitz

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2026

Still Image and Spatial-Temporal Tomato Data Enabling Detection, Segmentation, Tracking, and Video-Instance Segmentation Using Strong and Weak Labels

Still Image and Spatial-Temporal Tomato Data Enabling Detection, Segmentation, Tracking, and Video-Instance Segmentation Using Strong and Weak Labels

M. Halstead, E. Guclu, M. Farag, E. Pallotta, C. Hund, R. Roscher, M. Bennewitz, J. Gall, C. Stachniss, C. McCool

Arxiv Pre-print, 2026

GO-VMP: Global Optimization for View Motion Planning in Fruit Mapping

GO-VMP: Global Optimization for View Motion Planning in Fruit Mapping

A. Isaac Jose, S. Pan, T. Zaenker, R. Menon, S. Houben, M. Bennewitz

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2025

Exploiting Priors from 3D Diffusion Models for RGB-Based One-Shot View Planning

Exploiting Priors from 3D Diffusion Models for RGB-Based One-Shot View Planning

S. Pan, L. Jin, X. Huang, C. Stachniss, M. Popović, M. Bennewitz

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2024

Active Implicit Reconstruction Using One-Shot View Planning

Active Implicit Reconstruction Using One-Shot View Planning

H. Hu, S. Pan, L. Jin, M. Popović, M. Bennewitz

IEEE International Conference on Robotics and Automation (ICRA), 2024

How Many Views Are Needed to Reconstruct an Unknown Object Using NeRF?

How Many Views Are Needed to Reconstruct an Unknown Object Using NeRF?

S. Pan, L. Jin, H. Hu, M. Popović, M. Bennewitz

IEEE International Conference on Robotics and Automation (ICRA), 2024