AID4Crops - Automation and AI for Monitoring and Decision Making of Horticultural Crops

AID4Crops will bring together research about what can be sensed with what should be sensed. To do this, we will develop novel AI algorithms to enable autonomous monitoring (sensing) and management (forecasting and decision making) for horticultural crops. These approaches will be deployed in horticulture as it provides a set of realistic yet challenging environments with crops grown both indoors (in glasshouses) and outdoor (in orchards); the indoor environment provides greater control over the growth of the crops.

AID4Crops - Automation and AI for Monitoring and Decision Making of Horticultural Crops

Deutsche Forschungsgemeinschaft (DFG) - Project number 459376902

2023-02-01

2027-01-31

Long-term monitoring of horticultural crops is necessary to realize the forecasting of phenotypes and enable good management decisions. Autonomously, learning 3D models of crops is difficult due to their complex structure, occlusions that naturally occur, and deformation, or growth over time. Typically, multiple viewpoints are required to obtain relevant information of a crop, e.g., the position and shape of flowers, fruits, and the stem; furthermore, the sensing has to be carried out frequently to improve the phenotype forecast. Therefore, we will develop active sensing strategies to measure crops over their life cycle. We will provide methods to enable efficient sensing of relevant features and improve state-of-the-art next-best-view planners. We will make viewpoint planning efficient by considering the required regions of interest, which contain the relevant features for decision making. Furthermore, we will exploit prior information to speed up repeated coverage over time. We will use information about previously perceived crop parts and newly gained knowledge about significant features to speed up the coverage of relevant parts. Finally, we will optimize the sequence of the necessary viewpoints by trading off the cost of sensor data acquisition and the resulting reduced forecast uncertainty. To summarize, project IP3 will provide methods for efficiently obtaining relevant sensor data of horticultural crops and enable efficient decision making for necessary management actions in the other IPs.

SG-DOR: Learning Scene Graphs with Direction-Conditioned Occlusion Reasoning for Pepper Plants

SG-DOR: Learning Scene Graphs with Direction-Conditioned Occlusion Reasoning for Pepper Plants

Rohit Menon, Niklas Mueller-Goldingen, Sicong Pan, Gokul Krishna Gandhi Chenchani, Maren Bennewitz

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2026

Still Image and Spatial-Temporal Tomato Data Enabling Detection, Segmentation, Tracking, and Video-Instance Segmentation Using Strong and Weak Labels

Still Image and Spatial-Temporal Tomato Data Enabling Detection, Segmentation, Tracking, and Video-Instance Segmentation Using Strong and Weak Labels

Michael Halstead, Esra Guclu, Mohamed Farag, Enrico Pallotta, Christian Hund, Ribana Roscher, Maren Bennewitz, Juergen Gall, Cyrill Stachniss, Chris McCool

Arxiv Pre-print, 2026

EvidMTL: Evidential Multi-Task Learning for Uncertainty-Aware Semantic Surface Mapping from Monocular RGB Images

EvidMTL: Evidential Multi-Task Learning for Uncertainty-Aware Semantic Surface Mapping from Monocular RGB Images

Rohit Menon, Nils Dengler, Sicong Pan, Gokul Krishna Gandhi Chenchani, Maren Bennewitz

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2025

GO-VMP: Global Optimization for View Motion Planning in Fruit Mapping

GO-VMP: Global Optimization for View Motion Planning in Fruit Mapping

Allen Isaac Jose, Sicong Pan, Tobias Zaenker, Rohit Menon, Sebastian Houben, Maren Bennewitz

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2025

Exploiting Priors from 3D Diffusion Models for RGB-Based One-Shot View Planning

Exploiting Priors from 3D Diffusion Models for RGB-Based One-Shot View Planning

Sicong Pan, Liren Jin, Xuying Huang, Cyrill Stachniss, Marija Popović, Maren Bennewitz

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2024

Active Implicit Reconstruction Using One-Shot View Planning

Active Implicit Reconstruction Using One-Shot View Planning

Hao Hu, Sicong Pan, Liren Jin, Marija Popović, Maren Bennewitz

IEEE International Conference on Robotics and Automation (ICRA), 2024

How Many Views Are Needed to Reconstruct an Unknown Object Using NeRF?

How Many Views Are Needed to Reconstruct an Unknown Object Using NeRF?

Sicong Pan, Liren Jin, Hao Hu, Marija Popović, Maren Bennewitz

IEEE International Conference on Robotics and Automation (ICRA), 2024