Artificial intelligence approach for tomato detection and mass estimation in precision agriculture

Jaesu Lee, Haseeb Nazki, Jeonghyun Baek, Youngsin Hong, Meonghun Lee*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

5 Citations (Scopus)


Application of computer vision and robotics in agriculture requires sufficient knowledge and understanding of the physical properties of the object of interest. Yield monitoring is an example where these properties affect the quantified estimation of yield mass. In this study, we propose an image-processing and artificial intelligence-based system using multi-class detection with instance-wise segmentation of fruits in an image that can further estimate dimensions and mass. We analyze a tomato image dataset with mass and dimension values collected using a calibrated vision system and accurate measuring devices. After successful detection and instance-wise segmentation, we extract the real-world dimensions of the fruit. Our characterization results exhibited a significantly high correlation between dimensions and mass, indicating that artificial intelligence algorithms can effectively capture this complex physical relation to estimate the final mass. We also compare different artificial intelligence algorithms to show that the computed mass agrees well with the actual mass. Detection and segmentation results show an average mask intersection over union of 96.05%, mean average precision of 92.28%, detection accuracy of 99.02%, and precision of 99.7%. The mean absolute percentage error for mass estimation was 7.09 for 77 test samples using a bagged ensemble tree regressor. This approach could be applied to other computer vision and robotic applications such as sizing and packaging systems and automated harvesting or to other measuring instruments.
Original languageEnglish
Article numbere9138
Number of pages15
Issue number21
Publication statusPublished - 3 Nov 2020


  • Artificial intelligence
  • Convolutional neural network
  • Fruit size estimation
  • Image processing
  • Precision agriculture
  • Machine-learning
  • Mass estimation
  • Tomato detection


Dive into the research topics of 'Artificial intelligence approach for tomato detection and mass estimation in precision agriculture'. Together they form a unique fingerprint.

Cite this