Ground vehicles equipped with vision-based perception systems can provide a rich source of information for precision agriculture tasks in orchards, including fruit detection and counting, phenotyping, plant growth and health monitoring. This paper presents a semi-supervised deep learning framework for automatic pomegranate detection using a farmer robot equipped with a consumer-grade camera. In contrast to standard deep-learning methods that require time-consuming and labor-intensive image labeling, the proposed system relies on a novel multi-stage transfer learning approach, whereby a pre-trained network is fine-tuned for the target task using images of fruits in controlled conditions, and then it is progressively extended to more complex scenarios towards accurate and efficient segmentation of field images. Results of experimental tests, performed in a commercial pomegranate orchard in southern Italy, are presented using the DeepLabv3+ (Resnet18) architecture, and they are compared with those that were obtained based on conventional manual image annotation. The proposed framework allows for accurate segmentation results, achieving an F1-score of 86.42% and IoU of 97.94%, while relieving the burden of manual labeling.

In-Field Automatic Identification of Pomegranates Using a Farmer Robot / Devanna, R. P.; Milella, A.; Marani, R.; Garofalo, S. P.; Vivaldi, G. A.; Pascuzzi, S.; Galati, R.; Reina, G.. - In: SENSORS. - ISSN 1424-8220. - STAMPA. - 22:15(2022), p. 5821.5821. [10.3390/s22155821]

In-Field Automatic Identification of Pomegranates Using a Farmer Robot

Galati R.;Reina G.
2022-01-01

Abstract

Ground vehicles equipped with vision-based perception systems can provide a rich source of information for precision agriculture tasks in orchards, including fruit detection and counting, phenotyping, plant growth and health monitoring. This paper presents a semi-supervised deep learning framework for automatic pomegranate detection using a farmer robot equipped with a consumer-grade camera. In contrast to standard deep-learning methods that require time-consuming and labor-intensive image labeling, the proposed system relies on a novel multi-stage transfer learning approach, whereby a pre-trained network is fine-tuned for the target task using images of fruits in controlled conditions, and then it is progressively extended to more complex scenarios towards accurate and efficient segmentation of field images. Results of experimental tests, performed in a commercial pomegranate orchard in southern Italy, are presented using the DeepLabv3+ (Resnet18) architecture, and they are compared with those that were obtained based on conventional manual image annotation. The proposed framework allows for accurate segmentation results, achieving an F1-score of 86.42% and IoU of 97.94%, while relieving the burden of manual labeling.
2022
In-Field Automatic Identification of Pomegranates Using a Farmer Robot / Devanna, R. P.; Milella, A.; Marani, R.; Garofalo, S. P.; Vivaldi, G. A.; Pascuzzi, S.; Galati, R.; Reina, G.. - In: SENSORS. - ISSN 1424-8220. - STAMPA. - 22:15(2022), p. 5821.5821. [10.3390/s22155821]
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11589/249925
Citazioni
  • Scopus 11
  • ???jsp.display-item.citation.isi??? 8
social impact