Affordance detection consists in predicting the possibility of a specific action on an object. While this problem is generally defined for fully autonomous robotic platforms, we are interested in affordance detection for a semi-autonomous scenario, with a human in the loop. In this scenario, a human first moves their robotic prosthesis (e.g. lower arm and hand) towards an object and then the prosthesis selects the part of the object to grasp. The main challenges are the indirectly controlled camera position, which influences the quality of the view, and the limited computational resources available. This paper proposes an affordance detection pipeline to overcome framing issues leveraging object detectors and a reduced computational load for the pipeline to run on resource-constrained platforms. Experimental results on two state-of-the-art datasets show improvements in affordance detection with respect to the baseline solution which consists in considering only an affordance detection model. We argue that the combination of the selected models allows achieving a trade-off between performance and computational for embedded, resource-constrained systems.

An Affordance Detection Pipeline for Resource-Constrained Devices

Apicella T.;Berta R.;Gastaldo P.;Bellotti F.;Ragusa E.
2021

Abstract

Affordance detection consists in predicting the possibility of a specific action on an object. While this problem is generally defined for fully autonomous robotic platforms, we are interested in affordance detection for a semi-autonomous scenario, with a human in the loop. In this scenario, a human first moves their robotic prosthesis (e.g. lower arm and hand) towards an object and then the prosthesis selects the part of the object to grasp. The main challenges are the indirectly controlled camera position, which influences the quality of the view, and the limited computational resources available. This paper proposes an affordance detection pipeline to overcome framing issues leveraging object detectors and a reduced computational load for the pipeline to run on resource-constrained platforms. Experimental results on two state-of-the-art datasets show improvements in affordance detection with respect to the baseline solution which consists in considering only an affordance detection model. We argue that the combination of the selected models allows achieving a trade-off between performance and computational for embedded, resource-constrained systems.
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11567/1073845
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
social impact