Generally, items with missing modalities are dropped in multimodal recommendation. However, with this work, we question this procedure, highlighting that it would further damage the pipeline of any multimodal recommender system. First, we show that the lack of (some) modalities is, in fact, a widely-diffused phenomenon in multimodal recommendation. Second, we propose a pipeline that imputes missing multimodal features in recommendation by leveraging traditional imputation strategies in machine learning. Then, given the graph structure of the recommendation data, we also propose three more effective imputation solutions that leverage the item-item co-purchase graph and the multimodal similarities of co-interacted items. Our method can be plugged into any multimodal RSs in the literature working as an untrained pre-processing phase, showing (through extensive experiments) that any data pre-filtering is not only unnecessary but also harmful to the performance.

Do We Really Need to Drop Items with Missing Modalities in Multimodal Recommendation? / Malitesta, Daniele; Rossi, Emanuele; Pomo, Claudio; Di Noia, Tommaso; Malliaros, Fragkiskos D.. - (2024), pp. 3943-3948. (Intervento presentato al convegno 33rd ACM International Conference on Information and Knowledge Management, CIKM 2024 tenutosi a usa nel 2024) [10.1145/3627673.3679898].

Do We Really Need to Drop Items with Missing Modalities in Multimodal Recommendation?

Malitesta, Daniele
;
Pomo, Claudio
;
Di Noia, Tommaso;
2024-01-01

Abstract

Generally, items with missing modalities are dropped in multimodal recommendation. However, with this work, we question this procedure, highlighting that it would further damage the pipeline of any multimodal recommender system. First, we show that the lack of (some) modalities is, in fact, a widely-diffused phenomenon in multimodal recommendation. Second, we propose a pipeline that imputes missing multimodal features in recommendation by leveraging traditional imputation strategies in machine learning. Then, given the graph structure of the recommendation data, we also propose three more effective imputation solutions that leverage the item-item co-purchase graph and the multimodal similarities of co-interacted items. Our method can be plugged into any multimodal RSs in the literature working as an untrained pre-processing phase, showing (through extensive experiments) that any data pre-filtering is not only unnecessary but also harmful to the performance.
2024
33rd ACM International Conference on Information and Knowledge Management, CIKM 2024
Do We Really Need to Drop Items with Missing Modalities in Multimodal Recommendation? / Malitesta, Daniele; Rossi, Emanuele; Pomo, Claudio; Di Noia, Tommaso; Malliaros, Fragkiskos D.. - (2024), pp. 3943-3948. (Intervento presentato al convegno 33rd ACM International Conference on Information and Knowledge Management, CIKM 2024 tenutosi a usa nel 2024) [10.1145/3627673.3679898].
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11589/285761
Citazioni
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
social impact