Hyper-parameters tuning is a crucial task to make a model perform at its best. However, despite the well-established methodologies, some aspects of the tuning remain unexplored. As an example, it may afect not just accuracy but also novelty as well as it may depend on the adopted dataset. Moreover, sometimes it could be sufcient to concentrate on a single parameter only (or a few of them) instead of their overall set. In this paper we report on our investigation on hyper-parameters tuning by performing an extensive 10-Folds Cross-Validation on MovieLens and Amazon Movies for three well-known baselines: User-kNN, Item-kNN, BPR-MF. We adopted a grid search strategy considering approximately 15 values for each parameter, and we then evaluated each combination of parameters in terms of accuracy and novelty. We investigated the discriminative power of nDCG, Precision, Recall, MRR, EFD, EPC, and, fnally, we analyzed the role of parameters on model evaluation for Cross-Validation.

On the discriminative power of hyper-parameters in cross-validation and how to choose them / Anelli, Vito Walter; Di Noia, Tommaso; Di Sciascio, Eugenio; Pomo, Claudio; Ragone, Azzurra. - ELETTRONICO. - (2019), pp. 447-451. (Intervento presentato al convegno 13th ACM Conference on Recommender Systems, RecSys 2019 tenutosi a Copenhagen, Denmark nel September 16-20, 2019) [10.1145/3298689.3347010].

On the discriminative power of hyper-parameters in cross-validation and how to choose them

Anelli, Vito Walter;Di Noia, Tommaso;Di Sciascio, Eugenio;Pomo, Claudio;
2019-01-01

Abstract

Hyper-parameters tuning is a crucial task to make a model perform at its best. However, despite the well-established methodologies, some aspects of the tuning remain unexplored. As an example, it may afect not just accuracy but also novelty as well as it may depend on the adopted dataset. Moreover, sometimes it could be sufcient to concentrate on a single parameter only (or a few of them) instead of their overall set. In this paper we report on our investigation on hyper-parameters tuning by performing an extensive 10-Folds Cross-Validation on MovieLens and Amazon Movies for three well-known baselines: User-kNN, Item-kNN, BPR-MF. We adopted a grid search strategy considering approximately 15 values for each parameter, and we then evaluated each combination of parameters in terms of accuracy and novelty. We investigated the discriminative power of nDCG, Precision, Recall, MRR, EFD, EPC, and, fnally, we analyzed the role of parameters on model evaluation for Cross-Validation.
2019
13th ACM Conference on Recommender Systems, RecSys 2019
978-1-4503-6243-6
On the discriminative power of hyper-parameters in cross-validation and how to choose them / Anelli, Vito Walter; Di Noia, Tommaso; Di Sciascio, Eugenio; Pomo, Claudio; Ragone, Azzurra. - ELETTRONICO. - (2019), pp. 447-451. (Intervento presentato al convegno 13th ACM Conference on Recommender Systems, RecSys 2019 tenutosi a Copenhagen, Denmark nel September 16-20, 2019) [10.1145/3298689.3347010].
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11589/203375
Citazioni
  • Scopus 22
  • ???jsp.display-item.citation.isi??? 19
social impact