In this paper, we propose a novel approach to compare the performances of binary classification models with an application on a real data set on credit risk provided by Unicredit bank. Starting from the probability of default estimated by each predictive model under comparison, the idea is to derive an uncertainty interval comparing the predictions with the observed target variable. A model is considered to have good performances if the associated uncertainty interval is small. The shape of the uncertainty interval provides also some information about the model performances in terms of classification errors, false positive and false negative. The uncertainty interval permits to compare different models without selecting a binarization threshold and it applies both for parametric and non parametric predictive models.

UNCERTAINTY INTERVAL TO ASSESS PERFORMANCES OF CREDIT RISK MODELS

Pierpaolo Uberti
2019-01-01

Abstract

In this paper, we propose a novel approach to compare the performances of binary classification models with an application on a real data set on credit risk provided by Unicredit bank. Starting from the probability of default estimated by each predictive model under comparison, the idea is to derive an uncertainty interval comparing the predictions with the observed target variable. A model is considered to have good performances if the associated uncertainty interval is small. The shape of the uncertainty interval provides also some information about the model performances in terms of classification errors, false positive and false negative. The uncertainty interval permits to compare different models without selecting a binarization threshold and it applies both for parametric and non parametric predictive models.
File in questo prodotto:
File Dimensione Formato  
PPH-1905024-ADAS - Proofs II.pdf

accesso chiuso

Tipologia: Documento in Post-print
Dimensione 78.51 kB
Formato Adobe PDF
78.51 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11567/961715
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? 0
social impact