nep-dcm New Economics Papers
on Discrete Choice Models
Issue of 2010‒09‒03
one paper chosen by
Philip Yu
Hong Kong University

  1. AUK: a simple alternative to the AUC By Kaymak, U.; Ben-David, A.; Potharst, R.

  1. By: Kaymak, U.; Ben-David, A.; Potharst, R.
    Abstract: The area under Receiver Operating Characteristic (ROC) curve, also known as the AUC-index, is commonly used for ranking the performance of data mining models. The AUC has many merits, such as objectivity and ease of interpretation. However, since it is class indifferent, its usefulness while dealing with highly skewed data sets is questionable, to say the least. In this paper, we propose a simple alternative scalar measure to the AUCindex, the Area Under an Kappa curve (AUK). The proposed AUK-index compensates for the above basic flaw of the AUC by being sensitive to the class distribution. Therefore it is particularly suitable for measuring classifiers’ performance on skewed data sets. After introducing the AUK we explore its mathematical relationship with the AUC and show that there is a nonlinear relation between them.
    Keywords: ROC curve;area under ROC curve;AUC;H-measure;Kappa index;AUK;model ranking;model selection
    Date: 2010–06–01

This nep-dcm issue is ©2010 by Philip Yu. It is provided as is without any express or implied warranty. It may be freely redistributed in whole or in part for any purpose. If distributed in part, please include this notice.
General information on the NEP project can be found at For comments please write to the director of NEP, Marco Novarese at <>. Put “NEP” in the subject, otherwise your mail may be rejected.
NEP’s infrastructure is sponsored by the School of Economics and Finance of Massey University in New Zealand.