Good reference for multi-class metrics: precision, recall, F1, MCC. One thing buried in the paper: micro precision and micro recall are mathematically identical. Why report both instead of optimising for cross-entropy?
Metrics for Multi-Class Classification: an Overview
Classification tasks in machine learning involving more than two classes are known by the name of "multi-class classification". Performance indicators are very useful when the aim is to evaluate and compare different classification models or machine learning techniques. Many metrics come in handy to test the ability of a multi-class classifier. Those metrics turn out to be useful at different stage of the development process, e.g. comparing the performance of two different models or analysing the behaviour of the same model by tuning different parameters. In this white paper we review a list of the most promising multi-class metrics, we highlight their advantages and disadvantages and show their possible usages during the development of a classification model.
arxiv.org
