Is accuracy always a good metric?
Classic MLLevel: FoundationClassification
Is accuracy always a good metric?
Hints
- State the task, inputs and prediction target.
- Compare with a simple baseline: assumptions, objective and independent validation.
Answer
Accuracy is not a good performance metric when there is imbalance in the dataset. For example, in binary classification with 95% of A class and 5% of B class, a constant prediction of A class would have an accuracy of 95%. In case of imbalance dataset, we need to choose Precision, recall, or F1 Score depending on the problem we are trying to solve.
Source and licence: Alexey Grigorev & contributors — Data Science Interviews · CC-BY-4.0