Why does SHAP PermutationExplainer traverse feature orders both forward and backward rather than only once in one…
Classic MLLevel: IntermediateSHAP · PermutationExplainer
Why does SHAP PermutationExplainer traverse feature orders both forward and backward rather than only once in one direction?
Hints
- Consider how the reverse order complements the forward order.
- Exactness for low-order interactions is a limited guarantee.
Answer
The antithetic traversal balances ordering effects and preserves local additivity; the documented paired pass is exact for models with interactions up to second order. Higher-order interactions generally require averaging more permutations.
Source and licence: SHAP · PermutationExplainer · MIT · answer: Quantoros editorial