Repeated PermutationExplainer runs with one seed match exactly. Does that establish adequate explanation accuracy?
Classic MLLevel: IntermediateSHAP · PermutationExplainer
Repeated PermutationExplainer runs with one seed match exactly. Does that establish adequate explanation accuracy?
Hints
- Repeatability and estimator accuracy are separate properties.
- A fixed random sample can be consistently inaccurate.
Answer
No. A seed establishes repeatability for that randomized computation, not convergence. Increase the permutation budget and compare several seeds or uncertainty estimates, especially for higher-order interactions.
Source and licence: SHAP · PermutationExplainer · MIT · answer: Quantoros editorial