Skip to content
Quantoros

Repeated PermutationExplainer runs with one seed match exactly. Does that establish adequate explanation accuracy?

Classic MLLevel: IntermediateSHAP · PermutationExplainer

Repeated PermutationExplainer runs with one seed match exactly. Does that establish adequate explanation accuracy?

Hints
  • Repeatability and estimator accuracy are separate properties.
  • A fixed random sample can be consistently inaccurate.

Answer

No. A seed establishes repeatability for that randomized computation, not convergence. Increase the permutation budget and compare several seeds or uncertainty estimates, especially for higher-order interactions.

Source and licence: SHAP · PermutationExplainer · MIT · answer: Quantoros editorial

Related questions