Skip to content
Quantoros

Can the same group appear in test sets of several GroupShuffleSplit iterations?

Classic MLLevel: IntermediateRepeated holdout overlap

Can the same group appear in test sets of several GroupShuffleSplit iterations?

Hints
  • Distinguish within-split and between-split overlap.
  • Repeated holdout is not a partition.

Answer

Yes. Each split is independently sampled; group separation holds within each train/test pair, not across all iterations. Do not assume the test sets partition the dataset.

Source and licence: scikit-learn 1.7.2 — cross validation · BSD-3-Clause · answer: Quantoros editorial

Related questions