Skip to content

mnli

mnli

MNLIEval()

Bases: RolloutEvaluation

MNLI evaluation using validation_matched split.

max_new_tokens(inference: Any) -> int

Need ~3 tokens for entailment/neutral/contradiction.