Standalone evaluation jobs using native checkpoint restoration.
Evaluate(spec: ExecutionSpec, base: Node | None = None)
Bases: Evaluator[GPT]
Evaluate initialized or restored GPT weights with a declared EVALUATION.
BackboneEvaluate(spec: ExecutionSpec, base: Node | None = None)
Bases: Evaluator[Module]
Evaluate HuggingFace weights or a native checkpoint based on that model.