pile pile ¶ Pile perplexity evaluation. Measures language model perplexity on a sample from the Pile. Returns 1/perplexity (higher is better). PileEval() ¶ Bases: PerplexityEvaluation Perplexity evaluation on the Pile (EleutherAI).