clutrr

Bases: ChatTemplateDataset

CLUTRR relational reasoning benchmark (Facebook Research).

Given a semi-synthetic story about a hypothetical family, infer the kinship relation between two specified family members. The config parameter selects the subset (default "gen_train234_test2to10").