Individual results

View docs

View in-depth performance of a single language model on a single test suite.

Region-by-region surprisal
Sample item for Comparaison ORC and CMP short
Item
Condition
prefix CMP that subject aux verb continuation
Item Condition prefix CMP that subject aux verb continuation
1 CMPpl Roland points out to the offenders that the policeman has been intervening secretly for a month.
1 ORCpl Roland smiles to the offenders that the policeman has been investigating him secretly for a month.
1 CMPsg Roland points out to the offender that the policeman has been intervening secretly for a month.
1 ORCsg Roland smiles to the offender that the policeman has been investigating him secretly for a month.
Prediction performance for GPT-2 on Comparaison ORC and CMP short
Accuracy
Formula
Description
AccuracyPredictionDescription
0.00% ((696,CMPpl/6,verb) > (696,CMPpl/6,verb)) No description provided.