Individual results

View docs

View in-depth performance of a single language model on a single test suite.

Region-by-region surprisal
Sample item for Subordination (with prepositional phrase)
Item
Condition
Subordinate clause 1 subj_modifier Subordinate clause 2 obj_modifier Main clause
Item Condition Subordinate clause 1 subj_modifier Subordinate clause 2 obj_modifier Main clause
1 sub_no-matrix As the doctor in a long white lab jacket studied the book about several recent advances in cancer therapy .
1 no-sub_no-matrix The doctor in a long white lab jacket studied the book about several recent advances in cancer therapy .
1 sub_matrix As the doctor in a long white lab jacket studied the book about several recent advances in cancer therapy , the nurse walked into the room .
1 no-sub_matrix The doctor in a long white lab jacket studied the book about several recent advances in cancer therapy , the nurse walked into the room .
Prediction performance for GPT-2 XL on Subordination (with prepositional phrase)
Accuracy
Formula
Description
AccuracyPredictionDescription
95.65% (630,sub_no-matrix/5,Main clause) > (632,no-sub_no-matrix/5,Main clause) No description provided.
100.00% (631,sub_matrix/5,Main clause) < (629,no-sub_matrix/5,Main clause) No description provided.