Individual results
View docsView in-depth performance of a single language model on a single test suite.
Region-by-region surprisal
Sample item for Subordination (with prepositional phrase)
The first item of the test suite is shown below for quick reference. Please visit the page for Subordination (with prepositional phrase) to see the full list of items.
| Item |
Condition
|
Subordinate clause 1 | subj_modifier | Subordinate clause 2 | obj_modifier | Main clause |
|---|---|---|---|---|---|---|
| Item | Condition | Subordinate clause 1 | subj_modifier | Subordinate clause 2 | obj_modifier | Main clause |
| 1 | sub_no-matrix | As the doctor | in a long white lab jacket | studied the book | about several recent advances in cancer therapy | . |
| 1 | no-sub_no-matrix | The doctor | in a long white lab jacket | studied the book | about several recent advances in cancer therapy | . |
| 1 | sub_matrix | As the doctor | in a long white lab jacket | studied the book | about several recent advances in cancer therapy | , the nurse walked into the room . |
| 1 | no-sub_matrix | The doctor | in a long white lab jacket | studied the book | about several recent advances in cancer therapy | , the nurse walked into the room . |
Prediction performance for GPT-2 XL on Subordination (with prepositional phrase)
| Accuracy |
Formula
|
Description |
|---|---|---|
| Accuracy | Prediction | Description |
| 95.65% | (630,sub_no-matrix/5,Main clause) > (632,no-sub_no-matrix/5,Main clause) | No description provided. |
| 100.00% | (631,sub_matrix/5,Main clause) < (629,no-sub_matrix/5,Main clause) | No description provided. |