Individual results
View docsView in-depth performance of a single language model on a single test suite.
Region-by-region surprisal
Sample item for Negative Polarity Licensing (ever; with subject relative clause)
The first item of the test suite is shown below for quick reference. Please visit the page for Negative Polarity Licensing (ever; with subject relative clause) to see the full list of items.
| Item |
Condition
|
Licensor | np | compl | rc_verb | rc_dp | rc_subj | has | npi | continuation |
|---|---|---|---|---|---|---|---|---|---|---|
| Item | Condition | Licensor | np | compl | rc_verb | rc_dp | rc_subj | has | npi | continuation |
| 1 | neg_pos | No | author | that | liked | the | senators | has | ever | been popular |
| 1 | neg_neg | No | author | that | liked | no | senators | has | ever | been popular |
| 1 | pos_pos | The | author | that | liked | the | senators | has | ever | been popular |
| 1 | pos_neg | The | author | that | liked | no | senators | has | ever | been popular |
Prediction performance for Transformer XL on Negative Polarity Licensing (ever; with subject relative clause)
| Accuracy |
Formula
|
Description |
|---|---|---|
| Accuracy | Prediction | Description |
| 100.00% | (587,neg_pos/8,npi) < (585,pos_pos/8,npi) | No description provided. |
| 97.37% | (586,neg_neg/8,npi) < (588,pos_neg/8,npi) | No description provided. |
| 13.16% | (587,neg_pos/8,npi) < (588,pos_neg/8,npi) | No description provided. |