Viewing test suite Across The Board Wh-Movement and CSC
Reference
No reference provided.
Number of items
2
Tags
No tags provided.
Models evaluated
66% (6/9)
Description
No description has been provided for this test suite.
Items for Across The Board Wh-Movement and CSC
| Item |
Condition
|
Beginning | Comp | SubjLeftConj | VerbLeftConj | ObjLeftConj | AdvLeftConj | and | SubjRightConj | VerbRightConj | ObjRightConj | AdvRightConj |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Item | Condition | Beginning | Comp | SubjLeftConj | VerbLeftConj | ObjLeftConj | AdvLeftConj | and | SubjRightConj | VerbRightConj | ObjRightConj | AdvRightConj |
| 1 | ATB-what-2gaps | I know what | the guy | broke | accidentally | and | the mechanic | fixed | skilfully. | |||
| 1 | ATB-what-1gapL | I know what | the guy | broke | accidentally | and | the mechanic | fixed | the engine | skilfully. | ||
| 1 | ATB-what-1gapR | I know what | the guy | broke | the thing | accidentally | and | the mechanic | fixed | skilfully. | ||
| 1 | ATB-what-0gaps | I know what | the guy | broke | the thing | accidentally | and | the mechanic | fixed | the engine | skilfully. | |
| 1 | ATB-that-2gaps | I know that | the guy | broke | accidentally | and | the mechanic | fixed | skilfully. | |||
| 1 | ATB-that-0gaps | I know that | the guy | broke | the thing | accidentally | and | the mechanic | fixed | the engine | skilfully. | |
| 2 | ATB-what-2gaps | I remember what | the chef | made | quickly | and | the waiter | served | silently. | |||
| 2 | ATB-what-1gapL | I remember what | the chef | made | quickly | and | the waiter | served | the dessert | silently. | ||
| 2 | ATB-what-1gapR | I remember what | the chef | made | the meal | quickly | and | the waiter | served | silently. | ||
| 2 | ATB-what-0gaps | I remember what | the chef | made | the meal | quickly | and | the waiter | served | the dessert | silently. | |
| 2 | ATB-that-2gaps | I remember that | the chef | made | quickly | and | the waiter | served | silently. | |||
| 2 | ATB-that-0gaps | I remember that | the chef | made | the meal | quickly | and | the waiter | served | the dessert | silently. |
Predictions for Across The Board Wh-Movement and CSC
|
Formula
|
Description |
|---|---|
| Formula | Description |
| ((682,ATB-what-2gaps/11,AdvRightConj) < (684,ATB-what-1gapR/11,AdvRightConj)) | No description provided. |
| ((687,ATB-that-0gaps/10,ObjRightConj) < (683,ATB-what-1gapL/10,ObjRightConj)) | No description provided. |
| ((684,ATB-what-1gapR/5,ObjLeftConj) > (687,ATB-that-0gaps/5,ObjLeftConj)) | No description provided. |
| ((684,ATB-what-1gapR/7,and) > (687,ATB-that-0gaps/7,and)) | No description provided. |
| ((682,ATB-what-2gaps/6,AdvLeftConj) < (686,ATB-that-2gaps/6,AdvLeftConj)) | No description provided. |
Results for Across The Board Wh-Movement and CSC
| Model | Prediction 1 accuracy | Prediction 2 accuracy | Prediction 3 accuracy | Prediction 4 accuracy | Prediction 5 accuracy | |
|---|---|---|---|---|---|---|
| Model | Prediction 1 accuracy | Prediction 2 accuracy | Prediction 3 accuracy | Prediction 4 accuracy | Prediction 5 accuracy | |
| TinyLSTM | 50.00% | 50.00% | 100.00% | 100.00% | 100.00% | Visualize results |
| GPT-2 | 100.00% | 50.00% | 100.00% | 100.00% | 100.00% | Visualize results |
| GPT-2 XL | 100.00% | 50.00% | 100.00% | 100.00% | 100.00% | Visualize results |
| JRNN | 100.00% | 100.00% | 100.00% | 100.00% | 0.00% | Visualize results |
| Ordered Neurons | 0.00% | 100.00% | 100.00% | 100.00% | 50.00% | Visualize results |
| RNNG | 0.00% | 100.00% | 100.00% | 100.00% | 100.00% | Visualize results |