Viewing test suite Cataphor Prediction
Reference
No reference provided.
Number of items
2
Tags
No tags provided.
Models evaluated
33% (3/9)
Description
No description has been provided for this test suite.
Items for Cataphor Prediction
Item |
Condition
|
adjunct_comp | adjunct_subject | adjunct_verb | adjunct_rest | main_subj | main_adverb | main_verb | main_object | main_rest |
---|---|---|---|---|---|---|---|---|---|---|
Item | Condition | adjunct_comp | adjunct_subject | adjunct_verb | adjunct_rest | main_subj | main_adverb | main_verb | main_object | main_rest |
1 | cata_match | When | he | was | at the party, | the boy | cruelly | teased | the girl | about something. |
1 | cata_mismatch | When | she | was | at the party, | the boy | cruelly | teased | the girl | about something. |
1 | new_referent | While | I | was | at the party, | the boy | cruelly | teased | the girl | about something. |
2 | cata_match | While | she | was | working the night shift, | the woman | occasionally | called | the man | on the phone. |
2 | cata_mismatch | While | he | was | working the night shift, | the woman | occasionally | called | the man | on the phone. |
2 | new_referent | While | I | was | working the night shift, | the woman | occasionally | called | the man | on the phone. |
Predictions for Cataphor Prediction
Formula
|
Description |
---|---|
Formula | Description |
((679,cata_match/5,main_subj) < (680,cata_mismatch/5,main_subj)) | No description provided. |
((679,cata_match/5,main_subj) < (681,new_referent/5,main_subj)) | No description provided. |
((680,cata_mismatch/5,main_subj) > (681,new_referent/5,main_subj)) | No description provided. |
Results for Cataphor Prediction
Model | Prediction 1 accuracy | Prediction 2 accuracy | Prediction 3 accuracy | |
---|---|---|---|---|
Model | Prediction 1 accuracy | Prediction 2 accuracy | Prediction 3 accuracy | |
TinyLSTM | 50.00% | 100.00% | 50.00% | Visualize results |
GPT-2 | 50.00% | 100.00% | 0.00% | Visualize results |
Ordered Neurons | 50.00% | 0.00% | 50.00% | Visualize results |