Viewing test suite Cataphor Prediction

JSON CSV
Reference
No reference provided.
Number of items
2
Tags
No tags provided.
Models evaluated
33% (3/9)
Description
No description has been provided for this test suite.
Items for Cataphor Prediction
Item
Condition
adjunct_comp adjunct_subject adjunct_verb adjunct_rest main_subj main_adverb main_verb main_object main_rest
Item Condition adjunct_comp adjunct_subject adjunct_verb adjunct_rest main_subj main_adverb main_verb main_object main_rest
1 cata_match When he was at the party, the boy cruelly teased the girl about something.
1 cata_mismatch When she was at the party, the boy cruelly teased the girl about something.
1 new_referent While I was at the party, the boy cruelly teased the girl about something.
2 cata_match While she was working the night shift, the woman occasionally called the man on the phone.
2 cata_mismatch While he was working the night shift, the woman occasionally called the man on the phone.
2 new_referent While I was working the night shift, the woman occasionally called the man on the phone.
Need help? Take a look at the documentation.
Predictions for Cataphor Prediction
Formula
Description
Formula Description
((679,cata_match/5,main_subj) < (680,cata_mismatch/5,main_subj)) No description provided.
((679,cata_match/5,main_subj) < (681,new_referent/5,main_subj)) No description provided.
((680,cata_mismatch/5,main_subj) > (681,new_referent/5,main_subj)) No description provided.
Tip: hover over region or condition names to highlight the corresponding entries in the Items table above. Predictions are evaluated on region-level surprisal values.
Need help? Take a look at the documentation.
Results for Cataphor Prediction
Raw results (CSV) Raw results (JSON) Prediction results (CSV)
Model Prediction 1 accuracy Prediction 2 accuracy Prediction 3 accuracy
Model Prediction 1 accuracy Prediction 2 accuracy Prediction 3 accuracy
TinyLSTM 50.00% 100.00% 50.00% Visualize results
GPT-2 50.00% 100.00% 0.00% Visualize results
Ordered Neurons 50.00% 0.00% 50.00% Visualize results
← Back to test suites