Viewing test suite ORC with gap and no gap

JSON CSV
Reference
No reference provided.
Number of items
24
Tags
No tags provided.
Models evaluated
66% (6/9)
Description
No description has been provided for this test suite.
Items for ORC with gap and no gap
Item
Condition
sujet1 verbe1 cmp1 that sujet2 aux verbe2 gap/noGap test cmp2
Item Condition sujet1 verbe1 cmp1 that sujet2 aux verbe2 gap/noGap test cmp2
1 ORCpl_gap Roland smiles o the offenders that the policeman has been investigating secretly for a month.
1 ORCsg_gap Roland smiles o the offender that the policeman has been investigating secretly for a month.
1 ORCpl_noGap Roland smiles o the offenders that the policeman has been investigating him secretly for a month.
1 ORCsg_noGap Roland smiles o the offender that the policeman has been investigating him secretly for a month.
2 ORCpl_gap Julia smiles to the students that the speaker has been putting to sleep seriously from the beginning.
2 ORCsg_gap Julia smiles to the student that the speaker has been putting to sleep seriously from the beginning.
2 ORCpl_noGap Julia smiles to the students that the speaker has been putting her to sleep seriously from the beginning.
2 ORCsg_noGap Julia smiles to the student that the speaker has been putting her to sleep seriously from the beginning.
3 ORCpl_gap Paul thinks of the voters that the politician has been frankly disappointing since the elections.
3 ORCsg_gap Paul thinks of the voter that the politician has been frankly disappointing since the elections.
3 ORCpl_noGap Paul thinks of the voters that the politician has been frankly disappointing him since the elections.
3 ORCsg_noGap Paul thinks of the voter that the politician has been frankly disappointing him since the elections.
4 ORCpl_gap Louise smiles to the girls that the witch frightens on purpose for Halloween.
4 ORCsg_gap Louise smiles to the girl that the witch frightens on purpose for Halloween.
4 ORCpl_noGap Louise smiles to the girls that the witch frightens her on purpose for Halloween.
4 ORCsg_noGap Louise smiles to the girl that the witch frightens her on purpose for Halloween.
5 ORCpl_gap Laura smiles to the shepherds that the sheep is following stupidly after the shearing.
5 ORCsg_gap Laura smiles to the shepherd that the sheep is following stupidly after the shearing.
5 ORCpl_noGap Laura smiles to the shepherds that the sheep is following her stupidly after the shearing.
5 ORCsg_noGap Laura smiles to the shepherd that the sheep is following her stupidly after the shearing.
6 ORCpl_gap Peter calls the candidates that the jury will firmly wait after the audition.
6 ORCsg_gap Peter calls the candidate that the jury will firmly wait after the audition.
6 ORCpl_noGap Peter calls the candidates that the jury will firmly wait him for after the audition.
6 ORCsg_noGap Peter calls the candidate that the jury will firmly wait him for after the audition.
7 ORCpl_gap Mark thinks of the people that the unhappiness unites inevitably after the tragedy.
7 ORCsg_gap Mark thinks of the person that the unhappiness unites inevitably after the tragedy.
7 ORCpl_noGap Mark thinks of the people that the unhappiness unites him inevitably after the tragedy.
7 ORCsg_noGap Mark thinks of the person that the unhappiness unites him inevitably after the tragedy.
8 ORCpl_gap Claire attracts the workers that the fireplace has blackened a lot since the works.
8 ORCsg_gap Claire attracts the worker that the fireplace has blackened a lot since the works.
8 ORCpl_noGap Claire attracts the workers that the fireplace has blackened her a lot since the works.
8 ORCsg_noGap Claire attracts the worker that the fireplace has blackened her a lot since the works.
9 ORCpl_gap Patricia talks to the customers that the hat makes tall because of the feathers.
9 ORCsg_gap Patricia talks to the customer that the hat makes tall because of the feathers.
9 ORCpl_noGap Patricia talks to the customers that the hat makes her tall because of the feathers.
9 ORCsg_noGap Patricia talks to the customer that the hat makes her tall because of the feathers.
10 ORCpl_gap Aude is liked by the athletes that the massage relaxes always after the training.
10 ORCsg_gap Aude is liked by the athlete that the massage relaxes always after the training.
10 ORCpl_noGap Aude is liked by the athletes that the massage relaxes her always after the training.
10 ORCsg_noGap Aude is liked by the athlete that the massage relaxes her always after the training.
11 ORCpl_gap Luke thinks of the girls that the seducer has been addressing assiduously for an hour.
11 ORCsg_gap Luke thinks of the girl that the seducer has been addressing assiduously for an hour.
11 ORCpl_noGap Luke thinks of the girls that the seducer has been addressing him assiduously for an hour.
11 ORCsg_noGap Luke thinks of the girl that the seducer has been addressing him assiduously for an hour.
12 ORCpl_gap Anne speaks to the actors that the audience has been applauding frantically after each show.
12 ORCsg_gap Anne speaks to the actor that the audience has been applauding frantically after each show.
12 ORCpl_noGap Anne speaks to the actors that the audience has been applauding her frantically after each show.
12 ORCsg_noGap Anne speaks to the actor that the audience has been applauding her frantically after each show.
13 ORCpl_gap Joan speaks to the neighbours that the excursion has rarely enthused at the end of the year.
13 ORCsg_gap Joan speaks to the neighbour that the excursion has rarely enthused at the end of the year.
13 ORCpl_noGap Joan speaks to the neighbours that the excursion has rarely enthused him at the end of the year.
13 ORCsg_noGap Joan speaks to the neighbour that the excursion has rarely enthused him at the end of the year.
14 ORCpl_gap Joan calls the lawyers that the disappointment embitters inevitably fter the trial.
14 ORCsg_gap Joan calls the lawyer that the disappointment embitters inevitably fter the trial.
14 ORCpl_noGap Joan calls the lawyers that the disappointment embitters him inevitably fter the trial.
14 ORCsg_noGap Joan calls the lawyer that the disappointment embitters him inevitably fter the trial.
15 ORCpl_gap Sebastian smiles to the patients that the tranquilliser has been weakening progressively for a year.
15 ORCsg_gap Sebastian smiles to the patient that the tranquilliser has been weakening progressively for a year.
15 ORCpl_noGap Sebastian smiles to the patients that the tranquilliser has been weakening him progressively for a year.
15 ORCsg_noGap Sebastian smiles to the patient that the tranquilliser has been weakening him progressively for a year.
16 ORCpl_gap Jerome talks to the prisoners that the warden sometimes lets out into the courtyard.
16 ORCsg_gap Jerome talks to the prisoner that the warden sometimes lets out into the courtyard.
16 ORCpl_noGap Jerome talks to the prisoners that the warden sometimes lets him out into the courtyard.
16 ORCsg_noGap Jerome talks to the prisoner that the warden sometimes lets him out into the courtyard.
17 ORCpl_gap Benjamin thinks of the teen-agers that the educator has been beating often for a few years.
17 ORCsg_gap Benjamin thinks of the teen-ager that the educator has been beating often for a few years.
17 ORCpl_noGap Benjamin thinks of the teen-agers that the educator has been beating him often for a few years.
17 ORCsg_noGap Benjamin thinks of the teen-ager that the educator has been beating him often for a few years.
18 ORCpl_gap Fred smiles to the children that the priest has been blessing happily after each service.
18 ORCsg_gap Fred smiles to the child that the priest has been blessing happily after each service.
18 ORCpl_noGap Fred smiles to the children that the priest has been blessing him happily after each service.
18 ORCsg_noGap Fred smiles to the child that the priest has been blessing him happily after each service.
19 ORCpl_gap Charles smiles to the victims that the treatment is curing slowly but surely.
19 ORCsg_gap Charles smiles to the victim that the treatment is curing slowly but surely.
19 ORCpl_noGap Charles smiles to the victims that the treatment is curing him slowly but surely.
19 ORCsg_noGap Charles smiles to the victim that the treatment is curing him slowly but surely.
20 ORCpl_gap Lise speaks to the women whose weight the diet is reducing surprisingly easily.
20 ORCsg_gap Lise speaks to the woman whose weight the diet is reducing surprisingly easily.
20 ORCpl_noGap Lise speaks to the women whose weight the diet is reducing her surprisingly easily.
20 ORCsg_noGap Lise speaks to the woman whose weight the diet is reducing her surprisingly easily.
21 ORCpl_gap Giles speaks to the workers that the effort has been tiring inevitably with time.
21 ORCsg_gap Giles speaks to the worker that the effort has been tiring inevitably with time.
21 ORCpl_noGap Giles speaks to the workers that the effort has been tiring him inevitably with time.
21 ORCsg_noGap Giles speaks to the worker that the effort has been tiring him inevitably with time.
22 ORCpl_gap Jack thinks of the owners that the stress has been aging prematurely despite the anti-anxiety medications.
22 ORCsg_gap Jack thinks of the owner that the stress has been aging prematurely despite the anti-anxiety medications.
22 ORCpl_noGap Jack thinks of the owners that the stress has been aging him prematurely despite the anti-anxiety medications.
22 ORCsg_noGap Jack thinks of the owner that the stress has been aging him prematurely despite the anti-anxiety medications.
23 ORCpl_gap Patrick thinks of the families that the holidays have been reuniting every year for ten days.
23 ORCsg_gap Patrick thinks of the familie that the holidays have been reuniting every year for ten days.
23 ORCpl_noGap Patrick thinks of the families that the holidays have been reuniting him every year for ten days.
23 ORCsg_noGap Patrick thinks of the familie that the holidays have been reuniting him every year for ten days.
24 ORCpl_gap Bernard remembers the gamblers that the casino ruins every very fast.
24 ORCsg_gap Bernard remembers the gambler that the casino ruins unfortunately very fast.
24 ORCpl_noGap Bernard remembers the gamblers that the casino ruins him unfortunately very fast.
24 ORCsg_noGap Bernard remembers the gambler that the casino ruins him unfortunately very fast.
Need help? Take a look at the documentation.
Predictions for ORC with gap and no gap
Formula
Description
Formula Description
((688,ORCpl_gap/9,test) < (690,ORCpl_noGap/9,test)) No description provided.
((689,ORCsg_gap/9,test) < (691,ORCsg_noGap/9,test)) No description provided.
Tip: hover over region or condition names to highlight the corresponding entries in the Items table above. Predictions are evaluated on region-level surprisal values.
Need help? Take a look at the documentation.
Results for ORC with gap and no gap
Raw results (CSV) Raw results (JSON) Prediction results (CSV)
Model Prediction 1 accuracy Prediction 2 accuracy
Model Prediction 1 accuracy Prediction 2 accuracy
TinyLSTM 62.50% 54.17% Visualize results
GPT-2 50.00% 41.67% Visualize results
GPT-2 XL 54.17% 62.50% Visualize results
JRNN 37.50% 41.67% Visualize results
Ordered Neurons 70.83% 70.83% Visualize results
RNNG 50.00% 58.33% Visualize results
← Back to test suites