| open jev / customer control v1 |
Noul |
100.0 |
100.0 |
68.5 |
|
来源 ↗ |
| open jev / mailroom control v1 |
Choice |
100.0 |
100.0 |
89.6 |
|
来源 ↗ |
| open jev / phone extraction control v1 |
Noul |
100.0 |
100.0 |
64.1 |
|
来源 ↗ |
| s1mb generalization contextual choice |
Choice |
100.0 |
100.0 |
88.8 |
|
来源 ↗ |
| dbpedia |
Choice |
97.8 |
98.9 |
88.9 |
|
来源 ↗ |
| generalization japanese diverse |
Choice |
97.5 |
100.0 |
94.4 |
|
来源 ↗ |
| open jev / browser control v1 |
Choice |
95.7 |
100.0 |
76.6 |
|
来源 ↗ |
| snli |
Choice |
95.2 |
98.4 |
60.1 |
|
来源 ↗ |
| open jev / sponsor segment control v1 |
Choice |
94.9 |
100.0 |
66.5 |
|
来源 ↗ |
| jmteb retrieval |
Choice |
94.5 |
98.7 |
90.2 |
|
来源 ↗ |
| cvbench relation |
Choice |
94.4 |
96.5 |
80.1 |
|
来源 ↗ |
| open jev / drone control v1 |
Noul |
94.1 |
100.0 |
63.9 |
|
来源 ↗ |
| generalization vision easy |
Noul |
94.0 |
100.0 |
87.6 |
|
来源 ↗ |
| clinc |
Choice |
93.8 |
99.3 |
70.6 |
|
来源 ↗ |
| s1mb generalization diverse choice |
Choice |
93.4 |
100.0 |
78.2 |
|
来源 ↗ |
| generalization vision easy |
Choice |
92.9 |
98.6 |
90.8 |
|
来源 ↗ |
| generalization japanese diverse |
Noul |
92.7 |
100.0 |
91.6 |
|
来源 ↗ |
| cvbench depth |
Choice |
92.0 |
93.3 |
78.0 |
|
来源 ↗ |
| open jev / mailroom control v1 |
Noul |
90.6 |
100.0 |
73.3 |
|
来源 ↗ |
| sdoh nli |
Noul |
90.0 |
100.0 |
70.1 |
|
来源 ↗ |
| lonli |
Choice |
88.5 |
98.4 |
53.0 |
|
来源 ↗ |
| scienceqa |
Choice |
88.0 |
99.5 |
86.8 |
|
来源 ↗ |
| open jev / ir control v1 |
Choice |
88.0 |
88.0 |
55.6 |
|
来源 ↗ |
| s1mb generalization diverse noul |
Noul |
88.0 |
100.0 |
70.8 |
|
来源 ↗ |
| banking77 |
Choice |
87.4 |
93.7 |
64.3 |
|
来源 ↗ |
| massive |
Choice |
86.8 |
97.8 |
73.5 |
|
来源 ↗ |
| laya / ag news |
Choice |
86.6 |
94.0 |
77.7 |
|
来源 ↗ |
| miqa |
Choice |
86.4 |
97.7 |
71.1 |
|
来源 ↗ |
| paws |
Noul |
86.0 |
92.0 |
52.7 |
|
来源 ↗ |
| open jev / customer control v1 |
Score |
85.8 |
99.3 |
44.6 |
|
来源 ↗ |
| open jev / ir control v1 |
Noul |
85.7 |
100.0 |
60.4 |
|
来源 ↗ |
| sugarcrepe |
Choice |
85.7 |
95.2 |
81.0 |
|
来源 ↗ |
| hatecheck |
Noul |
84.0 |
100.0 |
57.6 |
|
来源 ↗ |
| scitail |
Noul |
84.0 |
98.0 |
63.5 |
|
来源 ↗ |
| scone |
Choice |
84.0 |
98.0 |
48.7 |
|
来源 ↗ |
| open jev / workflow controls v1 / customer service |
Noul |
84.0 |
100.0 |
53.9 |
|
来源 ↗ |
| jcommonsenseqa |
Choice |
83.8 |
97.9 |
87.7 |
|
来源 ↗ |
| bbq |
Choice |
83.3 |
98.3 |
64.6 |
|
来源 ↗ |
| open jev / customer control v1 |
Choice |
82.6 |
82.6 |
71.6 |
|
来源 ↗ |
| nlvr2 |
Noul |
82.5 |
88.9 |
59.7 |
|
来源 ↗ |
| mtop |
Choice |
82.3 |
93.2 |
67.5 |
|
来源 ↗ |
| s1mb generalization contextual noul |
Noul |
82.0 |
100.0 |
72.2 |
|
来源 ↗ |
| hwu64 |
Choice |
81.9 |
95.7 |
67.3 |
|
来源 ↗ |
| open jev / workflow controls v1 / security incidents |
Noul |
81.3 |
100.0 |
50.1 |
|
来源 ↗ |
| arc |
Choice |
80.9 |
98.5 |
73.8 |
|
来源 ↗ |
| open jev / phone extraction control v1 |
Choice |
80.4 |
100.0 |
44.6 |
|
来源 ↗ |
| open jev / amount extraction control v1 |
Choice |
80.4 |
100.0 |
63.3 |
|
来源 ↗ |
| open jev / workflow controls v1 / agent trace observability |
Noul |
80.0 |
100.0 |
39.6 |
|
来源 ↗ |
| openbookqa |
Choice |
79.2 |
98.6 |
64.5 |
|
来源 ↗ |
| rvlcdip |
Choice |
78.0 |
78.0 |
61.8 |
|
来源 ↗ |
| generalization japanese knowledge hard |
Choice |
77.8 |
99.6 |
88.0 |
|
来源 ↗ |
| open jev / email selection control v1 |
Noul |
76.9 |
100.0 |
57.0 |
|
来源 ↗ |
| followir robust04 |
Noul |
76.7 |
90.9 |
53.8 |
|
来源 ↗ |
| quartz |
Choice |
76.2 |
90.5 |
59.5 |
|
来源 ↗ |
| laya / enron spam |
Noul |
76.0 |
100.0 |
65.0 |
|
来源 ↗ |
| nights |
Choice |
75.2 |
92.0 |
75.3 |
|
来源 ↗ |
| s1mb generalization contextual score |
Score |
75.1 |
99.3 |
52.7 |
|
来源 ↗ |
| gretel pii |
Choice |
75.0 |
94.8 |
51.3 |
|
来源 ↗ |
| canttalk |
Noul |
74.0 |
92.0 |
50.7 |
|
来源 ↗ |
| hans |
Noul |
74.0 |
100.0 |
53.2 |
|
来源 ↗ |
| jnli |
Choice |
74.0 |
87.5 |
68.4 |
|
来源 ↗ |
| open jev / workflow controls v1 / invoice processing |
Noul |
73.8 |
100.0 |
47.2 |
|
来源 ↗ |
| cvbench distance |
Choice |
73.6 |
79.9 |
59.6 |
|
来源 ↗ |
| pope |
Noul |
73.3 |
80.0 |
73.0 |
|
来源 ↗ |
| qasper |
Noul |
72.0 |
88.0 |
51.5 |
|
来源 ↗ |
| commonsensemoralja |
Noul |
70.0 |
89.3 |
68.2 |
|
来源 ↗ |
| impli |
Noul |
70.0 |
96.0 |
57.2 |
|
来源 ↗ |
| vsr |
Noul |
69.1 |
77.6 |
48.5 |
|
来源 ↗ |
| open jev / email selection control v1 |
Choice |
68.7 |
100.0 |
38.6 |
|
来源 ↗ |
| open jev / painting geometry v1 |
Choice |
68.4 |
100.0 |
60.5 |
|
来源 ↗ |
| babi nli |
Noul |
68.0 |
96.0 |
48.6 |
|
来源 ↗ |
| argument quality |
Choice |
67.3 |
95.9 |
53.3 |
|
来源 ↗ |
| s1mb generalization diverse score |
Score |
66.1 |
97.6 |
52.8 |
|
来源 ↗ |
| jsts |
Score |
65.4 |
69.9 |
55.6 |
|
来源 ↗ |
| contract nli |
Choice |
64.8 |
81.6 |
43.2 |
|
来源 ↗ |
| visa |
Noul |
62.6 |
73.4 |
30.1 |
|
来源 ↗ |
| few nerd |
Choice |
62.0 |
87.8 |
52.9 |
|
来源 ↗ |
| mvtec ad |
Noul |
61.6 |
76.9 |
51.2 |
|
来源 ↗ |
| creak |
Noul |
60.0 |
90.0 |
48.3 |
|
来源 ↗ |
| aegis2 |
Noul |
59.7 |
68.3 |
39.7 |
|
来源 ↗ |
| scicite |
Choice |
58.1 |
74.2 |
49.5 |
|
来源 ↗ |
| open jev / citation control v1 |
Choice |
56.1 |
100.0 |
55.9 |
|
来源 ↗ |
| ethos |
Noul |
56.0 |
76.0 |
49.5 |
|
来源 ↗ |
| tallyqa |
Score |
55.8 |
72.0 |
48.1 |
|
来源 ↗ |
| generalization vision hard |
Noul |
55.7 |
84.9 |
48.0 |
|
来源 ↗ |
| gsm8k |
Choice |
55.7 |
95.7 |
38.1 |
|
来源 ↗ |
| robust lr |
Choice |
55.0 |
98.3 |
29.4 |
|
来源 ↗ |
| synthetic relevance / nanobeir / nanomsmarco |
Noul |
54.4 |
64.1 |
45.4 |
|
来源 ↗ |
| winobias |
Choice |
54.4 |
95.7 |
42.7 |
|
来源 ↗ |
| go emotions |
Noul |
54.1 |
63.4 |
42.2 |
|
来源 ↗ |
| ruletaker |
Noul |
54.0 |
100.0 |
39.4 |
|
来源 ↗ |
| generalization vision hard |
Choice |
53.3 |
84.1 |
48.6 |
|
来源 ↗ |
| open jev / painting geometry v1 |
Noul |
50.5 |
100.0 |
42.0 |
|
来源 ↗ |
| open jev / vizdoom basic v1 |
Score |
50.2 |
100.0 |
42.4 |
|
来源 ↗ |
| crows pairs |
Choice |
50.0 |
77.1 |
38.0 |
|
来源 ↗ |
| open jev / amount extraction control v1 |
Noul |
50.0 |
100.0 |
44.2 |
|
来源 ↗ |
| open jev / reasoning control v1 |
Choice |
50.0 |
100.0 |
41.7 |
|
来源 ↗ |
| spartqa |
Choice |
48.4 |
93.5 |
14.2 |
|
来源 ↗ |
| synthetic relevance / nanobeir / nanonq |
Noul |
48.4 |
72.7 |
48.0 |
|
来源 ↗ |
| open jev / reasoning control v1 |
Noul |
46.7 |
100.0 |
34.3 |
|
来源 ↗ |
| generalization vision easy |
Score |
46.7 |
79.7 |
50.0 |
|
来源 ↗ |
| jmmlu japan |
Choice |
46.7 |
94.2 |
68.3 |
|
来源 ↗ |
| jsem |
Choice |
45.7 |
69.2 |
46.2 |
|
来源 ↗ |
| synthetic relevance / nanocoir |
Noul |
43.6 |
73.6 |
42.2 |
|
来源 ↗ |
| kuci |
Choice |
43.1 |
85.8 |
64.3 |
|
来源 ↗ |
| jamp |
Choice |
42.0 |
81.5 |
50.1 |
|
来源 ↗ |
| open jev / reasoning control v1 |
Score |
41.7 |
96.3 |
38.3 |
|
来源 ↗ |
| lexcomp |
Noul |
40.0 |
60.0 |
27.8 |
|
来源 ↗ |
| laya / typed decisions |
Noul |
39.9 |
49.2 |
30.0 |
|
来源 ↗ |
| synthetic relevance / nanobeir / nanotouche2020 |
Noul |
39.6 |
48.2 |
32.3 |
|
来源 ↗ |
| synthetic relevance / nanobeir / nanomsmarco |
Score |
39.1 |
57.3 |
25.1 |
|
来源 ↗ |
| jsick sts |
Score |
38.6 |
61.5 |
40.2 |
|
来源 ↗ |
| synthetic relevance / nanobeir / nanotouche2020 |
Score |
38.3 |
49.4 |
25.5 |
|
来源 ↗ |
| cladder |
Noul |
38.0 |
94.0 |
28.6 |
|
来源 ↗ |
| open jev / entity alignment control v1 |
Noul |
37.2 |
100.0 |
50.5 |
|
来源 ↗ |
| defeasible nli |
Choice |
37.0 |
89.1 |
43.1 |
|
来源 ↗ |
| synthetic relevance / nanobeir / nanofiqa2018 |
Noul |
36.7 |
58.0 |
35.3 |
|
来源 ↗ |
| arct |
Choice |
36.2 |
89.4 |
49.2 |
|
来源 ↗ |
| stepgame |
Choice |
35.7 |
82.1 |
24.9 |
|
来源 ↗ |
| followir core17 |
Noul |
35.5 |
46.6 |
25.2 |
|
来源 ↗ |
| synthetic relevance / nanobeir / nanohotpotqa |
Noul |
35.5 |
78.9 |
36.1 |
|
来源 ↗ |
| civil comments |
Noul |
35.3 |
52.8 |
25.2 |
|
来源 ↗ |
| synthetic relevance / nanobeir / nanodbpedia |
Noul |
35.1 |
53.2 |
33.8 |
|
来源 ↗ |
| patent similarity |
Score |
34.2 |
53.0 |
24.1 |
|
来源 ↗ |
| synthetic relevance / nanobeir / nanoarguana |
Noul |
34.1 |
53.5 |
22.1 |
|
来源 ↗ |
| generalization japanese knowledge hard |
Noul |
34.0 |
87.3 |
50.8 |
|
来源 ↗ |
| wiqa |
Choice |
33.3 |
68.3 |
24.1 |
|
来源 ↗ |
| synthetic relevance / nanobeir / nanonfcorpus |
Noul |
33.3 |
49.7 |
29.6 |
|
来源 ↗ |
| laya / typed decisions |
Score |
31.0 |
76.0 |
35.4 |
|
来源 ↗ |
| synthetic relevance / nanobeir / nanodbpedia |
Score |
30.8 |
50.3 |
23.4 |
|
来源 ↗ |
| synthetic relevance / nanobeir / nanofiqa2018 |
Score |
30.1 |
49.0 |
21.1 |
|
来源 ↗ |
| mmmlu |
Choice |
29.8 |
78.2 |
52.8 |
|
来源 ↗ |
| fol nli |
Choice |
29.5 |
75.4 |
17.3 |
|
来源 ↗ |
| logical entailment |
Noul |
28.0 |
84.0 |
18.7 |
|
来源 ↗ |
| ethics |
Noul |
27.1 |
80.6 |
33.4 |
|
来源 ↗ |
| synthetic relevance / nanobeir / nanohotpotqa |
Score |
26.0 |
71.8 |
20.9 |
|
来源 ↗ |
| laya / typed decisions |
Choice |
25.2 |
35.7 |
23.3 |
|
来源 ↗ |
| janli |
Choice |
24.4 |
88.9 |
42.3 |
|
来源 ↗ |
| synthetic relevance / nanobeir / nanonfcorpus |
Score |
24.4 |
40.9 |
15.9 |
|
来源 ↗ |
| sgd |
Choice |
23.7 |
96.6 |
28.6 |
|
来源 ↗ |
| open jev / vizdoom basic v1 |
Noul |
23.5 |
100.0 |
53.0 |
|
来源 ↗ |
| corr2cause |
Choice |
23.3 |
91.7 |
9.4 |
|
来源 ↗ |
| open jev / entity alignment control v1 |
Score |
22.8 |
100.0 |
18.5 |
|
来源 ↗ |
| mmlu prox ja |
Choice |
21.9 |
69.5 |
39.6 |
|
来源 ↗ |
| open jev / snake v1 |
Choice |
21.6 |
83.5 |
18.4 |
|
来源 ↗ |
| generalization japanese knowledge hard |
Score |
21.4 |
86.8 |
45.6 |
|
来源 ↗ |
| plane |
Noul |
20.0 |
100.0 |
12.6 |
|
来源 ↗ |
| ud ewt |
Choice |
18.8 |
96.0 |
19.5 |
|
来源 ↗ |
| synthetic relevance / nanobeir / nanoscidocs |
Noul |
18.3 |
48.5 |
21.5 |
|
来源 ↗ |
| tracie |
Noul |
18.0 |
68.0 |
14.4 |
|
来源 ↗ |
| winowhy |
Noul |
16.0 |
66.0 |
25.8 |
|
来源 ↗ |
| boardgameqa |
Choice |
15.6 |
90.6 |
24.4 |
|
来源 ↗ |
| generalization japanese math formal hard |
Choice |
15.6 |
48.4 |
21.2 |
|
来源 ↗ |
| aqua rat |
Choice |
14.1 |
83.1 |
19.6 |
|
来源 ↗ |
| mintaka ja boolean |
Noul |
14.0 |
68.0 |
37.5 |
|
来源 ↗ |
| esci |
Choice |
13.7 |
49.3 |
17.5 |
|
来源 ↗ |
| followir news21 |
Noul |
12.0 |
58.0 |
18.4 |
|
来源 ↗ |
| synthetic relevance / nanobeir / nanonq |
Score |
11.9 |
54.3 |
13.3 |
|
来源 ↗ |
| generalization vision hard |
Score |
11.7 |
49.2 |
19.7 |
|
来源 ↗ |
| temporal nli |
Choice |
11.3 |
100.0 |
27.9 |
|
来源 ↗ |
| gpqa ja main |
Choice |
8.9 |
54.7 |
21.0 |
|
来源 ↗ |
| jcola |
Noul |
7.5 |
57.2 |
21.5 |
|
来源 ↗ |
| jamc qa |
Choice |
6.7 |
65.3 |
22.9 |
|
来源 ↗ |
| open jev / context retention control v1 |
Noul |
6.0 |
100.0 |
35.1 |
|
来源 ↗ |
| sobaco culture |
Choice |
4.5 |
80.5 |
30.8 |
|
来源 ↗ |
| synthetic relevance / nanobeir / nanoscidocs |
Score |
4.5 |
36.7 |
10.6 |
|
来源 ↗ |
| open jev / drone control v1 |
Choice |
3.5 |
100.0 |
13.3 |
|
来源 ↗ |
| jculture mcq |
Noul |
2.6 |
44.3 |
12.9 |
|
来源 ↗ |
| argument quality |
Noul |
1.8 |
30.2 |
7.7 |
|
来源 ↗ |
| ethics |
Choice |
0.0 |
100.0 |
28.3 |
|
来源 ↗ |
| generalization japanese math formal hard |
Noul |
0.0 |
34.7 |
10.7 |
|
来源 ↗ |
| generalization japanese math formal hard |
Score |
0.0 |
9.9 |
1.1 |
|
来源 ↗ |
| hh rlhf |
Choice |
0.0 |
33.3 |
4.4 |
|
来源 ↗ |
| koniq |
Score |
0.0 |
51.8 |
8.1 |
|
来源 ↗ |
| nlsat |
Noul |
0.0 |
22.0 |
3.2 |
|
来源 ↗ |
| open jev / drone control v1 |
Score |
0.0 |
100.0 |
7.1 |
|
来源 ↗ |
| open jev / ir control v1 |
Score |
0.0 |
100.0 |
22.9 |
|
来源 ↗ |
| open jev / painting geometry v1 |
Score |
0.0 |
100.0 |
29.6 |
|
来源 ↗ |
| open jev / silent failure control v1 |
Noul |
0.0 |
100.0 |
49.5 |
|
来源 ↗ |
| open jev / snake v1 |
Noul |
0.0 |
100.0 |
19.0 |
|
来源 ↗ |
| open jev / tic tac toe v1 |
Choice |
0.0 |
54.5 |
5.1 |
|
来源 ↗ |
| poem sentiment |
Choice |
0.0 |
68.6 |
9.2 |
|
来源 ↗ |
| synthetic relevance / nanobeir / nanoarguana |
Score |
0.0 |
43.2 |
10.3 |
|
来源 ↗ |
| synthetic relevance / nanocoir |
Score |
0.0 |
43.8 |
6.8 |
|
来源 ↗ |