Results


The tables below present results for both challenge tracks with either the constrained language model (Ranking A) or the unconstrained language model (Ranking B).

Track 1, Ranking A (constrained LM)

Rank Team Paper Dev Eval
USTC [paper] 31.11 30.96
Institute of Acoustics, CAS [paper] 33.55 35.11
STC-innovations Ltd, ITMO University [paper] 33.53 35.79
Toshiba Cambridge Research Laboratory [paper] 35.89 37.54
Qdreamer [paper] 37.59 39.00
Cloudwalk-XMU [paper] 41.56 40.24
Johns Hopkins University [paper] 41.75 42.07
OPPO [paper] 41.99 42.41
Brno University of Technology [paper] 42.75 44.34
Academia Sinica [paper] 47.28 46.82
IISC [paper] 51.05 50.69
Baseline [paper] 51.8 51.3

[TOP]



Track 1, Ranking B (unconstrained LM)

Rank Team Paper Dev Eval
Qdreamer [paper] 35.96 37.46
STC-innovations Ltd, ITMO University [paper] 30.96 33.91
Toshiba Cambridge Research Laboratory [paper] 34.83 36.83
OPPO [paper] 41.18 42.02
Johns Hopkins University [paper] 40.27 40.47
University of Science and Technology of China (USTC) [paper] 30.78 30.51
Brno University of Technology [paper] 41.21 42.55
Institute of Acoustics, CAS [paper] 32.92 34.53
CloudWalk-XMU [paper] 40.25 39.62
Baseline [paper] 51.8 51.3

[TOP]



Track 2, Ranking A (constrained LM)

Rank Team Paper Dev Eval
City University of New York [paper] 76.05 72.74
Paderborn University [paper] 73.50 68.96
STC-innovations Ltd, ITMO University [paper] 41.56 44.49
Cloudwalk-XMU [paper] 77.52 72.52
Johns Hopkins University [paper] 68.29 68.26
University of Science and Technology of China (USTC) [paper] 68.22 68.48
Brno University of Technology [paper] 55.60 69.17
Academia Sinica [paper] 75.78 73.54
Baseline [paper] 84.3 77.9

[TOP]



Track 2, Ranking B (unconstrained LM)

Rank Team Paper Dev Eval
STC-innovations Ltd, ITMO University [paper] 39.56 42.67
Johns Hopkins University [paper] 67.76 67.51
University of Science and Technology of China (USTC) [paper] 68.15 68.42
Paderborn University [paper] 73.05 68.45
Brno University of Technology [paper] 55.15 69.04
Baseline [paper] 84.3 77.9