Results
The tables below present results for both challenge tracks with either the constrained language model (Ranking A) or the unconstrained language model (Ranking B).
Track 1, Ranking A (constrained LM)
| Rank | Team | Paper | Dev | Eval |
|---|---|---|---|---|
| USTC | [paper] | 31.11 | 30.96 | |
| Institute of Acoustics, CAS | [paper] | 33.55 | 35.11 | |
| STC-innovations Ltd, ITMO University | [paper] | 33.53 | 35.79 | |
| Toshiba Cambridge Research Laboratory | [paper] | 35.89 | 37.54 | |
| Qdreamer | [paper] | 37.59 | 39.00 | |
| Cloudwalk-XMU | [paper] | 41.56 | 40.24 | |
| Johns Hopkins University | [paper] | 41.75 | 42.07 | |
| OPPO | [paper] | 41.99 | 42.41 | |
| Brno University of Technology | [paper] | 42.75 | 44.34 | |
| Academia Sinica | [paper] | 47.28 | 46.82 | |
| IISC | [paper] | 51.05 | 50.69 | |
| Baseline | [paper] | 51.8 | 51.3 |
[TOP]
Track 1, Ranking B (unconstrained LM)
| Rank | Team | Paper | Dev | Eval |
|---|---|---|---|---|
| Qdreamer | [paper] | 35.96 | 37.46 | |
| STC-innovations Ltd, ITMO University | [paper] | 30.96 | 33.91 | |
| Toshiba Cambridge Research Laboratory | [paper] | 34.83 | 36.83 | |
| OPPO | [paper] | 41.18 | 42.02 | |
| Johns Hopkins University | [paper] | 40.27 | 40.47 | |
| University of Science and Technology of China (USTC) | [paper] | 30.78 | 30.51 | |
| Brno University of Technology | [paper] | 41.21 | 42.55 | |
| Institute of Acoustics, CAS | [paper] | 32.92 | 34.53 | |
| CloudWalk-XMU | [paper] | 40.25 | 39.62 | |
| Baseline | [paper] | 51.8 | 51.3 |
[TOP]
Track 2, Ranking A (constrained LM)
| Rank | Team | Paper | Dev | Eval |
|---|---|---|---|---|
| City University of New York | [paper] | 76.05 | 72.74 | |
| Paderborn University | [paper] | 73.50 | 68.96 | |
| STC-innovations Ltd, ITMO University | [paper] | 41.56 | 44.49 | |
| Cloudwalk-XMU | [paper] | 77.52 | 72.52 | |
| Johns Hopkins University | [paper] | 68.29 | 68.26 | |
| University of Science and Technology of China (USTC) | [paper] | 68.22 | 68.48 | |
| Brno University of Technology | [paper] | 55.60 | 69.17 | |
| Academia Sinica | [paper] | 75.78 | 73.54 | |
| Baseline | [paper] | 84.3 | 77.9 |
[TOP]
Track 2, Ranking B (unconstrained LM)
| Rank | Team | Paper | Dev | Eval |
|---|---|---|---|---|
| STC-innovations Ltd, ITMO University | [paper] | 39.56 | 42.67 | |
| Johns Hopkins University | [paper] | 67.76 | 67.51 | |
| University of Science and Technology of China (USTC) | [paper] | 68.15 | 68.42 | |
| Paderborn University | [paper] | 73.05 | 68.45 | |
| Brno University of Technology | [paper] | 55.15 | 69.04 | |
| Baseline | [paper] | 84.3 | 77.9 |