EvaluationThe evaluation tools are now available for download (pcchome.tar.gz). Documentation is included with the download but can also be viewed online here. The tools include scripts that will allow you to:
- train a baseline recognition system using the challenge training data,
- transcribe utterances in the development test set — either before or after enhancement/separation — using a trained recognition system,
- score a set of recognition transcriptions using a standardised scoring script.
|SNR =||-6 dB||-3 dB||0 dB||3 dB||6 dB||9 dB|
|Final test set||30.33||35.42||49.50||62.92||75.00||82.42|
These are the baseline 'do nothing' results. While extensive testing has been performed we would appreciate rapid feedback on any problems that you find. Please report problems to Ning Ma (email@example.com).