Submissions
Challenge Guidelines
In order to reach a broad audience we have tried to avoid setting rules that might artificially disadvantage one research community over another. However, to keep the task as close to an application scenario as possible, and to allow systems to be broadly comparable, there are some guidelines that we would like participants to follow.- The systems should not exploit the SNR labels in the test data. Systems should not exploit the fact that the same utterances are used at each SNR. As already stated on the instructions page, the speaker identity is available from the utterance file name and you can assume this to be known. Noise background. The temporal location of the utterance has been given in order that the utterance can be located in the continuous CHiME audio. It is acceptable to exploit knowledge of the utterance's acoustic context (i.e. the audio occurring before and perhaps even after the utterance). There will probably be a lot of variation in the extent to which system's use this knowledge, so please be clear about the extent to which the context is used. Parameter tuning. We have provided the labels for the final test set so that participants can evaluate their own systems. However, please do not abuse this by tuning free parameters on the final test data. Tune free parameters on the development set and only run the final test set when you are satisfied with your system's tuning. We will expect to see results for both the development and test sets in the final papers.