Tests in preparation of class 2018/2019

[madclam]

This document describes tests passed/failed in preparation of the 2018/2019 challenge preparation class:

• Create a new class.
• Upload logo.
• 1. Data. Upload data.

Failed to select a default dataset OR to re-use old dataset, using:

or

We get in both cases:

Finally I created a new dataset and got the error:

This is because I do not have a directory tree, but I think we fixed that, it should accept both no? Particularly because on Codalab it is the opposite: we do NOT want the directory tree.

• Input new dataset, with correct split.
• Input new dataset, with no split. Server Error.

• 2. Split data. Does not work. Even small unsplit files lead to a server error 500.
  IMPORTANT: If we upload a new unsplit dataset and we get that error, the new dataset appears on the data page and the one that we tried to replace is still on the data split page.

• 3. Problem. Uploaded ingestion program OK.

• 4. Metric. Defined with the editor: OK.

• 5. Protocol. OK

• 6. Baseline. OK

• 7. Documentation. OK

• Package and publish. OK