Skip to content

Do not assume determinism #575

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
mzuenni wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Do not assume determinism #575

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 2 additions & 5 deletions spec/2025-09.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -752,11 +752,8 @@ Extension | Described in
`.yaml` | [Test case configuration](#test-case-configuration) | Additional configuration of the test case
`.png`, `.jpg`, `.jpeg`, `.svg` | [Illustrations](#illustrations) | Illustration of the test case

Judge systems may assume that the result of running a program on a test case is deterministic.
For any two test cases, if the contents of their `.in` and `.files` directory are equivalent,
as well as the `args` sequence in the `.yaml` file, then the input of the two test cases is equivalent.
For any two test cases, if their input, output validator arguments and the contents of their `.ans` files are equivalent, then the test cases are equivalent.
The assumption of determinism means that a judge system could choose to reuse the result of a previous run, or to re-run the equivalent test case.
Judge systems may not assume that the result of running a program on a test case is deterministic.
The assumption of non determinism means that a judge system cannot choose to reuse the result of a previous run.

Test cases and [test data groups](#test-data-groups) will be used in lexicographical order on test case or test data group name.
It is good practice to use a numbered prefix such as `00`, `01`, `02`, `03`, and so on, to get the desired order of test cases, while keeping the file names descriptive.
Expand Down