[CI] Introduce yarpgen testing #20829
Conversation
See https://github.com/intel/yarpgen Enabling on weekly basis.
|
@AlexeySachkov I'd like to get your review since you're familiar with this tool. |
![github-advanced-security[bot]](https://avatars.githubusercontent.com/in/57789?s=60&v=4){kind=small}
KornevNikita
temporarily deployed
to
WindowsCILock
GitHub Actions
Inactive
KornevNikita
had a problem deploying
to
WindowsCILock
GitHub Actions
Failure
KornevNikita
temporarily deployed
to
WindowsCILock
GitHub Actions
Inactive
KornevNikita
had a problem deploying
to
WindowsCILock
GitHub Actions
Failure
| run: | | ||
| cd yarpgen | ||
| # A system hits OOM when using all available threads. | ||
| python3 scripts/run_gen.py --target clang -j4 |
There was a problem hiding this comment.
For how long does it run by default? I suggest we set the duration here explicitly
There was a problem hiding this comment.
It takes just 10 minutes with this amount of jobs. I'm not sure if more jobs reduce the time or even increase:D
There was a problem hiding this comment.
You mean to set the time limit for this job?
There was a problem hiding this comment.
You mean to set the time limit for this job?
I mean yarpgen can continue generating and trying programs indefinitely, if you say it so. My point was to pass -t/--timeout parameter explicitly to better indicate the intent here and don't depend on a default which might change
| # A system hits OOM when using all available threads. | ||
| python3 scripts/run_gen.py --target clang -j4 | ||
| - name: Pack results | ||
| run: tar -czf yarpgen_results.tar.gz yarpgen/testing |
There was a problem hiding this comment.
I hope results aren't too huge. If they are, we can consider shorter retention policy if no issues were discovered
There was a problem hiding this comment.
The archive takes just 1mb, as I understand without Intel SDE there are not many compiled programs. The issue is I have no idea how to download Intel SDE via console.
| name: yarpgen_results | ||
| path: yarpgen_results.tar.gz | ||
| retention-days: 7 | ||
| - name: Clean up |
There was a problem hiding this comment.
I would like this job to somehow report the fuzzing outcome. The tool does print some summary, but there are also errors which should not be considered as problems. For example, when a generated kernel uses too many arguments and they exceed implementation limits.
See https://github.com/intel/yarpgen
Enabling on weekly basis.