Batching experiments together

[michaelmckinsey1]

Description

• Addresses Multi-experiment jobs #485

• Supersedes Batching experiments together #858

• Todo

  • Make into command
  • Docs
  • Add test for making multi-trial same resource allocation and multi-experiment from different experiments

• Depends on Expose n_repeats as experiment variant #1035

$ benchpark aggregate agg wkp wkp2 ...
$ flux batch agg/0.sh

[pearce8]

@michaelmckinsey1 why doesn't saxpy run?

[michaelmckinsey1]

I need to fix the test, there is something broken that I added

[codecov-commenter]

Codecov Report

❌ Patch coverage is 93.15068% with 5 lines in your changes missing coverage. Please review.
✅ Project coverage is 63.70%. Comparing base (d5f67c5) to head (52055f6).

Files with missing lines	Patch %	Lines
lib/benchpark/cmd/aggregate.py	92.64%	5 Missing ⚠️

Additional details and impacted files

@@             Coverage Diff             @@
##           develop    #1036      +/-   ##
===========================================
+ Coverage    62.97%   63.70%   +0.73%     
===========================================
  Files           45       46       +1     
  Lines         3433     3505      +72     
  Branches       264      264              
===========================================
+ Hits          2162     2233      +71     
- Misses        1262     1263       +1     
  Partials         9        9              

Files with missing lines	Coverage Δ
lib/main.py	54.72% <100.00%> (+0.91%)	⬆️
lib/benchpark/cmd/aggregate.py	92.64% <92.64%> (ø)

... and 1 file with indirect coverage changes

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[michaelmckinsey1]

pipeline https://lc.llnl.gov/gitlab/benchpark/benchpark/-/pipelines/649578