Skip to content

ariemic/experiments-runner

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Client usage examples


Run Experiment

  • Run with multiple problems, algorithms and metrics:
./gradlew run --args="--startExperiment --name TestExperiment --problems ZDT1,ZDT2 --metrics GenerationalDistance,Hypervolume,MaximumParetoFrontError --algorithms NSGAII,SPEA2 --budget 1000"
  • If you don't specify metrics, all of the available will be used:
./gradlew run --args="--startExperiment --name TestExperiment --problems ZDT1 --algorithms NSGAII --budget 1000"
  • Start experiment with extra repetitions
 ./gradlew run --args="--startExperiment --name Experiment --problems ZDT2 --metrics GenerationalDistance --algorithms SPEA2 --budget 500 --repetitions 2"

Get all experiments

  • To get all experiments:

./gradlew run --args="--listExperiments"

Get experiment

  • To get specific experiment:

./gradlew run --args="--getOneExperiment {id}"

Get experiment status

  • To get specific experiment status:

./gradlew run --args="--getExperimentStatus {id}"

Get experiment results

  • To get only results of specific experiment:

./gradlew run --args="--getExperimentResults {id}"

Filter experiments

  • To get experiments with exact problem/algorithm or metrics

./gradlew run --args="--filterExperiments --problems ZDT1,ZDT2 --algorithms NSGAII --metrics Hypervolume"

./gradlew run --args="--filterExperiments --problems ZDT1"

  • To assign filtered experiment to a group add --groupId {id}

./gradlew run --args="--filterExperiments --problems ZDT1,ZDT2 --algorithms NSGAII --metrics Hypervolume --groupId {id}"

Aggregate experiment results

./gradlew run --args="--aggregateExperiments --aggregation mean --metrics GenerationalDistance --algorithm NSGAII --problem ZDT1 --startDate 2024-12-01 --endDate 2025-01-31 --chart false"

./gradlew run --args="--aggregateExperiments --aggregation mean --metrics GenerationalDistance,MaximumParetoFrontError,Hypervolume --algorithm NSGAII --problem ZDT1 --startDate 2024-12-01 --endDate 2025-01-31 --chart false"

Aggregate experiment results saved as a chart

./gradlew run --args="--aggregateExperiments --aggregation mean --metrics GenerationalDistance --algorithm NSGAII --problem ZDT1 --startDate 2024-12-01 --endDate 2025-01-31 --chart true"

Aggregate experiment results saved as a csv

./gradlew run --args="--aggregateExperiments --aggregation mean --metrics GenerationalDistance --algorithm NSGAII --problem ZDT1 --startDate 2024-12-01 --endDate 2025-01-31 --csv true"

Add group to an experiment

./gradlew run --args="--assignGroup --groupId 1 --experimentId 1" ./gradlew run --args="--assignGroup --groupId 1 --experimentId 2" ./gradlew run --args="--assignGroup --groupId 2 --experimentId 3"

Delete experiment by id

./gradlew run --args="--deleteExperiment 3"

Delete group with all assigned experiments

./gradlew run --args="--deleteGroup 1"

Grouped experiment results

./gradlew run --args="--getGroupExperimentsResults 1"

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages