Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
244 commits
Select commit Hold shift + click to select a range
f7267fd
drafted 2 notebooks
Dec 5, 2022
3829715
Playing with nbs
Dec 6, 2022
e33bed3
first working draft for acceptance
Dec 8, 2022
dd2045b
added routines to read and write feather-stored datasets
Dec 8, 2022
28b1175
acceptance cleaned
Dec 8, 2022
8868c97
added draft for GAN preprocessing
Dec 17, 2022
91ec3f6
Drafted resolution model
Dec 20, 2022
6b60d4f
refactored common routines into python files
Dec 20, 2022
8a52555
added covariance models
Jan 2, 2023
6190c8f
refactoring to improve consistency with covariance models
Jan 2, 2023
50d1694
Improving the documentation (acceptance)
Jan 9, 2023
d36b15b
improved README.md
Jan 9, 2023
9b4edc8
documentation: efficiency (major) and acceptance (minor)
Jan 11, 2023
a415ff0
Added documentation to preprocessing of GANs
Jan 16, 2023
8d0cfa6
drafted deployment of acceptance and efficiency
Jan 16, 2023
ce52937
deployment documented
Jan 17, 2023
e175662
fixed README to be translatable to HTML
Jan 18, 2023
3b33320
documented covariance
Jan 18, 2023
bbd72cf
documented resolution
Jan 18, 2023
75b7ef8
added a simple script to install reports in docs/
Jan 18, 2023
1e80ce4
added reports to docs folder
Jan 18, 2023
b915ef3
fixed typo
Jan 18, 2023
4d00069
fixed broken links
Jan 18, 2023
9616d3a
Added deployment notebook to the README
Jan 18, 2023
cd390d2
Update to latest version used in prod
landerlini Jul 11, 2025
1fc43d9
Experimenting with GitHub actions for training
landerlini Jul 14, 2025
c38d870
added gha
Jul 14, 2025
256ea48
Merge branch 'landerlini:main' into gha
landerlini Jul 14, 2025
c4686c9
playing with gha
Jul 14, 2025
0559902
playing with gha
Jul 14, 2025
243a829
playing with gha
Jul 14, 2025
3013b42
playing with gha
Jul 14, 2025
06cbaaa
playing with gha
Jul 14, 2025
d55d40e
playing with gha
Jul 14, 2025
924801f
playing with gha
Jul 14, 2025
0b9403e
playing with gha
Jul 14, 2025
6efdca6
playing with gha
Jul 14, 2025
815d0e3
playing with gha
Jul 14, 2025
65da096
playing with gha
Jul 14, 2025
f93a02f
playing with gha
Jul 14, 2025
ebbb30e
playing with gha
Jul 14, 2025
775b77a
playing with gha
Jul 14, 2025
a7e832e
playing with gha
Jul 14, 2025
a0c918e
playing with gha
Jul 14, 2025
e4a44a5
playing with gha
Jul 14, 2025
b5c00b2
playing with gha
Jul 14, 2025
5728285
playing with gha
Jul 14, 2025
dbe1534
playing with gha
Jul 14, 2025
2ce1dbb
playing with gha
Jul 14, 2025
c66febc
playing with gha
Jul 14, 2025
8d584e4
playing with gha
Jul 14, 2025
af875b0
playing with gha
Jul 14, 2025
56d7465
playing with gha
Jul 14, 2025
83d746f
playing with gha
Jul 14, 2025
197e8d0
playing with gha
Jul 14, 2025
cca0d2c
playing with gha
Jul 14, 2025
a77b64a
playing with gha
Jul 14, 2025
6b2ca61
playing with gha
Jul 14, 2025
4e3957c
playing with gha
Jul 14, 2025
94c570f
playing with gha
Jul 14, 2025
7721a53
playing with gha
Jul 14, 2025
cf3710c
playing with gha
Jul 14, 2025
659bb83
playing with gha
Jul 14, 2025
c89b7fb
playing with gha
Jul 14, 2025
67b12b6
playing with gha
Jul 14, 2025
9925874
playing with gha
Jul 14, 2025
fa4e8b1
playing with gha
Jul 14, 2025
1ef11fb
playing with gha
Jul 14, 2025
70978e9
playing with gha
Jul 14, 2025
2ed9216
playing with gha
Jul 14, 2025
22380ee
playing with gha
Jul 14, 2025
a8d5f60
playing with gha
Jul 14, 2025
20ce958
playing with gha
Jul 14, 2025
f502c81
playing with gha
Jul 14, 2025
bf92d99
playing with gha
Jul 14, 2025
361bf72
playing with gha
Jul 14, 2025
6d47ba4
playing with gha
Jul 14, 2025
98d25b3
playing with gha
Jul 14, 2025
e55fc3f
playing with gha
Jul 14, 2025
202468e
playing with gha
Jul 14, 2025
8bb13f5
playing with gha
Jul 14, 2025
5ae19ef
playing with gha
Jul 14, 2025
7495e48
playing with gha
Jul 14, 2025
4c359af
playing with gha
Jul 14, 2025
898e981
playing with gha
Jul 14, 2025
11b8f41
playing with gha
Jul 14, 2025
733cd7a
playing with gha
Jul 14, 2025
f27ccac
playing with gha
Jul 14, 2025
4675ca6
playing with gha
Jul 14, 2025
341a8ad
playing with gha
Jul 14, 2025
1dd05a6
playing with gha
Jul 14, 2025
166512b
Added test rule
Jul 14, 2025
1ae9d60
playing with gha
Jul 14, 2025
2fceb5c
playing with gha
Jul 14, 2025
59bb4c6
playing with gha
Jul 14, 2025
01cdb2d
playing with gha
Jul 14, 2025
4d0a1db
playing with gha
Jul 14, 2025
fe76432
playing with gha
Jul 14, 2025
724d16c
playing with gha
Jul 14, 2025
6378e16
playing with gha
Jul 14, 2025
000d425
playing with gha
Jul 14, 2025
836da49
playing with gha
Jul 14, 2025
8bcbbfa
playing with gha
Jul 14, 2025
67ade88
playing with gha
Jul 14, 2025
f444db3
playing with gha
Jul 14, 2025
d866be2
playing with gha
Jul 14, 2025
314752f
playing with gha
Jul 14, 2025
6af56e5
added example.md to the report
Jul 14, 2025
65b2d02
playing with gha
Jul 14, 2025
a786113
playing with gha
Jul 14, 2025
7e61115
moving to new Snakemake workflow
Jul 17, 2025
6fef2af
fix
Jul 17, 2025
0aa05be
fix
Jul 17, 2025
779ab9a
fix
Jul 17, 2025
33935aa
fix
Jul 17, 2025
07ba3f1
fix
Jul 17, 2025
2c5ec49
fix
Jul 17, 2025
1750ef5
fix
Jul 17, 2025
d549eed
fix
Jul 17, 2025
f15c187
fix
Jul 17, 2025
4c56e60
fix
Jul 17, 2025
f7d4c97
fix
Jul 17, 2025
c4015a4
fix
Jul 17, 2025
92fd353
fix
Jul 17, 2025
48f46c6
fix
Jul 17, 2025
3752116
fix
Jul 17, 2025
277be3a
fix
Jul 17, 2025
2671523
fix
Jul 17, 2025
7d547c0
fix
Jul 17, 2025
b621c0d
fix
Jul 17, 2025
3e994d6
fix
Jul 17, 2025
a3534ca
added resolution and covariance training
Jul 18, 2025
a5da09c
moved to GH DAG
Jul 21, 2025
91b11cb
working on GHA
Jul 21, 2025
bde9908
working on GHA
Jul 21, 2025
4d5509d
working on GHA
Jul 21, 2025
29453d9
working on GHA
Jul 21, 2025
675489c
working on GHA
Jul 21, 2025
1ba3fb0
working on GHA
Jul 21, 2025
82173d6
working on GHA
Jul 21, 2025
f0f0808
working on GHA
Jul 21, 2025
5b40259
working on GHA
Jul 21, 2025
00ff972
working on GHA
Jul 21, 2025
e3777f6
working on GHA
Jul 21, 2025
c02c3dc
working on GHA
Jul 21, 2025
93f55d4
working on GHA
Jul 21, 2025
3f621fe
working on GHA
Jul 21, 2025
66627cc
working on GHA
Jul 21, 2025
0b496cc
working on GHA
Jul 21, 2025
9e91a18
working on GHA
Jul 21, 2025
00cf7aa
working on GHA
Jul 21, 2025
b54ad4b
working on GHA
Jul 21, 2025
fa749f6
working on GHA
Jul 21, 2025
aa44eb7
working on GHA
Jul 21, 2025
68479c3
working on GHA
Jul 21, 2025
d7456b7
working on GHA
Jul 21, 2025
d6c79fe
working on GHA
Jul 21, 2025
53ebeb1
working on GHA
Jul 21, 2025
ea86887
working on GHA
Jul 21, 2025
154f6d0
working on GHA
Jul 21, 2025
0579381
working on GHA
Jul 21, 2025
0d822f5
working on GHA
Jul 21, 2025
1655b04
working on GHA
Jul 21, 2025
622c855
working on GHA
Jul 21, 2025
49ef653
working on GHA
Jul 21, 2025
8b28468
working on GHA
Jul 21, 2025
0f18184
working on GHA
Jul 21, 2025
bfaf42b
working on GHA
Jul 21, 2025
8068956
working on GHA
Jul 21, 2025
8b768ba
working on GHA
Jul 21, 2025
ea674f4
working on GHA
Jul 21, 2025
e33ab6c
working on GHA
Jul 21, 2025
822853b
working on GHA
Jul 21, 2025
2d00409
working on GHA
Jul 21, 2025
8471b77
working on GHA
Jul 21, 2025
21c0a14
working on GHA
Jul 21, 2025
e65932d
working on GHA
Jul 21, 2025
eaa100f
working on GHA
Jul 21, 2025
c99114a
working on GHA
Jul 21, 2025
832f74a
working on GHA
Jul 21, 2025
e537598
working on GHA
Jul 21, 2025
28b268a
working on GHA
Jul 21, 2025
61e77bb
working on GHA
Jul 21, 2025
15b08b1
working on GHA
Jul 21, 2025
d3f629e
working on GHA
Jul 21, 2025
7a33870
working on GHA
Jul 22, 2025
7a02129
working on GHA
Jul 22, 2025
b200df8
working on GHA
Jul 22, 2025
fdfabd7
working on GHA
Jul 22, 2025
3973564
working on GHA
Jul 22, 2025
1fe8a97
working on GHA
Jul 22, 2025
c1b2d44
working on GHA
Jul 22, 2025
d7717b2
working on GHA
Jul 22, 2025
0eaad1b
working on GHA
Jul 22, 2025
8e40ddc
working on GHA
Jul 22, 2025
8941b9e
working on GHA
Jul 22, 2025
1e71bf4
working on GHA
Jul 22, 2025
38df74f
working on GHA
Jul 22, 2025
36a7838
working on GHA
Jul 22, 2025
a699f18
working on GHA
Jul 22, 2025
b36325b
working on GHA
Jul 22, 2025
1278d26
working on GHA
Jul 22, 2025
ef25207
working on GHA
Jul 22, 2025
22e96e9
working on GHA
Jul 22, 2025
85c0489
working on GHA
Jul 22, 2025
8f9b785
working on GHA
Jul 22, 2025
7b412fa
working on GHA
Jul 22, 2025
85dff59
working on GHA
Jul 22, 2025
5999459
working on GHA
Jul 22, 2025
90e4793
working on GHA
Jul 22, 2025
2ba4c22
working on GHA
Jul 22, 2025
d38c7b5
working on GHA
Jul 22, 2025
32a552a
working on GHA
Jul 22, 2025
9f0c837
working on GHA
Jul 22, 2025
163749e
working on GHA
Jul 22, 2025
b4b164b
working on GHA
Jul 22, 2025
058eddb
working on GHA
Jul 22, 2025
b4e5567
working on GHA
Jul 22, 2025
edab815
working on GHA
Jul 22, 2025
da10a9e
working on GHA
Jul 22, 2025
e906ee5
working on GHA
Jul 22, 2025
7d5a8a0
working on GHA
Jul 22, 2025
957e2af
working on GHA
Jul 23, 2025
60f4e8f
working on GHA
Jul 23, 2025
012f348
working on GHA
Jul 23, 2025
5d9ab5c
working on GHA
Jul 23, 2025
c306d61
working on GHA
Jul 23, 2025
fa17ebd
working on GHA
Jul 23, 2025
c5584a2
working on GHA
Jul 23, 2025
a74b6ce
working on GHA
Jul 24, 2025
95d55c4
working on GHA
Jul 24, 2025
eab301d
working on GHA
Jul 24, 2025
a695cc9
working on GHA
Jul 24, 2025
748cce3
working on GHA
Jul 24, 2025
b0d3b6d
working on GHA
Jul 24, 2025
dcb4de2
working on GHA
Jul 24, 2025
eb09dc0
working on GHA
Jul 26, 2025
1afd8ff
fixed naming scheme
Jul 26, 2025
119922a
working on GHA
Jul 26, 2025
93576f1
working on GHA
Jul 26, 2025
ad53b1d
imported a few improvements from lb-pidsim-train
Aug 27, 2025
b065d1e
configurable training time, now set to short for a quick test
Aug 28, 2025
ebaca9e
reduced memory usage for preprocessing and fixed mode collapsing with…
Aug 29, 2025
9a8c389
reduced verbosity and increased training time
Aug 29, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
33 changes: 33 additions & 0 deletions .github/workflows/train.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
name: Train models

on:
pull_request:
branches:
- main

concurrency:
group: pull_request-${{ github.head_ref }}
cancel-in-progress: true


jobs:
trk-2016MagUp-Sim10b:
uses: LamarrSim/release-models/.github/workflows/release.yaml@main
permissions:
contents: write
pull-requests: write
with:
name: pp-2016-MU-Sim10b-${{ github.head_ref }}
snakemake_dir: notebooks
target: deploy validate_acceptance validate_efficiency validate_resolution validate_covariance
model_prefix: trk
additional_config: |
storage_folder: trk-2016MagUp-Sim10b
training_data:
- training-data/2016MU-sim10b/LamarrTraining.root
additional_profile: |
rerun-triggers: mtime
generated_model_path: /tmp/compiled_model.c
secrets:
SECRETS_YAML: ${{ secrets.STORAGE_SECRETS }}

1 change: 1 addition & 0 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -1,4 +1,5 @@
*.swp
**/secrets.yaml
*.swo
*.html
*.log
Expand Down
11 changes: 11 additions & 0 deletions LbTrksimTrain/__main__.py
Original file line number Diff line number Diff line change
Expand Up @@ -23,6 +23,7 @@
parser.add_argument ( 'commands', nargs = "*", default = 'help',
choices = [
'help',
'propagation',
'acceptance',
'genlevelcheck',
'efficiency',
Expand Down Expand Up @@ -54,6 +55,16 @@
if args.verbose:
logging.getLogger().setLevel(logging.DEBUG)

################################################################################
### P R O P A G A T I O N
################################################################################
if 'propagation' in args.commands:
from LbTrksimTrain.steps import propagation
with Report ("Propagation", args.report) as report:
plt.inferno()
propagation.plot ( cfg, report )


################################################################################
### A C C E P T A N C E
################################################################################
Expand Down
11 changes: 11 additions & 0 deletions LbTrksimTrain/config/2016-MagDown.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -12,8 +12,19 @@ datasets:
#- /pclhcb06/landerli/TrackingParametrization/data/trackRes_10000000_2016_MagDown.root
- /pclhcb06/landerli/TrackingParametrization/data/unmerged/53/*/trackRes_10000000_2016_MagDown.root

files_train:
- /pclhcb06/landerli/TrackingParametrization/data/unmerged/53/*[1-9]/trackRes_10000000_2016_MagDown.root

files_validate:
- /pclhcb06/landerli/TrackingParametrization/data/unmerged/53/*0/trackRes_10000000_2016_MagDown.root



BrunelGenerated:
files:
- /pclhcb06/landerli/TrackingParametrization/data/unmerged/53/*/trackRes_10000000_2016_MagDown.root
files_train:
- /pclhcb06/landerli/TrackingParametrization/data/unmerged/53/*[1-9]/trackRes_10000000_2016_MagDown.root
files_validate:
- /pclhcb06/landerli/TrackingParametrization/data/unmerged/53/*0/trackRes_10000000_2016_MagDown.root

10 changes: 10 additions & 0 deletions LbTrksimTrain/config/2016-MagUp.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -11,9 +11,19 @@ datasets:
files:
# - /pclhcb06/landerli/TrackingParametrization/data/trackRes_10000000_2016_MagUp.root
- /pclhcb06/landerli/TrackingParametrization/data/unmerged/52/*/trackRes_10000000_2016_MagUp.root

files_train:
- /pclhcb06/landerli/TrackingParametrization/data/unmerged/52/*[1-9]/trackRes_10000000_2016_MagUp.root

files_validate:
- /pclhcb06/landerli/TrackingParametrization/data/unmerged/52/*0/trackRes_10000000_2016_MagUp.root


BrunelGenerated:
files:
- /pclhcb06/landerli/TrackingParametrization/data/unmerged/52/*/trackRes_10000000_2016_MagUp.root
files_train:
- /pclhcb06/landerli/TrackingParametrization/data/unmerged/52/*[1-9]/trackRes_10000000_2016_MagUp.root
files_validate:
- /pclhcb06/landerli/TrackingParametrization/data/unmerged/52/*0/trackRes_10000000_2016_MagUp.root

Loading
Loading