Skip to content

File and Memory Optimization#31

Open
noahares wants to merge 4 commits into
BenoitMorel:mainfrom
noahares:feat_file_and_mem_opt
Open

File and Memory Optimization#31
noahares wants to merge 4 commits into
BenoitMorel:mainfrom
noahares:feat_file_and_mem_opt

Conversation

@noahares

Copy link
Copy Markdown
Collaborator

This PR improves 2 things:

  1. Reduced memory usage during reconciliation sampling: No longer keep all reconciliations across all families around to estimate originations, but update them for each family after it is sampled.
  2. Change most output files to TSV: This makes it easier to process files inside alerax and also unifies the output format. Added headers where they were missing and changed "," to "\t" for the files that were csv-like. This will break some post-processing scripts but is the preferable long term solution for output files. That's why I increased the AleRax version string.

This PR involves no functional changes.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant