Skip to content

bug: Every branch merge creates thousand of post-branch merge tasks  #8502

@muffizone

Description

@muffizone

Component

API Server / GraphQL

Infrahub version

1.7.6

Current Behavior

Assume a scenario where we have 4000 and continuously increasing number of artifacts in the system plus around 40 branches.

As soon as a write heavy operation like merge which already takes time to complete is finished, infrahub will spawn atleast 4000 artifact generation tasks, 40 branches diffs, ipam reconcilliation and a few other tasks. While this happens, the entire system(api server, UI) is unuseable for the next 10-15 minutes.

This is based on my experience with infrahub and this function post_process_branch_merge flow.

The total time for any merge and post-merge operations is increasing pretty fast as we add more objects , artifacts in the system. This makes me think twice before i decide to write a new artifact.

Expected Behavior

Not sure but I would ideally like the artifact to be only generated for objects which have changes and branch diffs could be either staggered or the user needs to update the diff manually.

Steps to Reproduce

Just create a 1000 devices with artifacts with 30 branches, merge a large branch and see the number of flows created post branch merge

Additional Information

No response

Metadata

Metadata

Assignees

Labels

state/need-more-infoThis issue needs more informationtype/bugSomething isn't working as expected

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions