Skip to content

Add standalone compactors flag and service charts#171

Open
nadav-govari wants to merge 1 commit into
mainfrom
nadav/compactors
Open

Add standalone compactors flag and service charts#171
nadav-govari wants to merge 1 commit into
mainfrom
nadav/compactors

Conversation

@nadav-govari

Copy link
Copy Markdown

This change is alongside quickwit-oss/quickwit#6461. It adds the enable_standalone_compactor flag. When enabled, it affects three Quickwit services:

  • The janitor, which then starts the merge planner service
  • Indexers, which don't spawn merge pipelines as a result
  • Compactors, which now spawn

As far as the helm chart goes, when false this change is a no-op. When true, it adds the compactor service and defines it similarly to other deployments in this chart. It also injects the QW_ENABLE_STANDALONE_COMPACTORS env var to all services as true.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 93e3a777d0

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

{{- if $.Values.compactor.args }}
args: {{- toYaml $.Values.compactor.args | nindent 10 }}
{{- else }}
args: ["run", "--service", "compactor"]

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Use a compactor-capable Quickwit image

When enableStandaloneCompactors=true and users keep the chart default image, this pod still runs quickwit/quickwit:v0.8.2 because image.tag falls back to Chart.appVersion; I checked the v0.8.2 service parser and its accepted --service values are only control-plane|control_plane, indexer, searcher, janitor, and metastore, not compactor. The new compactor Deployment will therefore CrashLoop on this command while the same values disable local indexer merges, so compaction stops unless users know to override image.tag to a compatible build; please bump or guard the default before exposing this flag.

Useful? React with 👍 / 👎.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant