Skip to content

feat(spec): add source_task_size to RefreshMaterializedViewRequest#355

Open
justinrmiller wants to merge 1 commit into
lance-format:mainfrom
justinrmiller:gen-476-refresh-source-task-size
Open

feat(spec): add source_task_size to RefreshMaterializedViewRequest#355
justinrmiller wants to merge 1 commit into
lance-format:mainfrom
justinrmiller:gen-476-refresh-source-task-size

Conversation

@justinrmiller

Copy link
Copy Markdown

Context

Linear: GEN-476

Geneva's chunker-backed materialized-view refresh bounds per-actor memory by controlling how many source row IDs go into one expansion work item. That knob (source_task_size) needs to travel over the enterprise db:// path, but RefreshMaterializedViewRequest had no field for it — so it was silently dropped on remote refresh.

Change

Adds an optional source_task_size integer to RefreshMaterializedViewRequest, mirroring the existing optional overrides (max_rows_per_fragment, intra_applier_concurrency, …). Regenerated the Python (urllib3) and Rust (reqwest) client models and their docs; updated the spec model doc and the urllib3 test stub.

Geneva feature-detects the field, so it forwards source_task_size once a release carries it and degrades gracefully on older versions.

Test plan

  • openapi-spec-validator docs/src/spec.yaml → OK
  • urllib3 model round-trips source_task_size (set / omitted / from_dict)

Follow-ups (separate repos)

  • lance: bump lance-namespace-reqwest-client, rebuild RestNamespace bindings, publish a pylance beta.
  • geneva + sophon: pin the new versions so the field transits end-to-end at runtime.

🤖 Generated with Claude Code

Optional field bounding per-actor memory for chunker materialized-view
refresh by controlling the number of source row ids per expansion work item.
Mirrors the existing optional integer overrides. Regenerated the Python
urllib3 and Rust reqwest client models and docs.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@github-actions github-actions Bot added enhancement New feature or request python Python features rust Rust features labels Jun 11, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request python Python features rust Rust features

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant