Skip to content

refactor(namespace): remove table_version_storage_enabled and __manifest version storage#7222

Open
jackye1995 wants to merge 1 commit into
lance-format:mainfrom
jackye1995:jack/deprecate-table-version-storage
Open

refactor(namespace): remove table_version_storage_enabled and __manifest version storage#7222
jackye1995 wants to merge 1 commit into
lance-format:mainfrom
jackye1995:jack/deprecate-table-version-storage

Conversation

@jackye1995

Copy link
Copy Markdown
Contributor

__manifest cannot sustain per-commit version-write TPS; it suits table
create/remove, not every commit. This removes the table_version_storage_enabled
option and the entire __manifest-backed table-version path. Version
list/create/describe/batch-delete now use the physical _versions/ directory
exclusively, which was always the source of truth, so no data is lost.

Kept: table_version_tracking_enabled (managed versioning) and manifest_enabled
(table tracking) — both unaffected and served from physical storage.

The multi-table transaction work that motivated version storage will be
re-proposed on a separate mechanism.

…est version storage

__manifest cannot sustain per-commit version-write TPS; it suits table
create/remove, not every commit. Remove the table_version_storage_enabled
option and the entire __manifest-backed table-version path. Version
list/create/describe/batch-delete now use the physical _versions/ directory
exclusively, which was always the source of truth.

Keep table_version_tracking_enabled (managed versioning) and manifest_enabled
(table tracking); both are unaffected and served from physical storage. The
multi-table transaction work that motivated version storage will be re-proposed
separately.
@github-actions github-actions Bot added the A-namespace Namespace impls label Jun 11, 2026
@codecov

codecov Bot commented Jun 11, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 30.00000% with 7 lines in your changes missing coverage. Please review.

Files with missing lines Patch % Lines
rust/lance-namespace-impls/src/dir.rs 0.00% 6 Missing ⚠️
rust/lance-namespace-impls/src/dir/manifest.rs 66.66% 0 Missing and 1 partial ⚠️

📢 Thoughts on this report? Let us know!

@LuQQiu LuQQiu left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

agree that multi_table_transaction is still helpful but may be not this approach

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

A-namespace Namespace impls

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants