Skip to content

feat: raise row page-size cap from 200 to 1000#59

Merged
gordonmurray merged 1 commit into
lance-format:mainfrom
gordonmurray:feat/58-raise-row-limit
Jun 11, 2026
Merged

feat: raise row page-size cap from 200 to 1000#59
gordonmurray merged 1 commit into
lance-format:mainfrom
gordonmurray:feat/58-raise-row-limit

Conversation

@gordonmurray

Copy link
Copy Markdown
Collaborator

A developer mentioned the viewer stops at 200 rows per page and asked for 500 or 1000 when reviewing data integrity across a table.

The cap lived in two places:

  • backend/app.py: MAX_LIMIT = 200, applied to the limit param on /datasets/{name}/rows and /datasets/{name}/vector/preview. Anything over 200 returned a 422.
  • web/vanilla/index.html: the page-size dropdown topped out at 200.

This raises MAX_LIMIT to 1000 and adds 500 and 1000 options to the dropdown. The default stays at 50.

I kept a ceiling rather than removing it. Each response serializes the whole page from PyArrow to JSON in one go, and vector columns can be large, so unbounded pages would be easy to misuse on wide tables. Vector cells keep their existing sparkline truncation, so the per-cell payload is unchanged.

Updated the limit-bounds test to check the new boundary (1000 accepted, 1001 rejected) and added a changelog entry. Ran the test suite against the 0.33.0 image and it passes.

Fixes #58

A developer asked for larger pages when reviewing data integrity across a
table. The cap lived in two places: MAX_LIMIT in the backend (applied to
/rows and /vector/preview) and the page-size dropdown in the frontend.

Raise MAX_LIMIT to 1000 and add 500 and 1000 options to the dropdown. The
default stays at 50. Vector cells keep their existing sparkline truncation,
so the per-cell payload is unchanged.
@gordonmurray gordonmurray merged commit fb63c4c into lance-format:main Jun 11, 2026
14 checks passed
@gordonmurray gordonmurray deleted the feat/58-raise-row-limit branch June 11, 2026 21:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

feat: raise row page-size cap from 200 to 1000

1 participant