Skip to content

Expose Lz parameters in C++ (#763)#763

Open
terrelln wants to merge 6 commits into
facebook:devfrom
terrelln:export-D105368972
Open

Expose Lz parameters in C++ (#763)#763
terrelln wants to merge 6 commits into
facebook:devfrom
terrelln:export-D105368972

Conversation

@terrelln
Copy link
Copy Markdown
Contributor

@terrelln terrelln commented May 15, 2026

Summary:

As title

Differential Revision: D105368972

terrelln added 5 commits May 12, 2026 10:58
Differential Revision: D104843371
Summary:
The LZ encoder capped `matchLength()` at `UINT16_MAX` because sequence match
lengths are stored as `uint16_t`. If the match had been walked backward at least
`UINT16_MAX` bytes, then the match finding process would resume at a position
which had already been inserted into the hash table. This would result in match
with `distance <= 0` and corruption would ensue.

Differential Revision: D104838040
Differential Revision: D105332025
Differential Revision: D104873678
Summary:
LZ must be a dynamic graph because it invokes a multi-input node (ZL_NODE_MUX_LENGTHS).
But we need to allow overriding the successors in a serialized graph for training and configurability.
So do the same thing that FieldLZ does, which sets the index of the `customGraph` as a local int param.
When the local int param is set, set the corresponding successor to that graph.

Differential Revision: D105367885
@meta-codesync
Copy link
Copy Markdown

meta-codesync Bot commented May 15, 2026

@terrelln has exported this pull request. If you are a Meta employee, you can view the originating Diff in D105368972.

Summary:
Pull Request resolved: facebook#763

As title

Differential Revision: D105368972
@meta-codesync meta-codesync Bot changed the title Expose Lz parameters in C++ Expose Lz parameters in C++ (#763) May 18, 2026
terrelln added a commit to terrelln/openzl that referenced this pull request May 18, 2026
Summary:
Pull Request resolved: facebook#763

As title

Differential Revision: D105368972
@terrelln terrelln force-pushed the export-D105368972 branch 2 times, most recently from ec55cb3 to a69ef52 Compare May 18, 2026 15:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant