[BUG] Subsequent grammar requests fail. #367
Description
OS
Linux
GPU Library
CUDA 12.x
Python version
3.11
Describe the bug
Trying out https://github.com/p-e-w/waidrin which makes heavy use of grammar. No problems generating the first requests for world and protagonist. After advancing further, the next constrained generation goes through, the one after that fails.
ValueError: KBNF semantics error: the nonterminal __json_0_3 is not defined.
The value of the nonterminal changes from time to time. I see 1, 7, etc. Like old filters are never removed or it loses track of whats in the schema. Tried to update the reqs (knbf,formatron) but no real difference. Also made several attempts at fixing, like not replacing schema with "start" but using the raw values and it's always the same. Cleared the vocab cache between requests so it's not related to that either.
Reproduction steps
Use waidrin and try to advance all the way to actually playing.
Expected behavior
Grammar works and generate successfully.
Logs
No response
Additional context
No response
Acknowledgements
- I have looked for similar issues before submitting this one.
- I have read the disclaimer, and this issue is related to a code bug. If I have a question, I will use the Discord server.
- I understand that the developers have lives and my issue will be answered when possible.
- I understand the developers of this program are human, and I will ask my questions politely.