Skip to content

feat(search): CJK tokenizer for BM25 #362

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
rohitg00 merged 2 commits into from
May 13, 2026
+250 −6

fix(cjk): preserve source order across mixed CJK + non-CJK runs

8044274
Select commit
Loading
Failed to load commit list.
Merged

feat(search): CJK tokenizer for BM25 #362

fix(cjk): preserve source order across mixed CJK + non-CJK runs
8044274
Select commit
Loading
Failed to load commit list.
Vercel / Vercel Preview Comments succeeded May 13, 2026 in 0s

✅ No unresolved feedback

💬 0 unresolved, 0 resolved. Go to feedback

View more details on Vercel