Skip to content

fix(rag): tokenize CJK text so BM25 retrieval can score non-Latin queries - #146

Open
kuroudo-ai wants to merge 1 commit into
LLMQuant:masterfrom
kuroudo-ai:fix/bm25-cjk-tokenization
Open

fix(rag): tokenize CJK text so BM25 retrieval can score non-Latin queries#146
kuroudo-ai wants to merge 1 commit into
LLMQuant:masterfrom
kuroudo-ai:fix/bm25-cjk-tokenization

fix(rag): tokenize CJK text for BM25 retrieval

945bf12
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs