Skip to content

feat: add tokenized_documents parameter to avoid redundant tokenization [stacks on #2515]#2518

Draft
pidefrem wants to merge 2 commits into
MaartenGr:masterfrom
pidefrem:pr13-pretokenized-documents
Draft

feat: add tokenized_documents parameter to avoid redundant tokenization [stacks on #2515]#2518
pidefrem wants to merge 2 commits into
MaartenGr:masterfrom
pidefrem:pr13-pretokenized-documents

feat: support pre-tokenized documents across the pipeline

070ec79
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

2 errors
build (3.11)
cancelled Jul 8, 2026 in 7m 23s