Skip to content

Ingest decoder prompts in batch-sized chunks - #196

Merged
mattt merged 2 commits into
huggingface:mainfrom
james-333i:fix/llama-chunked-prompt
Sep 2, 2026
Merged

Ingest decoder prompts in batch-sized chunks#196
mattt merged 2 commits into
huggingface:mainfrom
james-333i:fix/llama-chunked-prompt

Commits

Commits on Aug 25, 2026