Add tool calling to LlamaLanguageModel, including streaming - #216

Open

james-333i wants to merge 7 commits into

huggingface:mainfrom

james-333i:feat/llama-tool-calling

Commits on Sep 2, 2026

Deliver streamed tokens live instead of after generation completes
james-333i
committed
4f6a869
Add vision support to LlamaLanguageModel via mtmd
james-333i
committed
303ba40
Render the Gemma 4 chat format when template detection fails
james-333i
committed
37e5e92
Reuse a per-session context across chat exchanges
james-333i
committed
ba9cd2a
Add tool calling to LlamaLanguageModel
james-333i
committed
5a07ff3
Support tool calling in MLXLanguageModel.streamResponse()

authored and
james-333i
committed
4f2da7a
Stream tool-call exchanges and strip Gemma 4 thought channels
james-333i
committed
0a8bad1