You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Add Flare as a third inference engine backend #293
Add Flare LLM as a third inference engine option alongside MLC WebLLM and Transformers.js. Flare is a pure Rust → WASM inference engine with WebGPU acceleration that loads standard GGUF files directly (no TVM compilation step).
Why
MLC WebLLM
Transformers.js
Flare
Model format
TVM artifacts
ONNX
Standard GGUF
Compilation
Need TVM compile
Need ONNX export
Direct HuggingFace GGUF
Language
C++ (emscripten)
C++ (ONNX RT)
Pure Rust → WASM
Progressive loading
No
No
Yes
LoRA hot-swap
No
No
Yes
BitNet ternary
No
No
Yes
Speculative decoding
No
No
Yes
WASM binary size
~15MB
~10MB
~5MB (est.)
Key advantage: users can grab any GGUF model from HuggingFace and use it immediately — no conversion pipeline.
Integration plan
Publish @aspect/flare npm package via wasm-pack
Create FlareEngine adapter implementing the BrowserAI engine interface
Completed in PR #301 — Flare is now integrated as the third inference engine with full BrowserAI API support (loadModel, generateText, loadAdapter, OPFS caching).
Activity
feat: add Flare WASM inference engine integration
feat: add Flare WASM inference engine integration
feat: add Flare WASM inference engine integration (#301)
sauravpanda commentedon Apr 17, 2026
Completed in PR #301 — Flare is now integrated as the third inference engine with full BrowserAI API support (
loadModel,generateText,loadAdapter, OPFS caching).