Add support for GGUF models using wllama #203

Activity

1. sauravpanda commented on Apr 17, 2026

   

   sauravpanda

   on Apr 17, 2026

   Owner

   More actions

   GGUF model support is now available via the Flare engine (PR #301, shipped in v2.1.0). Flare loads GGUF files directly in the browser via a Rust→WASM runtime with WebGPU acceleration.

   const ai = new BrowserAI();
   await ai.loadModel('llama-3.2-1b-flare');
   const response = await ai.generateText('Hello!');

   6 GGUF models are pre-registered. Custom GGUF URLs can be loaded via registerCustomModel(). This takes a different approach than wllama but solves the same user need. Closing — feel free to reopen if you specifically need wllama integration.

   👍React with 👍1Reacted by niu tech
2. sauravpanda

   closed this as completedon Apr 17, 2026
3. niutech commented on Apr 17, 2026

   

   niutech

   on Apr 17, 2026

   Author

   More actions

   @sauravpanda Great, thank you!