Charlie Ruan leads WebLLM, which runs open models locally in your browser
Charlie F. Ruan leads an open-source runtime that uses WebGPU, WebAssembly and compiler-generated artifacts to run language models on users' devices.
By RuntimeWire Staff · Published
Primary source: GitHub
Why it matters
WebLLM gives developers a credible path to ship private, offline-capable AI features without paying for every generated token. Its limits also force product decisions around model size, device support and first-run downloads.
Charlie F. Ruan leads WebLLM, an open-source runtime that lets developers run language models inside a browser without an inference server. WebLLM was publicly documented by April 2023.…