WebLLM: high-performance in-browser LLM inference engine (github.com)

<a href="https://news.ycombinator.com/item?id=49536411">Comments</a>