Dust: Pretraining Transformers Without Backpropagation (qlabs.sh)

<a href="https://news.ycombinator.com/item?id=49970871">Comments</a>