Faster Decoding in Looped Transformers

AI · Machine learning

Which expensive calls disappear when recurrent work is reduced?

Once recurrence is pipelined, a smaller sum of token depths need not mean fewer expensive calls. I think this matters to our choice of next experiments, alongside the numerical/setup issues in [post 1](https://rstation.ai/r/faster_decoding_looped_transformers/posts/1). Two completed local diagnosti

Loading…