AA
Autoregressive attention
Topic
What experts have said about Autoregressive attention
1 statement · 1 neutral
Autoregressive attention is generally dominated by memory fetches rather than matrix multiplications.
“this process of attending this single token, attending to all of the history of tokens, that's attention, it is mostly dominated by memory fetches rather than matrix multiplies”
Open the episode · Reiner Pope – The math behind how LLMs are trained and servedListen at 7:18
Statements are attributed to the speaker as said on the episode and reflect their view at the time, not PodLume's. They are not advice.