RN
Reversible neural networks
Topic
What experts have said about Reversible neural networks
1 statement · 1 positive
Reversible neural networks can eliminate stored training activations by rematerializing them during backpropagation.
“because it's invertible, I don't need to store this at all. I can completely rematerialize it when I'm running my backwards pass.”
Open the episode · Reiner Pope – The math behind how LLMs are trained and servedListen at 2:12:58
Statements are attributed to the speaker as said on the episode and reflect their view at the time, not PodLume's. They are not advice.