FL
Frontier language model scaling
Topic
What experts have said about Frontier language model scaling
1 statement · 1 neutral
Active parameters are constrained by compute cost, while total parameters are constrained by scale-up size.
“the active parameters as we saw, is limited by the compute cost and then the total parameters is limited by the scale up size”
Open the episode · Reiner Pope – The math behind how LLMs are trained and servedListen at 47:02
Statements are attributed to the speaker as said on the episode and reflect their view at the time, not PodLume's. They are not advice.