AL
AI lab inference compute
Topic
What experts have said about AI lab inference compute
1 statement · 1 negative
Inference consumes 30–50% of lab compute and currently does not improve models.
“Around 30 to 50% of a lab's compute goes to inference and that compute is currently not playing any productive role in helping improve the model.”
Open the episode · The next big breakthrough will be AIs learning on the jobListen at 7:50
Statements are attributed to the speaker as said on the episode and reflect their view at the time, not PodLume's. They are not advice.