AK
AI KV caches
Topic
What experts have said about AI KV caches
1 statement · 1 negative
Continual learning through indefinitely expanding KV caches is not scalable.
“AIs can't just keep building up a bigger and bigger KV cache as they learn from more and more users. That's just not scalable”
Open the episode · The next big breakthrough will be AIs learning on the jobListen at 7:17
Statements are attributed to the speaker as said on the episode and reflect their view at the time, not PodLume's. They are not advice.