Continuous-learning AI models
Topic
What experts have said about Continuous-learning AI models
8 statements · 4 positive · 3 negative · 1 mixed
Hundreds of iterative model updates cause catastrophic forgetting and general-capability degradation.
“when you're doing hundreds of these micro-updates, you see both catastrophic forgetting”
Open the episode · AI researchers debate how close we are to recursive self-improvementListen at 54:59
Continually learning models could improve daily from millions of work sessions.
“What if the model is improving every single day based on the millions of sessions of work it does in that day?”
Open the episode · 8 Predictions for the Era of Continual LearningListen at 0:00
Continuous learning will define the future of AI models.
“the future is continuous learning”
Open the episode · #875: The Random Show — Tim and Kevin Talk Retreats, Mortality, AI Predictions, Supplements, Rock Climbing at (Almost) 50, and Not Waiting for “Someday”Listen at 1:31:32
Future AIs will become smarter through learning from each user interaction worldwide.
“Every time that you interact with an AI, it'll be smarter, not only because it's been learning from your previous sessions, but also because it's been learning from all its interactions with all the other users in the world.”
Open the episode · The next big breakthrough will be AIs learning on the jobListen at 7:17
Deployed online-learning models currently require repeated identical objectives across millions of users.
“all of the successfully shipped online learning models have had to learn the exact same thing across millions of users.”
Open the episode · The next big breakthrough will be AIs learning on the jobListen at 7:17
Continual learning would let AI models learn from experience like humans.
“continual learning is the holy grail, where the model learns from experiences the way humans do”
Open the episode · SpaceX's $2T Case, Nvidia's Shock Selloff, America Turns on AI, Trump Pulls AI Order, Bond Crisis?Listen at 5:52
Self-directed on-the-job learning would make extensive skill pre-training pointless; otherwise AGI is not imminent.
“either these models will soon learn on the job in a self-directed way, which will make all this pre-baking pointless, or they won't, which means that AGI is not imminent.”
Open the episode · An audio version of my blog post, Thoughts on AI progress (Dec 2025)Listen at 0:15
The first model achieving continual learning will not produce runaway gains.
“I don't expect some kind of runaway gains from the first model that cracks continual learning”
Open the episode · An audio version of my blog post, Thoughts on AI progress (Dec 2025)Listen at 10:17
Statements are attributed to the speaker as said on the episode and reflect their view at the time, not PodLume's. They are not advice.