Continuous learning
Topic
Continuous learning, also known as lifelong learning, is the ongoing, voluntary, and self-motivated pursuit of knowledge for either personal or professional reasons. It extends beyond traditional schooling to encompass learning throughout an individual's entire life, fostering personal development, social inclusion, and professional adaptability.
What experts have said about Continuous learning
6 statements · 3 positive · 2 negative · 1 neutral
Continual learning may progress from quarterly releases to hourly updates, effectively solving deployment learning.
“instead of every 3 months we release a model, now it's every week and then every day and then every hour, at which point we basically have obviously solved it”
Open the episode · AI researchers debate how close we are to recursive self-improvementListen at 54:52
Continually mid-training one base model eventually reaches an asymptote.
“if you just keep continually mid-training the same base forever, it asymptotes at some point”
Open the episode · AI researchers debate how close we are to recursive self-improvementListen at 59:20
Human-competent AI job performance requires learning beyond session-to-session markdown files.
“I don't think you can have AIs that perform whole jobs as competently as humans if they are forced to just write markdown files from session to session.”
Open the episode · 8 Predictions for the Era of Continual LearningListen at 0:03
Tyson recommends continual learning as a way to create meaning.
“I want to learn something today that I didn't know yesterday.”
Open the episode · Neil deGrasse Tyson On Aliens, Simulation Theory, and What Happens Inside A Black HoleListen at 1:37:11
Model architecture is probably not the fundamental bottleneck for continual learning.
“It doesn't seem to me that architecture is fundamentally what is bottlenecking continual learning.”
Open the episode · The next big breakthrough will be AIs learning on the jobListen at 12:37
Continual learning may be solved within the next one or two years.
“I think there's a good chance that in the next year or two we also solve that”
Open the episode · Dario Amodei — The highest-stakes financial model in historyListen at 42:26
Statements are attributed to the speaker as said on the episode and reflect their view at the time, not PodLume's. They are not advice.
