IL
In-context learning
Topic
What experts have said about In-context learning
1 statement · 1 positive
Sufficiently strong in-context learning could eliminate the need for continual weight updates.
“if in context learning gets so good across longer and longer time horizons, then you don't need to distill back everything the model is learning on the job into the weights.”
Open the episode · The next big breakthrough will be AIs learning on the jobListen at 1:35
Statements are attributed to the speaker as said on the episode and reflect their view at the time, not PodLume's. They are not advice.