MO
Mixture of Experts
Topic
A machine learning architecture that uses multiple specialized sub-networks to process data more efficiently, allowing for larger model scales with less compute.
Topic
A machine learning architecture that uses multiple specialized sub-networks to process data more efficiently, allowing for larger model scales with less compute.