Definition
A mixture of experts is a model design that prepares multiple specialized sub-models and computes only a selected subset depending on the input. It can scale capacity while controlling inference cost.
混合専門家
Definition
A mixture of experts is a model design that prepares multiple specialized sub-models and computes only a selected subset depending on the input. It can scale capacity while controlling inference cost.