mindspore-Ecosystem
/
mindspore
21
0
Fork 27
Code Issues Pull Requests 6 Projects Releases Wiki Activity

moe adaption

This commit is contained in:
Xiaoda Zhang 2022-07-01 16:00:15 +08:00
parent e2e5850e0c
commit f944fe7065
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
docs/api/api_python/transformer/mindspore.nn.transformer.MoEConfig.rst
View File

@ -1,4 +1,4 @@
.. py:class:: mindspore.nn.transformer.MoEConfig(expert_num=1, capacity_factor=1.1, aux_loss_factor=0.05, num_experts_chosen=1)
.. py:class:: mindspore.nn.transformer.MoEConfig(expert_num=1, capacity_factor=1.1, aux_loss_factor=0.05, num_experts_chosen=1, expert_group_size=None)
MoE (Mixture of Expert)的配置。