Nigel
/
mindspore
forked from mindspore-Ecosystem/mindspore
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
52,683 Commits 24 Branches 0 Tags 3.9 GiB
Commit Graph

32 Commits

Author SHA1 Message Date
i-robot 017f26fcc0
!41553 modify the inconsistence in files 0906 
Merge pull request !41553 from 宦晓玲/code_docs_0906
 2022-09-07 01:07:41 +00:00
huodagu a6adb944cb repair brackets errors 2022-09-06 18:26:07 +08:00
zhangyi 2e3822f3d4 modify the inconsistence in files 0906 2022-09-06 17:41:09 +08:00
zhangyi 650dad47fb modify the inconsistence in files 0902 2022-09-02 17:20:35 +08:00
zhangyi 98deae82ce modify the inconsistence in files 0831 2022-08-31 18:43:53 +08:00
i-robot 89989b0b70
!40537 Fix the document error 
Merge pull request !40537 from huangxinjing/code_docs_fix_config_comment
 2022-08-27 00:56:55 +00:00
zhangyi 4c9049205b modify the inconsistence in files 2022-08-26 11:33:40 +08:00
huangxinjing 442361aaa4 Fix the attribute of the config 2022-08-24 17:04:29 +08:00
zhangyi 3aaa4b995a modify the inconsistence in files 2022-08-23 17:40:51 +08:00
zhangyi 1afdc74404 modify the files 2022-08-15 17:41:47 +08:00
zhangyi 56226400a7 mcorrect the format of API files 2022-07-18 15:22:30 +08:00
huangxinjing 31841c4163 Fix vocab embedding 2022-07-11 15:29:42 +08:00
huodagu 868433e823 modify format 2022-07-04 15:18:53 +08:00
Xiaoda Zhang f944fe7065 moe adaption 2022-07-01 16:00:15 +08:00
Xiaoda Zhang 1e4c9bf13b moe adaption 2022-06-29 09:36:43 +08:00
huangxinjing 95c5859d99 [AutoParalle]Fix ge process 2022-05-25 10:05:00 +08:00
huangxinjing 4d41474bb8 Fix transformer api differens 
Add ParallelConfig
 2022-05-13 18:05:29 +08:00
b00518648 dbc8ba0abc add accum_loss for api 2022-03-31 11:07:39 +08:00
b00518648 87e13c5458 fix some issues of chinese api 2022-03-29 22:00:57 +08:00
juzhong3 20741d83cb change for ch api_python CrossEntropyLoss 2022-03-20 18:20:39 +08:00
lvmingfu 64e346be67 fix api name 2022-03-10 11:15:23 +08:00
i-robot 76c43e0bf8
!30484 docs_moe 
Merge pull request !30484 from wangshengnan123/code_docs_moe
 2022-03-09 03:50:28 +00:00
wangshengnan123 2872f99ea2 add chinese api 2022-03-09 09:47:17 +08:00
xumengjuan1 a758f7cb84 modify format 2022-03-08 14:34:16 +08:00
xumengjuan1 5f6b6d0970 modify apiformat 2022-03-04 15:40:30 +08:00
huangxinjing 158b5b474e Add Chinese API 2022-03-02 10:33:12 +08:00
huodagu 1d48f7387b 输入参数校准v1 2022-02-28 15:04:55 +08:00
wangshengnan12@huawei.com bb761a47be add_TransformerRecomputeConfig_API 2022-02-25 11:18:51 +08:00
Xiaoda Zhang b714451937 implementing expert_parallel+data_parallel in MoE: 
1) extending _Linear's input as 4-dimension tensor: [outer_batch, expert_dim, -1, hidden], and _Liner's BatchMatMul becomes BatchMatMul(4_dim_tensor, 3_dim_tensor);
2) configuring the _Linear's BatchMatMul sharding strategy as [[dp, ep, 1, 1], [ep, 1, mp]];
3) introducing a new parameter 'expert_parallel' in TransformerOpParallelConfig, creating a new class MoEParallelConfig to include 'data_parallel', 'model_parallel' and 'expert_parallel';
4) changing parallel config for FeedForward, TransformerEncoderLayer, TransformerDecoderLayer.
 2022-02-24 09:24:27 +08:00
zhangyi 5d8887baab modify error format for api. 2022-02-22 17:02:04 +08:00
zhangyi eddb5f9ca0 modify error format for chinese python api. 2022-02-21 19:01:22 +08:00
wangshengnan12@huawei.com 3a27ee3533 code_docs_add_transformer_api 2022-02-21 10:41:16 +08:00