Nigel
/
mindspore
forked from mindspore-Ecosystem/mindspore
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
56,551 Commits 24 Branches 0 Tags 3.9 GiB
Commit Graph

651 Commits

Author SHA1 Message Date
yao_yf a83fb3316b fix parallel timeout 2021-04-02 20:19:26 +08:00
yao_yf 4d0635eabe set parallel communication init flag in parallel ut 2021-03-30 11:21:57 +08:00
dingpeifei 87e41aaeee IR operators of GPU and CPU are unified as batchnorm 2021-03-18 19:02:28 +08:00
mindspore-ci-bot 7454ac8ecd !13382 [PipelineSplit]change pipeline key word 
From: @lichen666
Reviewed-by: @kisnwang,@zhunaipan
Signed-off-by: @zhunaipan
 2021-03-16 20:20:32 +08:00
lichenever a2b2727ba8 change_pipeline_key_word 2021-03-16 14:02:35 +08:00
LianLiguang 17b9758543 unify range ops 2021-03-16 10:47:42 +08:00
mindspore-ci-bot 7ba21f8d8c !12900 Add communication parallel mode. 
From: @liujunzhu
Reviewed-by: @zhoufeng54,@guoqi1024
Signed-off-by: @guoqi1024
 2021-03-06 15:55:49 +08:00
liujunzhu 6541b96c40 Add communication parallel mode. 2021-03-05 21:36:03 +08:00
Ziyan ec9793861f fix grad accu 2021-03-05 10:28:10 +08:00
mindspore-ci-bot 7ff2b3b499 !12781 fix bug of amp bn cast 
From: @jojobugfree
Reviewed-by: 
Signed-off-by:
 2021-03-04 10:14:51 +08:00
caifubi a6959c2a13 fix bn cast bug 2021-03-02 17:24:47 +08:00
yangzhenzhang a70d616841 mini step grad accumulation 2021-03-01 10:20:12 +08:00
wangshuide2020 72e938eb06 change dimension of input for FusedBatchNormEx from 2D to 4D in test_two_matmul_batchnorm_ex. 2021-02-25 09:37:59 +08:00
He Wei 7d9a783993 [auto-monad] Support side-effects by auto-monad 
The basic idea is: exploits data dependency to control the execution order
of side-effect operations, and keep the semantics of ANF unchanged.

The ControlDepend primitive is removed and there are two primitives added:

1. UpdateState:
```
  a = Assign(para, value)
```
became:
```
  a = Assign(para, value, u)
  u = UpdateState(u, a)
```

2. Load:
```
  x = Add(para, value)
```
became:
```
  p = Load(para, u)
  x = Add(p, value)
  u = UpdateState(u, p)
```
 2021-02-08 09:01:15 +08:00
jinyaohui 30a27b2adb modify Gelu、FastGelu to GeLU and FastGeLU 2021-02-05 17:19:52 +08:00
mindspore-ci-bot 74652eb942 !12044 modify pack to stack 
From: @jinyaohui
Reviewed-by: 
Signed-off-by:
 2021-02-04 21:02:09 +08:00
jinyaohui 8022f9a6ed modify pack to stack 2021-02-04 18:54:31 +08:00
yangzhenzhang 726ea32778 merge parameter slice compile graph only once 2021-02-03 19:39:32 +08:00
l00591931 9ec100d069 Change TensorAdd to Add, from r1.1 to master 2021-02-01 17:53:52 +08:00
mindspore-ci-bot 9fa0499fa0 Change GatherV2 to Gather r1.1 to master 2021-01-30 14:13:47 +08:00
yangzhenzhang cbca482e59 delete useless parameter in pipeline parallel 2021-01-21 19:05:40 +08:00
yangzhenzhang 7303c3d3b8 add group ckpt 2021-01-21 14:41:05 +08:00
lilei 9a45c4419c modify batch_normal 2021-01-13 20:59:46 +08:00
yangzhenzhang 9da3f9bec9 mini step grad accumulation 2021-01-06 09:25:06 +08:00
mindspore-ci-bot 2e684df5b1 !10686 fix infer rank list typo and add testcase 
From: @gong_zi_yan
Reviewed-by: @stsuteng,@zhunaipan
Signed-off-by: @stsuteng
 2020-12-28 21:20:19 +08:00
Ziyan 2c3b99ce91 fix infer rank list typo 2020-12-28 18:46:01 +08:00
mindspore-ci-bot b67aaf6773 !9832 expose_allgather_fusion_to_users 
From: @gong_zi_yan
Reviewed-by: 
Signed-off-by:
 2020-12-28 09:54:57 +08:00
Ziyan bbf8ec82b9 expose allgather fusion interface to users 2020-12-27 17:44:45 +08:00
ms_yan deb1e6e965 use from_numpy and add do_copy option 2020-12-23 21:38:05 +08:00
Ziyan c5c905fdf5 add restriction for opt shard 2020-12-19 17:43:55 +08:00
huangxinjing a8446af1ab Fix condition check 2020-12-18 16:43:43 +08:00
jjfeing 1984cf8e20 unify mindir 2020-12-12 17:55:16 +08:00
mindspore-ci-bot d5db8872fd !9834 Fix wrong input argument of Reshape for multi field embedding 
From: @huangxinjing
Reviewed-by: @zhunaipan,@stsuteng
Signed-off-by: @stsuteng
 2020-12-11 21:31:48 +08:00
huangxinjing 996ee72c50 Fix embedding layer 
Fix input check
 2020-12-11 19:13:09 +08:00
yao_yf 19fe28cb9b hange strategys of last nodes in eval/predict at auto parallel mode 2020-12-11 11:11:28 +08:00
Xiaoda Zhang e78228603b move parallel-related black-list to core/ir, and fix the cloneCNode bug 2020-12-10 15:57:01 +08:00
mindspore-ci-bot ec3983b77d !9577 support distributed predict 
From: @gong_zi_yan
Reviewed-by: @caozhou_huawei,@yao_yf,@stsuteng,@zh_qh
Signed-off-by: @stsuteng
 2020-12-08 10:28:30 +08:00
Ziyan e7e9dae54d support distributed predict 2020-12-07 16:12:45 +08:00
Xiaoda Zhang 9a9e3a751e set cnode's fullname when cloning 2020-12-04 15:59:44 +08:00
lichenever 818e920f02 fix_pipeline_split_param_shared_bug 2020-12-03 19:30:29 +08:00
lichenever 78e131cf15 pipeline_split adapt parallel 2020-12-02 18:52:40 +08:00
yangzhenzhang 7b33f3e2ac gatherv2 axis split repeated calculation 2020-11-30 17:03:29 +08:00
yangzhenzhang 7278f5c109 update_gatherv2_op 2020-11-28 16:56:39 +08:00
Xiaoda Zhang c79e988b0d set fullname for reshape after reshape-elimination 2020-11-28 12:16:51 +08:00
yao_yf 9cda064716 auto parallel predict 2020-11-26 20:13:15 +08:00
mindspore-ci-bot 3d6d820612 !8154 Add nn.MultiFieldEmbedding for the embedding lookup opearations 
From: @huangxinjing
Reviewed-by: 
Signed-off-by:
 2020-11-24 09:49:39 +08:00
mindspore-ci-bot d915fd9b96 !8592 change repeat_elements to a composite op 
From: @tom__chen
Reviewed-by: 
Signed-off-by:
 2020-11-23 23:15:23 +08:00
huangxinjing b0deb7a289 Add dense embedding 2020-11-23 20:21:58 +08:00
tom__chen a52cd685fc change repeat_element op to a composite op 2020-11-19 15:42:22 -05:00
huangxinjing 89e7778497 Add UnsortedSegmentMax Operation 2020-11-19 17:41:54 +08:00
huangxinjing 8129806475 Add slice parallel op 2020-11-18 20:20:33 +08:00
mindspore-ci-bot ee72de1db2 !8441 Add Parallel Implements of UniformCandidateSampler 
From: @huangxinjing
Reviewed-by: 
Signed-off-by:
 2020-11-18 18:59:31 +08:00
mindspore-ci-bot cd6236c0a0 !8712 update pipeline parallel interface 
From: @yangzhenzhang
Reviewed-by: @kisnwang
Signed-off-by:
 2020-11-18 18:59:04 +08:00
mindspore-ci-bot fb0e866ad1 !8269 forward unique dynamic shape 
From: @yao_yf
Reviewed-by: 
Signed-off-by:
 2020-11-18 18:53:46 +08:00
yao_yf 31819bb4a7 support forward unique 2020-11-18 15:22:14 +08:00
yangzhenzhang 278e82a849 update pipeline parallel 2020-11-18 13:55:34 +08:00
huangxinjing 2730cef047 Uniform Sampler Base Update 2020-11-18 09:39:32 +08:00
Ziyan 0ddb754edb run cast before parallel optimizer 2020-11-13 14:04:04 +08:00
huangxinjing 12e9107162 Fix VirtualDiv Int32 error 2020-11-11 09:32:57 +08:00
mindspore-ci-bot 4e07f43dff !8323 [Auto parallel] Supporting for-loop in strategy-searching 
From: @xiaoda_zh
Reviewed-by: 
Signed-off-by:
 2020-11-10 10:33:25 +08:00
Xiaoda Zhang aa13d6b1cd support for-loop in auto-parallel 2020-11-09 17:18:30 +08:00
yangzhenzhang 9747bde861 add range op 2020-11-09 15:14:07 +08:00
yangzhenzhang 0a79ab82ae add parallel ops 2020-11-06 12:09:19 +08:00
Xiaoda Zhang aa84484049 enabling approximation in DP algorithms 2020-11-05 16:07:26 +08:00
Ziyan c33f2cd796 fix auto optimizer weight shard 2020-11-02 16:25:48 +08:00
Yi Huaijie 148d645915 fix ReLUV2 error 2020-10-29 20:29:01 +08:00
huangxinjing bf5d21770a Add UnsortedSegmentSum and UnosrtedSemenMin For Oparallel Implements 2020-10-28 08:57:02 +08:00
mindspore-ci-bot d4142d682d !7437 auto parallel support dynamic 
Merge pull request !7437 from yao_yf/auto_parallel_support_dynamic_shape
 2020-10-27 21:02:28 +08:00
mindspore-ci-bot 08e6ac0b09 !7805 support split ValueList 
Merge pull request !7805 from yihuaijie/master
 2020-10-27 19:22:52 +08:00
yao_yf 0cfe72cd22 auto parallel dynamic 2020-10-27 19:17:27 +08:00
Yi Huaijie 3102c4ff8d support split ValueList 2020-10-27 17:58:36 +08:00
yao_yf 65d8e63580 set last node data parallel or repeat calculate in eval/predict 2020-10-26 20:05:00 +08:00
mindspore-ci-bot f711e01f61 !7719 refactor cnode strategy 
Merge pull request !7719 from gziyan/refactor_cnode
 2020-10-24 16:16:29 +08:00
Ziyan 069318899a refactor get cnode strategy 2020-10-24 15:06:26 +08:00
mindspore-ci-bot d50736df2c !7607 modify_normal_seed 
Merge pull request !7607 from lilei/modify_normal
 2020-10-23 10:40:58 +08:00
lilei 0c043d18ef modify_normal 2020-10-22 21:35:44 +08:00
mindspore-ci-bot 8bfe141680 !7571 fix bug in reshape strategy search when reshape as the first operator 
Merge pull request !7571 from yao_yf/reshape_strategy_search_fix_when_reshape_is_first_op
 2020-10-22 10:16:33 +08:00
yao_yf f7189adb91 fix bug in reshape strategy search when reshape is first operator 2020-10-22 09:15:18 +08:00
mindspore-ci-bot f487797694 !7495 [Auto-parallel] Overwrite strategies for star graph structures 
Merge pull request !7495 from Xiaoda/27-star-elimination-overload
 2020-10-22 09:10:52 +08:00
mindspore-ci-bot b2b9016ddf !7429 modify normal seed 
Merge pull request !7429 from lilei/modify_bug
 2020-10-21 09:37:47 +08:00
lilei 04075671cf modify_normal_seed 2020-10-20 22:06:17 +08:00
Xiaoda Zhang fba2bfeb54 overwrite strategies for star graph structure 2020-10-20 13:40:24 +08:00
yangzhenzhang fc4ed975c4 handle repeated calculation 2020-10-19 10:47:01 +08:00
yao_yf 022005b94a fix a bug cases in reshape redistribution 2020-10-15 16:58:09 +08:00
yao_yf f60d81a15f support reshape redistribution in all scenes 2020-10-13 21:21:17 +08:00
mindspore-ci-bot fd0c03c493 !7090 implement parallel BroadcastTo 
Merge pull request !7090 from yihuaijie/master
 2020-10-09 19:10:20 +08:00
Yi Huaijie 45d373d40e implement parallel BroadcastTo 2020-10-09 15:17:37 +08:00
Ziyan ddc0113058 enable parallel optimizer in auto parallel 2020-10-08 14:51:15 +08:00
mindspore-ci-bot 58610443cb !7023 modify endofsequence for multi-machine 
Merge pull request !7023 from HW_KK/master
 2020-09-30 08:40:57 +08:00
wuweikang a32811e160 modify endofsequence for multi-machine 2020-09-29 16:17:38 +08:00
mindspore-ci-bot 2a799fe90e !6018 Set the number of epochs in mode.train() non-sink Mode 
Merge pull request !6018 from h.farahat/ms_nonsink_epochs
 2020-09-28 22:15:54 +08:00
hesham 9cee0d2143 Add num_epochs to non-sink training 2020-09-24 23:24:43 -04:00
huangxinjing 4ef439e27b Add stage information for ops and strategy 2020-09-25 10:42:43 +08:00
Yi Huaijie 6066b16838 implement parallel Pack 2020-09-23 09:22:21 +08:00
mindspore-ci-bot 9475f9a19a !6548 Implement parallel Split 
Merge pull request !6548 from yihuaijie/dev
 2020-09-22 19:41:04 +08:00
mindspore-ci-bot dfe77372f5 !6505 Set top graph parameters' name the same as original graph parameters. 
Merge pull request !6505 from 张清华/master2
 2020-09-21 20:06:59 +08:00
Zhang Qinghua 6c72d88ba1 Set top graph parameters' name as original graph parameters. 2020-09-21 17:44:02 +08:00
guohongzilong a754dea90c delete SoftmaxCrossEntropyExpand 2020-09-20 21:17:24 +08:00
mindspore-ci-bot 5a20b11012 !6502 [AutoParallel]Fix auto parallel find loss bug 
Merge pull request !6502 from lichen/fix_auto_parallel_find_loss_bug
 2020-09-19 15:56:56 +08:00
Yi Huaijie 18ed2bec53 implement parallel Split 2020-09-19 12:35:56 +08:00
lichenever d4bba3f1d2 fix_auto_parallel_find_loss_bug 2020-09-18 20:27:33 +08:00
mindspore-ci-bot 4d54de100b !6411 [Auto parallel] Add a flag to control whether to overwrite the right-node in triangle-elimination of DP algorithm 
Merge pull request !6411 from Xiaoda/23-fix-the-triangle-elimination-problem
 2020-09-18 19:32:37 +08:00
Xiaoda Zhang 970490a6f0 add a flag to control whether overwrite the right-node in triangle elimination of DP algorithm 2020-09-18 15:37:18 +08:00
mindspore-ci-bot d8d2a70cb3 !6344 [AutoParallel]fix auto parallel multigraph bug 
Merge pull request !6344 from lichen/fix_auto_parallel_mutigraph_bug
 2020-09-17 20:30:32 +08:00
lichenever 6b2a9de09f fix auto parallel mutigrpah bug 2020-09-17 14:51:14 +08:00
Yi Huaijie e4cd67596f raise RuntimeError when using full_batch neither under semi_auto_parallel nor auto_parallel 2020-09-16 14:51:09 +08:00
Wan Hanyang 0b7570eb53 add model with loss, without loso and o2 test case 2020-09-12 14:26:40 +08:00
Wan Hanyang 2ceea1e59d add a self attention test case 2020-09-11 16:30:28 +08:00
Su Teng 7b46f46a65 remove unuse test 2020-09-11 10:16:56 +08:00
Yi Huaijie eb83ea9607 change internal API _get_strategy() to _get_shard_strategy() 2020-09-10 17:46:53 +08:00
Yi Huaijie a836d25c64 change API set_strategy() to shard() 2020-09-10 15:30:19 +08:00
mindspore-ci-bot b40677002f !5714 [refine]change top graph and add cell class 
Merge pull request !5714 from vlne-v1/change-top-graph
 2020-09-08 11:56:36 +08:00
Wei Luning e6f82af849 add cell class to c++ 2020-09-07 21:06:07 +08:00
lichenever f2d3fd34ce rectification_allreduce_fusion_api 2020-09-07 16:38:58 +08:00
yao_yf d4cfe55c04 rename mirror_mean to gradients_mean 2020-09-04 14:47:36 +08:00
mindspore-ci-bot 9018737e99 !5696 [Auto parallel] Move 'multi-subgraphs' interface to internal 
Merge pull request !5696 from Xiaoda/20-moving-multi-graph-interface-internal
 2020-09-04 11:17:28 +08:00
mindspore-ci-bot c064c01b6b !5729 [AutoParallel]Add FuseBatchNormEx op 
Merge pull request !5729 from lichen/add_batchnormex_op
 2020-09-04 11:17:22 +08:00
mindspore-ci-bot 7786adc3aa !5722 fix semi auto parallel parameter of reshape has another user 
Merge pull request !5722 from yao_yf/semi_auto_parallel_reshape_parameter_has_another_user
 2020-09-04 09:45:41 +08:00
lichenever d22f506431 add BatchNormEx op 2020-09-03 22:22:19 +08:00
yao_yf 05c003ae6b origin/semi_auto_parallel_reshape_parameter_has_another_user 2020-09-03 20:27:46 +08:00
mindspore-ci-bot fc79997de5 !5502 Mod SoftmaxCrossEntropyWithlogits 
Merge pull request !5502 from wanyiming/mod_SoftmaxCrossEntropyWithlogits
 2020-09-03 20:24:43 +08:00
Xiaoda Zhang 42f1241270 remove 'multi-subgraphs' to internal 2020-09-03 19:07:08 +08:00
wanyiming 0ec70068ae mod_SoftmaxCrossEntropyWithLogits 2020-09-03 17:33:20 +08:00
mindspore-ci-bot 35e6cca1a3 !5634 wrap numpy random seed into an api 
Merge pull request !5634 from yihuaijie/master
 2020-09-02 19:28:33 +08:00
Yi Huaijie 4a5d115a66 add get_seed() and set_seed() 2020-09-02 17:17:04 +08:00
mindspore-ci-bot ccc0ea60ee !5661 fix auto parallel reshape strategy set when it is first operator 
Merge pull request !5661 from yao_yf/auto_parallel_reshape_fix
 2020-09-02 15:42:47 +08:00
yao_yf 755f381406 fix auto parallel reshape strategy set when it is first operator 2020-09-02 14:15:54 +08:00
yao_yf 8f7aa5bd5a auto parallel context modify 2020-08-31 21:19:49 +08:00
mindspore-ci-bot be606ba8f5 !5432 Mindspore parallel supports all elementary-wise operators 
Merge pull request !5432 from yihuaijie/master
 2020-08-29 14:16:48 +08:00
Yi Huaijie 84948ca730 parallel supports more elementary-wise operators 2020-08-28 18:19:06 +08:00
mindspore-ci-bot 414184c184 !5367 Check the parameter's split strategies if it has multiple users 
Merge pull request !5367 from yangzhenzhang/check-parameter-split
 2020-08-28 16:26:46 +08:00
yao_yf 07117e4dd4 mv ParallelMode to context 2020-08-28 19:13:55 +08:00
yangzhenzhang fbda03bbcc check parameter split 2020-08-28 10:49:27 +08:00
mindspore-ci-bot 66d6320b21 !5224 Add test case about loss scale in parallel mode 
Merge pull request !5224 from yangzhenzhang/add-split-sens-and-loss-scale-test-case
 2020-08-27 09:06:01 +08:00
yangzhenzhang 6ae5893681 add test cases 2020-08-26 15:11:44 +08:00
panyifeng 1a54785fe2 remove name arg from gradoperation 2020-08-26 11:16:57 +08:00
mindspore-ci-bot 7d4f481884 !5017 remove internal interface in wide&deep 
Merge pull request !5017 from yao_yf/wide_and_deep_no_internal_interface
 2020-08-25 14:11:51 +08:00
mindspore-ci-bot abe6b82138 !5011 remove global grad ops 
Merge pull request !5011 from riemann_penn/remove_global_grad_ops
 2020-08-25 09:47:55 +08:00
yao_yf a9a8e323b2 remove internal interface in wide&deep 2020-08-24 19:18:47 +08:00
mindspore-ci-bot fc6eee3bda !5019 raise RuntimeError when set different mode after Initializer created 
Merge pull request !5019 from yihuaijie/dev
 2020-08-24 18:49:32 +08:00
panyifeng 637e812347 remove global grad ops 2020-08-24 16:50:09 +08:00
Yi Huaijie 394be43492 raise RuntimeError when set different mode after Initializer created 2020-08-24 14:08:09 +08:00
Su Teng e3ae23c939 add parallel attention test 2020-08-21 10:10:53 +08:00
mindspore-ci-bot 3d06cbf987 !4801 Must set or change parallel mode before any Initializer created 
Merge pull request !4801 from yihuaijie/dev
 2020-08-21 09:47:32 +08:00
Yi Huaijie 89a4ebf8a1 parallel mode must be set before create an initializer 2020-08-20 19:20:46 +08:00
mindspore-ci-bot 9ee144ea40 !4744 [AutoParallel]Support bert 
Merge pull request !4744 from lichen/support_bert
 2020-08-20 14:13:19 +08:00
lichenever 221a801395 auto parallel support bert 2020-08-19 17:47:59 +08:00
yangzhenzhang cda08f6a52 concat 3 tensors in auto parallel mode 2020-08-19 11:27:35 +08:00
mindspore-ci-bot 2ae6365d77 !4650 EmbeddingLookup support auto parallel 
Merge pull request !4650 from yangzhenzhang/embedding-lookup-auto-parallel
 2020-08-18 15:51:04 +08:00
yangzhenzhang 6f6a8ae9f0 embedding lookup auto parallel 2020-08-18 11:40:09 +08:00
Yi Huaijie 0f7ead5f14 parameter slice init test all initializers 2020-08-18 10:34:15 +08:00
yao_yf cbb4363fa7 remove to_full_tensor and load_inputs in exexute stage 2020-08-14 11:40:27 +08:00
yangzhenzhang 14c77c9f03 update field split 2020-08-14 09:00:56 +08:00
mindspore-ci-bot 2db0290c49 !4356 Add validation for field split 
Merge pull request !4356 from yangzhenzhang/update-field-split
 2020-08-13 16:43:44 +08:00
yangzhenzhang 4a0e6ff7fc update field split 2020-08-13 10:35:04 +08:00
yao_yf e4de26d5bc embeddinglookup wrap 2020-08-12 14:24:13 +08:00
yangzhenzhang f4bb43bbaf add concat op 2020-08-07 15:47:17 +08:00
lichenever bfc96de1b9 add dropout distributed op 2020-08-05 14:07:24 +08:00
simson 3617121ccf revert modification of opt 2020-08-04 10:09:21 +08:00
Xiaoda Zhang d24a902afe add a new graph operation in autoparallel 2020-07-31 10:57:19 +08:00
mindspore-ci-bot ab4c43007f !3657 Add parallel operator for StridedSlice 
Merge pull request !3657 from yangzhenzhang/add-stridedslice-op
 2020-07-30 15:02:35 +08:00
Ziyan 98e2ee90de fix optimizer parallel problems 2020-07-29 20:55:31 +08:00
yangzhenzhang 9aa84b3d14 add strided slice op 2020-07-29 17:18:50 +08:00
mindspore-ci-bot 16079e6356 !3472 [Auto parallel] Cost model for GPU 
Merge pull request !3472 from Xiaoda/13-add-gpu-costmodel
 2020-07-28 09:27:26 +08:00
mindspore-ci-bot d4165671d9 !3435 Add parallel operator for Tile 
Merge pull request !3435 from yangzhenzhang/add-tile-op
 2020-07-28 09:16:30 +08:00
Xiaoda Zhang 9097b36950 add resnet50 testcases for gpu 2020-07-27 15:22:30 +08:00
lirongzhen1 51796aa624 fix sparse feature bug for auto parallel 2020-07-27 10:44:49 +08:00
yangzhenzhang 6a6e2bd271 add tile op 2020-07-25 11:42:06 +08:00
panyifeng 963bd67a60 add sparse api docs 2020-07-24 15:40:46 +08:00
panyifeng 8a89f003eb fix sparse related issues 2020-07-23 19:05:53 +08:00
mindspore-ci-bot 684ff4f46b !3160 Rewrite tensor's __bool__ for pynative mode 
Merge pull request !3160 from Simson/push-to-opensource
 2020-07-23 16:55:49 +08:00
simson 5f77fbdd75 Rewrite tensor's __bool__ for pynative mode 2020-07-23 16:51:46 +08:00
mindspore-ci-bot 7f1ccc5f3b !3311 add sparse feature test cases for auto parallel 
Merge pull request !3311 from lirongzhen1/master
 2020-07-23 11:35:49 +08:00
mindspore-ci-bot bc20de741a !3315 restore reshape ut 
Merge pull request !3315 from yao_yf/restore_auto_parallel_reshape_ut
 2020-07-22 16:23:29 +08:00
yao_yf 1d3a06a3b0 recover reshape ut 2020-07-22 14:30:12 +08:00
lirongzhen1 5d63c60135 add sparse feature test cases for auto parallel 2020-07-22 14:27:12 +08:00
wangnan39@huawei.com 082433183d uniform learning_rate behavior of optimizers 2020-07-20 21:09:20 +08:00
anzhengqi 008b91b2a1 inject epoch ctrl op in the execution tree and send eos at the end of epoch 2020-07-20 13:02:47 +08:00
liuxiao93 75881e5f2f check input of BatchNorm is 4D. 2020-07-18 14:53:11 +08:00
wangnan39@huawei.com 86889c59cb optimizer adapt IndexedSlices 2020-07-17 15:57:50 +08:00
yao_yf abebb2004b remove 4 reshape ut 2020-07-17 10:56:24 +08:00
mindspore-ci-bot edec821c50 !2876 set reshape operator no redistribution for auto parallel 
Merge pull request !2876 from lirongzhen1/master
 2020-07-17 10:01:06 +08:00
mindspore-ci-bot 74bbfa3cf6 !3095 modify the limit of loss scale 
Merge pull request !3095 from Simson/push-to-opensource
 2020-07-16 21:30:54 +08:00
lirongzhen1 c1eba79b83 set reshape redistribution strategy attribute to no redistribution 2020-07-16 21:20:46 +08:00
simson 177e18f3f4 modify the limit of loss scale 2020-07-16 16:44:02 +08:00
Ziyan 39f08eb7dd enable optimizer parallel 2020-07-16 11:47:41 +08:00
lichenever cde5cc2bd2 add_embedding_look_up 2020-07-13 22:00:55 +08:00
Xiaoda Zhang fc906f7f58 move embeddinglookup to external 2020-07-08 16:27:40 +08:00
Yi Huaijie cae254f4df asymmetric row split support for GatherV2 2020-07-07 14:36:07 +08:00
jinyaohui dd5fba1db9 add notice 2020-06-29 17:39:25 +08:00
Ziyan 0925e35252 enable optimizer parallel with broadcast 2020-06-27 14:36:17 +08:00
Ziyan 41ddc153a6 modify lars interface 2020-06-23 11:23:28 +08:00
Xiaoda Zhang 3ff6e336c6 check cast from optimizer in auto-parallel 2020-06-22 09:10:22 +08:00
mindspore-ci-bot c0fe8c0322 !2273 [AutoParallel]update EmbeddingLookUp op 
Merge pull request !2273 from lichen/fix_embeding_look_up
 2020-06-18 21:07:52 +08:00
lichenever 563622874a update 2020-06-18 19:45:40 +08:00
Xiaoda Zhang 69574f3823 fix the bprob error of embeddinglookup 2020-06-18 16:06:56 +08:00
Xiaoda Zhang 55e7d9d2b8 move embeddinglookup to the internal 2020-06-17 14:11:28 +08:00
Xiaoda Zhang 20d2012a0e implementing the backward of embeddinglookup 2020-06-13 16:57:56 +08:00
lichenever e0e055a0b8 add sparse gatherv2 2020-06-12 11:09:28 +08:00
mindspore-ci-bot 5b0472683c !1737 sparse feature backpropagation 
Merge pull request !1737 from lirongzhen1/sparse
 2020-06-12 09:51:41 +08:00
Yi Huaijie e5c351690b support load full dataset on each device 2020-06-11 19:48:06 +08:00
lirongzhen1 516b56cb64 sparse feature bp 2020-06-11 16:32:24 +08:00
Xiaoda Zhang 1cfb52bc0e add the reshape part of the embeddinglookup backward operator 2020-06-03 10:39:45 +08:00
lichenever 1437966c98 gatherv2_support_host_and_device 2020-06-01 21:06:35 +08:00
Xiaoda Zhang 55ef468a7f fix the embeddinglookup bug 2020-06-01 15:52:22 +08:00
Yi Huaijie d7e1ab1445 clean pylint warnings 2020-05-30 11:35:00 +08:00
jinyaohui 86d197dfeb clean pylint 2020-05-29 23:00:00 +08:00
mindspore-ci-bot 8316f736ea !1650 Support forward reduce scatter for Matmul 
Merge pull request !1650 from yangzhenzhang/forward-reduce-scatter
 2020-05-29 14:45:32 +08:00
mindspore-ci-bot 57874cd61f !1372 [Auto parallel] Add a new primitive EmbeddingLookup 
Merge pull request !1372 from Xiaoda/add-embedinglookup-primitive
 2020-05-29 11:06:25 +08:00
yangzhenzhang 19bd830539 support forward reduce scatter for matmul 2020-05-29 10:48:32 +08:00
mindspore-ci-bot f523a0f83c !1600 [AutoParallel]Fix GatherV2 bug 
Merge pull request !1600 from lichen/fix_auto_parallel_gatherv2_bug
 2020-05-29 10:27:14 +08:00
Xiaoda Zhang 4154adf196 add embedinglookup primitive 2020-05-29 10:15:09 +08:00
lichenever c223fde566 fix auto parallel gatherv2 bug 2020-05-28 20:34:35 +08:00
yangzhenzhang 1413f520d7 support reshape optimized 2020-05-28 16:05:36 +08:00
mindspore-ci-bot 0fe3ff2761 !1506 Setting auto parallel flag for dataset wrap cell 
Merge pull request !1506 from yangzhenzhang/set-auto-parallel-for-dataset-wrap
 2020-05-27 21:50:43 +08:00
yangzhenzhang 2f8516e5d7 set auto parallel for dataset warp cell 2020-05-27 15:27:22 +08:00
yao_yf 96c9569dca fix reshape reshape case 2020-05-27 14:25:40 +08:00
yangzhenzhang 7c237620ba add sigmoid op 2020-05-26 21:33:32 +08:00
Yi Huaijie ac484ebbc0 remove unused variable 2020-05-25 19:59:28 +08:00
Yi Huaijie 0b137e5312 delete unused arguments in test cases 2020-05-25 15:46:05 +08:00
Yi Huaijie 8cfc05e4cf clean pylint warnings of parallel test cases 2020-05-25 11:08:29 +08:00
mindspore-ci-bot e87e6b38b0 !1355 [AutoParallel]Fix GatherV2 distributed op 
Merge pull request !1355 from lichen/fix_gatherv2
 2020-05-23 17:04:41 +08:00
lichenever 390a86effb fix gatherv2 2020-05-23 15:38:50 +08:00
Yi Huaijie 1e6ee83874 delete parallel end-to-end test cases 2020-05-22 17:35:18 +08:00
Yi Huaijie 14fe72f383 fix pylint warnings 2020-05-22 14:54:36 +08:00
jinyaohui fbdba6e4da clean pylint 2020-05-22 13:23:13 +08:00
Yi Huaijie 7a5004cc49 init the slices of a Initialzer on different devices 2020-05-21 20:43:15 +08:00
mindspore-ci-bot 1b7cdc4c61 !1218 clean pylint warning in test about import 
Merge pull request !1218 from jinyaohui/pylint1
 2020-05-18 19:54:04 +08:00
jinyaohui 5a914994ba clean pylint 2020-05-18 16:42:35 +08:00
yangzhenzhang 6b54a6417d ckpt and restore parameter shape 2020-05-18 15:16:29 +08:00
jinyaohui bcfaff97f9 clean pylint 2020-05-18 10:31:46 +08:00
jinyaohui 2907cf4488 remove some context param 2020-05-16 15:07:13 +08:00
candanzg 2cc85bdc93 Support weight compile according to shape 
Signed-off-by: candanzg <zhangshucheng@huawei.com>
 2020-05-13 17:49:07 +08:00
mindspore-ci-bot 0345995000 !1110 [AutoParallel]fix gatherv2 and dataset bug 
Merge pull request !1110 from lichen/fix_gatherv2_and_dataset_bug
 2020-05-13 11:42:09 +08:00
lichenever debfd38b75 fix gatherv2 and dataset bug 2020-05-13 09:44:37 +08:00
jinyaohui 391a060f21 remove two context param 2020-05-12 22:11:50 +08:00
mindspore-ci-bot 48e54dcfda !1056 [Auto parallel] Memory calculation in the inference phase 
Merge pull request !1056 from Xiaoda/memory-estimation-in-inference-phase
 2020-05-12 17:21:05 +08:00
mindspore-ci-bot fdad91355f !1093 reset parallel context before running each parallel test case 
Merge pull request !1093 from yihuaijie/master
 2020-05-12 15:57:55 +08:00
Xiaoda Zhang a05aa21cc2 calculating PEAK memory cost in the inference phase 2020-05-12 15:30:59 +08:00
mindspore-ci-bot 06a9eeb3bf !1050 [bug][auto_mixed_precision]fix sens shape error of `TrainOneStepWithLossScaleCell` 
Merge pull request !1050 from vlne-v1/I1GEPN-check-bprop-error-loss-scale-wrap
 2020-05-12 15:23:46 +08:00
Yi Huaijie 462f30e077 reset auto parallel context before each test 2020-05-12 14:59:45 +08:00
Wei Luning 3e89f7baaa fix sens shape error in loss_scale one_step_wrap 2020-05-12 14:09:51 +08:00
mindspore-ci-bot 2af6ee2482 !1054 Add slice shape for param info 
Merge pull request !1054 from yangzhenzhang/add-slice-shape-for-param-info
 2020-05-11 21:29:40 +08:00
mindspore-ci-bot 57085bb18d !996 [Auto parallel] Supporting VirtualDataset having three inputs 
Merge pull request !996 from Xiaoda/supporting-virtualdataset-has-three-inputs
 2020-05-11 18:59:09 +08:00
yangzhenzhang 05fde3d23d add slice shape for param info 2020-05-11 16:01:55 +08:00
yao_yf 716def7c0a move InferStraByTensorInfo to tensor_info.h 2020-05-11 14:44:06 +08:00
mindspore-ci-bot dd2062bf8d !1023 add_gatherv2_distributed_op 
Merge pull request !1023 from lichen/add_gatherv2_distributed_op
 2020-05-11 09:18:10 +08:00
lichenever 19a24b86ac add gatherv2 distributed op 2020-05-09 17:20:50 +08:00
yao_yf f0bf438a55 reshape strategy search 2020-05-09 17:00:37 +08:00
Xiaoda Zhang 5e041966f1 add a new vritualdataset cell for three inputs 2020-05-09 11:10:33 +08:00
yangzhenzhang 8c9730b3c5 add parallel mode for cell 2020-05-07 20:11:20 +08:00
Xiaoda Zhang def8573275 implementing-searching-strategy-for-inference 2020-05-07 14:53:50 +08:00
yao_yf 5a6540450e use param name as the key of strategy checkpoint 2020-04-30 11:01:32 +08:00
mindspore-ci-bot 21d936e656 !728 auto parallel strategy checkpoint full 
Merge pull request !728 from yao_yf/strategy_checkpoint_extend
 2020-04-28 19:51:15 +08:00
yao_yf 6cde5f6d91 auto parallel strategy checkpoint 2020-04-28 15:48:41 +08:00
zjun c538b83712 remove enbale hccl 2020-04-28 10:37:08 +08:00
mindspore-ci-bot afbd24cb78 !718 Fix dtype judge sentence in infer_dtype function of hcom operations 
Merge pull request !718 from zhouyuanshen/master
 2020-04-27 21:23:25 +08:00
zhouyuanshen c046874b03 fix bug in infer_dtype function of hcom operations 2020-04-27 18:49:21 +08:00
Xiaoda Zhang e227415673 support-the-multiple-subgraphs-in-the-ANF 2020-04-27 09:34:41 +08:00
yangzhenzhang 4750861054 fix layernorm bug 2020-04-26 16:39:32 +08:00
yangzhenzhang 36a62576e8 support forward graph 2020-04-26 14:44:23 +08:00
Xiaoda Zhang 3ff9e54734 add the resnet50 32k-8p testcase 2020-04-26 09:07:37 +08:00
lirongzhen1 56f785f7e6 add context configration 2020-04-24 19:35:14 +08:00
mindspore-ci-bot ce71c17933 !645 auto parallel prelu operator support broadcast 
Merge pull request !645 from yao_yf/auto_parallel_prelu_support_broadcast
 2020-04-24 17:32:37 +08:00
mindspore-ci-bot 84d5e4f923 !643 [AutoParallel]Support reshape parameter 
Merge pull request !643 from lichen/support_reshape_parameter
 2020-04-24 16:43:29 +08:00
mindspore-ci-bot 00859ae119 !586 enable/disable allreduce_fusion 
Merge pull request !586 from lirongzhen1/allreduce_fusion
 2020-04-24 16:02:53 +08:00
lichenever 2ab211ae04 support reshape parameter 2020-04-24 15:59:09 +08:00
yao_yf 425276d43d auto parallel prelu support prelu 2020-04-24 14:10:57 +08:00
Xiaoda Zhang dfde76af88 delete the 'simplify_cal' attribute in 'set_algo_parameters' and 'get_algo_parameters' interface 2020-04-24 10:46:38 +08:00
lirongzhen 4ff418084c enable/disable allreduce_fusion 2020-04-24 10:34:59 +08:00
lichenever c78630d737 support multiple subgraphs 2020-04-22 17:40:56 +08:00
Ziyan 0d208e00bd Model ALLTOALL as a single operator in cost model; scale the ALLTOALL, 
ALLGATHER, and REDUCESCATTER with different factors; change the BETA and
GAMMA value in cost model.
 2020-04-20 09:11:03 +08:00
yangzhenzhang 36ffb66782 add parallel op for square 2020-04-17 10:42:52 +08:00
yangzhenzhang 57cd9f8188 add parallel op for sigmoidloss 2020-04-16 14:33:24 +08:00
yangzhenzhang 6d522f0a4f add parallel op for layernorm 2020-04-15 19:30:07 +08:00
Xiaoda Zhang ffb2cb03a4 Change 'NOT_FULLY_USE_DEVICES' to 'FULLY_USE_DEVICES' and make ALL-1 user-specified-strategy valid in auto-parallel 2020-04-15 10:14:46 +08:00
lichenever b81cc6ea4f add minimum distributed op 2020-04-13 17:26:31 +08:00
mindspore-ci-bot 7bc2cee318 !167 add_squeeze_distributed_op 
Merge pull request !167 from lichen/add_squeeze_distributed_op
 2020-04-13 10:03:25 +08:00
c00425699 c8cdb6b331 support distributed GatherV2 operator 2020-04-12 16:00:47 +08:00
buxue 5841fe010e Support pow's second input could be tensor and fix bug in bprop of pow 2020-04-11 16:16:58 +08:00
lichenever 32cd280c1a add squeeze distributed op 2020-04-11 16:03:08 +08:00
yangzhenzhang b34c0e7a17 add parallel op for dropoutdomask 2020-04-11 12:11:22 +08:00
yao_yf b5e3fa9593 fix auto parallel prelu 2020-04-08 20:45:08 +08:00
yangzhenzhang dd0d4e6b84 add parallel ops for expand dims 2020-04-03 15:17:07 +08:00
mindspore-ci-bot a5a904fbdf !91 fix bug for allreduce fusion and add resnet unit test 
Merge pull request !91 from chentingting/allreduce_fusion_resnet
 2020-04-02 21:35:35 +08:00
mindspore-ci-bot 55916351ee !52 remove ge depend 
Merge pull request !52 from flywind/remove-ge-depend
 2020-04-02 20:59:06 +08:00
Wei Luning 73ba399364 remove ge depend in cpu 2020-04-02 19:38:42 +08:00
c00425699 ab917a734d fix bug for allreduce fusion and add resnet unit test 2020-04-02 18:55:04 +08:00
lichenever 5240b1f603 fix refkey bug for auto parallel 2020-04-02 16:14:29 +08:00
mindspore-ci-bot a47046652a !76 [Auto parallel] Refining the strategy_checking for resnset50 
Merge pull request !76 from Xiaoda/modify-resnet50-strategy-checking
 2020-04-01 16:36:13 +08:00
mindspore-ci-bot 22a9c00bcd !57 Add parallel operators for Neg and BatchMatMul 
Merge pull request !57 from yangzhenzhang/master
 2020-04-01 15:23:46 +08:00
Xiaoda Zhang fb6eed23ae refining strategy-checking for resnet50 2020-04-01 14:58:58 +08:00
mindspore-ci-bot 87040483ee !58 fix two cast bug in auto parallel 
Merge pull request !58 from lichen/fix_two_cast_bug_in_auto_parallel
 2020-04-01 09:54:10 +08:00
yangzhenzhang 110640e2ad add parallel ops for neg and batchmatmul 2020-04-01 09:36:38 +08:00
mindspore-ci-bot e2df848597 !55 modify long time python ut 
Merge pull request !55 from changzherui/master
 2020-03-31 21:01:40 +08:00
lichenever 2da38ad401 fix two cast bug in auto parallel 2020-03-31 18:54:21 +08:00
chang zherui eaf7146d46 modify longtime python ut 2020-03-31 16:18:04 +08:00
lichenever f946aea10d fix grpah mode loop sink bug in auto parallel 2020-03-31 16:16:53 +08:00
leonwanghui 976af212e9 回退 'Pull Request !17 : [AutoParallel]Fix bug in the case of two cast' 2020-03-31 10:27:40 +08:00
lichenever b4d34973bc fix_cast_bug 2020-03-30 21:13:45 +08:00
zhunaipan 930a1fb0a8 initial version 
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
 2020-03-27 22:54:54 +08:00