yuchaojie
6d195f340c
add SyncBatchNorm
2021-02-27 14:32:54 +08:00
He Wei
7d9a783993
[auto-monad] Support side-effects by auto-monad
...
The basic idea is: exploits data dependency to control the execution order
of side-effect operations, and keep the semantics of ANF unchanged.
The ControlDepend primitive is removed and there are two primitives added:
1. UpdateState:
```
a = Assign(para, value)
```
became:
```
a = Assign(para, value, u)
u = UpdateState(u, a)
```
2. Load:
```
x = Add(para, value)
```
became:
```
p = Load(para, u)
x = Add(p, value)
u = UpdateState(u, p)
```
2021-02-08 09:01:15 +08:00
mindspore-ci-bot
aebe263dce
!11895 unify mindir for different backend: the output num of optimizer ops, the backward of concat
...
From: @wangnan39
Reviewed-by:
Signed-off-by:
2021-02-05 16:27:19 +08:00
jinyaohui
8022f9a6ed
modify pack to stack
2021-02-04 18:54:31 +08:00
wangnan39@huawei.com
cd9173fdfd
unify the output num of optimizer ops
2021-02-04 17:46:00 +08:00
mindspore-ci-bot
b189f177bb
Change tuple_getitem to TupleGetItem and some other ops, merge from r1.1 to master
2021-02-02 15:54:15 +08:00
l00591931
9ec100d069
Change TensorAdd to Add, from r1.1 to master
2021-02-01 17:53:52 +08:00
yuchaojie
b51b3a6764
update Pool's attr kernel_size, pad_mode
2021-01-18 12:10:20 +08:00
lilei
9a45c4419c
modify batch_normal
2021-01-13 20:59:46 +08:00
chenhaozhe
b3add83bf0
support const input in graph_ir convertor, add value inference in Concat
2020-11-19 20:34:49 +08:00
Hoai Linh Tran
46f07efc31
Fix AdjustAllReduceMulAdd pass
...
Revive tests in lib_test
Code cleaning
2020-09-19 01:07:01 -04:00
yujianfeng
4b77f6b53c
Add AdamApplyOneWithDecayAssign fusion pass
2020-08-29 17:54:15 +08:00
huanghui
b8d7f6d77f
add UnsortedSegmentSum fission pass
2020-08-12 19:17:19 +08:00
yujianfeng
8a77751988
Add AdamApplyOneAssign and AdamApplyOneWithDecayAssign fusion pass
2020-08-10 14:46:37 +08:00
panyifeng
34e50e5d6e
fix cell bprop
2020-08-07 10:57:01 +08:00
huanghui
30000fdb52
add ReduceMin fission pass
2020-08-05 10:46:01 +08:00
laiyongqiang
2458431750
not eliminate memcpy when nexe node is graph output
2020-07-30 19:51:57 +08:00
huanghui
f1563d2d37
insert memcpy async if hccl op cascade
2020-07-22 10:43:38 +08:00
mindspore-ci-bot
6f8863b65d
!3198 synchronize latest Ascend software suite 18 Jul 2020, and merging branches
...
Merge pull request !3198 from yanghaoran/code_sync_0718
2020-07-19 14:14:45 +08:00
yanghaoran
859acc6d2a
synchronize latest Ascend software suite 18 Jul 2020, and merging branches
2020-07-18 21:09:55 +08:00
yujianfeng
fa0684d12d
Add pack and concat fission pass
2020-07-18 15:39:06 +08:00
mindspore-ci-bot
4a19e6b8cb
!3114 add coo_tensor
...
Merge pull request !3114 from riemann_penn/coo_tensor
2020-07-18 10:24:58 +08:00
panyifeng
5a10383cc3
add coo_tensor
2020-07-17 18:53:03 +08:00
yujianfeng
188d74f15e
Remove transdata and cast for internal outputs
2020-07-17 16:55:47 +08:00
changzherui
f4cb445ea8
syn code for 0715
2020-07-16 17:18:21 +08:00
mindspore-ci-bot
a661545d49
!265 Synchronize Ascend software suite 07 Jul 2020
...
Merge pull request !265 from yanghaoran/incubator
2020-07-15 21:04:59 +08:00
jiangjinsheng
7f9bbfd338
add Conv1d ops
2020-07-14 18:59:45 +08:00
mindspore-ci-bot
69ce4bf2b2
!2970 Del mindspore/model_zoo
...
Merge pull request !2970 from panbingao/master
2020-07-14 08:57:31 +08:00
panbingao
45dbc8bf04
Move model_zoo.resnet.py
2020-07-10 17:36:34 +08:00
huanghui
3eaf663545
add tensor scatter update fission pass
2020-07-10 15:41:22 +08:00
yujianfeng
24f6b9d77e
Add input2output pass
2020-07-09 21:44:43 +08:00
zhousiyi
b29d260be3
reuse AddN primitive in opt as AddN will replicated by program_specialize
2020-07-03 03:18:25 +00:00
panyifeng
d6635bbbe2
Add IndexedSlices
2020-06-30 17:38:24 +08:00
yujianfeng
7ad877a948
Add Split fission pass
2020-06-20 14:28:25 +08:00
mindspore-ci-bot
182215e060
!2284 Add Pass to Eliminate Redundant Depend
...
Merge pull request !2284 from BowenK/fix_depend
2020-06-19 16:39:55 +08:00
BowenK
8f29e7242f
add pass to eliminate depend value
2020-06-19 14:52:52 +08:00
huanghui
c7bda5363d
fix ConfusionSoftmaxGrad fusion pass work if the ReduceSum's attr of keep_dims set False
2020-06-19 10:37:15 +08:00
yujianfeng
f15cb6b7c9
Add sort by index for each group of AllReduce
2020-06-18 09:18:01 +08:00
mindspore-ci-bot
971f10d222
!1790 remove transdata only connected with control depend
...
Merge pull request !1790 from lianliguang/remove-the-useless-transdata-connected-with-the-control-depend
2020-06-15 16:59:33 +08:00
WilliamLian
b86016a26f
remove the useless transdata and cast of control depend node
2020-06-15 14:54:47 +08:00
huanghui
4acb61d59d
code review fix for buffer fusion
2020-06-15 09:35:16 +08:00
huanghui
88eec2b894
fix single-batchnorm-fission && softmax-grad-ext-fusion pass
2020-06-12 14:53:22 +08:00
mindspore-ci-bot
81ba3b1b99
!1868 Enhance insert memcpy for hccl op
...
Merge pull request !1868 from huanghui/insert-memcpy-async-pass
2020-06-11 09:55:32 +08:00
huanghui
118496b3ec
enhance insert memcpy
2020-06-10 18:00:08 +08:00
kingfo
38436f929f
move hook function to primtivePy class
2020-06-10 15:33:46 +08:00
mindspore-ci-bot
bfc18f3adc
!1873 synchronize latest ascend software 04 Jun 2020
...
Merge pull request !1873 from yanghaoran/master
2020-06-10 01:27:43 +08:00
yanghaoran
8da4c1a763
synchronize latest ascend software 04 Jun 2020
2020-06-09 23:34:13 +08:00
zhaoting
b16a552d41
Revert "Revert "add pattern AdjustAllReduceMulAdduse the old opadd test case for bugtemp fix try""
...
This reverts commit 705c71a257 .
2020-06-09 20:56:36 +08:00
huanghui
b4c0ed4b36
add signle batchnorm fission pass
2020-06-08 10:08:23 +08:00
yujianfeng
e87ac6525e
Add batch norm fusion pattern for mix precision
2020-06-04 20:31:15 +08:00
mindspore-ci-bot
0426ed057b
!1777 Remove ZerosLikeTensor and sub with ZerosTensor
...
Merge pull request !1777 from BowenK/master
2020-06-02 10:41:58 +08:00
BowenK
96379faa3a
Remove ZerosLikeTensor and sub with ZerosLike
2020-06-02 09:52:12 +08:00
huanghui
d1cec14a0c
add 2 pattern for softmaxgradext fusion pass
2020-06-01 18:48:41 +08:00
mindspore-ci-bot
cc9c004bc1
!1696 Enable ConfusionMulGrad fusion pass
...
Merge pull request !1696 from huanghui/TMP
2020-05-30 14:44:29 +08:00
mindspore-ci-bot
692f38ded2
!1532 clean pylint warning in test dir
...
Merge pull request !1532 from jinyaohui/pylint1
2020-05-30 10:13:45 +08:00
huanghui
71acaa5300
enable ConfusionMulGrad fusion pass in bert only
2020-05-30 09:46:21 +08:00
jinyaohui
86d197dfeb
clean pylint
2020-05-29 23:00:00 +08:00
huanghui
ff05aa1faa
add newly 5 patterns for AdamApplyOneWithDecayRule fusion pass
2020-05-29 19:49:44 +08:00
huanghui
99ca6b3e80
add SoftmaxGradExt fusion pass
2020-05-29 14:30:52 +08:00
mindspore-ci-bot
8556eee3fc
!1578 recitify pretrained path and revert AdjustAllReduceMulAdduse
...
Merge pull request !1578 from gengdongjie/master
2020-05-28 20:25:50 +08:00
mindspore-ci-bot
9c858444b0
!1568 Fix pylint warning for test cases of optimizer, infer, parse and pynative.
...
Merge pull request !1568 from seatea/fix-pylint-warning
2020-05-28 16:59:57 +08:00
gengdongjie
705c71a257
Revert "add pattern AdjustAllReduceMulAdduse the old opadd test case for bugtemp fix try"
...
This reverts commit 3db8cfa54f .
2020-05-28 15:21:15 +08:00
seatea
7398526abc
Fix pylint warning for test cases of optimizer, infer, parse and
...
pynative.
2020-05-28 11:35:33 +08:00
huanghui
1d65ae598a
extract const_to_attr_strided_slice_grad pass
2020-05-27 17:30:17 +08:00
mindspore-ci-bot
650a45b233
!1490 Fix pylint warning
...
Merge pull request !1490 from seatea/fix-pylint-warning
2020-05-27 09:41:31 +08:00
seatea
c6d8a4dc98
Fix pylint warning.
2020-05-26 21:23:06 +08:00
yujianfeng
94818cf255
Fix fusion condition of transpose and reshape
2020-05-26 17:30:38 +08:00
huanghui
a42dd21430
add 3 pattern for lamb_next_mv_rule fusion pass
2020-05-25 14:18:22 +08:00
huanghui
f16ff539ba
refactor multiple patterns pass
2020-05-23 09:40:21 +08:00
jinyaohui
fbdba6e4da
clean pylint
2020-05-22 13:23:13 +08:00
huanghui
eaff850f11
add 3 patterns for lamb_next_mv_with_decay_rule pass
2020-05-21 17:00:15 +08:00
huanghui
5a68eba585
Refactor LambNextMVWithDecayRule fusion pass
2020-05-21 10:08:50 +08:00
Wei Luning
3db8cfa54f
add pattern AdjustAllReduceMulAdduse the old opadd test case for bugtemp fix try
2020-05-19 18:46:11 +08:00
mindspore-ci-bot
1b7cdc4c61
!1218 clean pylint warning in test about import
...
Merge pull request !1218 from jinyaohui/pylint1
2020-05-18 19:54:04 +08:00
yujianfeng
c8d33568f2
Add an new output to FusedMulApplyMomentum
2020-05-18 17:03:21 +08:00
jinyaohui
5a914994ba
clean pylint
2020-05-18 16:42:35 +08:00
huanghui
c4af71e236
add LarsV2 fission pass
2020-05-18 11:30:45 +08:00
jinyaohui
bcfaff97f9
clean pylint
2020-05-18 10:31:46 +08:00
mindspore-ci-bot
889d7b6eea
!1180 [pre_activate]Fix pylint warning
...
Merge pull request !1180 from YuJianfeng/master
2020-05-15 17:25:34 +08:00
yujianfeng
0f42fdbb80
Fix pylint warning
2020-05-15 15:29:22 +08:00
huanghui
709828a98b
add BatchNormGrad2BNInferGrad pass
2020-05-15 14:37:50 +08:00
mindspore-ci-bot
42ba885e58
!1098 Add BatchNorm2BNInfer pass
...
Merge pull request !1098 from huanghui/add-batchnorm-bninfer-pass
2020-05-15 14:33:09 +08:00
huanghui
6db71e6576
add batchnorm2bninfer pass
2020-05-15 09:56:38 +08:00
yujianfeng
2b061c84c7
Add batch_norm_grad infer fisson
2020-05-15 09:44:40 +08:00
yujianfeng
6e89ebe6f0
Add BatchNorm fusion pattern with mix precision
2020-05-14 21:28:08 +08:00
mindspore-ci-bot
4bb46606db
!1149 fix pylint in tests
...
Merge pull request !1149 from panyifeng/fix_pylint
2020-05-14 15:15:52 +08:00
panyifeng
755ba75deb
fix pylint
2020-05-14 14:22:52 +08:00
etone-chan
c4a5bfb787
add matmul eltwise buffer fusion pass
2020-05-14 10:36:23 +08:00
yujianfeng
85ff90c237
Add input shape condition for transpose_reshape fusion pass
2020-05-12 22:54:21 +08:00
huanghui
12eaaf710b
mul_add_fusion pass supports when add's 2nd is mul
2020-05-08 14:28:39 +08:00
YuJianfeng
aa6f808616
Add batch norm bert fission pass
2020-05-06 16:33:46 +08:00
YuJianfeng
7185961e89
Enable BatchNorm fusion pass
2020-04-30 15:29:23 +08:00
huanghui
0de0aee54e
Add BatchNormGrad split pass
2020-04-29 15:28:23 +08:00
mindspore-ci-bot
3d9f1087c6
!695 Check topk supported before converting input to attr
...
Merge pull request !695 from YuJianfeng/master
2020-04-26 21:38:43 +08:00
YuJianfeng
ce2a13fcda
Check topk supported before converting input to attr
2020-04-26 18:40:17 +08:00
Wei Luning
f305d6f8a7
Revert "add pattern AdjustAllReduceMulAdd"
...
This reverts commit ea6958c50a .
2020-04-25 19:50:50 +08:00
mindspore-ci-bot
928dcf4ec4
!554 Fix derelu fusion pass
...
Merge pull request !554 from huanghui/fix_derelu_fusion_pass
2020-04-23 21:52:55 +08:00
huanghui
cd6e8d6542
fix ReluV2's mask shape in derelu fusion pass
2020-04-23 21:25:18 +08:00
huanghui
14df771175
fix confusion_softmax_grad_rule pass
2020-04-23 16:45:06 +08:00
liubuyu
672244e0ac
add keep_bn_fp32 parameter
2020-04-23 11:04:18 +08:00