Commit Graph

143 Commits

Author SHA1 Message Date
mindspore-ci-bot b5bc938deb !12914 [GraphKernel]expander lamb_apply_weight_assign
From: @wenfangpei
Reviewed-by: @anyrenwei,@gaoxiong1,@gaoxiong1
Signed-off-by: @anyrenwei
2021-04-06 17:02:16 +08:00
mindspore-ci-bot f324a9a760 !14553 [GraphKernel] refine cast matmul fusion
From: @lingyunli63
Reviewed-by: @gaoxiong1,@ckey_dou
Signed-off-by: @ckey_dou
2021-04-06 11:07:55 +08:00
lingyunli63 56390330ac cast_Matmul_fusion, when cast cannot fuse forward 2021-04-02 17:32:11 +08:00
wenfangpei a4ad6066b1 expander lamb_apply_weight_assign 2021-04-02 17:28:59 +08:00
mindspore-ci-bot 8634675e2d !14499 [GraphKernel]split UMonad in inputs of op
From: @wenfangpei
Reviewed-by: @dayschan,@ckey_dou,@gaoxiong1
Signed-off-by: @gaoxiong1
2021-04-02 14:25:22 +08:00
wenfangpei 0085a273e7 split UMonad in inputs of op 2021-04-01 14:47:59 +08:00
lingyunli63 8b3823b22c optimizeMatmul 2021-04-01 10:48:48 +08:00
mindspore-ci-bot 69526df01e !14314 [GraphKernel] unify graph kernel pass add_atomic_clean on Ascend and GPU back-end
From: @looop5
Reviewed-by: @gaoxiong1,@gaoxiong1,@dylangeng
Signed-off-by: @dylangeng
2021-03-30 17:11:00 +08:00
mindspore-ci-bot ddf75da542 !14085 [GraphKernel] add some expander ops
From: @chenlei_autodiff
Reviewed-by: 
Signed-off-by:
2021-03-30 15:33:06 +08:00
looop5 76d322464d unify graph kernel pass add_atomic_clean on Ascend and GPU back-end
refactor CanActivateAtomicAdd

use smart pointer
2021-03-30 11:37:41 +08:00
chenlei_autodiff f4289d40f3 add graph kernel expander ops. 2021-03-30 11:19:40 +08:00
mindspore-ci-bot 7149e8c2c9 !14045 [Graph Kernel] add compare test case
From: @zengzitao
Reviewed-by: @gaoxiong1
Signed-off-by:
2021-03-29 09:15:57 +08:00
zengzitao 72c6dad4ba add compare_test case in gpu ci and update akg submodule 2021-03-27 15:28:54 +08:00
lingyunli63 4b966ed40d support matmul on D 2021-03-26 15:57:26 +08:00
mindspore-ci-bot 5b95409022 !13512 add some expander ops
From: @zengzitao
Reviewed-by: 
Signed-off-by:
2021-03-19 15:00:23 +08:00
wenfangpei 043a558ae2 expander lamb_apply_optimizer_assign 2021-03-19 09:54:10 +08:00
zengzitao d0a656f3cd add some expander ops 2021-03-18 19:03:36 +08:00
zengzitao ef3507e973 fix exec order bug about monad 2021-02-18 11:01:06 +08:00
He Wei 7d9a783993 [auto-monad] Support side-effects by auto-monad
The basic idea is: exploits data dependency to control the execution order
of side-effect operations, and keep the semantics of ANF unchanged.

The ControlDepend primitive is removed and there are two primitives added:

1. UpdateState:
```
  a = Assign(para, value)
```
became:
```
  a = Assign(para, value, u)
  u = UpdateState(u, a)
```

2. Load:
```
  x = Add(para, value)
```
became:
```
  p = Load(para, u)
  x = Add(p, value)
  u = UpdateState(u, p)
```
2021-02-08 09:01:15 +08:00
jinyaohui 30a27b2adb modify Gelu、FastGelu to GeLU and FastGeLU 2021-02-05 17:19:52 +08:00
mindspore-ci-bot e897eb4c41 !11915 Change TensorAdd to Add, merge from r1.1 to master
From: @liangzhibo
Reviewed-by: @ginfung,@zh_qh
Signed-off-by: @zh_qh
2021-02-02 09:16:08 +08:00
l00591931 9ec100d069 Change TensorAdd to Add, from r1.1 to master 2021-02-01 17:53:52 +08:00
looop5 0161209e40 update submoudle akg, close graph kernel ascend ci testcases 2021-02-01 15:59:50 +08:00
looop5 8bbe723603 add Tile infer shape function 2020-12-21 16:50:12 +08:00
mindspore-ci-bot 5f2c84f3cb !9867 Add graph kernel testcases
From: @looop5
Reviewed-by: @ckey_dou,@gaoxiong1
Signed-off-by: @gaoxiong1
2020-12-15 17:17:25 +08:00
looop5 4d8205cd93 Delete unused interface in graph_kernels.py 2020-12-14 19:13:07 +08:00
looop5 56fa56b173 add graph kernel testcases 2020-12-12 14:56:21 +08:00
tronzhang 2190da9946 support atomic clean and change package for akg. 2020-12-02 16:26:41 +08:00
zengzitao 3ef0e9f053 substitute dropout by cudnnuniformreal and dropout 2020-11-26 10:36:02 +08:00
zengzitao 266bfa50bf expand logsoftmax and logsoftmax_grad, delete softmax's cast and fix layernorm op 2020-11-17 09:57:58 +08:00
looop5 f5f66abd06 Add testcases in Ascend back-end for graph kernel 2020-11-16 16:40:12 +08:00
zengzitao 326540cbbd expand layernorm_grad op 2020-11-16 09:03:13 +08:00
zengzitao 28f1db74dd expand maximum_grad minimum_grad dropout_grad op 2020-11-12 10:31:03 +08:00
zengzitao db27783d54 expand tanh_grad and reduce_mean, fix bug and add test_case in ci 2020-11-10 10:37:38 +08:00
zengzitao 53043ae18f support expand fused_adam and fused_adam_weight_decay op 2020-11-05 20:56:49 +08:00
dayschan 0f8f1cdda7 Eliminate redundant parameters while expanding basic ops.
add testcase for Gelu/GeluGrad
2020-11-05 11:14:48 +08:00
mindspore-ci-bot 8d39a8a4b2 !7529 complex arithmetic_simplify
Merge pull request !7529 from zhuxiaochen/1020_allsimplify_1.0
2020-10-23 17:39:38 +08:00
zhu_xiaochen c739f14038 simplify transpose matmul reduce 2020-10-23 14:17:45 +08:00
lingyunli63 a500a57c72 add GraphkernelCSE 2020-10-20 15:29:33 +08:00
Geng_Fei 1455372cf1 add new pass in graph kernel: arithmetic_simplify 2020-10-15 10:54:10 +08:00
dayschan 37a48f6aac GraphKernel supports GPU
1. Update akg submodule
2. Refactor akg_kernel_build, akg_ascend_kernel_build, akg_gpu_kernel_build
3. Add akg_kernel_json_decoder to support converting kernel_json to AnfNode.
4. Add GraphKernel Cost Model. (mindspore/_extends/graph_kernel)
5. Add some GraphKernel passes to GpuSession, move these passes to backend/optimizer/graph_kernel.
6. Add global id for ir files.
7. Fix bug in ConstInputToAttr.
2020-09-09 17:46:50 +08:00
duxiutao 793737ab62 add primitive operator to test_lamb 2020-07-02 16:03:01 +08:00
duxiutao 1e43c609e0 Add test case and fix two bugs
1. add case to guard precision
2. fix a shape bug
3. fix a funcGraph bug
2020-07-02 12:52:15 +08:00