Nigel
/
mindspore
forked from mindspore-Ecosystem/mindspore
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
42,838 Commits 24 Branches 0 Tags 3.9 GiB
Commit Graph

19 Commits

Author SHA1 Message Date
liuyang_655 15a153a40d Modify error info 2022-01-06 01:28:53 -05:00
Zhang Qinghua a137fa1d0b Optimize the Executors routines. 
- Fix the key generating.
- Distinguish the executors.
 2021-08-28 17:36:12 +08:00
wangnan39@huawei.com 2761776699 add check for optimizer parameters 2021-05-17 22:23:03 +08:00
He Wei 7d9a783993 [auto-monad] Support side-effects by auto-monad 
The basic idea is: exploits data dependency to control the execution order
of side-effect operations, and keep the semantics of ANF unchanged.

The ControlDepend primitive is removed and there are two primitives added:

1. UpdateState:
```
  a = Assign(para, value)
```
became:
```
  a = Assign(para, value, u)
  u = UpdateState(u, a)
```

2. Load:
```
  x = Add(para, value)
```
became:
```
  p = Load(para, u)
  x = Add(p, value)
  u = UpdateState(u, p)
```
 2021-02-08 09:01:15 +08:00
wangnan39@huawei.com 0fe9e2e4cb support import dynamic_lr from nn 2020-12-09 17:47:52 +08:00
wangnan39@huawei.com ab811fca8f add AdamOffload optimizer 2020-11-18 16:13:47 +08:00
Jiaqi a30ccea62c sparse optimizer 2020-10-20 17:56:45 +08:00
wangnan39@huawei.com 082433183d uniform learning_rate behavior of optimizers 2020-07-20 21:09:20 +08:00
panyifeng 44e74ad5aa Apply indexed_slices 2020-07-13 15:36:25 +08:00
wangnan39@huawei.com 172728a6a6 support weight decay for sparse optimizer 2020-06-28 17:49:03 +08:00
panyifeng 3c2057297e support multi param for tuple grad 2020-06-20 08:39:42 +08:00
wangnan39@huawei.com d4e3d69f37 support loss scale for sparse situation 2020-06-15 22:17:53 +08:00
wangnan39@huawei.com 4042f16ce4 add lazy adam optim and support sparse adam & ftrl for cpu backend 2020-06-12 16:06:11 +08:00
mindspore-ci-bot 9dfb1011fe !1854 add SparseApplyAdam and SparseApplyLazyAdam ops 
Merge pull request !1854 from wangnan39/add_ops_sparse_adam_and_sparse_lazy_adam
 2020-06-11 16:35:03 +08:00
wangnan39@huawei.com de21dbdaef add ops SparseApplyAdam and SparseApplyLazyAdam 2020-06-11 15:50:28 +08:00
wangnan39@huawei.com c9b7d95c2c fix lr check bug in AdamWeightDecayDynamicLR 2020-06-03 19:20:36 +08:00
jinyaohui 26fd75895d pylint waring clean 2020-05-13 11:30:27 +08:00
guohongzilong 824bc30a94 learning rate and weight decay support group mode 2020-05-07 09:38:03 +08:00
zhunaipan 930a1fb0a8 initial version 
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
 2020-03-27 22:54:54 +08:00