changzherui
264dccfd0d
clean code for python 0918
2022-09-22 19:58:36 +08:00
He Wei
352571d7be
Add experimental API for MapParameter
2022-09-19 19:04:25 +08:00
i-robot
242e5c819e
!40599 [feature] change vjp
...
Merge pull request !40599 from chenzhuo/master_vjp
2022-09-15 01:41:13 +00:00
chenzhuo
b742f8aa76
modify vjp
2022-09-14 15:08:16 +08:00
chenfei
8402dc3570
fix some ut cases mode set
2022-09-06 16:01:00 +08:00
chenzhuo
5f39ebd788
support grad and value_and_grad with has_aux
2022-08-12 16:43:03 +08:00
huangxinjing
7bd91c0351
Fix warnning clear
2022-08-05 22:34:13 +08:00
yangzhenzhang
5fa63f8e46
delete auto parallel flag
2022-07-30 15:19:56 +08:00
Zhang Qinghua
8d9962d2f7
Support to use methods/attributes of Cell object in graph compiler.
2022-07-07 16:18:25 +08:00
fengyihang
1ed27daee3
delete extra check
2022-06-30 18:29:37 +08:00
i-robot
6c6d8931c3
!36329 Supply Tanhshrink activation function and test cases
...
Merge pull request !36329 from 冯一航/Supply_Tanhshrink
2022-06-24 01:33:32 +00:00
fengyihang
98bf50ffcf
Supply Tanhshrink activation function and test cases
2022-06-23 11:34:53 +08:00
i-robot
7943638d00
!35948 Add CPU and GPU operators of ApplyAdamWithAmsgrad with dynamic shape and vmap features support
...
Merge pull request !35948 from OwenSec/aawag
2022-06-23 01:49:18 +00:00
i-robot
5e1b73a836
!36204 Add RReLU activation function and test cases
...
Merge pull request !36204 from shaojunsong/feature/RReLU2
2022-06-22 10:33:36 +00:00
OwenSec
65467272e0
add cpu and gpu operators of applyadamwithamsgrad
2022-06-22 11:33:30 +08:00
shaojunsong
260c920b3d
add RReLU, in-place is not supported
2022-06-22 10:58:39 +08:00
i-robot
2919e625e3
!35699 Fix MultiHeadAttention dtype Error
...
Merge pull request !35699 from huangxinjing/fix_attention_dtype
2022-06-20 11:19:32 +00:00
fujianzhao
862752fdce
feat: add ops.applyAdadelta CPU backend, add nn.Adadelta, ops.applyAdadelta CPU backend support vmap.
2022-06-19 08:01:14 +08:00
huangxinjing
1918f058c4
Fix linear dtype
2022-06-17 10:29:46 +08:00
i-robot
f058997021
!35071 Add feature ReflectionPad1d & ReflecitonPad2d
...
Merge pull request !35071 from shaojunsong/feature/reflectionPad
2022-06-04 13:00:45 +00:00
shaojunsong
c0b9d74987
added reflectionpad1d and 2d
2022-06-04 17:43:49 +08:00
lvyufeng
ee30ffc3bf
add nll_loss and cross_entropy for ops.functional and nn
2022-06-02 11:13:34 +08:00
i-robot
4f1a8b1eef
!33877 operators: Softmin, SiLU
...
Merge pull request !33877 from Henry Shi/branch_operators
2022-06-01 01:53:19 +00:00
Henry Shi
63bd6f035b
operators:Softmin & SiLU
2022-05-29 10:42:31 +08:00
i-robot
f3148dbe6e
!34842 add nn.Threshold
...
Merge pull request !34842 from 吕昱峰(Nate.River)/threshold
2022-05-25 09:35:33 +00:00
lvyufeng
ce1f15666d
add nn.Threshold
2022-05-24 15:25:48 +08:00
i-robot
dd85238b91
!34579 set uni folder for ge test
...
Merge pull request !34579 from xiaoyao/master
2022-05-23 07:20:37 +00:00
He Wei
2d7c4334ec
Support fusion_size argument for flatten_weights
2022-05-20 17:11:48 +08:00
xiao_yao1994
fbdfdb1127
"change default backend in debug graph mode and set uni folder for ge
...
test"
2022-05-20 09:12:03 +08:00
i-robot
20f3a911f1
!34094 Remove the context option: 'enable_sparse'.
...
Merge pull request !34094 from 张清华/opt
2022-05-20 00:52:05 +00:00
Zhang Qinghua
d7762f1c8d
Add bprop_return_sparse flag for sparse bprop primitive and remove context option: 'enable_sparse'.
2022-05-19 17:31:57 +08:00
fujianzhao
7fcb75beaa
[feat] [assistant] [ops] [I51VS2] Add new operator nn.AdaptiveMaxPool1d
2022-05-18 15:50:44 +08:00
fujianzhao
cb56dd895d
[feat] [assistant] [ops] [I51VS1] Add new operator nn.AdaptiveAvgPool1d
2022-05-16 16:19:24 +08:00
i-robot
c07819796c
!34221 [feat] [assistant] [ops] [I51VSC] Add new operator nn.HuberLoss
...
Merge pull request !34221 from fujianzhao/huberloss
2022-05-13 02:57:19 +00:00
i-robot
bfd377ca3c
!34125 add nn.ConstantPad1d nn.ConstantPad2d nn.ConstantPad3d and nn.ZeroPad2d
...
Merge pull request !34125 from ZhidanLiu/master
2022-05-13 01:53:23 +00:00
ZhidanLiu
fdd6f7c759
add nn.ConstantPad1d nn.ConstantPad2d nn.ConstantPad3d and nn.ZeroPad2d
2022-05-12 10:34:52 +08:00
fujianzhao
4fd3433d23
[feat] [assistant] [ops] [I51VSC] Add new operator nn.HuberLoss
2022-05-11 15:39:02 +08:00
fujianzhao
5bb57674da
[feat] [assistant] [ops] [I51VSB] Add new operator nn.Hardtanh
2022-05-11 14:23:11 +08:00
liqiliang
0fabbc4ccb
Add a nn cell for softsign.
2022-05-10 17:09:33 +08:00
He Wei
8b0d4e7751
Refactor optimizers to support flatten parameters
2022-04-20 20:23:31 +08:00
He Wei
0d12199928
Enable flatten_gradients for Adam optimizer
2022-04-15 19:49:57 +08:00
He Wei
723543eb5d
Modify Optimizer to support flatten parameters
...
1. Provide method to create Parameter from Tensor without copy;
2. Adapt optimizer.py to support flattened parameters;
3. Add unit test cases for parameter and optimizer.
2022-04-07 14:11:32 +08:00
xiao_yao1994
94df0869ad
uni_backend: add ut ge test
2022-03-10 16:08:36 +08:00
Margaret_wangrui
462c38813d
[ME] Add parameter name check.
2022-02-14 10:07:43 +08:00
liuyang_655
15a153a40d
Modify error info
2022-01-06 01:28:53 -05:00
wanyiming
ab65f4ac98
addut
2021-11-26 09:48:34 +08:00
chenzhuo
d07f24462c
add examples of grad, jvp and vjp
2021-11-16 14:15:26 +08:00
chenzhuo
f36edec3ff
add function jvp
2021-11-12 08:44:41 +08:00
Zhang Qinghua
b43693be23
Fix fallback and cell kwargs issues.
2021-10-27 14:06:02 +08:00
Bingya Weng
be20f00299
modify ut of probability
2021-10-14 19:33:34 +08:00
huanghui
ba66c0d491
add security isolate for save_graphs
2021-09-14 10:24:12 +08:00
i-robot
76fac95591
!23069 Modify error content
...
Merge pull request !23069 from huchunmei/master
2021-09-11 03:50:52 +00:00
huchunmei
c75773cf37
Modify error content
2021-09-10 15:21:33 +08:00
yanghaoran
0ced8775c4
upgrade Ascend software package 09 Sep 21
2021-09-09 20:30:22 +08:00
huangxinjing
6cea07f749
Add args check
2021-09-08 09:12:35 +08:00
yao_yf
82889ec56b
fixed sparse attention
2021-08-31 16:11:56 +08:00
i-robot
ff2e34b9f9
!22509 Add ut and st for Jvp, Vjp and Grad
...
Merge pull request !22509 from LiangZhibo/fix
2021-08-30 08:21:54 +00:00
Zhang Qinghua
a137fa1d0b
Optimize the Executors routines.
...
- Fix the key generating.
- Distinguish the executors.
2021-08-28 17:36:12 +08:00
l00591931
98fad9f08e
Add st and ut for jvp vjp and grad
2021-08-28 17:34:23 +08:00
zhihenghu
ce12c02343
Add Sparse Attention
...
adjut the file structure and name
Deleted extra information
Do some formatting work
Add test case and fix some document
fix imports
2021-08-28 11:50:58 +08:00
huangxinjing
62496d75f3
less the interface exposed
2021-08-25 21:22:40 +08:00
ms_yan
36a8886ca2
Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset"
...
This reverts commit b077aa1cab .
Revert "[feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset"
This reverts commit 4e6f7dc97d .
delete pass_registry_test.cc
comment hiai_nlu_model_multi.pb related line
2021-08-23 01:46:38 +08:00
djc
4e6f7dc97d
[feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset
2021-08-22 13:39:37 +08:00
huangxinjing
d777742904
1. Move the class to mindspore.parallel, support activation sharding
2021-08-20 14:34:10 +08:00
huangxinjing
18044aff0f
1. Add docstring, elimitate attention mask, tuple append the deocoder return layer past
...
split attention inputs from two into three
Add input check and modify test case
Fix check error and add check to transformer inputs
add input check to the transformers
2021-08-16 21:08:48 +08:00
i-robot
2650aae9ba
!21351 complex support
...
Merge pull request !21351 from zhouyaqiang0/complex_support
2021-08-12 09:39:15 +00:00
zhouyaqiang
b81ba100b7
add complex number support
2021-08-12 10:36:43 +08:00
jiangzhenguang
a3bb780ce4
optimize run memory
2021-08-10 20:45:25 +08:00
huangxinjing
615d1a179d
Add transformer layer
2021-07-29 11:10:43 +08:00
huangbingjian
ad8f73f32b
set default context mode to GRAPH_MODE
2021-06-09 14:40:49 +08:00
huanghui
29f632613f
optimize log
2021-06-04 12:32:44 +08:00
huanghui
5acf3c8ade
[dfx]optimize exception info print
2021-05-31 14:57:29 +08:00
wangnan39@huawei.com
2761776699
add check for optimizer parameters
2021-05-17 22:23:03 +08:00
jiaqi
cdb7330818
diceloss bug
2021-03-09 16:23:45 +08:00
Zhang Qinghua
df866f7248
Add TopoSort Rhs First attribute for special CNode, such as Depend CNode with isolated nodes.
2021-03-06 12:39:36 +08:00
Zhang Qinghua
8b8c59f01e
Optimize the compile performance in Parser, FG, Manager and Renormalize:
...
---
Remove the routine of handling isolated nodes in Renormalize.
Add isolated nodes from Parser&Resolver.
Modify isolated nodes handling in FG&Manager.
Optimize the renormalize routines.
Other optimizations.
2021-03-04 16:01:54 +08:00
Jiaqi
112b8488c5
add rmse loss
2021-02-25 17:03:07 +08:00
Jiaqi
fd1a4726b7
add focal loss
2021-02-22 19:33:26 +08:00
Jiaqi
952e245000
add multclass diceloss
2021-02-19 15:43:30 +08:00
He Wei
7d9a783993
[auto-monad] Support side-effects by auto-monad
...
The basic idea is: exploits data dependency to control the execution order
of side-effect operations, and keep the semantics of ANF unchanged.
The ControlDepend primitive is removed and there are two primitives added:
1. UpdateState:
```
a = Assign(para, value)
```
became:
```
a = Assign(para, value, u)
u = UpdateState(u, a)
```
2. Load:
```
x = Add(para, value)
```
became:
```
p = Load(para, u)
x = Add(p, value)
u = UpdateState(u, p)
```
2021-02-08 09:01:15 +08:00
wangshuide2020
30f99f2722
add raises description for BCELoss, ReLU, BatchNorm1d, etc. operators.
2021-02-02 20:52:00 +08:00
Jiaqi
804ef79c18
modify dice and diceloss
2021-01-29 15:10:05 +08:00
mindspore-ci-bot
775d71f9c1
!11408 Update PP example
...
From: @zichun_ye
Reviewed-by: @wang_zi_dong,@sunnybeike
Signed-off-by:
2021-01-20 09:17:23 +08:00
Zichun Ye
ca316f4422
update doc example in probability
...
fix typo in probability module
fix pylint in msp
2021-01-19 11:51:43 -05:00
Jiaqi
87ecd44f67
develop dice loss
2021-01-16 15:54:06 +08:00
lilei
b858097ae4
modify MetaTensor and Tensor
2021-01-04 20:58:34 +08:00
huangxinjing
dd0da1542d
Add input check
2020-12-18 19:54:49 +08:00
buxue
aeeef7607a
remove the 'raise' in construct of Cell
2020-12-17 10:54:42 +08:00
l00591931
130c61cfc0
change name from interpolate to resizeBilinear
2020-12-10 11:46:40 +08:00
wangnan39@huawei.com
0fe9e2e4cb
support import dynamic_lr from nn
2020-12-09 17:47:52 +08:00
mindspore-ci-bot
231fccf66c
!9600 Add Adagrad Optimizer
...
From: @zyx5256
Reviewed-by: @liangchenghui,@kingxian
Signed-off-by: @liangchenghui
2020-12-08 18:29:18 +08:00
zhuyuxiao
37bebc751b
add adagrad optim
2020-12-08 09:38:15 +08:00
mindspore-ci-bot
e6ec9be6c2
!9386 l1_regularizer开发
...
From: @dangjiaqi1
Reviewed-by:
Signed-off-by:
2020-12-07 21:58:58 +08:00
“dangjiaqi1”
39948670dd
new update basic.py which add class L1Regularizer(Cell). new add test_l1_regularizer.py. new add test_l1_regularizer.py
2020-12-07 20:08:35 +08:00
Xun Deng
4ef9e9e57f
fix minor issues in distribution classes
2020-12-03 14:47:08 -05:00
peixu_ren
37d40bc495
Add Beta distribution
2020-11-27 17:07:54 -05:00
peixu_ren
93d4ef428f
Add Gamma distribution
2020-11-25 09:40:46 -05:00
peixu_ren
01f5da0a14
Add Poisson distribution
2020-11-24 11:55:39 -05:00
mindspore-ci-bot
7f725b93a3
!8234 Remove expm1_generic and log1p_generic from PP utils
...
From: @peixu_ren
Reviewed-by:
Signed-off-by:
2020-11-23 09:56:07 +08:00
mindspore-ci-bot
e3371a01d5
!8751 Fix minor bugs in bijector and distribution
...
From: @shallydeng
Reviewed-by: @zichun_ye,@sunnybeike
Signed-off-by:
2020-11-23 08:50:57 +08:00