Commit Graph

303 Commits

Author SHA1 Message Date
huanghui ba66c0d491 add security isolate for save_graphs 2021-09-14 10:24:12 +08:00
i-robot 76fac95591 !23069 Modify error content
Merge pull request !23069 from huchunmei/master
2021-09-11 03:50:52 +00:00
huchunmei c75773cf37 Modify error content 2021-09-10 15:21:33 +08:00
yanghaoran 0ced8775c4 upgrade Ascend software package 09 Sep 21 2021-09-09 20:30:22 +08:00
huangxinjing 6cea07f749 Add args check 2021-09-08 09:12:35 +08:00
yao_yf 82889ec56b fixed sparse attention 2021-08-31 16:11:56 +08:00
i-robot ff2e34b9f9 !22509 Add ut and st for Jvp, Vjp and Grad
Merge pull request !22509 from LiangZhibo/fix
2021-08-30 08:21:54 +00:00
Zhang Qinghua a137fa1d0b Optimize the Executors routines.
- Fix the key generating.
- Distinguish the executors.
2021-08-28 17:36:12 +08:00
l00591931 98fad9f08e Add st and ut for jvp vjp and grad 2021-08-28 17:34:23 +08:00
zhihenghu ce12c02343 Add Sparse Attention
adjut the file structure and name

Deleted extra information

Do some formatting work

Add test case and fix some document

fix imports
2021-08-28 11:50:58 +08:00
huangxinjing 62496d75f3 less the interface exposed 2021-08-25 21:22:40 +08:00
ms_yan 36a8886ca2 Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset"
This reverts commit b077aa1cab.

Revert "[feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset"

This reverts commit 4e6f7dc97d.

delete pass_registry_test.cc

comment  hiai_nlu_model_multi.pb related  line
2021-08-23 01:46:38 +08:00
djc 4e6f7dc97d [feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset 2021-08-22 13:39:37 +08:00
huangxinjing d777742904 1. Move the class to mindspore.parallel, support activation sharding 2021-08-20 14:34:10 +08:00
huangxinjing 18044aff0f 1. Add docstring, elimitate attention mask, tuple append the deocoder return layer past
split attention inputs from two into three

Add input check and modify test case

Fix check error and add check to transformer inputs

add input check to the transformers
2021-08-16 21:08:48 +08:00
i-robot 2650aae9ba !21351 complex support
Merge pull request !21351 from zhouyaqiang0/complex_support
2021-08-12 09:39:15 +00:00
zhouyaqiang b81ba100b7 add complex number support 2021-08-12 10:36:43 +08:00
jiangzhenguang a3bb780ce4 optimize run memory 2021-08-10 20:45:25 +08:00
huangxinjing 615d1a179d Add transformer layer 2021-07-29 11:10:43 +08:00
huangbingjian ad8f73f32b set default context mode to GRAPH_MODE 2021-06-09 14:40:49 +08:00
huanghui 29f632613f optimize log 2021-06-04 12:32:44 +08:00
huanghui 5acf3c8ade [dfx]optimize exception info print 2021-05-31 14:57:29 +08:00
wangnan39@huawei.com 2761776699 add check for optimizer parameters 2021-05-17 22:23:03 +08:00
jiaqi cdb7330818 diceloss bug 2021-03-09 16:23:45 +08:00
Zhang Qinghua df866f7248 Add TopoSort Rhs First attribute for special CNode, such as Depend CNode with isolated nodes. 2021-03-06 12:39:36 +08:00
Zhang Qinghua 8b8c59f01e Optimize the compile performance in Parser, FG, Manager and Renormalize:
---
Remove the routine of handling isolated nodes in Renormalize.
Add isolated nodes from Parser&Resolver.
Modify isolated nodes handling in FG&Manager.
Optimize the renormalize routines.
Other optimizations.
2021-03-04 16:01:54 +08:00
Jiaqi 112b8488c5 add rmse loss 2021-02-25 17:03:07 +08:00
Jiaqi fd1a4726b7 add focal loss 2021-02-22 19:33:26 +08:00
Jiaqi 952e245000 add multclass diceloss 2021-02-19 15:43:30 +08:00
He Wei 7d9a783993 [auto-monad] Support side-effects by auto-monad
The basic idea is: exploits data dependency to control the execution order
of side-effect operations, and keep the semantics of ANF unchanged.

The ControlDepend primitive is removed and there are two primitives added:

1. UpdateState:
```
  a = Assign(para, value)
```
became:
```
  a = Assign(para, value, u)
  u = UpdateState(u, a)
```

2. Load:
```
  x = Add(para, value)
```
became:
```
  p = Load(para, u)
  x = Add(p, value)
  u = UpdateState(u, p)
```
2021-02-08 09:01:15 +08:00
wangshuide2020 30f99f2722 add raises description for BCELoss, ReLU, BatchNorm1d, etc. operators. 2021-02-02 20:52:00 +08:00
Jiaqi 804ef79c18 modify dice and diceloss 2021-01-29 15:10:05 +08:00
mindspore-ci-bot 775d71f9c1 !11408 Update PP example
From: @zichun_ye
Reviewed-by: @wang_zi_dong,@sunnybeike
Signed-off-by:
2021-01-20 09:17:23 +08:00
Zichun Ye ca316f4422 update doc example in probability
fix typo in probability module

fix pylint in msp
2021-01-19 11:51:43 -05:00
Jiaqi 87ecd44f67 develop dice loss 2021-01-16 15:54:06 +08:00
lilei b858097ae4 modify MetaTensor and Tensor 2021-01-04 20:58:34 +08:00
huangxinjing dd0da1542d Add input check 2020-12-18 19:54:49 +08:00
buxue aeeef7607a remove the 'raise' in construct of Cell 2020-12-17 10:54:42 +08:00
l00591931 130c61cfc0 change name from interpolate to resizeBilinear 2020-12-10 11:46:40 +08:00
wangnan39@huawei.com 0fe9e2e4cb support import dynamic_lr from nn 2020-12-09 17:47:52 +08:00
mindspore-ci-bot 231fccf66c !9600 Add Adagrad Optimizer
From: @zyx5256
Reviewed-by: @liangchenghui,@kingxian
Signed-off-by: @liangchenghui
2020-12-08 18:29:18 +08:00
zhuyuxiao 37bebc751b add adagrad optim 2020-12-08 09:38:15 +08:00
mindspore-ci-bot e6ec9be6c2 !9386 l1_regularizer开发
From: @dangjiaqi1
Reviewed-by: 
Signed-off-by:
2020-12-07 21:58:58 +08:00
“dangjiaqi1” 39948670dd new update basic.py which add class L1Regularizer(Cell). new add test_l1_regularizer.py. new add test_l1_regularizer.py 2020-12-07 20:08:35 +08:00
Xun Deng 4ef9e9e57f fix minor issues in distribution classes 2020-12-03 14:47:08 -05:00
peixu_ren 37d40bc495 Add Beta distribution 2020-11-27 17:07:54 -05:00
peixu_ren 93d4ef428f Add Gamma distribution 2020-11-25 09:40:46 -05:00
peixu_ren 01f5da0a14 Add Poisson distribution 2020-11-24 11:55:39 -05:00
mindspore-ci-bot 7f725b93a3 !8234 Remove expm1_generic and log1p_generic from PP utils
From: @peixu_ren
Reviewed-by: 
Signed-off-by:
2020-11-23 09:56:07 +08:00
mindspore-ci-bot e3371a01d5 !8751 Fix minor bugs in bijector and distribution
From: @shallydeng
Reviewed-by: @zichun_ye,@sunnybeike
Signed-off-by:
2020-11-23 08:50:57 +08:00
l00591931 05e26f4739 Add nn.interpolate() 2020-11-20 10:00:47 +08:00
mindspore-ci-bot fa2185b8ef !8661 Add nn.Tril() and nn.Triu()
From: @liangzhibo
Reviewed-by: 
Signed-off-by:
2020-11-19 16:34:32 +08:00
l00591931 e1dba1337c Add nn.Tril function 2020-11-19 10:31:30 +08:00
Xun Deng b5e05472ce fix minor bugs in bijector and distribution utils, fix docs issues 2020-11-18 21:13:47 -05:00
wangnan39@huawei.com ab811fca8f add AdamOffload optimizer 2020-11-18 16:13:47 +08:00
peixu_ren 65d50861ec Remove expm1_generic and log1p_generic from PP utils 2020-11-16 16:12:13 -05:00
Xun Deng 1a68ccb40b added Cauchy distribution 2020-11-11 22:36:34 -05:00
Xun Deng fb0263f869 redesigned bijector classes, changed bacth_shape calculation in transformed distribution and upgraded dtype logic of bijector class 2020-11-03 15:28:45 -05:00
Yi Huaijie da29f232c6 fix CI random fails 2020-11-02 16:28:28 +08:00
Xun Deng d4df6f82ea support get_dist_args 2020-10-27 16:17:38 -04:00
Xun Deng 5ffc16c6db renamed test_invert_bijector 2020-10-26 10:51:07 -04:00
mindspore-ci-bot 1795840436 !7581 Extension interface for dense
Merge pull request !7581 from lilei/modify_bug
2020-10-23 10:40:42 +08:00
lilei 127f70ce40 Extension interface for dense 2020-10-22 17:58:24 +08:00
Xun Deng ce170b2241 added Gumbel distribution 2020-10-20 10:26:04 -04:00
mindspore-ci-bot 620d8b99b6 !6760 sparse optimizer
Merge pull request !6760 from lijiaqi/sparse_optimizer
2020-10-20 20:19:06 +08:00
Jiaqi a30ccea62c sparse optimizer 2020-10-20 17:56:45 +08:00
mindspore-ci-bot 3fd54fd58f !7361 Check whether the network args are tensors in the compile phase
Merge pull request !7361 from YuJianfeng/master
2020-10-19 14:32:15 +08:00
yujianfeng 18a76ff3c5 Check whether the network args are tensors in the compile phase 2020-10-19 11:46:10 +08:00
chenzomi acadb694aa [ME] delete reduant function in check_parameter 2020-10-16 16:22:28 +08:00
chenzomi 5b769dfb20 [ME] Bug fix 2020-10-16 13:01:34 +08:00
mindspore-ci-bot c967bf6846 !7339 fix for se-resnet50 accurancy
Merge pull request !7339 from qujianwei/master
2020-10-15 19:50:16 +08:00
Xun Deng f2e8e143be added gumbel_cdf and invert bijectors 2020-10-13 15:41:43 -04:00
mindspore-ci-bot 55e369a125 !7144 [ME] change `check_integer` to format `check_positive_int` and `check_integeter`
Merge pull request !7144 from chenzhongming/zomi_master
2020-10-10 14:14:38 +08:00
chenzomi d471d32e87 [ME] change `check_integer` to format `check_positive_int` and `check_integeter` 2020-10-10 12:08:10 +08:00
mindspore-ci-bot 3d21c80e3b !7110 [ME] delete check_bool and replace with Validate.check_bool
Merge pull request !7110 from chenzhongming/zomi_master
2020-10-10 11:56:39 +08:00
chenzomi d4e8e94981 [ME] delete check_bool and replace with Validate.check_bool 2020-10-09 16:46:07 +08:00
mindspore-ci-bot ab9cec0531 !7083 Support Categorical distribution
Merge pull request !7083 from XunDeng/categorical
2020-10-09 09:47:40 +08:00
Xun Deng 05a0dac125 add logistic distribution 2020-10-08 10:23:50 -04:00
Xun Deng 877b561e77 added categorical distribution 2020-10-07 11:49:44 -04:00
wanyiming 4e93413c5a add_BCELoss 2020-09-29 10:23:38 +08:00
Xun Deng ea57699ed1 added raise_not_implemented_error in distribution 2020-09-25 17:15:04 -04:00
peixu_ren 23ff21edd8 Added lognormal distribuition 2020-09-23 16:57:33 -04:00
guohongzilong a754dea90c delete SoftmaxCrossEntropyExpand 2020-09-20 21:17:24 +08:00
Xun Deng c64f6a0a2a move pp related tests cases to probability folder 2020-09-14 13:29:43 -04:00
mindspore-ci-bot d0e49c5cf8 !6192 Improve the functions of class SequentialCell and add examples
Merge pull request !6192 from lijiaqi/sequentialcell
2020-09-14 23:24:04 +08:00
Jiaqi 76cec24098 modify sequentialcell 2020-09-14 17:13:47 +08:00
bingyaweng 866a8a1178 modify path of ut and st of mdp 2020-09-14 11:23:55 +08:00
Xun Deng 67325d63b0 edited common_dtype and check_param dtype logic 2020-09-11 16:51:19 -04:00
mindspore-ci-bot dd215f4080 !5735 delete seed0 and seed1
Merge pull request !5735 from caozhou/delete_seed
2020-09-11 09:58:56 +08:00
mindspore-ci-bot eedbbb3649 !5958 Modify interface for function and remove duplicated def
Merge pull request !5958 from lilei/modify_bug
2020-09-10 21:22:32 +08:00
lilei 71adabd944 modify_bug 2020-09-09 18:20:32 +08:00
Wei Luning 249382899b fix bug in cell pickle and copy 2020-09-09 15:33:56 +08:00
caozhou 6509fa9023 delete seed0 and seed1 in Dropout 2020-09-08 10:51:12 +08:00
buxue 4168c51f0d add check tensor when graph output is a const or parameter 2020-08-31 17:17:24 +08:00
Wei Luning 4cc8342b5b fix bug in Parameter init_data 2020-08-26 22:15:22 +08:00
panyifeng 1a54785fe2 remove name arg from gradoperation 2020-08-26 11:16:57 +08:00
mindspore-ci-bot abe6b82138 !5011 remove global grad ops
Merge pull request !5011 from riemann_penn/remove_global_grad_ops
2020-08-25 09:47:55 +08:00
panyifeng 637e812347 remove global grad ops 2020-08-24 16:50:09 +08:00
Yi Huaijie 394be43492 raise RuntimeError when set different mode after Initializer created 2020-08-24 14:08:09 +08:00
Zichun Ye 9e7d6e2397 fix bernoulli prob formula; fix some other minor bugs
update threshold of softplus computation

support fp for bernoulli and geometric distribution
2020-08-23 17:49:09 -04:00
peixu_ren 1c8eb9b15d Fix errors in log calculation logics 2020-08-21 21:28:10 -04:00
Wei Luning 77dcdd89ec support parameter updata with implicit type conversion 2020-08-21 15:24:57 +08:00
Yi Huaijie 89a4ebf8a1 parallel mode must be set before create an initializer 2020-08-20 19:20:46 +08:00
Wei Luning d18ce95714 * add support to update by scalar* fix update error for by Initializer when slice_shape is* add ut for compute and update 2020-08-14 16:35:28 +08:00
mindspore-ci-bot 93f60269c3 !4369 Added distribution_specific_args checking to some functions and fixed minor issues in docs
Merge pull request !4369 from XunDeng/pp_poc_v3
2020-08-14 09:33:23 +08:00
mindspore-ci-bot 1b63c76c61 !4194 Add infer and dpn to nn/probability
Merge pull request !4194 from zhangxinfeng3/master
2020-08-13 17:32:50 +08:00
zhangxinfeng3 b16b71b9e8 add infer and dpn 2020-08-13 11:46:07 +08:00
Xun Deng c0a3b51bb8 fixed minor issues in docs, updated parameter checking in some functions in distributions 2020-08-12 22:05:58 -04:00
mindspore-ci-bot b120cbcfb4 !4249 Add parameter checking in distributions
Merge pull request !4249 from XunDeng/pp_poc_v3
2020-08-11 14:16:29 +08:00
Xun Deng be6db4a6fe add scalar affine and softplus bijector 2020-08-10 16:07:54 -04:00
Xun Deng 415dad3adb added some parameter checking 2020-08-10 15:46:24 -04:00
Wei Luning d4d6457ea7 init parameter data by defaultOnly keep no data as MetaTensor in auto parallel mode 2020-08-06 19:52:31 +08:00
peixu_ren b9c8c0b439 Added Bijector TransformDistribution base classes and two instances: power and exp bijectors 2020-08-05 00:03:50 -04:00
mindspore-ci-bot af9398b39a !3756 Change distribution api
Merge pull request !3756 from XunDeng/pp_poc_v3
2020-08-04 11:34:46 +08:00
Wei Luning a05c38bb63 make python Parameter inherit from Tensor 2020-08-03 09:12:24 +08:00
Xun Deng e87e1fc6bc changed distribution api 2020-07-31 12:41:06 -04:00
Xun Deng e94d91ba95 remove import probability from nn/__init__.py 2020-07-29 15:08:58 -04:00
peixu_ren 292f2de0cf Add sampling functions in exponential, geometric and uniform distributions 2020-07-27 17:07:14 -04:00
Xun Deng 7bb83067d0 added exponential uniform geometric distribution
added cdf, logcdf, survival, logsurvival, entropy, mode, cross_entropy wrapper
2020-07-27 17:03:37 -04:00
He Wei a6db29b11b Fix a bug for Parameter
1. Parameter's init_data() should have no effect if default_input already set;
2. This bug is introduced by 'decouple ParamValue from python';
3. An unit test case is added to ensure the right init_data() behavior.
2020-07-27 15:32:08 +08:00
wangnan39@huawei.com 082433183d uniform learning_rate behavior of optimizers 2020-07-20 21:09:20 +08:00
Wei Luning 88e864a4a3 remove loop can unroll flag, clean some python usage 2020-07-18 17:41:34 +08:00
wangnan39@huawei.com 86889c59cb optimizer adapt IndexedSlices 2020-07-17 15:57:50 +08:00
panyifeng 44e74ad5aa Apply indexed_slices 2020-07-13 15:36:25 +08:00
leilei_snow 9b21420b3e update SSIM loss, add MSSSIM loss feature; add their ut testcases. 2020-07-10 11:11:48 +08:00
peixu_ren bef1fc7f19 add sample functions in normal and bermoulli distributions 2020-07-07 18:13:58 -04:00
Xun Deng 0aa26c1815 add high level abstract class Distribution and two example class:
Bernoulli and Normal
2020-07-07 17:29:42 -04:00
panyifeng d6635bbbe2 Add IndexedSlices 2020-06-30 17:38:24 +08:00
wangnan39@huawei.com 172728a6a6 support weight decay for sparse optimizer 2020-06-28 17:49:03 +08:00
zhaozhenlong 71d33b087e limit ssim input img type to fp32 and fp16 2020-06-28 15:35:07 +08:00
Ziyan 41ddc153a6 modify lars interface 2020-06-23 11:23:28 +08:00
panyifeng 3c2057297e support multi param for tuple grad 2020-06-20 08:39:42 +08:00
lilei 497067d7b2 add sparse proximal ada grad optimizer 2020-06-19 09:56:28 +08:00
simson ca988e9e69 fix the condition when activation name is 0 2020-06-18 09:14:45 +08:00
liuxiao aa73abc2f7 Add image.CentralCrop 2020-06-16 16:10:17 +08:00
mindspore-ci-bot 2d84011504 !2071 optimizer support loss scale for sparse situation
Merge pull request !2071 from wangnan39/support_loss_scale_for_sparse_optimizer
2020-06-16 15:01:49 +08:00
wangnan39@huawei.com d4e3d69f37 support loss scale for sparse situation 2020-06-15 22:17:53 +08:00
kingfo 9708e58259 fix TupleToArray & Cast operator issue 2020-06-15 14:39:10 +08:00
mindspore-ci-bot 3536185f5b !2007 add lazy adam optimizer and support sparse adam&ftrl for cpu backend
Merge pull request !2007 from wangnan39/add_lazy_adam_optim_and_support_sparse_admm_for_cpu_backend
2020-06-12 17:22:03 +08:00
wangnan39@huawei.com 4042f16ce4 add lazy adam optim and support sparse adam & ftrl for cpu backend 2020-06-12 16:06:11 +08:00
mindspore-ci-bot 5c7cb7bd71 !2023 add op CosineEmbeddingLoss
Merge pull request !2023 from zhaozhenlong/op/cosine-embedding-loss-open
2020-06-12 11:09:55 +08:00
zhaozhenlong 19c5921c06 composed op CosineEmbeddingLoss 2020-06-11 21:28:35 +08:00
mindspore-ci-bot f859dfecc8 !1920 SupportPynativeIndexing
Merge pull request !1920 from amongo/SupportPynativeIndexing
2020-06-11 21:11:36 +08:00
huangdongrun 9522f59b87 support for tensor indexing in pynative
support tensor slice using constexpr

remove tensorslice metagraph

add pynative testcases
2020-06-11 19:14:22 +08:00
mindspore-ci-bot 9dfb1011fe !1854 add SparseApplyAdam and SparseApplyLazyAdam ops
Merge pull request !1854 from wangnan39/add_ops_sparse_adam_and_sparse_lazy_adam
2020-06-11 16:35:03 +08:00
wangnan39@huawei.com de21dbdaef add ops SparseApplyAdam and SparseApplyLazyAdam 2020-06-11 15:50:28 +08:00
mindspore-ci-bot 3b8edd5a5b !1918 sparse grad for gatherv2
Merge pull request !1918 from riemann_penn/sparse_grad_for_gatherv2
2020-06-11 14:11:49 +08:00
panyifeng acaa66a738 sparse grad for gatherv2 2020-06-11 12:00:53 +08:00
lilei 36d9e353a5 add proximal_ada_grad optimizer 2020-06-10 09:21:36 +08:00
mindspore-ci-bot c82a8bf483 !1678 modify print
Merge pull request !1678 from jinyaohui/print
2020-06-08 11:20:53 +08:00