Commit Graph

234 Commits

Author SHA1 Message Date
huangbingjian ad8f73f32b set default context mode to GRAPH_MODE 2021-06-09 14:40:49 +08:00
huanghui 29f632613f optimize log 2021-06-04 12:32:44 +08:00
huanghui 5acf3c8ade [dfx]optimize exception info print 2021-05-31 14:57:29 +08:00
wangnan39@huawei.com 2761776699 add check for optimizer parameters 2021-05-17 22:23:03 +08:00
jiaqi cdb7330818 diceloss bug 2021-03-09 16:23:45 +08:00
Zhang Qinghua df866f7248 Add TopoSort Rhs First attribute for special CNode, such as Depend CNode with isolated nodes. 2021-03-06 12:39:36 +08:00
Zhang Qinghua 8b8c59f01e Optimize the compile performance in Parser, FG, Manager and Renormalize:
---
Remove the routine of handling isolated nodes in Renormalize.
Add isolated nodes from Parser&Resolver.
Modify isolated nodes handling in FG&Manager.
Optimize the renormalize routines.
Other optimizations.
2021-03-04 16:01:54 +08:00
Jiaqi 112b8488c5 add rmse loss 2021-02-25 17:03:07 +08:00
Jiaqi fd1a4726b7 add focal loss 2021-02-22 19:33:26 +08:00
Jiaqi 952e245000 add multclass diceloss 2021-02-19 15:43:30 +08:00
He Wei 7d9a783993 [auto-monad] Support side-effects by auto-monad
The basic idea is: exploits data dependency to control the execution order
of side-effect operations, and keep the semantics of ANF unchanged.

The ControlDepend primitive is removed and there are two primitives added:

1. UpdateState:
```
  a = Assign(para, value)
```
became:
```
  a = Assign(para, value, u)
  u = UpdateState(u, a)
```

2. Load:
```
  x = Add(para, value)
```
became:
```
  p = Load(para, u)
  x = Add(p, value)
  u = UpdateState(u, p)
```
2021-02-08 09:01:15 +08:00
wangshuide2020 30f99f2722 add raises description for BCELoss, ReLU, BatchNorm1d, etc. operators. 2021-02-02 20:52:00 +08:00
Jiaqi 804ef79c18 modify dice and diceloss 2021-01-29 15:10:05 +08:00
mindspore-ci-bot 775d71f9c1 !11408 Update PP example
From: @zichun_ye
Reviewed-by: @wang_zi_dong,@sunnybeike
Signed-off-by:
2021-01-20 09:17:23 +08:00
Zichun Ye ca316f4422 update doc example in probability
fix typo in probability module

fix pylint in msp
2021-01-19 11:51:43 -05:00
Jiaqi 87ecd44f67 develop dice loss 2021-01-16 15:54:06 +08:00
lilei b858097ae4 modify MetaTensor and Tensor 2021-01-04 20:58:34 +08:00
huangxinjing dd0da1542d Add input check 2020-12-18 19:54:49 +08:00
buxue aeeef7607a remove the 'raise' in construct of Cell 2020-12-17 10:54:42 +08:00
l00591931 130c61cfc0 change name from interpolate to resizeBilinear 2020-12-10 11:46:40 +08:00
wangnan39@huawei.com 0fe9e2e4cb support import dynamic_lr from nn 2020-12-09 17:47:52 +08:00
mindspore-ci-bot 231fccf66c !9600 Add Adagrad Optimizer
From: @zyx5256
Reviewed-by: @liangchenghui,@kingxian
Signed-off-by: @liangchenghui
2020-12-08 18:29:18 +08:00
zhuyuxiao 37bebc751b add adagrad optim 2020-12-08 09:38:15 +08:00
mindspore-ci-bot e6ec9be6c2 !9386 l1_regularizer开发
From: @dangjiaqi1
Reviewed-by: 
Signed-off-by:
2020-12-07 21:58:58 +08:00
“dangjiaqi1” 39948670dd new update basic.py which add class L1Regularizer(Cell). new add test_l1_regularizer.py. new add test_l1_regularizer.py 2020-12-07 20:08:35 +08:00
Xun Deng 4ef9e9e57f fix minor issues in distribution classes 2020-12-03 14:47:08 -05:00
peixu_ren 37d40bc495 Add Beta distribution 2020-11-27 17:07:54 -05:00
peixu_ren 93d4ef428f Add Gamma distribution 2020-11-25 09:40:46 -05:00
peixu_ren 01f5da0a14 Add Poisson distribution 2020-11-24 11:55:39 -05:00
mindspore-ci-bot 7f725b93a3 !8234 Remove expm1_generic and log1p_generic from PP utils
From: @peixu_ren
Reviewed-by: 
Signed-off-by:
2020-11-23 09:56:07 +08:00
mindspore-ci-bot e3371a01d5 !8751 Fix minor bugs in bijector and distribution
From: @shallydeng
Reviewed-by: @zichun_ye,@sunnybeike
Signed-off-by:
2020-11-23 08:50:57 +08:00
l00591931 05e26f4739 Add nn.interpolate() 2020-11-20 10:00:47 +08:00
mindspore-ci-bot fa2185b8ef !8661 Add nn.Tril() and nn.Triu()
From: @liangzhibo
Reviewed-by: 
Signed-off-by:
2020-11-19 16:34:32 +08:00
l00591931 e1dba1337c Add nn.Tril function 2020-11-19 10:31:30 +08:00
Xun Deng b5e05472ce fix minor bugs in bijector and distribution utils, fix docs issues 2020-11-18 21:13:47 -05:00
wangnan39@huawei.com ab811fca8f add AdamOffload optimizer 2020-11-18 16:13:47 +08:00
peixu_ren 65d50861ec Remove expm1_generic and log1p_generic from PP utils 2020-11-16 16:12:13 -05:00
Xun Deng 1a68ccb40b added Cauchy distribution 2020-11-11 22:36:34 -05:00
Xun Deng fb0263f869 redesigned bijector classes, changed bacth_shape calculation in transformed distribution and upgraded dtype logic of bijector class 2020-11-03 15:28:45 -05:00
Yi Huaijie da29f232c6 fix CI random fails 2020-11-02 16:28:28 +08:00
Xun Deng d4df6f82ea support get_dist_args 2020-10-27 16:17:38 -04:00
Xun Deng 5ffc16c6db renamed test_invert_bijector 2020-10-26 10:51:07 -04:00
mindspore-ci-bot 1795840436 !7581 Extension interface for dense
Merge pull request !7581 from lilei/modify_bug
2020-10-23 10:40:42 +08:00
lilei 127f70ce40 Extension interface for dense 2020-10-22 17:58:24 +08:00
Xun Deng ce170b2241 added Gumbel distribution 2020-10-20 10:26:04 -04:00
mindspore-ci-bot 620d8b99b6 !6760 sparse optimizer
Merge pull request !6760 from lijiaqi/sparse_optimizer
2020-10-20 20:19:06 +08:00
Jiaqi a30ccea62c sparse optimizer 2020-10-20 17:56:45 +08:00
mindspore-ci-bot 3fd54fd58f !7361 Check whether the network args are tensors in the compile phase
Merge pull request !7361 from YuJianfeng/master
2020-10-19 14:32:15 +08:00
yujianfeng 18a76ff3c5 Check whether the network args are tensors in the compile phase 2020-10-19 11:46:10 +08:00
chenzomi acadb694aa [ME] delete reduant function in check_parameter 2020-10-16 16:22:28 +08:00
chenzomi 5b769dfb20 [ME] Bug fix 2020-10-16 13:01:34 +08:00
mindspore-ci-bot c967bf6846 !7339 fix for se-resnet50 accurancy
Merge pull request !7339 from qujianwei/master
2020-10-15 19:50:16 +08:00
Xun Deng f2e8e143be added gumbel_cdf and invert bijectors 2020-10-13 15:41:43 -04:00
mindspore-ci-bot 55e369a125 !7144 [ME] change `check_integer` to format `check_positive_int` and `check_integeter`
Merge pull request !7144 from chenzhongming/zomi_master
2020-10-10 14:14:38 +08:00
chenzomi d471d32e87 [ME] change `check_integer` to format `check_positive_int` and `check_integeter` 2020-10-10 12:08:10 +08:00
mindspore-ci-bot 3d21c80e3b !7110 [ME] delete check_bool and replace with Validate.check_bool
Merge pull request !7110 from chenzhongming/zomi_master
2020-10-10 11:56:39 +08:00
chenzomi d4e8e94981 [ME] delete check_bool and replace with Validate.check_bool 2020-10-09 16:46:07 +08:00
mindspore-ci-bot ab9cec0531 !7083 Support Categorical distribution
Merge pull request !7083 from XunDeng/categorical
2020-10-09 09:47:40 +08:00
Xun Deng 05a0dac125 add logistic distribution 2020-10-08 10:23:50 -04:00
Xun Deng 877b561e77 added categorical distribution 2020-10-07 11:49:44 -04:00
wanyiming 4e93413c5a add_BCELoss 2020-09-29 10:23:38 +08:00
Xun Deng ea57699ed1 added raise_not_implemented_error in distribution 2020-09-25 17:15:04 -04:00
peixu_ren 23ff21edd8 Added lognormal distribuition 2020-09-23 16:57:33 -04:00
guohongzilong a754dea90c delete SoftmaxCrossEntropyExpand 2020-09-20 21:17:24 +08:00
Xun Deng c64f6a0a2a move pp related tests cases to probability folder 2020-09-14 13:29:43 -04:00
mindspore-ci-bot d0e49c5cf8 !6192 Improve the functions of class SequentialCell and add examples
Merge pull request !6192 from lijiaqi/sequentialcell
2020-09-14 23:24:04 +08:00
Jiaqi 76cec24098 modify sequentialcell 2020-09-14 17:13:47 +08:00
bingyaweng 866a8a1178 modify path of ut and st of mdp 2020-09-14 11:23:55 +08:00
Xun Deng 67325d63b0 edited common_dtype and check_param dtype logic 2020-09-11 16:51:19 -04:00
mindspore-ci-bot dd215f4080 !5735 delete seed0 and seed1
Merge pull request !5735 from caozhou/delete_seed
2020-09-11 09:58:56 +08:00
mindspore-ci-bot eedbbb3649 !5958 Modify interface for function and remove duplicated def
Merge pull request !5958 from lilei/modify_bug
2020-09-10 21:22:32 +08:00
lilei 71adabd944 modify_bug 2020-09-09 18:20:32 +08:00
Wei Luning 249382899b fix bug in cell pickle and copy 2020-09-09 15:33:56 +08:00
caozhou 6509fa9023 delete seed0 and seed1 in Dropout 2020-09-08 10:51:12 +08:00
buxue 4168c51f0d add check tensor when graph output is a const or parameter 2020-08-31 17:17:24 +08:00
Wei Luning 4cc8342b5b fix bug in Parameter init_data 2020-08-26 22:15:22 +08:00
panyifeng 1a54785fe2 remove name arg from gradoperation 2020-08-26 11:16:57 +08:00
mindspore-ci-bot abe6b82138 !5011 remove global grad ops
Merge pull request !5011 from riemann_penn/remove_global_grad_ops
2020-08-25 09:47:55 +08:00
panyifeng 637e812347 remove global grad ops 2020-08-24 16:50:09 +08:00
Yi Huaijie 394be43492 raise RuntimeError when set different mode after Initializer created 2020-08-24 14:08:09 +08:00
Zichun Ye 9e7d6e2397 fix bernoulli prob formula; fix some other minor bugs
update threshold of softplus computation

support fp for bernoulli and geometric distribution
2020-08-23 17:49:09 -04:00
peixu_ren 1c8eb9b15d Fix errors in log calculation logics 2020-08-21 21:28:10 -04:00
Wei Luning 77dcdd89ec support parameter updata with implicit type conversion 2020-08-21 15:24:57 +08:00
Yi Huaijie 89a4ebf8a1 parallel mode must be set before create an initializer 2020-08-20 19:20:46 +08:00
Wei Luning d18ce95714 * add support to update by scalar* fix update error for by Initializer when slice_shape is* add ut for compute and update 2020-08-14 16:35:28 +08:00
mindspore-ci-bot 93f60269c3 !4369 Added distribution_specific_args checking to some functions and fixed minor issues in docs
Merge pull request !4369 from XunDeng/pp_poc_v3
2020-08-14 09:33:23 +08:00
mindspore-ci-bot 1b63c76c61 !4194 Add infer and dpn to nn/probability
Merge pull request !4194 from zhangxinfeng3/master
2020-08-13 17:32:50 +08:00
zhangxinfeng3 b16b71b9e8 add infer and dpn 2020-08-13 11:46:07 +08:00
Xun Deng c0a3b51bb8 fixed minor issues in docs, updated parameter checking in some functions in distributions 2020-08-12 22:05:58 -04:00
mindspore-ci-bot b120cbcfb4 !4249 Add parameter checking in distributions
Merge pull request !4249 from XunDeng/pp_poc_v3
2020-08-11 14:16:29 +08:00
Xun Deng be6db4a6fe add scalar affine and softplus bijector 2020-08-10 16:07:54 -04:00
Xun Deng 415dad3adb added some parameter checking 2020-08-10 15:46:24 -04:00
Wei Luning d4d6457ea7 init parameter data by defaultOnly keep no data as MetaTensor in auto parallel mode 2020-08-06 19:52:31 +08:00
peixu_ren b9c8c0b439 Added Bijector TransformDistribution base classes and two instances: power and exp bijectors 2020-08-05 00:03:50 -04:00
mindspore-ci-bot af9398b39a !3756 Change distribution api
Merge pull request !3756 from XunDeng/pp_poc_v3
2020-08-04 11:34:46 +08:00
Wei Luning a05c38bb63 make python Parameter inherit from Tensor 2020-08-03 09:12:24 +08:00
Xun Deng e87e1fc6bc changed distribution api 2020-07-31 12:41:06 -04:00
Xun Deng e94d91ba95 remove import probability from nn/__init__.py 2020-07-29 15:08:58 -04:00
peixu_ren 292f2de0cf Add sampling functions in exponential, geometric and uniform distributions 2020-07-27 17:07:14 -04:00
Xun Deng 7bb83067d0 added exponential uniform geometric distribution
added cdf, logcdf, survival, logsurvival, entropy, mode, cross_entropy wrapper
2020-07-27 17:03:37 -04:00