Commit Graph

3187 Commits

Author SHA1 Message Date
zetongzhao 4f199b548c deserialize and tests 2021-08-06 13:35:27 -04:00
yujianfeng cf4121126a Only replace the primal user with tuple_getitem once 2021-08-06 19:23:14 +08:00
i-robot d2ae09d891 !21437 Support ListComp and GeneratorExp in Graph Mode.
Merge pull request !21437 from 张清华/opt
2021-08-06 09:09:47 +00:00
i-robot 51a1ca61f2 !21357 [MD] fix SlicePatches when dealing with some special tensor.
Merge pull request !21357 from liyong126/fix_bug
2021-08-06 08:58:27 +00:00
i-robot 8a8851dc52 !18667 Remove redundant depend
Merge pull request !18667 from huangbingjian/remove_redundant_depend
2021-08-06 07:43:53 +00:00
SichongHao 3d2892b454 [feat][assistant][I3T91Y][I3T91Z]add new operator SoftMarginLoss and SoftMarginLossGrad 2021-08-06 15:13:13 +08:00
liyong 5fea72473c fix HW1 issue 2021-08-06 14:07:26 +08:00
Zhang Qinghua aef396f9f2 Support ListComp and GeneratorExp in Graph Mode. 2021-08-06 11:44:57 +08:00
ckczzj 9d9f33be88 [feat][assistant][I3J6VN] add new data operator flowers102 2021-08-06 10:55:12 +08:00
chenx2ovo aa45e2ebbc [feat] [assistant] [I3CEER] add op AmplitudeToDB 2021-08-06 10:07:29 +08:00
huangbingjian 53b31abf12 remove useless depend 2021-08-05 20:21:24 +08:00
Carry955 98be266585 [feat][assistant][I3J6TQ] add a new operator Angle 2021-08-04 19:41:00 -07:00
i-robot 680e40a43a !16453 [assistant][BassBiquadOp]
Merge pull request !16453 from StyleHang/BassBiquadOp
2021-08-04 10:02:34 +00:00
i-robot f4e07c0dce !17486 [assistant][ops] Add new dataset operator Flickr.
Merge pull request !17486 from Rainfor/wangkc
2021-08-04 08:52:21 +00:00
i-robot a83f8f6f5d !20284 Unify exception info with using the unsupported numpy method
Merge pull request !20284 from huanghui/numpy-in-graph-mode
2021-08-04 08:06:01 +00:00
i-robot d260f38936 !15722 [assistant][AdjustGamma]
Merge pull request !15722 from QingfengLi/adjust_gamma
2021-08-04 03:58:09 +00:00
li-qiyao ba326d76a8 [feat][assistant][I3J6TW] add new data operator BassBiquad 2021-08-03 19:40:12 -07:00
wangkc123 48f5fed1f8 [feat] [assistant] [I3CKEN] add new dataset operator Flickr 2021-08-04 10:20:43 +08:00
chenx2ovo 4191dde45f [feat][assistant][I3CEGM] add op adjust gamma 2021-08-04 02:32:13 +08:00
tongyue 08469e113a [feat][assistant][I3J6TV]add new audio operator BandrejectBiquad 2021-08-03 05:41:53 -07:00
i-robot 2c7b8e73df !16452 [assistant][BandpassBiquadOp]
Merge pull request !16452 from StyleHang/BandpassBiquadOp
2021-08-03 11:08:48 +00:00
i-robot a70b0f3bf4 !18260 [assistant][ops]New operator implementation, include HShrink and HShrinkGrad
Merge pull request !18260 from 张璇/hshrink
2021-08-03 11:00:11 +00:00
i-robot 93af13f332 !19979 dataset: modify some error msg
Merge pull request !19979 from ms_yan/err_msg
2021-08-03 08:53:30 +00:00
i-robot 0a3b4ff84b !21207 modify replace graph for conv2d
Merge pull request !21207 from yangzhenzhang/fix-bugs-for-conv2d
2021-08-03 08:48:37 +00:00
huanghui 3e17650172 Raise NotImplementedError when parsing the numpy methods, but not the numpy constant. 2021-08-03 14:33:22 +08:00
i-robot ef77050348 !18892 [assistant][ops] Add new dataset operator SBD.
Merge pull request !18892 from Rainfor/sbd
2021-08-03 03:33:00 +00:00
yangzhenzhang ef0361a449 fix bugs for conv2d 2021-08-03 10:48:05 +08:00
ms_yan 65870045bc modify some error msg 2021-08-03 09:16:28 +08:00
administrator 29d57a89fb [feat][assistant][I3TDRD]add new audio operator BandpassBiquad 2021-08-02 07:08:47 -07:00
i-robot a81fee280c !16458 [assistant][AllpassBiquadOp]
Merge pull request !16458 from StyleHang/AllpassBiquadOp
2021-08-02 08:40:06 +00:00
Xiaoda Zhang 4b4b3cdaf4 add reduceany operator and extend onehot to multi-dimensions 2021-08-02 08:53:43 +08:00
zhangjie b04036e13c [feat][assistant][I3PYD4] add new data operator HShrink and HShrinkGrad 2021-08-01 20:55:58 +08:00
danansheng accb87606a [feat][assistant][I3PYD4] add new data operator HShrink 2021-08-01 20:52:55 +08:00
Isaac b49e1acc3e [feat] [assistant] [I3J6TM] add new audio operator AllpassBiquad 2021-07-31 16:15:17 +08:00
i-robot 9301de1b54 !21098 fix bug
Merge pull request !21098 from shenwei41/fix_waring
2021-07-31 01:12:21 +00:00
shenwei41 e3385e2564 fix waring to master 2021-07-30 16:37:27 +08:00
i-robot 6e84bf0f0f !16449 [assistant][ops] Add new audio operator BandBiquad
Merge pull request !16449 from StyleHang/BandBiquadOp
2021-07-30 03:35:07 +00:00
liannai 5a341e7e27 [feat] [assistant] [I3J6TS] add new audio operator BandBiquad 2021-07-29 17:57:27 +08:00
huangxinjing 615d1a179d Add transformer layer 2021-07-29 11:10:43 +08:00
i-robot 9f296c58d6 !20960 [AutoParallel]Add replace graph for conv2d
Merge pull request !20960 from lichen/add_replace_graph_for_conv2d
2021-07-28 07:06:41 +00:00
lichenever a7f8024c29 add_replace_graph_for_conv2d 2021-07-28 11:02:21 +08:00
yao_yf dc7dc7d3fa dataset strategy set 2021-07-27 18:44:10 +08:00
i-robot b8901526b9 !20882 Fix GradOperation recursive call issues.
Merge pull request !20882 from 张清华/opt
2021-07-27 01:00:39 +00:00
Zhang Qinghua 8be269c1cc Fix GradOperation issues:
- Allow the J CNode used multiple as non-call input.
- Check recursive J FG including FV J CNode.
- Add grad functional api.
2021-07-26 20:47:49 +08:00
yangzhenzhang 80e5cc0e52 add parallel op for gatherd 2021-07-26 11:14:25 +08:00
i-robot c80098b261 !20712 [Auto parallel] Enable All2All when inferring redistribution ops
Merge pull request !20712 from Xiaoda/76-change-alltoall-redistribution
2021-07-24 07:07:16 +00:00
i-robot 26bfbf9124 !18282 [assistant][ops]New operator implementation, include HSigmoid and HSigmoidGrad
Merge pull request !18282 from 张璇/hsigmoid_grad
2021-07-24 06:22:46 +00:00
Xiaoda Zhang bb5d4212f7 enable All2All in infering redistribution ops 2021-07-24 09:09:01 +08:00
i-robot 1e1d7d5739 !20443 Add numpy-native ut/st
Merge pull request !20443 from 杨林枫/add_numpy_ut
2021-07-23 11:24:39 +00:00
wanglixin 33e93e296c [fix][assistant][I3PYD0] fix bug in the Ascend operator HSigmoid and HSigmoidGrad 2021-07-23 16:33:16 +08:00
wild-fox b6c575689d [feat][assistant][I3PYD0] add new Ascend operator HSigmoid 2021-07-23 16:20:51 +08:00
wanglixin a377ade89f [feat][assistant][I3PYD3] add new Ascend operator HSigmoidGrad 2021-07-23 16:20:51 +08:00
i-robot 0f8a21693b !18266 [assistant][ops]New operator implementation, include SoftShrink and SoftShrinkGrad
Merge pull request !18266 from 张璇/softshrink
2021-07-23 06:40:47 +00:00
i-robot 69a7ef8632 !20707 [AutoParallel]AutoParallel support control flow
Merge pull request !20707 from lichen/auto_parallel_support_control_flow
2021-07-23 06:22:12 +00:00
i-robot bcb49f10b4 !20702 Fix NumpySlicesDataset not accept NumPy as data
Merge pull request !20702 from xiaotianci/fix_numpy_slices
2021-07-23 03:31:29 +00:00
i-robot 7666b6e388 !20708 fix exception type to TypeError
Merge pull request !20708 from xychow/fix-exception-type
2021-07-23 02:48:49 +00:00
i-robot e8448f972b !20725 Support the tensor of string dtype.
Merge pull request !20725 from 张清华/opt
2021-07-23 02:12:48 +00:00
Zhang Qinghua f91c697efc Support the tensor of string dtype. 2021-07-22 19:05:37 +08:00
lichenever 3c7cfb7c08 auto_parallel_support_control_flow 2021-07-22 17:31:31 +08:00
Xiao Tianci 53c01c437d fix NumpySlicesDataset not accept numpy 2021-07-22 15:46:37 +08:00
wangrao124 463ca2434c add numpy-native ut/st test files 2021-07-22 14:47:00 +08:00
zhousiyi 9319eff958 change the error type from RuntimeError to TypeError 2021-07-22 06:38:12 +00:00
Lizxxy 5d00d482e4 [feat][assistant][I3PYDC] add new Ascend operator SoftShrinkGrad 2021-07-20 17:55:02 +08:00
zx be26e62080 [feat][assistant][I3PYDB] add new Ascend operator SoftShrink 2021-07-20 17:52:46 +08:00
i-robot a7d40fc220 !20520 [AutoParallel]Add op AllToAllv
Merge pull request !20520 from lichen/add_op_AllToAllv
2021-07-20 07:57:03 +00:00
i-robot ed4c9682b5 !20505 limit the scope of lift free variable
Merge pull request !20505 from xychow/limit-lift-scope
2021-07-20 06:10:17 +00:00
lichenever 8c1998fd6b add_op_AllToAllv 2021-07-20 10:49:28 +08:00
i-robot c9d3c1d346 !20411 enable optimizer parallel for inference
Merge pull request !20411 from gziyan/enable_opt_shard_predict
2021-07-20 01:37:06 +00:00
i-robot 6061194083 !20490 update check strategy for conv2d
Merge pull request !20490 from yangzhenzhang/update-check-strategy-for-conv2d
2021-07-20 01:23:08 +00:00
zhousiyi 597f29ea7d limit the lambda lift scope to the func_graph passed 2021-07-20 00:37:21 +00:00
zhousiyi b590f6d929 don't replace u with fprop_u in primal_graph and bprop_fg 2021-07-19 08:14:40 +00:00
yangzhenzhang b31cd27a08 update check strategy for conv2d 2021-07-19 15:03:26 +08:00
wangkc123 b381e0be9d [feat] [assistant] [I3CKER] add new dataset operator SBD 2021-07-17 21:02:30 +08:00
Ziyan 1c9166e0a6 remove restriction for opt shard in inference 2021-07-16 17:16:12 +08:00
Xiaoda Zhang 04381273b3 Add the sharding propagation function:
1) users configure sharding strategies for operators;
2) framework will propagate the strategies from configured-ops to
non-configured ops using BFS;
3) the propagation goal is to minimize redistribution communication
cost;
2021-07-14 10:54:18 +08:00
i-robot ea440db85e !18488 Remove Parameter Check in PyNative mode
Merge pull request !18488 from caifubi/master-pynative-no-parameter
2021-07-05 12:05:46 +00:00
i-robot 8508c9eb45 !18179 [MD] add slice patches op in c++ and python
Merge pull request !18179 from liyong126/slice_patches_op
2021-07-05 07:04:45 +00:00
i-robot 4a8225eaf4 !19160 Fix parameter check of Rotate and GaussianBlur API
Merge pull request !19160 from xiaotianci/fix_rotate_and_gaussian_blur
2021-07-05 06:30:46 +00:00
i-robot b93907fdca !19246 Change Loss to LossBase
Merge pull request !19246 from chenhaozhe/change-loss-base
2021-07-05 01:24:23 +00:00
liyong 9a1de0af65 add slice patches in python and c++ 2021-07-05 09:16:47 +08:00
zhousiyi a5b4e7bbf8 lift fv before grad except weight, then convert
switch(cond, partial(g1, xs), partial(g2, ys))(Zs)
 to
 switch(cond, g1, g2)(Xs, Ys, Zs)

 switch_layer(index, make_tuple(partial(g1, xs), partial(g2, ys)))(Zs)
 to
 switch_layer(index, make_tuple(g1, g2))(Xs, Ys, Zs)

put Zs at last when unifyparameter as it may have u-monad or io-monad

use joined args other than broadened one as some extra parameter which is not a parameter of while_header can be add to while_body

inline fprop_switch forcely

reorder the parameter if one of the parameter is Monad when incorporate call

incorporate switch tuple_getitem if item 0 of tuple is EnvInstance or
item 1 of tuple is bprop function

addn with shape() and shape(1)

remove context_ from FuncGraphEvaluator to make it re-entry able to resolve evaluator stuck issue because of re-entry of the same FuncGraphEvaluator
2021-07-03 00:03:37 +08:00
chenhaozhe 086a871975 Change Loss to LossBase 2021-07-02 16:41:02 +08:00
Xiao Tianci 8cdd0d8d90 fix param check for Rotate and GaussianBlur 2021-07-01 20:31:33 +08:00
i-robot 8102d68b8b !18420 Give concreted error when mappable dataset lack __len__ method
Merge pull request !18420 from luoyang/API-check-pybind-name
2021-06-29 07:48:03 +00:00
YangLuo 17c121b087 Give concreted error when mappable dataset lack __len__ method 2021-06-29 11:13:12 +08:00
lichenever db8850a4a3 pipeline_support_predict_master 2021-06-26 09:25:59 +08:00
i-robot 905cba5ae0 !18788 Fix cache_admin stderr message and TFRecord get_dataset_size() when cached
Merge pull request !18788 from lixiachen/fix_stderr_msg
2021-06-24 17:52:10 +00:00
i-robot 708e56f659 !17899 Fix compile cache bug for resent50
Merge pull request !17899 from LiangZhibo/cache
2021-06-24 13:29:58 +00:00
Ziyan be1f5a43d7 opt shard fit micro batch 2021-06-24 14:52:19 +08:00
l00591931 8ae5d7cc84 Fix compile cache for resnet50 2021-06-24 14:36:24 +08:00
yangzhenzhang 69acf757d0 add parallel op for conv2d backprop input 2021-06-24 10:01:49 +08:00
Lixia Chen 1f03b16e0e Fix cache_admin server start stderr output
Fix TFRecord get_dataset_size() when cached
2021-06-23 18:32:54 -04:00
Harshvardhan Gupta 6845a16b44 fix coredump with large max_rowsize and add arg validations 2021-06-23 09:31:11 -04:00
YangLuo 4e9f6d54f7 update cpp api & doc 2021-06-23 11:14:52 +08:00
i-robot dca5504fd4 !15672 [assistant][RGB2BGR]
Merge pull request !15672 from QingfengLi/rgb2bgr
2021-06-22 12:48:04 +00:00
chenx2ovo 4b98099dcb [feat][assistant][I3CEGQ] add op rgb2bgr 2021-06-21 16:16:50 +08:00
yangzhenzhang 24370b5613 add parallel op for maxpool 2021-06-21 09:00:56 +08:00
i-robot f6cda391a9 !18487 remove the redundant code, add docstring of operator init and add default valuefor args.
Merge pull request !18487 from wangshuide/wsd_master_warn
2021-06-18 09:38:26 +00:00
i-robot ec999d3fa5 !18477 Modify the error message of abstract join
Merge pull request !18477 from huangbingjian/abstract_join
2021-06-18 09:10:29 +00:00
huangbingjian d695554ae5 modify the error message of abstract join 2021-06-18 14:12:10 +08:00
i-robot ff3ad7428a !18413 add parallel op for batch norm
Merge pull request !18413 from yangzhenzhang/add-parallel-op-for-batchnorm
2021-06-18 03:08:07 +00:00
caifubi 95695711d7 Remove PyNative Parameter Check 2021-06-18 09:46:27 +08:00
i-robot ab3259c43a !18292 MD Profiling UT: Check CPU util file. Add sequential pipeline UTs
Merge pull request !18292 from cathwong/ckw_mon_py_analyze_ut4
2021-06-17 21:47:10 +08:00
wangshuide2020 185ddbbe66 remove the redundant code, add docstring of operator init and add default value for args. 2021-06-17 20:29:52 +08:00
yangzhenzhang af0d28de48 add parallel op for batchnorm 2021-06-17 15:43:24 +08:00
liyong 2989a5a23b fix some bugs 2021-06-17 11:56:10 +08:00
Cathy Wong c37eb350f6 MD Profiling UT: Check CPU util file. Add sequential pipeline UTs 2021-06-16 15:30:59 -04:00
i-robot 7ff63a8e70 !17894 Add support for mindir encryption
Merge pull request !17894 from liuluobin/master
2021-06-15 15:15:40 +08:00
i-robot 85d860e6a2 !16457 [AutoParallel]pipeline_split_adapt_master
Merge pull request !16457 from lichen/pipeline_split_adapt_master
2021-06-11 11:37:40 +08:00
liuluobin 5b9b46224b Add encryption support for mindir 2021-06-11 09:33:45 +08:00
i-robot 21513404c4 !17082 set default context mode to GRAPH_MODE
Merge pull request !17082 from huangbingjian/change_context_mode
2021-06-10 21:21:46 +08:00
lichenever db5d508356 pipeline_split_adapt_master 2021-06-10 20:17:33 +08:00
i-robot dc9720cbb2 !17999 add parallel operator for conv2d
Merge pull request !17999 from yangzhenzhang/add-parallel-operator-for-conv2d
2021-06-10 20:05:45 +08:00
i-robot 62a165a3a2 !16917 Add Crop Python API for CV data processing
Merge pull request !16917 from xiaotianci/crop
2021-06-10 17:16:04 +08:00
i-robot c293f06b27 !17373 add docs, user-example and assertion for rearrange_inputs
Merge pull request !17373 from zhiqwang/rearrange-inputs-docs
2021-06-10 16:17:23 +08:00
yangzhenzhang 7a40741048 add parallel operator for conv2d 2021-06-10 14:58:51 +08:00
i-robot 3a13dde14d !17761 add save ckpt info
Merge pull request !17761 from changzherui/add_ckpt_info
2021-06-10 11:01:18 +08:00
i-robot b79400296a !17959 fix optimizer weight shard config
Merge pull request !17959 from gziyan/add_optimizer_weight_shard_config
2021-06-10 10:49:17 +08:00
Xiao Tianci a54e65a7ad add Crop Python API 2021-06-10 09:46:57 +08:00
i-robot e60f5f12f5 !17836 Add Rotate API for CV data processing
Merge pull request !17836 from xiaotianci/rotate
2021-06-10 09:29:18 +08:00
changzherui 7a05132ed4 add ckpt save info 2021-06-09 22:42:27 +08:00
Cathy Wong a8de1327d9 MD Profiling Analyze: Add class BottleneckAnalyzer 2021-06-09 09:24:32 -04:00
zhiqiang f43d720eb0 Add docs and user-example for rearrange_inputs 2021-06-09 04:19:32 -04:00
huangbingjian ad8f73f32b set default context mode to GRAPH_MODE 2021-06-09 14:40:49 +08:00
i-robot 50f11d5439 !17503 dataset: enhance the expression of error msg
Merge pull request !17503 from ms_yan/log_modify
2021-06-08 22:25:04 +08:00
Xiao Tianci 9c4c1c6a77 add Rotate Python API 2021-06-08 22:19:15 +08:00
i-robot 3a63a66d64 !17807 MD Profiling UT: Add MD Analyze UT for MinddataProfilingAnalyzer
Merge pull request !17807 from cathwong/ckw_mon_py_analyze_ut3
2021-06-08 21:52:55 +08:00
ms_yan be65ebcb28 complete dataset log 2021-06-08 16:45:47 +08:00
mindspore-ci-bot 8934e4a513 !17879 dynamic min max shape phase 2
From: @luoyang42
Reviewed-by: @liucunwei,@jonyguo
Signed-off-by: @liucunwei
2021-06-08 14:49:13 +08:00
Ziyan 95ac0f6d58 fix optimizer weight shard config 2021-06-08 10:44:17 +08:00
Cathy Wong b7342efe12 MD Profiling UT: Add MD Analyze UT. Add more pipeline profiling UTs. 2021-06-07 11:00:34 -04:00
luoyang dad289c679 dynamic min max shape phase 2 2021-06-07 20:06:26 +08:00
Zhenglong Li 2c7d1bf603 Implement new gnn feature 2021-06-07 10:20:06 +08:00
mindspore-ci-bot e5a189a4f0 !17520 Optimize exception info when compile net failed
From: @irmo
Reviewed-by: @ginfung,@zh_qh
Signed-off-by: @zh_qh
2021-06-05 12:04:28 +08:00
mindspore-ci-bot e19e14295a !17773 adapt offline debugger to new dump, sync support for iteration ranges, GPU default dump mode correction
From: @john_tzanakakis
Reviewed-by: @nsyca,@mikef
Signed-off-by: @mikef
2021-06-05 02:46:50 +08:00
John Tzanakakis 7d460de8b4 adapt offline debuger to new dump, sync support for iteration ranges, GPU default dump mode correction 2021-06-04 08:38:50 -04:00
mindspore-ci-bot 7d9bf65654 !16755 support list add list in net in GraphMode.
From: @fenglovebei
Reviewed-by: @zh_qh
Signed-off-by: @zh_qh
2021-06-04 16:37:40 +08:00
huanghui 29f632613f optimize log 2021-06-04 12:32:44 +08:00
mindspore-ci-bot 97989c3bbc !17669 Substitute _Loss for Loss
From: @c_34
Reviewed-by: @guoqi1024,@liangchenghui
Signed-off-by: @guoqi1024,@liangchenghui
2021-06-04 10:20:00 +08:00
mindspore-ci-bot a3f2b92839 !17638 modify vgg16 network for clould
From: @zhanghuiyao
Reviewed-by: @c_34,@wuxuejian
Signed-off-by: @c_34
2021-06-04 09:21:30 +08:00
fenglovebei 76b884dea9 list add list 2021-06-03 21:16:30 +08:00
chenhaozhe 9da8534396 change _Loss to Loss 2021-06-03 15:26:59 +08:00
zhanghuiyao 36ec89656a modify vgg16 network for clould 2021-06-03 11:39:27 +08:00
mindspore-ci-bot b52f9ddb08 !17060 Add HorizontalFlip and VerticalFlip for CV data processing
From: @tiancixiao
Reviewed-by: @liucunwei
Signed-off-by: @liucunwei
2021-06-02 17:48:28 +08:00
mindspore-ci-bot c4757f0692 !17461 MD Profiling Analyze: Handle cpu util with missing ops. Enhance UTs.
From: @cathwong
Reviewed-by: @robingrosman
Signed-off-by: @robingrosman
2021-06-02 11:12:59 +08:00
mindspore-ci-bot c77e7de1dc !17313 fix static check
From: @jiang-shuqiang
Reviewed-by: @yelihua,@ouwenchang
Signed-off-by: @ouwenchang
2021-06-02 08:50:37 +08:00
mindspore-ci-bot ae2e7c1288 !17541 Fix MD Cache code check warnings [master]
From: @lixiachen
Reviewed-by: @pandoublefeng,@robingrosman
Signed-off-by: @robingrosman
2021-06-02 04:53:54 +08:00
Lixia Chen 8c1b561149 Fix cache code check warnings 2021-06-01 10:02:38 -04:00
mindspore-ci-bot a92a450881 !17383 Optimize exception info print
From: @irmo
Reviewed-by: @zh_qh,@ginfung,@ginfung
Signed-off-by: @zh_qh
2021-06-01 17:43:24 +08:00
Cathy Wong f8beb933ad MD Profiling Analyze: Handle cpu util with missing ops. Enhance UTs. 2021-05-31 20:33:19 -04:00
mindspore-ci-bot 4338e4abac !17374 files_need_cleanup report fixes to master
From: @hfarahat
Reviewed-by: @pandoublefeng,@robingrosman
Signed-off-by: @robingrosman
2021-06-01 05:21:18 +08:00
jiangshuqiang 6154f957fb fix static check 2021-05-31 16:47:21 +08:00
Xiao Tianci 9c74d55a49 add HorizontalFlip and VerticalFlip APIs 2021-05-31 15:55:21 +08:00
huanghui 5acf3c8ade [dfx]optimize exception info print 2021-05-31 14:57:29 +08:00
mindspore-ci-bot 8c1e7ce231 !16345 [DFX]Optimize exception log
From: @irmo
Reviewed-by: 
Signed-off-by:
2021-05-31 09:22:48 +08:00
mindspore-ci-bot 04341b1dbc !17076 fix log error for pynative mode
From: @chujinjin
Reviewed-by: @zhoufeng54,@kisnwang
Signed-off-by: @kisnwang
2021-05-31 09:22:29 +08:00
hesham 3a9695313b files_need_cleanup fixes 2021-05-30 15:44:08 -04:00
huanghui 0610a8d99c 9fdc0035a0 2021-05-29 10:31:23 +08:00
mindspore-ci-bot 1c8fda25ef !16478 handle load op in step parallel
From: @gong_zi_yan
Reviewed-by: @yangzhenzhang,@stsuteng
Signed-off-by: @stsuteng
2021-05-29 09:32:35 +08:00
mindspore-ci-bot b45b63fc58 !17239 add parallel gathernd test case
From: @hanyang001
Reviewed-by: @stsuteng,@yangzhenzhang
Signed-off-by: @stsuteng
2021-05-29 09:11:25 +08:00
mindspore-ci-bot 5e87097d15 !17240 add parallel layernorm test case
From: @hanyang001
Reviewed-by: @stsuteng,@yangzhenzhang
Signed-off-by: @stsuteng
2021-05-29 09:11:08 +08:00
Wan Hanyang c51dff2634 add parallel gathernd test case 2021-05-28 17:21:11 +08:00
Wan Hanyang 3ce521d78f add parallel layernorm test case 2021-05-28 17:20:04 +08:00
YangLuo ac319b3a79 Fix mindrecord UTs: files existed causes write exception 2021-05-28 15:13:48 +08:00
Ziyan 4b17493e52 handle load in step parallel 2021-05-28 09:16:40 +08:00
chujinjin 7fb3b5ea97 fix log error 2021-05-27 17:19:10 +08:00
mindspore-ci-bot 1e8868cecc !16727 handle duplicate code
From: @yangzhenzhang
Reviewed-by: @stsuteng,@jjfeing
Signed-off-by: @stsuteng
2021-05-26 10:58:54 +08:00
mindspore-ci-bot 2433778dac !15963 Support getting dynamic_min_max_shape of data
From: @luoyang42
Reviewed-by: 
Signed-off-by:
2021-05-26 09:41:02 +08:00
mindspore-ci-bot 730e211e52 !16702 Add GaussianBlur API for CV data processing
From: @tiancixiao
Reviewed-by: @liucunwei,@jonyguo
Signed-off-by: @liucunwei
2021-05-26 09:09:41 +08:00
mindspore-ci-bot d0978f709a !16167 CocoDataset add a new column according a new arg extra_metadata
From: @xiefangqi
Reviewed-by: 
Signed-off-by:
2021-05-25 19:55:41 +08:00
yangzhenzhang d711d98f07 clean duplicate code 2021-05-25 17:25:34 +08:00
mindspore-ci-bot e513786709 !16565 Bug in Normalize when num_channels > 128
From: @hfarahat
Reviewed-by: @robingrosman,@pandoublefeng
Signed-off-by: @robingrosman
2021-05-25 10:24:25 +08:00
xiefangqi 53891dbdf7 coco add img_id column 2021-05-24 17:19:58 +08:00
luoyang 13ef5b61f3 support getting dynamic_min_max_shape of data 2021-05-24 17:04:50 +08:00
Xiao Tianci 3f495bbae1 add GaussianBlur API 2021-05-24 16:27:05 +08:00
liuxiao93 1160088c8f support avgpool3d 2021-05-22 14:44:11 +08:00
yao_yf 732d13ccff parallel dropout support repeated compute 2021-05-20 19:42:13 +08:00
mindspore-ci-bot 05bbd1d8fa !16426 Change the permission of cache shared memory to 600 for security
From: @lixiachen
Reviewed-by: @robingrosman,@pandoublefeng
Signed-off-by: @robingrosman
2021-05-20 02:36:26 +08:00
mindspore-ci-bot c47356d77b !16502 check Optimizer parameters must be list
From: @wangnan39
Reviewed-by: @zh_qh,@kingxian
Signed-off-by: @zh_qh,@kingxian
2021-05-19 09:23:56 +08:00
mindspore-ci-bot 1cb2d31642 !16509 GNN dataset new feature for invalid edge or node id case
From: @lizhenglong1992
Reviewed-by: @liucunwei,@heleiwang
Signed-off-by: @liucunwei
2021-05-19 09:20:24 +08:00
hesham bc92011b5f Bug in Normalize when num_channels > 128 2021-05-18 12:23:11 -04:00
mindspore-ci-bot ed72a0d9c3 !16497 Add more accurate abstract join error information
From: @huangbingjian
Reviewed-by: @zh_qh,@ginfung
Signed-off-by: @zh_qh
2021-05-18 19:36:11 +08:00
Zhenglong Li 9284b6d6af Add special case returned value for get feature function 2021-05-18 15:53:01 +08:00
mindspore-ci-bot ec9fc5fb3b !16384 Fix python multiprocessing with shared memory for edge case
From: @robingrosman
Reviewed-by: @mikef
Signed-off-by: @mikef
2021-05-18 10:30:19 +08:00
Lixia Chen 8812111f94 change shared mem perm to 600 & minor other fixes 2021-05-17 17:19:55 -04:00
wangnan39@huawei.com 2761776699 add check for optimizer parameters 2021-05-17 22:23:03 +08:00
huangbingjian 81624dd501 add more error report to abstract join 2021-05-17 21:14:17 +08:00
mindspore-ci-bot 9d423638b3 !16466 Fix code check of python pass
From: @irmo
Reviewed-by: @ginfung,@zh_qh
Signed-off-by: @zh_qh
2021-05-17 21:00:16 +08:00
mindspore-ci-bot 601322356b !15638 VOCDataset need to add img_id for evaluation
From: @xiefangqi
Reviewed-by: @liucunwei
Signed-off-by: @liucunwei
2021-05-17 19:33:24 +08:00
xiefangqi 9b846c7873 voc add image_id column 2021-05-17 16:09:04 +08:00
huanghui 53e32077c1 fix code check 2021-05-17 11:20:35 +08:00
mindspore-ci-bot 8cfb5b8aea !16332 Add environment variable to enable recursive evaluate.
From: @zh_qh
Reviewed-by: @ginfung,@kingxian
Signed-off-by: @ginfung
2021-05-17 11:00:40 +08:00
RobinGrosman ca88d7d76a fix edge case and docstring in minddata multiprocessing shared memory code 2021-05-16 06:46:44 -07:00
Zhang Qinghua bea16101c3 Add environment variable to enable recursive evaluate. 2021-05-14 20:01:19 +08:00
jonyguo 9452142b50 enhance: enable shuffle infile / files when mindrecord 2021-05-14 17:41:18 +08:00
mindspore-ci-bot b5cddcb8cc !16036 Improve performance of multi-processing option for dataset
From: @robingrosman
Reviewed-by: 
Signed-off-by:
2021-05-13 01:41:16 +08:00
RobinGrosman 9a7d1fc034 Optimize multi-process in minddata by passing data via shared memory instead of multiprocessing.queue 2021-05-11 15:16:29 -07:00
mindspore-ci-bot 8c5680360d !16200 [Debugger] Fix empty result when reading non-existent tensor
From: @tina_mengting_zhang
Reviewed-by: @john_tzanakakis,@robingrosman
Signed-off-by: @john_tzanakakis
2021-05-12 03:08:00 +08:00
mindspore-ci-bot ebed057e72 !16196 If Imagefolder input directory is not right, will occur out of memory error
From: @xiefangqi
Reviewed-by: @ms_yan,@heleiwang,@jonyguo
Signed-off-by: @jonyguo
2021-05-11 17:36:28 +08:00
mindspore-ci-bot 4c71d9d1df !15675 add more tensor methods
From: @yanglf1121
Reviewed-by: @liangchenghui
Signed-off-by:
2021-05-11 14:32:29 +08:00
mindspore-ci-bot 9b4ff99305 !16158 modify check strategy for scatter update
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
2021-05-11 09:41:07 +08:00
mindspore-ci-bot d3a175e30f !16078 Modify Normalize to accept images with more than 3 channels
From: @hfarahat
Reviewed-by: @mikef,@robingrosman
Signed-off-by: @robingrosman
2021-05-11 02:03:34 +08:00
TinaMengtingZhang a44376f42a Fix empty tensor issue when reading an non-existing node in sync dump mode 2021-05-10 13:59:05 -04:00
xiefangqi e0148f7181 fix minddata directory path problem 2021-05-10 22:16:37 +08:00
yepei6 acbd7eb023 add more tensor methods 2021-05-10 14:40:53 +08:00
yangzhenzhang 6aa3859131 modify check strategy for scatter update 2021-05-10 11:22:00 +08:00
mindspore-ci-bot ee885b4e58 !15180 enable not fully use opt shard
From: @gong_zi_yan
Reviewed-by: @stsuteng
Signed-off-by: @stsuteng
2021-05-08 14:57:58 +08:00
mindspore-ci-bot b86747b9a6 !15813 Convert some pipeline Ops to be inlined
From: @hfarahat
Reviewed-by: 
Signed-off-by:
2021-05-08 05:30:39 +08:00
hesham fd943bbdc0 Modify normalize to support multiple of channels 2021-05-07 17:06:26 -04:00
Ziyan 2a752f24bf enable not fully use opt shard 2021-05-07 15:32:48 +08:00
mindspore-ci-bot d76574bbbf !15973 parallel env variables check
From: @yao_yf
Reviewed-by: @yangzhenzhang,@stsuteng
Signed-off-by: @stsuteng
2021-05-07 12:13:41 +08:00
mindspore-ci-bot e0422e972e !16019 If dataset_dir is not a dir or something else validation is not right somehow
From: @xiefangqi
Reviewed-by: @ms_yan,@liucunwei,@jonyguo
Signed-off-by: @liucunwei
2021-05-07 11:57:31 +08:00
mindspore-ci-bot b85bf60eb8 !15727 VOCDataset read xml will filter invalid bbox automationally
From: @xiefangqi
Reviewed-by: @heleiwang,@jonyguo
Signed-off-by: @jonyguo
2021-05-07 09:50:53 +08:00
yao_yf e967f1939b parallel envs variable check 2021-05-07 09:12:53 +08:00
mindspore-ci-bot eb08d2e952 !16024 dataset: modify some error msg in dataset module
From: @ms_yan
Reviewed-by: @jonyguo,@heleiwang
Signed-off-by: @jonyguo
2021-05-07 09:12:46 +08:00
ms_yan 34dcd2b463 modify log of dataset part 2021-05-06 23:33:17 +08:00
xiefangqi b6e1fceedc minddata modify dir validation 2021-05-06 21:35:31 +08:00
Lixia Chen 5967cb2cd7 Unblock mindrecord under cache 2021-05-05 13:28:13 -04:00
hesham e4c0bd51a5 Modify concat to be an inlined Op
Modify zip to be an inlined Op
Modify take to be an inlined Op
Modify skip to be an inlined Op
Modify rename to be an inlined Op
Modify filter to consume child's rows using one thread
2021-05-04 12:45:18 -04:00
mindspore-ci-bot c13ed20dad !15907 add type convert during load checkpoint
From: @changzherui
Reviewed-by: @kingxian,@zh_qh
Signed-off-by: @kingxian
2021-04-30 15:52:41 +08:00
mindspore-ci-bot ee3012fd3f !15303 add lsq quantization method
From: @erpim
Reviewed-by: 
Signed-off-by:
2021-04-30 11:26:42 +08:00
mindspore-ci-bot ac912672bf !15871 Support pass args or|and kwargs for OP CreateInstance.
From: @zh_qh
Reviewed-by: @ginfung,@hwhewei
Signed-off-by: @hwhewei
2021-04-30 10:39:04 +08:00
mindspore-ci-bot cefcf6c2ae !15931 Add eager tests for transform ops, and add a shape comparison in the EXPECT_MSTENSOR_EQ Macro
From: @alexyuyue
Reviewed-by: @nsyca,@robingrosman
Signed-off-by: @robingrosman
2021-04-30 06:15:12 +08:00
alex-yuyue 9ef4331f56 Add eager tests for transform ops
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-04-29 13:19:24 -04:00
changzherui 85025804ef add type convert during load checkpoint 2021-04-29 17:38:16 +08:00
Zhang Qinghua cd7f7d40fb Support pass args or|and kwargs for OP CreateInstance. 2021-04-29 14:14:58 +08:00
mindspore-ci-bot 33966f0cd5 !15744 Add encryption for ckpt file
From: @liu_luobin
Reviewed-by: @baochong,@chongbao
Signed-off-by:
2021-04-29 11:18:50 +08:00
mindspore-ci-bot 577cf7cd1d !15758 [Offline Debug] Add UT tests to the offline debugger.
From: @islam_amin
Reviewed-by: @john_tzanakakis,@tom__chen,@robingrosman
Signed-off-by: @john_tzanakakis
2021-04-29 04:33:02 +08:00
Islam Amin 6bb740f137 added GPU UT tests 2021-04-28 13:03:51 -04:00
liuluobin a40229d171 Add encryption for ckpt file 2021-04-28 16:24:29 +08:00
mindspore-ci-bot 78fcdbc7c9 !15790 modify scatter update op
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
2021-04-28 10:48:19 +08:00
mindspore-ci-bot b663bbd9ca !15597 [MD] save op support variable dimension 0
From: @liyong126
Reviewed-by: @liucunwei,@jonyguo
Signed-off-by: @liucunwei
2021-04-28 09:38:58 +08:00
mindspore-ci-bot cbca36d723 !15766 modify tile op
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
2021-04-28 09:17:17 +08:00
Erpim 90d5d5dab3 add lsq quantization method 2021-04-27 20:48:04 +08:00
yangzhenzhang 075f680a42 modify scatter update op 2021-04-27 20:23:14 +08:00
liyong 587247e793 add support save dynamic shape tensor 2021-04-27 19:15:10 +08:00
mindspore-ci-bot 9e650da6d7 !15578 numpy-native tensor setitem bug fix & restructure
From: @jachua
Reviewed-by: @guoqi1024,@kisnwang
Signed-off-by: @kisnwang
2021-04-27 15:20:25 +08:00
xiefangqi 458ff5fed9 md fix voc and manifest error scenario 2021-04-27 14:24:57 +08:00
Xiaoda Zhang aa52399200 Making the Tile operator to have more parallel strategies 2021-04-27 11:36:40 +08:00
huangmengxi d6be043cb9 fix & restructure setitem 2021-04-27 10:03:10 +08:00
mindspore-ci-bot e3d54b7e3b !15695 dont insert VirtualOutput for scalar
From: @yao_yf
Reviewed-by: @yangzhenzhang,@stsuteng
Signed-off-by: @stsuteng
2021-04-27 09:25:30 +08:00
mindspore-ci-bot 83cdb8bb38 !15560 Optimize cache_admin tool to allow multiple session destroy
From: @lixiachen
Reviewed-by: @robingrosman,@nsyca
Signed-off-by: @robingrosman
2021-04-27 07:55:29 +08:00
yao_yf 093ef784de dont insert virtualoutput for scalar 2021-04-26 19:55:16 +08:00
mindspore-ci-bot d328fdcf61 !15200 profiler: fixed AICPU timeline
From: @zhangyunshu
Reviewed-by: @yelihua,@ouwenchang
Signed-off-by: @ouwenchang
2021-04-26 11:06:50 +08:00
mindspore-ci-bot 3cfd58e8e0 !15643 insert virtual div only for first input of dropout do mask
From: @yangzhenzhang
Reviewed-by: @stsuteng,@kisnwang
Signed-off-by: @stsuteng
2021-04-26 09:21:00 +08:00
mindspore-ci-bot 49d6c029a6 !15542 split axis and batch for gather
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng,@stsuteng
Signed-off-by: @stsuteng,@stsuteng
2021-04-25 19:33:09 +08:00
mindspore-ci-bot 7dc9eb3e0b !15396 add parallel virtual output in eval/predict
From: @yao_yf
Reviewed-by: @yangzhenzhang,@stsuteng
Signed-off-by: @stsuteng
2021-04-25 17:43:13 +08:00
yangzhenzhang 5828973978 fix bug for dropout do mask 2021-04-25 16:47:44 +08:00
yao_yf 21276408b8 parallel virtual_out_ops 2021-04-25 11:18:54 +08:00
Lixia Chen 44fb7ac4bb Add support for multi-session destroy 2021-04-23 11:17:06 -04:00
yangzhenzhang 213922574e split axis and batch for gatherv2 2021-04-23 16:59:35 +08:00
zhiqiang 2a0b443cc4 Add indexes attribute and make metrics indexes recognizable 2021-04-23 04:32:02 -04:00
mindspore-ci-bot b77c3f093d !15436 augassign
From: @yepei6
Reviewed-by: @yanglf1121,@kingxian
Signed-off-by: @kingxian
2021-04-23 14:58:35 +08:00
yepei6 81789ffb5d augassign 2021-04-23 11:58:07 +08:00
changzherui f63a13b2e9 modify check file name bug 2021-04-23 08:57:43 +08:00
mindspore-ci-bot e43a57fd37 !15525 clean code not used
From: @zhangzhaoju
Reviewed-by: @zh_qh,@ginfung
Signed-off-by: @zh_qh
2021-04-22 20:04:57 +08:00
mindspore-ci-bot 1ecc638fad !15442 modify code method metrics
From: @changzherui
Reviewed-by: @kingxian,@zhoufeng54
Signed-off-by: @kingxian
2021-04-22 16:58:36 +08:00
zhangzhaoju 6a2aee492c Clean code that not used 2021-04-22 16:24:05 +08:00
mindspore-ci-bot b760d1235f !15416 Update normalization description at nn/layer/normalization.py
From: @dinglinhe123
Reviewed-by: @liangchenghui,@wuxuejian
Signed-off-by: @liangchenghui
2021-04-21 15:05:33 +08:00
changzherui 1f4c17edca modify clean code 2021-04-21 10:56:16 +08:00
dinglinhe 54fb72e2b3 Update normalization description at nn/layer/normalization.py 2021-04-20 12:30:37 +08:00
yangzhenzhang c2ca2232c5 add select op 2021-04-20 09:23:22 +08:00
mindspore-ci-bot 1c9d3c0aa0 !15353 add parallel operator for scatter update
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
2021-04-20 09:03:08 +08:00
Cathy Wong 636809c255 dataset: C++ API ToNumber & Lookup: change data_type parm from string to DataType 2021-04-19 12:35:37 -04:00
mindspore-ci-bot 0fd1726e79 !15172 Clean GraphKernel's codes from frontend
From: @dayschan
Reviewed-by: @gaoxiong1,@dylangeng,@gaoxiong1
Signed-off-by: @dylangeng,@dylangeng
2021-04-19 09:34:35 +08:00
yangzhenzhang 9cdd70433f add scatterupdate op 2021-04-17 17:32:48 +08:00
yangzhenzhang d070af122f add topk op 2021-04-17 14:12:49 +08:00
dayschan 771e3f61f3 Clean GraphKernel's codes from frontend
1. set class GraphKernel as deprecated, and treat it as Cell
2. set class InplaceAssign as deprecated, suggested using Assign instead.
3. set op_selector as deprecated, removed the _selected_ops and _selected_grad_ops, replaced with real operations
4. removed the two passes of GraphKernel from frontend
5. removed the GraphKernel's codes from other modules
2021-04-17 11:03:34 +08:00
mindspore-ci-bot f9c5060cf2 !14930 Handle ignored returned Status
From: @hfarahat
Reviewed-by: @robingrosman,@pandoublefeng
Signed-off-by: @robingrosman
2021-04-17 03:52:41 +08:00
mindspore-ci-bot 9c81c5d2a0 !15189 Add more ut for transform ops and subset sampler
From: @alexyuyue
Reviewed-by: 
Signed-off-by:
2021-04-17 01:46:13 +08:00
hesham 6e6eaebb77 Fix unused return value in main code 2021-04-16 11:33:35 -04:00
yangzhenzhang f9f5df368e add gathernd op 2021-04-16 14:29:03 +08:00
alex-yuyue 97e3232b6d Add more ut for transform ops and subset sampler
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-04-15 16:51:41 -04:00
mindspore-ci-bot f09df9ac2f !15248 Fix shellcheck warnings for cache shell scripts
From: @lixiachen
Reviewed-by: @pandoublefeng,@robingrosman
Signed-off-by: @robingrosman
2021-04-15 22:47:06 +08:00
Lixia Chen 91f9059263 Fix shellcheck warnings 2021-04-15 09:33:07 -04:00
zhangyunshu d969be9107 profiler: fixed aicpu timeline 2021-04-15 19:35:24 +08:00
yangzhenzhang bcd2ecc403 check layouts for shared parameter 2021-04-15 10:39:05 +08:00
mindspore-ci-bot 727203a498 !14911 dataset: Fill op: C++ API support, UTs and Pybind decoupling
From: @cathwong
Reviewed-by: 
Signed-off-by:
2021-04-14 05:32:11 +08:00
Cathy Wong 7e6a03487e dataset: Fill op: C++ API support, UTs and Pybind decoupling 2021-04-13 10:02:39 -04:00
mindspore-ci-bot e07a69d8f8 !14874 GNN dataset new feature
From: @lizhenglong1992
Reviewed-by: 
Signed-off-by:
2021-04-13 10:44:27 +08:00
Zhenglong Li f3895f2b09 Add get edges from nodes function for gnn network 2021-04-10 18:31:13 +08:00
mindspore-ci-bot f0f7bf1ed1 !14885 fix: wrong input order
From: @jonyguo
Reviewed-by: @liucunwei,@heleiwang
Signed-off-by: @liucunwei
2021-04-10 16:52:41 +08:00
jonyguo a5cc81dc97 fix: wrong input order in test_paddeddataset.py 2021-04-09 17:22:31 +08:00
Lixia Chen 1f2b178a16 Reset CacheClient's status for a new run
Turn off lock only after all data is cached
2021-04-08 15:30:48 -04:00
mindspore-ci-bot a9ba9b90f6 !14680 MindData Codespell correction
From: @luoyang42
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
2021-04-07 18:28:55 +08:00
luoyang 624511337c MindData Codespell correction 2021-04-07 10:20:29 +08:00
hesham 8535e89e6c Remove DataBuffer 2021-04-05 17:55:59 -04:00
hesham 0d86cb1423 Remove rows_per_buffer 2021-04-04 00:22:16 -04:00
mindspore-ci-bot c99fe1e412 !12841 DataBuffer removal from DE
From: @hfarahat
Reviewed-by: 
Signed-off-by:
2021-04-04 03:28:13 +08:00
mindspore-ci-bot 28f4759537 !14606 parallel ut test
From: @yao_yf
Reviewed-by: 
Signed-off-by:
2021-04-02 21:24:43 +08:00
yao_yf a83fb3316b fix parallel timeout 2021-04-02 20:19:26 +08:00
mindspore-ci-bot 5b8a200fa9 !14572 show accurate error line when use user defined class
From: @zhangbuxue
Reviewed-by: @zh_qh,@ginfung
Signed-off-by: @zh_qh
2021-04-02 15:14:31 +08:00
mindspore-ci-bot e034f0294b !14556 Fix validation of RGB2HSV/HSV2RGB/RandomResizedCrop in py_transform & Fix error msg of pythontokenizer
From: @luoyang42
Reviewed-by: @liucunwei,@heleiwang
Signed-off-by: @liucunwei
2021-04-02 14:23:56 +08:00
buxue 6f1105ea79 show accurate error line when use user defined class 2021-04-01 21:52:00 +08:00
luoyang ec21d3f748 Fix validation of RGB2HSV/HSV2RGB/RandomResizedCrop in py_transform
Fix error msg of pythontokenizer
2021-04-01 19:09:07 +08:00
changzherui ffee537387 modify python ut 2021-04-01 16:19:55 +08:00
hesham a9a80693be Replace Databuffers with TensorRows 2021-03-31 17:00:36 -04:00
buxue 8c47ce1803 show accurate error info and error lines when use unsupported builtin function 2021-03-31 12:33:38 +08:00
changzherui fde2856d5d modify python ut 2021-03-30 20:08:26 +08:00
mindspore-ci-bot 7d911cdeeb !14365 set parallel communication init in parallel ut
From: @yao_yf
Reviewed-by: @stsuteng,@kisnwang
Signed-off-by: @stsuteng
2021-03-30 16:30:07 +08:00
yao_yf 4d0635eabe set parallel communication init flag in parallel ut 2021-03-30 11:21:57 +08:00
buxue d830a2b55a optimize exception mode when use undefined name in if for and while 2021-03-27 17:28:52 +08:00
mindspore-ci-bot 5d0490909d !14097 map a fv cnode if it is not mapped and belong to primal_graph_
From: @xychow
Reviewed-by: @ginfung,@zh_qh
Signed-off-by: @zh_qh
2021-03-26 09:20:42 +08:00
zhousiyi 74d500a756 If a fv cnode is not mapped but belong to primal_graph_, then don't propagate this fv to caller, it should mapped instead 2021-03-25 11:49:37 +00:00
mindspore-ci-bot 5926f7c386 !13906 【MD】【BUG】Conventional judgment on the parameter h w not less than zero
From: @xulei2020
Reviewed-by: 
Signed-off-by:
2021-03-25 14:10:42 +08:00
xulei2020 4122d1dcce fix code format bug 2021-03-25 09:18:36 +08:00
mindspore-ci-bot 9023ba2b56 !13745 Enable zero dimension when it comes out of operator.
From: @liangzhibo
Reviewed-by: @ginfung,@zh_qh,@ginfung
Signed-off-by: @zh_qh
2021-03-24 20:34:30 +08:00
l00591931 923dd4b77a enable zero dimension tensor when input is data 2021-03-24 15:46:17 +08:00
mindspore-ci-bot 1bc5a2d8ec !13483 modify ci python ut execution
From: @changzherui
Reviewed-by: 
Signed-off-by:
2021-03-23 14:17:59 +08:00
buxue e3056ed9b2 show accurate code line when use uninitialized var in for 2021-03-21 17:50:58 +08:00
mindspore-ci-bot 8e8f3043f9 !12115 IR operators of GPU and CPU are unified as batchnorm
From: @ding_fei_fei
Reviewed-by: 
Signed-off-by:
2021-03-19 14:51:26 +08:00
mindspore-ci-bot 1d505ebad3 !13528 Optimize the functions of log module
From: @askmiao
Reviewed-by: @ginfung,@zh_qh,@ginfung
Signed-off-by: @zh_qh
2021-03-19 14:06:35 +08:00
askmiao 4e39eab473 modify the log module 2021-03-19 09:59:45 +08:00
dingpeifei 87e41aaeee IR operators of GPU and CPU are unified as batchnorm 2021-03-18 19:02:28 +08:00
YangLuo f99204b292 fix python tokenizer 2021-03-18 15:47:09 +08:00
changzherui 6cd90dc45e modify ci python ut execution 2021-03-18 11:30:49 +08:00
mindspore-ci-bot b61aa9b4cf !13342 Throw exception when tensor with 0 shape is constructed
From: @liangzhibo
Reviewed-by: 
Signed-off-by:
2021-03-17 09:18:27 +08:00
mindspore-ci-bot 7454ac8ecd !13382 [PipelineSplit]change pipeline key word
From: @lichen666
Reviewed-by: @kisnwang,@zhunaipan
Signed-off-by: @zhunaipan
2021-03-16 20:20:32 +08:00
mindspore-ci-bot 48a7a94677 !13397 fix shellcheck error
From: @xsmq
Reviewed-by: @zhoufeng54,@zhunaipan
Signed-off-by: @zhunaipan
2021-03-16 17:42:19 +08:00
mindspore-ci-bot f9c408934e !13380 unify range
From: @lianliguang
Reviewed-by: @zh_qh,@ginfung
Signed-off-by: @zh_qh
2021-03-16 16:56:53 +08:00
xsmq bf6da44f84 fix shellcheck error 2021-03-16 15:43:50 +08:00
lichenever a2b2727ba8 change_pipeline_key_word 2021-03-16 14:02:35 +08:00
LianLiguang 17b9758543 unify range ops 2021-03-16 10:47:42 +08:00
l00591931 bd777e0710 throw exception when tensor has zero in shape 2021-03-16 10:39:48 +08:00
Lixia Chen 30017ea5a0 Fix codex issues 2021-03-15 11:15:15 -04:00
mindspore-ci-bot ac18da3770 !13061 [MD][bugfix] Fix to_json error: can't pickle pyfunc
From: @xiefangqi
Reviewed-by: 
Signed-off-by:
2021-03-13 12:48:26 +08:00
Xiao Tianci 4a7100c7f9 fix RandomAffine degree error and some examples in docs 2021-03-12 17:39:38 +08:00
mindspore-ci-bot 682a8926bd !13176 fix minddata transform issue
From: @luoyang42
Reviewed-by: 
Signed-off-by:
2021-03-12 17:01:56 +08:00
mindspore-ci-bot a1c3f55aca !13197 support item negative index bprop
From: @zhangbuxue
Reviewed-by: @ginfung
Signed-off-by:
2021-03-12 15:52:26 +08:00
xiefangqi 41f3e02e87 fix pyfunc pickle issue 2021-03-12 15:17:08 +08:00
buxue 50ee325b96 support item negative index bprop 2021-03-12 13:58:46 +08:00
YangLuo 74d7bb41a6 fix minddata transform issue 2021-03-12 11:37:14 +08:00
mindspore-ci-bot 1e33df94a5 !13142 support name or attribute ast.Expr
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
2021-03-12 09:27:32 +08:00
mindspore-ci-bot f7040ca134 !13198 Fix get_dataset_size error with PKSampler
From: @ziruiwu
Reviewed-by: 
Signed-off-by:
2021-03-12 06:11:26 +08:00
mindspore-ci-bot 1bb789278d !13200 Fix CI warnings and test team issues
From: @alexyuyue
Reviewed-by: @robingrosman,@nsyca
Signed-off-by: @robingrosman
2021-03-12 05:38:01 +08:00
Zirui Wu 2692e3cc3d fix pk sampler's get_dataset error due to num_class unavaiable at pre-runtime 2021-03-11 15:43:02 -05:00
mindspore-ci-bot 236c874e64 !12862 Increase default level of parallelism in minddata pipeline
From: @robingrosman
Reviewed-by: 
Signed-off-by:
2021-03-12 04:23:02 +08:00
alex-yuyue 2457f52596 Fix CI warning and test team issues
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-03-11 13:34:51 -05:00
buxue 2551f5ea7e support name or attribute ast.Expr 2021-03-11 21:40:33 +08:00
mindspore-ci-bot e1a95b1152 !12714 rebuild getitem
From: @yepei6
Reviewed-by: 
Signed-off-by:
2021-03-11 14:49:21 +08:00
RobinGrosman a0e75b845a Increase default level of parallelism in mindddata pipeline to 8.
Adjust memory usage to not increase as parallelism increases.  it will
stay at same level it would be with 4 parallelism
2021-03-10 18:38:11 -08:00
mindspore-ci-bot 54c37bcd61 !12947 Add MaxPool3D,MaxPool3DGrad,MaxPool3DGradGrad ops for Ascend.
From: @liu_xiao_93
Reviewed-by: @liangchenghui
Signed-off-by: @liangchenghui
2021-03-11 08:55:46 +08:00
liuxiao93 35f6ba9011 Add MaxPool3D,MaxPool3DGrad,MaxPool3DGradGrad ops for Ascend. 2021-03-10 15:33:07 +08:00
mindspore-ci-bot 3c7463bf2c !12943 adding fix to sample script
From: @ezphlow
Reviewed-by: 
Signed-off-by:
2021-03-10 10:22:19 +08:00
Eric ed373f61ac Adding inheritance to user defined sampler
what if we just do nothing

trying wrapper approach

Fix yolo
2021-03-09 18:14:49 -05:00
mindspore-ci-bot fe3b26a637 !12982 dice bug
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
2021-03-09 17:04:16 +08:00
jiaqi cdb7330818 diceloss bug 2021-03-09 16:23:45 +08:00
yepei6 57373ed30a merge getitem the by otehr types to by tuple(success) 2021-03-09 10:47:29 +08:00
ougongchang e8ee209877 Optimize summary ut and delete duplicate test cases
Change the summary test case to stage3 to avoid multiple processes that cause the summary test case to fail
2021-03-08 17:36:17 +08:00
mindspore-ci-bot 91cf88d692 !12883 Fix bugs of minddata transforms
From: @luoyang42
Reviewed-by: 
Signed-off-by:
2021-03-08 09:08:30 +08:00
YangLuo 74431ad117 Fix bugs of minddata transforms 2021-03-06 16:41:51 +08:00
mindspore-ci-bot 7ba21f8d8c !12900 Add communication parallel mode.
From: @liujunzhu
Reviewed-by: @zhoufeng54,@guoqi1024
Signed-off-by: @guoqi1024
2021-03-06 15:55:49 +08:00
mindspore-ci-bot 48d4cca512 !12949 Add TopoSort Rhs First attribute for special CNode, such as Depend CNode with isolated nodes.
From: @zh_qh
Reviewed-by: @hwhewei,@zhunaipan
Signed-off-by: @zhunaipan
2021-03-06 14:41:35 +08:00
Zhang Qinghua df866f7248 Add TopoSort Rhs First attribute for special CNode, such as Depend CNode with isolated nodes. 2021-03-06 12:39:36 +08:00
mindspore-ci-bot fe53c71b3b !12843 Add more callable test and clean the input check for tensor ops
From: @alexyuyue
Reviewed-by: @robingrosman,@nsyca
Signed-off-by: @robingrosman
2021-03-05 22:59:45 +08:00
liujunzhu 6541b96c40 Add communication parallel mode. 2021-03-05 21:36:03 +08:00
mindspore-ci-bot d285692217 !12852 Change maketuple in coreops
From: @liangzhibo
Reviewed-by: 
Signed-off-by:
2021-03-05 19:13:42 +08:00
l00591931 680324f225 Change make tuple in core.ops 2021-03-05 10:54:33 +08:00
Ziyan ec9793861f fix grad accu 2021-03-05 10:28:10 +08:00
Zhang Qinghua 8b8c59f01e Optimize the compile performance in Parser, FG, Manager and Renormalize:
---
Remove the routine of handling isolated nodes in Renormalize.
Add isolated nodes from Parser&Resolver.
Modify isolated nodes handling in FG&Manager.
Optimize the renormalize routines.
Other optimizations.
2021-03-04 16:01:54 +08:00
mindspore-ci-bot 7ff2b3b499 !12781 fix bug of amp bn cast
From: @jojobugfree
Reviewed-by: 
Signed-off-by:
2021-03-04 10:14:51 +08:00
alex-yuyue 6d7be32614 Add more callable test and clean the input check
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-03-03 17:30:36 -05:00
mindspore-ci-bot 1c191a65fb !12765 Fix numpy input to samplers
From: @hfarahat
Reviewed-by: 
Signed-off-by:
2021-03-04 04:57:40 +08:00
mindspore-ci-bot c07371f5c9 !12763 Fix C++ API testcases
From: @ezphlow
Reviewed-by: 
Signed-off-by:
2021-03-04 04:57:28 +08:00
mindspore-ci-bot 8e13667ff4 !12674 Add support to multiple tensor in eager mode
From: @alexyuyue
Reviewed-by: @nsyca
Signed-off-by:
2021-03-04 01:28:34 +08:00
Eric f9a2379a70 Fixing api leftover
Fixed compile error

Fixed more testcases
2021-03-03 09:37:06 -05:00
mindspore-ci-bot e58be0de71 !12737 quantum state evolution operator
From: @donghufeng
Reviewed-by: 
Signed-off-by:
2021-03-03 15:38:42 +08:00
mindspore-ci-bot 7fcce73c51 !12700 add grad accumulation combined with optimizer parallel
From: @yangzhenzhang
Reviewed-by: 
Signed-off-by:
2021-03-03 11:04:19 +08:00
mindspore-ci-bot 8fb01aabd4 !12738 Add heartbeat check in summary and delete test cases that do not exit
From: @ouwenchang
Reviewed-by: @yelihua
Signed-off-by:
2021-03-03 10:11:32 +08:00
alex-yuyue 66aff93940 Fix test team issue: ToNumber in eager mode.
And support multiple tensor as input in call method

Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-03-02 17:39:44 -05:00
caifubi a6959c2a13 fix bn cast bug 2021-03-02 17:24:47 +08:00
ougongchang 4309e20b1b Add heartbeat check in summary and delete test cases that do not exit 2021-03-02 15:29:15 +08:00
hesham 616d1a1f3d Fix sampler supporting numpy input 2021-03-01 12:41:59 -05:00
mindspore-ci-bot 85461bcdb3 !12532 add SyncBatchNorm
From: @yuchaojie
Reviewed-by: 
Signed-off-by:
2021-03-01 19:34:41 +08:00
xuxs 066d23e2ad evolution operator 2021-03-01 14:20:31 +08:00
yangzhenzhang a70d616841 mini step grad accumulation 2021-03-01 10:20:12 +08:00
yujianfeng f0b7c3dd4d Add a switch to control grad for scalar 2021-02-27 18:12:37 +08:00
yuchaojie 6d195f340c add SyncBatchNorm 2021-02-27 14:32:54 +08:00
mindspore-ci-bot f269f3fc8d !12231 Support ad for scalar inputs
From: @ginfung
Reviewed-by: 
Signed-off-by:
2021-02-26 15:50:32 +08:00
mindspore-ci-bot 6808816cb2 !12618 support index by negative number
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
2021-02-26 15:49:14 +08:00
mindspore-ci-bot ed46bf8b18 !12624 add rmse_loss and mae_loss
From: @lijiaqi0612
Reviewed-by: @kingxian,@zh_qh
Signed-off-by: @kingxian
2021-02-26 14:34:03 +08:00
buxue 610300335f support index by negative number 2021-02-26 12:49:25 +08:00
mindspore-ci-bot c8defc2a8a !12558 Fix sampler error messages
From: @hfarahat
Reviewed-by: 
Signed-off-by:
2021-02-26 00:10:17 +08:00
Jiaqi 112b8488c5 add rmse loss 2021-02-25 17:03:07 +08:00
yujianfeng 41189781f3 support scalar input for cell 2021-02-25 09:56:15 +08:00
wangshuide2020 72e938eb06 change dimension of input for FusedBatchNormEx from 2D to 4D in test_two_matmul_batchnorm_ex. 2021-02-25 09:37:59 +08:00
mindspore-ci-bot 5b206557d2 !12586 support invert bool tensor
From: @zhangbuxue
Reviewed-by: @zh_qh,@ginfung,@zh_qh
Signed-off-by: @zh_qh,@zh_qh
2021-02-25 09:37:43 +08:00
buxue f8a00d52af support invert bool tensor 2021-02-24 17:47:07 +08:00
wangshuide2020 b9eb90b198 add GPU for DenseBnAct, Erfc, Log1p, etc. in Supported Platforms. 2021-02-24 16:30:38 +08:00
hesham aa4298721a Fix sampler error messages 2021-02-23 23:58:19 -05:00
mindspore-ci-bot 2e7a785d44 !12535 add raises description for Cast, Diag, Eye, Fill etc. operators
From: @wangshuide2020
Reviewed-by: @liangchenghui
Signed-off-by: @liangchenghui
2021-02-23 22:17:37 +08:00
mindspore-ci-bot e73f43aa85 !12507 support convert ValueDict to py dict
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
2021-02-23 19:19:44 +08:00
wangshuide2020 8a7fa2e651 add raises description for Cast, Diag, Eye, Fill etc. operators. 2021-02-23 17:33:19 +08:00
mindspore-ci-bot bff0fde980 !12249 make slice support tensor
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
2021-02-23 10:55:27 +08:00
mindspore-ci-bot 9893b3d128 !12320 add focal loss
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
2021-02-23 10:35:59 +08:00
xsmq 923b53d2e6 replace tab with spaces 2021-02-23 09:41:47 +08:00
buxue 47dd17a325 support convert ValueDict to py dict 2021-02-23 09:27:46 +08:00
Jiaqi fd1a4726b7 add focal loss 2021-02-22 19:33:26 +08:00
buxue 416017bf65 make slice support tensor 2021-02-22 17:07:37 +08:00
xuxs c70049b190 mindquantum
mindquantum

cmake lint

projectq patch

test pqc

space

pylint

pqc python ops

doc

check

bug

bug

bug

bug

check boundary condition

mindquantum in log_adapter

mindquantum in adapter and recorder cc

substract to subtract

public variable to private variable

public variable to private variable

commit

debug

debug

const in utils

delete dtol

clint
2021-02-20 12:33:51 +08:00
mindspore-ci-bot 4ac1982c58 !12258 add multclass diceloss
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
2021-02-20 09:42:31 +08:00
mindspore-ci-bot f940fe51b1 !12398 fix minddata issues
From: @luoyang42
Reviewed-by: @heleiwang,@pandoublefeng
Signed-off-by: @pandoublefeng
2021-02-19 17:01:06 +08:00
Jiaqi 952e245000 add multclass diceloss 2021-02-19 15:43:30 +08:00
YangLuo d8ace8f041 fix minddata issues 2021-02-19 10:53:49 +08:00
mindspore-ci-bot 166f7e7809 !12248 Fix the bug of calling recompute api after compiled
From: @ginfung
Reviewed-by: 
Signed-off-by:
2021-02-18 19:35:38 +08:00
mindspore-ci-bot c5df707b69 !12327 Block caching after random pyfunc cases
From: @lixiachen
Reviewed-by: 
Signed-off-by:
2021-02-17 08:56:10 +08:00
Lixia Chen 0667818d9a Block caching after random pyfunc 2021-02-12 14:10:00 -05:00
Mahdi 4b106f184c Fixed an issue with SequentialSampler 2021-02-10 12:55:10 -05:00
mindspore-ci-bot 260c77f4ad !12336 [MD] fix sampler log & transform log
From: @luoyang42
Reviewed-by: 
Signed-off-by:
2021-02-10 15:33:15 +08:00
luoyang 416ad23e9d fix resize & randomcoloradjust
fix sampler
2021-02-10 12:53:27 +08:00
mindspore-ci-bot 923dd47b0f !12331 Adding validators back to check method
From: @ezphlow
Reviewed-by: @robingrosman,@nsyca,@robingrosman
Signed-off-by: @robingrosman
2021-02-10 08:58:02 +08:00
Eric 5d91fa6d77 changed discription
Added validator checks

Added builtin sampler check

Added proper input check for samplers
2021-02-09 18:00:53 -05:00
hesham 58193bc469 User explicit deepcopy 2021-02-09 17:25:21 -05:00
yujianfeng 70cc548e32 Fix calling recompute api after compiling 2021-02-08 16:19:49 +08:00
mindspore-ci-bot a063d7633d !12241 [auto-monad] Support side-effects by auto-monad
From: @hwhewei
Reviewed-by: @zhunaipan,@zh_qh
Signed-off-by: @zh_qh
2021-02-08 10:25:57 +08:00
mindspore-ci-bot e6dcb0c31d !12239 [MD] fix bugs of execute & update doc description in minddata
From: @luoyang42
Reviewed-by: @liucunwei
Signed-off-by: @liucunwei
2021-02-08 10:15:08 +08:00
He Wei 7d9a783993 [auto-monad] Support side-effects by auto-monad
The basic idea is: exploits data dependency to control the execution order
of side-effect operations, and keep the semantics of ANF unchanged.

The ControlDepend primitive is removed and there are two primitives added:

1. UpdateState:
```
  a = Assign(para, value)
```
became:
```
  a = Assign(para, value, u)
  u = UpdateState(u, a)
```

2. Load:
```
  x = Add(para, value)
```
became:
```
  p = Load(para, u)
  x = Add(p, value)
  u = UpdateState(u, p)
```
2021-02-08 09:01:15 +08:00
luoyang cd86788cf3 fix bugs of execute & update doc description in minddata 2021-02-07 22:52:52 +08:00
liu_xiao_93 fabc25538e Add BCEWithLogitsLoss 2021-02-07 09:06:16 +08:00
mindspore-ci-bot 26d4b99019 !11056 Modifying profiling_Options parameter
From: @zyhstack
Reviewed-by: @lilongfei15,@xsmq
Signed-off-by: @xsmq
2021-02-06 13:23:21 +08:00
mindspore-ci-bot 4d9551e129 !12046 modify Gelu、FastGelu to GeLU and FastGeLU
From: @jinyaohui
Reviewed-by: 
Signed-off-by:
2021-02-06 09:57:48 +08:00
tom__chen d3330a1087 fix incorrect in_channel size error messages 2021-02-05 11:45:22 -05:00
jinyaohui 30a27b2adb modify Gelu、FastGelu to GeLU and FastGeLU 2021-02-05 17:19:52 +08:00
mindspore-ci-bot 24e528112f !12134 improve grad of first input
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
2021-02-05 15:33:30 +08:00
buxue 899d6114a4 improve grad of first input 2021-02-05 12:36:37 +08:00
zhangyihui bbbffbb6a9 Modify the profiling_options parameter name 2021-02-05 10:15:01 +08:00
mindspore-ci-bot 544da6f845 !11727 [MD] Add vision ops and py_transform ops support to Serdes save
From: @tina_mengting_zhang
Reviewed-by: 
Signed-off-by:
2021-02-05 06:38:54 +08:00
mindspore-ci-bot 74652eb942 !12044 modify pack to stack
From: @jinyaohui
Reviewed-by: 
Signed-off-by:
2021-02-04 21:02:09 +08:00
jinyaohui 8022f9a6ed modify pack to stack 2021-02-04 18:54:31 +08:00
mindspore-ci-bot 8fc5962418 !12055 compile graph for merging parameter slice only once
From: @yangzhenzhang
Reviewed-by: @stsuteng
Signed-off-by: @stsuteng
2021-02-04 14:30:47 +08:00
TinaMengtingZhang ddab5ad417 Add support for vision op and py_transform op to serdes 2021-02-03 12:31:09 -05:00
mindspore-ci-bot e8f4cafd02 !11950 Overwrite default port/hostname from env variables for cache_admin
From: @lixiachen
Reviewed-by: 
Signed-off-by:
2021-02-03 23:38:48 +08:00
yangzhenzhang 726ea32778 merge parameter slice compile graph only once 2021-02-03 19:39:32 +08:00
mindspore-ci-bot cbfba95ad0 !11921 do not broaden when arg is not tensor
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
2021-02-03 17:07:47 +08:00
buxue 6ccc4379b4 do not broaden scalar 2021-02-03 11:30:25 +08:00
mindspore-ci-bot 6378642c8a !11905 add raises description for BCELoss, ReLU, BatchNorm1d, etc. operators
From: @wangshuide2020
Reviewed-by: @liangchenghui,@wuxuejian
Signed-off-by: @liangchenghui
2021-02-03 11:19:00 +08:00
mindspore-ci-bot 78d250c7d5 !11648 fix param check for unexpected_format
From: @jiang-shuqiang
Reviewed-by: @yelihua
Signed-off-by:
2021-02-03 11:18:47 +08:00
Lixia Chen 97cd142f8d Overwrite default port/hostname from env variables
update copyright

add examples to CacheClient docstring
2021-02-02 20:39:19 -05:00
mindspore-ci-bot 840d819d08 !11975 improve isinstance
From: @zhangbuxue
Reviewed-by: @ginfung,@zh_qh
Signed-off-by: @zh_qh
2021-02-03 09:01:57 +08:00
hesham 1185218335 Support list of IDs as a sampler 2021-02-02 11:44:38 -05:00
buxue 5ede9ffcca improve isinstance 2021-02-02 21:12:14 +08:00
wangshuide2020 30f99f2722 add raises description for BCELoss, ReLU, BatchNorm1d, etc. operators. 2021-02-02 20:52:00 +08:00
mindspore-ci-bot 0dcd94d717 !11893 LookupOp: default value of unknown_token support NoneType
From: @luoyang42
Reviewed-by: @liucunwei,@pandoublefeng
Signed-off-by: @liucunwei
2021-02-02 20:13:18 +08:00
luoyang fa4f67cbcd LookupOp: default value of unknown_token support NoneType 2021-02-02 16:17:02 +08:00
mindspore-ci-bot b189f177bb Change tuple_getitem to TupleGetItem and some other ops, merge from r1.1 to master 2021-02-02 15:54:15 +08:00
jiangshuqiang 0bb80995bc fix param check for unexpected_format 2021-02-02 12:03:49 +08:00
mindspore-ci-bot e897eb4c41 !11915 Change TensorAdd to Add, merge from r1.1 to master
From: @liangzhibo
Reviewed-by: @ginfung,@zh_qh
Signed-off-by: @zh_qh
2021-02-02 09:16:08 +08:00
Nat Sutyanyong 5a7dc0accc Migrate repeat_pass.cc to IR optimizer and remove ExecTree optimizer 2021-02-01 12:30:16 -05:00
mindspore-ci-bot 320ea51308 !11853 Add call for decoupled image and text ops
From: @alexyuyue
Reviewed-by: 
Signed-off-by:
2021-02-01 19:47:00 +08:00
l00591931 9ec100d069 Change TensorAdd to Add, from r1.1 to master 2021-02-01 17:53:52 +08:00
mindspore-ci-bot ce89cc5e8b !11761 Change GatherV2 to Gather (merge from r1.1 to master)
From: @liangzhibo
Reviewed-by: 
Signed-off-by:
2021-01-30 17:53:20 +08:00
mindspore-ci-bot 794af6d094 !11834 [MD] Fix error msg description of dataset
From: @xiefangqi
Reviewed-by: @liucunwei,@heleiwang
Signed-off-by: @liucunwei
2021-01-30 14:49:24 +08:00
mindspore-ci-bot 9fa0499fa0 Change GatherV2 to Gather r1.1 to master 2021-01-30 14:13:47 +08:00
mindspore-ci-bot 84afbb510f !11813 modify dice and diceloss
From: @lijiaqi0612
Reviewed-by: @kingxian,@zh_qh
Signed-off-by: @kingxian
2021-01-30 11:08:17 +08:00
xiefangqi 3d72282f26 fix error msg issue 2021-01-30 11:03:53 +08:00
alex-yuyue 6fd58dc580 Add call for decoupled image and text ops
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-01-29 21:36:31 -05:00
Mahdi 8f34faeb7a Changed bindings to SamplerObj 2021-01-29 14:20:05 -05:00
Jiaqi 804ef79c18 modify dice and diceloss 2021-01-29 15:10:05 +08:00
mindspore-ci-bot a2f1a5b4b1 !11278 develop confusion matrix
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
2021-01-29 11:38:28 +08:00
Jiaqi c821a2f3a2 confusion matrix 2021-01-29 09:27:22 +08:00
mindspore-ci-bot 20c1727b2c !11631 Add SubsetSampler
From: @hfarahat
Reviewed-by: 
Signed-off-by:
2021-01-29 03:48:45 +08:00
mindspore-ci-bot 8e4a6842ff !11681 gnn support edge weight sampling
From: @heleiwang
Reviewed-by: @liucunwei
Signed-off-by: @liucunwei
2021-01-28 19:15:37 +08:00
heleiwang 2dc9ba761c gnn support weight sampling neighbors. 2021-01-28 15:28:44 +08:00
hesham 7120c66998 Add SubsetSampler 2021-01-27 15:00:18 -05:00
mindspore-ci-bot 4cd6588af0 !11393 Migrating cache transform pass from execution tree to IR tree
From: @lixiachen
Reviewed-by: 
Signed-off-by:
2021-01-27 22:10:13 +08:00
mindspore-ci-bot b9e1c3f045 !11530 support call inner net attr
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
2021-01-27 16:50:43 +08:00
buxue 3d33c4fed3 support call inner net attr 2021-01-27 15:08:29 +08:00
mindspore-ci-bot f2fd357ffc !11623 fix issues of MD
From: @luoyang42
Reviewed-by: 
Signed-off-by:
2021-01-27 14:37:55 +08:00
mindspore-ci-bot 007bd6c7d3 !11656 add dtype shape and value in __str__ and __repr__ of Parameter
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
2021-01-27 14:06:04 +08:00
mindspore-ci-bot 58b8d8cd02 !11677 add isfinite grad
From: @jiangzg001
Reviewed-by: @liangchenghui,@c_34
Signed-off-by: @liangchenghui
2021-01-27 11:13:58 +08:00
buxue 7c4b7203b0 add dtype shape and value in __str__ and __repr__ of Parameter 2021-01-27 11:04:24 +08:00
luoyang 415c8b08a5 fix issues of MD:
1. description of num_shard in datasets.py
2. add param validation for sampler
3. add description for add_child in sampler.py
2021-01-27 09:30:42 +08:00
jiangzhenguang de8c2c95d1 add isfinite grad 2021-01-27 09:10:49 +08:00
Lixia Chen 922e1f4f36 Migrate CacheTransformPass 2021-01-26 19:24:10 -05:00
mindspore-ci-bot 3708624a25 !11559 [MD] Change the default spill location of cache server
From: @lixiachen
Reviewed-by: 
Signed-off-by:
2021-01-27 03:12:24 +08:00
ougongchang c6e4b0c85f Add more log when collect graph and use summary operators
Fix can not collect input data when batch size is 1 and total step
number is 1

Fixed spelling errors
2021-01-26 11:24:16 +08:00
Lixia Chen be6d310946 Default to memory-only cache server 2021-01-25 18:38:24 -05:00
mindspore-ci-bot 8170669909 !11174 add_mish_mulnonan_selu_operations
From: @jiangzg001
Reviewed-by: @liangchenghui
Signed-off-by: @liangchenghui
2021-01-23 17:24:17 +08:00
mindspore-ci-bot f8f6421459 !10968 Add dynamic shape support for the operator Concat
From: @david-he91
Reviewed-by: 
Signed-off-by:
2021-01-23 16:58:40 +08:00
xiefangqi 3f76abcdee minddata err msg add file path 2021-01-22 16:38:46 +08:00
mindspore-ci-bot fd6dc1b060 !11177 modify Tensor
From: @Somnus2020
Reviewed-by: 
Signed-off-by:
2021-01-22 11:37:11 +08:00
jiangzhenguang 991fb122f3 add_mish_mulnonan_selu_operations 2021-01-22 10:31:31 +08:00
mindspore-ci-bot 2beb916bf5 !11427 TextOp decoupling
From: @alexyuyue
Reviewed-by: 
Signed-off-by:
2021-01-22 09:09:41 +08:00
mindspore-ci-bot fcc4a4eaea !11397 add GetDatasetSize to concat_node
From: @mhmotallebi
Reviewed-by: 
Signed-off-by:
2021-01-22 08:08:41 +08:00
mohammad b5e91139e2 add GetDatasetSize to concat node 2021-01-21 16:25:48 -05:00
mindspore-ci-bot 6394ba3974 !11499 delete useless params in pipeline parallel
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
2021-01-21 21:35:43 +08:00
hedongdong 8241dfa443 Add dynamic shape support for the operator Concat 2021-01-21 20:36:29 +08:00
mindspore-ci-bot 0c5b6107a7 !11475 support dict for isinstance
From: @zhangbuxue
Reviewed-by: @ginfung,@zh_qh,@ginfung
Signed-off-by: @ginfung
2021-01-21 19:31:13 +08:00
yangzhenzhang cbca482e59 delete useless parameter in pipeline parallel 2021-01-21 19:05:40 +08:00
lilei 7d9f5f6dba modify Tensor 2021-01-21 17:46:34 +08:00
buxue 2ea8b9e738 add dict for isinstance 2021-01-21 17:30:35 +08:00
yangzhenzhang 7303c3d3b8 add group ckpt 2021-01-21 14:41:05 +08:00
alex-yuyue a8675f8227 TextOp decoupling
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-01-20 21:52:45 -05:00
mindspore-ci-bot 55594db01c !11348 add check for outermost net inputs type and support isinstance first arg is an empty list
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
2021-01-20 19:00:08 +08:00
buxue e8cd572bc2 add check for outermost net inputs type and support isinstance first arg an empty list 2021-01-20 14:48:06 +08:00
mindspore-ci-bot 775d71f9c1 !11408 Update PP example
From: @zichun_ye
Reviewed-by: @wang_zi_dong,@sunnybeike
Signed-off-by:
2021-01-20 09:17:23 +08:00
Zichun Ye ca316f4422 update doc example in probability
fix typo in probability module

fix pylint in msp
2021-01-19 11:51:43 -05:00
mindspore-ci-bot 60feffad20 !11332 update Pooling's attr kernel_size, pad_mode
From: @yuchaojie
Reviewed-by: 
Signed-off-by:
2021-01-19 16:17:45 +08:00
Lixia Chen 273865a72b Rename SamplerObj::Build() to SamplerBuild() 2021-01-18 15:42:34 -05:00
mindspore-ci-bot 91842af2ad !11245 Pushing down pipeline json serializer logic to C++ IR - PART II
From: @tina_mengting_zhang
Reviewed-by: 
Signed-off-by:
2021-01-19 04:31:32 +08:00
buxue 15593dc98f improve isinstance function in graph mode 2021-01-18 19:18:48 +08:00
yuchaojie b51b3a6764 update Pool's attr kernel_size, pad_mode 2021-01-18 12:10:20 +08:00
mindspore-ci-bot e214c69bc2 !11195 develop dice loss
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
2021-01-18 12:00:41 +08:00
buxue 69d9a33ddb show line of code when parse or resolve phase exception 2021-01-16 16:31:04 +08:00
Jiaqi 87ecd44f67 develop dice loss 2021-01-16 15:54:06 +08:00
TinaMengtingZhang d3fdbceb61 [Part II] Push down json save logic to IR and add getter to each IR node 2021-01-15 18:03:37 -05:00
mindspore-ci-bot eacc8bac89 !10755 [Numpy-Native] Add new numpy-native interfaces to mindspore.numpy
From: @yanglf1121
Reviewed-by: 
Signed-off-by:
2021-01-15 10:04:17 +08:00
mindspore-ci-bot a2d9c5914a !10944 Tensor op decoupling stage 2
From: @alexyuyue
Reviewed-by: 
Signed-off-by:
2021-01-15 05:28:50 +08:00
alex-yuyue b54e01bfb4 Tensor op decoupling stage 2
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-01-14 11:51:16 -05:00
buxue 7eaf84d07a remove attr support_non_tensor_input of cell 2021-01-14 16:19:23 +08:00
yanglf1121 72903c11c8 add array_ops, math_ops and tensor ops 2021-01-14 15:32:36 +08:00
mindspore-ci-bot 44507b4a64 !11200 support non tensor inputs for ms_function and grad of net
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
2021-01-14 14:41:08 +08:00
mindspore-ci-bot 151c0e2977 !11132 modify batchnormal and fusedbatchnormal
From: @Somnus2020
Reviewed-by: 
Signed-off-by:
2021-01-14 10:57:10 +08:00
buxue acec35d4d4 support non tensor inputs 2021-01-14 09:21:01 +08:00
lilei 9a45c4419c modify batch_normal 2021-01-13 20:59:46 +08:00
mindspore-ci-bot 1dd600d416 !11114 add perplexity metric
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
2021-01-13 14:58:59 +08:00
TinaMengtingZhang 4812fece80 [Part I] Push down json save logic to IR and add getter to each IR node 2021-01-12 11:17:45 -05:00
Jiaqi d6f4421a1d perplexity 2021-01-12 20:26:26 +08:00
Nat Sutyanyong 686772cce7 Migrate GeneratorOp resetting logic to IR optimizer (incl. debug code)
with comments from the peer view addressed
2021-01-11 12:20:40 -05:00
mindspore-ci-bot fb97aa327c !10881 add the tensor collection feature when record summary
From: @jiang-shuqiang
Reviewed-by: 
Signed-off-by:
2021-01-11 20:59:07 +08:00
jiangshuqiang ab5cc10250 add the tensor collection feature when record summary 2021-01-11 12:39:36 +08:00
liuxiao93 aacad990c3 Add grad of sort. 2021-01-11 09:07:46 +08:00
mindspore-ci-bot 7957a3b6f5 !10988 Tensor op decoupling stage 1
From: @ezphlow
Reviewed-by: 
Signed-off-by:
2021-01-09 05:12:10 +08:00
Eric be46ccf721 Started vision decoupling
map validate params

Changing bindings

Change behavior of vision.cc

Added signature and changed Cmake

Compiling

Need to fix compile

Added compiling random transforms

python changes for decoupling

two failed test case remaining

Compiling random choice

passes all ut

Changed assert

review comments

Added validate params

add back return value

Fix lint

py lint fix

pylint 2

Addressing comments
2021-01-08 09:42:20 -05:00
mindspore-ci-bot b355f5402b !10309 Port over getter pass and tensor fusion pass to IR
From: @ziruiwu
Reviewed-by: 
Signed-off-by:
2021-01-08 21:37:51 +08:00
Zirui Wu 0e68575e77 port over getter pass
port over tensor_op_fusion pass

add fusion support for prebuildOpeartion (TensorOpeartion)
2021-01-07 10:52:49 -05:00
Jiaqi f6de97fc27 bleu_score 2021-01-07 21:24:38 +08:00
mindspore-ci-bot 62888f23b8 !10400 roc and auc
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
2021-01-07 21:19:41 +08:00
mindspore-ci-bot 274e0aa750 !10885 add nll_loss operation
From: @jiangzg001
Reviewed-by: @liangchenghui,@wuxuejian
Signed-off-by: @liangchenghui
2021-01-07 14:15:22 +08:00
mindspore-ci-bot 1276715c11 !10939 surface distance
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
2021-01-07 11:02:15 +08:00
Jiaqi ef3f6d62db auc_roc 2021-01-07 10:55:16 +08:00
mindspore-ci-bot 09848d7ef3 !9083 add dice and hausdroff
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
2021-01-07 10:31:42 +08:00
mindspore-ci-bot 67296c08c7 !9502 add hausdroff distance
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
2021-01-07 10:31:32 +08:00
mindspore-ci-bot 1c942ce49f !10221 support grad accumulation for auto parallel
From: @yangzhenzhang
Reviewed-by: 
Signed-off-by:
2021-01-06 15:27:34 +08:00
mindspore-ci-bot 1f06cd63f3 !10436 Support to control whether to throw runtime exceptions in SummaryRecord
From: @ouwenchang
Reviewed-by: 
Signed-off-by:
2021-01-06 14:21:21 +08:00
mindspore-ci-bot 1d1f6841b9 !10937 keep consistent in Graph mode and PyNative mode for 'isinstance'
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
2021-01-06 10:29:49 +08:00
ougongchang 06be546b52 Support to control whether raise RuntimeError exception in SummaryRecord
1. Support explainer raise an RuntimeError exception
2. fix the ut of SummaryRecord
2021-01-06 10:07:47 +08:00
yangzhenzhang 9da3f9bec9 mini step grad accumulation 2021-01-06 09:25:06 +08:00
jiangzhenguang d3f42e7d6b add nll_loss operation. 2021-01-06 09:11:35 +08:00
mindspore-ci-bot 03e655f14a !10070 Fixing GetDatasetSize issue with chained samplers
From: @mahdirahmanihanzaki
Reviewed-by: 
Signed-off-by:
2021-01-06 05:11:51 +08:00
buxue 6d395c1d3f keep consistent in Graph mode and PyNative mode for 'isinstance' 2021-01-05 21:36:10 +08:00
mindspore-ci-bot a531628dd5 !10325 modify MetaTensor and Tensor
From: @Somnus2020
Reviewed-by: @kingxian
Signed-off-by: @kingxian
2021-01-05 17:50:34 +08:00
Jiaqi 29cd33a542 3d 2021-01-05 17:25:41 +08:00
Jiaqi 9a5b9525de hausdorff_distance 2021-01-05 17:20:57 +08:00
Jiaqi ed7cf87d0b surface distance 2021-01-05 17:13:12 +08:00
lilei b858097ae4 modify MetaTensor and Tensor 2021-01-04 20:58:34 +08:00
Payne b12ca2165c add bool expand dims and wait to test 2020-12-31 14:55:13 +08:00
mindspore-ci-bot 37a4cbfb3b !10772 Prevent the multiprocess.pool from capturing KeyboardInterrupt,
From: @ouwenchang
Reviewed-by: @wenkai_dist,@wangyue01
Signed-off-by: @wangyue01
2020-12-30 10:02:25 +08:00
ougongchang e5529230bf Prevent the multiprocess from capturing KeyboardInterrupt 2020-12-29 17:46:42 +08:00
mindspore-ci-bot 998483e0c3 !10610 add batchnorm3d and check in conv3d
From: @jiangzg001
Reviewed-by: @liangchenghui,@wuxuejian
Signed-off-by: @liangchenghui
2020-12-29 16:56:22 +08:00
jiangzhenguang 9f950fb16c add batchnorm3d 2020-12-29 09:37:35 +08:00
mindspore-ci-bot 2e684df5b1 !10686 fix infer rank list typo and add testcase
From: @gong_zi_yan
Reviewed-by: @stsuteng,@zhunaipan
Signed-off-by: @stsuteng
2020-12-28 21:20:19 +08:00
Ziyan 2c3b99ce91 fix infer rank list typo 2020-12-28 18:46:01 +08:00
mindspore-ci-bot 0d04de8db2 !10455 Expand J for innermost graph first when the graph also contains J primitive
From: @ginfung
Reviewed-by: @zhunaipan
Signed-off-by:
2020-12-28 14:42:07 +08:00
mindspore-ci-bot b67aaf6773 !9832 expose_allgather_fusion_to_users
From: @gong_zi_yan
Reviewed-by: 
Signed-off-by:
2020-12-28 09:54:57 +08:00
yujianfeng 728fac6c9f Expand J for innermost graph first when the graph also contains J primitive 2020-12-28 09:37:23 +08:00
Ziyan bbf8ec82b9 expose allgather fusion interface to users 2020-12-27 17:44:45 +08:00
buxue 1a7c161e73 support len of a Tensor 2020-12-26 17:02:25 +08:00
mindspore-ci-bot 4df0baa6c7 !10392 getitem fix bug
From: @yepei6
Reviewed-by: @zhunaipan,@kingxian,@zhunaipan
Signed-off-by: @kingxian
2020-12-24 20:49:17 +08:00
mindspore-ci-bot 221d5b67d2 !10442 change code in modelzoo to import dataset APIs from mindspore.dataset rather than mindspore.dataset.engine
From: @tiancixiao
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
2020-12-24 19:56:39 +08:00
Xiao Tianci 31fed1a2f6 change code to import APIs from mindspore.dataset rather than mindspore.dataset.engine 2020-12-24 17:30:02 +08:00
mindspore-ci-bot 261bb736de !10063 Modify profiler directory structure to fit the new Run Package
From: @gzhcv
Reviewed-by: 
Signed-off-by:
2020-12-24 16:53:13 +08:00
mindspore-ci-bot 1343c9cca2 !10255 using do_copy option to choose Tensor.from_numpy to do Tensor convert
From: @ms_yan
Reviewed-by: 
Signed-off-by:
2020-12-24 14:53:18 +08:00
mindspore-ci-bot e1248a7246 !10389 Fix the Backward of the AllSwap Operation
From: @huangxinjing
Reviewed-by: @stsuteng,@stsuteng,@zhunaipan
Signed-off-by: @stsuteng,@stsuteng
2020-12-24 09:38:29 +08:00
Payne 4f78ee0077 fix getitem bug 2020-12-23 22:02:23 +08:00
ms_yan deb1e6e965 use from_numpy and add do_copy option 2020-12-23 21:38:05 +08:00
mindspore-ci-bot 70dc40551a !10020 Improve fancy index from 1st dimension to arbitrarily dimension
From: @yepei6
Reviewed-by: 
Signed-off-by:
2020-12-23 21:23:36 +08:00
mindspore-ci-bot 20df37e428 !10287 Add ut for dataset to_number
From: @luoyang42
Reviewed-by: @heleiwang
Signed-off-by:
2020-12-23 21:14:42 +08:00
huangxinjing 565ce81b29 Fix allsawp 2020-12-23 17:17:03 +08:00
Zirui Wu a1355a827c introduce a master switch to turn on and off profiler 2020-12-22 16:48:01 -05:00
mindspore-ci-bot 176ea4676c !10261 change the int32 restrict to int restric
From: @yepei6
Reviewed-by: @kingxian,@kingxian
Signed-off-by: @kingxian,@kingxian
2020-12-22 20:39:29 +08:00
Payne 5c9982729d fancy index getitem 2020-12-22 18:13:16 +08:00
mindspore-ci-bot 9b3226c2b6 !10289 Ignore the graphs with defer_inline flag when specializing on graph arguments
From: @ginfung
Reviewed-by: @zh_qh
Signed-off-by: @zh_qh
2020-12-22 17:41:20 +08:00
Payne 236bfb75e3 change the int32 restrict to int 2020-12-22 17:35:02 +08:00
yujianfeng e1aa34a030 Ignore the graphs with defer_inline flag when specializing on graph arguments 2020-12-22 14:32:44 +08:00
mindspore-ci-bot 00611b1c41 !10175 Add tensor.ndim and rename tensor.size() to tensor.size
From: @yanglf1121
Reviewed-by: @kingxian,@zhunaipan
Signed-off-by: @kingxian
2020-12-22 14:13:10 +08:00
YangLuo da6de519ae Add ut for dataset to_number 2020-12-21 20:09:03 +08:00
mindspore-ci-bot f8e5bffe4d !10286 fix Wrong TypeError in numpy_native
From: @wangrao124
Reviewed-by: @zhunaipan,@kingxian
Signed-off-by: @kingxian
2020-12-21 19:30:08 +08:00
mindspore-ci-bot 441e283e21 !10197 Add input check for the embedding
From: @huangxinjing
Reviewed-by: @stsuteng,@zhunaipan
Signed-off-by: @stsuteng
2020-12-21 19:12:09 +08:00
wangrao 2fb3f0ef4f fix Wrong TypeError in numpy_native 2020-12-21 16:33:36 +08:00
Ziyan c5c905fdf5 add restriction for opt shard 2020-12-19 17:43:55 +08:00
mindspore-ci-bot 5ff6de83eb !10173 Fix Strategy Check for UnsortedSegments
From: @huangxinjing
Reviewed-by: @zhunaipan,@stsuteng
Signed-off-by: @stsuteng
2020-12-19 14:24:58 +08:00
mindspore-ci-bot d99189f681 !10207 Fix some minor doc, typo related to AutoNumWorker
From: @ziruiwu
Reviewed-by: @mikef
Signed-off-by:
2020-12-19 06:35:59 +08:00
Zirui Wu 4ae7102fd3 address 2 tickets 2020-12-18 15:03:32 -05:00
huangxinjing dd0da1542d Add input check 2020-12-18 19:54:49 +08:00
yanglf1121 918679daa3 add tensor.ndim and rename tensor.size() to tensor.size 2020-12-18 17:15:42 +08:00
huangxinjing a8446af1ab Fix condition check 2020-12-18 16:43:43 +08:00
gzhcv bad8c0e422 Modify profiling dir structure to fit the new Run Package 2020-12-18 11:04:07 +08:00
mindspore-ci-bot 893d59afd7 !10097 Fix bugs for np.mean, np.asarray, np.concatenate, np.linspace
From: @yanglf1121
Reviewed-by: 
Signed-off-by:
2020-12-18 09:10:51 +08:00
Mahdi 98ea8fa6ea Added tests for chain samplers, fixed GetDatasetSize issue with chained samplers 2020-12-17 13:26:42 -05:00
mindspore-ci-bot fc11b7dd68 !10074 Fix a testcase error when shuffle is above cache
From: @lixiachen
Reviewed-by: @liucunwei,@pandoublefeng
Signed-off-by: @liucunwei,@liucunwei
2020-12-17 19:56:26 +08:00
mindspore-ci-bot 691e3baab6 !10109 [MD] Fix Decode doc & RandomNode log
From: @luoyang42
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
2020-12-17 19:50:19 +08:00
mindspore-ci-bot 6035823c4b !10044 fix get num classes of concat
From: @luoyang42
Reviewed-by: @liucunwei,@heleiwang,@liucunwei
Signed-off-by: @liucunwei,@liucunwei
2020-12-17 19:30:50 +08:00
yanglf1121 760cd1870a corner cases check for np.asarray, np.mean, np.concatenate 2020-12-17 18:33:10 +08:00
luoyang 595b7a782f [MD] Fix Decode doc & RandomNode log 2020-12-17 17:04:31 +08:00
mindspore-ci-bot 734f50f36e !10083 support non tensor inputs in model predict
From: @zhangbuxue
Reviewed-by: @zhunaipan,@zh_qh
Signed-off-by: @zh_qh
2020-12-17 16:33:52 +08:00
buxue f90f77c16e support non tensor inputs in model predict 2020-12-17 14:17:41 +08:00
buxue aeeef7607a remove the 'raise' in construct of Cell 2020-12-17 10:54:42 +08:00
Lixia Chen a7f0e13234 Remove special treatment for cache above repeat 2020-12-16 21:13:04 -05:00
YangLuo df9f4f41e8 fix get num classes of concat 2020-12-16 14:58:32 +08:00
mindspore-ci-bot 26ff566f90 !10002 fix get dataset size in distributed scenario
From: @tiancixiao
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
2020-12-16 14:25:39 +08:00
Xiao Tianci 633f97bb48 fix get dataset size in distributed scenario 2020-12-15 20:41:45 +08:00
yanglf1121 9072283395 fix mindpsore.numpy packaging issue and format API comments 2020-12-15 18:06:55 +08:00
mindspore-ci-bot c4f284b928 !9910 [MD][Perf] MindData add NormalizePad for GPU performance
From: @xiefangqi
Reviewed-by: 
Signed-off-by:
2020-12-15 16:51:22 +08:00
mindspore-ci-bot b8faa8293b !9920 python eager add decode
From: @luoyang42
Reviewed-by: @liucunwei
Signed-off-by: @liucunwei
2020-12-15 16:37:39 +08:00
mindspore-ci-bot dd134d7554 !9926 optimize list setitem in bprop
From: @zhangbuxue
Reviewed-by: @zh_qh
Signed-off-by: @zh_qh
2020-12-15 16:20:07 +08:00
buxue 2530943a7f optimize list getitem in bprop 2020-12-15 15:00:49 +08:00
xiefangqi 3c6cc3c58c Add NormalizePadOp 2020-12-15 11:45:41 +08:00
YangLuo 18e61a627a python eager add decode 2020-12-15 10:00:59 +08:00
mindspore-ci-bot a9f2de8307 !9737 complete fancy index getitem
From: @yepei6
Reviewed-by: 
Signed-off-by:
2020-12-15 09:44:52 +08:00
Payne 4c8f0914d0 complete fancy index getitem 2020-12-14 22:18:38 +08:00
mindspore-ci-bot ca4225a4f3 !9717 amend some script
From: @jiangzg001
Reviewed-by: @liangchenghui,@c_34
Signed-off-by: @liangchenghui
2020-12-14 19:39:15 +08:00
mindspore-ci-bot 3a803b3c18 !9862 Fix the bug of ImageNetToMR
From: @shenwei41
Reviewed-by: @pandoublefeng,@liucunwei
Signed-off-by: @liucunwei
2020-12-14 15:53:14 +08:00
jiangzhenguang 9cf856dd25 amend some script 2020-12-14 11:08:20 +08:00
mindspore-ci-bot ad6507d88a !9825 [MD] fix pad, normalize in c_trasnform
From: @luoyang42
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
2020-12-14 10:48:10 +08:00
mindspore-ci-bot e10dbb4a7f !9723 add ir passes to unify mindir
From: @yuchaojie
Reviewed-by: 
Signed-off-by:
2020-12-14 10:14:47 +08:00
jjfeing 1984cf8e20 unify mindir 2020-12-12 17:55:16 +08:00
buxue 70d12aae26 add detailed and accurate description for support non tensor inputs for outermost net. 2020-12-12 16:54:08 +08:00
shenwei41 547f96717b Fix Bug 2020-12-12 11:35:34 +08:00
mindspore-ci-bot d5db8872fd !9834 Fix wrong input argument of Reshape for multi field embedding
From: @huangxinjing
Reviewed-by: @zhunaipan,@stsuteng
Signed-off-by: @stsuteng
2020-12-11 21:31:48 +08:00
huangxinjing 996ee72c50 Fix embedding layer
Fix input check
2020-12-11 19:13:09 +08:00
mindspore-ci-bot 5e35bec957 !9799 change_last_nodes_strategy_in_auto_parallel_when_eval_and_predict
From: @yao_yf
Reviewed-by: @zhunaipan,@stsuteng
Signed-off-by: @stsuteng
2020-12-11 17:51:32 +08:00
luoyang 1cc147df1d fix pad, normalize in c_trasnform 2020-12-11 17:46:29 +08:00
mindspore-ci-bot 10d326ee62 !9798 hide arange
From: @bairongz
Reviewed-by: @zh_qh,@zhunaipan
Signed-off-by: @zh_qh
2020-12-11 15:29:33 +08:00
yao_yf 19fe28cb9b hange strategys of last nodes in eval/predict at auto parallel mode 2020-12-11 11:11:28 +08:00
Zirui Wu 77521e78d2 staging 2020-12-10 14:45:04 -05:00
Bairong 8cf43e59e0 hide arange, delete related test case and improve the doc string of nn.Range 2020-12-10 21:42:59 +08:00
mindspore-ci-bot 8c0d066bf9 !9763 Change name from interpolate to resizeBilinear
From: @liangzhibo
Reviewed-by: @ginfung,@zh_qh,@zhunaipan
Signed-off-by: @zh_qh
2020-12-10 17:41:14 +08:00
Xiaoda Zhang e78228603b move parallel-related black-list to core/ir, and fix the cloneCNode bug 2020-12-10 15:57:01 +08:00
l00591931 130c61cfc0 change name from interpolate to resizeBilinear 2020-12-10 11:46:40 +08:00
mindspore-ci-bot 9ecf062581 !9552 change the import level of dynamic_lr
From: @wangnan39
Reviewed-by: @kingxian,@zh_qh,@kingxian
Signed-off-by: @kingxian,@kingxian
2020-12-10 11:15:08 +08:00
mindspore-ci-bot 78fba32865 !9752 Fix potential hang in RandomData and incorrectly named functions
From: @ziruiwu
Reviewed-by: @heleiwang,@pandoublefeng
Signed-off-by: @pandoublefeng
2020-12-10 10:51:01 +08:00
mindspore-ci-bot 3f82405d17 !9639 Add Numpy Native to Mindspore
From: @yanglf1121
Reviewed-by: 
Signed-off-by:
2020-12-10 09:45:16 +08:00
Zirui Wu 91a6b2b0ca Add checks to RandomData and LookUp 2020-12-09 17:09:34 -05:00
yanglf1121 59e5afd2bb Add mindnumpy to mindspore 2020-12-09 21:35:16 +08:00
wangnan39@huawei.com 0fe9e2e4cb support import dynamic_lr from nn 2020-12-09 17:47:52 +08:00
mindspore-ci-bot a2aea8cba5 !9578 add_conv3d_transpose_object
From: @jiangzg001
Reviewed-by: @liangchenghui,@liangchenghui
Signed-off-by: @liangchenghui
2020-12-09 16:41:48 +08:00
mindspore-ci-bot 6d34bacc17 !9470 support arange in functional.py
From: @bairongz
Reviewed-by: @ginfung
Signed-off-by:
2020-12-09 14:39:36 +08:00
jiangzhenguang 5060565920 add conv3d_transpose. 2020-12-09 13:48:23 +08:00
mindspore-ci-bot 317a97e6b9 !9336 auto num_parallel_workers setup
From: @ziruiwu
Reviewed-by: 
Signed-off-by:
2020-12-09 08:32:55 +08:00
mindspore-ci-bot a2c80435ce !9685 Fix a core dump in TreeConsumer::Terminate() plus minor cache fixes
From: @lixiachen
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
2020-12-09 08:21:22 +08:00
Zirui Wu d6df1b0832 Implemented AutoNumWorker Pass which sets num_workers of selected parallel ops automatically if enabled 2020-12-08 17:49:05 -05:00
Lixia Chen 32b82c2737 Fix a core dump in TreeConsumer::Terminate()
and other minor cache changes
2020-12-08 15:38:40 -05:00
mindspore-ci-bot 934005f390 !9636 Remove batch_map multi-process test case
From: @hfarahat
Reviewed-by: @nsyca,@mikef
Signed-off-by: @mikef
2020-12-08 23:24:56 +08:00
mindspore-ci-bot 231fccf66c !9600 Add Adagrad Optimizer
From: @zyx5256
Reviewed-by: @liangchenghui,@kingxian
Signed-off-by: @liangchenghui
2020-12-08 18:29:18 +08:00
hesham ff65f6feb8 Remove batch_map multiprocess test case 2020-12-08 00:36:02 -05:00
mindspore-ci-bot f6a22cb455 !9591 Assignment enables negative index
From: @liangzhibo
Reviewed-by: @ginfung,@zh_qh
Signed-off-by: @zh_qh
2020-12-08 11:03:48 +08:00
mindspore-ci-bot ec3983b77d !9577 support distributed predict
From: @gong_zi_yan
Reviewed-by: @caozhou_huawei,@yao_yf,@stsuteng,@zh_qh
Signed-off-by: @stsuteng
2020-12-08 10:28:30 +08:00
zhuyuxiao 37bebc751b add adagrad optim 2020-12-08 09:38:15 +08:00
mindspore-ci-bot e6ec9be6c2 !9386 l1_regularizer开发
From: @dangjiaqi1
Reviewed-by: 
Signed-off-by:
2020-12-07 21:58:58 +08:00