Nigel
/
mindspore
forked from mindspore-Ecosystem/mindspore
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
35,316 Commits 24 Branches 0 Tags 3.9 GiB
Commit Graph

3187 Commits

Author SHA1 Message Date
i-robot ff3ad7428a !18413 add parallel op for batch norm 
Merge pull request !18413 from yangzhenzhang/add-parallel-op-for-batchnorm
 2021-06-18 03:08:07 +00:00
caifubi 95695711d7 Remove PyNative Parameter Check 2021-06-18 09:46:27 +08:00
i-robot ab3259c43a !18292 MD Profiling UT: Check CPU util file. Add sequential pipeline UTs 
Merge pull request !18292 from cathwong/ckw_mon_py_analyze_ut4
 2021-06-17 21:47:10 +08:00
wangshuide2020 185ddbbe66 remove the redundant code, add docstring of operator init and add default value for args. 2021-06-17 20:29:52 +08:00
yangzhenzhang af0d28de48 add parallel op for batchnorm 2021-06-17 15:43:24 +08:00
liyong 2989a5a23b fix some bugs 2021-06-17 11:56:10 +08:00
Cathy Wong c37eb350f6 MD Profiling UT: Check CPU util file. Add sequential pipeline UTs 2021-06-16 15:30:59 -04:00
i-robot 7ff63a8e70 !17894 Add support for mindir encryption 
Merge pull request !17894 from liuluobin/master
 2021-06-15 15:15:40 +08:00
i-robot 85d860e6a2 !16457 [AutoParallel]pipeline_split_adapt_master 
Merge pull request !16457 from lichen/pipeline_split_adapt_master
 2021-06-11 11:37:40 +08:00
liuluobin 5b9b46224b Add encryption support for mindir 2021-06-11 09:33:45 +08:00
i-robot 21513404c4 !17082 set default context mode to GRAPH_MODE 
Merge pull request !17082 from huangbingjian/change_context_mode
 2021-06-10 21:21:46 +08:00
lichenever db5d508356 pipeline_split_adapt_master 2021-06-10 20:17:33 +08:00
i-robot dc9720cbb2 !17999 add parallel operator for conv2d 
Merge pull request !17999 from yangzhenzhang/add-parallel-operator-for-conv2d
 2021-06-10 20:05:45 +08:00
i-robot 62a165a3a2 !16917 Add Crop Python API for CV data processing 
Merge pull request !16917 from xiaotianci/crop
 2021-06-10 17:16:04 +08:00
i-robot c293f06b27 !17373 add docs, user-example and assertion for rearrange_inputs 
Merge pull request !17373 from zhiqwang/rearrange-inputs-docs
 2021-06-10 16:17:23 +08:00
yangzhenzhang 7a40741048 add parallel operator for conv2d 2021-06-10 14:58:51 +08:00
i-robot 3a13dde14d !17761 add save ckpt info 
Merge pull request !17761 from changzherui/add_ckpt_info
 2021-06-10 11:01:18 +08:00
i-robot b79400296a !17959 fix optimizer weight shard config 
Merge pull request !17959 from gziyan/add_optimizer_weight_shard_config
 2021-06-10 10:49:17 +08:00
Xiao Tianci a54e65a7ad add Crop Python API 2021-06-10 09:46:57 +08:00
i-robot e60f5f12f5 !17836 Add Rotate API for CV data processing 
Merge pull request !17836 from xiaotianci/rotate
 2021-06-10 09:29:18 +08:00
changzherui 7a05132ed4 add ckpt save info 2021-06-09 22:42:27 +08:00
Cathy Wong a8de1327d9 MD Profiling Analyze: Add class BottleneckAnalyzer 2021-06-09 09:24:32 -04:00
zhiqiang f43d720eb0 Add docs and user-example for rearrange_inputs 2021-06-09 04:19:32 -04:00
huangbingjian ad8f73f32b set default context mode to GRAPH_MODE 2021-06-09 14:40:49 +08:00
i-robot 50f11d5439 !17503 dataset: enhance the expression of error msg 
Merge pull request !17503 from ms_yan/log_modify
 2021-06-08 22:25:04 +08:00
Xiao Tianci 9c4c1c6a77 add Rotate Python API 2021-06-08 22:19:15 +08:00
i-robot 3a63a66d64 !17807 MD Profiling UT: Add MD Analyze UT for MinddataProfilingAnalyzer 
Merge pull request !17807 from cathwong/ckw_mon_py_analyze_ut3
 2021-06-08 21:52:55 +08:00
ms_yan be65ebcb28 complete dataset log 2021-06-08 16:45:47 +08:00
mindspore-ci-bot 8934e4a513 !17879 dynamic min max shape phase 2 
From: @luoyang42
Reviewed-by: @liucunwei,@jonyguo
Signed-off-by: @liucunwei
 2021-06-08 14:49:13 +08:00
Ziyan 95ac0f6d58 fix optimizer weight shard config 2021-06-08 10:44:17 +08:00
Cathy Wong b7342efe12 MD Profiling UT: Add MD Analyze UT. Add more pipeline profiling UTs. 2021-06-07 11:00:34 -04:00
luoyang dad289c679 dynamic min max shape phase 2 2021-06-07 20:06:26 +08:00
Zhenglong Li 2c7d1bf603 Implement new gnn feature 2021-06-07 10:20:06 +08:00
mindspore-ci-bot e5a189a4f0 !17520 Optimize exception info when compile net failed 
From: @irmo
Reviewed-by: @ginfung,@zh_qh
Signed-off-by: @zh_qh
 2021-06-05 12:04:28 +08:00
mindspore-ci-bot e19e14295a !17773 adapt offline debugger to new dump, sync support for iteration ranges, GPU default dump mode correction 
From: @john_tzanakakis
Reviewed-by: @nsyca,@mikef
Signed-off-by: @mikef
 2021-06-05 02:46:50 +08:00
John Tzanakakis 7d460de8b4 adapt offline debuger to new dump, sync support for iteration ranges, GPU default dump mode correction 2021-06-04 08:38:50 -04:00
mindspore-ci-bot 7d9bf65654 !16755 support list add list in net in GraphMode. 
From: @fenglovebei
Reviewed-by: @zh_qh
Signed-off-by: @zh_qh
 2021-06-04 16:37:40 +08:00
huanghui 29f632613f optimize log 2021-06-04 12:32:44 +08:00
mindspore-ci-bot 97989c3bbc !17669 Substitute _Loss for Loss 
From: @c_34
Reviewed-by: @guoqi1024,@liangchenghui
Signed-off-by: @guoqi1024,@liangchenghui
 2021-06-04 10:20:00 +08:00
mindspore-ci-bot a3f2b92839 !17638 modify vgg16 network for clould 
From: @zhanghuiyao
Reviewed-by: @c_34,@wuxuejian
Signed-off-by: @c_34
 2021-06-04 09:21:30 +08:00
fenglovebei 76b884dea9 list add list 2021-06-03 21:16:30 +08:00
chenhaozhe 9da8534396 change _Loss to Loss 2021-06-03 15:26:59 +08:00
zhanghuiyao 36ec89656a modify vgg16 network for clould 2021-06-03 11:39:27 +08:00
mindspore-ci-bot b52f9ddb08 !17060 Add HorizontalFlip and VerticalFlip for CV data processing 
From: @tiancixiao
Reviewed-by: @liucunwei
Signed-off-by: @liucunwei
 2021-06-02 17:48:28 +08:00
mindspore-ci-bot c4757f0692 !17461 MD Profiling Analyze: Handle cpu util with missing ops. Enhance UTs. 
From: @cathwong
Reviewed-by: @robingrosman
Signed-off-by: @robingrosman
 2021-06-02 11:12:59 +08:00
mindspore-ci-bot c77e7de1dc !17313 fix static check 
From: @jiang-shuqiang
Reviewed-by: @yelihua,@ouwenchang
Signed-off-by: @ouwenchang
 2021-06-02 08:50:37 +08:00
mindspore-ci-bot ae2e7c1288 !17541 Fix MD Cache code check warnings [master] 
From: @lixiachen
Reviewed-by: @pandoublefeng,@robingrosman
Signed-off-by: @robingrosman
 2021-06-02 04:53:54 +08:00
Lixia Chen 8c1b561149 Fix cache code check warnings 2021-06-01 10:02:38 -04:00
mindspore-ci-bot a92a450881 !17383 Optimize exception info print 
From: @irmo
Reviewed-by: @zh_qh,@ginfung,@ginfung
Signed-off-by: @zh_qh
 2021-06-01 17:43:24 +08:00
Cathy Wong f8beb933ad MD Profiling Analyze: Handle cpu util with missing ops. Enhance UTs. 2021-05-31 20:33:19 -04:00
mindspore-ci-bot 4338e4abac !17374 files_need_cleanup report fixes to master 
From: @hfarahat
Reviewed-by: @pandoublefeng,@robingrosman
Signed-off-by: @robingrosman
 2021-06-01 05:21:18 +08:00
jiangshuqiang 6154f957fb fix static check 2021-05-31 16:47:21 +08:00
Xiao Tianci 9c74d55a49 add HorizontalFlip and VerticalFlip APIs 2021-05-31 15:55:21 +08:00
huanghui 5acf3c8ade [dfx]optimize exception info print 2021-05-31 14:57:29 +08:00
mindspore-ci-bot 8c1e7ce231 !16345 [DFX]Optimize exception log 
From: @irmo
Reviewed-by: 
Signed-off-by:
 2021-05-31 09:22:48 +08:00
mindspore-ci-bot 04341b1dbc !17076 fix log error for pynative mode 
From: @chujinjin
Reviewed-by: @zhoufeng54,@kisnwang
Signed-off-by: @kisnwang
 2021-05-31 09:22:29 +08:00
hesham 3a9695313b files_need_cleanup fixes 2021-05-30 15:44:08 -04:00
huanghui 0610a8d99c 9fdc0035a0 2021-05-29 10:31:23 +08:00
mindspore-ci-bot 1c8fda25ef !16478 handle load op in step parallel 
From: @gong_zi_yan
Reviewed-by: @yangzhenzhang,@stsuteng
Signed-off-by: @stsuteng
 2021-05-29 09:32:35 +08:00
mindspore-ci-bot b45b63fc58 !17239 add parallel gathernd test case 
From: @hanyang001
Reviewed-by: @stsuteng,@yangzhenzhang
Signed-off-by: @stsuteng
 2021-05-29 09:11:25 +08:00
mindspore-ci-bot 5e87097d15 !17240 add parallel layernorm test case 
From: @hanyang001
Reviewed-by: @stsuteng,@yangzhenzhang
Signed-off-by: @stsuteng
 2021-05-29 09:11:08 +08:00
Wan Hanyang c51dff2634 add parallel gathernd test case 2021-05-28 17:21:11 +08:00
Wan Hanyang 3ce521d78f add parallel layernorm test case 2021-05-28 17:20:04 +08:00
YangLuo ac319b3a79 Fix mindrecord UTs: files existed causes write exception 2021-05-28 15:13:48 +08:00
Ziyan 4b17493e52 handle load in step parallel 2021-05-28 09:16:40 +08:00
chujinjin 7fb3b5ea97 fix log error 2021-05-27 17:19:10 +08:00
mindspore-ci-bot 1e8868cecc !16727 handle duplicate code 
From: @yangzhenzhang
Reviewed-by: @stsuteng,@jjfeing
Signed-off-by: @stsuteng
 2021-05-26 10:58:54 +08:00
mindspore-ci-bot 2433778dac !15963 Support getting dynamic_min_max_shape of data 
From: @luoyang42
Reviewed-by: 
Signed-off-by:
 2021-05-26 09:41:02 +08:00
mindspore-ci-bot 730e211e52 !16702 Add GaussianBlur API for CV data processing 
From: @tiancixiao
Reviewed-by: @liucunwei,@jonyguo
Signed-off-by: @liucunwei
 2021-05-26 09:09:41 +08:00
mindspore-ci-bot d0978f709a !16167 CocoDataset add a new column according a new arg extra_metadata 
From: @xiefangqi
Reviewed-by: 
Signed-off-by:
 2021-05-25 19:55:41 +08:00
yangzhenzhang d711d98f07 clean duplicate code 2021-05-25 17:25:34 +08:00
mindspore-ci-bot e513786709 !16565 Bug in Normalize when num_channels > 128 
From: @hfarahat
Reviewed-by: @robingrosman,@pandoublefeng
Signed-off-by: @robingrosman
 2021-05-25 10:24:25 +08:00
xiefangqi 53891dbdf7 coco add img_id column 2021-05-24 17:19:58 +08:00
luoyang 13ef5b61f3 support getting dynamic_min_max_shape of data 2021-05-24 17:04:50 +08:00
Xiao Tianci 3f495bbae1 add GaussianBlur API 2021-05-24 16:27:05 +08:00
liuxiao93 1160088c8f support avgpool3d 2021-05-22 14:44:11 +08:00
yao_yf 732d13ccff parallel dropout support repeated compute 2021-05-20 19:42:13 +08:00
mindspore-ci-bot 05bbd1d8fa !16426 Change the permission of cache shared memory to 600 for security 
From: @lixiachen
Reviewed-by: @robingrosman,@pandoublefeng
Signed-off-by: @robingrosman
 2021-05-20 02:36:26 +08:00
mindspore-ci-bot c47356d77b !16502 check Optimizer parameters must be list 
From: @wangnan39
Reviewed-by: @zh_qh,@kingxian
Signed-off-by: @zh_qh,@kingxian
 2021-05-19 09:23:56 +08:00
mindspore-ci-bot 1cb2d31642 !16509 GNN dataset new feature for invalid edge or node id case 
From: @lizhenglong1992
Reviewed-by: @liucunwei,@heleiwang
Signed-off-by: @liucunwei
 2021-05-19 09:20:24 +08:00
hesham bc92011b5f Bug in Normalize when num_channels > 128 2021-05-18 12:23:11 -04:00
mindspore-ci-bot ed72a0d9c3 !16497 Add more accurate abstract join error information 
From: @huangbingjian
Reviewed-by: @zh_qh,@ginfung
Signed-off-by: @zh_qh
 2021-05-18 19:36:11 +08:00
Zhenglong Li 9284b6d6af Add special case returned value for get feature function 2021-05-18 15:53:01 +08:00
mindspore-ci-bot ec9fc5fb3b !16384 Fix python multiprocessing with shared memory for edge case 
From: @robingrosman
Reviewed-by: @mikef
Signed-off-by: @mikef
 2021-05-18 10:30:19 +08:00
Lixia Chen 8812111f94 change shared mem perm to 600 & minor other fixes 2021-05-17 17:19:55 -04:00
wangnan39@huawei.com 2761776699 add check for optimizer parameters 2021-05-17 22:23:03 +08:00
huangbingjian 81624dd501 add more error report to abstract join 2021-05-17 21:14:17 +08:00
mindspore-ci-bot 9d423638b3 !16466 Fix code check of python pass 
From: @irmo
Reviewed-by: @ginfung,@zh_qh
Signed-off-by: @zh_qh
 2021-05-17 21:00:16 +08:00
mindspore-ci-bot 601322356b !15638 VOCDataset need to add img_id for evaluation 
From: @xiefangqi
Reviewed-by: @liucunwei
Signed-off-by: @liucunwei
 2021-05-17 19:33:24 +08:00
xiefangqi 9b846c7873 voc add image_id column 2021-05-17 16:09:04 +08:00
huanghui 53e32077c1 fix code check 2021-05-17 11:20:35 +08:00
mindspore-ci-bot 8cfb5b8aea !16332 Add environment variable to enable recursive evaluate. 
From: @zh_qh
Reviewed-by: @ginfung,@kingxian
Signed-off-by: @ginfung
 2021-05-17 11:00:40 +08:00
RobinGrosman ca88d7d76a fix edge case and docstring in minddata multiprocessing shared memory code 2021-05-16 06:46:44 -07:00
Zhang Qinghua bea16101c3 Add environment variable to enable recursive evaluate. 2021-05-14 20:01:19 +08:00
jonyguo 9452142b50 enhance: enable shuffle infile / files when mindrecord 2021-05-14 17:41:18 +08:00
mindspore-ci-bot b5cddcb8cc !16036 Improve performance of multi-processing option for dataset 
From: @robingrosman
Reviewed-by: 
Signed-off-by:
 2021-05-13 01:41:16 +08:00
RobinGrosman 9a7d1fc034 Optimize multi-process in minddata by passing data via shared memory instead of multiprocessing.queue 2021-05-11 15:16:29 -07:00
mindspore-ci-bot 8c5680360d !16200 [Debugger] Fix empty result when reading non-existent tensor 
From: @tina_mengting_zhang
Reviewed-by: @john_tzanakakis,@robingrosman
Signed-off-by: @john_tzanakakis
 2021-05-12 03:08:00 +08:00
mindspore-ci-bot ebed057e72 !16196 If Imagefolder input directory is not right, will occur out of memory error 
From: @xiefangqi
Reviewed-by: @ms_yan,@heleiwang,@jonyguo
Signed-off-by: @jonyguo
 2021-05-11 17:36:28 +08:00
mindspore-ci-bot 4c71d9d1df !15675 add more tensor methods 
From: @yanglf1121
Reviewed-by: @liangchenghui
Signed-off-by:
 2021-05-11 14:32:29 +08:00
mindspore-ci-bot 9b4ff99305 !16158 modify check strategy for scatter update 
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
 2021-05-11 09:41:07 +08:00
mindspore-ci-bot d3a175e30f !16078 Modify Normalize to accept images with more than 3 channels 
From: @hfarahat
Reviewed-by: @mikef,@robingrosman
Signed-off-by: @robingrosman
 2021-05-11 02:03:34 +08:00
TinaMengtingZhang a44376f42a Fix empty tensor issue when reading an non-existing node in sync dump mode 2021-05-10 13:59:05 -04:00
xiefangqi e0148f7181 fix minddata directory path problem 2021-05-10 22:16:37 +08:00
yepei6 acbd7eb023 add more tensor methods 2021-05-10 14:40:53 +08:00
yangzhenzhang 6aa3859131 modify check strategy for scatter update 2021-05-10 11:22:00 +08:00
mindspore-ci-bot ee885b4e58 !15180 enable not fully use opt shard 
From: @gong_zi_yan
Reviewed-by: @stsuteng
Signed-off-by: @stsuteng
 2021-05-08 14:57:58 +08:00
mindspore-ci-bot b86747b9a6 !15813 Convert some pipeline Ops to be inlined 
From: @hfarahat
Reviewed-by: 
Signed-off-by:
 2021-05-08 05:30:39 +08:00
hesham fd943bbdc0 Modify normalize to support multiple of channels 2021-05-07 17:06:26 -04:00
Ziyan 2a752f24bf enable not fully use opt shard 2021-05-07 15:32:48 +08:00
mindspore-ci-bot d76574bbbf !15973 parallel env variables check 
From: @yao_yf
Reviewed-by: @yangzhenzhang,@stsuteng
Signed-off-by: @stsuteng
 2021-05-07 12:13:41 +08:00
mindspore-ci-bot e0422e972e !16019 If dataset_dir is not a dir or something else validation is not right somehow 
From: @xiefangqi
Reviewed-by: @ms_yan,@liucunwei,@jonyguo
Signed-off-by: @liucunwei
 2021-05-07 11:57:31 +08:00
mindspore-ci-bot b85bf60eb8 !15727 VOCDataset read xml will filter invalid bbox automationally 
From: @xiefangqi
Reviewed-by: @heleiwang,@jonyguo
Signed-off-by: @jonyguo
 2021-05-07 09:50:53 +08:00
yao_yf e967f1939b parallel envs variable check 2021-05-07 09:12:53 +08:00
mindspore-ci-bot eb08d2e952 !16024 dataset: modify some error msg in dataset module 
From: @ms_yan
Reviewed-by: @jonyguo,@heleiwang
Signed-off-by: @jonyguo
 2021-05-07 09:12:46 +08:00
ms_yan 34dcd2b463 modify log of dataset part 2021-05-06 23:33:17 +08:00
xiefangqi b6e1fceedc minddata modify dir validation 2021-05-06 21:35:31 +08:00
Lixia Chen 5967cb2cd7 Unblock mindrecord under cache 2021-05-05 13:28:13 -04:00
hesham e4c0bd51a5 Modify concat to be an inlined Op 
Modify zip to be an inlined Op
Modify take to be an inlined Op
Modify skip to be an inlined Op
Modify rename to be an inlined Op
Modify filter to consume child's rows using one thread
 2021-05-04 12:45:18 -04:00
mindspore-ci-bot c13ed20dad !15907 add type convert during load checkpoint 
From: @changzherui
Reviewed-by: @kingxian,@zh_qh
Signed-off-by: @kingxian
 2021-04-30 15:52:41 +08:00
mindspore-ci-bot ee3012fd3f !15303 add lsq quantization method 
From: @erpim
Reviewed-by: 
Signed-off-by:
 2021-04-30 11:26:42 +08:00
mindspore-ci-bot ac912672bf !15871 Support pass args or|and kwargs for OP CreateInstance. 
From: @zh_qh
Reviewed-by: @ginfung,@hwhewei
Signed-off-by: @hwhewei
 2021-04-30 10:39:04 +08:00
mindspore-ci-bot cefcf6c2ae !15931 Add eager tests for transform ops, and add a shape comparison in the EXPECT_MSTENSOR_EQ Macro 
From: @alexyuyue
Reviewed-by: @nsyca,@robingrosman
Signed-off-by: @robingrosman
 2021-04-30 06:15:12 +08:00
alex-yuyue 9ef4331f56 Add eager tests for transform ops 
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
 2021-04-29 13:19:24 -04:00
changzherui 85025804ef add type convert during load checkpoint 2021-04-29 17:38:16 +08:00
Zhang Qinghua cd7f7d40fb Support pass args or|and kwargs for OP CreateInstance. 2021-04-29 14:14:58 +08:00
mindspore-ci-bot 33966f0cd5 !15744 Add encryption for ckpt file 
From: @liu_luobin
Reviewed-by: @baochong,@chongbao
Signed-off-by:
 2021-04-29 11:18:50 +08:00
mindspore-ci-bot 577cf7cd1d !15758 [Offline Debug] Add UT tests to the offline debugger. 
From: @islam_amin
Reviewed-by: @john_tzanakakis,@tom__chen,@robingrosman
Signed-off-by: @john_tzanakakis
 2021-04-29 04:33:02 +08:00
Islam Amin 6bb740f137 added GPU UT tests 2021-04-28 13:03:51 -04:00
liuluobin a40229d171 Add encryption for ckpt file 2021-04-28 16:24:29 +08:00
mindspore-ci-bot 78fcdbc7c9 !15790 modify scatter update op 
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
 2021-04-28 10:48:19 +08:00
mindspore-ci-bot b663bbd9ca !15597 [MD] save op support variable dimension 0 
From: @liyong126
Reviewed-by: @liucunwei,@jonyguo
Signed-off-by: @liucunwei
 2021-04-28 09:38:58 +08:00
mindspore-ci-bot cbca36d723 !15766 modify tile op 
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
 2021-04-28 09:17:17 +08:00
Erpim 90d5d5dab3 add lsq quantization method 2021-04-27 20:48:04 +08:00
yangzhenzhang 075f680a42 modify scatter update op 2021-04-27 20:23:14 +08:00
liyong 587247e793 add support save dynamic shape tensor 2021-04-27 19:15:10 +08:00
mindspore-ci-bot 9e650da6d7 !15578 numpy-native tensor setitem bug fix & restructure 
From: @jachua
Reviewed-by: @guoqi1024,@kisnwang
Signed-off-by: @kisnwang
 2021-04-27 15:20:25 +08:00
xiefangqi 458ff5fed9 md fix voc and manifest error scenario 2021-04-27 14:24:57 +08:00
Xiaoda Zhang aa52399200 Making the Tile operator to have more parallel strategies 2021-04-27 11:36:40 +08:00
huangmengxi d6be043cb9 fix & restructure setitem 2021-04-27 10:03:10 +08:00
mindspore-ci-bot e3d54b7e3b !15695 dont insert VirtualOutput for scalar 
From: @yao_yf
Reviewed-by: @yangzhenzhang,@stsuteng
Signed-off-by: @stsuteng
 2021-04-27 09:25:30 +08:00
mindspore-ci-bot 83cdb8bb38 !15560 Optimize cache_admin tool to allow multiple session destroy 
From: @lixiachen
Reviewed-by: @robingrosman,@nsyca
Signed-off-by: @robingrosman
 2021-04-27 07:55:29 +08:00
yao_yf 093ef784de dont insert virtualoutput for scalar 2021-04-26 19:55:16 +08:00
mindspore-ci-bot d328fdcf61 !15200 profiler: fixed AICPU timeline 
From: @zhangyunshu
Reviewed-by: @yelihua,@ouwenchang
Signed-off-by: @ouwenchang
 2021-04-26 11:06:50 +08:00
mindspore-ci-bot 3cfd58e8e0 !15643 insert virtual div only for first input of dropout do mask 
From: @yangzhenzhang
Reviewed-by: @stsuteng,@kisnwang
Signed-off-by: @stsuteng
 2021-04-26 09:21:00 +08:00
mindspore-ci-bot 49d6c029a6 !15542 split axis and batch for gather 
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng,@stsuteng
Signed-off-by: @stsuteng,@stsuteng
 2021-04-25 19:33:09 +08:00
mindspore-ci-bot 7dc9eb3e0b !15396 add parallel virtual output in eval/predict 
From: @yao_yf
Reviewed-by: @yangzhenzhang,@stsuteng
Signed-off-by: @stsuteng
 2021-04-25 17:43:13 +08:00
yangzhenzhang 5828973978 fix bug for dropout do mask 2021-04-25 16:47:44 +08:00
yao_yf 21276408b8 parallel virtual_out_ops 2021-04-25 11:18:54 +08:00
Lixia Chen 44fb7ac4bb Add support for multi-session destroy 2021-04-23 11:17:06 -04:00
yangzhenzhang 213922574e split axis and batch for gatherv2 2021-04-23 16:59:35 +08:00
zhiqiang 2a0b443cc4 Add indexes attribute and make metrics indexes recognizable 2021-04-23 04:32:02 -04:00
mindspore-ci-bot b77c3f093d !15436 augassign 
From: @yepei6
Reviewed-by: @yanglf1121,@kingxian
Signed-off-by: @kingxian
 2021-04-23 14:58:35 +08:00
yepei6 81789ffb5d augassign 2021-04-23 11:58:07 +08:00
changzherui f63a13b2e9 modify check file name bug 2021-04-23 08:57:43 +08:00
mindspore-ci-bot e43a57fd37 !15525 clean code not used 
From: @zhangzhaoju
Reviewed-by: @zh_qh,@ginfung
Signed-off-by: @zh_qh
 2021-04-22 20:04:57 +08:00
mindspore-ci-bot 1ecc638fad !15442 modify code method metrics 
From: @changzherui
Reviewed-by: @kingxian,@zhoufeng54
Signed-off-by: @kingxian
 2021-04-22 16:58:36 +08:00
zhangzhaoju 6a2aee492c Clean code that not used 2021-04-22 16:24:05 +08:00
mindspore-ci-bot b760d1235f !15416 Update normalization description at nn/layer/normalization.py 
From: @dinglinhe123
Reviewed-by: @liangchenghui,@wuxuejian
Signed-off-by: @liangchenghui
 2021-04-21 15:05:33 +08:00
changzherui 1f4c17edca modify clean code 2021-04-21 10:56:16 +08:00
dinglinhe 54fb72e2b3 Update normalization description at nn/layer/normalization.py 2021-04-20 12:30:37 +08:00
yangzhenzhang c2ca2232c5 add select op 2021-04-20 09:23:22 +08:00
mindspore-ci-bot 1c9d3c0aa0 !15353 add parallel operator for scatter update 
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
 2021-04-20 09:03:08 +08:00
Cathy Wong 636809c255 dataset: C++ API ToNumber & Lookup: change data_type parm from string to DataType 2021-04-19 12:35:37 -04:00
mindspore-ci-bot 0fd1726e79 !15172 Clean GraphKernel's codes from frontend 
From: @dayschan
Reviewed-by: @gaoxiong1,@dylangeng,@gaoxiong1
Signed-off-by: @dylangeng,@dylangeng
 2021-04-19 09:34:35 +08:00
yangzhenzhang 9cdd70433f add scatterupdate op 2021-04-17 17:32:48 +08:00
yangzhenzhang d070af122f add topk op 2021-04-17 14:12:49 +08:00
dayschan 771e3f61f3 Clean GraphKernel's codes from frontend 
1. set class GraphKernel as deprecated, and treat it as Cell
2. set class InplaceAssign as deprecated, suggested using Assign instead.
3. set op_selector as deprecated, removed the _selected_ops and _selected_grad_ops, replaced with real operations
4. removed the two passes of GraphKernel from frontend
5. removed the GraphKernel's codes from other modules
 2021-04-17 11:03:34 +08:00
mindspore-ci-bot f9c5060cf2 !14930 Handle ignored returned Status 
From: @hfarahat
Reviewed-by: @robingrosman,@pandoublefeng
Signed-off-by: @robingrosman
 2021-04-17 03:52:41 +08:00
mindspore-ci-bot 9c81c5d2a0 !15189 Add more ut for transform ops and subset sampler 
From: @alexyuyue
Reviewed-by: 
Signed-off-by:
 2021-04-17 01:46:13 +08:00
hesham 6e6eaebb77 Fix unused return value in main code 2021-04-16 11:33:35 -04:00
yangzhenzhang f9f5df368e add gathernd op 2021-04-16 14:29:03 +08:00
alex-yuyue 97e3232b6d Add more ut for transform ops and subset sampler 
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
 2021-04-15 16:51:41 -04:00
mindspore-ci-bot f09df9ac2f !15248 Fix shellcheck warnings for cache shell scripts 
From: @lixiachen
Reviewed-by: @pandoublefeng,@robingrosman
Signed-off-by: @robingrosman
 2021-04-15 22:47:06 +08:00
Lixia Chen 91f9059263 Fix shellcheck warnings 2021-04-15 09:33:07 -04:00
zhangyunshu d969be9107 profiler: fixed aicpu timeline 2021-04-15 19:35:24 +08:00
yangzhenzhang bcd2ecc403 check layouts for shared parameter 2021-04-15 10:39:05 +08:00
mindspore-ci-bot 727203a498 !14911 dataset: Fill op: C++ API support, UTs and Pybind decoupling 
From: @cathwong
Reviewed-by: 
Signed-off-by:
 2021-04-14 05:32:11 +08:00
Cathy Wong 7e6a03487e dataset: Fill op: C++ API support, UTs and Pybind decoupling 2021-04-13 10:02:39 -04:00
mindspore-ci-bot e07a69d8f8 !14874 GNN dataset new feature 
From: @lizhenglong1992
Reviewed-by: 
Signed-off-by:
 2021-04-13 10:44:27 +08:00
Zhenglong Li f3895f2b09 Add get edges from nodes function for gnn network 2021-04-10 18:31:13 +08:00
mindspore-ci-bot f0f7bf1ed1 !14885 fix: wrong input order 
From: @jonyguo
Reviewed-by: @liucunwei,@heleiwang
Signed-off-by: @liucunwei
 2021-04-10 16:52:41 +08:00
jonyguo a5cc81dc97 fix: wrong input order in test_paddeddataset.py 2021-04-09 17:22:31 +08:00
Lixia Chen 1f2b178a16 Reset CacheClient's status for a new run 
Turn off lock only after all data is cached
 2021-04-08 15:30:48 -04:00
mindspore-ci-bot a9ba9b90f6 !14680 MindData Codespell correction 
From: @luoyang42
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
 2021-04-07 18:28:55 +08:00
luoyang 624511337c MindData Codespell correction 2021-04-07 10:20:29 +08:00
hesham 8535e89e6c Remove DataBuffer 2021-04-05 17:55:59 -04:00
hesham 0d86cb1423 Remove rows_per_buffer 2021-04-04 00:22:16 -04:00
mindspore-ci-bot c99fe1e412 !12841 DataBuffer removal from DE 
From: @hfarahat
Reviewed-by: 
Signed-off-by:
 2021-04-04 03:28:13 +08:00
mindspore-ci-bot 28f4759537 !14606 parallel ut test 
From: @yao_yf
Reviewed-by: 
Signed-off-by:
 2021-04-02 21:24:43 +08:00
yao_yf a83fb3316b fix parallel timeout 2021-04-02 20:19:26 +08:00
mindspore-ci-bot 5b8a200fa9 !14572 show accurate error line when use user defined class 
From: @zhangbuxue
Reviewed-by: @zh_qh,@ginfung
Signed-off-by: @zh_qh
 2021-04-02 15:14:31 +08:00
mindspore-ci-bot e034f0294b !14556 Fix validation of RGB2HSV/HSV2RGB/RandomResizedCrop in py_transform & Fix error msg of pythontokenizer 
From: @luoyang42
Reviewed-by: @liucunwei,@heleiwang
Signed-off-by: @liucunwei
 2021-04-02 14:23:56 +08:00
buxue 6f1105ea79 show accurate error line when use user defined class 2021-04-01 21:52:00 +08:00
luoyang ec21d3f748 Fix validation of RGB2HSV/HSV2RGB/RandomResizedCrop in py_transform 
Fix error msg of pythontokenizer
 2021-04-01 19:09:07 +08:00
changzherui ffee537387 modify python ut 2021-04-01 16:19:55 +08:00
hesham a9a80693be Replace Databuffers with TensorRows 2021-03-31 17:00:36 -04:00
buxue 8c47ce1803 show accurate error info and error lines when use unsupported builtin function 2021-03-31 12:33:38 +08:00
changzherui fde2856d5d modify python ut 2021-03-30 20:08:26 +08:00
mindspore-ci-bot 7d911cdeeb !14365 set parallel communication init in parallel ut 
From: @yao_yf
Reviewed-by: @stsuteng,@kisnwang
Signed-off-by: @stsuteng
 2021-03-30 16:30:07 +08:00
yao_yf 4d0635eabe set parallel communication init flag in parallel ut 2021-03-30 11:21:57 +08:00
buxue d830a2b55a optimize exception mode when use undefined name in if for and while 2021-03-27 17:28:52 +08:00
mindspore-ci-bot 5d0490909d !14097 map a fv cnode if it is not mapped and belong to primal_graph_ 
From: @xychow
Reviewed-by: @ginfung,@zh_qh
Signed-off-by: @zh_qh
 2021-03-26 09:20:42 +08:00
zhousiyi 74d500a756 If a fv cnode is not mapped but belong to primal_graph_, then don't propagate this fv to caller, it should mapped instead 2021-03-25 11:49:37 +00:00
mindspore-ci-bot 5926f7c386 !13906 【MD】【BUG】Conventional judgment on the parameter h w not less than zero 
From: @xulei2020
Reviewed-by: 
Signed-off-by:
 2021-03-25 14:10:42 +08:00
xulei2020 4122d1dcce fix code format bug 2021-03-25 09:18:36 +08:00
mindspore-ci-bot 9023ba2b56 !13745 Enable zero dimension when it comes out of operator. 
From: @liangzhibo
Reviewed-by: @ginfung,@zh_qh,@ginfung
Signed-off-by: @zh_qh
 2021-03-24 20:34:30 +08:00
l00591931 923dd4b77a enable zero dimension tensor when input is data 2021-03-24 15:46:17 +08:00
mindspore-ci-bot 1bc5a2d8ec !13483 modify ci python ut execution 
From: @changzherui
Reviewed-by: 
Signed-off-by:
 2021-03-23 14:17:59 +08:00
buxue e3056ed9b2 show accurate code line when use uninitialized var in for 2021-03-21 17:50:58 +08:00
mindspore-ci-bot 8e8f3043f9 !12115 IR operators of GPU and CPU are unified as batchnorm 
From: @ding_fei_fei
Reviewed-by: 
Signed-off-by:
 2021-03-19 14:51:26 +08:00
mindspore-ci-bot 1d505ebad3 !13528 Optimize the functions of log module 
From: @askmiao
Reviewed-by: @ginfung,@zh_qh,@ginfung
Signed-off-by: @zh_qh
 2021-03-19 14:06:35 +08:00
askmiao 4e39eab473 modify the log module 2021-03-19 09:59:45 +08:00
dingpeifei 87e41aaeee IR operators of GPU and CPU are unified as batchnorm 2021-03-18 19:02:28 +08:00
YangLuo f99204b292 fix python tokenizer 2021-03-18 15:47:09 +08:00
changzherui 6cd90dc45e modify ci python ut execution 2021-03-18 11:30:49 +08:00
mindspore-ci-bot b61aa9b4cf !13342 Throw exception when tensor with 0 shape is constructed 
From: @liangzhibo
Reviewed-by: 
Signed-off-by:
 2021-03-17 09:18:27 +08:00
mindspore-ci-bot 7454ac8ecd !13382 [PipelineSplit]change pipeline key word 
From: @lichen666
Reviewed-by: @kisnwang,@zhunaipan
Signed-off-by: @zhunaipan
 2021-03-16 20:20:32 +08:00
mindspore-ci-bot 48a7a94677 !13397 fix shellcheck error 
From: @xsmq
Reviewed-by: @zhoufeng54,@zhunaipan
Signed-off-by: @zhunaipan
 2021-03-16 17:42:19 +08:00
mindspore-ci-bot f9c408934e !13380 unify range 
From: @lianliguang
Reviewed-by: @zh_qh,@ginfung
Signed-off-by: @zh_qh
 2021-03-16 16:56:53 +08:00
xsmq bf6da44f84 fix shellcheck error 2021-03-16 15:43:50 +08:00
lichenever a2b2727ba8 change_pipeline_key_word 2021-03-16 14:02:35 +08:00
LianLiguang 17b9758543 unify range ops 2021-03-16 10:47:42 +08:00
l00591931 bd777e0710 throw exception when tensor has zero in shape 2021-03-16 10:39:48 +08:00
Lixia Chen 30017ea5a0 Fix codex issues 2021-03-15 11:15:15 -04:00
mindspore-ci-bot ac18da3770 !13061 [MD][bugfix] Fix to_json error: can't pickle pyfunc 
From: @xiefangqi
Reviewed-by: 
Signed-off-by:
 2021-03-13 12:48:26 +08:00
Xiao Tianci 4a7100c7f9 fix RandomAffine degree error and some examples in docs 2021-03-12 17:39:38 +08:00
mindspore-ci-bot 682a8926bd !13176 fix minddata transform issue 
From: @luoyang42
Reviewed-by: 
Signed-off-by:
 2021-03-12 17:01:56 +08:00
mindspore-ci-bot a1c3f55aca !13197 support item negative index bprop 
From: @zhangbuxue
Reviewed-by: @ginfung
Signed-off-by:
 2021-03-12 15:52:26 +08:00
xiefangqi 41f3e02e87 fix pyfunc pickle issue 2021-03-12 15:17:08 +08:00
buxue 50ee325b96 support item negative index bprop 2021-03-12 13:58:46 +08:00
YangLuo 74d7bb41a6 fix minddata transform issue 2021-03-12 11:37:14 +08:00
mindspore-ci-bot 1e33df94a5 !13142 support name or attribute ast.Expr 
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
 2021-03-12 09:27:32 +08:00
mindspore-ci-bot f7040ca134 !13198 Fix get_dataset_size error with PKSampler 
From: @ziruiwu
Reviewed-by: 
Signed-off-by:
 2021-03-12 06:11:26 +08:00
mindspore-ci-bot 1bb789278d !13200 Fix CI warnings and test team issues 
From: @alexyuyue
Reviewed-by: @robingrosman,@nsyca
Signed-off-by: @robingrosman
 2021-03-12 05:38:01 +08:00
Zirui Wu 2692e3cc3d fix pk sampler's get_dataset error due to num_class unavaiable at pre-runtime 2021-03-11 15:43:02 -05:00
mindspore-ci-bot 236c874e64 !12862 Increase default level of parallelism in minddata pipeline 
From: @robingrosman
Reviewed-by: 
Signed-off-by:
 2021-03-12 04:23:02 +08:00
alex-yuyue 2457f52596 Fix CI warning and test team issues 
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
 2021-03-11 13:34:51 -05:00
buxue 2551f5ea7e support name or attribute ast.Expr 2021-03-11 21:40:33 +08:00
mindspore-ci-bot e1a95b1152 !12714 rebuild getitem 
From: @yepei6
Reviewed-by: 
Signed-off-by:
 2021-03-11 14:49:21 +08:00
RobinGrosman a0e75b845a Increase default level of parallelism in mindddata pipeline to 8. 
Adjust memory usage to not increase as parallelism increases.  it will
stay at same level it would be with 4 parallelism
 2021-03-10 18:38:11 -08:00
mindspore-ci-bot 54c37bcd61 !12947 Add MaxPool3D,MaxPool3DGrad,MaxPool3DGradGrad ops for Ascend. 
From: @liu_xiao_93
Reviewed-by: @liangchenghui
Signed-off-by: @liangchenghui
 2021-03-11 08:55:46 +08:00
liuxiao93 35f6ba9011 Add MaxPool3D,MaxPool3DGrad,MaxPool3DGradGrad ops for Ascend. 2021-03-10 15:33:07 +08:00
mindspore-ci-bot 3c7463bf2c !12943 adding fix to sample script 
From: @ezphlow
Reviewed-by: 
Signed-off-by:
 2021-03-10 10:22:19 +08:00
Eric ed373f61ac Adding inheritance to user defined sampler 
what if we just do nothing

trying wrapper approach

Fix yolo
 2021-03-09 18:14:49 -05:00
mindspore-ci-bot fe3b26a637 !12982 dice bug 
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
 2021-03-09 17:04:16 +08:00
jiaqi cdb7330818 diceloss bug 2021-03-09 16:23:45 +08:00
yepei6 57373ed30a merge getitem the by otehr types to by tuple(success) 2021-03-09 10:47:29 +08:00
ougongchang e8ee209877 Optimize summary ut and delete duplicate test cases 
Change the summary test case to stage3 to avoid multiple processes that cause the summary test case to fail
 2021-03-08 17:36:17 +08:00
mindspore-ci-bot 91cf88d692 !12883 Fix bugs of minddata transforms 
From: @luoyang42
Reviewed-by: 
Signed-off-by:
 2021-03-08 09:08:30 +08:00
YangLuo 74431ad117 Fix bugs of minddata transforms 2021-03-06 16:41:51 +08:00
mindspore-ci-bot 7ba21f8d8c !12900 Add communication parallel mode. 
From: @liujunzhu
Reviewed-by: @zhoufeng54,@guoqi1024
Signed-off-by: @guoqi1024
 2021-03-06 15:55:49 +08:00
mindspore-ci-bot 48d4cca512 !12949 Add TopoSort Rhs First attribute for special CNode, such as Depend CNode with isolated nodes. 
From: @zh_qh
Reviewed-by: @hwhewei,@zhunaipan
Signed-off-by: @zhunaipan
 2021-03-06 14:41:35 +08:00
Zhang Qinghua df866f7248 Add TopoSort Rhs First attribute for special CNode, such as Depend CNode with isolated nodes. 2021-03-06 12:39:36 +08:00
mindspore-ci-bot fe53c71b3b !12843 Add more callable test and clean the input check for tensor ops 
From: @alexyuyue
Reviewed-by: @robingrosman,@nsyca
Signed-off-by: @robingrosman
 2021-03-05 22:59:45 +08:00
liujunzhu 6541b96c40 Add communication parallel mode. 2021-03-05 21:36:03 +08:00
mindspore-ci-bot d285692217 !12852 Change maketuple in coreops 
From: @liangzhibo
Reviewed-by: 
Signed-off-by:
 2021-03-05 19:13:42 +08:00
l00591931 680324f225 Change make tuple in core.ops 2021-03-05 10:54:33 +08:00
Ziyan ec9793861f fix grad accu 2021-03-05 10:28:10 +08:00
Zhang Qinghua 8b8c59f01e Optimize the compile performance in Parser, FG, Manager and Renormalize: 
---
Remove the routine of handling isolated nodes in Renormalize.
Add isolated nodes from Parser&Resolver.
Modify isolated nodes handling in FG&Manager.
Optimize the renormalize routines.
Other optimizations.
 2021-03-04 16:01:54 +08:00
mindspore-ci-bot 7ff2b3b499 !12781 fix bug of amp bn cast 
From: @jojobugfree
Reviewed-by: 
Signed-off-by:
 2021-03-04 10:14:51 +08:00
alex-yuyue 6d7be32614 Add more callable test and clean the input check 
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
 2021-03-03 17:30:36 -05:00
mindspore-ci-bot 1c191a65fb !12765 Fix numpy input to samplers 
From: @hfarahat
Reviewed-by: 
Signed-off-by:
 2021-03-04 04:57:40 +08:00
mindspore-ci-bot c07371f5c9 !12763 Fix C++ API testcases 
From: @ezphlow
Reviewed-by: 
Signed-off-by:
 2021-03-04 04:57:28 +08:00
mindspore-ci-bot 8e13667ff4 !12674 Add support to multiple tensor in eager mode 
From: @alexyuyue
Reviewed-by: @nsyca
Signed-off-by:
 2021-03-04 01:28:34 +08:00
Eric f9a2379a70 Fixing api leftover 
Fixed compile error

Fixed more testcases
 2021-03-03 09:37:06 -05:00
mindspore-ci-bot e58be0de71 !12737 quantum state evolution operator 
From: @donghufeng
Reviewed-by: 
Signed-off-by:
 2021-03-03 15:38:42 +08:00
mindspore-ci-bot 7fcce73c51 !12700 add grad accumulation combined with optimizer parallel 
From: @yangzhenzhang
Reviewed-by: 
Signed-off-by:
 2021-03-03 11:04:19 +08:00
mindspore-ci-bot 8fb01aabd4 !12738 Add heartbeat check in summary and delete test cases that do not exit 
From: @ouwenchang
Reviewed-by: @yelihua
Signed-off-by:
 2021-03-03 10:11:32 +08:00
alex-yuyue 66aff93940 Fix test team issue: ToNumber in eager mode. 
And support multiple tensor as input in call method

Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
 2021-03-02 17:39:44 -05:00
caifubi a6959c2a13 fix bn cast bug 2021-03-02 17:24:47 +08:00
ougongchang 4309e20b1b Add heartbeat check in summary and delete test cases that do not exit 2021-03-02 15:29:15 +08:00
hesham 616d1a1f3d Fix sampler supporting numpy input 2021-03-01 12:41:59 -05:00
mindspore-ci-bot 85461bcdb3 !12532 add SyncBatchNorm 
From: @yuchaojie
Reviewed-by: 
Signed-off-by:
 2021-03-01 19:34:41 +08:00
xuxs 066d23e2ad evolution operator 2021-03-01 14:20:31 +08:00
yangzhenzhang a70d616841 mini step grad accumulation 2021-03-01 10:20:12 +08:00
yujianfeng f0b7c3dd4d Add a switch to control grad for scalar 2021-02-27 18:12:37 +08:00
yuchaojie 6d195f340c add SyncBatchNorm 2021-02-27 14:32:54 +08:00
mindspore-ci-bot f269f3fc8d !12231 Support ad for scalar inputs 
From: @ginfung
Reviewed-by: 
Signed-off-by:
 2021-02-26 15:50:32 +08:00
mindspore-ci-bot 6808816cb2 !12618 support index by negative number 
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
 2021-02-26 15:49:14 +08:00
mindspore-ci-bot ed46bf8b18 !12624 add rmse_loss and mae_loss 
From: @lijiaqi0612
Reviewed-by: @kingxian,@zh_qh
Signed-off-by: @kingxian
 2021-02-26 14:34:03 +08:00
buxue 610300335f support index by negative number 2021-02-26 12:49:25 +08:00
mindspore-ci-bot c8defc2a8a !12558 Fix sampler error messages 
From: @hfarahat
Reviewed-by: 
Signed-off-by:
 2021-02-26 00:10:17 +08:00
Jiaqi 112b8488c5 add rmse loss 2021-02-25 17:03:07 +08:00
yujianfeng 41189781f3 support scalar input for cell 2021-02-25 09:56:15 +08:00
wangshuide2020 72e938eb06 change dimension of input for FusedBatchNormEx from 2D to 4D in test_two_matmul_batchnorm_ex. 2021-02-25 09:37:59 +08:00
mindspore-ci-bot 5b206557d2 !12586 support invert bool tensor 
From: @zhangbuxue
Reviewed-by: @zh_qh,@ginfung,@zh_qh
Signed-off-by: @zh_qh,@zh_qh
 2021-02-25 09:37:43 +08:00
buxue f8a00d52af support invert bool tensor 2021-02-24 17:47:07 +08:00
wangshuide2020 b9eb90b198 add GPU for DenseBnAct, Erfc, Log1p, etc. in Supported Platforms. 2021-02-24 16:30:38 +08:00
hesham aa4298721a Fix sampler error messages 2021-02-23 23:58:19 -05:00
mindspore-ci-bot 2e7a785d44 !12535 add raises description for Cast, Diag, Eye, Fill etc. operators 
From: @wangshuide2020
Reviewed-by: @liangchenghui
Signed-off-by: @liangchenghui
 2021-02-23 22:17:37 +08:00
mindspore-ci-bot e73f43aa85 !12507 support convert ValueDict to py dict 
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
 2021-02-23 19:19:44 +08:00
wangshuide2020 8a7fa2e651 add raises description for Cast, Diag, Eye, Fill etc. operators. 2021-02-23 17:33:19 +08:00
mindspore-ci-bot bff0fde980 !12249 make slice support tensor 
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
 2021-02-23 10:55:27 +08:00
mindspore-ci-bot 9893b3d128 !12320 add focal loss 
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
 2021-02-23 10:35:59 +08:00
xsmq 923b53d2e6 replace tab with spaces 2021-02-23 09:41:47 +08:00
buxue 47dd17a325 support convert ValueDict to py dict 2021-02-23 09:27:46 +08:00
Jiaqi fd1a4726b7 add focal loss 2021-02-22 19:33:26 +08:00
buxue 416017bf65 make slice support tensor 2021-02-22 17:07:37 +08:00
xuxs c70049b190 mindquantum 
mindquantum

cmake lint

projectq patch

test pqc

space

pylint

pqc python ops

doc

check

bug

bug

bug

bug

check boundary condition

mindquantum in log_adapter

mindquantum in adapter and recorder cc

substract to subtract

public variable to private variable

public variable to private variable

commit

debug

debug

const in utils

delete dtol

clint
 2021-02-20 12:33:51 +08:00
mindspore-ci-bot 4ac1982c58 !12258 add multclass diceloss 
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
 2021-02-20 09:42:31 +08:00
mindspore-ci-bot f940fe51b1 !12398 fix minddata issues 
From: @luoyang42
Reviewed-by: @heleiwang,@pandoublefeng
Signed-off-by: @pandoublefeng
 2021-02-19 17:01:06 +08:00
Jiaqi 952e245000 add multclass diceloss 2021-02-19 15:43:30 +08:00
YangLuo d8ace8f041 fix minddata issues 2021-02-19 10:53:49 +08:00
mindspore-ci-bot 166f7e7809 !12248 Fix the bug of calling recompute api after compiled 
From: @ginfung
Reviewed-by: 
Signed-off-by:
 2021-02-18 19:35:38 +08:00
mindspore-ci-bot c5df707b69 !12327 Block caching after random pyfunc cases 
From: @lixiachen
Reviewed-by: 
Signed-off-by:
 2021-02-17 08:56:10 +08:00
Lixia Chen 0667818d9a Block caching after random pyfunc 2021-02-12 14:10:00 -05:00
Mahdi 4b106f184c Fixed an issue with SequentialSampler 2021-02-10 12:55:10 -05:00
mindspore-ci-bot 260c77f4ad !12336 [MD] fix sampler log & transform log 
From: @luoyang42
Reviewed-by: 
Signed-off-by:
 2021-02-10 15:33:15 +08:00
luoyang 416ad23e9d fix resize & randomcoloradjust 
fix sampler
 2021-02-10 12:53:27 +08:00
mindspore-ci-bot 923dd47b0f !12331 Adding validators back to check method 
From: @ezphlow
Reviewed-by: @robingrosman,@nsyca,@robingrosman
Signed-off-by: @robingrosman
 2021-02-10 08:58:02 +08:00
Eric 5d91fa6d77 changed discription 
Added validator checks

Added builtin sampler check

Added proper input check for samplers
 2021-02-09 18:00:53 -05:00
hesham 58193bc469 User explicit deepcopy 2021-02-09 17:25:21 -05:00
yujianfeng 70cc548e32 Fix calling recompute api after compiling 2021-02-08 16:19:49 +08:00
mindspore-ci-bot a063d7633d !12241 [auto-monad] Support side-effects by auto-monad 
From: @hwhewei
Reviewed-by: @zhunaipan,@zh_qh
Signed-off-by: @zh_qh
 2021-02-08 10:25:57 +08:00
mindspore-ci-bot e6dcb0c31d !12239 [MD] fix bugs of execute & update doc description in minddata 
From: @luoyang42
Reviewed-by: @liucunwei
Signed-off-by: @liucunwei
 2021-02-08 10:15:08 +08:00
He Wei 7d9a783993 [auto-monad] Support side-effects by auto-monad 
The basic idea is: exploits data dependency to control the execution order
of side-effect operations, and keep the semantics of ANF unchanged.

The ControlDepend primitive is removed and there are two primitives added:

1. UpdateState:
```
  a = Assign(para, value)
```
became:
```
  a = Assign(para, value, u)
  u = UpdateState(u, a)
```

2. Load:
```
  x = Add(para, value)
```
became:
```
  p = Load(para, u)
  x = Add(p, value)
  u = UpdateState(u, p)
```
 2021-02-08 09:01:15 +08:00
luoyang cd86788cf3 fix bugs of execute & update doc description in minddata 2021-02-07 22:52:52 +08:00
liu_xiao_93 fabc25538e Add BCEWithLogitsLoss 2021-02-07 09:06:16 +08:00
mindspore-ci-bot 26d4b99019 !11056 Modifying profiling_Options parameter 
From: @zyhstack
Reviewed-by: @lilongfei15,@xsmq
Signed-off-by: @xsmq
 2021-02-06 13:23:21 +08:00
mindspore-ci-bot 4d9551e129 !12046 modify Gelu、FastGelu to GeLU and FastGeLU 
From: @jinyaohui
Reviewed-by: 
Signed-off-by:
 2021-02-06 09:57:48 +08:00
tom__chen d3330a1087 fix incorrect in_channel size error messages 2021-02-05 11:45:22 -05:00
jinyaohui 30a27b2adb modify Gelu、FastGelu to GeLU and FastGeLU 2021-02-05 17:19:52 +08:00
mindspore-ci-bot 24e528112f !12134 improve grad of first input 
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
 2021-02-05 15:33:30 +08:00
buxue 899d6114a4 improve grad of first input 2021-02-05 12:36:37 +08:00
zhangyihui bbbffbb6a9 Modify the profiling_options parameter name 2021-02-05 10:15:01 +08:00
mindspore-ci-bot 544da6f845 !11727 [MD] Add vision ops and py_transform ops support to Serdes save 
From: @tina_mengting_zhang
Reviewed-by: 
Signed-off-by:
 2021-02-05 06:38:54 +08:00
mindspore-ci-bot 74652eb942 !12044 modify pack to stack 
From: @jinyaohui
Reviewed-by: 
Signed-off-by:
 2021-02-04 21:02:09 +08:00
jinyaohui 8022f9a6ed modify pack to stack 2021-02-04 18:54:31 +08:00
mindspore-ci-bot 8fc5962418 !12055 compile graph for merging parameter slice only once 
From: @yangzhenzhang
Reviewed-by: @stsuteng
Signed-off-by: @stsuteng
 2021-02-04 14:30:47 +08:00
TinaMengtingZhang ddab5ad417 Add support for vision op and py_transform op to serdes 2021-02-03 12:31:09 -05:00
mindspore-ci-bot e8f4cafd02 !11950 Overwrite default port/hostname from env variables for cache_admin 
From: @lixiachen
Reviewed-by: 
Signed-off-by:
 2021-02-03 23:38:48 +08:00
yangzhenzhang 726ea32778 merge parameter slice compile graph only once 2021-02-03 19:39:32 +08:00
mindspore-ci-bot cbfba95ad0 !11921 do not broaden when arg is not tensor 
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
 2021-02-03 17:07:47 +08:00
buxue 6ccc4379b4 do not broaden scalar 2021-02-03 11:30:25 +08:00
mindspore-ci-bot 6378642c8a !11905 add raises description for BCELoss, ReLU, BatchNorm1d, etc. operators 
From: @wangshuide2020
Reviewed-by: @liangchenghui,@wuxuejian
Signed-off-by: @liangchenghui
 2021-02-03 11:19:00 +08:00
mindspore-ci-bot 78d250c7d5 !11648 fix param check for unexpected_format 
From: @jiang-shuqiang
Reviewed-by: @yelihua
Signed-off-by:
 2021-02-03 11:18:47 +08:00
Lixia Chen 97cd142f8d Overwrite default port/hostname from env variables 
update copyright

add examples to CacheClient docstring
 2021-02-02 20:39:19 -05:00
mindspore-ci-bot 840d819d08 !11975 improve isinstance 
From: @zhangbuxue
Reviewed-by: @ginfung,@zh_qh
Signed-off-by: @zh_qh
 2021-02-03 09:01:57 +08:00
hesham 1185218335 Support list of IDs as a sampler 2021-02-02 11:44:38 -05:00
buxue 5ede9ffcca improve isinstance 2021-02-02 21:12:14 +08:00
wangshuide2020 30f99f2722 add raises description for BCELoss, ReLU, BatchNorm1d, etc. operators. 2021-02-02 20:52:00 +08:00
mindspore-ci-bot 0dcd94d717 !11893 LookupOp: default value of unknown_token support NoneType 
From: @luoyang42
Reviewed-by: @liucunwei,@pandoublefeng
Signed-off-by: @liucunwei
 2021-02-02 20:13:18 +08:00
luoyang fa4f67cbcd LookupOp: default value of unknown_token support NoneType 2021-02-02 16:17:02 +08:00
mindspore-ci-bot b189f177bb Change tuple_getitem to TupleGetItem and some other ops, merge from r1.1 to master 2021-02-02 15:54:15 +08:00
jiangshuqiang 0bb80995bc fix param check for unexpected_format 2021-02-02 12:03:49 +08:00
mindspore-ci-bot e897eb4c41 !11915 Change TensorAdd to Add, merge from r1.1 to master 
From: @liangzhibo
Reviewed-by: @ginfung,@zh_qh
Signed-off-by: @zh_qh
 2021-02-02 09:16:08 +08:00
Nat Sutyanyong 5a7dc0accc Migrate repeat_pass.cc to IR optimizer and remove ExecTree optimizer 2021-02-01 12:30:16 -05:00
mindspore-ci-bot 320ea51308 !11853 Add call for decoupled image and text ops 
From: @alexyuyue
Reviewed-by: 
Signed-off-by:
 2021-02-01 19:47:00 +08:00
l00591931 9ec100d069 Change TensorAdd to Add, from r1.1 to master 2021-02-01 17:53:52 +08:00
mindspore-ci-bot ce89cc5e8b !11761 Change GatherV2 to Gather (merge from r1.1 to master) 
From: @liangzhibo
Reviewed-by: 
Signed-off-by:
 2021-01-30 17:53:20 +08:00
mindspore-ci-bot 794af6d094 !11834 [MD] Fix error msg description of dataset 
From: @xiefangqi
Reviewed-by: @liucunwei,@heleiwang
Signed-off-by: @liucunwei
 2021-01-30 14:49:24 +08:00
mindspore-ci-bot 9fa0499fa0 Change GatherV2 to Gather r1.1 to master 2021-01-30 14:13:47 +08:00
mindspore-ci-bot 84afbb510f !11813 modify dice and diceloss 
From: @lijiaqi0612
Reviewed-by: @kingxian,@zh_qh
Signed-off-by: @kingxian
 2021-01-30 11:08:17 +08:00
xiefangqi 3d72282f26 fix error msg issue 2021-01-30 11:03:53 +08:00
alex-yuyue 6fd58dc580 Add call for decoupled image and text ops 
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
 2021-01-29 21:36:31 -05:00
Mahdi 8f34faeb7a Changed bindings to SamplerObj 2021-01-29 14:20:05 -05:00
Jiaqi 804ef79c18 modify dice and diceloss 2021-01-29 15:10:05 +08:00
mindspore-ci-bot a2f1a5b4b1 !11278 develop confusion matrix 
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
 2021-01-29 11:38:28 +08:00
Jiaqi c821a2f3a2 confusion matrix 2021-01-29 09:27:22 +08:00
mindspore-ci-bot 20c1727b2c !11631 Add SubsetSampler 
From: @hfarahat
Reviewed-by: 
Signed-off-by:
 2021-01-29 03:48:45 +08:00
mindspore-ci-bot 8e4a6842ff !11681 gnn support edge weight sampling 
From: @heleiwang
Reviewed-by: @liucunwei
Signed-off-by: @liucunwei
 2021-01-28 19:15:37 +08:00
heleiwang 2dc9ba761c gnn support weight sampling neighbors. 2021-01-28 15:28:44 +08:00
hesham 7120c66998 Add SubsetSampler 2021-01-27 15:00:18 -05:00
mindspore-ci-bot 4cd6588af0 !11393 Migrating cache transform pass from execution tree to IR tree 
From: @lixiachen
Reviewed-by: 
Signed-off-by:
 2021-01-27 22:10:13 +08:00
mindspore-ci-bot b9e1c3f045 !11530 support call inner net attr 
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
 2021-01-27 16:50:43 +08:00
buxue 3d33c4fed3 support call inner net attr 2021-01-27 15:08:29 +08:00
mindspore-ci-bot f2fd357ffc !11623 fix issues of MD 
From: @luoyang42
Reviewed-by: 
Signed-off-by:
 2021-01-27 14:37:55 +08:00
mindspore-ci-bot 007bd6c7d3 !11656 add dtype shape and value in __str__ and __repr__ of Parameter 
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
 2021-01-27 14:06:04 +08:00
mindspore-ci-bot 58b8d8cd02 !11677 add isfinite grad 
From: @jiangzg001
Reviewed-by: @liangchenghui,@c_34
Signed-off-by: @liangchenghui
 2021-01-27 11:13:58 +08:00
buxue 7c4b7203b0 add dtype shape and value in __str__ and __repr__ of Parameter 2021-01-27 11:04:24 +08:00
luoyang 415c8b08a5 fix issues of MD: 
1. description of num_shard in datasets.py
2. add param validation for sampler
3. add description for add_child in sampler.py
 2021-01-27 09:30:42 +08:00
jiangzhenguang de8c2c95d1 add isfinite grad 2021-01-27 09:10:49 +08:00
Lixia Chen 922e1f4f36 Migrate CacheTransformPass 2021-01-26 19:24:10 -05:00
mindspore-ci-bot 3708624a25 !11559 [MD] Change the default spill location of cache server 
From: @lixiachen
Reviewed-by: 
Signed-off-by:
 2021-01-27 03:12:24 +08:00
ougongchang c6e4b0c85f Add more log when collect graph and use summary operators 
Fix can not collect input data when batch size is 1 and total step
number is 1

Fixed spelling errors
 2021-01-26 11:24:16 +08:00
Lixia Chen be6d310946 Default to memory-only cache server 2021-01-25 18:38:24 -05:00
mindspore-ci-bot 8170669909 !11174 add_mish_mulnonan_selu_operations 
From: @jiangzg001
Reviewed-by: @liangchenghui
Signed-off-by: @liangchenghui
 2021-01-23 17:24:17 +08:00
mindspore-ci-bot f8f6421459 !10968 Add dynamic shape support for the operator Concat 
From: @david-he91
Reviewed-by: 
Signed-off-by:
 2021-01-23 16:58:40 +08:00
xiefangqi 3f76abcdee minddata err msg add file path 2021-01-22 16:38:46 +08:00
mindspore-ci-bot fd6dc1b060 !11177 modify Tensor 
From: @Somnus2020
Reviewed-by: 
Signed-off-by:
 2021-01-22 11:37:11 +08:00
jiangzhenguang 991fb122f3 add_mish_mulnonan_selu_operations 2021-01-22 10:31:31 +08:00
mindspore-ci-bot 2beb916bf5 !11427 TextOp decoupling 
From: @alexyuyue
Reviewed-by: 
Signed-off-by:
 2021-01-22 09:09:41 +08:00
mindspore-ci-bot fcc4a4eaea !11397 add GetDatasetSize to concat_node 
From: @mhmotallebi
Reviewed-by: 
Signed-off-by:
 2021-01-22 08:08:41 +08:00
mohammad b5e91139e2 add GetDatasetSize to concat node 2021-01-21 16:25:48 -05:00
mindspore-ci-bot 6394ba3974 !11499 delete useless params in pipeline parallel 
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
 2021-01-21 21:35:43 +08:00
hedongdong 8241dfa443 Add dynamic shape support for the operator Concat 2021-01-21 20:36:29 +08:00
mindspore-ci-bot 0c5b6107a7 !11475 support dict for isinstance 
From: @zhangbuxue
Reviewed-by: @ginfung,@zh_qh,@ginfung
Signed-off-by: @ginfung
 2021-01-21 19:31:13 +08:00
yangzhenzhang cbca482e59 delete useless parameter in pipeline parallel 2021-01-21 19:05:40 +08:00
lilei 7d9f5f6dba modify Tensor 2021-01-21 17:46:34 +08:00
buxue 2ea8b9e738 add dict for isinstance 2021-01-21 17:30:35 +08:00
yangzhenzhang 7303c3d3b8 add group ckpt 2021-01-21 14:41:05 +08:00
alex-yuyue a8675f8227 TextOp decoupling 
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
 2021-01-20 21:52:45 -05:00
mindspore-ci-bot 55594db01c !11348 add check for outermost net inputs type and support isinstance first arg is an empty list 
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
 2021-01-20 19:00:08 +08:00
buxue e8cd572bc2 add check for outermost net inputs type and support isinstance first arg an empty list 2021-01-20 14:48:06 +08:00
mindspore-ci-bot 775d71f9c1 !11408 Update PP example 
From: @zichun_ye
Reviewed-by: @wang_zi_dong,@sunnybeike
Signed-off-by:
 2021-01-20 09:17:23 +08:00
Zichun Ye ca316f4422 update doc example in probability 
fix typo in probability module

fix pylint in msp
 2021-01-19 11:51:43 -05:00
mindspore-ci-bot 60feffad20 !11332 update Pooling's attr kernel_size, pad_mode 
From: @yuchaojie
Reviewed-by: 
Signed-off-by:
 2021-01-19 16:17:45 +08:00
Lixia Chen 273865a72b Rename SamplerObj::Build() to SamplerBuild() 2021-01-18 15:42:34 -05:00
mindspore-ci-bot 91842af2ad !11245 Pushing down pipeline json serializer logic to C++ IR - PART II 
From: @tina_mengting_zhang
Reviewed-by: 
Signed-off-by:
 2021-01-19 04:31:32 +08:00
buxue 15593dc98f improve isinstance function in graph mode 2021-01-18 19:18:48 +08:00
yuchaojie b51b3a6764 update Pool's attr kernel_size, pad_mode 2021-01-18 12:10:20 +08:00
mindspore-ci-bot e214c69bc2 !11195 develop dice loss 
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
 2021-01-18 12:00:41 +08:00
buxue 69d9a33ddb show line of code when parse or resolve phase exception 2021-01-16 16:31:04 +08:00
Jiaqi 87ecd44f67 develop dice loss 2021-01-16 15:54:06 +08:00
TinaMengtingZhang d3fdbceb61 [Part II] Push down json save logic to IR and add getter to each IR node 2021-01-15 18:03:37 -05:00
mindspore-ci-bot eacc8bac89 !10755 [Numpy-Native] Add new numpy-native interfaces to mindspore.numpy 
From: @yanglf1121
Reviewed-by: 
Signed-off-by:
 2021-01-15 10:04:17 +08:00
mindspore-ci-bot a2d9c5914a !10944 Tensor op decoupling stage 2 
From: @alexyuyue
Reviewed-by: 
Signed-off-by:
 2021-01-15 05:28:50 +08:00
alex-yuyue b54e01bfb4 Tensor op decoupling stage 2 
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
 2021-01-14 11:51:16 -05:00
buxue 7eaf84d07a remove attr support_non_tensor_input of cell 2021-01-14 16:19:23 +08:00
yanglf1121 72903c11c8 add array_ops, math_ops and tensor ops 2021-01-14 15:32:36 +08:00
mindspore-ci-bot 44507b4a64 !11200 support non tensor inputs for ms_function and grad of net 
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
 2021-01-14 14:41:08 +08:00
mindspore-ci-bot 151c0e2977 !11132 modify batchnormal and fusedbatchnormal 
From: @Somnus2020
Reviewed-by: 
Signed-off-by:
 2021-01-14 10:57:10 +08:00
buxue acec35d4d4 support non tensor inputs 2021-01-14 09:21:01 +08:00
lilei 9a45c4419c modify batch_normal 2021-01-13 20:59:46 +08:00
mindspore-ci-bot 1dd600d416 !11114 add perplexity metric 
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
 2021-01-13 14:58:59 +08:00
TinaMengtingZhang 4812fece80 [Part I] Push down json save logic to IR and add getter to each IR node 2021-01-12 11:17:45 -05:00
Jiaqi d6f4421a1d perplexity 2021-01-12 20:26:26 +08:00
Nat Sutyanyong 686772cce7 Migrate GeneratorOp resetting logic to IR optimizer (incl. debug code) 
with comments from the peer view addressed
 2021-01-11 12:20:40 -05:00
mindspore-ci-bot fb97aa327c !10881 add the tensor collection feature when record summary 
From: @jiang-shuqiang
Reviewed-by: 
Signed-off-by:
 2021-01-11 20:59:07 +08:00
jiangshuqiang ab5cc10250 add the tensor collection feature when record summary 2021-01-11 12:39:36 +08:00
liuxiao93 aacad990c3 Add grad of sort. 2021-01-11 09:07:46 +08:00
mindspore-ci-bot 7957a3b6f5 !10988 Tensor op decoupling stage 1 
From: @ezphlow
Reviewed-by: 
Signed-off-by:
 2021-01-09 05:12:10 +08:00
Eric be46ccf721 Started vision decoupling 
map validate params

Changing bindings

Change behavior of vision.cc

Added signature and changed Cmake

Compiling

Need to fix compile

Added compiling random transforms

python changes for decoupling

two failed test case remaining

Compiling random choice

passes all ut

Changed assert

review comments

Added validate params

add back return value

Fix lint

py lint fix

pylint 2

Addressing comments
 2021-01-08 09:42:20 -05:00
mindspore-ci-bot b355f5402b !10309 Port over getter pass and tensor fusion pass to IR 
From: @ziruiwu
Reviewed-by: 
Signed-off-by:
 2021-01-08 21:37:51 +08:00
Zirui Wu 0e68575e77 port over getter pass 
port over tensor_op_fusion pass

add fusion support for prebuildOpeartion (TensorOpeartion)
 2021-01-07 10:52:49 -05:00
Jiaqi f6de97fc27 bleu_score 2021-01-07 21:24:38 +08:00
mindspore-ci-bot 62888f23b8 !10400 roc and auc 
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
 2021-01-07 21:19:41 +08:00
mindspore-ci-bot 274e0aa750 !10885 add nll_loss operation 
From: @jiangzg001
Reviewed-by: @liangchenghui,@wuxuejian
Signed-off-by: @liangchenghui
 2021-01-07 14:15:22 +08:00
mindspore-ci-bot 1276715c11 !10939 surface distance 
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
 2021-01-07 11:02:15 +08:00
Jiaqi ef3f6d62db auc_roc 2021-01-07 10:55:16 +08:00
mindspore-ci-bot 09848d7ef3 !9083 add dice and hausdroff 
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
 2021-01-07 10:31:42 +08:00
mindspore-ci-bot 67296c08c7 !9502 add hausdroff distance 
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
 2021-01-07 10:31:32 +08:00
mindspore-ci-bot 1c942ce49f !10221 support grad accumulation for auto parallel 
From: @yangzhenzhang
Reviewed-by: 
Signed-off-by:
 2021-01-06 15:27:34 +08:00
mindspore-ci-bot 1f06cd63f3 !10436 Support to control whether to throw runtime exceptions in SummaryRecord 
From: @ouwenchang
Reviewed-by: 
Signed-off-by:
 2021-01-06 14:21:21 +08:00
mindspore-ci-bot 1d1f6841b9 !10937 keep consistent in Graph mode and PyNative mode for 'isinstance' 
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
 2021-01-06 10:29:49 +08:00
ougongchang 06be546b52 Support to control whether raise RuntimeError exception in SummaryRecord 
1. Support explainer raise an RuntimeError exception
2. fix the ut of SummaryRecord
 2021-01-06 10:07:47 +08:00
yangzhenzhang 9da3f9bec9 mini step grad accumulation 2021-01-06 09:25:06 +08:00
jiangzhenguang d3f42e7d6b add nll_loss operation. 2021-01-06 09:11:35 +08:00
mindspore-ci-bot 03e655f14a !10070 Fixing GetDatasetSize issue with chained samplers 
From: @mahdirahmanihanzaki
Reviewed-by: 
Signed-off-by:
 2021-01-06 05:11:51 +08:00
buxue 6d395c1d3f keep consistent in Graph mode and PyNative mode for 'isinstance' 2021-01-05 21:36:10 +08:00
mindspore-ci-bot a531628dd5 !10325 modify MetaTensor and Tensor 
From: @Somnus2020
Reviewed-by: @kingxian
Signed-off-by: @kingxian
 2021-01-05 17:50:34 +08:00
Jiaqi 29cd33a542 3d 2021-01-05 17:25:41 +08:00
Jiaqi 9a5b9525de hausdorff_distance 2021-01-05 17:20:57 +08:00
Jiaqi ed7cf87d0b surface distance 2021-01-05 17:13:12 +08:00
lilei b858097ae4 modify MetaTensor and Tensor 2021-01-04 20:58:34 +08:00
Payne b12ca2165c add bool expand dims and wait to test 2020-12-31 14:55:13 +08:00
mindspore-ci-bot 37a4cbfb3b !10772 Prevent the multiprocess.pool from capturing KeyboardInterrupt, 
From: @ouwenchang
Reviewed-by: @wenkai_dist,@wangyue01
Signed-off-by: @wangyue01
 2020-12-30 10:02:25 +08:00
ougongchang e5529230bf Prevent the multiprocess from capturing KeyboardInterrupt 2020-12-29 17:46:42 +08:00
mindspore-ci-bot 998483e0c3 !10610 add batchnorm3d and check in conv3d 
From: @jiangzg001
Reviewed-by: @liangchenghui,@wuxuejian
Signed-off-by: @liangchenghui
 2020-12-29 16:56:22 +08:00
jiangzhenguang 9f950fb16c add batchnorm3d 2020-12-29 09:37:35 +08:00
mindspore-ci-bot 2e684df5b1 !10686 fix infer rank list typo and add testcase 
From: @gong_zi_yan
Reviewed-by: @stsuteng,@zhunaipan
Signed-off-by: @stsuteng
 2020-12-28 21:20:19 +08:00
Ziyan 2c3b99ce91 fix infer rank list typo 2020-12-28 18:46:01 +08:00
mindspore-ci-bot 0d04de8db2 !10455 Expand J for innermost graph first when the graph also contains J primitive 
From: @ginfung
Reviewed-by: @zhunaipan
Signed-off-by:
 2020-12-28 14:42:07 +08:00
mindspore-ci-bot b67aaf6773 !9832 expose_allgather_fusion_to_users 
From: @gong_zi_yan
Reviewed-by: 
Signed-off-by:
 2020-12-28 09:54:57 +08:00
yujianfeng 728fac6c9f Expand J for innermost graph first when the graph also contains J primitive 2020-12-28 09:37:23 +08:00
Ziyan bbf8ec82b9 expose allgather fusion interface to users 2020-12-27 17:44:45 +08:00
buxue 1a7c161e73 support len of a Tensor 2020-12-26 17:02:25 +08:00
mindspore-ci-bot 4df0baa6c7 !10392 getitem fix bug 
From: @yepei6
Reviewed-by: @zhunaipan,@kingxian,@zhunaipan
Signed-off-by: @kingxian
 2020-12-24 20:49:17 +08:00
mindspore-ci-bot 221d5b67d2 !10442 change code in modelzoo to import dataset APIs from mindspore.dataset rather than mindspore.dataset.engine 
From: @tiancixiao
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
 2020-12-24 19:56:39 +08:00
Xiao Tianci 31fed1a2f6 change code to import APIs from mindspore.dataset rather than mindspore.dataset.engine 2020-12-24 17:30:02 +08:00
mindspore-ci-bot 261bb736de !10063 Modify profiler directory structure to fit the new Run Package 
From: @gzhcv
Reviewed-by: 
Signed-off-by:
 2020-12-24 16:53:13 +08:00
mindspore-ci-bot 1343c9cca2 !10255 using do_copy option to choose Tensor.from_numpy to do Tensor convert 
From: @ms_yan
Reviewed-by: 
Signed-off-by:
 2020-12-24 14:53:18 +08:00
mindspore-ci-bot e1248a7246 !10389 Fix the Backward of the AllSwap Operation 
From: @huangxinjing
Reviewed-by: @stsuteng,@stsuteng,@zhunaipan
Signed-off-by: @stsuteng,@stsuteng
 2020-12-24 09:38:29 +08:00
Payne 4f78ee0077 fix getitem bug 2020-12-23 22:02:23 +08:00
ms_yan deb1e6e965 use from_numpy and add do_copy option 2020-12-23 21:38:05 +08:00
mindspore-ci-bot 70dc40551a !10020 Improve fancy index from 1st dimension to arbitrarily dimension 
From: @yepei6
Reviewed-by: 
Signed-off-by:
 2020-12-23 21:23:36 +08:00
mindspore-ci-bot 20df37e428 !10287 Add ut for dataset to_number 
From: @luoyang42
Reviewed-by: @heleiwang
Signed-off-by:
 2020-12-23 21:14:42 +08:00
huangxinjing 565ce81b29 Fix allsawp 2020-12-23 17:17:03 +08:00
Zirui Wu a1355a827c introduce a master switch to turn on and off profiler 2020-12-22 16:48:01 -05:00
mindspore-ci-bot 176ea4676c !10261 change the int32 restrict to int restric 
From: @yepei6
Reviewed-by: @kingxian,@kingxian
Signed-off-by: @kingxian,@kingxian
 2020-12-22 20:39:29 +08:00
Payne 5c9982729d fancy index getitem 2020-12-22 18:13:16 +08:00
mindspore-ci-bot 9b3226c2b6 !10289 Ignore the graphs with defer_inline flag when specializing on graph arguments 
From: @ginfung
Reviewed-by: @zh_qh
Signed-off-by: @zh_qh
 2020-12-22 17:41:20 +08:00
Payne 236bfb75e3 change the int32 restrict to int 2020-12-22 17:35:02 +08:00
yujianfeng e1aa34a030 Ignore the graphs with defer_inline flag when specializing on graph arguments 2020-12-22 14:32:44 +08:00
mindspore-ci-bot 00611b1c41 !10175 Add tensor.ndim and rename tensor.size() to tensor.size 
From: @yanglf1121
Reviewed-by: @kingxian,@zhunaipan
Signed-off-by: @kingxian
 2020-12-22 14:13:10 +08:00
YangLuo da6de519ae Add ut for dataset to_number 2020-12-21 20:09:03 +08:00
mindspore-ci-bot f8e5bffe4d !10286 fix Wrong TypeError in numpy_native 
From: @wangrao124
Reviewed-by: @zhunaipan,@kingxian
Signed-off-by: @kingxian
 2020-12-21 19:30:08 +08:00
mindspore-ci-bot 441e283e21 !10197 Add input check for the embedding 
From: @huangxinjing
Reviewed-by: @stsuteng,@zhunaipan
Signed-off-by: @stsuteng
 2020-12-21 19:12:09 +08:00
wangrao 2fb3f0ef4f fix Wrong TypeError in numpy_native 2020-12-21 16:33:36 +08:00
Ziyan c5c905fdf5 add restriction for opt shard 2020-12-19 17:43:55 +08:00
mindspore-ci-bot 5ff6de83eb !10173 Fix Strategy Check for UnsortedSegments 
From: @huangxinjing
Reviewed-by: @zhunaipan,@stsuteng
Signed-off-by: @stsuteng
 2020-12-19 14:24:58 +08:00
mindspore-ci-bot d99189f681 !10207 Fix some minor doc, typo related to AutoNumWorker 
From: @ziruiwu
Reviewed-by: @mikef
Signed-off-by:
 2020-12-19 06:35:59 +08:00
Zirui Wu 4ae7102fd3 address 2 tickets 2020-12-18 15:03:32 -05:00
huangxinjing dd0da1542d Add input check 2020-12-18 19:54:49 +08:00
yanglf1121 918679daa3 add tensor.ndim and rename tensor.size() to tensor.size 2020-12-18 17:15:42 +08:00
huangxinjing a8446af1ab Fix condition check 2020-12-18 16:43:43 +08:00
gzhcv bad8c0e422 Modify profiling dir structure to fit the new Run Package 2020-12-18 11:04:07 +08:00
mindspore-ci-bot 893d59afd7 !10097 Fix bugs for np.mean, np.asarray, np.concatenate, np.linspace 
From: @yanglf1121
Reviewed-by: 
Signed-off-by:
 2020-12-18 09:10:51 +08:00
Mahdi 98ea8fa6ea Added tests for chain samplers, fixed GetDatasetSize issue with chained samplers 2020-12-17 13:26:42 -05:00
mindspore-ci-bot fc11b7dd68 !10074 Fix a testcase error when shuffle is above cache 
From: @lixiachen
Reviewed-by: @liucunwei,@pandoublefeng
Signed-off-by: @liucunwei,@liucunwei
 2020-12-17 19:56:26 +08:00
mindspore-ci-bot 691e3baab6 !10109 [MD] Fix Decode doc & RandomNode log 
From: @luoyang42
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
 2020-12-17 19:50:19 +08:00
mindspore-ci-bot 6035823c4b !10044 fix get num classes of concat 
From: @luoyang42
Reviewed-by: @liucunwei,@heleiwang,@liucunwei
Signed-off-by: @liucunwei,@liucunwei
 2020-12-17 19:30:50 +08:00
yanglf1121 760cd1870a corner cases check for np.asarray, np.mean, np.concatenate 2020-12-17 18:33:10 +08:00
luoyang 595b7a782f [MD] Fix Decode doc & RandomNode log 2020-12-17 17:04:31 +08:00
mindspore-ci-bot 734f50f36e !10083 support non tensor inputs in model predict 
From: @zhangbuxue
Reviewed-by: @zhunaipan,@zh_qh
Signed-off-by: @zh_qh
 2020-12-17 16:33:52 +08:00
buxue f90f77c16e support non tensor inputs in model predict 2020-12-17 14:17:41 +08:00
buxue aeeef7607a remove the 'raise' in construct of Cell 2020-12-17 10:54:42 +08:00
Lixia Chen a7f0e13234 Remove special treatment for cache above repeat 2020-12-16 21:13:04 -05:00
YangLuo df9f4f41e8 fix get num classes of concat 2020-12-16 14:58:32 +08:00
mindspore-ci-bot 26ff566f90 !10002 fix get dataset size in distributed scenario 
From: @tiancixiao
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
 2020-12-16 14:25:39 +08:00
Xiao Tianci 633f97bb48 fix get dataset size in distributed scenario 2020-12-15 20:41:45 +08:00
yanglf1121 9072283395 fix mindpsore.numpy packaging issue and format API comments 2020-12-15 18:06:55 +08:00
mindspore-ci-bot c4f284b928 !9910 [MD][Perf] MindData add NormalizePad for GPU performance 
From: @xiefangqi
Reviewed-by: 
Signed-off-by:
 2020-12-15 16:51:22 +08:00
mindspore-ci-bot b8faa8293b !9920 python eager add decode 
From: @luoyang42
Reviewed-by: @liucunwei
Signed-off-by: @liucunwei
 2020-12-15 16:37:39 +08:00
mindspore-ci-bot dd134d7554 !9926 optimize list setitem in bprop 
From: @zhangbuxue
Reviewed-by: @zh_qh
Signed-off-by: @zh_qh
 2020-12-15 16:20:07 +08:00
buxue 2530943a7f optimize list getitem in bprop 2020-12-15 15:00:49 +08:00
xiefangqi 3c6cc3c58c Add NormalizePadOp 2020-12-15 11:45:41 +08:00
YangLuo 18e61a627a python eager add decode 2020-12-15 10:00:59 +08:00
mindspore-ci-bot a9f2de8307 !9737 complete fancy index getitem 
From: @yepei6
Reviewed-by: 
Signed-off-by:
 2020-12-15 09:44:52 +08:00
Payne 4c8f0914d0 complete fancy index getitem 2020-12-14 22:18:38 +08:00
mindspore-ci-bot ca4225a4f3 !9717 amend some script 
From: @jiangzg001
Reviewed-by: @liangchenghui,@c_34
Signed-off-by: @liangchenghui
 2020-12-14 19:39:15 +08:00
mindspore-ci-bot 3a803b3c18 !9862 Fix the bug of ImageNetToMR 
From: @shenwei41
Reviewed-by: @pandoublefeng,@liucunwei
Signed-off-by: @liucunwei
 2020-12-14 15:53:14 +08:00
jiangzhenguang 9cf856dd25 amend some script 2020-12-14 11:08:20 +08:00
mindspore-ci-bot ad6507d88a !9825 [MD] fix pad, normalize in c_trasnform 
From: @luoyang42
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
 2020-12-14 10:48:10 +08:00
mindspore-ci-bot e10dbb4a7f !9723 add ir passes to unify mindir 
From: @yuchaojie
Reviewed-by: 
Signed-off-by:
 2020-12-14 10:14:47 +08:00
jjfeing 1984cf8e20 unify mindir 2020-12-12 17:55:16 +08:00
buxue 70d12aae26 add detailed and accurate description for support non tensor inputs for outermost net. 2020-12-12 16:54:08 +08:00
shenwei41 547f96717b Fix Bug 2020-12-12 11:35:34 +08:00
mindspore-ci-bot d5db8872fd !9834 Fix wrong input argument of Reshape for multi field embedding 
From: @huangxinjing
Reviewed-by: @zhunaipan,@stsuteng
Signed-off-by: @stsuteng
 2020-12-11 21:31:48 +08:00
huangxinjing 996ee72c50 Fix embedding layer 
Fix input check
 2020-12-11 19:13:09 +08:00
mindspore-ci-bot 5e35bec957 !9799 change_last_nodes_strategy_in_auto_parallel_when_eval_and_predict 
From: @yao_yf
Reviewed-by: @zhunaipan,@stsuteng
Signed-off-by: @stsuteng
 2020-12-11 17:51:32 +08:00
luoyang 1cc147df1d fix pad, normalize in c_trasnform 2020-12-11 17:46:29 +08:00
mindspore-ci-bot 10d326ee62 !9798 hide arange 
From: @bairongz
Reviewed-by: @zh_qh,@zhunaipan
Signed-off-by: @zh_qh
 2020-12-11 15:29:33 +08:00
yao_yf 19fe28cb9b hange strategys of last nodes in eval/predict at auto parallel mode 2020-12-11 11:11:28 +08:00
Zirui Wu 77521e78d2 staging 2020-12-10 14:45:04 -05:00
Bairong 8cf43e59e0 hide arange, delete related test case and improve the doc string of nn.Range 2020-12-10 21:42:59 +08:00
mindspore-ci-bot 8c0d066bf9 !9763 Change name from interpolate to resizeBilinear 
From: @liangzhibo
Reviewed-by: @ginfung,@zh_qh,@zhunaipan
Signed-off-by: @zh_qh
 2020-12-10 17:41:14 +08:00
Xiaoda Zhang e78228603b move parallel-related black-list to core/ir, and fix the cloneCNode bug 2020-12-10 15:57:01 +08:00
l00591931 130c61cfc0 change name from interpolate to resizeBilinear 2020-12-10 11:46:40 +08:00
mindspore-ci-bot 9ecf062581 !9552 change the import level of dynamic_lr 
From: @wangnan39
Reviewed-by: @kingxian,@zh_qh,@kingxian
Signed-off-by: @kingxian,@kingxian
 2020-12-10 11:15:08 +08:00
mindspore-ci-bot 78fba32865 !9752 Fix potential hang in RandomData and incorrectly named functions 
From: @ziruiwu
Reviewed-by: @heleiwang,@pandoublefeng
Signed-off-by: @pandoublefeng
 2020-12-10 10:51:01 +08:00
mindspore-ci-bot 3f82405d17 !9639 Add Numpy Native to Mindspore 
From: @yanglf1121
Reviewed-by: 
Signed-off-by:
 2020-12-10 09:45:16 +08:00
Zirui Wu 91a6b2b0ca Add checks to RandomData and LookUp 2020-12-09 17:09:34 -05:00
yanglf1121 59e5afd2bb Add mindnumpy to mindspore 2020-12-09 21:35:16 +08:00
wangnan39@huawei.com 0fe9e2e4cb support import dynamic_lr from nn 2020-12-09 17:47:52 +08:00
mindspore-ci-bot a2aea8cba5 !9578 add_conv3d_transpose_object 
From: @jiangzg001
Reviewed-by: @liangchenghui,@liangchenghui
Signed-off-by: @liangchenghui
 2020-12-09 16:41:48 +08:00
mindspore-ci-bot 6d34bacc17 !9470 support arange in functional.py 
From: @bairongz
Reviewed-by: @ginfung
Signed-off-by:
 2020-12-09 14:39:36 +08:00
jiangzhenguang 5060565920 add conv3d_transpose. 2020-12-09 13:48:23 +08:00
mindspore-ci-bot 317a97e6b9 !9336 auto num_parallel_workers setup 
From: @ziruiwu
Reviewed-by: 
Signed-off-by:
 2020-12-09 08:32:55 +08:00
mindspore-ci-bot a2c80435ce !9685 Fix a core dump in TreeConsumer::Terminate() plus minor cache fixes 
From: @lixiachen
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
 2020-12-09 08:21:22 +08:00
Zirui Wu d6df1b0832 Implemented AutoNumWorker Pass which sets num_workers of selected parallel ops automatically if enabled 2020-12-08 17:49:05 -05:00
Lixia Chen 32b82c2737 Fix a core dump in TreeConsumer::Terminate() 
and other minor cache changes
 2020-12-08 15:38:40 -05:00
mindspore-ci-bot 934005f390 !9636 Remove batch_map multi-process test case 
From: @hfarahat
Reviewed-by: @nsyca,@mikef
Signed-off-by: @mikef
 2020-12-08 23:24:56 +08:00
mindspore-ci-bot 231fccf66c !9600 Add Adagrad Optimizer 
From: @zyx5256
Reviewed-by: @liangchenghui,@kingxian
Signed-off-by: @liangchenghui
 2020-12-08 18:29:18 +08:00
hesham ff65f6feb8 Remove batch_map multiprocess test case 2020-12-08 00:36:02 -05:00
mindspore-ci-bot f6a22cb455 !9591 Assignment enables negative index 
From: @liangzhibo
Reviewed-by: @ginfung,@zh_qh
Signed-off-by: @zh_qh
 2020-12-08 11:03:48 +08:00
mindspore-ci-bot ec3983b77d !9577 support distributed predict 
From: @gong_zi_yan
Reviewed-by: @caozhou_huawei,@yao_yf,@stsuteng,@zh_qh
Signed-off-by: @stsuteng
 2020-12-08 10:28:30 +08:00
zhuyuxiao 37bebc751b add adagrad optim 2020-12-08 09:38:15 +08:00
mindspore-ci-bot e6ec9be6c2 !9386 l1_regularizer开发 
From: @dangjiaqi1
Reviewed-by: 
Signed-off-by:
 2020-12-07 21:58:58 +08:00
“dangjiaqi1” 39948670dd new update basic.py which add class L1Regularizer(Cell). new add test_l1_regularizer.py. new add test_l1_regularizer.py 2020-12-07 20:08:35 +08:00
l00591931 3189868a15 Assignment enable index smaller than 0 2020-12-07 17:09:03 +08:00
Bairong 2eeaec7512 support arange in functional.py 2020-12-07 16:22:55 +08:00
Ziyan e7e9dae54d support distributed predict 2020-12-07 16:12:45 +08:00
mindspore-ci-bot 186f5394ba !9155 add_conv3d_object 
From: @jiangzg001
Reviewed-by: 
Signed-off-by:
 2020-12-07 11:48:06 +08:00
mindspore-ci-bot 5d1a8b09db !9097 Primitive Shape support return range of dynamic shape 
From: @M20211031
Reviewed-by: @ginfung
Signed-off-by:
 2020-12-07 10:30:02 +08:00
mindspore-ci-bot 3c4a585143 !9545 Move API inner.DynamicGRUV2 to P.DynamicGRUV2. 
From: @liu_xiao_93
Reviewed-by: @liangchenghui
Signed-off-by: @liangchenghui
 2020-12-05 18:26:34 +08:00
mindspore-ci-bot aa5d4e08a9 !9544 Fix a possible seg fault in GenerateCRC caused by std::regex 
From: @lixiachen
Reviewed-by: @jonyguo,@heleiwang
Signed-off-by: @heleiwang
 2020-12-05 15:31:40 +08:00
liuxiao93 712ad98a92 Move API inner.DynamicGRUV2 to P.DynamicGRUV2. 2020-12-05 14:53:14 +08:00
mindspore-ci-bot 3b7acc57c9 !9508 [Auto parallel] Set CNODE's fullname when cloning 
From: @xiaoda_zh
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
 2020-12-05 13:56:13 +08:00
Lixia Chen 27579fe858 Fix a seg fault caused by std::regex 2020-12-04 20:58:11 -05:00
Nat Sutyanyong 4cb78f2e03 Remove Repeat(1),Take(-1), and Skip(0) in NodeRemovalPass 2020-12-04 17:37:07 -05:00
mindspore-ci-bot 3280474d71 !9533 dataset Python Pushdown - more minor code rework; CSVDataset delim_field bug fix 
From: @cathwong
Reviewed-by: @nsyca,@mikef
Signed-off-by: @nsyca
 2020-12-05 06:01:13 +08:00
Jesse Lee 0c8dfc68ec Fix hang on RequestFreeTag 2020-12-04 14:54:30 -05:00
Cathy Wong 69b269c6cf dataset Python Pushdown - more minor code rework; CSVDataset delim_field bug fix 2020-12-04 14:39:52 -05:00
jiangzhenguang c45eee9b94 add conv3d object 2020-12-04 20:13:29 +08:00
Xiaoda Zhang 9a9e3a751e set cnode's fullname when cloning 2020-12-04 15:59:44 +08:00
mindspore-ci-bot 4f607e9c26 !9335 Add multiprocessing support to per_batch_map 
From: @hfarahat
Reviewed-by: 
Signed-off-by:
 2020-12-04 15:13:46 +08:00
mindspore-ci-bot a6b716003f !9469 Fix minor issues in distribution classes 
From: @shallydeng
Reviewed-by: @zichun_ye,@sunnybeike
Signed-off-by: @sunnybeike
 2020-12-04 09:41:49 +08:00
Xun Deng 4ef9e9e57f fix minor issues in distribution classes 2020-12-03 14:47:08 -05:00
Nat Sutyanyong d69a29a44e Migrate 3 pre passes to IR optimizer, namely, cache_error_pass, epoch_injection, and removal_pass 2020-12-03 14:40:03 -05:00
mindspore-ci-bot 73c91e05b1 !9398 Change Build to return status 
From: @alex-yuyue
Reviewed-by: @mikef
Signed-off-by:
 2020-12-03 23:43:08 +08:00
mindspore-ci-bot 4bb7303463 !9424 [PipelineSplit]Fix Shared Parameter bug 
From: @lichen666
Reviewed-by: @zh_qh
Signed-off-by:
 2020-12-03 20:43:31 +08:00
lichenever 818e920f02 fix_pipeline_split_param_shared_bug 2020-12-03 19:30:29 +08:00
mxm 82268dc703 support DynamicShape and StridedSlice primitive return range of shape value. 2020-12-03 19:08:34 +08:00
alex-yuyue ccff3a5316 Change build to return status 
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
 2020-12-02 22:46:49 -05:00
mindspore-ci-bot b9d2392937 !9350 Add Matrix_Determinant and Matrix_Inverse to Mindspore front-end 
From: @peixu_ren
Reviewed-by: @liangchenghui,@zh_qh
Signed-off-by: @liangchenghui
 2020-12-03 10:01:16 +08:00
hesham 809f9c91be Add multiprocessing support to per_batch_map 2020-12-02 15:40:14 -05:00
lichenever 78e131cf15 pipeline_split adapt parallel 2020-12-02 18:52:40 +08:00
mindspore-ci-bot 79fef0df0e !9142 fix bug of addn not supported dynamic shape 
From: @M20211031
Reviewed-by: @zh_qh
Signed-off-by: @zh_qh
 2020-12-02 17:59:37 +08:00
bai-yangfan c46c4dffe4 mindir_suffix 2020-12-02 11:52:37 +08:00
peixu_ren 0adab15de7 Add Matrix_Determinant and Matrix_Inverse to Mindspore front-end 2020-12-01 22:25:50 -05:00
mindspore-ci-bot 51d885815a !9281 increase variable_memory_max_size max size from 30GB to 31GB 
From: @laiyongqiang
Reviewed-by: 
Signed-off-by:
 2020-12-02 10:43:57 +08:00
mindspore-ci-bot df44e1339e !9249 Optimizing GetDatasetSize 
From: @mahdirahmanihanzaki
Reviewed-by: 
Signed-off-by:
 2020-12-02 08:26:34 +08:00
mindspore-ci-bot 4ffd9b578f !9331 More cache minor fix for HQ testers 
From: @lixiachen
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
 2020-12-02 06:45:15 +08:00
Mahdi f80553bc6e Optimization for GetDatasetSize 2020-12-01 17:40:25 -05:00
Lixia Chen 2ddb1fb75e More CRC fix and blocking BatchOp under cache 2020-12-01 15:20:33 -05:00
mindspore-ci-bot 77ef72be30 !9306 fix ndarray field without type in mindrecord 
From: @jonyguo
Reviewed-by: @pandoublefeng,@liucunwei
Signed-off-by: @liucunwei
 2020-12-01 20:50:37 +08:00
laiyongqiang 11244f790a increase variable_memory_max_size max size from 30GB to 31GB 2020-12-01 20:29:57 +08:00
mindspore-ci-bot 45b705bca0 !9129 support abs() and mean() method for Tensor object 
From: @bairongz
Reviewed-by: 
Signed-off-by:
 2020-12-01 19:03:42 +08:00
jonyguo 847e59bd6c fix: ndarray field without type in mindrecord 2020-12-01 17:30:57 +08:00
mindspore-ci-bot 920bbf1541 !9277 fix schema & zip validation 
From: @luoyang42
Reviewed-by: @pandoublefeng,@liucunwei
Signed-off-by: @liucunwei
 2020-12-01 16:28:48 +08:00
YangLuo 5cc3b76577 fix schema & zip validation 2020-12-01 14:23:56 +08:00
Bairong 623b2e3f99 support abs and mean of Tensor 2020-12-01 11:34:12 +08:00
mindspore-ci-bot e45f19adc8 !8697 support the outermost layer network inputs are list or dict or scalar 
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
 2020-12-01 11:11:43 +08:00
mindspore-ci-bot 5306c91cb7 !9214 support repeated calculation when the axis of gatherv2 is 0 and split 
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
 2020-12-01 09:14:50 +08:00
mindspore-ci-bot af3c27d354 !9244 Fix core dump with concat and getter_pass 
From: @ziruiwu
Reviewed-by: 
Signed-off-by:
 2020-12-01 06:56:41 +08:00
mindspore-ci-bot ccf637f64a !9241 SequenceMask gpu kernel 
From: @peilin-wang
Reviewed-by: @tom__chen
Signed-off-by:
 2020-12-01 06:49:47 +08:00
mindspore-ci-bot c3e7a8255c !9248 Add input check to nlp operators 
From: @ezphlow
Reviewed-by: @nsyca,@mikef
Signed-off-by: @nsyca
 2020-12-01 06:45:26 +08:00
Eric cf802c839c Added missing input check for nlp operator 2020-11-30 16:23:40 -05:00
Zirui Wu 23487fae09 fix get_shape/type and a segfault in getter_pass 
add test case
 2020-11-30 16:22:33 -05:00
Peilin Wang f7dc2432a0 initial commit 
fix ci

fix ci

remove old sequence mask api

fix ci

fix ci

remove old seuqence mask tests
 2020-11-30 14:44:22 -05:00
buxue d6f91133c3 Support the outermost layer network inputs are list or dict or scalar 2020-11-30 20:21:38 +08:00
mindspore-ci-bot 762793cb8f !9175 fix a bug in random resize crop op and some lint 
From: @tiancixiao
Reviewed-by: @liucunwei,@jonyguo,@liucunwei
Signed-off-by: @liucunwei
 2020-11-30 20:03:51 +08:00
mindspore-ci-bot f0671ce513 !9076 [MD] Support vision c_transform python eager: Resize, Rescale, Normalize, HWC2CHW, Pad 
From: @luoyang42
Reviewed-by: 
Signed-off-by:
 2020-11-30 20:03:45 +08:00
mxm 59f9ac9975 Primitive 'AddN' support dynamic shape 2020-11-30 17:30:20 +08:00
yangzhenzhang 7b33f3e2ac gatherv2 axis split repeated calculation 2020-11-30 17:03:29 +08:00
mindspore-ci-bot b85bcff4b2 !9057 modify export file name 
From: @changzherui
Reviewed-by: 
Signed-off-by:
 2020-11-30 16:39:27 +08:00
Xiao Tianci 12da8717b7 1.correct param check for vision op 2.fix config review 3.fix api doc 2020-11-30 16:12:31 +08:00
yangzhenzhang 7278f5c109 update_gatherv2_op 2020-11-28 16:56:39 +08:00
Xiaoda Zhang c79e988b0d set fullname for reshape after reshape-elimination 2020-11-28 12:16:51 +08:00
mindspore-ci-bot a146f982bc !8983 support variabel length virtual_dataset in auto parallel 
From: @yao_yf
Reviewed-by: 
Signed-off-by:
 2020-11-28 11:07:27 +08:00
mindspore-ci-bot dcde1fc70a !9092 Add LBeta op at nn level 
From: @peixu_ren
Reviewed-by: 
Signed-off-by:
 2020-11-28 10:44:45 +08:00
luoyang aa4bf9a3f2 [MD] Support python-eager: Resize, Rescale, Normalize, HWC2CHW, Pad 2020-11-28 10:06:53 +08:00
changzherui 91301a6d1a modify export file name 2020-11-28 09:59:41 +08:00
mindspore-ci-bot 55f7e3dc16 !9135 Minor fixs for cache error message 
From: @tina_mengting_zhang
Reviewed-by: @mikef,@robingrosman
Signed-off-by: @nsyca
 2020-11-28 08:49:25 +08:00
peixu_ren 37d40bc495 Add Beta distribution 2020-11-27 17:07:54 -05:00
tinazhang 6f31bdbf67 fix issues for hq testers: I277HD, I277HV 2020-11-27 17:01:23 -05:00
peixu_ren 6355f46d32 Add LBeta op at nn level 2020-11-27 11:59:06 -05:00
tinazhang 27698866d1 Block take/skip under cache and fix docstring 
and other minor changes per the request of HQ testers
 2020-11-26 17:44:19 -05:00
yao_yf 9cda064716 auto parallel predict 2020-11-26 20:13:15 +08:00
mindspore-ci-bot 421cad24ef !8715 Add Gamma distribution 
From: @peixu_ren
Reviewed-by: 
Signed-off-by:
 2020-11-26 09:57:31 +08:00
mindspore-ci-bot adc8e3e707 !8594 [MD] Pybind Pushdown Support for dataset 
From: @cathwong
Reviewed-by: 
Signed-off-by:
 2020-11-26 05:55:49 +08:00
Eric Zhang 809e1d5086 added python api based on cpp api 
1st draft of python iterator

Added Cifar10 and Cifar100 pybind port

Change pybind to use IR for Skip and Manifest

Signed-off-by: alex-yuyue <yue.yu1@huawei.com>

DatasetNode as a base for all IR nodes

namespace change

Fix the namespace issue and make ut tests work

Signed-off-by: alex-yuyue <yue.yu1@huawei.com>

Add VOCDataset

!63 Added RandomDataset
* Added RandomDataset

add imagefolder ir

Pybind switch: CelebA and UT

!61 CLUE example with class definition
* Merge branch 'python-api' of gitee.com:ezphlow/mindspore into clue_class_pybind
* Passing testcases
* Added CLUE, not working

add ManifestDataset IR

Signed-off-by: alex-yuyue <yue.yu1@huawei.com>

Update Coco & VOC & TFReader, Update clang-format, Reorder
datasets_binding

!69 Add Generator and move c_dataset.Iterator to dataset.Iterator
* Add GeneratorDataset to c_dataset
* Add GeneratorDataset to c_dataset

!67 Moving c_datasets and adding sampler wrapper
* Need to add create() method in datasets.py
* migration from c_dataset to dataset part 1

!71 Fix indent error
* Fix indentation error

!72 Fix c_api tests cases
* Fix c_api tests cases

!73 Added CSV Dataset
* Added CSVDataset

pybind switch: Take and CelebA fixes

!75 move c_dataset functionality to datasets
* Fixed existing testcases
* Added working clue and imagefolder
* Added sampler conversion from pybind
* Added sampler creation

!77 Add Python API tree
* Python API tree

add minddataset

TextFileDataset pybind

Rename to skip test_concat.py and test_minddataset_exception.py

!80 Add batch IR to python-api branch, most test cases work
* staging III
* staging, add pybind

Enable more c_api take and CelebA tests; delete util_c_api

!84 Schema changes in datasets.py
* Schema changes

!85 Remove input_indexes from sub-classes
* remove input_index from each subclass

!83 Remove C datasets
* Removed c_dataset package
* Remove c_datasets

!82  pybind switch: shuffle
* pybind switch: shuffle

!86 Add build_vocab
* Add build_vocab

Rebase with upstream/master
_shuffle conflict
BatchNode error

!88 Fix rebase problem
* fix rebase problem

Enable more unit tests; code typo/nit fixes

!91 Fix python vocag hang
* Fix python vocab hang

!89 Added BucketBatchByLength Pybind switch
* Added BucketBatchByLength

Update and enable more tet_c_api_*.py tests

!95 Add BuildSentencePeiceVocab
* - Add BuildSentencePeiceVocab

!96 Fix more tests
* - Fix some tests

- Enable more test_c_api_*
- Add syncwait

!99 pybind switch for device op
* pybind switch for device op

!93 Add getters to python API
* Add getters to python API

!101 Validate tree, error if graph
* - Add sync wait

!103 TFrecord/Random Datasets schema problem
* - TfRecord/Random schem aproblem

!102 Added filter pybind switch
* Added Filter pybind switch

!104 Fix num_samples
* - TfRecord/Random schem aproblem

!105 Fix to_device hang
* Fix to_device hang

!94 Adds Cache support for CLUE dataset
* Added cache for all dataset ops
* format change
* Added CLUE cache support
* Added Cache conversion

Add save pybind

fix compile err

init modify concat_node

!107 Fix some tests cases
* Fix tests cases

Enable and fix more tests

!109 pybind switch for get dataset size
* pybind_get_dataset_size

some check-code fixes for pylint, cpplint and clang-format

!113 Add callback
* revert
* dataset_sz 1 line
* fix typo
* get callback to work

!114 Make Android compile clean
* Make Android Compile Clean

Fix build issues due to rebase

!115 Fix more tests
* Fix tests cases
* !93 Add getters to python API

fix test_profiling.py

!116 fix get dataset size
* fix get dataset size

!117 GetColumnNames pybind switch
* Added GetColumnNames pybind switch

code-check fixes: clangformat, cppcheck, cpplint, pylint

Delete duplicate test_c_api_*.py files; more lint fixes

!121 Fix cpp tests
* Remove extra call to getNext in cpp tests

!122 Fix Schema with Generator
* Fix Schema with Generator

fix some cases of csv & mindrecord

!124 fix tfrecord get_dataset_size and add some UTs
* fix tfrecord get dataset size and add some ut for get_dataset_size

!125 getter separation
* Getter separation

!126 Fix sampler.GetNumSamples
* Fix sampler.GetNumSampler

!127 Assign runtime getter to each get function
* Assign runtime getter to each get function

Fix compile issues

!128 Match master code
* Match master code

!129 Cleanup DeviceOp/save code
* Cleanup ToDevice/Save code

!130 Add cache fix
* Added cache fix for map and image folder

!132 Fix testing team issues
* Pass queue_name from python to C++
* Add Schema.from_json

!131 Fix Cache op issues and delete de_pipeline
* Roll back C++ change
* Removed de_pipeline and passing all cache tests.
* fixed cache tests

!134 Cleanup datasets.py part1
* Cleanup dataset.py part1

!133 Updated validation for SentencePieceVocab.from_dataset
* Added type_check for column names in SentencePieceVocab.from_dataset

Rebase on master 181120 10:20

fix profiling

temporary solution of catching stauts from Node.Build()

!141 ToDevice Termination
* ToDevice termination

pylint fixes

!137 Fix test team issues and add some corresponding tests
* Fix test team issues and add some corresponding tests

!138 TreeGetter changes to use OptPass
* Getter changes to use OptPass (Zirui)

Rebase fix

!143 Fix cpplint issue
* Fix cpplint issue

pylint fixes in updated testcases

!145 Reset exceptions testcase
* reset exception test to master

!146 Fix Check_Pylint Error
* Fix Check_Pylint Error

!147 fix android
* fix android

!148 ToDevice changes
* Add ToDevice to the iterator List for cleanup at exit

!149 Pylint issue
* Add ToDevice to the iterator List for cleanup at exit

!150 Pylint 2
* Add ToDevice to the iterator List for cleanup at exit

!152 ExecutionTree error
* ET destructor error

!153 in getter_pass, only remove callback, without deleting map op
* getter pass no longer removes map

!156 early __del__ of iterator/to_device
* early __del__ of iterator

!155 Address review comments Eric 1
* Added one liner fix to validators.py
* roll back signature fix
* lint fix
* Eric Address comments 2
* C++ lint fix
* Address comments Eric 1

!158 Review rework for dataset bindings - part 1
* Reorder nodes repeat and rename
* Review rework for dataset bindings - part 1

!154 Fixing minor problems in the comments (datasets.py, python_tree_consumer.cc, iterators_bindings.cc, and iterators.py)
* Fixing minor problems in the comments (datasets.py, python_tree_consum…

!157 add replace none
* Add replace_none to datasets.py, address comments in tests

Trying to resolve copy

Override the deepcopy method of deviceop

Create_ir_tree method

Create_ir_tree method 2

Create_ir_tree method 2

del to_device if already exists

del to_device if already exists

cache getters shapes and types

Added yolov3 relaxation, to be rolled back

Get shapes and types together

bypass yolo

NumWorkers for MapOp

revert Yolo

revert Thor

Print more info

Debug code: Update LOG INFO to LOG ERROR

do not remove epochctrl for getter pass

Remove repeat(1)

pritn batch size

add log to tree_consumer and device_queue op

Revert PR 8744

Signed-off-by: alex-yuyue <yue.yu1@huawei.com>

__del__ toDEvice

__del__ toDevice2

!165 add ifndef ENABLE_ANDROID to device queue print
* Add ifndef ENABLE_ANDROID to device queue print

revert some changes

!166 getter: get_data_info
* getter: get_data_info

!168 add back tree print
* revert info to warnning in one log
* add back the missed print tree log

Release GIL in GetDataInfo
 2020-11-25 15:46:59 -05:00
mindspore-ci-bot 979bb26cba !9031 Fix DatasetCache parameter check 
From: @lixiachen
Reviewed-by: @nsyca,@mikef
Signed-off-by: @nsyca
 2020-11-26 03:55:02 +08:00
Lixia Chen ab7427f1a9 Minor fix for DatasetCache param validation 2020-11-25 13:20:30 -05:00
peixu_ren 93d4ef428f Add Gamma distribution 2020-11-25 09:40:46 -05:00
mindspore-ci-bot 22d683a805 !8920 Adapt ops LinSpace for Ascend. 
From: @liu_xiao_93
Reviewed-by: @liangchenghui,@linqingke,@liangchenghui
Signed-off-by: @liangchenghui,@liangchenghui
 2020-11-25 12:03:56 +08:00
mindspore-ci-bot d9b4b5c750 !8954 Add SequenceMask operator. 
From: @liangzhibo
Reviewed-by: @chenfei52,@zh_qh
Signed-off-by: @zh_qh
 2020-11-25 11:41:59 +08:00
liuxiao93 584e241e29 Adapt ops LinSpace for Ascend. 2020-11-25 09:50:03 +08:00
peixu_ren 01f5da0a14 Add Poisson distribution 2020-11-24 11:55:39 -05:00
l00591931 17c0810f9e add SequenceMask operator 2020-11-24 19:47:28 +08:00
mindspore-ci-bot 3d6d820612 !8154 Add nn.MultiFieldEmbedding for the embedding lookup opearations 
From: @huangxinjing
Reviewed-by: 
Signed-off-by:
 2020-11-24 09:49:39 +08:00
mindspore-ci-bot d915fd9b96 !8592 change repeat_elements to a composite op 
From: @tom__chen
Reviewed-by: 
Signed-off-by:
 2020-11-23 23:15:23 +08:00
huangxinjing b0deb7a289 Add dense embedding 2020-11-23 20:21:58 +08:00
mindspore-ci-bot 2eee1c06f0 !8842 Change Ones/Zeros operator 
From: @liangzhibo
Reviewed-by: @chenfei52
Signed-off-by:
 2020-11-23 12:37:19 +08:00
mindspore-ci-bot 7f725b93a3 !8234 Remove expm1_generic and log1p_generic from PP utils 
From: @peixu_ren
Reviewed-by: 
Signed-off-by:
 2020-11-23 09:56:07 +08:00
l00591931 f1e92d0ea7 Change Ones/zeros 2020-11-23 09:33:38 +08:00
mindspore-ci-bot e3371a01d5 !8751 Fix minor bugs in bijector and distribution 
From: @shallydeng
Reviewed-by: @zichun_ye,@sunnybeike
Signed-off-by:
 2020-11-23 08:50:57 +08:00
mindspore-ci-bot cfb9fb40d0 !8794 Add nn.Interpolate() function. 
From: @liangzhibo
Reviewed-by: @chenfei52,@zh_qh
Signed-off-by: @zh_qh
 2020-11-20 14:55:21 +08:00
l00591931 05e26f4739 Add nn.interpolate() 2020-11-20 10:00:47 +08:00
mindspore-ci-bot 81dfd70ece !8785 Add Parallel Operator UnsortedSegmentMax 
From: @huangxinjing
Reviewed-by: @yangzhenzhang,@stsuteng,@kisnwang
Signed-off-by: @stsuteng
 2020-11-20 09:23:30 +08:00
tom__chen a52cd685fc change repeat_element op to a composite op 2020-11-19 15:42:22 -05:00
mindspore-ci-bot 8980bc3de7 !8675 support allreduce prod 
From: @yao_yf
Reviewed-by: @stsuteng,@kisnwang
Signed-off-by: @stsuteng
 2020-11-19 20:21:27 +08:00
mindspore-ci-bot 39352ca658 !8580 Add Operation AllSwap Primitive 
From: @huangxinjing
Reviewed-by: 
Signed-off-by:
 2020-11-19 19:41:06 +08:00
huangxinjing 89e7778497 Add UnsortedSegmentMax Operation 2020-11-19 17:41:54 +08:00
mindspore-ci-bot fa2185b8ef !8661 Add nn.Tril() and nn.Triu() 
From: @liangzhibo
Reviewed-by: 
Signed-off-by:
 2020-11-19 16:34:32 +08:00
mindspore-ci-bot f827c18f1d !8289 Add Parallel Implements of Slice Op 
From: @huangxinjing
Reviewed-by: 
Signed-off-by:
 2020-11-19 15:54:20 +08:00
mindspore-ci-bot a3ae3b9794 !8695 add AdamOffload optimizer 
From: @wangnan39
Reviewed-by: @stsuteng,@stsuteng,@kingxian
Signed-off-by: @kingxian
 2020-11-19 10:42:14 +08:00
l00591931 e1dba1337c Add nn.Tril function 2020-11-19 10:31:30 +08:00
Xun Deng b5e05472ce fix minor bugs in bijector and distribution utils, fix docs issues 2020-11-18 21:13:47 -05:00
mindspore-ci-bot f1ef84e1a6 !8714 dataset Python UT: Add Sampler Chain Tests, with get_dataset_size 
From: @cathwong
Reviewed-by: @nsyca,@mikef
Signed-off-by: @nsyca
 2020-11-19 03:26:44 +08:00
mindspore-ci-bot 8e1ce841b4 !8688 dataset: modify the error log msg in python layer to be more acceptable 
From: @ms_yan
Reviewed-by: 
Signed-off-by:
 2020-11-18 21:43:48 +08:00
huangxinjing 8129806475 Add slice parallel op 2020-11-18 20:20:33 +08:00
mindspore-ci-bot ee72de1db2 !8441 Add Parallel Implements of UniformCandidateSampler 
From: @huangxinjing
Reviewed-by: 
Signed-off-by:
 2020-11-18 18:59:31 +08:00
mindspore-ci-bot cd6236c0a0 !8712 update pipeline parallel interface 
From: @yangzhenzhang
Reviewed-by: @kisnwang
Signed-off-by:
 2020-11-18 18:59:04 +08:00
mindspore-ci-bot fb0e866ad1 !8269 forward unique dynamic shape 
From: @yao_yf
Reviewed-by: 
Signed-off-by:
 2020-11-18 18:53:46 +08:00
huangxinjing 23284f0b35 Add AllSwap Op 2020-11-18 18:35:28 +08:00
ms_yan 0cb5c47856 add err modify 2020-11-18 16:30:24 +08:00
wangnan39@huawei.com ab811fca8f add AdamOffload optimizer 2020-11-18 16:13:47 +08:00
yao_yf 31819bb4a7 support forward unique 2020-11-18 15:22:14 +08:00
yangzhenzhang 278e82a849 update pipeline parallel 2020-11-18 13:55:34 +08:00
yao_yf 1529d544b9 add allreduce prod 2020-11-18 11:08:56 +08:00
mindspore-ci-bot f40a4781e4 !8656 Adapt DynamicGRUV2Grad for Ascend new backend. 
From: @liu_xiao_93
Reviewed-by: @jjfeing,@liangchenghui
Signed-off-by: @liangchenghui
 2020-11-18 09:54:05 +08:00
huangxinjing 2730cef047 Uniform Sampler Base Update 2020-11-18 09:39:32 +08:00
Cathy Wong e5f62013f4 dataset Python UT: Add Sampler Chain Tests, with get_dataset_size 2020-11-17 15:24:44 -05:00
peixu_ren 4aa836dae1 Add Digamma op 2020-11-17 11:49:20 -05:00
liuxiao93 2aaf5e2e1b Adapt DynamicGRUV2Grad for Ascend new backend. 2020-11-17 20:27:18 +08:00
peixu_ren 65d50861ec Remove expm1_generic and log1p_generic from PP utils 2020-11-16 16:12:13 -05:00
peixu_ren 5e9178c5b6 Add IGamma operator 2020-11-16 15:40:09 -05:00
mindspore-ci-bot 52eb2d3401 !8477 Add Cauchy distribution 
From: @shallydeng
Reviewed-by: @zichun_ye
Signed-off-by:
 2020-11-16 23:24:00 +08:00
mindspore-ci-bot b411c05de0 !8495 Adapt DynamicGRUV2 forward for Ascend new backend. 
From: @liu_xiao_93
Reviewed-by: 
Signed-off-by:
 2020-11-16 19:13:16 +08:00
mindspore-ci-bot a321f402c8 !8579 Add view function for tensor 
From: @liangzhibo
Reviewed-by: @zh_qh,@chenfei52
Signed-off-by: @zh_qh
 2020-11-16 14:37:21 +08:00
l00591931 7a192973ff Add view function for tensor 2020-11-16 10:49:19 +08:00
mindspore-ci-bot 2bf165c0b4 !8557 run cast before allgather in parallel optimzier 
From: @gong_zi_yan
Reviewed-by: 
Signed-off-by:
 2020-11-16 09:55:44 +08:00
mindspore-ci-bot c11c79170e !8554 Add expand_as function to tensor 
From: @liangzhibo
Reviewed-by: @zh_qh,@chenfei52
Signed-off-by: @zh_qh
 2020-11-13 15:19:01 +08:00
liuxiao93 d471ac491e Adapt DynamicGRUV2 forward for Ascend new backend. 2020-11-13 14:54:40 +08:00
Ziyan 0ddb754edb run cast before parallel optimizer 2020-11-13 14:04:04 +08:00
l00591931 ba7ee2aa13 add expand_as function 2020-11-13 11:42:54 +08:00
mindspore-ci-bot d2427b6e89 !8538 fix get_num_class in imagefolder 
From: @ziruiwu
Reviewed-by: @robingrosman,@nsyca
Signed-off-by: @nsyca
 2020-11-13 05:07:11 +08:00
Zirui Wu 3555d19b07 fix get num_class in imagefolder 
address cmt

review cmts
 2020-11-12 14:26:54 -05:00
mindspore-ci-bot ffc5209c09 !8476 Merge CacheOp_dev fixes for HQ system test. 
From: @jkl_lee
Reviewed-by: 
Signed-off-by:
 2020-11-13 01:30:41 +08:00
Jesse Lee c795879313 CacheOp delivery for HQ tester 2020-11-12 08:48:29 -05:00
mindspore-ci-bot a442024604 !8510 Add Ones and Zeros operators 
From: @liangzhibo
Reviewed-by: @zh_qh,@chenfei52
Signed-off-by: @zh_qh
 2020-11-12 20:45:52 +08:00
l00591931 886ef520d7 Add Ones and Zeros operators 2020-11-12 16:26:28 +08:00
mindspore-ci-bot f16509388c !8409 Multi-dimensional list value assignment 
From: @liangzhibo
Reviewed-by: @chenfei52
Signed-off-by:
 2020-11-12 14:36:20 +08:00
Xun Deng 1a68ccb40b added Cauchy distribution 2020-11-11 22:36:34 -05:00
mindspore-ci-bot 156980778b !8416 Fix RealDiv Type Error when insert an VirtualDiv Operation 
From: @huangxinjing
Reviewed-by: @stsuteng
Signed-off-by: @stsuteng
 2020-11-11 17:24:19 +08:00
huangxinjing 12e9107162 Fix VirtualDiv Int32 error 2020-11-11 09:32:57 +08:00
l00591931 c5b5a6719c Enable multi-dimensional list value assignment 2020-11-11 09:25:12 +08:00
liuxiao93 92ba9d94df Adapt UnsortedSegmentMax for Ascend. 2020-11-10 14:12:00 +08:00
mindspore-ci-bot 4e07f43dff !8323 [Auto parallel] Supporting for-loop in strategy-searching 
From: @xiaoda_zh
Reviewed-by: 
Signed-off-by:
 2020-11-10 10:33:25 +08:00
mindspore-ci-bot 5a4af56c15 !8322 add parallel op for Range 
From: @yangzhenzhang
Reviewed-by: @xiaoda_zh,@cristoval
Signed-off-by:
 2020-11-10 09:18:56 +08:00
Xiaoda Zhang aa13d6b1cd support for-loop in auto-parallel 2020-11-09 17:18:30 +08:00
yangzhenzhang 9747bde861 add range op 2020-11-09 15:14:07 +08:00
HuangBingjian 265a6d61b6 reverse fix shape=0 2020-11-09 15:06:37 +08:00
mindspore-ci-bot 470027a3a2 !8318 Fix some bugs about API. 
From: @liu_xiao_93
Reviewed-by: @liangchenghui
Signed-off-by: @liangchenghui
 2020-11-09 11:26:32 +08:00
mindspore-ci-bot ec5c86c1bb !8191 redesigned bijector broadcast shape and bijector's dtype logic 
From: @shallydeng
Reviewed-by: @zichun_ye,@sunnybeike
Signed-off-by: @sunnybeike
 2020-11-09 09:47:08 +08:00
mindspore-ci-bot 027916cb5f !8315 Cache server stability 
From: @jkl_lee
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
 2020-11-08 20:03:23 +08:00
liuxiao93 0a1155f938 Fix some bugs about API. 2020-11-07 17:06:25 +08:00
Lixia Chen f24a788eed Rebase up to 5792d50ca7 2020-11-06 18:39:05 -05:00
mindspore-ci-bot a9a9c45662 !8232 C++ api add Filter 
From: @tiancixiao
Reviewed-by: 
Signed-off-by:
 2020-11-07 00:32:15 +08:00
mindspore-ci-bot 8c2ed3bb80 !8138 Throw an exception when a tensor with 0 shape is constructed. 
Merge pull request !8138 from huangbingjian/fix_shape
 2020-11-06 16:26:58 +08:00
Xiao Tianci 4a5e287b92 add filter c api and ut 2020-11-06 15:49:23 +08:00
HuangBingjian 4477fcfe19 fix shape bug. 2020-11-06 12:59:03 +08:00
yangzhenzhang 0a79ab82ae add parallel ops 2020-11-06 12:09:19 +08:00
mindspore-ci-bot c253d874e0 !8280 add export lenet grad example 
Merge pull request !8280 from changzherui/add_export_grad_example
 2020-11-06 10:14:54 +08:00
changzherui 6b823282aa add export mindir lenet grad 2020-11-05 23:01:43 +08:00
Yi Huaijie d7faa77b5e support int64 shape 2020-11-05 21:15:49 +08:00
Xiaoda Zhang aa84484049 enabling approximation in DP algorithms 2020-11-05 16:07:26 +08:00
mindspore-ci-bot b3855530e3 !7838 Enumerate function enable tensor as input 
Merge pull request !7838 from LiangZhibo/master
 2020-11-05 11:33:02 +08:00
Xun Deng fb0263f869 redesigned bijector classes, changed bacth_shape calculation in transformed distribution and upgraded dtype logic of bijector class 2020-11-03 15:28:45 -05:00
mindspore-ci-bot 49eb4d3106 !8089 add antialias option for py reset 
Merge pull request !8089 from guozhijian/enhance_py_resize
 2020-11-03 16:25:21 +08:00
mindspore-ci-bot f3d7b32d56 !7855 Move backend opt pass ir files to the fold: verbose_ir_files 
Merge pull request !7855 from huanghui/move_ir_files
 2020-11-03 15:34:17 +08:00
mindspore-ci-bot e9cd12e904 !8114 rectify and optimize the type checking function 
Merge pull request !8114 from zhangbuxue/rectify_and_optimize_the_type_checking_function
 2020-11-03 14:48:12 +08:00
mindspore-ci-bot 00294473e3 !7976 [pynative] Add nested derivative feature 
Merge pull request !7976 from zjun/Add_nested_derivative
 2020-11-03 14:02:43 +08:00
buxue 346bcfa3fd Rectify and optimize the type checking function 2020-11-03 13:48:43 +08:00
jonyguo 1b78e34310 add ANTIALIAS support for python progress 2020-11-03 11:03:46 +08:00
mindspore-ci-bot bbfef6233a !8134 Add TBE op DynamicGRU for new and old backend. 
Merge pull request !8134 from liuxiao93/DynamicGRU-new-old-backend
 2020-11-03 09:53:08 +08:00
l00591931 6f165ee5e3 enumerate function and enumerate test case added 2020-11-02 21:11:52 +08:00
mindspore-ci-bot e909b9077c !7946 fix auto parallel optimizer weight shard 
Merge pull request !7946 from gziyan/fix_auto_optim_shard
 2020-11-02 20:51:56 +08:00
mindspore-ci-bot e99a8bd784 !8120 fix CI randomly fails 
Merge pull request !8120 from yihuaijie/master
 2020-11-02 20:08:33 +08:00
liuxiao93 45d343257b Add DynamicGRU. 2020-11-02 19:59:40 +08:00
zjun ccedf71de5 Add pynative bprop nested grad 
Signed-off-by: zjun <zhangjun0@huawei.com>
 2020-11-02 19:33:33 +08:00
mindspore-ci-bot ad930b30db !7891 add layer of clipbyglobalnorm 
Merge pull request !7891 from jiangzhenguang/add_clip_by_global_norm
 2020-11-02 19:18:33 +08:00
huanghui fa6c23358a Move some ir files which backend optpass dumped to the fold: verbose_ir_files 2020-11-02 19:18:24 +08:00
Yi Huaijie da29f232c6 fix CI random fails 2020-11-02 16:28:28 +08:00
Ziyan c33f2cd796 fix auto optimizer weight shard 2020-11-02 16:25:48 +08:00
jzg 4851a67bb5 add layer of clipbyglobalnorm. 2020-11-02 16:15:17 +08:00
mindspore-ci-bot 7e43eaf5e8 !8072 Revert changes to weighted_random_sampler in PR7866 
Merge pull request !8072 from luoyang/pylint
 2020-11-02 15:36:45 +08:00
mindspore-ci-bot 7092a33e87 !8039 support key ward way to pass arg for outermost net in graph mode 
Merge pull request !8039 from zhangbuxue/support_key_ward_way_to_pass_arg_for_outermost_net_in_graph_mode
 2020-10-31 14:58:40 +08:00
YangLuo 82cc7c3f63 [MD] Revert changes to weighted_random_sampler in PR7866 2020-10-31 12:56:17 +08:00
mindspore-ci-bot cacebd1211 !7933 Cache performance updates 
Merge pull request !7933 from Jamie/CacheOp_dev
 2020-10-31 04:25:47 +08:00
buxue 1364b5c301 support key ward way to pass arg for outermost net in graph mode 2020-10-30 16:55:53 +08:00
mindspore-ci-bot eb3b093686 !8013 [MD] fix minddataset padding bug 
Merge pull request !8013 from liyong126/fix_md_pad
 2020-10-30 16:44:45 +08:00
mindspore-ci-bot 015b244471 !7991 fix ReLUV2 error 
Merge pull request !7991 from yihuaijie/dev
 2020-10-30 14:16:33 +08:00
liyong 0d40abf5dd fix md padding bug 2020-10-30 12:00:44 +08:00
Lixia Chen 572c5e5f29 Rebase up to 542a52fbf8 2020-10-29 20:34:09 -04:00
Yi Huaijie 148d645915 fix ReLUV2 error 2020-10-29 20:29:01 +08:00
mindspore-ci-bot 870afe08f5 !7914 get keys and values from dictionary & set tuple to dictionary 
Merge pull request !7914 from Simson/push-to-opensource
 2020-10-29 19:58:35 +08:00
simson 3b21822824 get keys and values from dictionary & set tuple to dictionary 2020-10-29 18:06:06 +08:00
Zirui Wu ea97197311 fix tfrecord_op core dump 
add test case

fix ci

fix ci round 2

address review cmts
 2020-10-28 17:38:43 -04:00
mindspore-ci-bot 163544795f !7922 add params check for offset in distributed_sampler 
Merge pull request !7922 from xiaotianci/fix_distributed_sampler
 2020-10-28 20:57:50 +08:00
mindspore-ci-bot 376fa95717 !7771 Add Parallel SegmentOps 
Merge pull request !7771 from huangxinjing/segment_ops
 2020-10-28 17:19:35 +08:00
Xiao Tianci 823e52f1dc add params checking of offset in distributed_sampler 
add related comment to explain
add related UT
 2020-10-28 16:46:12 +08:00
mindspore-ci-bot 0d43e37f22 !7651 Add embedding and embedding_lookup 
Merge pull request !7651 from jiangzhenguang/add_embedding_and_enbedding_lookup
 2020-10-28 15:13:40 +08:00
huangxinjing bf5d21770a Add UnsortedSegmentSum and UnosrtedSemenMin For Oparallel Implements 2020-10-28 08:57:02 +08:00
Xun Deng d4df6f82ea support get_dist_args 2020-10-27 16:17:38 -04:00
mindspore-ci-bot d4142d682d !7437 auto parallel support dynamic 
Merge pull request !7437 from yao_yf/auto_parallel_support_dynamic_shape
 2020-10-27 21:02:28 +08:00
jzg 7cbd55e17d add embedding layer. 2020-10-27 20:51:49 +08:00