yystopf
/
mindspore
forked from mindspore-Ecosystem/mindspore
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
22,898 Commits 23 Branches 0 Tags 3.9 GiB
Commit Graph

2386 Commits

Author SHA1 Message Date
yuchaojie b51b3a6764 update Pool's attr kernel_size, pad_mode 2021-01-18 12:10:20 +08:00
mindspore-ci-bot e214c69bc2 !11195 develop dice loss 
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
 2021-01-18 12:00:41 +08:00
buxue 69d9a33ddb show line of code when parse or resolve phase exception 2021-01-16 16:31:04 +08:00
Jiaqi 87ecd44f67 develop dice loss 2021-01-16 15:54:06 +08:00
TinaMengtingZhang d3fdbceb61 [Part II] Push down json save logic to IR and add getter to each IR node 2021-01-15 18:03:37 -05:00
mindspore-ci-bot eacc8bac89 !10755 [Numpy-Native] Add new numpy-native interfaces to mindspore.numpy 
From: @yanglf1121
Reviewed-by: 
Signed-off-by:
 2021-01-15 10:04:17 +08:00
mindspore-ci-bot a2d9c5914a !10944 Tensor op decoupling stage 2 
From: @alexyuyue
Reviewed-by: 
Signed-off-by:
 2021-01-15 05:28:50 +08:00
alex-yuyue b54e01bfb4 Tensor op decoupling stage 2 
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
 2021-01-14 11:51:16 -05:00
buxue 7eaf84d07a remove attr support_non_tensor_input of cell 2021-01-14 16:19:23 +08:00
yanglf1121 72903c11c8 add array_ops, math_ops and tensor ops 2021-01-14 15:32:36 +08:00
mindspore-ci-bot 44507b4a64 !11200 support non tensor inputs for ms_function and grad of net 
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
 2021-01-14 14:41:08 +08:00
mindspore-ci-bot 151c0e2977 !11132 modify batchnormal and fusedbatchnormal 
From: @Somnus2020
Reviewed-by: 
Signed-off-by:
 2021-01-14 10:57:10 +08:00
buxue acec35d4d4 support non tensor inputs 2021-01-14 09:21:01 +08:00
lilei 9a45c4419c modify batch_normal 2021-01-13 20:59:46 +08:00
mindspore-ci-bot 1dd600d416 !11114 add perplexity metric 
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
 2021-01-13 14:58:59 +08:00
TinaMengtingZhang 4812fece80 [Part I] Push down json save logic to IR and add getter to each IR node 2021-01-12 11:17:45 -05:00
Jiaqi d6f4421a1d perplexity 2021-01-12 20:26:26 +08:00
Nat Sutyanyong 686772cce7 Migrate GeneratorOp resetting logic to IR optimizer (incl. debug code) 
with comments from the peer view addressed
 2021-01-11 12:20:40 -05:00
mindspore-ci-bot fb97aa327c !10881 add the tensor collection feature when record summary 
From: @jiang-shuqiang
Reviewed-by: 
Signed-off-by:
 2021-01-11 20:59:07 +08:00
jiangshuqiang ab5cc10250 add the tensor collection feature when record summary 2021-01-11 12:39:36 +08:00
liuxiao93 aacad990c3 Add grad of sort. 2021-01-11 09:07:46 +08:00
mindspore-ci-bot 7957a3b6f5 !10988 Tensor op decoupling stage 1 
From: @ezphlow
Reviewed-by: 
Signed-off-by:
 2021-01-09 05:12:10 +08:00
Eric be46ccf721 Started vision decoupling 
map validate params

Changing bindings

Change behavior of vision.cc

Added signature and changed Cmake

Compiling

Need to fix compile

Added compiling random transforms

python changes for decoupling

two failed test case remaining

Compiling random choice

passes all ut

Changed assert

review comments

Added validate params

add back return value

Fix lint

py lint fix

pylint 2

Addressing comments
 2021-01-08 09:42:20 -05:00
mindspore-ci-bot b355f5402b !10309 Port over getter pass and tensor fusion pass to IR 
From: @ziruiwu
Reviewed-by: 
Signed-off-by:
 2021-01-08 21:37:51 +08:00
Zirui Wu 0e68575e77 port over getter pass 
port over tensor_op_fusion pass

add fusion support for prebuildOpeartion (TensorOpeartion)
 2021-01-07 10:52:49 -05:00
Jiaqi f6de97fc27 bleu_score 2021-01-07 21:24:38 +08:00
mindspore-ci-bot 62888f23b8 !10400 roc and auc 
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
 2021-01-07 21:19:41 +08:00
mindspore-ci-bot 274e0aa750 !10885 add nll_loss operation 
From: @jiangzg001
Reviewed-by: @liangchenghui,@wuxuejian
Signed-off-by: @liangchenghui
 2021-01-07 14:15:22 +08:00
mindspore-ci-bot 1276715c11 !10939 surface distance 
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
 2021-01-07 11:02:15 +08:00
Jiaqi ef3f6d62db auc_roc 2021-01-07 10:55:16 +08:00
mindspore-ci-bot 09848d7ef3 !9083 add dice and hausdroff 
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
 2021-01-07 10:31:42 +08:00
mindspore-ci-bot 67296c08c7 !9502 add hausdroff distance 
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
 2021-01-07 10:31:32 +08:00
mindspore-ci-bot 1c942ce49f !10221 support grad accumulation for auto parallel 
From: @yangzhenzhang
Reviewed-by: 
Signed-off-by:
 2021-01-06 15:27:34 +08:00
mindspore-ci-bot 1f06cd63f3 !10436 Support to control whether to throw runtime exceptions in SummaryRecord 
From: @ouwenchang
Reviewed-by: 
Signed-off-by:
 2021-01-06 14:21:21 +08:00
mindspore-ci-bot 1d1f6841b9 !10937 keep consistent in Graph mode and PyNative mode for 'isinstance' 
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
 2021-01-06 10:29:49 +08:00
ougongchang 06be546b52 Support to control whether raise RuntimeError exception in SummaryRecord 
1. Support explainer raise an RuntimeError exception
2. fix the ut of SummaryRecord
 2021-01-06 10:07:47 +08:00
yangzhenzhang 9da3f9bec9 mini step grad accumulation 2021-01-06 09:25:06 +08:00
jiangzhenguang d3f42e7d6b add nll_loss operation. 2021-01-06 09:11:35 +08:00
mindspore-ci-bot 03e655f14a !10070 Fixing GetDatasetSize issue with chained samplers 
From: @mahdirahmanihanzaki
Reviewed-by: 
Signed-off-by:
 2021-01-06 05:11:51 +08:00
buxue 6d395c1d3f keep consistent in Graph mode and PyNative mode for 'isinstance' 2021-01-05 21:36:10 +08:00
mindspore-ci-bot a531628dd5 !10325 modify MetaTensor and Tensor 
From: @Somnus2020
Reviewed-by: @kingxian
Signed-off-by: @kingxian
 2021-01-05 17:50:34 +08:00
Jiaqi 29cd33a542 3d 2021-01-05 17:25:41 +08:00
Jiaqi 9a5b9525de hausdorff_distance 2021-01-05 17:20:57 +08:00
Jiaqi ed7cf87d0b surface distance 2021-01-05 17:13:12 +08:00
lilei b858097ae4 modify MetaTensor and Tensor 2021-01-04 20:58:34 +08:00
Payne b12ca2165c add bool expand dims and wait to test 2020-12-31 14:55:13 +08:00
mindspore-ci-bot 37a4cbfb3b !10772 Prevent the multiprocess.pool from capturing KeyboardInterrupt, 
From: @ouwenchang
Reviewed-by: @wenkai_dist,@wangyue01
Signed-off-by: @wangyue01
 2020-12-30 10:02:25 +08:00
ougongchang e5529230bf Prevent the multiprocess from capturing KeyboardInterrupt 2020-12-29 17:46:42 +08:00
mindspore-ci-bot 998483e0c3 !10610 add batchnorm3d and check in conv3d 
From: @jiangzg001
Reviewed-by: @liangchenghui,@wuxuejian
Signed-off-by: @liangchenghui
 2020-12-29 16:56:22 +08:00
jiangzhenguang 9f950fb16c add batchnorm3d 2020-12-29 09:37:35 +08:00
mindspore-ci-bot 2e684df5b1 !10686 fix infer rank list typo and add testcase 
From: @gong_zi_yan
Reviewed-by: @stsuteng,@zhunaipan
Signed-off-by: @stsuteng
 2020-12-28 21:20:19 +08:00
Ziyan 2c3b99ce91 fix infer rank list typo 2020-12-28 18:46:01 +08:00
mindspore-ci-bot 0d04de8db2 !10455 Expand J for innermost graph first when the graph also contains J primitive 
From: @ginfung
Reviewed-by: @zhunaipan
Signed-off-by:
 2020-12-28 14:42:07 +08:00
mindspore-ci-bot b67aaf6773 !9832 expose_allgather_fusion_to_users 
From: @gong_zi_yan
Reviewed-by: 
Signed-off-by:
 2020-12-28 09:54:57 +08:00
yujianfeng 728fac6c9f Expand J for innermost graph first when the graph also contains J primitive 2020-12-28 09:37:23 +08:00
Ziyan bbf8ec82b9 expose allgather fusion interface to users 2020-12-27 17:44:45 +08:00
buxue 1a7c161e73 support len of a Tensor 2020-12-26 17:02:25 +08:00
mindspore-ci-bot 4df0baa6c7 !10392 getitem fix bug 
From: @yepei6
Reviewed-by: @zhunaipan,@kingxian,@zhunaipan
Signed-off-by: @kingxian
 2020-12-24 20:49:17 +08:00
mindspore-ci-bot 221d5b67d2 !10442 change code in modelzoo to import dataset APIs from mindspore.dataset rather than mindspore.dataset.engine 
From: @tiancixiao
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
 2020-12-24 19:56:39 +08:00
Xiao Tianci 31fed1a2f6 change code to import APIs from mindspore.dataset rather than mindspore.dataset.engine 2020-12-24 17:30:02 +08:00
mindspore-ci-bot 261bb736de !10063 Modify profiler directory structure to fit the new Run Package 
From: @gzhcv
Reviewed-by: 
Signed-off-by:
 2020-12-24 16:53:13 +08:00
mindspore-ci-bot 1343c9cca2 !10255 using do_copy option to choose Tensor.from_numpy to do Tensor convert 
From: @ms_yan
Reviewed-by: 
Signed-off-by:
 2020-12-24 14:53:18 +08:00
mindspore-ci-bot e1248a7246 !10389 Fix the Backward of the AllSwap Operation 
From: @huangxinjing
Reviewed-by: @stsuteng,@stsuteng,@zhunaipan
Signed-off-by: @stsuteng,@stsuteng
 2020-12-24 09:38:29 +08:00
Payne 4f78ee0077 fix getitem bug 2020-12-23 22:02:23 +08:00
ms_yan deb1e6e965 use from_numpy and add do_copy option 2020-12-23 21:38:05 +08:00
mindspore-ci-bot 70dc40551a !10020 Improve fancy index from 1st dimension to arbitrarily dimension 
From: @yepei6
Reviewed-by: 
Signed-off-by:
 2020-12-23 21:23:36 +08:00
mindspore-ci-bot 20df37e428 !10287 Add ut for dataset to_number 
From: @luoyang42
Reviewed-by: @heleiwang
Signed-off-by:
 2020-12-23 21:14:42 +08:00
huangxinjing 565ce81b29 Fix allsawp 2020-12-23 17:17:03 +08:00
Zirui Wu a1355a827c introduce a master switch to turn on and off profiler 2020-12-22 16:48:01 -05:00
mindspore-ci-bot 176ea4676c !10261 change the int32 restrict to int restric 
From: @yepei6
Reviewed-by: @kingxian,@kingxian
Signed-off-by: @kingxian,@kingxian
 2020-12-22 20:39:29 +08:00
Payne 5c9982729d fancy index getitem 2020-12-22 18:13:16 +08:00
mindspore-ci-bot 9b3226c2b6 !10289 Ignore the graphs with defer_inline flag when specializing on graph arguments 
From: @ginfung
Reviewed-by: @zh_qh
Signed-off-by: @zh_qh
 2020-12-22 17:41:20 +08:00
Payne 236bfb75e3 change the int32 restrict to int 2020-12-22 17:35:02 +08:00
yujianfeng e1aa34a030 Ignore the graphs with defer_inline flag when specializing on graph arguments 2020-12-22 14:32:44 +08:00
mindspore-ci-bot 00611b1c41 !10175 Add tensor.ndim and rename tensor.size() to tensor.size 
From: @yanglf1121
Reviewed-by: @kingxian,@zhunaipan
Signed-off-by: @kingxian
 2020-12-22 14:13:10 +08:00
YangLuo da6de519ae Add ut for dataset to_number 2020-12-21 20:09:03 +08:00
mindspore-ci-bot f8e5bffe4d !10286 fix Wrong TypeError in numpy_native 
From: @wangrao124
Reviewed-by: @zhunaipan,@kingxian
Signed-off-by: @kingxian
 2020-12-21 19:30:08 +08:00
mindspore-ci-bot 441e283e21 !10197 Add input check for the embedding 
From: @huangxinjing
Reviewed-by: @stsuteng,@zhunaipan
Signed-off-by: @stsuteng
 2020-12-21 19:12:09 +08:00
wangrao 2fb3f0ef4f fix Wrong TypeError in numpy_native 2020-12-21 16:33:36 +08:00
Ziyan c5c905fdf5 add restriction for opt shard 2020-12-19 17:43:55 +08:00
mindspore-ci-bot 5ff6de83eb !10173 Fix Strategy Check for UnsortedSegments 
From: @huangxinjing
Reviewed-by: @zhunaipan,@stsuteng
Signed-off-by: @stsuteng
 2020-12-19 14:24:58 +08:00
mindspore-ci-bot d99189f681 !10207 Fix some minor doc, typo related to AutoNumWorker 
From: @ziruiwu
Reviewed-by: @mikef
Signed-off-by:
 2020-12-19 06:35:59 +08:00
Zirui Wu 4ae7102fd3 address 2 tickets 2020-12-18 15:03:32 -05:00
huangxinjing dd0da1542d Add input check 2020-12-18 19:54:49 +08:00
yanglf1121 918679daa3 add tensor.ndim and rename tensor.size() to tensor.size 2020-12-18 17:15:42 +08:00
huangxinjing a8446af1ab Fix condition check 2020-12-18 16:43:43 +08:00
gzhcv bad8c0e422 Modify profiling dir structure to fit the new Run Package 2020-12-18 11:04:07 +08:00
mindspore-ci-bot 893d59afd7 !10097 Fix bugs for np.mean, np.asarray, np.concatenate, np.linspace 
From: @yanglf1121
Reviewed-by: 
Signed-off-by:
 2020-12-18 09:10:51 +08:00
Mahdi 98ea8fa6ea Added tests for chain samplers, fixed GetDatasetSize issue with chained samplers 2020-12-17 13:26:42 -05:00
mindspore-ci-bot fc11b7dd68 !10074 Fix a testcase error when shuffle is above cache 
From: @lixiachen
Reviewed-by: @liucunwei,@pandoublefeng
Signed-off-by: @liucunwei,@liucunwei
 2020-12-17 19:56:26 +08:00
mindspore-ci-bot 691e3baab6 !10109 [MD] Fix Decode doc & RandomNode log 
From: @luoyang42
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
 2020-12-17 19:50:19 +08:00
mindspore-ci-bot 6035823c4b !10044 fix get num classes of concat 
From: @luoyang42
Reviewed-by: @liucunwei,@heleiwang,@liucunwei
Signed-off-by: @liucunwei,@liucunwei
 2020-12-17 19:30:50 +08:00
yanglf1121 760cd1870a corner cases check for np.asarray, np.mean, np.concatenate 2020-12-17 18:33:10 +08:00
luoyang 595b7a782f [MD] Fix Decode doc & RandomNode log 2020-12-17 17:04:31 +08:00
mindspore-ci-bot 734f50f36e !10083 support non tensor inputs in model predict 
From: @zhangbuxue
Reviewed-by: @zhunaipan,@zh_qh
Signed-off-by: @zh_qh
 2020-12-17 16:33:52 +08:00
buxue f90f77c16e support non tensor inputs in model predict 2020-12-17 14:17:41 +08:00
buxue aeeef7607a remove the 'raise' in construct of Cell 2020-12-17 10:54:42 +08:00
Lixia Chen a7f0e13234 Remove special treatment for cache above repeat 2020-12-16 21:13:04 -05:00
YangLuo df9f4f41e8 fix get num classes of concat 2020-12-16 14:58:32 +08:00
mindspore-ci-bot 26ff566f90 !10002 fix get dataset size in distributed scenario 
From: @tiancixiao
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
 2020-12-16 14:25:39 +08:00
Xiao Tianci 633f97bb48 fix get dataset size in distributed scenario 2020-12-15 20:41:45 +08:00
yanglf1121 9072283395 fix mindpsore.numpy packaging issue and format API comments 2020-12-15 18:06:55 +08:00
mindspore-ci-bot c4f284b928 !9910 [MD][Perf] MindData add NormalizePad for GPU performance 
From: @xiefangqi
Reviewed-by: 
Signed-off-by:
 2020-12-15 16:51:22 +08:00
mindspore-ci-bot b8faa8293b !9920 python eager add decode 
From: @luoyang42
Reviewed-by: @liucunwei
Signed-off-by: @liucunwei
 2020-12-15 16:37:39 +08:00
mindspore-ci-bot dd134d7554 !9926 optimize list setitem in bprop 
From: @zhangbuxue
Reviewed-by: @zh_qh
Signed-off-by: @zh_qh
 2020-12-15 16:20:07 +08:00
buxue 2530943a7f optimize list getitem in bprop 2020-12-15 15:00:49 +08:00
xiefangqi 3c6cc3c58c Add NormalizePadOp 2020-12-15 11:45:41 +08:00
YangLuo 18e61a627a python eager add decode 2020-12-15 10:00:59 +08:00
mindspore-ci-bot a9f2de8307 !9737 complete fancy index getitem 
From: @yepei6
Reviewed-by: 
Signed-off-by:
 2020-12-15 09:44:52 +08:00
Payne 4c8f0914d0 complete fancy index getitem 2020-12-14 22:18:38 +08:00
mindspore-ci-bot ca4225a4f3 !9717 amend some script 
From: @jiangzg001
Reviewed-by: @liangchenghui,@c_34
Signed-off-by: @liangchenghui
 2020-12-14 19:39:15 +08:00
mindspore-ci-bot 3a803b3c18 !9862 Fix the bug of ImageNetToMR 
From: @shenwei41
Reviewed-by: @pandoublefeng,@liucunwei
Signed-off-by: @liucunwei
 2020-12-14 15:53:14 +08:00
jiangzhenguang 9cf856dd25 amend some script 2020-12-14 11:08:20 +08:00
mindspore-ci-bot ad6507d88a !9825 [MD] fix pad, normalize in c_trasnform 
From: @luoyang42
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
 2020-12-14 10:48:10 +08:00
mindspore-ci-bot e10dbb4a7f !9723 add ir passes to unify mindir 
From: @yuchaojie
Reviewed-by: 
Signed-off-by:
 2020-12-14 10:14:47 +08:00
jjfeing 1984cf8e20 unify mindir 2020-12-12 17:55:16 +08:00
buxue 70d12aae26 add detailed and accurate description for support non tensor inputs for outermost net. 2020-12-12 16:54:08 +08:00
shenwei41 547f96717b Fix Bug 2020-12-12 11:35:34 +08:00
mindspore-ci-bot d5db8872fd !9834 Fix wrong input argument of Reshape for multi field embedding 
From: @huangxinjing
Reviewed-by: @zhunaipan,@stsuteng
Signed-off-by: @stsuteng
 2020-12-11 21:31:48 +08:00
huangxinjing 996ee72c50 Fix embedding layer 
Fix input check
 2020-12-11 19:13:09 +08:00
mindspore-ci-bot 5e35bec957 !9799 change_last_nodes_strategy_in_auto_parallel_when_eval_and_predict 
From: @yao_yf
Reviewed-by: @zhunaipan,@stsuteng
Signed-off-by: @stsuteng
 2020-12-11 17:51:32 +08:00
luoyang 1cc147df1d fix pad, normalize in c_trasnform 2020-12-11 17:46:29 +08:00
mindspore-ci-bot 10d326ee62 !9798 hide arange 
From: @bairongz
Reviewed-by: @zh_qh,@zhunaipan
Signed-off-by: @zh_qh
 2020-12-11 15:29:33 +08:00
yao_yf 19fe28cb9b hange strategys of last nodes in eval/predict at auto parallel mode 2020-12-11 11:11:28 +08:00
Zirui Wu 77521e78d2 staging 2020-12-10 14:45:04 -05:00
Bairong 8cf43e59e0 hide arange, delete related test case and improve the doc string of nn.Range 2020-12-10 21:42:59 +08:00
mindspore-ci-bot 8c0d066bf9 !9763 Change name from interpolate to resizeBilinear 
From: @liangzhibo
Reviewed-by: @ginfung,@zh_qh,@zhunaipan
Signed-off-by: @zh_qh
 2020-12-10 17:41:14 +08:00
Xiaoda Zhang e78228603b move parallel-related black-list to core/ir, and fix the cloneCNode bug 2020-12-10 15:57:01 +08:00
l00591931 130c61cfc0 change name from interpolate to resizeBilinear 2020-12-10 11:46:40 +08:00
mindspore-ci-bot 9ecf062581 !9552 change the import level of dynamic_lr 
From: @wangnan39
Reviewed-by: @kingxian,@zh_qh,@kingxian
Signed-off-by: @kingxian,@kingxian
 2020-12-10 11:15:08 +08:00
mindspore-ci-bot 78fba32865 !9752 Fix potential hang in RandomData and incorrectly named functions 
From: @ziruiwu
Reviewed-by: @heleiwang,@pandoublefeng
Signed-off-by: @pandoublefeng
 2020-12-10 10:51:01 +08:00
mindspore-ci-bot 3f82405d17 !9639 Add Numpy Native to Mindspore 
From: @yanglf1121
Reviewed-by: 
Signed-off-by:
 2020-12-10 09:45:16 +08:00
Zirui Wu 91a6b2b0ca Add checks to RandomData and LookUp 2020-12-09 17:09:34 -05:00
yanglf1121 59e5afd2bb Add mindnumpy to mindspore 2020-12-09 21:35:16 +08:00
wangnan39@huawei.com 0fe9e2e4cb support import dynamic_lr from nn 2020-12-09 17:47:52 +08:00
mindspore-ci-bot a2aea8cba5 !9578 add_conv3d_transpose_object 
From: @jiangzg001
Reviewed-by: @liangchenghui,@liangchenghui
Signed-off-by: @liangchenghui
 2020-12-09 16:41:48 +08:00
mindspore-ci-bot 6d34bacc17 !9470 support arange in functional.py 
From: @bairongz
Reviewed-by: @ginfung
Signed-off-by:
 2020-12-09 14:39:36 +08:00
jiangzhenguang 5060565920 add conv3d_transpose. 2020-12-09 13:48:23 +08:00
mindspore-ci-bot 317a97e6b9 !9336 auto num_parallel_workers setup 
From: @ziruiwu
Reviewed-by: 
Signed-off-by:
 2020-12-09 08:32:55 +08:00
mindspore-ci-bot a2c80435ce !9685 Fix a core dump in TreeConsumer::Terminate() plus minor cache fixes 
From: @lixiachen
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
 2020-12-09 08:21:22 +08:00
Zirui Wu d6df1b0832 Implemented AutoNumWorker Pass which sets num_workers of selected parallel ops automatically if enabled 2020-12-08 17:49:05 -05:00
Lixia Chen 32b82c2737 Fix a core dump in TreeConsumer::Terminate() 
and other minor cache changes
 2020-12-08 15:38:40 -05:00
mindspore-ci-bot 934005f390 !9636 Remove batch_map multi-process test case 
From: @hfarahat
Reviewed-by: @nsyca,@mikef
Signed-off-by: @mikef
 2020-12-08 23:24:56 +08:00
mindspore-ci-bot 231fccf66c !9600 Add Adagrad Optimizer 
From: @zyx5256
Reviewed-by: @liangchenghui,@kingxian
Signed-off-by: @liangchenghui
 2020-12-08 18:29:18 +08:00
hesham ff65f6feb8 Remove batch_map multiprocess test case 2020-12-08 00:36:02 -05:00
mindspore-ci-bot f6a22cb455 !9591 Assignment enables negative index 
From: @liangzhibo
Reviewed-by: @ginfung,@zh_qh
Signed-off-by: @zh_qh
 2020-12-08 11:03:48 +08:00
mindspore-ci-bot ec3983b77d !9577 support distributed predict 
From: @gong_zi_yan
Reviewed-by: @caozhou_huawei,@yao_yf,@stsuteng,@zh_qh
Signed-off-by: @stsuteng
 2020-12-08 10:28:30 +08:00
zhuyuxiao 37bebc751b add adagrad optim 2020-12-08 09:38:15 +08:00
mindspore-ci-bot e6ec9be6c2 !9386 l1_regularizer开发 
From: @dangjiaqi1
Reviewed-by: 
Signed-off-by:
 2020-12-07 21:58:58 +08:00
“dangjiaqi1” 39948670dd new update basic.py which add class L1Regularizer(Cell). new add test_l1_regularizer.py. new add test_l1_regularizer.py 2020-12-07 20:08:35 +08:00
l00591931 3189868a15 Assignment enable index smaller than 0 2020-12-07 17:09:03 +08:00
Bairong 2eeaec7512 support arange in functional.py 2020-12-07 16:22:55 +08:00
Ziyan e7e9dae54d support distributed predict 2020-12-07 16:12:45 +08:00
mindspore-ci-bot 186f5394ba !9155 add_conv3d_object 
From: @jiangzg001
Reviewed-by: 
Signed-off-by:
 2020-12-07 11:48:06 +08:00
mindspore-ci-bot 5d1a8b09db !9097 Primitive Shape support return range of dynamic shape 
From: @M20211031
Reviewed-by: @ginfung
Signed-off-by:
 2020-12-07 10:30:02 +08:00
mindspore-ci-bot 3c4a585143 !9545 Move API inner.DynamicGRUV2 to P.DynamicGRUV2. 
From: @liu_xiao_93
Reviewed-by: @liangchenghui
Signed-off-by: @liangchenghui
 2020-12-05 18:26:34 +08:00
mindspore-ci-bot aa5d4e08a9 !9544 Fix a possible seg fault in GenerateCRC caused by std::regex 
From: @lixiachen
Reviewed-by: @jonyguo,@heleiwang
Signed-off-by: @heleiwang
 2020-12-05 15:31:40 +08:00
liuxiao93 712ad98a92 Move API inner.DynamicGRUV2 to P.DynamicGRUV2. 2020-12-05 14:53:14 +08:00
mindspore-ci-bot 3b7acc57c9 !9508 [Auto parallel] Set CNODE's fullname when cloning 
From: @xiaoda_zh
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
 2020-12-05 13:56:13 +08:00
Lixia Chen 27579fe858 Fix a seg fault caused by std::regex 2020-12-04 20:58:11 -05:00
Nat Sutyanyong 4cb78f2e03 Remove Repeat(1),Take(-1), and Skip(0) in NodeRemovalPass 2020-12-04 17:37:07 -05:00
mindspore-ci-bot 3280474d71 !9533 dataset Python Pushdown - more minor code rework; CSVDataset delim_field bug fix 
From: @cathwong
Reviewed-by: @nsyca,@mikef
Signed-off-by: @nsyca
 2020-12-05 06:01:13 +08:00
Jesse Lee 0c8dfc68ec Fix hang on RequestFreeTag 2020-12-04 14:54:30 -05:00
Cathy Wong 69b269c6cf dataset Python Pushdown - more minor code rework; CSVDataset delim_field bug fix 2020-12-04 14:39:52 -05:00
jiangzhenguang c45eee9b94 add conv3d object 2020-12-04 20:13:29 +08:00
Xiaoda Zhang 9a9e3a751e set cnode's fullname when cloning 2020-12-04 15:59:44 +08:00
mindspore-ci-bot 4f607e9c26 !9335 Add multiprocessing support to per_batch_map 
From: @hfarahat
Reviewed-by: 
Signed-off-by:
 2020-12-04 15:13:46 +08:00
mindspore-ci-bot a6b716003f !9469 Fix minor issues in distribution classes 
From: @shallydeng
Reviewed-by: @zichun_ye,@sunnybeike
Signed-off-by: @sunnybeike
 2020-12-04 09:41:49 +08:00
Xun Deng 4ef9e9e57f fix minor issues in distribution classes 2020-12-03 14:47:08 -05:00
Nat Sutyanyong d69a29a44e Migrate 3 pre passes to IR optimizer, namely, cache_error_pass, epoch_injection, and removal_pass 2020-12-03 14:40:03 -05:00
mindspore-ci-bot 73c91e05b1 !9398 Change Build to return status 
From: @alex-yuyue
Reviewed-by: @mikef
Signed-off-by:
 2020-12-03 23:43:08 +08:00
mindspore-ci-bot 4bb7303463 !9424 [PipelineSplit]Fix Shared Parameter bug 
From: @lichen666
Reviewed-by: @zh_qh
Signed-off-by:
 2020-12-03 20:43:31 +08:00
lichenever 818e920f02 fix_pipeline_split_param_shared_bug 2020-12-03 19:30:29 +08:00
mxm 82268dc703 support DynamicShape and StridedSlice primitive return range of shape value. 2020-12-03 19:08:34 +08:00
alex-yuyue ccff3a5316 Change build to return status 
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
 2020-12-02 22:46:49 -05:00
mindspore-ci-bot b9d2392937 !9350 Add Matrix_Determinant and Matrix_Inverse to Mindspore front-end 
From: @peixu_ren
Reviewed-by: @liangchenghui,@zh_qh
Signed-off-by: @liangchenghui
 2020-12-03 10:01:16 +08:00
hesham 809f9c91be Add multiprocessing support to per_batch_map 2020-12-02 15:40:14 -05:00
lichenever 78e131cf15 pipeline_split adapt parallel 2020-12-02 18:52:40 +08:00
mindspore-ci-bot 79fef0df0e !9142 fix bug of addn not supported dynamic shape 
From: @M20211031
Reviewed-by: @zh_qh
Signed-off-by: @zh_qh
 2020-12-02 17:59:37 +08:00
bai-yangfan c46c4dffe4 mindir_suffix 2020-12-02 11:52:37 +08:00
peixu_ren 0adab15de7 Add Matrix_Determinant and Matrix_Inverse to Mindspore front-end 2020-12-01 22:25:50 -05:00
mindspore-ci-bot 51d885815a !9281 increase variable_memory_max_size max size from 30GB to 31GB 
From: @laiyongqiang
Reviewed-by: 
Signed-off-by:
 2020-12-02 10:43:57 +08:00
mindspore-ci-bot df44e1339e !9249 Optimizing GetDatasetSize 
From: @mahdirahmanihanzaki
Reviewed-by: 
Signed-off-by:
 2020-12-02 08:26:34 +08:00
mindspore-ci-bot 4ffd9b578f !9331 More cache minor fix for HQ testers 
From: @lixiachen
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
 2020-12-02 06:45:15 +08:00
Mahdi f80553bc6e Optimization for GetDatasetSize 2020-12-01 17:40:25 -05:00
Lixia Chen 2ddb1fb75e More CRC fix and blocking BatchOp under cache 2020-12-01 15:20:33 -05:00
mindspore-ci-bot 77ef72be30 !9306 fix ndarray field without type in mindrecord 
From: @jonyguo
Reviewed-by: @pandoublefeng,@liucunwei
Signed-off-by: @liucunwei
 2020-12-01 20:50:37 +08:00
laiyongqiang 11244f790a increase variable_memory_max_size max size from 30GB to 31GB 2020-12-01 20:29:57 +08:00
mindspore-ci-bot 45b705bca0 !9129 support abs() and mean() method for Tensor object 
From: @bairongz
Reviewed-by: 
Signed-off-by:
 2020-12-01 19:03:42 +08:00
jonyguo 847e59bd6c fix: ndarray field without type in mindrecord 2020-12-01 17:30:57 +08:00
mindspore-ci-bot 920bbf1541 !9277 fix schema & zip validation 
From: @luoyang42
Reviewed-by: @pandoublefeng,@liucunwei
Signed-off-by: @liucunwei
 2020-12-01 16:28:48 +08:00
YangLuo 5cc3b76577 fix schema & zip validation 2020-12-01 14:23:56 +08:00
Bairong 623b2e3f99 support abs and mean of Tensor 2020-12-01 11:34:12 +08:00
mindspore-ci-bot e45f19adc8 !8697 support the outermost layer network inputs are list or dict or scalar 
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
 2020-12-01 11:11:43 +08:00
mindspore-ci-bot 5306c91cb7 !9214 support repeated calculation when the axis of gatherv2 is 0 and split 
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
 2020-12-01 09:14:50 +08:00
mindspore-ci-bot af3c27d354 !9244 Fix core dump with concat and getter_pass 
From: @ziruiwu
Reviewed-by: 
Signed-off-by:
 2020-12-01 06:56:41 +08:00
mindspore-ci-bot ccf637f64a !9241 SequenceMask gpu kernel 
From: @peilin-wang
Reviewed-by: @tom__chen
Signed-off-by:
 2020-12-01 06:49:47 +08:00
mindspore-ci-bot c3e7a8255c !9248 Add input check to nlp operators 
From: @ezphlow
Reviewed-by: @nsyca,@mikef
Signed-off-by: @nsyca
 2020-12-01 06:45:26 +08:00
Eric cf802c839c Added missing input check for nlp operator 2020-11-30 16:23:40 -05:00
Zirui Wu 23487fae09 fix get_shape/type and a segfault in getter_pass 
add test case
 2020-11-30 16:22:33 -05:00
Peilin Wang f7dc2432a0 initial commit 
fix ci

fix ci

remove old sequence mask api

fix ci

fix ci

remove old seuqence mask tests
 2020-11-30 14:44:22 -05:00
buxue d6f91133c3 Support the outermost layer network inputs are list or dict or scalar 2020-11-30 20:21:38 +08:00
mindspore-ci-bot 762793cb8f !9175 fix a bug in random resize crop op and some lint 
From: @tiancixiao
Reviewed-by: @liucunwei,@jonyguo,@liucunwei
Signed-off-by: @liucunwei
 2020-11-30 20:03:51 +08:00
mindspore-ci-bot f0671ce513 !9076 [MD] Support vision c_transform python eager: Resize, Rescale, Normalize, HWC2CHW, Pad 
From: @luoyang42
Reviewed-by: 
Signed-off-by:
 2020-11-30 20:03:45 +08:00
mxm 59f9ac9975 Primitive 'AddN' support dynamic shape 2020-11-30 17:30:20 +08:00
yangzhenzhang 7b33f3e2ac gatherv2 axis split repeated calculation 2020-11-30 17:03:29 +08:00
mindspore-ci-bot b85bcff4b2 !9057 modify export file name 
From: @changzherui
Reviewed-by: 
Signed-off-by:
 2020-11-30 16:39:27 +08:00
Xiao Tianci 12da8717b7 1.correct param check for vision op 2.fix config review 3.fix api doc 2020-11-30 16:12:31 +08:00
yangzhenzhang 7278f5c109 update_gatherv2_op 2020-11-28 16:56:39 +08:00
Xiaoda Zhang c79e988b0d set fullname for reshape after reshape-elimination 2020-11-28 12:16:51 +08:00
mindspore-ci-bot a146f982bc !8983 support variabel length virtual_dataset in auto parallel 
From: @yao_yf
Reviewed-by: 
Signed-off-by:
 2020-11-28 11:07:27 +08:00
mindspore-ci-bot dcde1fc70a !9092 Add LBeta op at nn level 
From: @peixu_ren
Reviewed-by: 
Signed-off-by:
 2020-11-28 10:44:45 +08:00
luoyang aa4bf9a3f2 [MD] Support python-eager: Resize, Rescale, Normalize, HWC2CHW, Pad 2020-11-28 10:06:53 +08:00
changzherui 91301a6d1a modify export file name 2020-11-28 09:59:41 +08:00
mindspore-ci-bot 55f7e3dc16 !9135 Minor fixs for cache error message 
From: @tina_mengting_zhang
Reviewed-by: @mikef,@robingrosman
Signed-off-by: @nsyca
 2020-11-28 08:49:25 +08:00
peixu_ren 37d40bc495 Add Beta distribution 2020-11-27 17:07:54 -05:00
tinazhang 6f31bdbf67 fix issues for hq testers: I277HD, I277HV 2020-11-27 17:01:23 -05:00
peixu_ren 6355f46d32 Add LBeta op at nn level 2020-11-27 11:59:06 -05:00
tinazhang 27698866d1 Block take/skip under cache and fix docstring 
and other minor changes per the request of HQ testers
 2020-11-26 17:44:19 -05:00
yao_yf 9cda064716 auto parallel predict 2020-11-26 20:13:15 +08:00
mindspore-ci-bot 421cad24ef !8715 Add Gamma distribution 
From: @peixu_ren
Reviewed-by: 
Signed-off-by:
 2020-11-26 09:57:31 +08:00
mindspore-ci-bot adc8e3e707 !8594 [MD] Pybind Pushdown Support for dataset 
From: @cathwong
Reviewed-by: 
Signed-off-by:
 2020-11-26 05:55:49 +08:00
Eric Zhang 809e1d5086 added python api based on cpp api 
1st draft of python iterator

Added Cifar10 and Cifar100 pybind port

Change pybind to use IR for Skip and Manifest

Signed-off-by: alex-yuyue <yue.yu1@huawei.com>

DatasetNode as a base for all IR nodes

namespace change

Fix the namespace issue and make ut tests work

Signed-off-by: alex-yuyue <yue.yu1@huawei.com>

Add VOCDataset

!63 Added RandomDataset
* Added RandomDataset

add imagefolder ir

Pybind switch: CelebA and UT

!61 CLUE example with class definition
* Merge branch 'python-api' of gitee.com:ezphlow/mindspore into clue_class_pybind
* Passing testcases
* Added CLUE, not working

add ManifestDataset IR

Signed-off-by: alex-yuyue <yue.yu1@huawei.com>

Update Coco & VOC & TFReader, Update clang-format, Reorder
datasets_binding

!69 Add Generator and move c_dataset.Iterator to dataset.Iterator
* Add GeneratorDataset to c_dataset
* Add GeneratorDataset to c_dataset

!67 Moving c_datasets and adding sampler wrapper
* Need to add create() method in datasets.py
* migration from c_dataset to dataset part 1

!71 Fix indent error
* Fix indentation error

!72 Fix c_api tests cases
* Fix c_api tests cases

!73 Added CSV Dataset
* Added CSVDataset

pybind switch: Take and CelebA fixes

!75 move c_dataset functionality to datasets
* Fixed existing testcases
* Added working clue and imagefolder
* Added sampler conversion from pybind
* Added sampler creation

!77 Add Python API tree
* Python API tree

add minddataset

TextFileDataset pybind

Rename to skip test_concat.py and test_minddataset_exception.py

!80 Add batch IR to python-api branch, most test cases work
* staging III
* staging, add pybind

Enable more c_api take and CelebA tests; delete util_c_api

!84 Schema changes in datasets.py
* Schema changes

!85 Remove input_indexes from sub-classes
* remove input_index from each subclass

!83 Remove C datasets
* Removed c_dataset package
* Remove c_datasets

!82  pybind switch: shuffle
* pybind switch: shuffle

!86 Add build_vocab
* Add build_vocab

Rebase with upstream/master
_shuffle conflict
BatchNode error

!88 Fix rebase problem
* fix rebase problem

Enable more unit tests; code typo/nit fixes

!91 Fix python vocag hang
* Fix python vocab hang

!89 Added BucketBatchByLength Pybind switch
* Added BucketBatchByLength

Update and enable more tet_c_api_*.py tests

!95 Add BuildSentencePeiceVocab
* - Add BuildSentencePeiceVocab

!96 Fix more tests
* - Fix some tests

- Enable more test_c_api_*
- Add syncwait

!99 pybind switch for device op
* pybind switch for device op

!93 Add getters to python API
* Add getters to python API

!101 Validate tree, error if graph
* - Add sync wait

!103 TFrecord/Random Datasets schema problem
* - TfRecord/Random schem aproblem

!102 Added filter pybind switch
* Added Filter pybind switch

!104 Fix num_samples
* - TfRecord/Random schem aproblem

!105 Fix to_device hang
* Fix to_device hang

!94 Adds Cache support for CLUE dataset
* Added cache for all dataset ops
* format change
* Added CLUE cache support
* Added Cache conversion

Add save pybind

fix compile err

init modify concat_node

!107 Fix some tests cases
* Fix tests cases

Enable and fix more tests

!109 pybind switch for get dataset size
* pybind_get_dataset_size

some check-code fixes for pylint, cpplint and clang-format

!113 Add callback
* revert
* dataset_sz 1 line
* fix typo
* get callback to work

!114 Make Android compile clean
* Make Android Compile Clean

Fix build issues due to rebase

!115 Fix more tests
* Fix tests cases
* !93 Add getters to python API

fix test_profiling.py

!116 fix get dataset size
* fix get dataset size

!117 GetColumnNames pybind switch
* Added GetColumnNames pybind switch

code-check fixes: clangformat, cppcheck, cpplint, pylint

Delete duplicate test_c_api_*.py files; more lint fixes

!121 Fix cpp tests
* Remove extra call to getNext in cpp tests

!122 Fix Schema with Generator
* Fix Schema with Generator

fix some cases of csv & mindrecord

!124 fix tfrecord get_dataset_size and add some UTs
* fix tfrecord get dataset size and add some ut for get_dataset_size

!125 getter separation
* Getter separation

!126 Fix sampler.GetNumSamples
* Fix sampler.GetNumSampler

!127 Assign runtime getter to each get function
* Assign runtime getter to each get function

Fix compile issues

!128 Match master code
* Match master code

!129 Cleanup DeviceOp/save code
* Cleanup ToDevice/Save code

!130 Add cache fix
* Added cache fix for map and image folder

!132 Fix testing team issues
* Pass queue_name from python to C++
* Add Schema.from_json

!131 Fix Cache op issues and delete de_pipeline
* Roll back C++ change
* Removed de_pipeline and passing all cache tests.
* fixed cache tests

!134 Cleanup datasets.py part1
* Cleanup dataset.py part1

!133 Updated validation for SentencePieceVocab.from_dataset
* Added type_check for column names in SentencePieceVocab.from_dataset

Rebase on master 181120 10:20

fix profiling

temporary solution of catching stauts from Node.Build()

!141 ToDevice Termination
* ToDevice termination

pylint fixes

!137 Fix test team issues and add some corresponding tests
* Fix test team issues and add some corresponding tests

!138 TreeGetter changes to use OptPass
* Getter changes to use OptPass (Zirui)

Rebase fix

!143 Fix cpplint issue
* Fix cpplint issue

pylint fixes in updated testcases

!145 Reset exceptions testcase
* reset exception test to master

!146 Fix Check_Pylint Error
* Fix Check_Pylint Error

!147 fix android
* fix android

!148 ToDevice changes
* Add ToDevice to the iterator List for cleanup at exit

!149 Pylint issue
* Add ToDevice to the iterator List for cleanup at exit

!150 Pylint 2
* Add ToDevice to the iterator List for cleanup at exit

!152 ExecutionTree error
* ET destructor error

!153 in getter_pass, only remove callback, without deleting map op
* getter pass no longer removes map

!156 early __del__ of iterator/to_device
* early __del__ of iterator

!155 Address review comments Eric 1
* Added one liner fix to validators.py
* roll back signature fix
* lint fix
* Eric Address comments 2
* C++ lint fix
* Address comments Eric 1

!158 Review rework for dataset bindings - part 1
* Reorder nodes repeat and rename
* Review rework for dataset bindings - part 1

!154 Fixing minor problems in the comments (datasets.py, python_tree_consumer.cc, iterators_bindings.cc, and iterators.py)
* Fixing minor problems in the comments (datasets.py, python_tree_consum…

!157 add replace none
* Add replace_none to datasets.py, address comments in tests

Trying to resolve copy

Override the deepcopy method of deviceop

Create_ir_tree method

Create_ir_tree method 2

Create_ir_tree method 2

del to_device if already exists

del to_device if already exists

cache getters shapes and types

Added yolov3 relaxation, to be rolled back

Get shapes and types together

bypass yolo

NumWorkers for MapOp

revert Yolo

revert Thor

Print more info

Debug code: Update LOG INFO to LOG ERROR

do not remove epochctrl for getter pass

Remove repeat(1)

pritn batch size

add log to tree_consumer and device_queue op

Revert PR 8744

Signed-off-by: alex-yuyue <yue.yu1@huawei.com>

__del__ toDEvice

__del__ toDevice2

!165 add ifndef ENABLE_ANDROID to device queue print
* Add ifndef ENABLE_ANDROID to device queue print

revert some changes

!166 getter: get_data_info
* getter: get_data_info

!168 add back tree print
* revert info to warnning in one log
* add back the missed print tree log

Release GIL in GetDataInfo
 2020-11-25 15:46:59 -05:00
mindspore-ci-bot 979bb26cba !9031 Fix DatasetCache parameter check 
From: @lixiachen
Reviewed-by: @nsyca,@mikef
Signed-off-by: @nsyca
 2020-11-26 03:55:02 +08:00
Lixia Chen ab7427f1a9 Minor fix for DatasetCache param validation 2020-11-25 13:20:30 -05:00
peixu_ren 93d4ef428f Add Gamma distribution 2020-11-25 09:40:46 -05:00
mindspore-ci-bot 22d683a805 !8920 Adapt ops LinSpace for Ascend. 
From: @liu_xiao_93
Reviewed-by: @liangchenghui,@linqingke,@liangchenghui
Signed-off-by: @liangchenghui,@liangchenghui
 2020-11-25 12:03:56 +08:00
mindspore-ci-bot d9b4b5c750 !8954 Add SequenceMask operator. 
From: @liangzhibo
Reviewed-by: @chenfei52,@zh_qh
Signed-off-by: @zh_qh
 2020-11-25 11:41:59 +08:00
liuxiao93 584e241e29 Adapt ops LinSpace for Ascend. 2020-11-25 09:50:03 +08:00
peixu_ren 01f5da0a14 Add Poisson distribution 2020-11-24 11:55:39 -05:00
l00591931 17c0810f9e add SequenceMask operator 2020-11-24 19:47:28 +08:00
mindspore-ci-bot 3d6d820612 !8154 Add nn.MultiFieldEmbedding for the embedding lookup opearations 
From: @huangxinjing
Reviewed-by: 
Signed-off-by:
 2020-11-24 09:49:39 +08:00
mindspore-ci-bot d915fd9b96 !8592 change repeat_elements to a composite op 
From: @tom__chen
Reviewed-by: 
Signed-off-by:
 2020-11-23 23:15:23 +08:00
huangxinjing b0deb7a289 Add dense embedding 2020-11-23 20:21:58 +08:00
mindspore-ci-bot 2eee1c06f0 !8842 Change Ones/Zeros operator 
From: @liangzhibo
Reviewed-by: @chenfei52
Signed-off-by:
 2020-11-23 12:37:19 +08:00
mindspore-ci-bot 7f725b93a3 !8234 Remove expm1_generic and log1p_generic from PP utils 
From: @peixu_ren
Reviewed-by: 
Signed-off-by:
 2020-11-23 09:56:07 +08:00
l00591931 f1e92d0ea7 Change Ones/zeros 2020-11-23 09:33:38 +08:00
mindspore-ci-bot e3371a01d5 !8751 Fix minor bugs in bijector and distribution 
From: @shallydeng
Reviewed-by: @zichun_ye,@sunnybeike
Signed-off-by:
 2020-11-23 08:50:57 +08:00
mindspore-ci-bot cfb9fb40d0 !8794 Add nn.Interpolate() function. 
From: @liangzhibo
Reviewed-by: @chenfei52,@zh_qh
Signed-off-by: @zh_qh
 2020-11-20 14:55:21 +08:00
l00591931 05e26f4739 Add nn.interpolate() 2020-11-20 10:00:47 +08:00
mindspore-ci-bot 81dfd70ece !8785 Add Parallel Operator UnsortedSegmentMax 
From: @huangxinjing
Reviewed-by: @yangzhenzhang,@stsuteng,@kisnwang
Signed-off-by: @stsuteng
 2020-11-20 09:23:30 +08:00
tom__chen a52cd685fc change repeat_element op to a composite op 2020-11-19 15:42:22 -05:00
mindspore-ci-bot 8980bc3de7 !8675 support allreduce prod 
From: @yao_yf
Reviewed-by: @stsuteng,@kisnwang
Signed-off-by: @stsuteng
 2020-11-19 20:21:27 +08:00
mindspore-ci-bot 39352ca658 !8580 Add Operation AllSwap Primitive 
From: @huangxinjing
Reviewed-by: 
Signed-off-by:
 2020-11-19 19:41:06 +08:00
huangxinjing 89e7778497 Add UnsortedSegmentMax Operation 2020-11-19 17:41:54 +08:00
mindspore-ci-bot fa2185b8ef !8661 Add nn.Tril() and nn.Triu() 
From: @liangzhibo
Reviewed-by: 
Signed-off-by:
 2020-11-19 16:34:32 +08:00
mindspore-ci-bot f827c18f1d !8289 Add Parallel Implements of Slice Op 
From: @huangxinjing
Reviewed-by: 
Signed-off-by:
 2020-11-19 15:54:20 +08:00
mindspore-ci-bot a3ae3b9794 !8695 add AdamOffload optimizer 
From: @wangnan39
Reviewed-by: @stsuteng,@stsuteng,@kingxian
Signed-off-by: @kingxian
 2020-11-19 10:42:14 +08:00
l00591931 e1dba1337c Add nn.Tril function 2020-11-19 10:31:30 +08:00
Xun Deng b5e05472ce fix minor bugs in bijector and distribution utils, fix docs issues 2020-11-18 21:13:47 -05:00
mindspore-ci-bot f1ef84e1a6 !8714 dataset Python UT: Add Sampler Chain Tests, with get_dataset_size 
From: @cathwong
Reviewed-by: @nsyca,@mikef
Signed-off-by: @nsyca
 2020-11-19 03:26:44 +08:00
mindspore-ci-bot 8e1ce841b4 !8688 dataset: modify the error log msg in python layer to be more acceptable 
From: @ms_yan
Reviewed-by: 
Signed-off-by:
 2020-11-18 21:43:48 +08:00
huangxinjing 8129806475 Add slice parallel op 2020-11-18 20:20:33 +08:00
mindspore-ci-bot ee72de1db2 !8441 Add Parallel Implements of UniformCandidateSampler 
From: @huangxinjing
Reviewed-by: 
Signed-off-by:
 2020-11-18 18:59:31 +08:00
mindspore-ci-bot cd6236c0a0 !8712 update pipeline parallel interface 
From: @yangzhenzhang
Reviewed-by: @kisnwang
Signed-off-by:
 2020-11-18 18:59:04 +08:00
mindspore-ci-bot fb0e866ad1 !8269 forward unique dynamic shape 
From: @yao_yf
Reviewed-by: 
Signed-off-by:
 2020-11-18 18:53:46 +08:00
huangxinjing 23284f0b35 Add AllSwap Op 2020-11-18 18:35:28 +08:00
ms_yan 0cb5c47856 add err modify 2020-11-18 16:30:24 +08:00
wangnan39@huawei.com ab811fca8f add AdamOffload optimizer 2020-11-18 16:13:47 +08:00
yao_yf 31819bb4a7 support forward unique 2020-11-18 15:22:14 +08:00
yangzhenzhang 278e82a849 update pipeline parallel 2020-11-18 13:55:34 +08:00
yao_yf 1529d544b9 add allreduce prod 2020-11-18 11:08:56 +08:00
mindspore-ci-bot f40a4781e4 !8656 Adapt DynamicGRUV2Grad for Ascend new backend. 
From: @liu_xiao_93
Reviewed-by: @jjfeing,@liangchenghui
Signed-off-by: @liangchenghui
 2020-11-18 09:54:05 +08:00
huangxinjing 2730cef047 Uniform Sampler Base Update 2020-11-18 09:39:32 +08:00
Cathy Wong e5f62013f4 dataset Python UT: Add Sampler Chain Tests, with get_dataset_size 2020-11-17 15:24:44 -05:00
peixu_ren 4aa836dae1 Add Digamma op 2020-11-17 11:49:20 -05:00
liuxiao93 2aaf5e2e1b Adapt DynamicGRUV2Grad for Ascend new backend. 2020-11-17 20:27:18 +08:00
peixu_ren 65d50861ec Remove expm1_generic and log1p_generic from PP utils 2020-11-16 16:12:13 -05:00
peixu_ren 5e9178c5b6 Add IGamma operator 2020-11-16 15:40:09 -05:00
mindspore-ci-bot 52eb2d3401 !8477 Add Cauchy distribution 
From: @shallydeng
Reviewed-by: @zichun_ye
Signed-off-by:
 2020-11-16 23:24:00 +08:00
mindspore-ci-bot b411c05de0 !8495 Adapt DynamicGRUV2 forward for Ascend new backend. 
From: @liu_xiao_93
Reviewed-by: 
Signed-off-by:
 2020-11-16 19:13:16 +08:00
mindspore-ci-bot a321f402c8 !8579 Add view function for tensor 
From: @liangzhibo
Reviewed-by: @zh_qh,@chenfei52
Signed-off-by: @zh_qh
 2020-11-16 14:37:21 +08:00
l00591931 7a192973ff Add view function for tensor 2020-11-16 10:49:19 +08:00
mindspore-ci-bot 2bf165c0b4 !8557 run cast before allgather in parallel optimzier 
From: @gong_zi_yan
Reviewed-by: 
Signed-off-by:
 2020-11-16 09:55:44 +08:00
mindspore-ci-bot c11c79170e !8554 Add expand_as function to tensor 
From: @liangzhibo
Reviewed-by: @zh_qh,@chenfei52
Signed-off-by: @zh_qh
 2020-11-13 15:19:01 +08:00
liuxiao93 d471ac491e Adapt DynamicGRUV2 forward for Ascend new backend. 2020-11-13 14:54:40 +08:00
Ziyan 0ddb754edb run cast before parallel optimizer 2020-11-13 14:04:04 +08:00
l00591931 ba7ee2aa13 add expand_as function 2020-11-13 11:42:54 +08:00
mindspore-ci-bot d2427b6e89 !8538 fix get_num_class in imagefolder 
From: @ziruiwu
Reviewed-by: @robingrosman,@nsyca
Signed-off-by: @nsyca
 2020-11-13 05:07:11 +08:00
Zirui Wu 3555d19b07 fix get num_class in imagefolder 
address cmt

review cmts
 2020-11-12 14:26:54 -05:00
mindspore-ci-bot ffc5209c09 !8476 Merge CacheOp_dev fixes for HQ system test. 
From: @jkl_lee
Reviewed-by: 
Signed-off-by:
 2020-11-13 01:30:41 +08:00
Jesse Lee c795879313 CacheOp delivery for HQ tester 2020-11-12 08:48:29 -05:00
mindspore-ci-bot a442024604 !8510 Add Ones and Zeros operators 
From: @liangzhibo
Reviewed-by: @zh_qh,@chenfei52
Signed-off-by: @zh_qh
 2020-11-12 20:45:52 +08:00
l00591931 886ef520d7 Add Ones and Zeros operators 2020-11-12 16:26:28 +08:00
mindspore-ci-bot f16509388c !8409 Multi-dimensional list value assignment 
From: @liangzhibo
Reviewed-by: @chenfei52
Signed-off-by:
 2020-11-12 14:36:20 +08:00
Xun Deng 1a68ccb40b added Cauchy distribution 2020-11-11 22:36:34 -05:00
mindspore-ci-bot 156980778b !8416 Fix RealDiv Type Error when insert an VirtualDiv Operation 
From: @huangxinjing
Reviewed-by: @stsuteng
Signed-off-by: @stsuteng
 2020-11-11 17:24:19 +08:00
huangxinjing 12e9107162 Fix VirtualDiv Int32 error 2020-11-11 09:32:57 +08:00
l00591931 c5b5a6719c Enable multi-dimensional list value assignment 2020-11-11 09:25:12 +08:00
liuxiao93 92ba9d94df Adapt UnsortedSegmentMax for Ascend. 2020-11-10 14:12:00 +08:00
mindspore-ci-bot 4e07f43dff !8323 [Auto parallel] Supporting for-loop in strategy-searching 
From: @xiaoda_zh
Reviewed-by: 
Signed-off-by:
 2020-11-10 10:33:25 +08:00
mindspore-ci-bot 5a4af56c15 !8322 add parallel op for Range 
From: @yangzhenzhang
Reviewed-by: @xiaoda_zh,@cristoval
Signed-off-by:
 2020-11-10 09:18:56 +08:00
Xiaoda Zhang aa13d6b1cd support for-loop in auto-parallel 2020-11-09 17:18:30 +08:00
yangzhenzhang 9747bde861 add range op 2020-11-09 15:14:07 +08:00
HuangBingjian 265a6d61b6 reverse fix shape=0 2020-11-09 15:06:37 +08:00
mindspore-ci-bot 470027a3a2 !8318 Fix some bugs about API. 
From: @liu_xiao_93
Reviewed-by: @liangchenghui
Signed-off-by: @liangchenghui
 2020-11-09 11:26:32 +08:00
mindspore-ci-bot ec5c86c1bb !8191 redesigned bijector broadcast shape and bijector's dtype logic 
From: @shallydeng
Reviewed-by: @zichun_ye,@sunnybeike
Signed-off-by: @sunnybeike
 2020-11-09 09:47:08 +08:00
mindspore-ci-bot 027916cb5f !8315 Cache server stability 
From: @jkl_lee
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
 2020-11-08 20:03:23 +08:00
liuxiao93 0a1155f938 Fix some bugs about API. 2020-11-07 17:06:25 +08:00
Lixia Chen f24a788eed Rebase up to 5792d50ca7 2020-11-06 18:39:05 -05:00
mindspore-ci-bot a9a9c45662 !8232 C++ api add Filter 
From: @tiancixiao
Reviewed-by: 
Signed-off-by:
 2020-11-07 00:32:15 +08:00
mindspore-ci-bot 8c2ed3bb80 !8138 Throw an exception when a tensor with 0 shape is constructed. 
Merge pull request !8138 from huangbingjian/fix_shape
 2020-11-06 16:26:58 +08:00
Xiao Tianci 4a5e287b92 add filter c api and ut 2020-11-06 15:49:23 +08:00
HuangBingjian 4477fcfe19 fix shape bug. 2020-11-06 12:59:03 +08:00
yangzhenzhang 0a79ab82ae add parallel ops 2020-11-06 12:09:19 +08:00
mindspore-ci-bot c253d874e0 !8280 add export lenet grad example 
Merge pull request !8280 from changzherui/add_export_grad_example
 2020-11-06 10:14:54 +08:00
changzherui 6b823282aa add export mindir lenet grad 2020-11-05 23:01:43 +08:00
Yi Huaijie d7faa77b5e support int64 shape 2020-11-05 21:15:49 +08:00
Xiaoda Zhang aa84484049 enabling approximation in DP algorithms 2020-11-05 16:07:26 +08:00
mindspore-ci-bot b3855530e3 !7838 Enumerate function enable tensor as input 
Merge pull request !7838 from LiangZhibo/master
 2020-11-05 11:33:02 +08:00
Xun Deng fb0263f869 redesigned bijector classes, changed bacth_shape calculation in transformed distribution and upgraded dtype logic of bijector class 2020-11-03 15:28:45 -05:00
mindspore-ci-bot 49eb4d3106 !8089 add antialias option for py reset 
Merge pull request !8089 from guozhijian/enhance_py_resize
 2020-11-03 16:25:21 +08:00
mindspore-ci-bot f3d7b32d56 !7855 Move backend opt pass ir files to the fold: verbose_ir_files 
Merge pull request !7855 from huanghui/move_ir_files
 2020-11-03 15:34:17 +08:00
mindspore-ci-bot e9cd12e904 !8114 rectify and optimize the type checking function 
Merge pull request !8114 from zhangbuxue/rectify_and_optimize_the_type_checking_function
 2020-11-03 14:48:12 +08:00
mindspore-ci-bot 00294473e3 !7976 [pynative] Add nested derivative feature 
Merge pull request !7976 from zjun/Add_nested_derivative
 2020-11-03 14:02:43 +08:00
buxue 346bcfa3fd Rectify and optimize the type checking function 2020-11-03 13:48:43 +08:00
jonyguo 1b78e34310 add ANTIALIAS support for python progress 2020-11-03 11:03:46 +08:00
mindspore-ci-bot bbfef6233a !8134 Add TBE op DynamicGRU for new and old backend. 
Merge pull request !8134 from liuxiao93/DynamicGRU-new-old-backend
 2020-11-03 09:53:08 +08:00
l00591931 6f165ee5e3 enumerate function and enumerate test case added 2020-11-02 21:11:52 +08:00
mindspore-ci-bot e909b9077c !7946 fix auto parallel optimizer weight shard 
Merge pull request !7946 from gziyan/fix_auto_optim_shard
 2020-11-02 20:51:56 +08:00
mindspore-ci-bot e99a8bd784 !8120 fix CI randomly fails 
Merge pull request !8120 from yihuaijie/master
 2020-11-02 20:08:33 +08:00
liuxiao93 45d343257b Add DynamicGRU. 2020-11-02 19:59:40 +08:00
zjun ccedf71de5 Add pynative bprop nested grad 
Signed-off-by: zjun <zhangjun0@huawei.com>
 2020-11-02 19:33:33 +08:00
mindspore-ci-bot ad930b30db !7891 add layer of clipbyglobalnorm 
Merge pull request !7891 from jiangzhenguang/add_clip_by_global_norm
 2020-11-02 19:18:33 +08:00
huanghui fa6c23358a Move some ir files which backend optpass dumped to the fold: verbose_ir_files 2020-11-02 19:18:24 +08:00
Yi Huaijie da29f232c6 fix CI random fails 2020-11-02 16:28:28 +08:00
Ziyan c33f2cd796 fix auto optimizer weight shard 2020-11-02 16:25:48 +08:00
jzg 4851a67bb5 add layer of clipbyglobalnorm. 2020-11-02 16:15:17 +08:00
mindspore-ci-bot 7e43eaf5e8 !8072 Revert changes to weighted_random_sampler in PR7866 
Merge pull request !8072 from luoyang/pylint
 2020-11-02 15:36:45 +08:00
mindspore-ci-bot 7092a33e87 !8039 support key ward way to pass arg for outermost net in graph mode 
Merge pull request !8039 from zhangbuxue/support_key_ward_way_to_pass_arg_for_outermost_net_in_graph_mode
 2020-10-31 14:58:40 +08:00
YangLuo 82cc7c3f63 [MD] Revert changes to weighted_random_sampler in PR7866 2020-10-31 12:56:17 +08:00
mindspore-ci-bot cacebd1211 !7933 Cache performance updates 
Merge pull request !7933 from Jamie/CacheOp_dev
 2020-10-31 04:25:47 +08:00
buxue 1364b5c301 support key ward way to pass arg for outermost net in graph mode 2020-10-30 16:55:53 +08:00
mindspore-ci-bot eb3b093686 !8013 [MD] fix minddataset padding bug 
Merge pull request !8013 from liyong126/fix_md_pad
 2020-10-30 16:44:45 +08:00
mindspore-ci-bot 015b244471 !7991 fix ReLUV2 error 
Merge pull request !7991 from yihuaijie/dev
 2020-10-30 14:16:33 +08:00
liyong 0d40abf5dd fix md padding bug 2020-10-30 12:00:44 +08:00
Lixia Chen 572c5e5f29 Rebase up to 542a52fbf8 2020-10-29 20:34:09 -04:00
Yi Huaijie 148d645915 fix ReLUV2 error 2020-10-29 20:29:01 +08:00
mindspore-ci-bot 870afe08f5 !7914 get keys and values from dictionary & set tuple to dictionary 
Merge pull request !7914 from Simson/push-to-opensource
 2020-10-29 19:58:35 +08:00
simson 3b21822824 get keys and values from dictionary & set tuple to dictionary 2020-10-29 18:06:06 +08:00
Zirui Wu ea97197311 fix tfrecord_op core dump 
add test case

fix ci

fix ci round 2

address review cmts
 2020-10-28 17:38:43 -04:00
mindspore-ci-bot 163544795f !7922 add params check for offset in distributed_sampler 
Merge pull request !7922 from xiaotianci/fix_distributed_sampler
 2020-10-28 20:57:50 +08:00
mindspore-ci-bot 376fa95717 !7771 Add Parallel SegmentOps 
Merge pull request !7771 from huangxinjing/segment_ops
 2020-10-28 17:19:35 +08:00
Xiao Tianci 823e52f1dc add params checking of offset in distributed_sampler 
add related comment to explain
add related UT
 2020-10-28 16:46:12 +08:00
mindspore-ci-bot 0d43e37f22 !7651 Add embedding and embedding_lookup 
Merge pull request !7651 from jiangzhenguang/add_embedding_and_enbedding_lookup
 2020-10-28 15:13:40 +08:00
huangxinjing bf5d21770a Add UnsortedSegmentSum and UnosrtedSemenMin For Oparallel Implements 2020-10-28 08:57:02 +08:00
Xun Deng d4df6f82ea support get_dist_args 2020-10-27 16:17:38 -04:00
mindspore-ci-bot d4142d682d !7437 auto parallel support dynamic 
Merge pull request !7437 from yao_yf/auto_parallel_support_dynamic_shape
 2020-10-27 21:02:28 +08:00
jzg 7cbd55e17d add embedding layer. 2020-10-27 20:51:49 +08:00
mindspore-ci-bot 08e6ac0b09 !7805 support split ValueList 
Merge pull request !7805 from yihuaijie/master
 2020-10-27 19:22:52 +08:00