p83571920
/
mindspore
forked from mindspore-Ecosystem/mindspore
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
3,516 Commits 23 Branches 0 Tags 3.9 GiB
Commit Graph

1253 Commits

Author SHA1 Message Date
mindspore-ci-bot c366b3fb18 !1704 fix num rows bug in sampler 
Merge pull request !1704 from Peilin/fix-random-sampler-bug
 2020-05-30 05:27:20 +08:00
Eric 8e1b2107ce Added example for sync_wait bad batch_num 
Added broken test case for cv

Fixed error handling in sync_wait
 2020-05-29 16:30:12 -04:00
mindspore-ci-bot 976b4793d1 !1544 Python Unit Test for TenCrop 
Merge pull request !1544 from MahdiRahmaniHanzaki/I1IHNG-ten-crop
 2020-05-30 03:02:29 +08:00
mindspore-ci-bot 15a196eba9 !1636 Add TCs to 3 vision transformation ops and cleanup config settings 
Merge pull request !1636 from Tinazhang/randomGray
 2020-05-30 03:02:15 +08:00
Peilin Wang 3ef3d1433d fixed num_samples bug for RandomSampler 2020-05-29 13:09:26 -04:00
Tinazhang f4a61fdbb2 Adding new UT cases and missing TCs in PY Ops. 2020-05-29 12:12:17 -04:00
Peilin Wang 5469be2a97 fixed bug for split, RandomSampler and some other cleanup 
add another test case

typo

merge conflict

another PR changed testing behavior, updated test cases in this commit

added input check for use_sampler

addressed code review comments

fixed pylint, not related to my changes

fixed edge case of rounding in getting split sizes

fix pylint
 2020-05-29 11:27:32 -04:00
jinyaohui 86d197dfeb clean pylint 2020-05-29 23:00:00 +08:00
lizhenyu 9df3a8613c fix get nullptr when use graph manager 2020-05-29 21:20:50 +08:00
huanghui ff05aa1faa add newly 5 patterns for AdamApplyOneWithDecayRule fusion pass 2020-05-29 19:49:44 +08:00
yujianfeng e6f1cfa581 Check the input size of BatchNorm before fission in bert 2020-05-29 19:34:58 +08:00
meixiaowei 1778ec0135 fix topk bug 2020-05-29 19:04:18 +08:00
zhouneng 65b0f8d1b3 为算子进行VM流程对接 2020-05-29 16:45:14 +08:00
mindspore-ci-bot 163eebf7b6 !1648 Add SoftmaxGradExt fusion pass 
Merge pull request !1648 from huanghui/softmaxgradext-fusion-pass
 2020-05-29 16:33:40 +08:00
jiangjinsheng c3f681f0cf vm for BesselI0e and BesselI1e 2020-05-29 16:04:27 +08:00
mindspore-ci-bot d3dbb10b6d !1563 Fixing some tiny faults about Pylint in my code(ops) 
Merge pull request !1563 from liuwenhao/master
 2020-05-29 15:04:51 +08:00
mindspore-ci-bot 8316f736ea !1650 Support forward reduce scatter for Matmul 
Merge pull request !1650 from yangzhenzhang/forward-reduce-scatter
 2020-05-29 14:45:32 +08:00
mindspore-ci-bot 23d27e0a17 !1540 [AutoParallel]Add resnet50 st 
Merge pull request !1540 from lichen/add_auto_parallel_st
 2020-05-29 14:35:56 +08:00
huanghui 99ca6b3e80 add SoftmaxGradExt fusion pass 2020-05-29 14:30:52 +08:00
liuwenhao4 f87c70a9ab Fixing some tiny faults about Pylint in my code(ops) 2020-05-29 12:01:04 +08:00
mindspore-ci-bot 57874cd61f !1372 [Auto parallel] Add a new primitive EmbeddingLookup 
Merge pull request !1372 from Xiaoda/add-embedinglookup-primitive
 2020-05-29 11:06:25 +08:00
lichenever 191d3c05d0 add auto parallel st 2020-05-29 10:53:50 +08:00
yangzhenzhang 19bd830539 support forward reduce scatter for matmul 2020-05-29 10:48:32 +08:00
mindspore-ci-bot f523a0f83c !1600 [AutoParallel]Fix GatherV2 bug 
Merge pull request !1600 from lichen/fix_auto_parallel_gatherv2_bug
 2020-05-29 10:27:14 +08:00
Xiaoda Zhang 4154adf196 add embedinglookup primitive 2020-05-29 10:15:09 +08:00
mindspore-ci-bot bb72c0020b !1612 add cpu stridedslice 
Merge pull request !1612 from kisnwang/add-cpu-stridedslice
 2020-05-29 10:01:50 +08:00
mindspore-ci-bot 4da9fe083b !1584 Modify the importing path of BERT after its src has been moved. 
Merge pull request !1584 from lyvette/master
 2020-05-29 09:12:46 +08:00
Mahdi dfc097019b Added TenCrop test 
Added unit tests for both testing the functinality of the TenCrop and
its error messages. Due to the similarity of this method to FiveCrop the
test cases are similar to FiveCrop test cases.
Signed-off-by: Mahdi <mahdi.rahmani.hanzaki@huawei.com>

added error_msg function call in the main method

refactored the test and added visual representation of the results

Separated the two error cases into two different functions and used the
visualize function in util.py to plot the result of TenCrop.
Signed-off-by: Mahdi <mahdi.rahmani.hanzaki@huawei.com>

Added new test cases

Added new test cases including test case for checking the error message
when the size variable is not a positive integer, test case for
rectangle crop, test case for vertical flip setting, and testing for
similarity of the result of TenCrop for the same input data in different runs.
Signed-off-by: Mahdi <mahdi.rahmani.hanzaki@huawei.com>

changed visualize in test_five_crop

Changed the visualize function in test_five_crop to use the already
existing function in util.py
Signed-off-by: Mahdi <mahdi.rahmani.hanzaki@huawei.com>

made generate_golden variable global
 2020-05-28 17:52:56 -04:00
yangjie159 37904cea01 fix reviewBot of mem_reuse 2020-05-28 23:40:20 +08:00
kswang f93e6beb52 add cpu strided slice 2020-05-28 23:04:35 +08:00
mindspore-ci-bot 21da86b393 !1591 add get_dataset_size for CelebADataset 
Merge pull request !1591 from yanghaitao/yht_celeba_get_dataset_size
 2020-05-28 22:21:43 +08:00
lichenever c223fde566 fix auto parallel gatherv2 bug 2020-05-28 20:34:35 +08:00
mindspore-ci-bot 8556eee3fc !1578 recitify pretrained path and revert AdjustAllReduceMulAdduse 
Merge pull request !1578 from gengdongjie/master
 2020-05-28 20:25:50 +08:00
mindspore-ci-bot ec5363ad9d !1593 Fix the bug that there is only return node in the forward graph 
Merge pull request !1593 from yangzhenzhang/reshape-optimized
 2020-05-28 19:30:26 +08:00
mindspore-ci-bot 4bf1c5099a !1551 add onnx ops for deepfm 
Merge pull request !1551 from wandongdong/master
 2020-05-28 17:31:05 +08:00
mindspore-ci-bot 39c1966593 !1488 add vm ops: Asin, AsinGrad, Asinh, AsinhGrad 
Merge pull request !1488 from fangzehua/fzh_edit
 2020-05-28 17:12:01 +08:00
mindspore-ci-bot 19ce0c372a !1257 Implicit type conversion 
Merge pull request !1257 from candanzg/implicit_type_conversion2
 2020-05-28 17:05:56 +08:00
yanghaitao cc6c7a3f60 add get_dataset_size to celebadataset 2020-05-28 17:00:14 +08:00
mindspore-ci-bot 9c858444b0 !1568 Fix pylint warning for test cases of optimizer, infer, parse and pynative. 
Merge pull request !1568 from seatea/fix-pylint-warning
 2020-05-28 16:59:57 +08:00
mindspore-ci-bot 1a4abefa9a !1385 support for multi nest switch 
Merge pull request !1385 from amongo/SupportMultiSwitch
 2020-05-28 16:21:10 +08:00
yvetteliu 9b0aa3eb4a Modify the importing path of BERT after its src has been moved. 
Fix an error.
 2020-05-28 16:09:42 +08:00
mindspore-ci-bot 2a6a3e012c !1555 fix bug in lamb warmup step check 
Merge pull request !1555 from wangnan39/fix_bug_in_check_lamb_warmup_step
 2020-05-28 16:08:43 +08:00
yangzhenzhang 1413f520d7 support reshape optimized 2020-05-28 16:05:36 +08:00
mindspore-ci-bot 04398cf88e !1433 add tensor_minnie and separate py from ir 
Merge pull request !1433 from leopz/tensor_base
 2020-05-28 16:00:56 +08:00
mindspore-ci-bot 0f4dc13e8e !1478 [Dataset] Fix CI warnings, clean pylint. 
Merge pull request !1478 from luoyang/pylint
 2020-05-28 15:54:52 +08:00
gengdongjie 705c71a257 Revert "add pattern AdjustAllReduceMulAdduse the old opadd test case for bugtemp fix try" 
This reverts commit 3db8cfa54f.
 2020-05-28 15:21:15 +08:00
wandongdong 9c5f6b9198 add onnx ops for deepfm 2020-05-28 15:06:01 +08:00
fangzehua c0b8a90105 add vm ops: asin asinh asingrad asinhgrad 2020-05-28 14:58:23 +08:00
mindspore-ci-bot dd54ffdbdb !1491 Complete vm ops for ReduceAllD, SparseApplyAdagradD and UnsortedSegmentMinD 
Merge pull request !1491 from lihongkang/master
 2020-05-28 14:45:59 +08:00
leopz 4508134ceb add tensor_minnie and separate py from ir 2020-05-28 14:26:26 +08:00
mindspore-ci-bot 3dc061165b !1559 Voc dataset support split ops 
Merge pull request !1559 from xiefangqi/xfq_voc_support_split
 2020-05-28 14:17:35 +08:00
Yang 9b2a778d94 !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
wangnan39@huawei.com 810ccf80d8 fix_bug_in_check_lamb_warmup_step 2020-05-28 12:15:12 +08:00
mindspore-ci-bot c086d91aaf !1505 Add some checks in ConstToAttr[StridedSliceGrad] pass 
Merge pull request !1505 from huanghui/stride-slice
 2020-05-28 11:46:18 +08:00
mindspore-ci-bot ab94e92cd1 !1554 Check the size of topk input names before converting input to attr 
Merge pull request !1554 from YuJianfeng/master
 2020-05-28 11:44:33 +08:00
seatea 7398526abc Fix pylint warning for test cases of optimizer, infer, parse and 
pynative.
 2020-05-28 11:35:33 +08:00
xiefangqi 5e4728c50f add voc support split 2020-05-28 11:18:32 +08:00
lihongkang a36880f0ef add vms for reducealld etc. 2020-05-28 11:00:02 +08:00
mindspore-ci-bot 14f9a6e31c !1310 add cpu lstm 
Merge pull request !1310 from baihuawei/cpu-lstm
 2020-05-28 10:35:09 +08:00
yujianfeng ee087bdf60 Check the size of topk input names before converting input to attr 2020-05-28 10:29:21 +08:00
mindspore-ci-bot 1bfa0dc5d5 !1265 add cpu transpose 
Merge pull request !1265 from baihuawei/transpose
 2020-05-28 10:28:40 +08:00
mindspore-ci-bot 9c33da391a !1513 refine data copy in multi-graph 
Merge pull request !1513 from zyli2020/refine_data_copy_in_multi_graph
 2020-05-28 10:21:52 +08:00
liuwenhao4 a7ad0d0a49 Fixing some tiny faults about Pylint in my code(ops) 2020-05-28 09:52:42 +08:00
mindspore-ci-bot fb7e4eac76 !1535 change hook function grad input to tuple 
Merge pull request !1535 from wangqiuliang/change-hook-grad-input-to-tuple
 2020-05-28 09:36:28 +08:00
mindspore-ci-bot a5161a969f !1531 cpu kernel support multiple inputs 
Merge pull request !1531 from sunsuodong/multi_input
 2020-05-28 09:12:20 +08:00
baihuawei 9bcdf4cbdc add lstm 2020-05-28 09:09:56 +08:00
mindspore-ci-bot ff4e4c2ee2 !1533 Fix pylint warning for pynative test cases 
Merge pull request !1533 from seatea/fix-pylint-warning-for-pynative-mode
 2020-05-28 08:11:42 +08:00
Jesse Lee 3b80c10b1e Fix some timing hole in these two testcases 2020-05-27 14:22:37 -04:00
mindspore-ci-bot e311473401 !1453 Raise mse threshold in RandomCropDecodeResizeOp 
Merge pull request !1453 from Alexey_Shevlyakov/fix_random_crop_decode_resize_ut
 2020-05-27 23:58:58 +08:00
sunsuodong 5cf29f2478 multi_input 2020-05-27 22:04:22 +08:00
mindspore-ci-bot 0fe3ff2761 !1506 Setting auto parallel flag for dataset wrap cell 
Merge pull request !1506 from yangzhenzhang/set-auto-parallel-for-dataset-wrap
 2020-05-27 21:50:43 +08:00
mindspore-ci-bot 77547cdfc0 !1530 support tensor set item the number value type is similar as tensor dtype 
Merge pull request !1530 from zhangbuxue/support_tensor_getitem_number_value_type_similar_as_tensor_dtype
 2020-05-27 21:29:24 +08:00
mindspore-ci-bot 906389b3a7 !1382 support create new item when dictionary set item key not exist 
Merge pull request !1382 from amongo/DictionarySupportSetNewItem
 2020-05-27 21:08:39 +08:00
baihuawei eb0f897d31 add cpu transpose 2020-05-27 20:51:47 +08:00
kingfo 8f7e571a0b change hook grad input to tuple 2020-05-27 20:34:07 +08:00
mindspore-ci-bot df347785c3 !1508 add op BitwiseAnd BitwiseOr BitwiseXor vm 
Merge pull request !1508 from zhaozhenlong/op/bitwise-and-or-xor
 2020-05-27 20:05:23 +08:00
candanzg 2429da19fb implicit type conversion 
Signed-off-by: candanzg <zhangshucheng@huawei.com>
 2020-05-27 20:04:52 +08:00
seatea 21ab029227 Fix pylint warning for files under `pynative_mode` directory. 2020-05-27 19:28:31 +08:00
mindspore-ci-bot c8b30f9290 !1504 add custom tbe ops for quant aware training 
Merge pull request !1504 from wandongdong/master
 2020-05-27 19:18:22 +08:00
lizhenyu a25b84055c refine data copy in multi-graph 2020-05-27 18:47:15 +08:00
buxue d226a23b65 support tensor set item the number value type is similar as tensor dtype not same 2020-05-27 18:08:10 +08:00
huanghui 1d65ae598a extract const_to_attr_strided_slice_grad pass 2020-05-27 17:30:17 +08:00
wandongdong d35c41e737 add custom tbe ops for quant aware training 2020-05-27 17:09:34 +08:00
mindspore-ci-bot 9c20b1d6f7 !1512 fix reshape reshape case 
Merge pull request !1512 from yao_yf/fix_reshape_reshape_graph
 2020-05-27 16:08:25 +08:00
zhaozhenlong 6fa2813945 add op BitwiseAnd BitwiseOr BitwiseXor 2020-05-27 16:00:25 +08:00
mindspore-ci-bot b46ad9a1bb !1398 Update the bert scripts according to rules of modelzoo 
Merge pull request !1398 from chenhaozhe/update_bert_script
 2020-05-27 15:55:09 +08:00
yangzhenzhang 2f8516e5d7 set auto parallel for dataset warp cell 2020-05-27 15:27:22 +08:00
mindspore-ci-bot ad279e90fd !1407 support mixed tensor index for tensor get item and set item and support in operator. 
Merge pull request !1407 from zhangbuxue/support_mixed_tensor_for_tensor_get_item_and_tensor_set_item
 2020-05-27 14:49:21 +08:00
chenhaozhe b6aceddeab update bert scripts according to rules of modelzoo 2020-05-27 14:27:09 +08:00
yao_yf 96c9569dca fix reshape reshape case 2020-05-27 14:25:40 +08:00
mindspore-ci-bot 2e684e89e7 !1446 pylint clean 
Merge pull request !1446 from liuxiao78/master
 2020-05-27 14:15:14 +08:00
mindspore-ci-bot 5b9c145ff8 !1383 keep different attributes for cnode evaluation 
Merge pull request !1383 from amongo/KeepPrimAttrInCNode
 2020-05-27 13:02:34 +08:00
mindspore-ci-bot 2eedd32120 !1472 add operator HostAllGather and HostReduceScatter 
Merge pull request !1472 from yihuaijie/master
 2020-05-27 11:41:45 +08:00
buxue 7ae289a197 Support mixed tensor for tensor getitem or setitem. 2020-05-27 11:19:51 +08:00
huangdongrun e9aa280f86 add support for dictionary set item which does not exist 2020-05-27 11:19:20 +08:00
mindspore-ci-bot b94949ea99 !1477 support vm for SpaceToBatchND and BatchToSpaceND 
Merge pull request !1477 from jiangjinsheng/BatchToSpaceND
 2020-05-27 10:29:43 +08:00
mindspore-ci-bot 5e2f440eed !1271 refactor of memreuse allocator to adapt the control stream 
Merge pull request !1271 from yangjie159/refactor_memreuse_allocator
 2020-05-27 10:24:16 +08:00
mindspore-ci-bot 4e8e82f24a !1457 fix 3 bug reports for split 
Merge pull request !1457 from Peilin/splitOp-after-testing
 2020-05-27 10:08:57 +08:00
mindspore-ci-bot 3aeb91ee58 !1443 Add parallel operator for Sigmoid 
Merge pull request !1443 from yangzhenzhang/add-sigmoid-op
 2020-05-27 10:08:28 +08:00
mindspore-ci-bot 650a45b233 !1490 Fix pylint warning 
Merge pull request !1490 from seatea/fix-pylint-warning
 2020-05-27 09:41:31 +08:00
jiangjinsheng a45dfca142 support BatchToSpaceND and SpaceToBatchND 2020-05-27 09:13:12 +08:00
Peilin Wang d4c93575e7 fixed bug for split, RandomSampler and some other cleanup 
add another test case

typo

merge conflict

another PR changed testing behavior, updated test cases in this commit

added input check for use_sampler

addressed code review comments

fixed pylint, not related to my changes
 2020-05-26 16:29:52 -04:00
mindspore-ci-bot 2753aa5a9c !1487 add cpu kernel "AddN" 
Merge pull request !1487 from sunsuodong/addn
 2020-05-26 22:27:07 +08:00
yangzhenzhang 7c237620ba add sigmoid op 2020-05-26 21:33:32 +08:00
seatea c6d8a4dc98 Fix pylint warning. 2020-05-26 21:23:06 +08:00
huangdongrun 334d038008 add support for multi switch 
resolve review
 2020-05-26 21:20:29 +08:00
sunsuodong ade90be427 addn 2020-05-26 20:16:41 +08:00
“liuxiao” 73a287e5e0 pylint clean 2020-05-26 19:46:14 +08:00
“liuxiao” ebbccca78b pylint clean 2020-05-26 19:36:54 +08:00
“liuxiao” f4542f810b pylint clean 2020-05-26 19:11:12 +08:00
Yi Huaijie 2f8e7ff693 add operator HostAllGather and HostReduceScatter 2020-05-26 17:41:20 +08:00
yujianfeng 94818cf255 Fix fusion condition of transpose and reshape 2020-05-26 17:30:38 +08:00
yangjie159 cbf5390b34 refactor memreuse allocator 
remove stream id from membuf
add kernel dependence to determine whether is usable
 2020-05-26 17:27:33 +08:00
huangdongrun 1159f2b11e add prim infer attr cache 
modify infer to get abstract value and attr value map together

support get attr in specialize

clone primitive when specialize if attribute is not the same with
infered attribute
 2020-05-26 16:19:58 +08:00
zhaozhenlong 55d1927534 add op scatter add vm 2020-05-26 12:17:23 +08:00
mindspore-ci-bot 10076ffe1a !1216 add graph attention networks model and test file 
Merge pull request !1216 from zhangdengcheng/master
 2020-05-26 11:27:31 +08:00
mindspore-ci-bot 831ceba6eb !1277 Fixing some tiny faults about Pylint in ME code 
Merge pull request !1277 from liuwenhao/master
 2020-05-26 11:08:10 +08:00
Yang abca62f407 10:00 26/5 clean pylint 2020-05-26 10:05:12 +08:00
mindspore-ci-bot 93fc82b8f7 !1447 remove unused variable 
Merge pull request !1447 from yihuaijie/master
 2020-05-26 09:17:48 +08:00
mindspore-ci-bot 2215e3267f !1419 remove old buffer fusion pass 
Merge pull request !1419 from Etone.Chan/Resnet50
 2020-05-26 09:16:06 +08:00
mindspore-ci-bot 0b191615a9 !1427 fix check bprop attr error 
Merge pull request !1427 from panyifeng/fix_check_bprop_attr_error
 2020-05-26 09:10:51 +08:00
mindspore-ci-bot 578cdb4235 !1454 Allow TaskGroup::join_all() to block for GNN 
Merge pull request !1454 from JesseKLee/zirui
 2020-05-26 05:40:59 +08:00
mindspore-ci-bot 0a8ef2fe72 !1455 Cleanup dataset UT: restore config support 
Merge pull request !1455 from cathwong/ckw_dataset_config_util
 2020-05-26 05:40:39 +08:00
Jesse Lee a8fa847556 Allow join_all to be blocking 2020-05-25 15:24:36 -04:00
Cathy Wong f891e1755c Cleanup dataset UT: restore config support 2020-05-25 15:10:03 -04:00
Alexey Shevlyakov 7a807cbff9 fix ut 2020-05-25 14:56:58 -04:00
mindspore-ci-bot aeb4c52f2d !1379 Creating new UTs to three vision transformation ops 
Merge pull request !1379 from Tinazhang/linearTrans
 2020-05-25 23:10:30 +08:00
liuwenhao4 f3f0cbaeee Fixing some tiny faults about Pylint in my code(ops) 2020-05-25 21:27:45 +08:00
etone-chan 42d724d8b4 remove old buffer fusion pass 2020-05-25 21:25:45 +08:00
“liuxiao” 382a0124c3 pylint clean 2020-05-25 21:16:04 +08:00
mindspore-ci-bot e8980ed298 !1406 Simplify CondVar class 
Merge pull request !1406 from JesseKLee/CondVar
 2020-05-25 21:04:05 +08:00
mindspore-ci-bot 44bf7c9330 !1414 fix issue use reshape as flatten grad impl 
Merge pull request !1414 from zhaozhenlong/fix-issues-reshape-replace-flattern-grad
 2020-05-25 20:45:46 +08:00
Yi Huaijie ac484ebbc0 remove unused variable 2020-05-25 19:59:28 +08:00
“liuxiao” 18f0af0529 pylint clean 2020-05-25 19:49:06 +08:00
mindspore-ci-bot e5c7ecfd46 !1426 Fix the issues checked by pylint 
Merge pull request !1426 from chengang/fix_pylint
 2020-05-25 17:47:12 +08:00
mindspore-ci-bot 318e3012d7 !1422 Fix result error when calling AllReduce serially. 
Merge pull request !1422 from ZPaC/fix-multi-allreduce-calling-error
 2020-05-25 17:39:27 +08:00
mindspore-ci-bot 55027096d3 !1400 Add 3 patterns for lamb_next_mv fusion pass 
Merge pull request !1400 from huanghui/TMP
 2020-05-25 17:15:24 +08:00
mindspore-ci-bot 1c8548adb8 !1300 Add TBE op RangeD for GE. 
Merge pull request !1300 from liuxiao/RangeD
 2020-05-25 17:04:53 +08:00
zhaozhenlong 30b93ecbf8 use reshape as flatten grad 2020-05-25 16:57:26 +08:00
panyifeng 6a57eeb922 fix check_bprop attr error 2020-05-25 16:52:30 +08:00
mindspore-ci-bot 57c1da121f !1424 Delete unused arguments in test cases 
Merge pull request !1424 from yihuaijie/master
 2020-05-25 16:42:47 +08:00
Yi Huaijie 0b137e5312 delete unused arguments in test cases 2020-05-25 15:46:05 +08:00
cristoval f6c20178d2 fix pylint check issues 2020-05-25 15:34:01 +08:00
ZPaC d9bcdac3dc Fix result error when calling AllReduce serially. 2020-05-25 15:18:41 +08:00
mindspore-ci-bot 929ef67bfc !1411 pylint warning clean 
Merge pull request !1411 from liubuyu/master
 2020-05-25 15:14:55 +08:00
liuxiao 627724a205 Add RangeD for GE 2020-05-25 14:49:49 +08:00
huanghui a42dd21430 add 3 pattern for lamb_next_mv_rule fusion pass 2020-05-25 14:18:22 +08:00
mindspore-ci-bot 848d19207f !1359 Optimize the IR modules. 
Merge pull request !1359 from ZhangQinghua/master
 2020-05-25 14:14:44 +08:00
liubuyu 107794fac9 pylint warning clean 2020-05-25 11:52:36 +08:00
Yi Huaijie 8cfc05e4cf clean pylint warnings of parallel test cases 2020-05-25 11:08:29 +08:00
Zhang Qinghua dbb86cb1be Adjust some routines of FG and FGM, about the nodes info. IF. 2020-05-25 10:06:27 +08:00
Zhang Qinghua f31564ce98 Remove the useless collectors in manager. 2020-05-25 09:56:28 +08:00
Jesse Lee 641112a40c Initial Drop 2020-05-24 16:57:40 -04:00
mindspore-ci-bot 0e665616f0 !1160 add backward hook and custom bprop in pynative mode 
Merge pull request !1160 from wangqiuliang/add-backward-hook-in-pynative-mode
 2020-05-24 18:09:48 +08:00
kingfo 840922e501 add backward hook function in pynative mode 2020-05-24 13:32:44 +08:00
mindspore-ci-bot 718a96430f !1389 Security issues in recent string tensor PR 
Merge pull request !1389 from h.farahat/fix_security_issues
 2020-05-24 08:45:21 +08:00
mindspore-ci-bot a6b8451a33 !1380 make ShuffleOp have deterministic behavior for subsequent epochs 
Merge pull request !1380 from Peilin/shuffle-subsequent-epoch-deterministic
 2020-05-23 21:02:30 +08:00
mindspore-ci-bot ad9db524bb !1394 Fix comment error and mod parameter check in graphdata 
Merge pull request !1394 from heleiwang/fix_comments_error
 2020-05-23 19:47:19 +08:00
heleiwang f28f883cac fix comments error and modify parameter check 2020-05-23 18:31:13 +08:00
mindspore-ci-bot daccfef738 !1361 Refactor multiple output pass 
Merge pull request !1361 from huanghui/LambNextMVRule-fusion-pass
 2020-05-23 17:21:27 +08:00
mindspore-ci-bot e87e6b38b0 !1355 [AutoParallel]Fix GatherV2 distributed op 
Merge pull request !1355 from lichen/fix_gatherv2
 2020-05-23 17:04:41 +08:00
mindspore-ci-bot a510ecc8ff !1339 add epsilon parameter for layernorm 
Merge pull request !1339 from JichenZhao/layernorm_mean_var_shape
 2020-05-23 15:58:44 +08:00
mindspore-ci-bot e82088d175 !1373 add memory copy module 
Merge pull request !1373 from zyli2020/add_mem_swap_module_header
 2020-05-23 15:39:13 +08:00
lichenever 390a86effb fix gatherv2 2020-05-23 15:38:50 +08:00
lizhenyu c5ac2cc38c add memory copy module 2020-05-23 13:04:50 +08:00
hesham c0f0e154f5 Clean up work for text python package 2020-05-22 23:53:34 -04:00
mindspore-ci-bot 45368a86e9 !1329 Put the parameter validation of the Summary operator into the python layer 
Merge pull request !1329 from ougongchang/master
 2020-05-23 11:41:34 +08:00
mindspore-ci-bot 41456ac824 !1369 dataset: delete StorageDataset 
Merge pull request !1369 from ms_yan/del_storage
 2020-05-23 10:39:34 +08:00
huanghui f16ff539ba refactor multiple patterns pass 2020-05-23 09:40:21 +08:00
Tinazhang 7322839b04 add UTs for LinearTransformation, ToPIL, ToType 2020-05-22 18:04:09 -04:00
mindspore-ci-bot 964a757db2 !1378 Just want to debug this case in Jenkin environment 
Merge pull request !1378 from JesseKLee/cond_var_debug
 2020-05-23 05:26:12 +08:00
Peilin Wang 0cbcc7200b made shuffle determinisitc for subsequent epochs 2020-05-22 17:03:19 -04:00
Jesse Lee 06ae724261 Again 2020-05-22 16:38:03 -04:00
mindspore-ci-bot 61639be1e0 !1375 Cleanup dataset UT: remove num_parallel_workers=1 in test_exception 
Merge pull request !1375 from cathwong/ckw_dataset_ut_cleanup5
 2020-05-22 23:54:52 +08:00
mindspore-ci-bot a528797253 !1377 Code Fix for Uniform Augmentation 
Merge pull request !1377 from Tinazhang/cc
 2020-05-22 23:20:01 +08:00
mindspore-ci-bot 458436186c !1365 Clean up work for text python sub-package 
Merge pull request !1365 from h.farahat/text_namespace
 2020-05-22 23:16:31 +08:00
Tinazhang b390883c6a Bug fix 2020-05-22 10:56:56 -04:00
Cathy Wong 702005d403 Cleanup dataset UT: remove num_parallel_workers=1 in test_exception 2020-05-22 09:28:17 -04:00
ougongchang 7d78b5d89e Put the parameter validation of the Summary operator into the python layer 
add some unittest for summary operator

support ScalarSummary to record number type
 2020-05-22 21:23:43 +08:00
ms_yan d5e896b51c delete storageDataset Op API and its test case 2020-05-22 21:23:24 +08:00
mindspore-ci-bot 6f733ec113 !1308 Stage 2 of adding support for string Tensor 
Merge pull request !1308 from h.farahat/string_tensor2
 2020-05-22 21:17:53 +08:00
xiefangqi 34236ce1f1 fix pylint 2020-05-22 20:18:21 +08:00
mindspore-ci-bot d402b94476 !1370 delete parallel end-to-end test cases 
Merge pull request !1370 from yihuaijie/master
 2020-05-22 20:01:49 +08:00
mindspore-ci-bot f967700ef4 !1215 [Auto parallel] Changing succive edges orders and add some strategy checkings 
Merge pull request !1215 from Xiaoda/change-succive-edges-order-and-add-checking
 2020-05-22 18:56:35 +08:00
mindspore-ci-bot 3363d4e834 !1249 Add GNN dataset processing API 
Merge pull request !1249 from heleiwang/hlw_gnn_data
 2020-05-22 18:49:36 +08:00
mindspore-ci-bot f3d14fa14b !1363 Restrict tensor get item or set item not support mixed tensor. 
Merge pull request !1363 from zhangbuxue/Not_support_mixed_tensor_as_index_for_tensor_getitem_and_setitem
 2020-05-22 18:04:31 +08:00
zhaojichen 7c9fb3424f add epsilon parameter for layernorm 2020-05-22 05:36:39 -04:00
Yi Huaijie 1e6ee83874 delete parallel end-to-end test cases 2020-05-22 17:35:18 +08:00
mindspore-ci-bot 3f23aa1d79 !1348 fix pylint warnings of parallel test cases 
Merge pull request !1348 from yihuaijie/master
 2020-05-22 16:40:42 +08:00
hesham 6c21e556c4 Clean up work for text python package 2020-05-22 04:35:58 -04:00
mindspore-ci-bot 368007240c !1320 add applyrmsprop cumprod and reduceprod for vm 
Merge pull request !1320 from JichenZhao/applyrms_squaresumall_cumprod_reduceprod
 2020-05-22 16:33:31 +08:00
mindspore-ci-bot 889696bcab !1331 delete dropoutgenmask and dropoutdomask when dropout prob equals 0 to enhance performance and adjust ci script 
Merge pull request !1331 from yoonlee666/master-deletedropout
 2020-05-22 16:22:33 +08:00
mindspore-ci-bot 4bdfddedb2 !1358 Link child graphs 
Merge pull request !1358 from zhoufeng/link-child-graph-2
 2020-05-22 16:10:52 +08:00
mindspore-ci-bot 62c716b68e !1349 Fix some functions in group parameters and optimizer 
Merge pull request !1349 from ghzl/add-group-check-for-lars
 2020-05-22 16:05:36 +08:00
buxue 850171a34b Restrict tensor getitem or setitem not support mixed tensor. 2020-05-22 15:55:38 +08:00
zhoufeng af5019b94f link child graphs 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2020-05-22 15:37:19 +08:00
Yi Huaijie 14fe72f383 fix pylint warnings 2020-05-22 14:54:36 +08:00
mindspore-ci-bot bd845dd0b7 !1352 [MD] fix bug when append data in mindrecord using absolute path 
Merge pull request !1352 from liyong126/mindrecord_fix_bug_I1HQUI
 2020-05-22 14:25:15 +08:00
heleiwang 599a449e0b Support processing GNN data 2020-05-22 14:15:25 +08:00
jinyaohui fbdba6e4da clean pylint 2020-05-22 13:23:13 +08:00
hesham df361d1d26 Change mem layout of string tensor 
add support for MindRecord and TFRecord
----
optimize tensorshape

optimize tensorshape and FlatIndex

TFRecord and MindRecord support for string tensor

Modify mem layout
Add new constructor
Add method Allocate

Change some GetMutableBuffer usages to AllocateBuffer
 2020-05-22 01:22:29 -04:00
liyong 447420eb9a fix bug when append data by absolute path 2020-05-22 11:27:56 +08:00
guohongzilong 2d2f9ba8fd fix group parameter code for check 2020-05-22 11:05:45 +08:00
zhaojichen a42ec8f69f add applyrmsprop op for vm 2020-05-21 23:02:32 -04:00
Xiaoda Zhang 9f4b8a3cd1 changing the succive edges order in GetAliveSuccEdges() so that Triangle and Star Elimination can be merged into particular node; adding some check information 2020-05-22 10:57:02 +08:00
mindspore-ci-bot d9c74e0acd !1328 Add 3 patterns support for LambNextMVWithDecay fusion pass 
Merge pull request !1328 from huanghui/LambNextMvWithDecayRuleConds-fusion-pass
 2020-05-22 10:35:17 +08:00
mindspore-ci-bot d6e930d737 !1337 test(custom_op): delete conv2d custom op. 
Merge pull request !1337 from gongchen/del_conv2d_custom_op
 2020-05-22 10:20:46 +08:00
mindspore-ci-bot 58e6d7d950 !1341 Added lookup and vocab to mindspore.dataset.text 
Merge pull request !1341 from ZiruiWu/vocab_and_lookup
 2020-05-22 10:19:42 +08:00
mindspore-ci-bot decf12cd0b !1317 [MD]add compress for nlp data in mindrecord 
Merge pull request !1317 from liyong126/mindrecord_compress
 2020-05-22 10:05:09 +08:00
mindspore-ci-bot 274f6f014f !1133 support tensor get value by tensor index 
Merge pull request !1133 from zhangbuxue/support_tensor_get_value_by_tensor_index
 2020-05-22 10:02:35 +08:00
mindspore-ci-bot 0a795c24aa !1245 add model init api to compile df graph before train 
Merge pull request !1245 from wangnan39/add_model_init_api_to_compile_df_graph_before_train_and_eval
 2020-05-22 09:51:19 +08:00
jonwe bb51bb88d7 add compress in mindrecord 2020-05-22 09:37:51 +08:00
mindspore-ci-bot 2e3d55ed87 !1281 Implementation of SplitOp 
Merge pull request !1281 from Peilin/splitOp
 2020-05-22 09:29:03 +08:00
mindspore-ci-bot 39b9aedf68 !1342 Bug fix on issue Core dump on GPU when train with lenet with AU 
Merge pull request !1342 from Tinazhang/cc
 2020-05-22 09:18:49 +08:00
mindspore-ci-bot 0ca626ef6c !1229 Init the slices of a Initializer on different devices 
Merge pull request !1229 from yihuaijie/master
 2020-05-22 08:57:58 +08:00
Peilin Wang 71e8bb1960 general split case done, chaining sampler (basic case) is working 
implementation 99% complete

everything and tested except for repeatable shuffling

tested most basic/typical split usecases

cleanup

some more cleanup

fix CI

more ci fix

more ci fixes

more ci fix

more ci fix

more ci fix

added more tests, fixed some bugs

some more clean up and test cases

added shard/shuffle before split warning/error

addressed code review comments and ci

fixed ci
 2020-05-21 20:42:51 -04:00
Tinazhang e9e40b688b Bug fix 2020-05-21 18:20:00 -04:00
Zirui Wu 25ab2ef303 Implemented lookup and vocab 2020-05-21 17:17:24 -04:00
mindspore-ci-bot 46949fc327 !1307 Cleanup dataset UT: unskip and enhance TFRecord sharding tests 
Merge pull request !1307 from cathwong/ckw_dataset_ut_unskip2
 2020-05-22 03:21:45 +08:00
wangnan39@huawei.com 1ebf98b795 add model init api to compile df graph before exec 2020-05-21 22:21:49 +08:00
yoonlee666 12d9c71c83 delete dropout when prob equals 0 and adjust bert ci script 2020-05-21 22:08:36 +08:00
buxue e490618db8 support tensor get value by tensor index 
support tensor set value by tensor index
 2020-05-21 21:05:35 +08:00
mindspore-ci-bot 07b14f32b9 !1296 move signature to primitivepy and bprop_func to utils 
Merge pull request !1296 from leopz/fix_primitive
 2020-05-21 20:44:59 +08:00
Yi Huaijie 7a5004cc49 init the slices of a Initialzer on different devices 2020-05-21 20:43:15 +08:00
gongchen 36edbe411e test(custom_op): Delete conv2d custom op. 2020-05-21 20:37:03 +08:00
zhouneng 218ade30b2 add vm support sin and cumsum 2020-05-21 17:26:01 +08:00
huanghui eaff850f11 add 3 patterns for lamb_next_mv_with_decay_rule pass 2020-05-21 17:00:15 +08:00
mindspore-ci-bot 2224fa093b !1302 Complete vm ops for BinaryCrossEntropy and BinaryCrossEntropyGrad 
Merge pull request !1302 from lihongkang/master
 2020-05-21 17:00:09 +08:00
mindspore-ci-bot b96a2ed816 !1312 support vm for erfc 
Merge pull request !1312 from jiangjinsheng/vm_erfc
 2020-05-21 16:59:56 +08:00
mindspore-ci-bot beb3cadb75 !1327 fix resnet cifar 1p test case device error 
Merge pull request !1327 from chujinjin/fix_cifar_1p_test
 2020-05-21 16:59:09 +08:00
mindspore-ci-bot bddd743ca9 !1304 Add check for controldepend 
Merge pull request !1304 from amongo/AddCheckForControlDepend
 2020-05-21 16:09:46 +08:00
chujinjin 668c18c42c fix cifar 1p test 2020-05-21 15:48:57 +08:00
mindspore-ci-bot e4795974be !1266 Refactor LambNextMVWithDecayRule fusion pass 
Merge pull request !1266 from huanghui/LambNextMvWithDecayRuleConds-fusion-pass
 2020-05-21 11:43:49 +08:00
mindspore-ci-bot 19c200e9cc !1280 pylint clean 
Merge pull request !1280 from liubuyu/master
 2020-05-21 11:27:07 +08:00
zhangdengcheng 9fbc519ebb Add graph attention networks model and test file 2020-05-21 02:55:46 +00:00
huanghui 5a68eba585 Refactor LambNextMVWithDecayRule fusion pass 2020-05-21 10:08:50 +08:00
jiangjinsheng 2d3cd8276e vm for erfc 2020-05-21 10:08:23 +08:00
qianlong 451c20a6f5 Add UnicodeCharTokenizer for nlp 2020-05-21 09:22:45 +08:00
mindspore-ci-bot 93e7c97a96 !1272 [Dataset] MindData Tree Optimizer Infrastructure 
Merge pull request !1272 from JunhanHu/minddata_opt
 2020-05-21 05:29:00 +08:00
Cathy Wong b78894e02b Cleanup dataset UT: unskip and enhance TFRecord sharding tests 2020-05-20 17:05:38 -04:00
Junhan Hu f44d213503 MindData optimizer infrastructure. 2020-05-20 16:11:26 -04:00
huangdongrun 3e2074b113 add check for ControlDepend 2020-05-20 22:48:00 +08:00
mindspore-ci-bot 233508b70e !1250 Dict_setitem transofrm to tuple_setitem 
Merge pull request !1250 from amongo/SupportDictSetItemTransform
 2020-05-20 21:37:26 +08:00
lihongkang cf543382aa add vms for binarycrossentropy and binarycrossentropygrad 2020-05-20 20:28:56 +08:00
leopz 04763b8b76 move signature to primitivepy and bprop_func to utils 2020-05-20 18:06:36 +08:00
mindspore-ci-bot 183144e135 !1282 support vm for PReLU and PReLUGrad 
Merge pull request !1282 from jiangjinsheng/vm_prelu
 2020-05-20 17:08:03 +08:00
xulei2020 163b6b7ea7 add jieba c++ code 2020-05-20 15:55:12 +08:00
mindspore-ci-bot aa1cee113d !1279 test(custom_op): clean up custom op test case. 
Merge pull request !1279 from gongchen/fix_custom_op_case
 2020-05-20 15:21:31 +08:00
mindspore-ci-bot 89470cf29d !1263 Modified clip_gradients to clip_grad 
Merge pull request !1263 from Kang/master
 2020-05-20 14:15:05 +08:00
mindspore-ci-bot 1ba8e052f8 !1125 support vm for space_to_depth 
Merge pull request !1125 from jiangjinsheng/space_to_depth
 2020-05-20 11:59:21 +08:00