p83571920
/
mindspore
forked from mindspore-Ecosystem/mindspore
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
3,516 Commits 23 Branches 0 Tags 3.9 GiB
Commit Graph

1253 Commits

Author SHA1 Message Date
mindspore-ci-bot 3dc061165b !1559 Voc dataset support split ops 
Merge pull request !1559 from xiefangqi/xfq_voc_support_split
 2020-05-28 14:17:35 +08:00
Yang 9b2a778d94 !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
wangnan39@huawei.com 810ccf80d8 fix_bug_in_check_lamb_warmup_step 2020-05-28 12:15:12 +08:00
mindspore-ci-bot c086d91aaf !1505 Add some checks in ConstToAttr[StridedSliceGrad] pass 
Merge pull request !1505 from huanghui/stride-slice
 2020-05-28 11:46:18 +08:00
mindspore-ci-bot ab94e92cd1 !1554 Check the size of topk input names before converting input to attr 
Merge pull request !1554 from YuJianfeng/master
 2020-05-28 11:44:33 +08:00
seatea 7398526abc Fix pylint warning for test cases of optimizer, infer, parse and 
pynative.
 2020-05-28 11:35:33 +08:00
xiefangqi 5e4728c50f add voc support split 2020-05-28 11:18:32 +08:00
lihongkang a36880f0ef add vms for reducealld etc. 2020-05-28 11:00:02 +08:00
mindspore-ci-bot 14f9a6e31c !1310 add cpu lstm 
Merge pull request !1310 from baihuawei/cpu-lstm
 2020-05-28 10:35:09 +08:00
yujianfeng ee087bdf60 Check the size of topk input names before converting input to attr 2020-05-28 10:29:21 +08:00
mindspore-ci-bot 1bfa0dc5d5 !1265 add cpu transpose 
Merge pull request !1265 from baihuawei/transpose
 2020-05-28 10:28:40 +08:00
mindspore-ci-bot 9c33da391a !1513 refine data copy in multi-graph 
Merge pull request !1513 from zyli2020/refine_data_copy_in_multi_graph
 2020-05-28 10:21:52 +08:00
liuwenhao4 a7ad0d0a49 Fixing some tiny faults about Pylint in my code(ops) 2020-05-28 09:52:42 +08:00
mindspore-ci-bot fb7e4eac76 !1535 change hook function grad input to tuple 
Merge pull request !1535 from wangqiuliang/change-hook-grad-input-to-tuple
 2020-05-28 09:36:28 +08:00
mindspore-ci-bot a5161a969f !1531 cpu kernel support multiple inputs 
Merge pull request !1531 from sunsuodong/multi_input
 2020-05-28 09:12:20 +08:00
baihuawei 9bcdf4cbdc add lstm 2020-05-28 09:09:56 +08:00
mindspore-ci-bot ff4e4c2ee2 !1533 Fix pylint warning for pynative test cases 
Merge pull request !1533 from seatea/fix-pylint-warning-for-pynative-mode
 2020-05-28 08:11:42 +08:00
Jesse Lee 3b80c10b1e Fix some timing hole in these two testcases 2020-05-27 14:22:37 -04:00
mindspore-ci-bot e311473401 !1453 Raise mse threshold in RandomCropDecodeResizeOp 
Merge pull request !1453 from Alexey_Shevlyakov/fix_random_crop_decode_resize_ut
 2020-05-27 23:58:58 +08:00
sunsuodong 5cf29f2478 multi_input 2020-05-27 22:04:22 +08:00
mindspore-ci-bot 0fe3ff2761 !1506 Setting auto parallel flag for dataset wrap cell 
Merge pull request !1506 from yangzhenzhang/set-auto-parallel-for-dataset-wrap
 2020-05-27 21:50:43 +08:00
mindspore-ci-bot 77547cdfc0 !1530 support tensor set item the number value type is similar as tensor dtype 
Merge pull request !1530 from zhangbuxue/support_tensor_getitem_number_value_type_similar_as_tensor_dtype
 2020-05-27 21:29:24 +08:00
mindspore-ci-bot 906389b3a7 !1382 support create new item when dictionary set item key not exist 
Merge pull request !1382 from amongo/DictionarySupportSetNewItem
 2020-05-27 21:08:39 +08:00
baihuawei eb0f897d31 add cpu transpose 2020-05-27 20:51:47 +08:00
kingfo 8f7e571a0b change hook grad input to tuple 2020-05-27 20:34:07 +08:00
mindspore-ci-bot df347785c3 !1508 add op BitwiseAnd BitwiseOr BitwiseXor vm 
Merge pull request !1508 from zhaozhenlong/op/bitwise-and-or-xor
 2020-05-27 20:05:23 +08:00
candanzg 2429da19fb implicit type conversion 
Signed-off-by: candanzg <zhangshucheng@huawei.com>
 2020-05-27 20:04:52 +08:00
seatea 21ab029227 Fix pylint warning for files under `pynative_mode` directory. 2020-05-27 19:28:31 +08:00
mindspore-ci-bot c8b30f9290 !1504 add custom tbe ops for quant aware training 
Merge pull request !1504 from wandongdong/master
 2020-05-27 19:18:22 +08:00
lizhenyu a25b84055c refine data copy in multi-graph 2020-05-27 18:47:15 +08:00
buxue d226a23b65 support tensor set item the number value type is similar as tensor dtype not same 2020-05-27 18:08:10 +08:00
huanghui 1d65ae598a extract const_to_attr_strided_slice_grad pass 2020-05-27 17:30:17 +08:00
wandongdong d35c41e737 add custom tbe ops for quant aware training 2020-05-27 17:09:34 +08:00
mindspore-ci-bot 9c20b1d6f7 !1512 fix reshape reshape case 
Merge pull request !1512 from yao_yf/fix_reshape_reshape_graph
 2020-05-27 16:08:25 +08:00
zhaozhenlong 6fa2813945 add op BitwiseAnd BitwiseOr BitwiseXor 2020-05-27 16:00:25 +08:00
mindspore-ci-bot b46ad9a1bb !1398 Update the bert scripts according to rules of modelzoo 
Merge pull request !1398 from chenhaozhe/update_bert_script
 2020-05-27 15:55:09 +08:00
yangzhenzhang 2f8516e5d7 set auto parallel for dataset warp cell 2020-05-27 15:27:22 +08:00
mindspore-ci-bot ad279e90fd !1407 support mixed tensor index for tensor get item and set item and support in operator. 
Merge pull request !1407 from zhangbuxue/support_mixed_tensor_for_tensor_get_item_and_tensor_set_item
 2020-05-27 14:49:21 +08:00
chenhaozhe b6aceddeab update bert scripts according to rules of modelzoo 2020-05-27 14:27:09 +08:00
yao_yf 96c9569dca fix reshape reshape case 2020-05-27 14:25:40 +08:00
mindspore-ci-bot 2e684e89e7 !1446 pylint clean 
Merge pull request !1446 from liuxiao78/master
 2020-05-27 14:15:14 +08:00
mindspore-ci-bot 5b9c145ff8 !1383 keep different attributes for cnode evaluation 
Merge pull request !1383 from amongo/KeepPrimAttrInCNode
 2020-05-27 13:02:34 +08:00
mindspore-ci-bot 2eedd32120 !1472 add operator HostAllGather and HostReduceScatter 
Merge pull request !1472 from yihuaijie/master
 2020-05-27 11:41:45 +08:00
buxue 7ae289a197 Support mixed tensor for tensor getitem or setitem. 2020-05-27 11:19:51 +08:00
huangdongrun e9aa280f86 add support for dictionary set item which does not exist 2020-05-27 11:19:20 +08:00
mindspore-ci-bot b94949ea99 !1477 support vm for SpaceToBatchND and BatchToSpaceND 
Merge pull request !1477 from jiangjinsheng/BatchToSpaceND
 2020-05-27 10:29:43 +08:00
mindspore-ci-bot 5e2f440eed !1271 refactor of memreuse allocator to adapt the control stream 
Merge pull request !1271 from yangjie159/refactor_memreuse_allocator
 2020-05-27 10:24:16 +08:00
mindspore-ci-bot 4e8e82f24a !1457 fix 3 bug reports for split 
Merge pull request !1457 from Peilin/splitOp-after-testing
 2020-05-27 10:08:57 +08:00
mindspore-ci-bot 3aeb91ee58 !1443 Add parallel operator for Sigmoid 
Merge pull request !1443 from yangzhenzhang/add-sigmoid-op
 2020-05-27 10:08:28 +08:00
mindspore-ci-bot 650a45b233 !1490 Fix pylint warning 
Merge pull request !1490 from seatea/fix-pylint-warning
 2020-05-27 09:41:31 +08:00
jiangjinsheng a45dfca142 support BatchToSpaceND and SpaceToBatchND 2020-05-27 09:13:12 +08:00
Peilin Wang d4c93575e7 fixed bug for split, RandomSampler and some other cleanup 
add another test case

typo

merge conflict

another PR changed testing behavior, updated test cases in this commit

added input check for use_sampler

addressed code review comments

fixed pylint, not related to my changes
 2020-05-26 16:29:52 -04:00
mindspore-ci-bot 2753aa5a9c !1487 add cpu kernel "AddN" 
Merge pull request !1487 from sunsuodong/addn
 2020-05-26 22:27:07 +08:00
yangzhenzhang 7c237620ba add sigmoid op 2020-05-26 21:33:32 +08:00
seatea c6d8a4dc98 Fix pylint warning. 2020-05-26 21:23:06 +08:00
huangdongrun 334d038008 add support for multi switch 
resolve review
 2020-05-26 21:20:29 +08:00
sunsuodong ade90be427 addn 2020-05-26 20:16:41 +08:00
“liuxiao” 73a287e5e0 pylint clean 2020-05-26 19:46:14 +08:00
“liuxiao” ebbccca78b pylint clean 2020-05-26 19:36:54 +08:00
“liuxiao” f4542f810b pylint clean 2020-05-26 19:11:12 +08:00
Yi Huaijie 2f8e7ff693 add operator HostAllGather and HostReduceScatter 2020-05-26 17:41:20 +08:00
yujianfeng 94818cf255 Fix fusion condition of transpose and reshape 2020-05-26 17:30:38 +08:00
yangjie159 cbf5390b34 refactor memreuse allocator 
remove stream id from membuf
add kernel dependence to determine whether is usable
 2020-05-26 17:27:33 +08:00
huangdongrun 1159f2b11e add prim infer attr cache 
modify infer to get abstract value and attr value map together

support get attr in specialize

clone primitive when specialize if attribute is not the same with
infered attribute
 2020-05-26 16:19:58 +08:00
zhaozhenlong 55d1927534 add op scatter add vm 2020-05-26 12:17:23 +08:00
mindspore-ci-bot 10076ffe1a !1216 add graph attention networks model and test file 
Merge pull request !1216 from zhangdengcheng/master
 2020-05-26 11:27:31 +08:00
mindspore-ci-bot 831ceba6eb !1277 Fixing some tiny faults about Pylint in ME code 
Merge pull request !1277 from liuwenhao/master
 2020-05-26 11:08:10 +08:00
Yang abca62f407 10:00 26/5 clean pylint 2020-05-26 10:05:12 +08:00
mindspore-ci-bot 93fc82b8f7 !1447 remove unused variable 
Merge pull request !1447 from yihuaijie/master
 2020-05-26 09:17:48 +08:00
mindspore-ci-bot 2215e3267f !1419 remove old buffer fusion pass 
Merge pull request !1419 from Etone.Chan/Resnet50
 2020-05-26 09:16:06 +08:00
mindspore-ci-bot 0b191615a9 !1427 fix check bprop attr error 
Merge pull request !1427 from panyifeng/fix_check_bprop_attr_error
 2020-05-26 09:10:51 +08:00
mindspore-ci-bot 578cdb4235 !1454 Allow TaskGroup::join_all() to block for GNN 
Merge pull request !1454 from JesseKLee/zirui
 2020-05-26 05:40:59 +08:00
mindspore-ci-bot 0a8ef2fe72 !1455 Cleanup dataset UT: restore config support 
Merge pull request !1455 from cathwong/ckw_dataset_config_util
 2020-05-26 05:40:39 +08:00
Jesse Lee a8fa847556 Allow join_all to be blocking 2020-05-25 15:24:36 -04:00
Cathy Wong f891e1755c Cleanup dataset UT: restore config support 2020-05-25 15:10:03 -04:00
Alexey Shevlyakov 7a807cbff9 fix ut 2020-05-25 14:56:58 -04:00
mindspore-ci-bot aeb4c52f2d !1379 Creating new UTs to three vision transformation ops 
Merge pull request !1379 from Tinazhang/linearTrans
 2020-05-25 23:10:30 +08:00
liuwenhao4 f3f0cbaeee Fixing some tiny faults about Pylint in my code(ops) 2020-05-25 21:27:45 +08:00
etone-chan 42d724d8b4 remove old buffer fusion pass 2020-05-25 21:25:45 +08:00
“liuxiao” 382a0124c3 pylint clean 2020-05-25 21:16:04 +08:00
mindspore-ci-bot e8980ed298 !1406 Simplify CondVar class 
Merge pull request !1406 from JesseKLee/CondVar
 2020-05-25 21:04:05 +08:00
mindspore-ci-bot 44bf7c9330 !1414 fix issue use reshape as flatten grad impl 
Merge pull request !1414 from zhaozhenlong/fix-issues-reshape-replace-flattern-grad
 2020-05-25 20:45:46 +08:00
Yi Huaijie ac484ebbc0 remove unused variable 2020-05-25 19:59:28 +08:00
“liuxiao” 18f0af0529 pylint clean 2020-05-25 19:49:06 +08:00
mindspore-ci-bot e5c7ecfd46 !1426 Fix the issues checked by pylint 
Merge pull request !1426 from chengang/fix_pylint
 2020-05-25 17:47:12 +08:00
mindspore-ci-bot 318e3012d7 !1422 Fix result error when calling AllReduce serially. 
Merge pull request !1422 from ZPaC/fix-multi-allreduce-calling-error
 2020-05-25 17:39:27 +08:00
mindspore-ci-bot 55027096d3 !1400 Add 3 patterns for lamb_next_mv fusion pass 
Merge pull request !1400 from huanghui/TMP
 2020-05-25 17:15:24 +08:00
mindspore-ci-bot 1c8548adb8 !1300 Add TBE op RangeD for GE. 
Merge pull request !1300 from liuxiao/RangeD
 2020-05-25 17:04:53 +08:00
zhaozhenlong 30b93ecbf8 use reshape as flatten grad 2020-05-25 16:57:26 +08:00
panyifeng 6a57eeb922 fix check_bprop attr error 2020-05-25 16:52:30 +08:00
mindspore-ci-bot 57c1da121f !1424 Delete unused arguments in test cases 
Merge pull request !1424 from yihuaijie/master
 2020-05-25 16:42:47 +08:00
Yi Huaijie 0b137e5312 delete unused arguments in test cases 2020-05-25 15:46:05 +08:00
cristoval f6c20178d2 fix pylint check issues 2020-05-25 15:34:01 +08:00
ZPaC d9bcdac3dc Fix result error when calling AllReduce serially. 2020-05-25 15:18:41 +08:00
mindspore-ci-bot 929ef67bfc !1411 pylint warning clean 
Merge pull request !1411 from liubuyu/master
 2020-05-25 15:14:55 +08:00
liuxiao 627724a205 Add RangeD for GE 2020-05-25 14:49:49 +08:00
huanghui a42dd21430 add 3 pattern for lamb_next_mv_rule fusion pass 2020-05-25 14:18:22 +08:00
mindspore-ci-bot 848d19207f !1359 Optimize the IR modules. 
Merge pull request !1359 from ZhangQinghua/master
 2020-05-25 14:14:44 +08:00
liubuyu 107794fac9 pylint warning clean 2020-05-25 11:52:36 +08:00
Yi Huaijie 8cfc05e4cf clean pylint warnings of parallel test cases 2020-05-25 11:08:29 +08:00
Zhang Qinghua dbb86cb1be Adjust some routines of FG and FGM, about the nodes info. IF. 2020-05-25 10:06:27 +08:00
Zhang Qinghua f31564ce98 Remove the useless collectors in manager. 2020-05-25 09:56:28 +08:00
Jesse Lee 641112a40c Initial Drop 2020-05-24 16:57:40 -04:00
mindspore-ci-bot 0e665616f0 !1160 add backward hook and custom bprop in pynative mode 
Merge pull request !1160 from wangqiuliang/add-backward-hook-in-pynative-mode
 2020-05-24 18:09:48 +08:00
kingfo 840922e501 add backward hook function in pynative mode 2020-05-24 13:32:44 +08:00
mindspore-ci-bot 718a96430f !1389 Security issues in recent string tensor PR 
Merge pull request !1389 from h.farahat/fix_security_issues
 2020-05-24 08:45:21 +08:00
mindspore-ci-bot a6b8451a33 !1380 make ShuffleOp have deterministic behavior for subsequent epochs 
Merge pull request !1380 from Peilin/shuffle-subsequent-epoch-deterministic
 2020-05-23 21:02:30 +08:00
mindspore-ci-bot ad9db524bb !1394 Fix comment error and mod parameter check in graphdata 
Merge pull request !1394 from heleiwang/fix_comments_error
 2020-05-23 19:47:19 +08:00
heleiwang f28f883cac fix comments error and modify parameter check 2020-05-23 18:31:13 +08:00
mindspore-ci-bot daccfef738 !1361 Refactor multiple output pass 
Merge pull request !1361 from huanghui/LambNextMVRule-fusion-pass
 2020-05-23 17:21:27 +08:00
mindspore-ci-bot e87e6b38b0 !1355 [AutoParallel]Fix GatherV2 distributed op 
Merge pull request !1355 from lichen/fix_gatherv2
 2020-05-23 17:04:41 +08:00
mindspore-ci-bot a510ecc8ff !1339 add epsilon parameter for layernorm 
Merge pull request !1339 from JichenZhao/layernorm_mean_var_shape
 2020-05-23 15:58:44 +08:00
mindspore-ci-bot e82088d175 !1373 add memory copy module 
Merge pull request !1373 from zyli2020/add_mem_swap_module_header
 2020-05-23 15:39:13 +08:00
lichenever 390a86effb fix gatherv2 2020-05-23 15:38:50 +08:00
lizhenyu c5ac2cc38c add memory copy module 2020-05-23 13:04:50 +08:00
hesham c0f0e154f5 Clean up work for text python package 2020-05-22 23:53:34 -04:00
mindspore-ci-bot 45368a86e9 !1329 Put the parameter validation of the Summary operator into the python layer 
Merge pull request !1329 from ougongchang/master
 2020-05-23 11:41:34 +08:00
mindspore-ci-bot 41456ac824 !1369 dataset: delete StorageDataset 
Merge pull request !1369 from ms_yan/del_storage
 2020-05-23 10:39:34 +08:00
huanghui f16ff539ba refactor multiple patterns pass 2020-05-23 09:40:21 +08:00
Tinazhang 7322839b04 add UTs for LinearTransformation, ToPIL, ToType 2020-05-22 18:04:09 -04:00
mindspore-ci-bot 964a757db2 !1378 Just want to debug this case in Jenkin environment 
Merge pull request !1378 from JesseKLee/cond_var_debug
 2020-05-23 05:26:12 +08:00
Peilin Wang 0cbcc7200b made shuffle determinisitc for subsequent epochs 2020-05-22 17:03:19 -04:00
Jesse Lee 06ae724261 Again 2020-05-22 16:38:03 -04:00
mindspore-ci-bot 61639be1e0 !1375 Cleanup dataset UT: remove num_parallel_workers=1 in test_exception 
Merge pull request !1375 from cathwong/ckw_dataset_ut_cleanup5
 2020-05-22 23:54:52 +08:00
mindspore-ci-bot a528797253 !1377 Code Fix for Uniform Augmentation 
Merge pull request !1377 from Tinazhang/cc
 2020-05-22 23:20:01 +08:00
mindspore-ci-bot 458436186c !1365 Clean up work for text python sub-package 
Merge pull request !1365 from h.farahat/text_namespace
 2020-05-22 23:16:31 +08:00
Tinazhang b390883c6a Bug fix 2020-05-22 10:56:56 -04:00
Cathy Wong 702005d403 Cleanup dataset UT: remove num_parallel_workers=1 in test_exception 2020-05-22 09:28:17 -04:00
ougongchang 7d78b5d89e Put the parameter validation of the Summary operator into the python layer 
add some unittest for summary operator

support ScalarSummary to record number type
 2020-05-22 21:23:43 +08:00
ms_yan d5e896b51c delete storageDataset Op API and its test case 2020-05-22 21:23:24 +08:00
mindspore-ci-bot 6f733ec113 !1308 Stage 2 of adding support for string Tensor 
Merge pull request !1308 from h.farahat/string_tensor2
 2020-05-22 21:17:53 +08:00
xiefangqi 34236ce1f1 fix pylint 2020-05-22 20:18:21 +08:00
mindspore-ci-bot d402b94476 !1370 delete parallel end-to-end test cases 
Merge pull request !1370 from yihuaijie/master
 2020-05-22 20:01:49 +08:00
mindspore-ci-bot f967700ef4 !1215 [Auto parallel] Changing succive edges orders and add some strategy checkings 
Merge pull request !1215 from Xiaoda/change-succive-edges-order-and-add-checking
 2020-05-22 18:56:35 +08:00
mindspore-ci-bot 3363d4e834 !1249 Add GNN dataset processing API 
Merge pull request !1249 from heleiwang/hlw_gnn_data
 2020-05-22 18:49:36 +08:00
mindspore-ci-bot f3d14fa14b !1363 Restrict tensor get item or set item not support mixed tensor. 
Merge pull request !1363 from zhangbuxue/Not_support_mixed_tensor_as_index_for_tensor_getitem_and_setitem
 2020-05-22 18:04:31 +08:00
zhaojichen 7c9fb3424f add epsilon parameter for layernorm 2020-05-22 05:36:39 -04:00
Yi Huaijie 1e6ee83874 delete parallel end-to-end test cases 2020-05-22 17:35:18 +08:00
mindspore-ci-bot 3f23aa1d79 !1348 fix pylint warnings of parallel test cases 
Merge pull request !1348 from yihuaijie/master
 2020-05-22 16:40:42 +08:00
hesham 6c21e556c4 Clean up work for text python package 2020-05-22 04:35:58 -04:00
mindspore-ci-bot 368007240c !1320 add applyrmsprop cumprod and reduceprod for vm 
Merge pull request !1320 from JichenZhao/applyrms_squaresumall_cumprod_reduceprod
 2020-05-22 16:33:31 +08:00
mindspore-ci-bot 889696bcab !1331 delete dropoutgenmask and dropoutdomask when dropout prob equals 0 to enhance performance and adjust ci script 
Merge pull request !1331 from yoonlee666/master-deletedropout
 2020-05-22 16:22:33 +08:00
mindspore-ci-bot 4bdfddedb2 !1358 Link child graphs 
Merge pull request !1358 from zhoufeng/link-child-graph-2
 2020-05-22 16:10:52 +08:00
mindspore-ci-bot 62c716b68e !1349 Fix some functions in group parameters and optimizer 
Merge pull request !1349 from ghzl/add-group-check-for-lars
 2020-05-22 16:05:36 +08:00
buxue 850171a34b Restrict tensor getitem or setitem not support mixed tensor. 2020-05-22 15:55:38 +08:00
zhoufeng af5019b94f link child graphs 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2020-05-22 15:37:19 +08:00
Yi Huaijie 14fe72f383 fix pylint warnings 2020-05-22 14:54:36 +08:00
mindspore-ci-bot bd845dd0b7 !1352 [MD] fix bug when append data in mindrecord using absolute path 
Merge pull request !1352 from liyong126/mindrecord_fix_bug_I1HQUI
 2020-05-22 14:25:15 +08:00
heleiwang 599a449e0b Support processing GNN data 2020-05-22 14:15:25 +08:00
jinyaohui fbdba6e4da clean pylint 2020-05-22 13:23:13 +08:00
hesham df361d1d26 Change mem layout of string tensor 
add support for MindRecord and TFRecord
----
optimize tensorshape

optimize tensorshape and FlatIndex

TFRecord and MindRecord support for string tensor

Modify mem layout
Add new constructor
Add method Allocate

Change some GetMutableBuffer usages to AllocateBuffer
 2020-05-22 01:22:29 -04:00
liyong 447420eb9a fix bug when append data by absolute path 2020-05-22 11:27:56 +08:00
guohongzilong 2d2f9ba8fd fix group parameter code for check 2020-05-22 11:05:45 +08:00
zhaojichen a42ec8f69f add applyrmsprop op for vm 2020-05-21 23:02:32 -04:00
Xiaoda Zhang 9f4b8a3cd1 changing the succive edges order in GetAliveSuccEdges() so that Triangle and Star Elimination can be merged into particular node; adding some check information 2020-05-22 10:57:02 +08:00
mindspore-ci-bot d9c74e0acd !1328 Add 3 patterns support for LambNextMVWithDecay fusion pass 
Merge pull request !1328 from huanghui/LambNextMvWithDecayRuleConds-fusion-pass
 2020-05-22 10:35:17 +08:00
mindspore-ci-bot d6e930d737 !1337 test(custom_op): delete conv2d custom op. 
Merge pull request !1337 from gongchen/del_conv2d_custom_op
 2020-05-22 10:20:46 +08:00
mindspore-ci-bot 58e6d7d950 !1341 Added lookup and vocab to mindspore.dataset.text 
Merge pull request !1341 from ZiruiWu/vocab_and_lookup
 2020-05-22 10:19:42 +08:00
mindspore-ci-bot decf12cd0b !1317 [MD]add compress for nlp data in mindrecord 
Merge pull request !1317 from liyong126/mindrecord_compress
 2020-05-22 10:05:09 +08:00
mindspore-ci-bot 274f6f014f !1133 support tensor get value by tensor index 
Merge pull request !1133 from zhangbuxue/support_tensor_get_value_by_tensor_index
 2020-05-22 10:02:35 +08:00
mindspore-ci-bot 0a795c24aa !1245 add model init api to compile df graph before train 
Merge pull request !1245 from wangnan39/add_model_init_api_to_compile_df_graph_before_train_and_eval
 2020-05-22 09:51:19 +08:00
jonwe bb51bb88d7 add compress in mindrecord 2020-05-22 09:37:51 +08:00
mindspore-ci-bot 2e3d55ed87 !1281 Implementation of SplitOp 
Merge pull request !1281 from Peilin/splitOp
 2020-05-22 09:29:03 +08:00
mindspore-ci-bot 39b9aedf68 !1342 Bug fix on issue Core dump on GPU when train with lenet with AU 
Merge pull request !1342 from Tinazhang/cc
 2020-05-22 09:18:49 +08:00
mindspore-ci-bot 0ca626ef6c !1229 Init the slices of a Initializer on different devices 
Merge pull request !1229 from yihuaijie/master
 2020-05-22 08:57:58 +08:00
Peilin Wang 71e8bb1960 general split case done, chaining sampler (basic case) is working 
implementation 99% complete

everything and tested except for repeatable shuffling

tested most basic/typical split usecases

cleanup

some more cleanup

fix CI

more ci fix

more ci fixes

more ci fix

more ci fix

more ci fix

added more tests, fixed some bugs

some more clean up and test cases

added shard/shuffle before split warning/error

addressed code review comments and ci

fixed ci
 2020-05-21 20:42:51 -04:00
Tinazhang e9e40b688b Bug fix 2020-05-21 18:20:00 -04:00
Zirui Wu 25ab2ef303 Implemented lookup and vocab 2020-05-21 17:17:24 -04:00
mindspore-ci-bot 46949fc327 !1307 Cleanup dataset UT: unskip and enhance TFRecord sharding tests 
Merge pull request !1307 from cathwong/ckw_dataset_ut_unskip2
 2020-05-22 03:21:45 +08:00
wangnan39@huawei.com 1ebf98b795 add model init api to compile df graph before exec 2020-05-21 22:21:49 +08:00
yoonlee666 12d9c71c83 delete dropout when prob equals 0 and adjust bert ci script 2020-05-21 22:08:36 +08:00
buxue e490618db8 support tensor get value by tensor index 
support tensor set value by tensor index
 2020-05-21 21:05:35 +08:00
mindspore-ci-bot 07b14f32b9 !1296 move signature to primitivepy and bprop_func to utils 
Merge pull request !1296 from leopz/fix_primitive
 2020-05-21 20:44:59 +08:00
Yi Huaijie 7a5004cc49 init the slices of a Initialzer on different devices 2020-05-21 20:43:15 +08:00
gongchen 36edbe411e test(custom_op): Delete conv2d custom op. 2020-05-21 20:37:03 +08:00
zhouneng 218ade30b2 add vm support sin and cumsum 2020-05-21 17:26:01 +08:00
huanghui eaff850f11 add 3 patterns for lamb_next_mv_with_decay_rule pass 2020-05-21 17:00:15 +08:00
mindspore-ci-bot 2224fa093b !1302 Complete vm ops for BinaryCrossEntropy and BinaryCrossEntropyGrad 
Merge pull request !1302 from lihongkang/master
 2020-05-21 17:00:09 +08:00
mindspore-ci-bot b96a2ed816 !1312 support vm for erfc 
Merge pull request !1312 from jiangjinsheng/vm_erfc
 2020-05-21 16:59:56 +08:00
mindspore-ci-bot beb3cadb75 !1327 fix resnet cifar 1p test case device error 
Merge pull request !1327 from chujinjin/fix_cifar_1p_test
 2020-05-21 16:59:09 +08:00
mindspore-ci-bot bddd743ca9 !1304 Add check for controldepend 
Merge pull request !1304 from amongo/AddCheckForControlDepend
 2020-05-21 16:09:46 +08:00
chujinjin 668c18c42c fix cifar 1p test 2020-05-21 15:48:57 +08:00
mindspore-ci-bot e4795974be !1266 Refactor LambNextMVWithDecayRule fusion pass 
Merge pull request !1266 from huanghui/LambNextMvWithDecayRuleConds-fusion-pass
 2020-05-21 11:43:49 +08:00
mindspore-ci-bot 19c200e9cc !1280 pylint clean 
Merge pull request !1280 from liubuyu/master
 2020-05-21 11:27:07 +08:00
zhangdengcheng 9fbc519ebb Add graph attention networks model and test file 2020-05-21 02:55:46 +00:00
huanghui 5a68eba585 Refactor LambNextMVWithDecayRule fusion pass 2020-05-21 10:08:50 +08:00
jiangjinsheng 2d3cd8276e vm for erfc 2020-05-21 10:08:23 +08:00
qianlong 451c20a6f5 Add UnicodeCharTokenizer for nlp 2020-05-21 09:22:45 +08:00
mindspore-ci-bot 93e7c97a96 !1272 [Dataset] MindData Tree Optimizer Infrastructure 
Merge pull request !1272 from JunhanHu/minddata_opt
 2020-05-21 05:29:00 +08:00
Cathy Wong b78894e02b Cleanup dataset UT: unskip and enhance TFRecord sharding tests 2020-05-20 17:05:38 -04:00
Junhan Hu f44d213503 MindData optimizer infrastructure. 2020-05-20 16:11:26 -04:00
huangdongrun 3e2074b113 add check for ControlDepend 2020-05-20 22:48:00 +08:00
mindspore-ci-bot 233508b70e !1250 Dict_setitem transofrm to tuple_setitem 
Merge pull request !1250 from amongo/SupportDictSetItemTransform
 2020-05-20 21:37:26 +08:00
lihongkang cf543382aa add vms for binarycrossentropy and binarycrossentropygrad 2020-05-20 20:28:56 +08:00
leopz 04763b8b76 move signature to primitivepy and bprop_func to utils 2020-05-20 18:06:36 +08:00
mindspore-ci-bot 183144e135 !1282 support vm for PReLU and PReLUGrad 
Merge pull request !1282 from jiangjinsheng/vm_prelu
 2020-05-20 17:08:03 +08:00
xulei2020 163b6b7ea7 add jieba c++ code 2020-05-20 15:55:12 +08:00
mindspore-ci-bot aa1cee113d !1279 test(custom_op): clean up custom op test case. 
Merge pull request !1279 from gongchen/fix_custom_op_case
 2020-05-20 15:21:31 +08:00
mindspore-ci-bot 89470cf29d !1263 Modified clip_gradients to clip_grad 
Merge pull request !1263 from Kang/master
 2020-05-20 14:15:05 +08:00
mindspore-ci-bot 1ba8e052f8 !1125 support vm for space_to_depth 
Merge pull request !1125 from jiangjinsheng/space_to_depth
 2020-05-20 11:59:21 +08:00
Kang bfff7c0a2f Modified clip_gradients to clip_grad 2020-05-20 11:58:47 +08:00
mindspore-ci-bot 97ba539e7b !1269 fix issue of loadding control input tensors failed in control sink mode 
Merge pull request !1269 from wenchunjiang/fix_task_sink_bug
 2020-05-20 11:33:12 +08:00
jiangjinsheng ce09f5e15a vm for prelu and prelugrad 2020-05-20 11:21:56 +08:00
liubuyu 37be555a81 pylint clean 2020-05-20 11:12:14 +08:00
gongchen 44458865b6 test(custom_op): Clean up custom op test case. 2020-05-20 11:03:18 +08:00
wenchunjiang 729ea8cc55 fix bug of loadding ctrl input tensors failed in control sink mode 2020-05-20 10:45:28 +08:00
mindspore-ci-bot 6ffb3c97cd !1058 add host cpu kernel: GatherV2/Concat/Slice/SliceGrad 
Merge pull request !1058 from sunsuodong/lstm_ops
 2020-05-20 10:26:30 +08:00
mindspore-ci-bot b391e43407 !1262 fix bert precision bug 
Merge pull request !1262 from wanghua/master
 2020-05-20 10:23:17 +08:00
mindspore-ci-bot 04ac611fe8 !1189 Decoupling py default param from Parameter 
Merge pull request !1189 from leopz/master
 2020-05-20 10:02:01 +08:00
huangdongrun 3cf94daefc add support for dict setitem operation 
format code

remove save_graph

raise exception when dictionary setitem if the key not exists

resolve error

remove unnessary op_
 2020-05-20 09:58:30 +08:00
jiangjinsheng ba99cb7bcb support vm for space_to_depth 2020-05-20 09:47:12 +08:00
Tinazhang 17cecf2cf5 Added TCs to RandomCrop and RandomCropAndResize and modified visalize() calling 2020-05-19 15:42:24 -04:00
mindspore-ci-bot fe8b59f26b !1111 support vm for pack and unpack 
Merge pull request !1111 from jiangjinsheng/vm_pack
 2020-05-19 21:36:16 +08:00
wanghua 2703ac5ba4 fix bert percision problem 2020-05-19 21:01:42 +08:00
leopz 40e15996b0 move default_param out of parameter and remove pybind11 in anf define 2020-05-19 19:11:12 +08:00
Wei Luning 3db8cfa54f add pattern AdjustAllReduceMulAdduse the old opadd test case for bugtemp fix try 2020-05-19 18:46:11 +08:00
mindspore-ci-bot c9ce34ea48 !1194 test(custom_op): add custom op testcase. 
Merge pull request !1194 from gongchen/add_custom_op_test
 2020-05-19 16:58:36 +08:00
jiangjinsheng f9bd460c96 support vm for pack 2020-05-19 16:52:41 +08:00
gongchen 366364ba38 Add custom op testcases. 2020-05-19 14:38:18 +08:00
mindspore-ci-bot c793540cc9 !1231 Assign label resource for new control sink 
Merge pull request !1231 from zhoufeng/label-assign
 2020-05-19 10:48:35 +08:00
mindspore-ci-bot 18c9495000 !1228 Adapt tbe op UnsortedSegmentMin for GE. 
Merge pull request !1228 from liuxiao/UnsortedSegmentMin
 2020-05-19 09:04:22 +08:00
mindspore-ci-bot 9f9af3c59a !1224 add squaresumall op 
Merge pull request !1224 from JichenZhao/squaresumall
 2020-05-18 22:18:21 +08:00
zhoufeng c99f904276 assign label resource for new control sink 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2020-05-18 21:44:52 +08:00
mindspore-ci-bot 828d0b124e !1209 add format trans function 
Merge pull request !1209 from liubuyu/master
 2020-05-18 20:59:43 +08:00
liuxiao cc024bb3a1 UnsortedSegmentMin for GE 2020-05-18 20:49:58 +08:00
zhaojichen d1d1766bed add squaresumall op 2020-05-18 08:01:22 -04:00
mindspore-ci-bot 1b7cdc4c61 !1218 clean pylint warning in test about import 
Merge pull request !1218 from jinyaohui/pylint1
 2020-05-18 19:54:04 +08:00
liubuyu f70429d671 add format transfer 2020-05-18 19:45:04 +08:00
mindspore-ci-bot 3b6de89368 !1187 Checkpoint and restore parameter's shape 
Merge pull request !1187 from yangzhenzhang/ckpt-and-restore-parameter-shape
 2020-05-18 19:05:45 +08:00
yujianfeng c8d33568f2 Add an new output to FusedMulApplyMomentum 2020-05-18 17:03:21 +08:00
jinyaohui 5a914994ba clean pylint 2020-05-18 16:42:35 +08:00
sunsuodong 28241d0293 lstm ops 2020-05-18 16:39:09 +08:00
yangzhenzhang 6b54a6417d ckpt and restore parameter shape 2020-05-18 15:16:29 +08:00
huanghui c4af71e236 add LarsV2 fission pass 2020-05-18 11:30:45 +08:00
jinyaohui bcfaff97f9 clean pylint 2020-05-18 10:31:46 +08:00
mindspore-ci-bot 93f6fc0ab0 !1188 fine tuning mindspore_test_framework 
Merge pull request !1188 from panyifeng/fine_tuning_mindspore_test_framework
 2020-05-18 10:23:37 +08:00
mindspore-ci-bot 051567ba20 !1192 Support string type Stage ! 
Merge pull request !1192 from h.farahat/string_Tensor
 2020-05-18 09:51:17 +08:00
mindspore-ci-bot 78a29bba3c !972 Fix CSE bug for some operations like `DropoutGenMask` which may have random effect 
Merge pull request !972 from seatea/fix-cse-bug-for-random-effect
 2020-05-18 09:39:16 +08:00
mindspore-ci-bot 4efa9717bb !1129 Add op bounding box encoder 
Merge pull request !1129 from zhaozhenlong/op/bounding-box-encoder
 2020-05-18 09:04:59 +08:00
mindspore-ci-bot 6de7eb2633 !1203 delete ApplyAdamD for master 
Merge pull request !1203 from changzherui/code516
 2020-05-17 20:14:06 +08:00
changzherui 1e93927772 code 516 for test 2020-05-17 15:28:17 +08:00
mindspore-ci-bot c3d9f18087 !1176 fix validator for transpose 
Merge pull request !1176 from jiangjinsheng/issue_transpose
 2020-05-16 19:10:35 +08:00
seatea 981b013f81 Fix CSE bug for some operations like `DropoutGenMask` which should not 
be optimized as it will generate different values each time.
 2020-05-16 18:58:43 +08:00
mindspore-ci-bot c169ac6a18 !1195 add validate for geswitch and merge 
Merge pull request !1195 from jiangjinsheng/issue_geswitch
 2020-05-16 18:43:19 +08:00
jiangjinsheng e45532b78c fixed transpose 2020-05-16 18:07:52 +08:00
jiangjinsheng c05203ef06 add validate for geswitch and merge 2020-05-16 17:49:21 +08:00
mindspore-ci-bot 0040764dec !1100 delete some context param(enable_loop_sink,enable_mem_reuse,enable_auto_mixed_precision) 
Merge pull request !1100 from jinyaohui/context_opt_2
 2020-05-16 15:38:40 +08:00
jinyaohui 2907cf4488 remove some context param 2020-05-16 15:07:13 +08:00
zhaozhenlong b54ffdc086 add op BoundingBoxDecode 
iou

NMSWithMask

larsupdate testcase

sgd testcase
 2020-05-16 02:40:16 -04:00
mindspore-ci-bot 92d196f054 !1178 Complete vm ops for ROIAlign and ROIAlignGrad 
Merge pull request !1178 from zhouneng/add_vm_support_roialign
 2020-05-16 11:15:13 +08:00
hesham e8ca243364 -Add DE_STRING 
-replace switch'case by indexing

- Add test case
- Add constructors
- Add getItem string

- Fix bugs
- Add more tests

- Tensor iterator
- asNumpy
- TextFileDataset

- Tensor(Numpy)

- Super > 2D
- Add more test cases for GeneratorDataset

- Change StartAddr to GetBuffer and GetMutableNuffer

- Raise an error if batch is used with strings

Clean-up work
 2020-05-15 20:33:28 -04:00
mindspore-ci-bot 7240c6feff !1061 Add flat_map op to Dataset 
Merge pull request !1061 from jiangzhiwen/dataset/flat_map
 2020-05-15 20:14:30 +08:00
jiangzhiwen cb2814b498 flat_map first commit 2020-05-15 17:45:39 +08:00
mindspore-ci-bot ca64bfdbab !1120 Code refactoring ：modify Infer to Eval 
Merge pull request !1120 from Kang/master
 2020-05-15 17:44:29 +08:00
mindspore-ci-bot 889d7b6eea !1180 [pre_activate]Fix pylint warning 
Merge pull request !1180 from YuJianfeng/master
 2020-05-15 17:25:34 +08:00
mindspore-ci-bot efb9672849 !1118 Add BatchNormGrad2BNInferGrad pass 
Merge pull request !1118 from huanghui/batchnormgrad-to-bninfergrad-pass
 2020-05-15 17:15:38 +08:00
mindspore-ci-bot c680cfbf27 !1157 dataset: add concat operation for dataset 
Merge pull request !1157 from ms_yan/concat_dataset
 2020-05-15 16:07:19 +08:00
mindspore-ci-bot ab031ee9ea !1126 VOCDataset support object detection function 
Merge pull request !1126 from xiefangqi/voc_support_detection
 2020-05-15 15:56:39 +08:00
yujianfeng 0f42fdbb80 Fix pylint warning 2020-05-15 15:29:22 +08:00
zhouneng c2a1b5f8c1 add register info for ROIAlign and ROIAlignGrad 2020-05-15 14:58:33 +08:00
mindspore-ci-bot dbac31e787 !1175 LayerNormGrad fix & codex 
Merge pull request !1175 from chenweifeng/layernorm
 2020-05-15 14:55:36 +08:00
huanghui 709828a98b add BatchNormGrad2BNInferGrad pass 2020-05-15 14:37:50 +08:00
mindspore-ci-bot 42ba885e58 !1098 Add BatchNorm2BNInfer pass 
Merge pull request !1098 from huanghui/add-batchnorm-bninfer-pass
 2020-05-15 14:33:09 +08:00
xiefangqi c937bad53f minddata support voc 2020-05-15 13:24:03 +08:00
ms_yan c0fa7b4b19 init commit of concat dataset 
change to use __add__ operation instead ds.concat
 2020-05-15 13:14:13 +08:00
wilfChen 1991a89f40 LayerNormGrad fix & codex 2020-05-15 11:16:30 +08:00
mindspore-ci-bot 6f68dd7d12 !1130 support vm for flatten 
Merge pull request !1130 from jiangjinsheng/flatten
 2020-05-15 11:06:00 +08:00
mindspore-ci-bot c786596641 !1156 Add batch_norm grad infer fission pass 
Merge pull request !1156 from YuJianfeng/master
 2020-05-15 10:38:32 +08:00
jiangjinsheng 766906dd6d support vm for flatten 2020-05-15 10:30:58 +08:00
Kang be60bd3d79 Code refactoring for the static_analysis : modified Infer to Eval. 2020-05-15 09:56:41 +08:00
huanghui 6db71e6576 add batchnorm2bninfer pass 2020-05-15 09:56:38 +08:00
mindspore-ci-bot 8a853cec2d !1171 adjust onnx related testcases 
Merge pull request !1171 from fary86/adjust_onnx_related_uts
 2020-05-15 09:46:11 +08:00
yujianfeng 2b061c84c7 Add batch_norm_grad infer fisson 2020-05-15 09:44:40 +08:00
mindspore-ci-bot 597933b04b !1113 rename kernel/mng to kernel/rts 
Merge pull request !1113 from dengwentao/rts
 2020-05-15 09:39:18 +08:00
mindspore-ci-bot d2efa20cab !1163 Add BatchNorm fusion pattern with mix precision 
Merge pull request !1163 from YuJianfeng/bn_fusion_with_cast
 2020-05-15 09:20:36 +08:00
mindspore-ci-bot bb374ebc28 !1015 Support weights to be compiled according to shape 
Merge pull request !1015 from candanzg/me_with_shape
 2020-05-15 09:13:41 +08:00
fary86 fe2ee14340 Adjust onnx exporting related testcases 2020-05-15 03:21:29 +08:00
mindspore-ci-bot a9816fa779 !1026 Add Logsigmoid and Reduce_logsumexp 
Merge pull request !1026 from peixu_ren/custom_pp_ops
 2020-05-14 22:02:58 +08:00
yujianfeng 6e89ebe6f0 Add BatchNorm fusion pattern with mix precision 2020-05-14 21:28:08 +08:00
panyifeng 5a7abf0740 tuning mindspore_test_framework 2020-05-14 17:26:52 +08:00
jonyguo be2e7531ca fix: MindDataset parameter shard_id & num_shards check 2020-05-14 17:18:11 +08:00
mindspore-ci-bot 4bb46606db !1149 fix pylint in tests 
Merge pull request !1149 from panyifeng/fix_pylint
 2020-05-14 15:15:52 +08:00
mindspore-ci-bot 5075f0a27e !1146 add matmul eltwise buffer fusion 
Merge pull request !1146 from Etone.Chan/master
 2020-05-14 14:54:54 +08:00
panyifeng 755ba75deb fix pylint 2020-05-14 14:22:52 +08:00
mindspore-ci-bot 4bb5c7b39a !1084 add new interface quant combined 
Merge pull request !1084 from SanjayChan/04quant
 2020-05-14 11:19:00 +08:00
peixu_ren 99fda6f431 Add logsigmoid and reduce_logsumexp 2020-05-13 23:52:10 -03:00
etone-chan c4a5bfb787 add matmul eltwise buffer fusion pass 2020-05-14 10:36:23 +08:00
mindspore-ci-bot a2a3b1c6c5 !1089 Add Optimizer method get_lr_parameter 
Merge pull request !1089 from ghzl/add-get-lr-base-on-parameter
 2020-05-14 09:40:31 +08:00
mindspore-ci-bot 9e116e15fb !1139 Change Thread::Join to async call with time out 
Merge pull request !1139 from JesseKLee/timing_hole
 2020-05-14 09:07:06 +08:00
mindspore-ci-bot 1a052f7155 !1131 [Data]fix cmake build format 
Merge pull request !1131 from xulei/filter_op
 2020-05-14 08:24:35 +08:00
Jesse Lee f2be49d85e Fix a racing condition 2020-05-13 14:59:25 -04:00
Cathy Wong 913074e656 Cleanup dataset UT: resolve skipped test units 2020-05-13 14:41:57 -04:00
mindspore-ci-bot 6b68671805 !1069 Use a resident process to write summary files and SummaryRecord as context manager 
Merge pull request !1069 from 李鸿章/context_manager
 2020-05-13 22:44:39 +08:00
李鸿章 32c1d558f4 SummaryRecord as context manager 2020-05-13 21:53:24 +08:00
mindspore-ci-bot 7e3ec651dc !1094 Complete vm ops for L2Normalize and L2NormalizeGrad 
Merge pull request !1094 from zhouneng/add_vm_support_l2normalize
 2020-05-13 21:52:45 +08:00
candanzg 2cc85bdc93 Support weight compile according to shape 
Signed-off-by: candanzg <zhangshucheng@huawei.com>
 2020-05-13 17:49:07 +08:00
mindspore-ci-bot 21bcdcd8ad !1121 Complete vm ops for ResizeBilinear and ResizeBilinearGrad 
Merge pull request !1121 from lihongkang/master
 2020-05-13 17:43:04 +08:00
chenzomi 1239cd6135 Merge branch 'master' into 04quant 2020-05-13 17:31:50 +08:00
guohongzilong e70b2f5430 add optimizer.get_lr_parameter() method 2020-05-13 17:21:22 +08:00
chenzomi bf6246e617 add quant combined 2020-05-13 17:05:45 +08:00