p04896132
/
mindspore
forked from mindspore-Ecosystem/mindspore
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
2,829 Commits 23 Branches 0 Tags 3.9 GiB
Commit Graph

1021 Commits

Author SHA1 Message Date
Yi Huaijie ac484ebbc0 remove unused variable 2020-05-25 19:59:28 +08:00
“liuxiao” 18f0af0529 pylint clean 2020-05-25 19:49:06 +08:00
mindspore-ci-bot e5c7ecfd46 !1426 Fix the issues checked by pylint 
Merge pull request !1426 from chengang/fix_pylint
 2020-05-25 17:47:12 +08:00
mindspore-ci-bot 318e3012d7 !1422 Fix result error when calling AllReduce serially. 
Merge pull request !1422 from ZPaC/fix-multi-allreduce-calling-error
 2020-05-25 17:39:27 +08:00
mindspore-ci-bot 55027096d3 !1400 Add 3 patterns for lamb_next_mv fusion pass 
Merge pull request !1400 from huanghui/TMP
 2020-05-25 17:15:24 +08:00
mindspore-ci-bot 1c8548adb8 !1300 Add TBE op RangeD for GE. 
Merge pull request !1300 from liuxiao/RangeD
 2020-05-25 17:04:53 +08:00
zhaozhenlong 30b93ecbf8 use reshape as flatten grad 2020-05-25 16:57:26 +08:00
panyifeng 6a57eeb922 fix check_bprop attr error 2020-05-25 16:52:30 +08:00
mindspore-ci-bot 57c1da121f !1424 Delete unused arguments in test cases 
Merge pull request !1424 from yihuaijie/master
 2020-05-25 16:42:47 +08:00
Yi Huaijie 0b137e5312 delete unused arguments in test cases 2020-05-25 15:46:05 +08:00
cristoval f6c20178d2 fix pylint check issues 2020-05-25 15:34:01 +08:00
ZPaC d9bcdac3dc Fix result error when calling AllReduce serially. 2020-05-25 15:18:41 +08:00
mindspore-ci-bot 929ef67bfc !1411 pylint warning clean 
Merge pull request !1411 from liubuyu/master
 2020-05-25 15:14:55 +08:00
liuxiao 627724a205 Add RangeD for GE 2020-05-25 14:49:49 +08:00
huanghui a42dd21430 add 3 pattern for lamb_next_mv_rule fusion pass 2020-05-25 14:18:22 +08:00
mindspore-ci-bot 848d19207f !1359 Optimize the IR modules. 
Merge pull request !1359 from ZhangQinghua/master
 2020-05-25 14:14:44 +08:00
liubuyu 107794fac9 pylint warning clean 2020-05-25 11:52:36 +08:00
Yi Huaijie 8cfc05e4cf clean pylint warnings of parallel test cases 2020-05-25 11:08:29 +08:00
Zhang Qinghua dbb86cb1be Adjust some routines of FG and FGM, about the nodes info. IF. 2020-05-25 10:06:27 +08:00
Zhang Qinghua f31564ce98 Remove the useless collectors in manager. 2020-05-25 09:56:28 +08:00
Jesse Lee 641112a40c Initial Drop 2020-05-24 16:57:40 -04:00
mindspore-ci-bot 0e665616f0 !1160 add backward hook and custom bprop in pynative mode 
Merge pull request !1160 from wangqiuliang/add-backward-hook-in-pynative-mode
 2020-05-24 18:09:48 +08:00
kingfo 840922e501 add backward hook function in pynative mode 2020-05-24 13:32:44 +08:00
mindspore-ci-bot 718a96430f !1389 Security issues in recent string tensor PR 
Merge pull request !1389 from h.farahat/fix_security_issues
 2020-05-24 08:45:21 +08:00
mindspore-ci-bot a6b8451a33 !1380 make ShuffleOp have deterministic behavior for subsequent epochs 
Merge pull request !1380 from Peilin/shuffle-subsequent-epoch-deterministic
 2020-05-23 21:02:30 +08:00
mindspore-ci-bot ad9db524bb !1394 Fix comment error and mod parameter check in graphdata 
Merge pull request !1394 from heleiwang/fix_comments_error
 2020-05-23 19:47:19 +08:00
heleiwang f28f883cac fix comments error and modify parameter check 2020-05-23 18:31:13 +08:00
mindspore-ci-bot daccfef738 !1361 Refactor multiple output pass 
Merge pull request !1361 from huanghui/LambNextMVRule-fusion-pass
 2020-05-23 17:21:27 +08:00
mindspore-ci-bot e87e6b38b0 !1355 [AutoParallel]Fix GatherV2 distributed op 
Merge pull request !1355 from lichen/fix_gatherv2
 2020-05-23 17:04:41 +08:00
mindspore-ci-bot a510ecc8ff !1339 add epsilon parameter for layernorm 
Merge pull request !1339 from JichenZhao/layernorm_mean_var_shape
 2020-05-23 15:58:44 +08:00
mindspore-ci-bot e82088d175 !1373 add memory copy module 
Merge pull request !1373 from zyli2020/add_mem_swap_module_header
 2020-05-23 15:39:13 +08:00
lichenever 390a86effb fix gatherv2 2020-05-23 15:38:50 +08:00
lizhenyu c5ac2cc38c add memory copy module 2020-05-23 13:04:50 +08:00
hesham c0f0e154f5 Clean up work for text python package 2020-05-22 23:53:34 -04:00
mindspore-ci-bot 45368a86e9 !1329 Put the parameter validation of the Summary operator into the python layer 
Merge pull request !1329 from ougongchang/master
 2020-05-23 11:41:34 +08:00
mindspore-ci-bot 41456ac824 !1369 dataset: delete StorageDataset 
Merge pull request !1369 from ms_yan/del_storage
 2020-05-23 10:39:34 +08:00
huanghui f16ff539ba refactor multiple patterns pass 2020-05-23 09:40:21 +08:00
Tinazhang 7322839b04 add UTs for LinearTransformation, ToPIL, ToType 2020-05-22 18:04:09 -04:00
mindspore-ci-bot 964a757db2 !1378 Just want to debug this case in Jenkin environment 
Merge pull request !1378 from JesseKLee/cond_var_debug
 2020-05-23 05:26:12 +08:00
Peilin Wang 0cbcc7200b made shuffle determinisitc for subsequent epochs 2020-05-22 17:03:19 -04:00
Jesse Lee 06ae724261 Again 2020-05-22 16:38:03 -04:00
mindspore-ci-bot 61639be1e0 !1375 Cleanup dataset UT: remove num_parallel_workers=1 in test_exception 
Merge pull request !1375 from cathwong/ckw_dataset_ut_cleanup5
 2020-05-22 23:54:52 +08:00
mindspore-ci-bot a528797253 !1377 Code Fix for Uniform Augmentation 
Merge pull request !1377 from Tinazhang/cc
 2020-05-22 23:20:01 +08:00
mindspore-ci-bot 458436186c !1365 Clean up work for text python sub-package 
Merge pull request !1365 from h.farahat/text_namespace
 2020-05-22 23:16:31 +08:00
Tinazhang b390883c6a Bug fix 2020-05-22 10:56:56 -04:00
Cathy Wong 702005d403 Cleanup dataset UT: remove num_parallel_workers=1 in test_exception 2020-05-22 09:28:17 -04:00
ougongchang 7d78b5d89e Put the parameter validation of the Summary operator into the python layer 
add some unittest for summary operator

support ScalarSummary to record number type
 2020-05-22 21:23:43 +08:00
ms_yan d5e896b51c delete storageDataset Op API and its test case 2020-05-22 21:23:24 +08:00
mindspore-ci-bot 6f733ec113 !1308 Stage 2 of adding support for string Tensor 
Merge pull request !1308 from h.farahat/string_tensor2
 2020-05-22 21:17:53 +08:00
xiefangqi 34236ce1f1 fix pylint 2020-05-22 20:18:21 +08:00
mindspore-ci-bot d402b94476 !1370 delete parallel end-to-end test cases 
Merge pull request !1370 from yihuaijie/master
 2020-05-22 20:01:49 +08:00
mindspore-ci-bot f967700ef4 !1215 [Auto parallel] Changing succive edges orders and add some strategy checkings 
Merge pull request !1215 from Xiaoda/change-succive-edges-order-and-add-checking
 2020-05-22 18:56:35 +08:00
mindspore-ci-bot 3363d4e834 !1249 Add GNN dataset processing API 
Merge pull request !1249 from heleiwang/hlw_gnn_data
 2020-05-22 18:49:36 +08:00
mindspore-ci-bot f3d14fa14b !1363 Restrict tensor get item or set item not support mixed tensor. 
Merge pull request !1363 from zhangbuxue/Not_support_mixed_tensor_as_index_for_tensor_getitem_and_setitem
 2020-05-22 18:04:31 +08:00
zhaojichen 7c9fb3424f add epsilon parameter for layernorm 2020-05-22 05:36:39 -04:00
Yi Huaijie 1e6ee83874 delete parallel end-to-end test cases 2020-05-22 17:35:18 +08:00
mindspore-ci-bot 3f23aa1d79 !1348 fix pylint warnings of parallel test cases 
Merge pull request !1348 from yihuaijie/master
 2020-05-22 16:40:42 +08:00
hesham 6c21e556c4 Clean up work for text python package 2020-05-22 04:35:58 -04:00
mindspore-ci-bot 368007240c !1320 add applyrmsprop cumprod and reduceprod for vm 
Merge pull request !1320 from JichenZhao/applyrms_squaresumall_cumprod_reduceprod
 2020-05-22 16:33:31 +08:00
mindspore-ci-bot 889696bcab !1331 delete dropoutgenmask and dropoutdomask when dropout prob equals 0 to enhance performance and adjust ci script 
Merge pull request !1331 from yoonlee666/master-deletedropout
 2020-05-22 16:22:33 +08:00
mindspore-ci-bot 4bdfddedb2 !1358 Link child graphs 
Merge pull request !1358 from zhoufeng/link-child-graph-2
 2020-05-22 16:10:52 +08:00
mindspore-ci-bot 62c716b68e !1349 Fix some functions in group parameters and optimizer 
Merge pull request !1349 from ghzl/add-group-check-for-lars
 2020-05-22 16:05:36 +08:00
buxue 850171a34b Restrict tensor getitem or setitem not support mixed tensor. 2020-05-22 15:55:38 +08:00
zhoufeng af5019b94f link child graphs 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2020-05-22 15:37:19 +08:00
Yi Huaijie 14fe72f383 fix pylint warnings 2020-05-22 14:54:36 +08:00
mindspore-ci-bot bd845dd0b7 !1352 [MD] fix bug when append data in mindrecord using absolute path 
Merge pull request !1352 from liyong126/mindrecord_fix_bug_I1HQUI
 2020-05-22 14:25:15 +08:00
heleiwang 599a449e0b Support processing GNN data 2020-05-22 14:15:25 +08:00
jinyaohui fbdba6e4da clean pylint 2020-05-22 13:23:13 +08:00
hesham df361d1d26 Change mem layout of string tensor 
add support for MindRecord and TFRecord
----
optimize tensorshape

optimize tensorshape and FlatIndex

TFRecord and MindRecord support for string tensor

Modify mem layout
Add new constructor
Add method Allocate

Change some GetMutableBuffer usages to AllocateBuffer
 2020-05-22 01:22:29 -04:00
liyong 447420eb9a fix bug when append data by absolute path 2020-05-22 11:27:56 +08:00
guohongzilong 2d2f9ba8fd fix group parameter code for check 2020-05-22 11:05:45 +08:00
zhaojichen a42ec8f69f add applyrmsprop op for vm 2020-05-21 23:02:32 -04:00
Xiaoda Zhang 9f4b8a3cd1 changing the succive edges order in GetAliveSuccEdges() so that Triangle and Star Elimination can be merged into particular node; adding some check information 2020-05-22 10:57:02 +08:00
mindspore-ci-bot d9c74e0acd !1328 Add 3 patterns support for LambNextMVWithDecay fusion pass 
Merge pull request !1328 from huanghui/LambNextMvWithDecayRuleConds-fusion-pass
 2020-05-22 10:35:17 +08:00
mindspore-ci-bot d6e930d737 !1337 test(custom_op): delete conv2d custom op. 
Merge pull request !1337 from gongchen/del_conv2d_custom_op
 2020-05-22 10:20:46 +08:00
mindspore-ci-bot 58e6d7d950 !1341 Added lookup and vocab to mindspore.dataset.text 
Merge pull request !1341 from ZiruiWu/vocab_and_lookup
 2020-05-22 10:19:42 +08:00
mindspore-ci-bot decf12cd0b !1317 [MD]add compress for nlp data in mindrecord 
Merge pull request !1317 from liyong126/mindrecord_compress
 2020-05-22 10:05:09 +08:00
mindspore-ci-bot 274f6f014f !1133 support tensor get value by tensor index 
Merge pull request !1133 from zhangbuxue/support_tensor_get_value_by_tensor_index
 2020-05-22 10:02:35 +08:00
mindspore-ci-bot 0a795c24aa !1245 add model init api to compile df graph before train 
Merge pull request !1245 from wangnan39/add_model_init_api_to_compile_df_graph_before_train_and_eval
 2020-05-22 09:51:19 +08:00
jonwe bb51bb88d7 add compress in mindrecord 2020-05-22 09:37:51 +08:00
mindspore-ci-bot 2e3d55ed87 !1281 Implementation of SplitOp 
Merge pull request !1281 from Peilin/splitOp
 2020-05-22 09:29:03 +08:00
mindspore-ci-bot 39b9aedf68 !1342 Bug fix on issue Core dump on GPU when train with lenet with AU 
Merge pull request !1342 from Tinazhang/cc
 2020-05-22 09:18:49 +08:00
mindspore-ci-bot 0ca626ef6c !1229 Init the slices of a Initializer on different devices 
Merge pull request !1229 from yihuaijie/master
 2020-05-22 08:57:58 +08:00
Peilin Wang 71e8bb1960 general split case done, chaining sampler (basic case) is working 
implementation 99% complete

everything and tested except for repeatable shuffling

tested most basic/typical split usecases

cleanup

some more cleanup

fix CI

more ci fix

more ci fixes

more ci fix

more ci fix

more ci fix

added more tests, fixed some bugs

some more clean up and test cases

added shard/shuffle before split warning/error

addressed code review comments and ci

fixed ci
 2020-05-21 20:42:51 -04:00
Tinazhang e9e40b688b Bug fix 2020-05-21 18:20:00 -04:00
Zirui Wu 25ab2ef303 Implemented lookup and vocab 2020-05-21 17:17:24 -04:00
mindspore-ci-bot 46949fc327 !1307 Cleanup dataset UT: unskip and enhance TFRecord sharding tests 
Merge pull request !1307 from cathwong/ckw_dataset_ut_unskip2
 2020-05-22 03:21:45 +08:00
wangnan39@huawei.com 1ebf98b795 add model init api to compile df graph before exec 2020-05-21 22:21:49 +08:00
yoonlee666 12d9c71c83 delete dropout when prob equals 0 and adjust bert ci script 2020-05-21 22:08:36 +08:00
buxue e490618db8 support tensor get value by tensor index 
support tensor set value by tensor index
 2020-05-21 21:05:35 +08:00
mindspore-ci-bot 07b14f32b9 !1296 move signature to primitivepy and bprop_func to utils 
Merge pull request !1296 from leopz/fix_primitive
 2020-05-21 20:44:59 +08:00
Yi Huaijie 7a5004cc49 init the slices of a Initialzer on different devices 2020-05-21 20:43:15 +08:00
gongchen 36edbe411e test(custom_op): Delete conv2d custom op. 2020-05-21 20:37:03 +08:00
zhouneng 218ade30b2 add vm support sin and cumsum 2020-05-21 17:26:01 +08:00
huanghui eaff850f11 add 3 patterns for lamb_next_mv_with_decay_rule pass 2020-05-21 17:00:15 +08:00
mindspore-ci-bot 2224fa093b !1302 Complete vm ops for BinaryCrossEntropy and BinaryCrossEntropyGrad 
Merge pull request !1302 from lihongkang/master
 2020-05-21 17:00:09 +08:00
mindspore-ci-bot b96a2ed816 !1312 support vm for erfc 
Merge pull request !1312 from jiangjinsheng/vm_erfc
 2020-05-21 16:59:56 +08:00
mindspore-ci-bot beb3cadb75 !1327 fix resnet cifar 1p test case device error 
Merge pull request !1327 from chujinjin/fix_cifar_1p_test
 2020-05-21 16:59:09 +08:00
mindspore-ci-bot bddd743ca9 !1304 Add check for controldepend 
Merge pull request !1304 from amongo/AddCheckForControlDepend
 2020-05-21 16:09:46 +08:00
chujinjin 668c18c42c fix cifar 1p test 2020-05-21 15:48:57 +08:00
mindspore-ci-bot e4795974be !1266 Refactor LambNextMVWithDecayRule fusion pass 
Merge pull request !1266 from huanghui/LambNextMvWithDecayRuleConds-fusion-pass
 2020-05-21 11:43:49 +08:00
mindspore-ci-bot 19c200e9cc !1280 pylint clean 
Merge pull request !1280 from liubuyu/master
 2020-05-21 11:27:07 +08:00
zhangdengcheng 9fbc519ebb Add graph attention networks model and test file 2020-05-21 02:55:46 +00:00
huanghui 5a68eba585 Refactor LambNextMVWithDecayRule fusion pass 2020-05-21 10:08:50 +08:00
jiangjinsheng 2d3cd8276e vm for erfc 2020-05-21 10:08:23 +08:00
qianlong 451c20a6f5 Add UnicodeCharTokenizer for nlp 2020-05-21 09:22:45 +08:00
mindspore-ci-bot 93e7c97a96 !1272 [Dataset] MindData Tree Optimizer Infrastructure 
Merge pull request !1272 from JunhanHu/minddata_opt
 2020-05-21 05:29:00 +08:00
Cathy Wong b78894e02b Cleanup dataset UT: unskip and enhance TFRecord sharding tests 2020-05-20 17:05:38 -04:00
Junhan Hu f44d213503 MindData optimizer infrastructure. 2020-05-20 16:11:26 -04:00
huangdongrun 3e2074b113 add check for ControlDepend 2020-05-20 22:48:00 +08:00
mindspore-ci-bot 233508b70e !1250 Dict_setitem transofrm to tuple_setitem 
Merge pull request !1250 from amongo/SupportDictSetItemTransform
 2020-05-20 21:37:26 +08:00
lihongkang cf543382aa add vms for binarycrossentropy and binarycrossentropygrad 2020-05-20 20:28:56 +08:00
leopz 04763b8b76 move signature to primitivepy and bprop_func to utils 2020-05-20 18:06:36 +08:00
mindspore-ci-bot 183144e135 !1282 support vm for PReLU and PReLUGrad 
Merge pull request !1282 from jiangjinsheng/vm_prelu
 2020-05-20 17:08:03 +08:00
xulei2020 163b6b7ea7 add jieba c++ code 2020-05-20 15:55:12 +08:00
mindspore-ci-bot aa1cee113d !1279 test(custom_op): clean up custom op test case. 
Merge pull request !1279 from gongchen/fix_custom_op_case
 2020-05-20 15:21:31 +08:00
mindspore-ci-bot 89470cf29d !1263 Modified clip_gradients to clip_grad 
Merge pull request !1263 from Kang/master
 2020-05-20 14:15:05 +08:00
mindspore-ci-bot 1ba8e052f8 !1125 support vm for space_to_depth 
Merge pull request !1125 from jiangjinsheng/space_to_depth
 2020-05-20 11:59:21 +08:00
Kang bfff7c0a2f Modified clip_gradients to clip_grad 2020-05-20 11:58:47 +08:00
mindspore-ci-bot 97ba539e7b !1269 fix issue of loadding control input tensors failed in control sink mode 
Merge pull request !1269 from wenchunjiang/fix_task_sink_bug
 2020-05-20 11:33:12 +08:00
jiangjinsheng ce09f5e15a vm for prelu and prelugrad 2020-05-20 11:21:56 +08:00
liubuyu 37be555a81 pylint clean 2020-05-20 11:12:14 +08:00
gongchen 44458865b6 test(custom_op): Clean up custom op test case. 2020-05-20 11:03:18 +08:00
wenchunjiang 729ea8cc55 fix bug of loadding ctrl input tensors failed in control sink mode 2020-05-20 10:45:28 +08:00
mindspore-ci-bot 6ffb3c97cd !1058 add host cpu kernel: GatherV2/Concat/Slice/SliceGrad 
Merge pull request !1058 from sunsuodong/lstm_ops
 2020-05-20 10:26:30 +08:00
mindspore-ci-bot b391e43407 !1262 fix bert precision bug 
Merge pull request !1262 from wanghua/master
 2020-05-20 10:23:17 +08:00
mindspore-ci-bot 04ac611fe8 !1189 Decoupling py default param from Parameter 
Merge pull request !1189 from leopz/master
 2020-05-20 10:02:01 +08:00
huangdongrun 3cf94daefc add support for dict setitem operation 
format code

remove save_graph

raise exception when dictionary setitem if the key not exists

resolve error

remove unnessary op_
 2020-05-20 09:58:30 +08:00
jiangjinsheng ba99cb7bcb support vm for space_to_depth 2020-05-20 09:47:12 +08:00
Tinazhang 17cecf2cf5 Added TCs to RandomCrop and RandomCropAndResize and modified visalize() calling 2020-05-19 15:42:24 -04:00
mindspore-ci-bot fe8b59f26b !1111 support vm for pack and unpack 
Merge pull request !1111 from jiangjinsheng/vm_pack
 2020-05-19 21:36:16 +08:00
wanghua 2703ac5ba4 fix bert percision problem 2020-05-19 21:01:42 +08:00
leopz 40e15996b0 move default_param out of parameter and remove pybind11 in anf define 2020-05-19 19:11:12 +08:00
Wei Luning 3db8cfa54f add pattern AdjustAllReduceMulAdduse the old opadd test case for bugtemp fix try 2020-05-19 18:46:11 +08:00
mindspore-ci-bot c9ce34ea48 !1194 test(custom_op): add custom op testcase. 
Merge pull request !1194 from gongchen/add_custom_op_test
 2020-05-19 16:58:36 +08:00
jiangjinsheng f9bd460c96 support vm for pack 2020-05-19 16:52:41 +08:00
gongchen 366364ba38 Add custom op testcases. 2020-05-19 14:38:18 +08:00
mindspore-ci-bot c793540cc9 !1231 Assign label resource for new control sink 
Merge pull request !1231 from zhoufeng/label-assign
 2020-05-19 10:48:35 +08:00
mindspore-ci-bot 18c9495000 !1228 Adapt tbe op UnsortedSegmentMin for GE. 
Merge pull request !1228 from liuxiao/UnsortedSegmentMin
 2020-05-19 09:04:22 +08:00
mindspore-ci-bot 9f9af3c59a !1224 add squaresumall op 
Merge pull request !1224 from JichenZhao/squaresumall
 2020-05-18 22:18:21 +08:00
zhoufeng c99f904276 assign label resource for new control sink 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2020-05-18 21:44:52 +08:00
mindspore-ci-bot 828d0b124e !1209 add format trans function 
Merge pull request !1209 from liubuyu/master
 2020-05-18 20:59:43 +08:00
liuxiao cc024bb3a1 UnsortedSegmentMin for GE 2020-05-18 20:49:58 +08:00
zhaojichen d1d1766bed add squaresumall op 2020-05-18 08:01:22 -04:00
mindspore-ci-bot 1b7cdc4c61 !1218 clean pylint warning in test about import 
Merge pull request !1218 from jinyaohui/pylint1
 2020-05-18 19:54:04 +08:00
liubuyu f70429d671 add format transfer 2020-05-18 19:45:04 +08:00
mindspore-ci-bot 3b6de89368 !1187 Checkpoint and restore parameter's shape 
Merge pull request !1187 from yangzhenzhang/ckpt-and-restore-parameter-shape
 2020-05-18 19:05:45 +08:00
yujianfeng c8d33568f2 Add an new output to FusedMulApplyMomentum 2020-05-18 17:03:21 +08:00
jinyaohui 5a914994ba clean pylint 2020-05-18 16:42:35 +08:00
sunsuodong 28241d0293 lstm ops 2020-05-18 16:39:09 +08:00