Nigel
/
mindspore
forked from mindspore-Ecosystem/mindspore
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
42,838 Commits 24 Branches 0 Tags 3.9 GiB
Commit Graph

3732 Commits

Author SHA1 Message Date
yangzhenzhang 1413f520d7 support reshape optimized 2020-05-28 16:05:36 +08:00
mindspore-ci-bot 0f4dc13e8e !1478 [Dataset] Fix CI warnings, clean pylint. 
Merge pull request !1478 from luoyang/pylint
 2020-05-28 15:54:52 +08:00
gengdongjie 705c71a257 Revert "add pattern AdjustAllReduceMulAdduse the old opadd test case for bugtemp fix try" 
This reverts commit 3db8cfa54f.
 2020-05-28 15:21:15 +08:00
wandongdong 9c5f6b9198 add onnx ops for deepfm 2020-05-28 15:06:01 +08:00
fangzehua c0b8a90105 add vm ops: asin asinh asingrad asinhgrad 2020-05-28 14:58:23 +08:00
jonyguo 34428e0082 Merge branch 'incubator-master' into sync_a7744bde_acce61d0 2020-05-28 14:50:40 +08:00
mindspore-ci-bot dd54ffdbdb !1491 Complete vm ops for ReduceAllD, SparseApplyAdagradD and UnsortedSegmentMinD 
Merge pull request !1491 from lihongkang/master
 2020-05-28 14:45:59 +08:00
mindspore-ci-bot 3dc061165b !1559 Voc dataset support split ops 
Merge pull request !1559 from xiefangqi/xfq_voc_support_split
 2020-05-28 14:17:35 +08:00
Yang 9b2a778d94 !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
wangnan39@huawei.com 810ccf80d8 fix_bug_in_check_lamb_warmup_step 2020-05-28 12:15:12 +08:00
seatea 7398526abc Fix pylint warning for test cases of optimizer, infer, parse and 
pynative.
 2020-05-28 11:35:33 +08:00
xiefangqi 5e4728c50f add voc support split 2020-05-28 11:18:32 +08:00
lihongkang a36880f0ef add vms for reducealld etc. 2020-05-28 11:00:02 +08:00
liuwenhao4 a7ad0d0a49 Fixing some tiny faults about Pylint in my code(ops) 2020-05-28 09:52:42 +08:00
mindspore-ci-bot fb7e4eac76 !1535 change hook function grad input to tuple 
Merge pull request !1535 from wangqiuliang/change-hook-grad-input-to-tuple
 2020-05-28 09:36:28 +08:00
mindspore-ci-bot ff4e4c2ee2 !1533 Fix pylint warning for pynative test cases 
Merge pull request !1533 from seatea/fix-pylint-warning-for-pynative-mode
 2020-05-28 08:11:42 +08:00
mindspore-ci-bot 0fe3ff2761 !1506 Setting auto parallel flag for dataset wrap cell 
Merge pull request !1506 from yangzhenzhang/set-auto-parallel-for-dataset-wrap
 2020-05-27 21:50:43 +08:00
mindspore-ci-bot 77547cdfc0 !1530 support tensor set item the number value type is similar as tensor dtype 
Merge pull request !1530 from zhangbuxue/support_tensor_getitem_number_value_type_similar_as_tensor_dtype
 2020-05-27 21:29:24 +08:00
mindspore-ci-bot 906389b3a7 !1382 support create new item when dictionary set item key not exist 
Merge pull request !1382 from amongo/DictionarySupportSetNewItem
 2020-05-27 21:08:39 +08:00
kingfo 8f7e571a0b change hook grad input to tuple 2020-05-27 20:34:07 +08:00
mindspore-ci-bot df347785c3 !1508 add op BitwiseAnd BitwiseOr BitwiseXor vm 
Merge pull request !1508 from zhaozhenlong/op/bitwise-and-or-xor
 2020-05-27 20:05:23 +08:00
candanzg 2429da19fb implicit type conversion 
Signed-off-by: candanzg <zhangshucheng@huawei.com>
 2020-05-27 20:04:52 +08:00
seatea 21ab029227 Fix pylint warning for files under `pynative_mode` directory. 2020-05-27 19:28:31 +08:00
mindspore-ci-bot c8b30f9290 !1504 add custom tbe ops for quant aware training 
Merge pull request !1504 from wandongdong/master
 2020-05-27 19:18:22 +08:00
buxue d226a23b65 support tensor set item the number value type is similar as tensor dtype not same 2020-05-27 18:08:10 +08:00
wandongdong d35c41e737 add custom tbe ops for quant aware training 2020-05-27 17:09:34 +08:00
mindspore-ci-bot 9c20b1d6f7 !1512 fix reshape reshape case 
Merge pull request !1512 from yao_yf/fix_reshape_reshape_graph
 2020-05-27 16:08:25 +08:00
zhaozhenlong 6fa2813945 add op BitwiseAnd BitwiseOr BitwiseXor 2020-05-27 16:00:25 +08:00
mindspore-ci-bot b46ad9a1bb !1398 Update the bert scripts according to rules of modelzoo 
Merge pull request !1398 from chenhaozhe/update_bert_script
 2020-05-27 15:55:09 +08:00
yangzhenzhang 2f8516e5d7 set auto parallel for dataset warp cell 2020-05-27 15:27:22 +08:00
mindspore-ci-bot ad279e90fd !1407 support mixed tensor index for tensor get item and set item and support in operator. 
Merge pull request !1407 from zhangbuxue/support_mixed_tensor_for_tensor_get_item_and_tensor_set_item
 2020-05-27 14:49:21 +08:00
chenhaozhe b6aceddeab update bert scripts according to rules of modelzoo 2020-05-27 14:27:09 +08:00
yao_yf 96c9569dca fix reshape reshape case 2020-05-27 14:25:40 +08:00
mindspore-ci-bot 2e684e89e7 !1446 pylint clean 
Merge pull request !1446 from liuxiao78/master
 2020-05-27 14:15:14 +08:00
mindspore-ci-bot 5b9c145ff8 !1383 keep different attributes for cnode evaluation 
Merge pull request !1383 from amongo/KeepPrimAttrInCNode
 2020-05-27 13:02:34 +08:00
mindspore-ci-bot 2eedd32120 !1472 add operator HostAllGather and HostReduceScatter 
Merge pull request !1472 from yihuaijie/master
 2020-05-27 11:41:45 +08:00
buxue 7ae289a197 Support mixed tensor for tensor getitem or setitem. 2020-05-27 11:19:51 +08:00
huangdongrun e9aa280f86 add support for dictionary set item which does not exist 2020-05-27 11:19:20 +08:00
mindspore-ci-bot b94949ea99 !1477 support vm for SpaceToBatchND and BatchToSpaceND 
Merge pull request !1477 from jiangjinsheng/BatchToSpaceND
 2020-05-27 10:29:43 +08:00
mindspore-ci-bot 4e8e82f24a !1457 fix 3 bug reports for split 
Merge pull request !1457 from Peilin/splitOp-after-testing
 2020-05-27 10:08:57 +08:00
jiangjinsheng a45dfca142 support BatchToSpaceND and SpaceToBatchND 2020-05-27 09:13:12 +08:00
Peilin Wang d4c93575e7 fixed bug for split, RandomSampler and some other cleanup 
add another test case

typo

merge conflict

another PR changed testing behavior, updated test cases in this commit

added input check for use_sampler

addressed code review comments

fixed pylint, not related to my changes
 2020-05-26 16:29:52 -04:00
yangzhenzhang 7c237620ba add sigmoid op 2020-05-26 21:33:32 +08:00
huangdongrun 334d038008 add support for multi switch 
resolve review
 2020-05-26 21:20:29 +08:00
“liuxiao” 73a287e5e0 pylint clean 2020-05-26 19:46:14 +08:00
“liuxiao” ebbccca78b pylint clean 2020-05-26 19:36:54 +08:00
“liuxiao” f4542f810b pylint clean 2020-05-26 19:11:12 +08:00
Yi Huaijie 2f8e7ff693 add operator HostAllGather and HostReduceScatter 2020-05-26 17:41:20 +08:00
huangdongrun 1159f2b11e add prim infer attr cache 
modify infer to get abstract value and attr value map together

support get attr in specialize

clone primitive when specialize if attribute is not the same with
infered attribute
 2020-05-26 16:19:58 +08:00
zhaozhenlong 55d1927534 add op scatter add vm 2020-05-26 12:17:23 +08:00
mindspore-ci-bot 831ceba6eb !1277 Fixing some tiny faults about Pylint in ME code 
Merge pull request !1277 from liuwenhao/master
 2020-05-26 11:08:10 +08:00
Yang abca62f407 10:00 26/5 clean pylint 2020-05-26 10:05:12 +08:00
mindspore-ci-bot 93fc82b8f7 !1447 remove unused variable 
Merge pull request !1447 from yihuaijie/master
 2020-05-26 09:17:48 +08:00
mindspore-ci-bot 0b191615a9 !1427 fix check bprop attr error 
Merge pull request !1427 from panyifeng/fix_check_bprop_attr_error
 2020-05-26 09:10:51 +08:00
mindspore-ci-bot 0a8ef2fe72 !1455 Cleanup dataset UT: restore config support 
Merge pull request !1455 from cathwong/ckw_dataset_config_util
 2020-05-26 05:40:39 +08:00
Cathy Wong f891e1755c Cleanup dataset UT: restore config support 2020-05-25 15:10:03 -04:00
mindspore-ci-bot aeb4c52f2d !1379 Creating new UTs to three vision transformation ops 
Merge pull request !1379 from Tinazhang/linearTrans
 2020-05-25 23:10:30 +08:00
liuwenhao4 f3f0cbaeee Fixing some tiny faults about Pylint in my code(ops) 2020-05-25 21:27:45 +08:00
“liuxiao” 382a0124c3 pylint clean 2020-05-25 21:16:04 +08:00
mindspore-ci-bot 44bf7c9330 !1414 fix issue use reshape as flatten grad impl 
Merge pull request !1414 from zhaozhenlong/fix-issues-reshape-replace-flattern-grad
 2020-05-25 20:45:46 +08:00
Yi Huaijie ac484ebbc0 remove unused variable 2020-05-25 19:59:28 +08:00
“liuxiao” 18f0af0529 pylint clean 2020-05-25 19:49:06 +08:00
mindspore-ci-bot 1c8548adb8 !1300 Add TBE op RangeD for GE. 
Merge pull request !1300 from liuxiao/RangeD
 2020-05-25 17:04:53 +08:00
zhaozhenlong 30b93ecbf8 use reshape as flatten grad 2020-05-25 16:57:26 +08:00
panyifeng 6a57eeb922 fix check_bprop attr error 2020-05-25 16:52:30 +08:00
Yi Huaijie 0b137e5312 delete unused arguments in test cases 2020-05-25 15:46:05 +08:00
liuxiao 627724a205 Add RangeD for GE 2020-05-25 14:49:49 +08:00
Yi Huaijie 8cfc05e4cf clean pylint warnings of parallel test cases 2020-05-25 11:08:29 +08:00
mindspore-ci-bot 0e665616f0 !1160 add backward hook and custom bprop in pynative mode 
Merge pull request !1160 from wangqiuliang/add-backward-hook-in-pynative-mode
 2020-05-24 18:09:48 +08:00
kingfo 840922e501 add backward hook function in pynative mode 2020-05-24 13:32:44 +08:00
mindspore-ci-bot 718a96430f !1389 Security issues in recent string tensor PR 
Merge pull request !1389 from h.farahat/fix_security_issues
 2020-05-24 08:45:21 +08:00
mindspore-ci-bot a6b8451a33 !1380 make ShuffleOp have deterministic behavior for subsequent epochs 
Merge pull request !1380 from Peilin/shuffle-subsequent-epoch-deterministic
 2020-05-23 21:02:30 +08:00
mindspore-ci-bot ad9db524bb !1394 Fix comment error and mod parameter check in graphdata 
Merge pull request !1394 from heleiwang/fix_comments_error
 2020-05-23 19:47:19 +08:00
heleiwang f28f883cac fix comments error and modify parameter check 2020-05-23 18:31:13 +08:00
mindspore-ci-bot e87e6b38b0 !1355 [AutoParallel]Fix GatherV2 distributed op 
Merge pull request !1355 from lichen/fix_gatherv2
 2020-05-23 17:04:41 +08:00
lichenever 390a86effb fix gatherv2 2020-05-23 15:38:50 +08:00
hesham c0f0e154f5 Clean up work for text python package 2020-05-22 23:53:34 -04:00
mindspore-ci-bot 45368a86e9 !1329 Put the parameter validation of the Summary operator into the python layer 
Merge pull request !1329 from ougongchang/master
 2020-05-23 11:41:34 +08:00
jonyguo 78cc0d5d8d Merge branch 'incubator-master' into sync_d9c74e0a 2020-05-23 11:03:41 +08:00
mindspore-ci-bot 41456ac824 !1369 dataset: delete StorageDataset 
Merge pull request !1369 from ms_yan/del_storage
 2020-05-23 10:39:34 +08:00
Tinazhang 7322839b04 add UTs for LinearTransformation, ToPIL, ToType 2020-05-22 18:04:09 -04:00
Peilin Wang 0cbcc7200b made shuffle determinisitc for subsequent epochs 2020-05-22 17:03:19 -04:00
mindspore-ci-bot 61639be1e0 !1375 Cleanup dataset UT: remove num_parallel_workers=1 in test_exception 
Merge pull request !1375 from cathwong/ckw_dataset_ut_cleanup5
 2020-05-22 23:54:52 +08:00
mindspore-ci-bot a528797253 !1377 Code Fix for Uniform Augmentation 
Merge pull request !1377 from Tinazhang/cc
 2020-05-22 23:20:01 +08:00
mindspore-ci-bot 458436186c !1365 Clean up work for text python sub-package 
Merge pull request !1365 from h.farahat/text_namespace
 2020-05-22 23:16:31 +08:00
Tinazhang b390883c6a Bug fix 2020-05-22 10:56:56 -04:00
Cathy Wong 702005d403 Cleanup dataset UT: remove num_parallel_workers=1 in test_exception 2020-05-22 09:28:17 -04:00
ougongchang 7d78b5d89e Put the parameter validation of the Summary operator into the python layer 
add some unittest for summary operator

support ScalarSummary to record number type
 2020-05-22 21:23:43 +08:00
ms_yan d5e896b51c delete storageDataset Op API and its test case 2020-05-22 21:23:24 +08:00
mindspore-ci-bot 6f733ec113 !1308 Stage 2 of adding support for string Tensor 
Merge pull request !1308 from h.farahat/string_tensor2
 2020-05-22 21:17:53 +08:00
xiefangqi 34236ce1f1 fix pylint 2020-05-22 20:18:21 +08:00
mindspore-ci-bot d402b94476 !1370 delete parallel end-to-end test cases 
Merge pull request !1370 from yihuaijie/master
 2020-05-22 20:01:49 +08:00
mindspore-ci-bot 3363d4e834 !1249 Add GNN dataset processing API 
Merge pull request !1249 from heleiwang/hlw_gnn_data
 2020-05-22 18:49:36 +08:00
mindspore-ci-bot f3d14fa14b !1363 Restrict tensor get item or set item not support mixed tensor. 
Merge pull request !1363 from zhangbuxue/Not_support_mixed_tensor_as_index_for_tensor_getitem_and_setitem
 2020-05-22 18:04:31 +08:00
Yi Huaijie 1e6ee83874 delete parallel end-to-end test cases 2020-05-22 17:35:18 +08:00
mindspore-ci-bot 3f23aa1d79 !1348 fix pylint warnings of parallel test cases 
Merge pull request !1348 from yihuaijie/master
 2020-05-22 16:40:42 +08:00
hesham 6c21e556c4 Clean up work for text python package 2020-05-22 04:35:58 -04:00
mindspore-ci-bot 368007240c !1320 add applyrmsprop cumprod and reduceprod for vm 
Merge pull request !1320 from JichenZhao/applyrms_squaresumall_cumprod_reduceprod
 2020-05-22 16:33:31 +08:00
mindspore-ci-bot 62c716b68e !1349 Fix some functions in group parameters and optimizer 
Merge pull request !1349 from ghzl/add-group-check-for-lars
 2020-05-22 16:05:36 +08:00
buxue 850171a34b Restrict tensor getitem or setitem not support mixed tensor. 2020-05-22 15:55:38 +08:00
Yi Huaijie 14fe72f383 fix pylint warnings 2020-05-22 14:54:36 +08:00
mindspore-ci-bot bd845dd0b7 !1352 [MD] fix bug when append data in mindrecord using absolute path 
Merge pull request !1352 from liyong126/mindrecord_fix_bug_I1HQUI
 2020-05-22 14:25:15 +08:00
heleiwang 599a449e0b Support processing GNN data 2020-05-22 14:15:25 +08:00
jinyaohui fbdba6e4da clean pylint 2020-05-22 13:23:13 +08:00
hesham df361d1d26 Change mem layout of string tensor 
add support for MindRecord and TFRecord
----
optimize tensorshape

optimize tensorshape and FlatIndex

TFRecord and MindRecord support for string tensor

Modify mem layout
Add new constructor
Add method Allocate

Change some GetMutableBuffer usages to AllocateBuffer
 2020-05-22 01:22:29 -04:00
liyong 447420eb9a fix bug when append data by absolute path 2020-05-22 11:27:56 +08:00
guohongzilong 2d2f9ba8fd fix group parameter code for check 2020-05-22 11:05:45 +08:00
zhaojichen a42ec8f69f add applyrmsprop op for vm 2020-05-21 23:02:32 -04:00
mindspore-ci-bot 58e6d7d950 !1341 Added lookup and vocab to mindspore.dataset.text 
Merge pull request !1341 from ZiruiWu/vocab_and_lookup
 2020-05-22 10:19:42 +08:00
mindspore-ci-bot decf12cd0b !1317 [MD]add compress for nlp data in mindrecord 
Merge pull request !1317 from liyong126/mindrecord_compress
 2020-05-22 10:05:09 +08:00
mindspore-ci-bot 274f6f014f !1133 support tensor get value by tensor index 
Merge pull request !1133 from zhangbuxue/support_tensor_get_value_by_tensor_index
 2020-05-22 10:02:35 +08:00
mindspore-ci-bot 0a795c24aa !1245 add model init api to compile df graph before train 
Merge pull request !1245 from wangnan39/add_model_init_api_to_compile_df_graph_before_train_and_eval
 2020-05-22 09:51:19 +08:00
jonwe bb51bb88d7 add compress in mindrecord 2020-05-22 09:37:51 +08:00
mindspore-ci-bot 2e3d55ed87 !1281 Implementation of SplitOp 
Merge pull request !1281 from Peilin/splitOp
 2020-05-22 09:29:03 +08:00
mindspore-ci-bot 39b9aedf68 !1342 Bug fix on issue Core dump on GPU when train with lenet with AU 
Merge pull request !1342 from Tinazhang/cc
 2020-05-22 09:18:49 +08:00
mindspore-ci-bot 0ca626ef6c !1229 Init the slices of a Initializer on different devices 
Merge pull request !1229 from yihuaijie/master
 2020-05-22 08:57:58 +08:00
Peilin Wang 71e8bb1960 general split case done, chaining sampler (basic case) is working 
implementation 99% complete

everything and tested except for repeatable shuffling

tested most basic/typical split usecases

cleanup

some more cleanup

fix CI

more ci fix

more ci fixes

more ci fix

more ci fix

more ci fix

added more tests, fixed some bugs

some more clean up and test cases

added shard/shuffle before split warning/error

addressed code review comments and ci

fixed ci
 2020-05-21 20:42:51 -04:00
Tinazhang e9e40b688b Bug fix 2020-05-21 18:20:00 -04:00
Zirui Wu 25ab2ef303 Implemented lookup and vocab 2020-05-21 17:17:24 -04:00
mindspore-ci-bot 46949fc327 !1307 Cleanup dataset UT: unskip and enhance TFRecord sharding tests 
Merge pull request !1307 from cathwong/ckw_dataset_ut_unskip2
 2020-05-22 03:21:45 +08:00
wangnan39@huawei.com 1ebf98b795 add model init api to compile df graph before exec 2020-05-21 22:21:49 +08:00
buxue e490618db8 support tensor get value by tensor index 
support tensor set value by tensor index
 2020-05-21 21:05:35 +08:00
Yi Huaijie 7a5004cc49 init the slices of a Initialzer on different devices 2020-05-21 20:43:15 +08:00
zhouneng 218ade30b2 add vm support sin and cumsum 2020-05-21 17:26:01 +08:00
mindspore-ci-bot 2224fa093b !1302 Complete vm ops for BinaryCrossEntropy and BinaryCrossEntropyGrad 
Merge pull request !1302 from lihongkang/master
 2020-05-21 17:00:09 +08:00
mindspore-ci-bot b96a2ed816 !1312 support vm for erfc 
Merge pull request !1312 from jiangjinsheng/vm_erfc
 2020-05-21 16:59:56 +08:00
mindspore-ci-bot bddd743ca9 !1304 Add check for controldepend 
Merge pull request !1304 from amongo/AddCheckForControlDepend
 2020-05-21 16:09:46 +08:00
jiangjinsheng 2d3cd8276e vm for erfc 2020-05-21 10:08:23 +08:00
qianlong 451c20a6f5 Add UnicodeCharTokenizer for nlp 2020-05-21 09:22:45 +08:00
mindspore-ci-bot 93e7c97a96 !1272 [Dataset] MindData Tree Optimizer Infrastructure 
Merge pull request !1272 from JunhanHu/minddata_opt
 2020-05-21 05:29:00 +08:00
Cathy Wong b78894e02b Cleanup dataset UT: unskip and enhance TFRecord sharding tests 2020-05-20 17:05:38 -04:00
Junhan Hu f44d213503 MindData optimizer infrastructure. 2020-05-20 16:11:26 -04:00
huangdongrun 3e2074b113 add check for ControlDepend 2020-05-20 22:48:00 +08:00
mindspore-ci-bot 233508b70e !1250 Dict_setitem transofrm to tuple_setitem 
Merge pull request !1250 from amongo/SupportDictSetItemTransform
 2020-05-20 21:37:26 +08:00
lihongkang cf543382aa add vms for binarycrossentropy and binarycrossentropygrad 2020-05-20 20:28:56 +08:00
mindspore-ci-bot 183144e135 !1282 support vm for PReLU and PReLUGrad 
Merge pull request !1282 from jiangjinsheng/vm_prelu
 2020-05-20 17:08:03 +08:00
xulei2020 163b6b7ea7 add jieba c++ code 2020-05-20 15:55:12 +08:00
mindspore-ci-bot 89470cf29d !1263 Modified clip_gradients to clip_grad 
Merge pull request !1263 from Kang/master
 2020-05-20 14:15:05 +08:00
Kang bfff7c0a2f Modified clip_gradients to clip_grad 2020-05-20 11:58:47 +08:00
jiangjinsheng ce09f5e15a vm for prelu and prelugrad 2020-05-20 11:21:56 +08:00
huangdongrun 3cf94daefc add support for dict setitem operation 
format code

remove save_graph

raise exception when dictionary setitem if the key not exists

resolve error

remove unnessary op_
 2020-05-20 09:58:30 +08:00
jiangjinsheng ba99cb7bcb support vm for space_to_depth 2020-05-20 09:47:12 +08:00
Tinazhang 17cecf2cf5 Added TCs to RandomCrop and RandomCropAndResize and modified visalize() calling 2020-05-19 15:42:24 -04:00
mindspore-ci-bot fe8b59f26b !1111 support vm for pack and unpack 
Merge pull request !1111 from jiangjinsheng/vm_pack
 2020-05-19 21:36:16 +08:00
Wei Luning 3db8cfa54f add pattern AdjustAllReduceMulAdduse the old opadd test case for bugtemp fix try 2020-05-19 18:46:11 +08:00
jiangjinsheng f9bd460c96 support vm for pack 2020-05-19 16:52:41 +08:00
mindspore-ci-bot 18c9495000 !1228 Adapt tbe op UnsortedSegmentMin for GE. 
Merge pull request !1228 from liuxiao/UnsortedSegmentMin
 2020-05-19 09:04:22 +08:00
liuxiao cc024bb3a1 UnsortedSegmentMin for GE 2020-05-18 20:49:58 +08:00
zhaojichen d1d1766bed add squaresumall op 2020-05-18 08:01:22 -04:00
mindspore-ci-bot 1b7cdc4c61 !1218 clean pylint warning in test about import 
Merge pull request !1218 from jinyaohui/pylint1
 2020-05-18 19:54:04 +08:00
jinyaohui 5a914994ba clean pylint 2020-05-18 16:42:35 +08:00
yangzhenzhang 6b54a6417d ckpt and restore parameter shape 2020-05-18 15:16:29 +08:00
jinyaohui bcfaff97f9 clean pylint 2020-05-18 10:31:46 +08:00
mindspore-ci-bot 051567ba20 !1192 Support string type Stage ! 
Merge pull request !1192 from h.farahat/string_Tensor
 2020-05-18 09:51:17 +08:00
mindspore-ci-bot 4efa9717bb !1129 Add op bounding box encoder 
Merge pull request !1129 from zhaozhenlong/op/bounding-box-encoder
 2020-05-18 09:04:59 +08:00
mindspore-ci-bot 6de7eb2633 !1203 delete ApplyAdamD for master 
Merge pull request !1203 from changzherui/code516
 2020-05-17 20:14:06 +08:00
changzherui 1e93927772 code 516 for test 2020-05-17 15:28:17 +08:00
mindspore-ci-bot c3d9f18087 !1176 fix validator for transpose 
Merge pull request !1176 from jiangjinsheng/issue_transpose
 2020-05-16 19:10:35 +08:00
mindspore-ci-bot c169ac6a18 !1195 add validate for geswitch and merge 
Merge pull request !1195 from jiangjinsheng/issue_geswitch
 2020-05-16 18:43:19 +08:00
jiangjinsheng e45532b78c fixed transpose 2020-05-16 18:07:52 +08:00
jiangjinsheng c05203ef06 add validate for geswitch and merge 2020-05-16 17:49:21 +08:00
mindspore-ci-bot 0040764dec !1100 delete some context param(enable_loop_sink,enable_mem_reuse,enable_auto_mixed_precision) 
Merge pull request !1100 from jinyaohui/context_opt_2
 2020-05-16 15:38:40 +08:00
jinyaohui 2907cf4488 remove some context param 2020-05-16 15:07:13 +08:00
zhaozhenlong b54ffdc086 add op BoundingBoxDecode 
iou

NMSWithMask

larsupdate testcase

sgd testcase
 2020-05-16 02:40:16 -04:00
mindspore-ci-bot 92d196f054 !1178 Complete vm ops for ROIAlign and ROIAlignGrad 
Merge pull request !1178 from zhouneng/add_vm_support_roialign
 2020-05-16 11:15:13 +08:00
hesham e8ca243364 -Add DE_STRING 
-replace switch'case by indexing

- Add test case
- Add constructors
- Add getItem string

- Fix bugs
- Add more tests

- Tensor iterator
- asNumpy
- TextFileDataset

- Tensor(Numpy)

- Super > 2D
- Add more test cases for GeneratorDataset

- Change StartAddr to GetBuffer and GetMutableNuffer

- Raise an error if batch is used with strings

Clean-up work
 2020-05-15 20:33:28 -04:00
jiangzhiwen cb2814b498 flat_map first commit 2020-05-15 17:45:39 +08:00
mindspore-ci-bot c680cfbf27 !1157 dataset: add concat operation for dataset 
Merge pull request !1157 from ms_yan/concat_dataset
 2020-05-15 16:07:19 +08:00
mindspore-ci-bot ab031ee9ea !1126 VOCDataset support object detection function 
Merge pull request !1126 from xiefangqi/voc_support_detection
 2020-05-15 15:56:39 +08:00
zhouneng c2a1b5f8c1 add register info for ROIAlign and ROIAlignGrad 2020-05-15 14:58:33 +08:00
xiefangqi c937bad53f minddata support voc 2020-05-15 13:24:03 +08:00
ms_yan c0fa7b4b19 init commit of concat dataset 
change to use __add__ operation instead ds.concat
 2020-05-15 13:14:13 +08:00
jiangjinsheng 766906dd6d support vm for flatten 2020-05-15 10:30:58 +08:00
mindspore-ci-bot 8a853cec2d !1171 adjust onnx related testcases 
Merge pull request !1171 from fary86/adjust_onnx_related_uts
 2020-05-15 09:46:11 +08:00
mindspore-ci-bot bb374ebc28 !1015 Support weights to be compiled according to shape 
Merge pull request !1015 from candanzg/me_with_shape
 2020-05-15 09:13:41 +08:00
fary86 fe2ee14340 Adjust onnx exporting related testcases 2020-05-15 03:21:29 +08:00
mindspore-ci-bot a9816fa779 !1026 Add Logsigmoid and Reduce_logsumexp 
Merge pull request !1026 from peixu_ren/custom_pp_ops
 2020-05-14 22:02:58 +08:00
jonyguo be2e7531ca fix: MindDataset parameter shard_id & num_shards check 2020-05-14 17:18:11 +08:00
panyifeng 755ba75deb fix pylint 2020-05-14 14:22:52 +08:00
mindspore-ci-bot 4bb5c7b39a !1084 add new interface quant combined 
Merge pull request !1084 from SanjayChan/04quant
 2020-05-14 11:19:00 +08:00
peixu_ren 99fda6f431 Add logsigmoid and reduce_logsumexp 2020-05-13 23:52:10 -03:00
mindspore-ci-bot a2a3b1c6c5 !1089 Add Optimizer method get_lr_parameter 
Merge pull request !1089 from ghzl/add-get-lr-base-on-parameter
 2020-05-14 09:40:31 +08:00
Cathy Wong 913074e656 Cleanup dataset UT: resolve skipped test units 2020-05-13 14:41:57 -04:00
mindspore-ci-bot 6b68671805 !1069 Use a resident process to write summary files and SummaryRecord as context manager 
Merge pull request !1069 from 李鸿章/context_manager
 2020-05-13 22:44:39 +08:00
李鸿章 32c1d558f4 SummaryRecord as context manager 2020-05-13 21:53:24 +08:00
mindspore-ci-bot 7e3ec651dc !1094 Complete vm ops for L2Normalize and L2NormalizeGrad 
Merge pull request !1094 from zhouneng/add_vm_support_l2normalize
 2020-05-13 21:52:45 +08:00
candanzg 2cc85bdc93 Support weight compile according to shape 
Signed-off-by: candanzg <zhangshucheng@huawei.com>
 2020-05-13 17:49:07 +08:00
mindspore-ci-bot 21bcdcd8ad !1121 Complete vm ops for ResizeBilinear and ResizeBilinearGrad 
Merge pull request !1121 from lihongkang/master
 2020-05-13 17:43:04 +08:00
chenzomi 1239cd6135 Merge branch 'master' into 04quant 2020-05-13 17:31:50 +08:00
guohongzilong e70b2f5430 add optimizer.get_lr_parameter() method 2020-05-13 17:21:22 +08:00
chenzomi bf6246e617 add quant combined 2020-05-13 17:05:45 +08:00
mindspore-ci-bot 1a98c6b459 !999 [MD] mindrecord support reading file list 
Merge pull request !999 from liyong126/mindrecord_file_list
 2020-05-13 15:53:26 +08:00
mindspore-ci-bot 25b2424f9b !1042 clean pylint warning in test_framwork dir 
Merge pull request !1042 from jinyaohui/clean_pylint
 2020-05-13 14:51:36 +08:00
lihongkang ca8a914736 接入算子resizebilinear and resizebilineargrad 2020-05-13 14:27:35 +08:00
mindspore-ci-bot 6f386c5782 !1082 Support 'break', 'continue' and 'pass' statements 
Merge pull request !1082 from hewei/support_cont_break
 2020-05-13 14:19:28 +08:00
liyong aa3f89e74f mindrecord support read file list 2020-05-13 14:11:59 +08:00
He Wei 33fa90efc9 Support 'break', 'continue' and 'pass' 
To handle 'break' and 'continue' statement, a loop context is pushed
to a stack before we parse the loop body, and pop it after body parsed.
When a 'break', 'continue' statement is encountered, we retrieve current
loop contex from the stack, and let the current block jump to the end
block or header block;

For 'break' statement, we added an extra 'end_block' follow the 'after_block',
because 'after_block' is called from a ContionalJump in 'header_block', it can
not be set as jump target from other place. to support 'break', we let loop
body jump to the 'end_block' at the 'break' point. and 'after_block'
maybe a good place to handle loop 'else' clause in the future.

Handle 'pass' is simple, just bypass it when doing parse.
 2020-05-13 12:53:07 +08:00
mindspore-ci-bot 0345995000 !1110 [AutoParallel]fix gatherv2 and dataset bug 
Merge pull request !1110 from lichen/fix_gatherv2_and_dataset_bug
 2020-05-13 11:42:09 +08:00
jinyaohui 26fd75895d pylint waring clean 2020-05-13 11:30:27 +08:00
mindspore-ci-bot 18019ad6a5 !1038 clean some context param 
Merge pull request !1038 from jinyaohui/clean_context
 2020-05-13 09:54:43 +08:00
lichenever debfd38b75 fix gatherv2 and dataset bug 2020-05-13 09:44:37 +08:00
mindspore-ci-bot ba3d48817e !1070 Adapt aicpu op CTCLoss and TBE op L2Loss for GE. 
Merge pull request !1070 from liuxiao/ops-for-VM
 2020-05-13 09:43:42 +08:00
jinyaohui 391a060f21 remove two context param 2020-05-12 22:11:50 +08:00
mindspore-ci-bot 48e54dcfda !1056 [Auto parallel] Memory calculation in the inference phase 
Merge pull request !1056 from Xiaoda/memory-estimation-in-inference-phase
 2020-05-12 17:21:05 +08:00
zhouneng 79725af4cd 为L2Normalize/L2NormalizeGrad增加VM支持 2020-05-12 16:46:02 +08:00
liuxiao 10abb68498 add ops CTCLoss 2020-05-12 15:58:51 +08:00
mindspore-ci-bot fdad91355f !1093 reset parallel context before running each parallel test case 
Merge pull request !1093 from yihuaijie/master
 2020-05-12 15:57:55 +08:00
mindspore-ci-bot da7d605e85 !683 WIP: specialize hyper map parameter 
Merge pull request !683 from xychow/bypass-renorm-and-specialize-hypermap-parameter
 2020-05-12 15:50:00 +08:00
mindspore-ci-bot 6ab046e4dd !1062 Adapt Softplus\SoftplusGrad for VM, and ApplyFtrlD for both GE and VM. 
Merge pull request !1062 from liuxiao/softplus-softplusgrad
 2020-05-12 15:35:56 +08:00
Xiaoda Zhang a05aa21cc2 calculating PEAK memory cost in the inference phase 2020-05-12 15:30:59 +08:00
mindspore-ci-bot 06a9eeb3bf !1050 [bug][auto_mixed_precision]fix sens shape error of `TrainOneStepWithLossScaleCell` 
Merge pull request !1050 from vlne-v1/I1GEPN-check-bprop-error-loss-scale-wrap
 2020-05-12 15:23:46 +08:00
Yi Huaijie 462f30e077 reset auto parallel context before each test 2020-05-12 14:59:45 +08:00
mindspore-ci-bot 98112d1a64 !997 support vm for log1p 
Merge pull request !997 from jiangjinsheng/log1p
 2020-05-12 14:21:14 +08:00
Wei Luning 3e89f7baaa fix sens shape error in loss_scale one_step_wrap 2020-05-12 14:09:51 +08:00
mindspore-ci-bot 28a6daaed5 !1017 add profiling_mode and profiling_options to context 
Merge pull request !1017 from jinyaohui/context_opt
 2020-05-12 11:55:14 +08:00
jiangjinsheng c36e7f1564 support vm for log1p 2020-05-12 11:46:18 +08:00
mindspore-ci-bot 8003a89a7b !766 bugfix(SA): Add the support of nested loop. 
Merge pull request !766 from gongchen/nest_loop
 2020-05-12 11:10:53 +08:00
mindspore-ci-bot fd72534a1c !1065 Seperate lr groups and weight_decay groups 
Merge pull request !1065 from ghzl/improve-parameter-groups
 2020-05-12 10:13:05 +08:00
mindspore-ci-bot 4fe6ddebd1 !1075 Cleanup dataset UT: util.py internals 
Merge pull request !1075 from cathwong/ckw_dataset_ut_cleanup3
 2020-05-12 09:58:14 +08:00
jinyaohui 5a9de3716d add profiling mode and profiling options to context 2020-05-12 09:53:08 +08:00
zhousiyi 047ac018da specialize hypermap paramater 2020-05-12 01:51:57 +00:00
mindspore-ci-bot 4a8fcf5d76 !1055 support vm for floor 
Merge pull request !1055 from jiangjinsheng/vm_floor
 2020-05-12 09:20:16 +08:00
mindspore-ci-bot 05e8b8028b !1060 Fix bug of assigning value to non-Parameter class member 
Merge pull request !1060 from fary86/fix_assign_target_not_parameter
 2020-05-12 09:20:08 +08:00
mindspore-ci-bot 66667d727e !1034 Gpu Support Dropout operator 
Merge pull request !1034 from SanjayChan/dropout
 2020-05-12 09:11:30 +08:00
Cathy Wong 49ef53f164 Cleanup dataset UT: util.py internals 2020-05-11 14:44:24 -04:00
mindspore-ci-bot 2af6ee2482 !1054 Add slice shape for param info 
Merge pull request !1054 from yangzhenzhang/add-slice-shape-for-param-info
 2020-05-11 21:29:40 +08:00
guohongzilong c95215bca0 seperate lr groups and weight_decay groups 2020-05-11 21:27:30 +08:00
liuxiao 4335e9bc83 adapt Softplus\SoftplusGrad\ApplyFtrlD for VM 2020-05-11 20:45:12 +08:00
fary86 16b9004d53 Fix bug of assign value to non Parameter class member 2020-05-11 20:15:34 +08:00
mindspore-ci-bot 5ff79d0204 !1048 Support index to switch_layer 
Merge pull request !1048 from panyifeng/index_to_switch_case
 2020-05-11 19:30:13 +08:00
chenzomi 661f9dfaf8 add dropout primtive 2020-05-11 19:29:18 +08:00
mindspore-ci-bot 57085bb18d !996 [Auto parallel] Supporting VirtualDataset having three inputs 
Merge pull request !996 from Xiaoda/supporting-virtualdataset-has-three-inputs
 2020-05-11 18:59:09 +08:00
jiangjinsheng 2fa654e65c support vm for floor 2020-05-11 16:17:20 +08:00
yangzhenzhang 05fde3d23d add slice shape for param info 2020-05-11 16:01:55 +08:00
panyifeng 065e25e1bb Support index to switch_layer 2020-05-11 15:52:30 +08:00
yao_yf 716def7c0a move InferStraByTensorInfo to tensor_info.h 2020-05-11 14:44:06 +08:00
mindspore-ci-bot dd2062bf8d !1023 add_gatherv2_distributed_op 
Merge pull request !1023 from lichen/add_gatherv2_distributed_op
 2020-05-11 09:18:10 +08:00
mindspore-ci-bot 8a45ab1125 !906 fix a bug that support dilation greater than 1 in conv2dTranspose ops 
Merge pull request !906 from yangyongjie/master
 2020-05-09 21:58:27 +08:00
mindspore-ci-bot 22632f2f09 !977 reshape operator support auto strategy search 
Merge pull request !977 from yao_yf/reshape_auto_parallel_strategy_search
 2020-05-09 17:47:24 +08:00
lichenever 19a24b86ac add gatherv2 distributed op 2020-05-09 17:20:50 +08:00
mindspore-ci-bot 68372231bb !1031 Support transform valuetuple of nested graph to make tuple 
Merge pull request !1031 from amongo/ValueTupleOfNestedGraph
 2020-05-09 17:15:54 +08:00
yao_yf f0bf438a55 reshape strategy search 2020-05-09 17:00:37 +08:00
gongchen 425a207663 bug(SA): Add the support of nested loop. 2020-05-09 16:18:16 +08:00
guohongzilong 0b8cea8018 learning rate and weight decay support group mode 2020-05-09 15:57:58 +08:00
huangdongrun 0e89813759 add resolve 
transform valuetuple to maketuple of graphs

add testcase
 2020-05-09 14:30:19 +08:00
mindspore-ci-bot affdd22de3 !967 Add switch_case primitive 
Merge pull request !967 from panyifeng/switch_case_primitive
 2020-05-09 14:14:25 +08:00
Xiaoda Zhang 5e041966f1 add a new vritualdataset cell for three inputs 2020-05-09 11:10:33 +08:00
mindspore-ci-bot 0eb32593a6 !958 Add parallel mode configuration for cell 
Merge pull request !958 from yangzhenzhang/add_parallel_mode_for_cell
 2020-05-09 09:45:25 +08:00
panyifeng b7596e1f33 Add switch_case primitive 2020-05-09 09:38:17 +08:00
mindspore-ci-bot 2860fd9338 !984 Add unit test case for HWC2CHW. 
Merge pull request !984 from Tinazhang/hwc2chw
 2020-05-09 05:02:41 +08:00
Tinazhang c8b5586c7f add unit test for HWC2CHWC 2020-05-08 13:17:20 -04:00
Cathy Wong 58226addd6 Cleanup dataset UT: use md5 npz in test_zip for images 2020-05-08 11:25:48 -04:00
mindspore-ci-bot 47f5abceb4 !960 Adding example for grayscale 
Merge pull request !960 from EricZ/grayscale_fix
 2020-05-08 05:08:15 +08:00
mindspore-ci-bot 078dd86cfe !507 Implemented padded_batch 
Merge pull request !507 from ZiruiWu/batch_with_padding
 2020-05-08 04:54:05 +08:00
mindspore-ci-bot de7625777f !951 fix: MindDataset with columns_name parameter cause errors in some scenes 
Merge pull request !951 from guozhijian/fix_read_by_columns
 2020-05-08 04:51:03 +08:00
eric 0f0548f21b Added test case for grayscale support 2020-05-07 15:09:57 -04:00
Zirui Wu c2d364a573 batch with padding implemented 
support for 1 specific dimension to be None, added validator

fix various CI complains

another round of CI fixes

ci

refactor parts of the code

code refactor

ci fix

comments added, fix bugs

address review comments

address review comments

review cmts

added simple perf test script

update pad code

perf imprv
 2020-05-07 11:18:42 -04:00
mindspore-ci-bot 16930c562d !969 [MD] fix bug in pk sampler of minddataset 
Merge pull request !969 from liyong126/fix_mindrecord_pk_sampler
 2020-05-07 23:01:46 +08:00
liuxiao e97d33f772 add ops for VM 2020-05-07 20:14:18 +08:00
yangzhenzhang 8c9730b3c5 add parallel mode for cell 2020-05-07 20:11:20 +08:00
mindspore-ci-bot 7c64048d76 !935 develop op ScatterMax and dock ge process 
Merge pull request !935 from zhangbuxue/develop_scatter_max_op_and_dock_ge
 2020-05-07 19:35:57 +08:00
mindspore-ci-bot becaf39262 !957 complete vm ops for BatchToSpace and SpaceToBatch 
Merge pull request !957 from jiangjinsheng/space_to_batch
 2020-05-07 19:11:32 +08:00
buxue ac86996746 develop op ScatterMax and dock ge process 2020-05-07 18:58:11 +08:00
jonyguo d4d236bcce fix: use MindDataset by column_names get data error in some situation 2020-05-07 18:12:36 +08:00
mindspore-ci-bot 6351f9c837 !859 [Auto parallel] Support searching strategy for inference phase 
Merge pull request !859 from Xiaoda/support-inferring-phase-parallel-strategy-searching
 2020-05-07 17:38:14 +08:00
mindspore-ci-bot e75d75854d !959 Add Elu\EluGrad ops for VM. 
Merge pull request !959 from liuxiao/ops-for-VM
 2020-05-07 16:26:41 +08:00
mindspore-ci-bot deae380969 !637 Learning rate and weight decay making group params 
Merge pull request !637 from ghzl/learning-rate-make-group-mode
 2020-05-07 15:34:10 +08:00
jiangjinsheng a945299e42 update test for batch_to_space 2020-05-07 15:21:33 +08:00
liyong b520ca9087 fix pk sampler in mindrecord 2020-05-07 14:54:23 +08:00
Xiaoda Zhang def8573275 implementing-searching-strategy-for-inference 2020-05-07 14:53:50 +08:00
jiangjinsheng 79a3f0821a add vm for batch_to_space and space_to_batch 2020-05-07 10:49:30 +08:00
liuxiao eba74ca8f7 add ops for VM 2020-05-07 10:44:51 +08:00
guohongzilong 824bc30a94 learning rate and weight decay support group mode 2020-05-07 09:38:03 +08:00
mindspore-ci-bot 3d3b9d5474 !840 [BUG] fix conv2dtranspose bug 
Merge pull request !840 from jinyaohui/conv2dtranspose
 2020-05-06 16:43:28 +08:00
jinyaohui 88e763a98f modify conv2dtranspose 2020-05-06 10:53:36 +08:00
mindspore-ci-bot 108ef72aaf !904 fix avgpool and add dimension check for groupnorm 
Merge pull request !904 from JichenZhao/groupn
 2020-05-06 10:42:05 +08:00
mindspore-ci-bot cae8a921e3 !929 Cleanup dataset UT: test_batch, save_and_check support 
Merge pull request !929 from cathwong/ckw_dataset_ut_cleanup
 2020-05-06 04:40:26 +08:00
Cathy Wong 772e6c1461 Cleanup dataset UT: test_batch, save_and_check support 2020-05-05 15:35:09 -04:00
changzherui ffcbcc8dcb syn code 505 2020-05-05 22:44:20 +08:00
changzherui 446828f221 modify momentum test 2020-05-05 21:56:13 +08:00
zhaojichen 039c75af8e fix avgpool and add check 2020-05-04 22:28:50 -04:00
eric 36fffb7706 Added example md5 generation 
Comparison example

Added md5 and comparison example for py_transforms

Added md5 check for images
 2020-05-04 21:15:33 -04:00
yangyongjie 3f1c6b7b47 solve the problem when dialtion greater than 1 in Conv2dTranspose ops 2020-05-04 11:55:18 +08:00
Junhan Hu 83c68ca2ef Skip pyfunc test case 2020-05-01 15:14:07 -04:00
mindspore-ci-bot 79f087c2af !909 Adding fix for set seed 
Merge pull request !909 from EricZ/test_random
 2020-05-01 21:13:44 +08:00
mindspore-ci-bot 200b3f0789 !837 add onnx op converter: ReLU6 and DepthwiseConv2dNative 
Merge pull request !837 from chenzupeng/master
 2020-05-01 09:20:38 +08:00
eric 26cb3e8a5f Added test function to show that seed doesn't work. 
Added testcase to show that c image aug don't use seed properly

Added passing test cases

Added working testcases for using seed

Added additional test cases to show seed use

Added test case for seed
 2020-04-30 18:57:59 -04:00
changzherui b323199dc1 syn code 430 2020-04-30 17:55:12 +08:00
mindspore-ci-bot a5b530c427 !857 use parameter name as the key of strategy checkpoint 
Merge pull request !857 from yao_yf/strategy_ckpt_key_to_use_param_name
 2020-04-30 17:12:51 +08:00
zhaozhenlong 4694c979a5 delete pack description about num and add raise error 
SparseApplyAdagrad example format

PReLU and grad state 1-d not supported

atan2 bprop dx dy revert to original shapes
 2020-04-30 16:05:03 +08:00
mindspore-ci-bot 0611c1a579 !849 [CT][MS] Wrong format of broadcast output, when multi-output 
Merge pull request !849 from vlne-v1/I1FQ76-wrong-format-of-boardcast-output-when-multi-output
 2020-04-30 14:27:36 +08:00
mindspore-ci-bot 67f3d0eb5d !871 dataset: repair take op problem when there exist muti-thread in next node 
Merge pull request !871 from ms_yan/take_operator
 2020-04-30 14:08:38 +08:00
chenzupeng a109bc3d96 add onnx op converter: ReLU6, DepthwiseConv2dNative 2020-04-30 12:59:39 +08:00
Wei Luning 157710ca0f bugfix* fix bug in output tuple of tuple.* check kRWWrite input no-variable* input x of ScatterNdUpdate should be a parameter node 2020-04-30 12:00:56 +08:00
mindspore-ci-bot ff1a05d6c8 !882 fix bug of bprop of FloorMod 
Merge pull request !882 from zhangbuxue/fix_bprop_for_floor_mod
 2020-04-30 11:44:49 +08:00
buxue 0c6cf98db0 fix bug of brpop of FloorMod 2020-04-30 11:02:02 +08:00
yao_yf 5a6540450e use param name as the key of strategy checkpoint 2020-04-30 11:01:32 +08:00
ms_yan c56fe3aa2d modify take op with an operator 2020-04-30 10:16:36 +08:00
mindspore-ci-bot 8af10eb51e !875 Reject python OP in operations argument for C++ uniform augmentation OP 
Merge pull request !875 from AdelShafiei/ua_py
 2020-04-30 06:11:17 +08:00
Adel Shafiei d15bd04bfe added input validation to reject python op in C++ uniform augmentation operations list 2020-04-29 16:48:10 -04:00
mindspore-ci-bot a606c2e4da !872 [Dataset] Add schema support for GeneratorDataset 
Merge pull request !872 from JunhanHu/generator_schema
 2020-04-30 02:58:29 +08:00
mindspore-ci-bot 2303453753 !869 Random data op 
Merge pull request !869 from JesseKLee/random_data_op
 2020-04-30 02:56:39 +08:00
Junhan Hu c5a8ffe4f4 Add schema support for GeneratorDataset 2020-04-29 13:50:51 -04:00
Jesse Lee 5236d0c3c0 Replace print with logger.info 2020-04-29 12:44:04 -04:00
mindspore-ci-bot 8d3695f666 !672 Added UT for uniform augmentation C++ OP 
Merge pull request !672 from AdelShafiei/ua_ut
 2020-04-29 23:56:09 +08:00
mindspore-ci-bot 732c7f8266 !794 fix issues image gradients 4d check 
Merge pull request !794 from zhaozhenlong/fix-issues-image-gradients-complement-check
 2020-04-29 22:26:53 +08:00
Jesse Lee 270bf831a9 Random Data Op 2020-04-29 10:26:00 -04:00
mindspore-ci-bot 98939d839c !856 Fix skip op bug 
Merge pull request !856 from jiangzhiwen/dataset/skip_thread
 2020-04-29 21:47:50 +08:00
zhaozhenlong 66e7a36846 ImageGradients check 4d 
fix DiagPart constant folding issue

fix argmin output type check

fix atan2 doc error

fix remove FusedBatchNorm and its grad
 2020-04-29 21:47:33 +08:00
jiangzhiwen 34bfa2f7c9 fix skip 2020-04-29 20:12:37 +08:00
mindspore-ci-bot 8ab5e0118f !829 Add parser of case which parameter in tuple in run_op function 
Merge pull request !829 from ghzl/parser-parameter-in-tuple-in-run_op
 2020-04-29 19:47:46 +08:00
guohongzilong b96df362f8 add parser of case which parameter in tuple in run_op function 2020-04-29 17:55:12 +08:00
mindspore-ci-bot 883fde0494 !839 add parameter verification for RMSprop 
Merge pull request !839 from wangnan39/add_parameter_verification_for_rmsprop
 2020-04-29 17:20:21 +08:00
mindspore-ci-bot 728345fdd0 !841 fix bugs of Acosh bprop and Elu bprop 
Merge pull request !841 from zhangbuxue/adapt_ExtractImagePatches_and_fix_EluGrad
 2020-04-29 17:17:30 +08:00
buxue 064d370a61 fix bug of Acosh bprop and Elu bprop 2020-04-29 16:50:08 +08:00
mindspore-ci-bot 33e427e1c5 !721 Tensor assign by ellipsis 
Merge pull request !721 from candanzg/tensor_assgin_ellipsis
 2020-04-29 16:31:05 +08:00
wangnan39@huawei.com 7f602016f4 add parameter verification for rmsprop, and modify default value in annotation 2020-04-29 16:12:58 +08:00
mindspore-ci-bot 6241814320 !749 fix np.histogram sometimes calc very large bucket number 
Merge pull request !749 from wenkai/wkmaster
 2020-04-29 11:36:11 +08:00
candanzg e886a3182c tensor assign with ellpsis 
Signed-off-by: candanzg <zhangshucheng@huawei.com>
 2020-04-29 11:05:44 +08:00
Adel Shafiei 3322e65da9 added ut for uniform augment C++ op 2020-04-28 21:07:29 -04:00
zhaozhenlong 243cd33203 adapt SparseApplyAdagradD adding output accum 2020-04-28 21:48:04 +08:00
mindspore-ci-bot 9ffb3993e8 !732 dock AcoshGrad for GE and AvgPool AvgPoolGrad for VM 
Merge pull request !732 from zhangbuxue/dock_AcoshGrad_AvgPool_AvgPoolGrad_for_vm
 2020-04-28 20:22:04 +08:00
mindspore-ci-bot 21d936e656 !728 auto parallel strategy checkpoint full 
Merge pull request !728 from yao_yf/strategy_checkpoint_extend
 2020-04-28 19:51:15 +08:00
mindspore-ci-bot 4fff5f442c !791 onnx adapter for MaxPoolWithArgmax 
Merge pull request !791 from 梅晓蔚/master
 2020-04-28 19:24:13 +08:00
buxue 0f89cc1da4 dock AcoshGrad for GE and AvgPool AvgPoolGrad for Vm 2020-04-28 18:52:23 +08:00
meixiaowei cd899fba0a ONNX adapter for the MaxPoolWithArgmax 2020-04-28 16:43:15 +08:00
yao_yf 6cde5f6d91 auto parallel strategy checkpoint 2020-04-28 15:48:41 +08:00
mindspore-ci-bot 9399dffe0e !751 Remove enable hccl 
Merge pull request !751 from zjun/remove_enable_hccl
 2020-04-28 14:23:40 +08:00
mindspore-ci-bot 5b3327d103 !746 reducescatter backforward operator 
Merge pull request !746 from lirongzhen1/bp_reducescatter
 2020-04-28 14:11:53 +08:00
mindspore-ci-bot c1813671db !694 Refactor vm module for multigraph sink. 
Merge pull request !694 from rick_sanchez/master
 2020-04-28 10:42:26 +08:00
mindspore-ci-bot 8bf35b2b0c !700 validate bprop rules 
Merge pull request !700 from penn/validate_bprop_rules
 2020-04-28 10:40:41 +08:00
zjun c538b83712 remove enbale hccl 2020-04-28 10:37:08 +08:00
lirongzhen1 0b4648881b add reducescatter bprop 2020-04-28 09:58:34 +08:00
rick_sanchez 6ae8345cad refactor vm module for multigraph sink 2020-04-28 09:53:43 +08:00
mindspore-ci-bot b37db1edf5 !603 [MD] update pk sampler in minddataset 
Merge pull request !603 from liyong126/update_pk_sampler
 2020-04-27 23:17:38 +08:00
mindspore-ci-bot f82e63fecc !671 Added testcase for sync_wait 
Merge pull request !671 from EricZ/master
 2020-04-27 22:14:10 +08:00
mindspore-ci-bot 0e3054d527 !466 Deepcopy problem when pyfunc cannot be pickled 
Merge pull request !466 from h.farahat/deepcopy
 2020-04-27 22:07:55 +08:00
liyong bfba630aa2 update pK_sampler 2020-04-27 21:40:49 +08:00
mindspore-ci-bot c47ef8ee4e !711 Address first epoch always shuffle with same seed init of random sampler 
Merge pull request !711 from ZiruiWu/mindspore_master_only
 2020-04-27 21:39:12 +08:00
mindspore-ci-bot afbd24cb78 !718 Fix dtype judge sentence in infer_dtype function of hcom operations 
Merge pull request !718 from zhouyuanshen/master
 2020-04-27 21:23:25 +08:00
zhouyuanshen c046874b03 fix bug in infer_dtype function of hcom operations 2020-04-27 18:49:21 +08:00
wenkai ab04b3dc4b fix np.histograms(bins='auto') sometimes calc very small width and very large bucket number, which lead to error/long compute time. 2020-04-27 18:08:17 +08:00
panyifeng 9e633b6c12 validate bprop rules 2020-04-27 11:57:22 +08:00
mindspore-ci-bot ef71ae941f !698 [Auto parallel] Support multi-subgraphs in auto-parallel 
Merge pull request !698 from Xiaoda/support-wide-deep-in-auto-parallel
 2020-04-27 11:15:40 +08:00
mindspore-ci-bot e213f2a435 !687 Fix bug: Summary tage type checking and exception throwing 
Merge pull request !687 from candanzg/summary_tag_check
 2020-04-27 09:57:33 +08:00
Xiaoda Zhang e227415673 support-the-multiple-subgraphs-in-the-ANF 2020-04-27 09:34:41 +08:00
Zirui Wu 8c3931cf1d fix first epoch always shuffle with default seed in random sampler 
fix ut
 2020-04-26 10:58:59 -04:00
mindspore-ci-bot efdcd4c258 !682 fix api comments of some ops 
Merge pull request !682 from liuxiao/fix-bug
 2020-04-26 19:29:40 +08:00
mindspore-ci-bot da5b10b699 !681 add psnr inputs shape and dtype check 
Merge pull request !681 from zhaozhenlong/psnr-check-same-shape
 2020-04-26 17:49:05 +08:00
zhaozhenlong c88edfb31d psnr check two input same shape and type 2020-04-26 17:16:58 +08:00
yangzhenzhang 4750861054 fix layernorm bug 2020-04-26 16:39:32 +08:00
mindspore-ci-bot 348b0ef53c !344 add prim name to error message for operators in array_ops.py 
Merge pull request !344 from fary86/add_prim_name_to_error_message_for_array_ops
 2020-04-26 16:23:33 +08:00
candanzg b84deeeb5c fix summary tage check error 
Signed-off-by: candanzg <zhangshucheng@huawei.com>
 2020-04-26 15:43:57 +08:00
fary86 2078229436 Add prim name to error message for array_ops 2020-04-26 15:23:04 +08:00
yangzhenzhang 36a62576e8 support forward graph 2020-04-26 14:44:23 +08:00
liuxiao 5e877a7715 modify api and add example 2020-04-26 11:07:18 +08:00
mindspore-ci-bot ad2a5dcad2 !676 [Auto parallel] Add the resnet50 testcase 
Merge pull request !676 from Xiaoda/add-the-resnet50-testcase
 2020-04-26 11:06:29 +08:00
buxue aff6777ecc fix reviewboot and example of TruncatedNormal and add type mapping 2020-04-26 10:01:20 +08:00
Xiaoda Zhang 3ff9e54734 add the resnet50 32k-8p testcase 2020-04-26 09:07:37 +08:00
eric 2d115cd04e Added example for multiple iterator 
Added new testcase for multi iterator

Addressing review

Fixed typo
 2020-04-24 17:28:40 -04:00
lirongzhen1 56f785f7e6 add context configration 2020-04-24 19:35:14 +08:00
mindspore-ci-bot 6844ea633d !56 Synchronization code423 to ms-incubator 
Merge pull request !56 from changzherui/syn-code423
 2020-04-24 19:30:37 +08:00
mindspore-ci-bot a02eb240e9 !595 Tensor assign with int or tuple(int) index 
Merge pull request !595 from candanzg/tensor_assign_with_integer
 2020-04-24 17:35:58 +08:00
mindspore-ci-bot ce71c17933 !645 auto parallel prelu operator support broadcast 
Merge pull request !645 from yao_yf/auto_parallel_prelu_support_broadcast
 2020-04-24 17:32:37 +08:00
mindspore-ci-bot 84d5e4f923 !643 [AutoParallel]Support reshape parameter 
Merge pull request !643 from lichen/support_reshape_parameter
 2020-04-24 16:43:29 +08:00
candanzg 31aae36106 Tensor assign with integer 
Signed-off-by: candanzg <zhangshucheng@huawei.com>
 2020-04-24 16:28:23 +08:00
mindspore-ci-bot 43a8f829a2 !628 fix the infer of TruncatedNormal and a bug of structure output 
Merge pull request !628 from zhangbuxue/fix_example_for_TruncatedNormal
 2020-04-24 16:12:05 +08:00
mindspore-ci-bot 00859ae119 !586 enable/disable allreduce_fusion 
Merge pull request !586 from lirongzhen1/allreduce_fusion
 2020-04-24 16:02:53 +08:00
lichenever 2ab211ae04 support reshape parameter 2020-04-24 15:59:09 +08:00
buxue c8a1a24ce3 fix the infer of TruncatedNormal and a bug of structure output and a bug of tensorslice ellipsis 2020-04-24 15:42:58 +08:00
yao_yf 425276d43d auto parallel prelu support prelu 2020-04-24 14:10:57 +08:00
Xiaoda Zhang dfde76af88 delete the 'simplify_cal' attribute in 'set_algo_parameters' and 'get_algo_parameters' interface 2020-04-24 10:46:38 +08:00
lirongzhen 4ff418084c enable/disable allreduce_fusion 2020-04-24 10:34:59 +08:00
zhaojichen d1add07b5a change error type 2020-04-23 09:49:56 -04:00
zhaojichen 1af894e25f change error type 2020-04-23 09:21:05 -04:00
zhaojichen 57bc30505c change error type 2020-04-23 07:58:44 -04:00
mindspore-ci-bot ad75618ca6 !611 change error message type 
Merge pull request !611 from JichenZhao/errormsg
 2020-04-23 19:49:59 +08:00
chang zherui bd13f9ba33 modify ResizeNearestNeighborV2D 2020-04-23 18:56:03 +08:00
zhaojichen 8963e39516 change error type 2020-04-23 05:29:26 -04:00
mindspore-ci-bot 5ac07bb695 !504 Support Tensor assign A[slice] = u 
Merge pull request !504 from candanzg/tensor_assign_with_slice
 2020-04-23 16:24:10 +08:00
candanzg 663d597330 tensor assign with slice index 
Signed-off-by: candanzg <zhangshucheng@huawei.com>
 2020-04-23 13:07:04 +08:00
mindspore-ci-bot 0bf6717e9a !454 Fix the check of bool type in auto cast 
Merge pull request !454 from candanzg/bug_cast_op
 2020-04-23 10:54:40 +08:00
mindspore-ci-bot 5cf09405e2 !532 [AutoParallel]support multiple subgraphs 
Merge pull request !532 from lichen/support_multiple_subgraphs_in_auto_parallel
 2020-04-23 09:04:09 +08:00
hesham a9e9266149 Deepcopy problem when pyfunc cannot be pickled 2020-04-22 11:55:27 -04:00
liuxiao b6e77e5178 Add ReluV2/ReluGradV2/ConfusionMulGrad for VM 2020-04-22 21:09:37 +08:00
mindspore-ci-bot 1a0d2666b7 !559 Add Fill/Erf op for VM. 
Merge pull request !559 from liuxiao/fill-op
 2020-04-22 19:22:04 +08:00
mindspore-ci-bot 818acd46d4 !569 fix bug in checkpoint when save scaler 
Merge pull request !569 from wangnan39/master
 2020-04-22 18:55:02 +08:00
lichenever c78630d737 support multiple subgraphs 2020-04-22 17:40:56 +08:00
wangnan39@huawei.com f38d18c665 fix bug in checkpoint when save scaler 2020-04-22 16:04:55 +08:00
mindspore-ci-bot 24a9f4974c !536 support ellipsis and bool for tensor slice 
Merge pull request !536 from zhangbuxue/support_elipis_for_tensor_slice
 2020-04-22 15:49:33 +08:00
liuxiao 5b6c8fade8 Add Erf\FillD operator for VM 2020-04-22 15:32:42 +08:00
buxue 437bb8c27c support ellipsis and bool for tensor slice 2020-04-22 15:00:04 +08:00
mindspore-ci-bot 67057d1309 !541 add average pooling 1D 
Merge pull request !541 from JichenZhao/avgpooling
 2020-04-22 14:13:04 +08:00
mindspore-ci-bot 4516b8feff !437 Add L2Loss op for VM. 
Merge pull request !437 from liuxiao/add-l2-loss
 2020-04-22 10:27:04 +08:00
mindspore-ci-bot 3b083d07bb !550 support one node communication group 
Merge pull request !550 from yao_yf/support_one_node_communication_group
 2020-04-22 10:17:01 +08:00
liuxiao c874e2d484 Add L2Loss op for VM 2020-04-22 09:31:14 +08:00
mindspore-ci-bot aad5771a62 !524 Added support for UA augmentation ops with tests 
Merge pull request !524 from alashkari/ua-ops
 2020-04-22 08:28:47 +08:00
Amir Lashkari 56e7a7deb5 Added UniformAugment + Python Augmentation Ops 2020-04-21 19:54:32 -04:00
mindspore-ci-bot dc0491caf9 !508 [Dataset] Adding sync_wait operator for dataset 
Merge pull request !508 from EricZ/master
 2020-04-22 06:15:24 +08:00
eric cd94518769 X# This is a combination of 2 commits. 
Initial commit for dataset op python

Added signature to barrier

Adde compiling barrier code

Rebasing, fixed new compile errors

Final fix for make_unique

Added pybind API for barrier

Fixed pyfunc invocation

python interface - sync_wait

!1 sync_wait python interface
* python interface - sync_wait

fix test

update test

update test

Added new test case

add test case

test for shuffle + batch

Added two-sync test case

Restrited that no shuffle after sync

Added sync to pipeline info

block first databuffer as well

Intelligently get batch size

Fix default case

Lock Pair shares among all iterators

Added fix for empty character

Fixed up test case formatting

Fix end of epoch in sync_wait

Fixing CI
 2020-04-21 17:42:13 -04:00
Junhan Hu 78001ac9e6 Add multiprocessing support for Mindspore.Dataset.GeneratorDataset 2020-04-21 16:03:43 -04:00
mindspore-ci-bot fb18671b28 !506 [Dataset] Multiprocessing support for Pyfunc 
Merge pull request !506 from JunhanHu/multiprocess_pyfunc
 2020-04-22 03:57:26 +08:00
Junhan Hu b13e7bc31a Add python multiprocessing support for Mindspore.dataset 2020-04-21 14:56:25 -04:00
yao_yf 371b3338b6 support one node communication group 2020-04-21 21:16:22 +08:00
mindspore-ci-bot 72f42fc37c !170 Add prim name to error message for operators in nn_ops.py 
Merge pull request !170 from fary86/add_prim_name_to_error_message_for_nn_ops
 2020-04-21 21:14:44 +08:00
wangnan39@huawei.com b812b18c02 support update parameter for vm 2020-04-21 20:19:46 +08:00
fary86 6dd72f654a Add prim name to error message for nn_ops.py 2020-04-21 19:25:30 +08:00
qianlong db80f4ff92 The num_samples and numRows in schema for TFRecordDataset are conflict 2020-04-21 17:08:59 +08:00
zhaojichen 94c99998ae add AvgPooling layer 2020-04-21 03:17:24 -04:00
mindspore-ci-bot d9e4dcc33b !483 Optimize skip dataset op 
Merge pull request !483 from jiangzhiwen/dataset/skip_opt
 2020-04-21 15:10:23 +08:00
mindspore-ci-bot 862d23fe90 !481 Move args_type_check function to _checkparam.py 
Merge pull request !481 from leonwanghui/rm-code
 2020-04-21 11:23:05 +08:00
mindspore-ci-bot 7aac50804a !514 [MD] add Pk Sampler in minddataset 
Merge pull request !514 from liyong126/mindrecord_pk_sampler_lee
 2020-04-21 11:10:19 +08:00
leonwanghui 24b26ee1a8 Move args_type_check function to _checkparam.py 2020-04-21 10:20:09 +08:00
liyong f1542a90a3 add pk sampler 2020-04-21 10:08:38 +08:00
candanzg 0de05b3949 [bug] fixed bool check for cast op 
Signed-off-by: candanzg <zhangshucheng@huawei.com>
 2020-04-21 09:48:34 +08:00
mindspore-ci-bot 27a88a6bc3 !456 Auto cast case for NotEqual op 
Merge pull request !456 from candanzg/not_equal_auto_cast
 2020-04-21 09:20:40 +08:00
jiangzhiwen e1b109e8b8 optimize skip dataset op 2020-04-21 09:16:37 +08:00
Cathy Wong 60df369100 Fixup py Normalize doc: takes input CHW 2020-04-20 15:17:30 -04:00
mindspore-ci-bot 6369cf27bd !406 added first row crc check for when reading tfrecord files 
Merge pull request !406 from Peilin/first-row-crc-check
 2020-04-21 00:10:18 +08:00
mindspore-ci-bot 98fbd30a5b !460 [Data]Add filter operation 
Merge pull request !460 from xulei/filter_master
 2020-04-20 23:33:44 +08:00
mindspore-ci-bot 822a3160e4 !404 [Dataset] Add Python Sampler support for CPP dataset 
Merge pull request !404 from JunhanHu/python_sampler_for_cpp_dataset
 2020-04-20 22:45:51 +08:00
xulei2020 c705ea5e5b add filterOp code 2020-04-20 22:32:19 +08:00
Peilin Wang 9bc2134cb7 added checking of first row crc to find invalid tfrecord files 
addressed code review comments. added check in python layer to exclude directories and to raise an error if a pattern does not match any file

fixed clang format

fixed cppcheck

fixed cppcheck (used std::accumulate and std::copy_if). regenerated tfrecord file to contain correct header, it was a dummy header before

fixed cppcheck: added const reference for string parameter for lambdas, fixed clang format: whitespace adjustments

more clang whitespace fixes...

changed print to logger.info
 2020-04-20 10:25:26 -04:00
mindspore-ci-bot d8176a77f4 !425 New api "TextFileDataset" 
Merge pull request !425 from yanghaitao/yht_textfiledatasetv2
 2020-04-20 22:14:26 +08:00
mindspore-ci-bot 5434a96d85 !493 support python func print and != for list with none 
Merge pull request !493 from zhangbuxue/support_python_func_print
 2020-04-20 20:32:18 +08:00
mindspore-ci-bot 0cdb1171d5 !87 Take AllToAll as a virtual operator in cost model 
Merge pull request !87 from gziyan/dev_alltoall
 2020-04-20 20:13:15 +08:00
mindspore-ci-bot c3ec9712e0 !403 add cell class name to error message 
Merge pull request !403 from fary86/add_cell_name_to_error_message_for_nn_layer
 2020-04-20 20:06:12 +08:00
buxue 7c233a57fa support python func print and != for list with none 2020-04-20 19:55:50 +08:00
mindspore-ci-bot 679dbd27b3 !478 fix save_graphs_path and log file mode related issues 
Merge pull request !478 from fary86/fix_log_and_ir_issues
 2020-04-20 19:07:38 +08:00
fary86 7e23a1a475 Fix issues of save_graphs_path, Type/Value error message and log file mode 2020-04-20 16:23:40 +08:00
mindspore-ci-bot 3ba31ec15a !419 Tensor assign with bool Tensor 
Merge pull request !419 from candanzg/tensor_assign_bool_index
 2020-04-20 15:00:55 +08:00
yanghaitao 2795e492ff TextFileDataset 2020-04-20 11:18:55 +08:00
mindspore-ci-bot 18580a7867 !261 Add summary module python code to extract histogram info from tensor 
Merge pull request !261 from wenkai/histogram_dev3cp
 2020-04-20 11:08:34 +08:00
mindspore-ci-bot 3822b4837f !340 Add a HistogramSummary ops to record tensor value 
Merge pull request !340 from ougongchang/master
 2020-04-20 10:54:04 +08:00
Ziyan 0d208e00bd Model ALLTOALL as a single operator in cost model; scale the ALLTOALL, 
ALLGATHER, and REDUCESCATTER with different factors; change the BETA and
GAMMA value in cost model.
 2020-04-20 09:11:03 +08:00
candanzg 3f087dba1a Tensor assign syntax: 
1) A[B]=U
2) A[A>n]=U
    A.shape == B.shape
    U is a scalar or Tensor(size==1)
    B is Tensor(dtype=bool)
    n is a Number

Signed-off-by: candanzg <zhangshucheng@huawei.com>
 2020-04-20 08:44:34 +08:00
Junhan Hu 43a2e99833 Add python sampler support for CPP dataset 2020-04-19 20:36:37 -04:00
candanzg 79c4312e89 NotEqual op auto cast 
Signed-off-by: candanzg <zhangshucheng@huawei.com>
 2020-04-19 11:41:47 +08:00
ms_yan f0c07c3fa6 Realize take op and add ut 2020-04-18 18:33:57 +08:00
mindspore-ci-bot cc08fdfd9a !420 Fix mixed precision usage when const value passed as argument 
Merge pull request !420 from amongo/FixMixedPrecisionForConstParam
 2020-04-18 10:31:33 +08:00
ougongchang 0ed6d9178e add Histogram summary operator 
clean clang format errors and cpplint errors

add some test cases for histogram summary operator
 2020-04-18 09:56:45 +08:00
mindspore-ci-bot 80333e9f55 !435 Fix dataset serialize and deserialize for MindDataset 
Merge pull request !435 from anthonyaje/fix_serdes_dataset
 2020-04-18 09:37:22 +08:00
mindspore-ci-bot d34afbd61b !400 Support math operation between float and int for scalar 
Merge pull request !400 from amongo/FixMathOps
 2020-04-18 09:34:42 +08:00
mindspore-ci-bot 40f0a4a4f4 !333 Add skip op to Dataset 
Merge pull request !333 from jiangzhiwen/dataset/skip
 2020-04-18 09:19:07 +08:00
mindspore-ci-bot 9e1b5efd1d !434 Bug in cleaning dataset iterators 
Merge pull request !434 from h.farahat/multi_itr_bug
 2020-04-18 05:17:31 +08:00
anthonyaje ea297c0889 Fix dataset serdes for MindDataset 2020-04-17 13:24:02 -04:00
hesham 3c02c82771 Bug in weak reference. 
Add new test cases
 2020-04-17 11:36:32 -04:00
jzw 3f7054dccb add skip dataset op 2020-04-17 19:48:25 +08:00
huangdongrun 7fae76d10d add support for calculation between float and int 
format code

remove test case for fp64

add back scalar manipulation

remove save graph
 2020-04-17 19:13:52 +08:00
huangdongrun 9cb665e634 add suport for parameter of const value pass as mixed precision args 
fix pylint
 2020-04-17 16:27:46 +08:00
mindspore-ci-bot 7214c04114 !402 Add parallel op for Square 
Merge pull request !402 from yangzhenzhang/square
 2020-04-17 15:06:40 +08:00
fary86 8cbbbd950e Add cell name to error message 2020-04-17 12:58:11 +08:00
yangzhenzhang 36ffb66782 add parallel op for square 2020-04-17 10:42:52 +08:00
mindspore-ci-bot 2d31ae97e8 !383 add cell psnr 
Merge pull request !383 from zhaozhenlong/cell/psnr
 2020-04-17 10:23:30 +08:00
mindspore-ci-bot 08985a1e56 !286 resolve pynative operator unsupport issue 
Merge pull request !286 from wangqiuliang/resolve-pynative-operator-issue
 2020-04-17 10:04:54 +08:00
wenkai cce61d462c histogram python dev 2020-04-17 09:42:02 +08:00
zhaozhenlong aa8fbcc06e add cell psnr 2020-04-17 09:15:51 +08:00
mindspore-ci-bot cf026096a6 !183 Mindspore.dataset CPP sampler for GeneratorDataset 
Merge pull request !183 from JunhanHu/cpp_sampler
 2020-04-16 22:30:59 +08:00
kingfo 75fec82b52 resolve pynative operator issue 2020-04-16 21:02:22 +08:00
mindspore-ci-bot d3e4dd06b0 !386 modify test_cell_bprop.py ut test_with_param 
Merge pull request !386 from changzherui/modify-ut
 2020-04-16 20:15:15 +08:00
mindspore-ci-bot 549bfb97ad !343 Fix usage of variable arguments in test framework 
Merge pull request !343 from amongo/FixGradUsingInterfaceExtend
 2020-04-16 19:42:07 +08:00
mindspore-ci-bot 31621467a4 !217 support operator ** // % for scalar and tensor, and "in" "not in" key word, and string concat 
Merge pull request !217 from zhangbuxue/support_pow_operator
 2020-04-16 18:53:47 +08:00
mindspore-ci-bot 0d0517c22d !379 Add Group normalization 
Merge pull request !379 from JichenZhao/groupnorm
 2020-04-16 17:30:12 +08:00
buxue 80978cf3cc support operator ** // % for scalar and tensor, and in not in for dict, ang str concat 2020-04-16 17:03:31 +08:00
huangdongrun efedcfb530 add test case of Bprop and tester 
add test case for grad concat

fix usage in test framework

fix testcase

format code
 2020-04-16 16:59:18 +08:00
chang zherui 8bdcd8c267 modify test_cell_bprop.py ut 2020-04-16 16:20:24 +08:00
yangzhenzhang 57cd9f8188 add parallel op for sigmoidloss 2020-04-16 14:33:24 +08:00
zhaojichen 04c522d0c6 Add Group Normalization 2020-04-16 01:59:32 -04:00
zhaojichen 0b7de6968f Add Group Normalization 2020-04-16 01:56:12 -04:00
zhaojichen ebe6efff71 Add Group Normalization 2020-04-16 01:42:32 -04:00
yangzhenzhang 6d522f0a4f add parallel op for layernorm 2020-04-15 19:30:07 +08:00
mindspore-ci-bot ba55a8ed0b !304 [Auto parallel] Change 'NOT_FULLY_USE_DEVICES' to 'FULLY_USE_DEVICES' and make ALL-1 user-specified-strategy valid in auto-parallel 
Merge pull request !304 from Xiaoda/modify-not-fully-use-devices-and-strategy-checking
 2020-04-15 17:21:45 +08:00
buxue 62807da0c4 Develop operator Unfold，take the ge backend，dock with tbe's ExtractImagePatches operator 2020-04-15 15:26:44 +08:00
Xiaoda Zhang ffb2cb03a4 Change 'NOT_FULLY_USE_DEVICES' to 'FULLY_USE_DEVICES' and make ALL-1 user-specified-strategy valid in auto-parallel 2020-04-15 10:14:46 +08:00
Junhan Hu 9739d3b048 Add CPP sampler support for GeneratorDataset 2020-04-14 12:09:03 -04:00
mindspore-ci-bot 30de261c3c !243 Support nested repeat 
Merge pull request !243 from h.farahat/nested_repeat
 2020-04-14 23:07:32 +08:00
mindspore-ci-bot fe4cde6b1e !294 Add cell ssim 
Merge pull request !294 from zhaozhenlong/cell/ssim
 2020-04-14 22:34:03 +08:00
mindspore-ci-bot 150024f089 !312 Implemention of new dataset ops: apply 
Merge pull request !312 from xiefangqi/xfq_apply_branch
 2020-04-14 22:29:07 +08:00
hesham 0fc23eee0f Support nested repeat 2020-04-14 10:13:18 -04:00
zhaozhenlong 6a2cf4b6e6 ssim impl code 2020-04-14 21:53:29 +08:00
xiefangqi 1a1cbc6814 implemention of new api: apply 2020-04-14 21:43:53 +08:00
Wei Luning e1c8f248e0 Fix the output is not tuple, when eval 2020-04-14 16:14:41 +08:00
mindspore-ci-bot f1fa2a9941 !273 [MD] update subset random sampler in minddataset 
Merge pull request !273 from liyong126/mindrecord_subset_sampler_python
 2020-04-14 11:18:36 +08:00
mindspore-ci-bot 7ffb8bb19f !250 Add nn.pad to support three modes 
Merge pull request !250 from casgj/gaojing_new4
 2020-04-14 10:56:05 +08:00
mindspore-ci-bot 60958d6b25 !239 Add dynamic learning rate decay and review optimizer code 
Merge pull request !239 from fanglei/master
 2020-04-14 09:24:25 +08:00
gaojing 2db3e64ff2 add operation 2020-04-13 10:38:03 -04:00
root 7d700295f8 add dynamic lr and enhance optim 2020-04-13 13:48:01 +00:00
liyong 0ce83e39e1 fix TestShardSampleWrongNumber 
adjust internal api
 2020-04-13 21:31:45 +08:00
mindspore-ci-bot 39a46b9342 !245 Add bool type check in communication operator 
Merge pull request !245 from chentingting/add_bool_type_check_in_comm_op
 2020-04-13 20:19:47 +08:00
mindspore-ci-bot 77725e81a4 !258 add_minimum_distributed_op 
Merge pull request !258 from lichen/add_minimum_distributed_op
 2020-04-13 20:16:08 +08:00
Wei Luning 37c94a5f76 add pass replace_old_param_ 2020-04-13 17:52:55 +08:00
c00425699 d62f560b50 add_bool_type_check_in_comm_op 2020-04-13 17:34:29 +08:00
lichenever b81cc6ea4f add minimum distributed op 2020-04-13 17:26:31 +08:00
chenzomi d64f662c76 quantization aware training frontend operators define. 2020-04-13 12:02:49 +08:00
mindspore-ci-bot 98e69fc639 !215 fix bprop cache caused error with variable params 
Merge pull request !215 from penn/fix_print_bprop_error
 2020-04-13 10:10:49 +08:00
mindspore-ci-bot 7bc2cee318 !167 add_squeeze_distributed_op 
Merge pull request !167 from lichen/add_squeeze_distributed_op
 2020-04-13 10:03:25 +08:00
c00425699 c8cdb6b331 support distributed GatherV2 operator 2020-04-12 16:00:47 +08:00
liyong 11403492ae add mindrecord subset random sampler 2020-04-11 18:48:23 +08:00
buxue 5841fe010e Support pow's second input could be tensor and fix bug in bprop of pow 2020-04-11 16:16:58 +08:00
lichenever 32cd280c1a add squeeze distributed op 2020-04-11 16:03:08 +08:00
mindspore-ci-bot 5141054ecd !220 Add parallel operator for DropoutDoMask 
Merge pull request !220 from yangzhenzhang/dropoutdomask
 2020-04-11 15:01:43 +08:00
mindspore-ci-bot 066f20e791 !169 fix the method to calculate the children graph 
Merge pull request !169 from xychow/fix-manager-children-issue
 2020-04-11 14:07:45 +08:00
yangzhenzhang b34c0e7a17 add parallel op for dropoutdomask 2020-04-11 12:11:22 +08:00
jonyguo a9443635b7 fix: mindpage enhance parameter check and search by filename failed 2020-04-11 10:19:14 +08:00
义峰潘 2bef22d8a3 fix bprop cache caused error with variable params 2020-04-10 12:21:40 +08:00
Cathy Wong 59a714c654 Correct shuffle UT buffer_size > #dataset-row as valid 2020-04-09 15:22:33 -04:00
liuxiao 0f0f83e292 modified api name Stack -> Pack, Unstack -> Unpack 2020-04-09 19:02:59 +08:00
mindspore-ci-bot 0565e4641e !185 modify comment about normal mode 
Merge pull request !185 from jinyaohui/master
 2020-04-09 14:24:28 +08:00
mindspore-ci-bot 2e6e94b2b6 !177 prelu operator support parallel on the channel 
Merge pull request !177 from yao_yf/fix_auto_parallel_prelu
 2020-04-09 14:08:41 +08:00
zhousiyi 99f22c5b85 fix children issue: missing users of the children's direct users. 2020-04-09 02:18:55 +00:00
jinyaohui 0790ef8a85 modify comment 2020-04-09 09:23:39 +08:00
mindspore-ci-bot 3e36982314 !99 Develop op MaxPoolWithArgMax 
Merge pull request !99 from zhangbuxue/Dock_MaxPoolWithArgMax
 2020-04-08 22:40:00 +08:00
mindspore-ci-bot 40d4a4baa3 !20 modify _set_dataset_mode_config api param 
Merge pull request !20 from jinyaohui/master
 2020-04-08 20:58:26 +08:00
buxue 7541d3b067 Develop op MaxPoolWithArgMax 2020-04-08 20:47:49 +08:00
yao_yf b5e3fa9593 fix auto parallel prelu 2020-04-08 20:45:08 +08:00
jinyaohui ac62faa388 modify set_dataset_mode_config api param 2020-04-08 18:30:36 +08:00
liuxiao 47d903ff57 Add pack and unpack 2020-04-08 16:58:53 +08:00
mindspore-ci-bot e6ea09082c !153 add api image_gradients 
Merge pull request !153 from zhaozhenlong/cell/image_gradients
 2020-04-08 14:55:48 +08:00
zhaozhenlong f9d180d413 add api image gradients 2020-04-08 11:50:22 +08:00
mindspore-ci-bot a24297f547 !122 Support to config whether to save integeated checkpoint, in auto model parallel scene 
Merge pull request !122 from WeibiaoYu/master
 2020-04-08 09:42:59 +08:00
WeibiaoYu 22c6baeea2 Support to config whether to save integeated checkpoint, in auto model parallel scene 2020-04-07 08:25:27 -04:00
jonyguo c688265671 fix: when use MindDataset block_reade=True hung 2020-04-07 17:53:23 +08:00
chang zherui 7696c21e65 fix runtest.sh for python ut 2020-04-07 13:10:33 +08:00
mindspore-ci-bot 5add5979e8 !92 add prim name to param check error message for math_ops.py 
Merge pull request !92 from fary86/add-prim-name-for-param-validator
 2020-04-07 10:48:10 +08:00
Wei Luning 113c0d8cd2 fix InsertGradientOf with class method 2020-04-07 02:11:35 +00:00
fary86 69ed72f10d Add primitive name to param error message for math_ops.py 2020-04-07 10:08:04 +08:00
mindspore-ci-bot 7a367af9c6 !135 fix grad missing due to indirect dependent free morphism 
Merge pull request !135 from penn/fix_free_morphism_error
 2020-04-06 10:17:13 +08:00
panyifeng 1fb776fe09 fix grad missing due to indirect dependent free morphism 2020-04-03 18:22:53 +08:00
mindspore-ci-bot 9e529f9dd0 !54 Interface change :`_Constant` to `Constant` 
Merge pull request !54 from ghzl/initializer-change-_Constant-to-Constant
 2020-04-03 17:53:51 +08:00
guohongzilong bb5320be13 iterfaces change: _Constant to Constant 2020-04-03 16:19:29 +08:00
mindspore-ci-bot 2c3c1577b1 !115 Add parallel operator for ExpandDims 
Merge pull request !115 from yangzhenzhang/expand-dim
 2020-04-03 15:54:33 +08:00
mindspore-ci-bot a5d95e472e !106 support comparison ops for python 
Merge pull request !106 from amongo/SupportPythonOperators
 2020-04-03 15:52:08 +08:00
mindspore-ci-bot acb99f6e8c !123 modify runtest.sh for python ut exec form 
Merge pull request !123 from changzherui/modify_runtest_python_ut
 2020-04-03 15:35:43 +08:00
yangzhenzhang dd0d4e6b84 add parallel ops for expand dims 2020-04-03 15:17:07 +08:00
huangdongrun 461d8e3a08 add comparison ops 
fix pylint

use scalar_lt primitive directly

fix review
 2020-04-03 09:58:41 +08:00
chang zherui 86a3398547 modify runtest py ut for parallel exec 2020-04-03 09:38:04 +08:00
xiefangqi bc4602b58e fix and remove useless import of example, st, ut 2020-04-02 22:13:36 +08:00
mindspore-ci-bot d245792842 !94 enhance: reduce execution time for mindrecord test case 
Merge pull request !94 from yanzhenxiang2020/fix_mindrecord_ut_long_time
 2020-04-02 21:50:43 +08:00
mindspore-ci-bot a5a904fbdf !91 fix bug for allreduce fusion and add resnet unit test 
Merge pull request !91 from chentingting/allreduce_fusion_resnet
 2020-04-02 21:35:35 +08:00
mindspore-ci-bot cb323eccf0 !71 Add operator adapting in ME for FloorMod, Acosh and SparseApplyFtrlD 【CR】，并主动Acosh and FloorMod operator adapting 
Merge pull request !71 from zhangzheng/sparse_acosh_floormod
 2020-04-02 21:33:33 +08:00
mindspore-ci-bot 55916351ee !52 remove ge depend 
Merge pull request !52 from flywind/remove-ge-depend
 2020-04-02 20:59:06 +08:00
zhangz0911gm 6f1747045c Add FloorMod, Acosh in ME 2020-04-02 08:50:39 -04:00
Wei Luning 73ba399364 remove ge depend in cpu 2020-04-02 19:38:42 +08:00
yanzhenxiang2020 5a4f17bfb6 fix mindrecord ut long time 2020-04-02 19:18:49 +08:00
c00425699 ab917a734d fix bug for allreduce fusion and add resnet unit test 2020-04-02 18:55:04 +08:00
mindspore-ci-bot d8b460c780 !96 fix refkey bug for auto parallel 
Merge pull request !96 from lichen/fix_ref_key_bug_for_auto_parallel
 2020-04-02 17:26:58 +08:00
lichenever 5240b1f603 fix refkey bug for auto parallel 2020-04-02 16:14:29 +08:00
mindspore-ci-bot cf54ecfe6e !62 support grad on python function with variable arguments 
Merge pull request !62 from amongo/SupportGradOnVarArgs
 2020-04-02 11:21:06 +08:00
zhaoting ed3c2d7229 add RMSProp optimizer 2020-04-02 09:10:58 +08:00
mindspore-ci-bot 5c22c088bb !69 Enable skipped dataset zip operator python unit tests 
Merge pull request !69 from cathwong/ckw_dataset_py_ut1
 2020-04-01 22:20:37 +08:00
huangdongrun d3f733fa25 support grad on graph with variable arguments 
use unpack graph primitive instead

add testcases for all grad interface

remove debug log

format code

remove dumpfuncgraph

resolve clang-format

resolve reviews

resolve cpplint

fix review
 2020-04-01 20:24:04 +08:00
mindspore-ci-bot 37dba2ddcf !74 delete longtime python ut 
Merge pull request !74 from changzherui/master
 2020-04-01 18:29:58 +08:00
mindspore-ci-bot 69d5403319 !14 add adapter for ge atan2 
Merge pull request !14 from zhaozhenlong/op/atan2
 2020-04-01 18:24:55 +08:00
mindspore-ci-bot a47046652a !76 [Auto parallel] Refining the strategy_checking for resnset50 
Merge pull request !76 from Xiaoda/modify-resnet50-strategy-checking
 2020-04-01 16:36:13 +08:00
zhaozhenlong bed5997a14 add atan2 operator 2020-04-01 16:27:35 +08:00
mindspore-ci-bot f0bcf90b5b !64 fix error while num_samples equal 0 
Merge pull request !64 from anzhengqi/fix-check-num-samples
 2020-04-01 15:48:38 +08:00
mindspore-ci-bot 22a9c00bcd !57 Add parallel operators for Neg and BatchMatMul 
Merge pull request !57 from yangzhenzhang/master
 2020-04-01 15:23:46 +08:00
Xiaoda Zhang fb6eed23ae refining strategy-checking for resnet50 2020-04-01 14:58:58 +08:00
anzhengqi 6a1b865c91 check num_samples 2020-04-01 14:39:23 +08:00
chang zherui 1de7011bc8 delete longtime python ut 2020-04-01 11:53:35 +08:00
mindspore-ci-bot 87040483ee !58 fix two cast bug in auto parallel 
Merge pull request !58 from lichen/fix_two_cast_bug_in_auto_parallel
 2020-04-01 09:54:10 +08:00
yangzhenzhang 110640e2ad add parallel ops for neg and batchmatmul 2020-04-01 09:36:38 +08:00
Cathy Wong 2e881276ab Enable skipped dataset zip python unit tests 
Signed-off-by: Cathy Wong <cathy.wong@huawei.com>
 2020-03-31 16:47:13 -04:00
mindspore-ci-bot 045a1c356c !51 add op SpaceToBatch and BatchToSpace for ge 
Merge pull request !51 from zhaozhenlong/op/space-to-batch
 2020-03-31 21:59:03 +08:00
mindspore-ci-bot e2df848597 !55 modify long time python ut 
Merge pull request !55 from changzherui/master
 2020-03-31 21:01:40 +08:00
zhaozhenlong cf40305bf0 add operator SpaceToBatch and BatchToSpace for ge 2020-03-31 20:21:47 +08:00
mindspore-ci-bot 352c6faf85 !18 enable use float type learning rate in lars optimizer 
Merge pull request !18 from gziyan/master
 2020-03-31 18:54:55 +08:00
lichenever 2da38ad401 fix two cast bug in auto parallel 2020-03-31 18:54:21 +08:00
chang zherui eaf7146d46 modify longtime python ut 2020-03-31 16:18:04 +08:00
lichenever f946aea10d fix grpah mode loop sink bug in auto parallel 2020-03-31 16:16:53 +08:00
mindspore-ci-bot 6f03881b04 !39 add op Diag and DiagPart 
Merge pull request !39 from zhaozhenlong/op/diag
 2020-03-31 14:45:44 +08:00
leonwanghui 976af212e9 回退 'Pull Request !17 : [AutoParallel]Fix bug in the case of two cast' 2020-03-31 10:27:40 +08:00
mindspore-ci-bot 140a15924c !17 [AutoParallel]Fix bug in the case of two cast 
Merge pull request !17 from lichen/fix_cast_bug
 2020-03-31 10:25:04 +08:00
mindspore-ci-bot e9be3483fe !33 Optimize the execution time of test case test_rgb_hsv.py 
Merge pull request !33 from qianlong21st/ql/fix_test_rgb_hsv
 2020-03-31 09:53:01 +08:00
zhaozhenlong b12e6ff780 add operator diag and diag_part 2020-03-31 09:44:56 +08:00
mindspore-ci-bot c1c8fef9ca !24 Change strategy for structure output 
Merge pull request !24 from 步学/structure-output
 2020-03-31 09:38:44 +08:00
qianlong 8c88b39da1 Optimize the execution time of test case test_rgb_hsv.py 2020-03-31 09:23:20 +08:00
lichenever b4d34973bc fix_cast_bug 2020-03-30 21:13:45 +08:00
buxue 0da0bdcf40 Fix bug structure output when there is depend whose first input is constant in outputs 2020-03-30 19:49:46 +08:00
Ziyan 4cbcd8e907 enable use float type learning rate in lars optimizer 2020-03-30 19:05:33 +08:00
jonyguo 34e42bd6f9 1. add more log info for dataset & mindrecord, 2. add two new testcase for MindDataset 2020-03-30 17:24:24 +08:00
zhunaipan 930a1fb0a8 initial version 
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
 2020-03-27 22:54:54 +08:00