Commit Graph

475 Commits

Author SHA1 Message Date
mindspore-ci-bot bd845dd0b7 !1352 [MD] fix bug when append data in mindrecord using absolute path
Merge pull request !1352 from liyong126/mindrecord_fix_bug_I1HQUI
2020-05-22 14:25:15 +08:00
jinyaohui fbdba6e4da clean pylint 2020-05-22 13:23:13 +08:00
liyong 447420eb9a fix bug when append data by absolute path 2020-05-22 11:27:56 +08:00
mindspore-ci-bot 58e6d7d950 !1341 Added lookup and vocab to mindspore.dataset.text
Merge pull request !1341 from ZiruiWu/vocab_and_lookup
2020-05-22 10:19:42 +08:00
mindspore-ci-bot decf12cd0b !1317 [MD]add compress for nlp data in mindrecord
Merge pull request !1317 from liyong126/mindrecord_compress
2020-05-22 10:05:09 +08:00
mindspore-ci-bot 274f6f014f !1133 support tensor get value by tensor index
Merge pull request !1133 from zhangbuxue/support_tensor_get_value_by_tensor_index
2020-05-22 10:02:35 +08:00
mindspore-ci-bot 0a795c24aa !1245 add model init api to compile df graph before train
Merge pull request !1245 from wangnan39/add_model_init_api_to_compile_df_graph_before_train_and_eval
2020-05-22 09:51:19 +08:00
jonwe bb51bb88d7 add compress in mindrecord 2020-05-22 09:37:51 +08:00
mindspore-ci-bot 2e3d55ed87 !1281 Implementation of SplitOp
Merge pull request !1281 from Peilin/splitOp
2020-05-22 09:29:03 +08:00
mindspore-ci-bot 39b9aedf68 !1342 Bug fix on issue Core dump on GPU when train with lenet with AU
Merge pull request !1342 from Tinazhang/cc
2020-05-22 09:18:49 +08:00
mindspore-ci-bot 0ca626ef6c !1229 Init the slices of a Initializer on different devices
Merge pull request !1229 from yihuaijie/master
2020-05-22 08:57:58 +08:00
Peilin Wang 71e8bb1960 general split case done, chaining sampler (basic case) is working
implementation 99% complete

everything and tested except for repeatable shuffling

tested most basic/typical split usecases

cleanup

some more cleanup

fix CI

more ci fix

more ci fixes

more ci fix

more ci fix

more ci fix

added more tests, fixed some bugs

some more clean up and test cases

added shard/shuffle before split warning/error

addressed code review comments and ci

fixed ci
2020-05-21 20:42:51 -04:00
Tinazhang e9e40b688b Bug fix 2020-05-21 18:20:00 -04:00
Zirui Wu 25ab2ef303 Implemented lookup and vocab 2020-05-21 17:17:24 -04:00
mindspore-ci-bot 46949fc327 !1307 Cleanup dataset UT: unskip and enhance TFRecord sharding tests
Merge pull request !1307 from cathwong/ckw_dataset_ut_unskip2
2020-05-22 03:21:45 +08:00
wangnan39@huawei.com 1ebf98b795 add model init api to compile df graph before exec 2020-05-21 22:21:49 +08:00
buxue e490618db8 support tensor get value by tensor index
support tensor set value by tensor index
2020-05-21 21:05:35 +08:00
Yi Huaijie 7a5004cc49 init the slices of a Initialzer on different devices 2020-05-21 20:43:15 +08:00
zhouneng 218ade30b2 add vm support sin and cumsum 2020-05-21 17:26:01 +08:00
mindspore-ci-bot 2224fa093b !1302 Complete vm ops for BinaryCrossEntropy and BinaryCrossEntropyGrad
Merge pull request !1302 from lihongkang/master
2020-05-21 17:00:09 +08:00
mindspore-ci-bot b96a2ed816 !1312 support vm for erfc
Merge pull request !1312 from jiangjinsheng/vm_erfc
2020-05-21 16:59:56 +08:00
mindspore-ci-bot bddd743ca9 !1304 Add check for controldepend
Merge pull request !1304 from amongo/AddCheckForControlDepend
2020-05-21 16:09:46 +08:00
jiangjinsheng 2d3cd8276e vm for erfc 2020-05-21 10:08:23 +08:00
qianlong 451c20a6f5 Add UnicodeCharTokenizer for nlp 2020-05-21 09:22:45 +08:00
mindspore-ci-bot 93e7c97a96 !1272 [Dataset] MindData Tree Optimizer Infrastructure
Merge pull request !1272 from JunhanHu/minddata_opt
2020-05-21 05:29:00 +08:00
Cathy Wong b78894e02b Cleanup dataset UT: unskip and enhance TFRecord sharding tests 2020-05-20 17:05:38 -04:00
Junhan Hu f44d213503 MindData optimizer infrastructure. 2020-05-20 16:11:26 -04:00
huangdongrun 3e2074b113 add check for ControlDepend 2020-05-20 22:48:00 +08:00
mindspore-ci-bot 233508b70e !1250 Dict_setitem transofrm to tuple_setitem
Merge pull request !1250 from amongo/SupportDictSetItemTransform
2020-05-20 21:37:26 +08:00
lihongkang cf543382aa add vms for binarycrossentropy and binarycrossentropygrad 2020-05-20 20:28:56 +08:00
mindspore-ci-bot 183144e135 !1282 support vm for PReLU and PReLUGrad
Merge pull request !1282 from jiangjinsheng/vm_prelu
2020-05-20 17:08:03 +08:00
xulei2020 163b6b7ea7 add jieba c++ code 2020-05-20 15:55:12 +08:00
mindspore-ci-bot 89470cf29d !1263 Modified clip_gradients to clip_grad
Merge pull request !1263 from Kang/master
2020-05-20 14:15:05 +08:00
Kang bfff7c0a2f Modified clip_gradients to clip_grad 2020-05-20 11:58:47 +08:00
jiangjinsheng ce09f5e15a vm for prelu and prelugrad 2020-05-20 11:21:56 +08:00
huangdongrun 3cf94daefc add support for dict setitem operation
format code

remove save_graph

raise exception when dictionary setitem if the key not exists

resolve error

remove unnessary op_
2020-05-20 09:58:30 +08:00
jiangjinsheng ba99cb7bcb support vm for space_to_depth 2020-05-20 09:47:12 +08:00
Tinazhang 17cecf2cf5 Added TCs to RandomCrop and RandomCropAndResize and modified visalize() calling 2020-05-19 15:42:24 -04:00
mindspore-ci-bot fe8b59f26b !1111 support vm for pack and unpack
Merge pull request !1111 from jiangjinsheng/vm_pack
2020-05-19 21:36:16 +08:00
Wei Luning 3db8cfa54f add pattern AdjustAllReduceMulAdduse the old opadd test case for bugtemp fix try 2020-05-19 18:46:11 +08:00
jiangjinsheng f9bd460c96 support vm for pack 2020-05-19 16:52:41 +08:00
mindspore-ci-bot 18c9495000 !1228 Adapt tbe op UnsortedSegmentMin for GE.
Merge pull request !1228 from liuxiao/UnsortedSegmentMin
2020-05-19 09:04:22 +08:00
liuxiao cc024bb3a1 UnsortedSegmentMin for GE 2020-05-18 20:49:58 +08:00
zhaojichen d1d1766bed add squaresumall op 2020-05-18 08:01:22 -04:00
mindspore-ci-bot 1b7cdc4c61 !1218 clean pylint warning in test about import
Merge pull request !1218 from jinyaohui/pylint1
2020-05-18 19:54:04 +08:00
jinyaohui 5a914994ba clean pylint 2020-05-18 16:42:35 +08:00
yangzhenzhang 6b54a6417d ckpt and restore parameter shape 2020-05-18 15:16:29 +08:00
jinyaohui bcfaff97f9 clean pylint 2020-05-18 10:31:46 +08:00
mindspore-ci-bot 051567ba20 !1192 Support string type Stage !
Merge pull request !1192 from h.farahat/string_Tensor
2020-05-18 09:51:17 +08:00
mindspore-ci-bot 4efa9717bb !1129 Add op bounding box encoder
Merge pull request !1129 from zhaozhenlong/op/bounding-box-encoder
2020-05-18 09:04:59 +08:00