Commit Graph

3732 Commits

Author SHA1 Message Date
mindspore-ci-bot 831ceba6eb !1277 Fixing some tiny faults about Pylint in ME code
Merge pull request !1277 from liuwenhao/master
2020-05-26 11:08:10 +08:00
Yang abca62f407 10:00 26/5 clean pylint 2020-05-26 10:05:12 +08:00
mindspore-ci-bot 93fc82b8f7 !1447 remove unused variable
Merge pull request !1447 from yihuaijie/master
2020-05-26 09:17:48 +08:00
mindspore-ci-bot 0b191615a9 !1427 fix check bprop attr error
Merge pull request !1427 from panyifeng/fix_check_bprop_attr_error
2020-05-26 09:10:51 +08:00
mindspore-ci-bot 0a8ef2fe72 !1455 Cleanup dataset UT: restore config support
Merge pull request !1455 from cathwong/ckw_dataset_config_util
2020-05-26 05:40:39 +08:00
Cathy Wong f891e1755c Cleanup dataset UT: restore config support 2020-05-25 15:10:03 -04:00
mindspore-ci-bot aeb4c52f2d !1379 Creating new UTs to three vision transformation ops
Merge pull request !1379 from Tinazhang/linearTrans
2020-05-25 23:10:30 +08:00
liuwenhao4 f3f0cbaeee Fixing some tiny faults about Pylint in my code(ops) 2020-05-25 21:27:45 +08:00
“liuxiao” 382a0124c3 pylint clean 2020-05-25 21:16:04 +08:00
mindspore-ci-bot 44bf7c9330 !1414 fix issue use reshape as flatten grad impl
Merge pull request !1414 from zhaozhenlong/fix-issues-reshape-replace-flattern-grad
2020-05-25 20:45:46 +08:00
Yi Huaijie ac484ebbc0 remove unused variable 2020-05-25 19:59:28 +08:00
“liuxiao” 18f0af0529 pylint clean 2020-05-25 19:49:06 +08:00
mindspore-ci-bot 1c8548adb8 !1300 Add TBE op RangeD for GE.
Merge pull request !1300 from liuxiao/RangeD
2020-05-25 17:04:53 +08:00
zhaozhenlong 30b93ecbf8 use reshape as flatten grad 2020-05-25 16:57:26 +08:00
panyifeng 6a57eeb922 fix check_bprop attr error 2020-05-25 16:52:30 +08:00
Yi Huaijie 0b137e5312 delete unused arguments in test cases 2020-05-25 15:46:05 +08:00
liuxiao 627724a205 Add RangeD for GE 2020-05-25 14:49:49 +08:00
Yi Huaijie 8cfc05e4cf clean pylint warnings of parallel test cases 2020-05-25 11:08:29 +08:00
mindspore-ci-bot 0e665616f0 !1160 add backward hook and custom bprop in pynative mode
Merge pull request !1160 from wangqiuliang/add-backward-hook-in-pynative-mode
2020-05-24 18:09:48 +08:00
kingfo 840922e501 add backward hook function in pynative mode 2020-05-24 13:32:44 +08:00
mindspore-ci-bot 718a96430f !1389 Security issues in recent string tensor PR
Merge pull request !1389 from h.farahat/fix_security_issues
2020-05-24 08:45:21 +08:00
mindspore-ci-bot a6b8451a33 !1380 make ShuffleOp have deterministic behavior for subsequent epochs
Merge pull request !1380 from Peilin/shuffle-subsequent-epoch-deterministic
2020-05-23 21:02:30 +08:00
mindspore-ci-bot ad9db524bb !1394 Fix comment error and mod parameter check in graphdata
Merge pull request !1394 from heleiwang/fix_comments_error
2020-05-23 19:47:19 +08:00
heleiwang f28f883cac fix comments error and modify parameter check 2020-05-23 18:31:13 +08:00
mindspore-ci-bot e87e6b38b0 !1355 [AutoParallel]Fix GatherV2 distributed op
Merge pull request !1355 from lichen/fix_gatherv2
2020-05-23 17:04:41 +08:00
lichenever 390a86effb fix gatherv2 2020-05-23 15:38:50 +08:00
hesham c0f0e154f5 Clean up work for text python package 2020-05-22 23:53:34 -04:00
mindspore-ci-bot 45368a86e9 !1329 Put the parameter validation of the Summary operator into the python layer
Merge pull request !1329 from ougongchang/master
2020-05-23 11:41:34 +08:00
jonyguo 78cc0d5d8d Merge branch 'incubator-master' into sync_d9c74e0a 2020-05-23 11:03:41 +08:00
mindspore-ci-bot 41456ac824 !1369 dataset: delete StorageDataset
Merge pull request !1369 from ms_yan/del_storage
2020-05-23 10:39:34 +08:00
Tinazhang 7322839b04 add UTs for LinearTransformation, ToPIL, ToType 2020-05-22 18:04:09 -04:00
Peilin Wang 0cbcc7200b made shuffle determinisitc for subsequent epochs 2020-05-22 17:03:19 -04:00
mindspore-ci-bot 61639be1e0 !1375 Cleanup dataset UT: remove num_parallel_workers=1 in test_exception
Merge pull request !1375 from cathwong/ckw_dataset_ut_cleanup5
2020-05-22 23:54:52 +08:00
mindspore-ci-bot a528797253 !1377 Code Fix for Uniform Augmentation
Merge pull request !1377 from Tinazhang/cc
2020-05-22 23:20:01 +08:00
mindspore-ci-bot 458436186c !1365 Clean up work for text python sub-package
Merge pull request !1365 from h.farahat/text_namespace
2020-05-22 23:16:31 +08:00
Tinazhang b390883c6a Bug fix 2020-05-22 10:56:56 -04:00
Cathy Wong 702005d403 Cleanup dataset UT: remove num_parallel_workers=1 in test_exception 2020-05-22 09:28:17 -04:00
ougongchang 7d78b5d89e Put the parameter validation of the Summary operator into the python layer
add some unittest for summary operator

support ScalarSummary to record number type
2020-05-22 21:23:43 +08:00
ms_yan d5e896b51c delete storageDataset Op API and its test case 2020-05-22 21:23:24 +08:00
mindspore-ci-bot 6f733ec113 !1308 Stage 2 of adding support for string Tensor
Merge pull request !1308 from h.farahat/string_tensor2
2020-05-22 21:17:53 +08:00
xiefangqi 34236ce1f1 fix pylint 2020-05-22 20:18:21 +08:00
mindspore-ci-bot d402b94476 !1370 delete parallel end-to-end test cases
Merge pull request !1370 from yihuaijie/master
2020-05-22 20:01:49 +08:00
mindspore-ci-bot 3363d4e834 !1249 Add GNN dataset processing API
Merge pull request !1249 from heleiwang/hlw_gnn_data
2020-05-22 18:49:36 +08:00
mindspore-ci-bot f3d14fa14b !1363 Restrict tensor get item or set item not support mixed tensor.
Merge pull request !1363 from zhangbuxue/Not_support_mixed_tensor_as_index_for_tensor_getitem_and_setitem
2020-05-22 18:04:31 +08:00
Yi Huaijie 1e6ee83874 delete parallel end-to-end test cases 2020-05-22 17:35:18 +08:00
mindspore-ci-bot 3f23aa1d79 !1348 fix pylint warnings of parallel test cases
Merge pull request !1348 from yihuaijie/master
2020-05-22 16:40:42 +08:00
hesham 6c21e556c4 Clean up work for text python package 2020-05-22 04:35:58 -04:00
mindspore-ci-bot 368007240c !1320 add applyrmsprop cumprod and reduceprod for vm
Merge pull request !1320 from JichenZhao/applyrms_squaresumall_cumprod_reduceprod
2020-05-22 16:33:31 +08:00
mindspore-ci-bot 62c716b68e !1349 Fix some functions in group parameters and optimizer
Merge pull request !1349 from ghzl/add-group-check-for-lars
2020-05-22 16:05:36 +08:00
buxue 850171a34b Restrict tensor getitem or setitem not support mixed tensor. 2020-05-22 15:55:38 +08:00
Yi Huaijie 14fe72f383 fix pylint warnings 2020-05-22 14:54:36 +08:00
mindspore-ci-bot bd845dd0b7 !1352 [MD] fix bug when append data in mindrecord using absolute path
Merge pull request !1352 from liyong126/mindrecord_fix_bug_I1HQUI
2020-05-22 14:25:15 +08:00
heleiwang 599a449e0b Support processing GNN data 2020-05-22 14:15:25 +08:00
jinyaohui fbdba6e4da clean pylint 2020-05-22 13:23:13 +08:00
hesham df361d1d26 Change mem layout of string tensor
add support for MindRecord and TFRecord
----
optimize tensorshape

optimize tensorshape and FlatIndex

TFRecord and MindRecord support for string tensor

Modify mem layout
Add new constructor
Add method Allocate

Change some GetMutableBuffer usages to AllocateBuffer
2020-05-22 01:22:29 -04:00
liyong 447420eb9a fix bug when append data by absolute path 2020-05-22 11:27:56 +08:00
guohongzilong 2d2f9ba8fd fix group parameter code for check 2020-05-22 11:05:45 +08:00
zhaojichen a42ec8f69f add applyrmsprop op for vm 2020-05-21 23:02:32 -04:00
mindspore-ci-bot 58e6d7d950 !1341 Added lookup and vocab to mindspore.dataset.text
Merge pull request !1341 from ZiruiWu/vocab_and_lookup
2020-05-22 10:19:42 +08:00
mindspore-ci-bot decf12cd0b !1317 [MD]add compress for nlp data in mindrecord
Merge pull request !1317 from liyong126/mindrecord_compress
2020-05-22 10:05:09 +08:00
mindspore-ci-bot 274f6f014f !1133 support tensor get value by tensor index
Merge pull request !1133 from zhangbuxue/support_tensor_get_value_by_tensor_index
2020-05-22 10:02:35 +08:00
mindspore-ci-bot 0a795c24aa !1245 add model init api to compile df graph before train
Merge pull request !1245 from wangnan39/add_model_init_api_to_compile_df_graph_before_train_and_eval
2020-05-22 09:51:19 +08:00
jonwe bb51bb88d7 add compress in mindrecord 2020-05-22 09:37:51 +08:00
mindspore-ci-bot 2e3d55ed87 !1281 Implementation of SplitOp
Merge pull request !1281 from Peilin/splitOp
2020-05-22 09:29:03 +08:00
mindspore-ci-bot 39b9aedf68 !1342 Bug fix on issue Core dump on GPU when train with lenet with AU
Merge pull request !1342 from Tinazhang/cc
2020-05-22 09:18:49 +08:00
mindspore-ci-bot 0ca626ef6c !1229 Init the slices of a Initializer on different devices
Merge pull request !1229 from yihuaijie/master
2020-05-22 08:57:58 +08:00
Peilin Wang 71e8bb1960 general split case done, chaining sampler (basic case) is working
implementation 99% complete

everything and tested except for repeatable shuffling

tested most basic/typical split usecases

cleanup

some more cleanup

fix CI

more ci fix

more ci fixes

more ci fix

more ci fix

more ci fix

added more tests, fixed some bugs

some more clean up and test cases

added shard/shuffle before split warning/error

addressed code review comments and ci

fixed ci
2020-05-21 20:42:51 -04:00
Tinazhang e9e40b688b Bug fix 2020-05-21 18:20:00 -04:00
Zirui Wu 25ab2ef303 Implemented lookup and vocab 2020-05-21 17:17:24 -04:00
mindspore-ci-bot 46949fc327 !1307 Cleanup dataset UT: unskip and enhance TFRecord sharding tests
Merge pull request !1307 from cathwong/ckw_dataset_ut_unskip2
2020-05-22 03:21:45 +08:00
wangnan39@huawei.com 1ebf98b795 add model init api to compile df graph before exec 2020-05-21 22:21:49 +08:00
buxue e490618db8 support tensor get value by tensor index
support tensor set value by tensor index
2020-05-21 21:05:35 +08:00
Yi Huaijie 7a5004cc49 init the slices of a Initialzer on different devices 2020-05-21 20:43:15 +08:00
zhouneng 218ade30b2 add vm support sin and cumsum 2020-05-21 17:26:01 +08:00
mindspore-ci-bot 2224fa093b !1302 Complete vm ops for BinaryCrossEntropy and BinaryCrossEntropyGrad
Merge pull request !1302 from lihongkang/master
2020-05-21 17:00:09 +08:00
mindspore-ci-bot b96a2ed816 !1312 support vm for erfc
Merge pull request !1312 from jiangjinsheng/vm_erfc
2020-05-21 16:59:56 +08:00
mindspore-ci-bot bddd743ca9 !1304 Add check for controldepend
Merge pull request !1304 from amongo/AddCheckForControlDepend
2020-05-21 16:09:46 +08:00
jiangjinsheng 2d3cd8276e vm for erfc 2020-05-21 10:08:23 +08:00
qianlong 451c20a6f5 Add UnicodeCharTokenizer for nlp 2020-05-21 09:22:45 +08:00
mindspore-ci-bot 93e7c97a96 !1272 [Dataset] MindData Tree Optimizer Infrastructure
Merge pull request !1272 from JunhanHu/minddata_opt
2020-05-21 05:29:00 +08:00
Cathy Wong b78894e02b Cleanup dataset UT: unskip and enhance TFRecord sharding tests 2020-05-20 17:05:38 -04:00
Junhan Hu f44d213503 MindData optimizer infrastructure. 2020-05-20 16:11:26 -04:00
huangdongrun 3e2074b113 add check for ControlDepend 2020-05-20 22:48:00 +08:00
mindspore-ci-bot 233508b70e !1250 Dict_setitem transofrm to tuple_setitem
Merge pull request !1250 from amongo/SupportDictSetItemTransform
2020-05-20 21:37:26 +08:00
lihongkang cf543382aa add vms for binarycrossentropy and binarycrossentropygrad 2020-05-20 20:28:56 +08:00
mindspore-ci-bot 183144e135 !1282 support vm for PReLU and PReLUGrad
Merge pull request !1282 from jiangjinsheng/vm_prelu
2020-05-20 17:08:03 +08:00
xulei2020 163b6b7ea7 add jieba c++ code 2020-05-20 15:55:12 +08:00
mindspore-ci-bot 89470cf29d !1263 Modified clip_gradients to clip_grad
Merge pull request !1263 from Kang/master
2020-05-20 14:15:05 +08:00
Kang bfff7c0a2f Modified clip_gradients to clip_grad 2020-05-20 11:58:47 +08:00
jiangjinsheng ce09f5e15a vm for prelu and prelugrad 2020-05-20 11:21:56 +08:00
huangdongrun 3cf94daefc add support for dict setitem operation
format code

remove save_graph

raise exception when dictionary setitem if the key not exists

resolve error

remove unnessary op_
2020-05-20 09:58:30 +08:00
jiangjinsheng ba99cb7bcb support vm for space_to_depth 2020-05-20 09:47:12 +08:00
Tinazhang 17cecf2cf5 Added TCs to RandomCrop and RandomCropAndResize and modified visalize() calling 2020-05-19 15:42:24 -04:00
mindspore-ci-bot fe8b59f26b !1111 support vm for pack and unpack
Merge pull request !1111 from jiangjinsheng/vm_pack
2020-05-19 21:36:16 +08:00
Wei Luning 3db8cfa54f add pattern AdjustAllReduceMulAdduse the old opadd test case for bugtemp fix try 2020-05-19 18:46:11 +08:00
jiangjinsheng f9bd460c96 support vm for pack 2020-05-19 16:52:41 +08:00
mindspore-ci-bot 18c9495000 !1228 Adapt tbe op UnsortedSegmentMin for GE.
Merge pull request !1228 from liuxiao/UnsortedSegmentMin
2020-05-19 09:04:22 +08:00
liuxiao cc024bb3a1 UnsortedSegmentMin for GE 2020-05-18 20:49:58 +08:00
zhaojichen d1d1766bed add squaresumall op 2020-05-18 08:01:22 -04:00
mindspore-ci-bot 1b7cdc4c61 !1218 clean pylint warning in test about import
Merge pull request !1218 from jinyaohui/pylint1
2020-05-18 19:54:04 +08:00
jinyaohui 5a914994ba clean pylint 2020-05-18 16:42:35 +08:00
yangzhenzhang 6b54a6417d ckpt and restore parameter shape 2020-05-18 15:16:29 +08:00
jinyaohui bcfaff97f9 clean pylint 2020-05-18 10:31:46 +08:00
mindspore-ci-bot 051567ba20 !1192 Support string type Stage !
Merge pull request !1192 from h.farahat/string_Tensor
2020-05-18 09:51:17 +08:00
mindspore-ci-bot 4efa9717bb !1129 Add op bounding box encoder
Merge pull request !1129 from zhaozhenlong/op/bounding-box-encoder
2020-05-18 09:04:59 +08:00
mindspore-ci-bot 6de7eb2633 !1203 delete ApplyAdamD for master
Merge pull request !1203 from changzherui/code516
2020-05-17 20:14:06 +08:00
changzherui 1e93927772 code 516 for test 2020-05-17 15:28:17 +08:00
mindspore-ci-bot c3d9f18087 !1176 fix validator for transpose
Merge pull request !1176 from jiangjinsheng/issue_transpose
2020-05-16 19:10:35 +08:00
mindspore-ci-bot c169ac6a18 !1195 add validate for geswitch and merge
Merge pull request !1195 from jiangjinsheng/issue_geswitch
2020-05-16 18:43:19 +08:00
jiangjinsheng e45532b78c fixed transpose 2020-05-16 18:07:52 +08:00
jiangjinsheng c05203ef06 add validate for geswitch and merge 2020-05-16 17:49:21 +08:00
mindspore-ci-bot 0040764dec !1100 delete some context param(enable_loop_sink,enable_mem_reuse,enable_auto_mixed_precision)
Merge pull request !1100 from jinyaohui/context_opt_2
2020-05-16 15:38:40 +08:00
jinyaohui 2907cf4488 remove some context param 2020-05-16 15:07:13 +08:00
zhaozhenlong b54ffdc086 add op BoundingBoxDecode
iou

NMSWithMask

larsupdate testcase

sgd testcase
2020-05-16 02:40:16 -04:00
mindspore-ci-bot 92d196f054 !1178 Complete vm ops for ROIAlign and ROIAlignGrad
Merge pull request !1178 from zhouneng/add_vm_support_roialign
2020-05-16 11:15:13 +08:00
hesham e8ca243364 -Add DE_STRING
-replace switch'case by indexing

- Add test case
- Add constructors
- Add getItem string

- Fix bugs
- Add more tests

- Tensor iterator
- asNumpy
- TextFileDataset

- Tensor(Numpy)

- Super > 2D
- Add more test cases for GeneratorDataset

- Change StartAddr to GetBuffer and GetMutableNuffer

- Raise an error if batch is used with strings

Clean-up work
2020-05-15 20:33:28 -04:00
jiangzhiwen cb2814b498 flat_map first commit 2020-05-15 17:45:39 +08:00
mindspore-ci-bot c680cfbf27 !1157 dataset: add concat operation for dataset
Merge pull request !1157 from ms_yan/concat_dataset
2020-05-15 16:07:19 +08:00
mindspore-ci-bot ab031ee9ea !1126 VOCDataset support object detection function
Merge pull request !1126 from xiefangqi/voc_support_detection
2020-05-15 15:56:39 +08:00
zhouneng c2a1b5f8c1 add register info for ROIAlign and ROIAlignGrad 2020-05-15 14:58:33 +08:00
xiefangqi c937bad53f minddata support voc 2020-05-15 13:24:03 +08:00
ms_yan c0fa7b4b19 init commit of concat dataset
change to use __add__ operation instead ds.concat
2020-05-15 13:14:13 +08:00
jiangjinsheng 766906dd6d support vm for flatten 2020-05-15 10:30:58 +08:00
mindspore-ci-bot 8a853cec2d !1171 adjust onnx related testcases
Merge pull request !1171 from fary86/adjust_onnx_related_uts
2020-05-15 09:46:11 +08:00
mindspore-ci-bot bb374ebc28 !1015 Support weights to be compiled according to shape
Merge pull request !1015 from candanzg/me_with_shape
2020-05-15 09:13:41 +08:00
fary86 fe2ee14340 Adjust onnx exporting related testcases 2020-05-15 03:21:29 +08:00
mindspore-ci-bot a9816fa779 !1026 Add Logsigmoid and Reduce_logsumexp
Merge pull request !1026 from peixu_ren/custom_pp_ops
2020-05-14 22:02:58 +08:00
jonyguo be2e7531ca fix: MindDataset parameter shard_id & num_shards check 2020-05-14 17:18:11 +08:00
panyifeng 755ba75deb fix pylint 2020-05-14 14:22:52 +08:00
mindspore-ci-bot 4bb5c7b39a !1084 add new interface quant combined
Merge pull request !1084 from SanjayChan/04quant
2020-05-14 11:19:00 +08:00
peixu_ren 99fda6f431 Add logsigmoid and reduce_logsumexp 2020-05-13 23:52:10 -03:00
mindspore-ci-bot a2a3b1c6c5 !1089 Add Optimizer method get_lr_parameter
Merge pull request !1089 from ghzl/add-get-lr-base-on-parameter
2020-05-14 09:40:31 +08:00
Cathy Wong 913074e656 Cleanup dataset UT: resolve skipped test units 2020-05-13 14:41:57 -04:00
mindspore-ci-bot 6b68671805 !1069 Use a resident process to write summary files and SummaryRecord as context manager
Merge pull request !1069 from 李鸿章/context_manager
2020-05-13 22:44:39 +08:00
李鸿章 32c1d558f4 SummaryRecord as context manager 2020-05-13 21:53:24 +08:00
mindspore-ci-bot 7e3ec651dc !1094 Complete vm ops for L2Normalize and L2NormalizeGrad
Merge pull request !1094 from zhouneng/add_vm_support_l2normalize
2020-05-13 21:52:45 +08:00
candanzg 2cc85bdc93 Support weight compile according to shape
Signed-off-by: candanzg <zhangshucheng@huawei.com>
2020-05-13 17:49:07 +08:00
mindspore-ci-bot 21bcdcd8ad !1121 Complete vm ops for ResizeBilinear and ResizeBilinearGrad
Merge pull request !1121 from lihongkang/master
2020-05-13 17:43:04 +08:00
chenzomi 1239cd6135 Merge branch 'master' into 04quant 2020-05-13 17:31:50 +08:00
guohongzilong e70b2f5430 add optimizer.get_lr_parameter() method 2020-05-13 17:21:22 +08:00
chenzomi bf6246e617 add quant combined 2020-05-13 17:05:45 +08:00
mindspore-ci-bot 1a98c6b459 !999 [MD] mindrecord support reading file list
Merge pull request !999 from liyong126/mindrecord_file_list
2020-05-13 15:53:26 +08:00
mindspore-ci-bot 25b2424f9b !1042 clean pylint warning in test_framwork dir
Merge pull request !1042 from jinyaohui/clean_pylint
2020-05-13 14:51:36 +08:00
lihongkang ca8a914736 接入算子resizebilinear and resizebilineargrad 2020-05-13 14:27:35 +08:00
mindspore-ci-bot 6f386c5782 !1082 Support 'break', 'continue' and 'pass' statements
Merge pull request !1082 from hewei/support_cont_break
2020-05-13 14:19:28 +08:00
liyong aa3f89e74f mindrecord support read file list 2020-05-13 14:11:59 +08:00
He Wei 33fa90efc9 Support 'break', 'continue' and 'pass'
To handle 'break' and 'continue' statement, a loop context is pushed
to a stack before we parse the loop body, and pop it after body parsed.
When a 'break', 'continue' statement is encountered, we retrieve current
loop contex from the stack, and let the current block jump to the end
block or header block;

For 'break' statement, we added an extra 'end_block' follow the 'after_block',
because 'after_block' is called from a ContionalJump in 'header_block', it can
not be set as jump target from other place. to support 'break', we let loop
body jump to the 'end_block' at the 'break' point. and 'after_block'
maybe a good place to handle loop 'else' clause in the future.

Handle 'pass' is simple, just bypass it when doing parse.
2020-05-13 12:53:07 +08:00
mindspore-ci-bot 0345995000 !1110 [AutoParallel]fix gatherv2 and dataset bug
Merge pull request !1110 from lichen/fix_gatherv2_and_dataset_bug
2020-05-13 11:42:09 +08:00
jinyaohui 26fd75895d pylint waring clean 2020-05-13 11:30:27 +08:00
mindspore-ci-bot 18019ad6a5 !1038 clean some context param
Merge pull request !1038 from jinyaohui/clean_context
2020-05-13 09:54:43 +08:00
lichenever debfd38b75 fix gatherv2 and dataset bug 2020-05-13 09:44:37 +08:00
mindspore-ci-bot ba3d48817e !1070 Adapt aicpu op CTCLoss and TBE op L2Loss for GE.
Merge pull request !1070 from liuxiao/ops-for-VM
2020-05-13 09:43:42 +08:00
jinyaohui 391a060f21 remove two context param 2020-05-12 22:11:50 +08:00
mindspore-ci-bot 48e54dcfda !1056 [Auto parallel] Memory calculation in the inference phase
Merge pull request !1056 from Xiaoda/memory-estimation-in-inference-phase
2020-05-12 17:21:05 +08:00
zhouneng 79725af4cd 为L2Normalize/L2NormalizeGrad增加VM支持 2020-05-12 16:46:02 +08:00
liuxiao 10abb68498 add ops CTCLoss 2020-05-12 15:58:51 +08:00
mindspore-ci-bot fdad91355f !1093 reset parallel context before running each parallel test case
Merge pull request !1093 from yihuaijie/master
2020-05-12 15:57:55 +08:00
mindspore-ci-bot da7d605e85 !683 WIP: specialize hyper map parameter
Merge pull request !683 from xychow/bypass-renorm-and-specialize-hypermap-parameter
2020-05-12 15:50:00 +08:00
mindspore-ci-bot 6ab046e4dd !1062 Adapt Softplus\SoftplusGrad for VM, and ApplyFtrlD for both GE and VM.
Merge pull request !1062 from liuxiao/softplus-softplusgrad
2020-05-12 15:35:56 +08:00
Xiaoda Zhang a05aa21cc2 calculating PEAK memory cost in the inference phase 2020-05-12 15:30:59 +08:00
mindspore-ci-bot 06a9eeb3bf !1050 [bug][auto_mixed_precision]fix sens shape error of `TrainOneStepWithLossScaleCell`
Merge pull request !1050 from vlne-v1/I1GEPN-check-bprop-error-loss-scale-wrap
2020-05-12 15:23:46 +08:00
Yi Huaijie 462f30e077 reset auto parallel context before each test 2020-05-12 14:59:45 +08:00
mindspore-ci-bot 98112d1a64 !997 support vm for log1p
Merge pull request !997 from jiangjinsheng/log1p
2020-05-12 14:21:14 +08:00
Wei Luning 3e89f7baaa fix sens shape error in loss_scale one_step_wrap 2020-05-12 14:09:51 +08:00
mindspore-ci-bot 28a6daaed5 !1017 add profiling_mode and profiling_options to context
Merge pull request !1017 from jinyaohui/context_opt
2020-05-12 11:55:14 +08:00
jiangjinsheng c36e7f1564 support vm for log1p 2020-05-12 11:46:18 +08:00
mindspore-ci-bot 8003a89a7b !766 bugfix(SA): Add the support of nested loop.
Merge pull request !766 from gongchen/nest_loop
2020-05-12 11:10:53 +08:00
mindspore-ci-bot fd72534a1c !1065 Seperate lr groups and weight_decay groups
Merge pull request !1065 from ghzl/improve-parameter-groups
2020-05-12 10:13:05 +08:00
mindspore-ci-bot 4fe6ddebd1 !1075 Cleanup dataset UT: util.py internals
Merge pull request !1075 from cathwong/ckw_dataset_ut_cleanup3
2020-05-12 09:58:14 +08:00
jinyaohui 5a9de3716d add profiling mode and profiling options to context 2020-05-12 09:53:08 +08:00
zhousiyi 047ac018da specialize hypermap paramater 2020-05-12 01:51:57 +00:00
mindspore-ci-bot 4a8fcf5d76 !1055 support vm for floor
Merge pull request !1055 from jiangjinsheng/vm_floor
2020-05-12 09:20:16 +08:00
mindspore-ci-bot 05e8b8028b !1060 Fix bug of assigning value to non-Parameter class member
Merge pull request !1060 from fary86/fix_assign_target_not_parameter
2020-05-12 09:20:08 +08:00
mindspore-ci-bot 66667d727e !1034 Gpu Support Dropout operator
Merge pull request !1034 from SanjayChan/dropout
2020-05-12 09:11:30 +08:00
Cathy Wong 49ef53f164 Cleanup dataset UT: util.py internals 2020-05-11 14:44:24 -04:00
mindspore-ci-bot 2af6ee2482 !1054 Add slice shape for param info
Merge pull request !1054 from yangzhenzhang/add-slice-shape-for-param-info
2020-05-11 21:29:40 +08:00
guohongzilong c95215bca0 seperate lr groups and weight_decay groups 2020-05-11 21:27:30 +08:00
liuxiao 4335e9bc83 adapt Softplus\SoftplusGrad\ApplyFtrlD for VM 2020-05-11 20:45:12 +08:00
fary86 16b9004d53 Fix bug of assign value to non Parameter class member 2020-05-11 20:15:34 +08:00
mindspore-ci-bot 5ff79d0204 !1048 Support index to switch_layer
Merge pull request !1048 from panyifeng/index_to_switch_case
2020-05-11 19:30:13 +08:00
chenzomi 661f9dfaf8 add dropout primtive 2020-05-11 19:29:18 +08:00
mindspore-ci-bot 57085bb18d !996 [Auto parallel] Supporting VirtualDataset having three inputs
Merge pull request !996 from Xiaoda/supporting-virtualdataset-has-three-inputs
2020-05-11 18:59:09 +08:00
jiangjinsheng 2fa654e65c support vm for floor 2020-05-11 16:17:20 +08:00
yangzhenzhang 05fde3d23d add slice shape for param info 2020-05-11 16:01:55 +08:00
panyifeng 065e25e1bb Support index to switch_layer 2020-05-11 15:52:30 +08:00
yao_yf 716def7c0a move InferStraByTensorInfo to tensor_info.h 2020-05-11 14:44:06 +08:00
mindspore-ci-bot dd2062bf8d !1023 add_gatherv2_distributed_op
Merge pull request !1023 from lichen/add_gatherv2_distributed_op
2020-05-11 09:18:10 +08:00
mindspore-ci-bot 8a45ab1125 !906 fix a bug that support dilation greater than 1 in conv2dTranspose ops
Merge pull request !906 from yangyongjie/master
2020-05-09 21:58:27 +08:00
mindspore-ci-bot 22632f2f09 !977 reshape operator support auto strategy search
Merge pull request !977 from yao_yf/reshape_auto_parallel_strategy_search
2020-05-09 17:47:24 +08:00
lichenever 19a24b86ac add gatherv2 distributed op 2020-05-09 17:20:50 +08:00
mindspore-ci-bot 68372231bb !1031 Support transform valuetuple of nested graph to make tuple
Merge pull request !1031 from amongo/ValueTupleOfNestedGraph
2020-05-09 17:15:54 +08:00
yao_yf f0bf438a55 reshape strategy search 2020-05-09 17:00:37 +08:00
gongchen 425a207663 bug(SA): Add the support of nested loop. 2020-05-09 16:18:16 +08:00
guohongzilong 0b8cea8018 learning rate and weight decay support group mode 2020-05-09 15:57:58 +08:00
huangdongrun 0e89813759 add resolve
transform valuetuple to maketuple of graphs

add testcase
2020-05-09 14:30:19 +08:00
mindspore-ci-bot affdd22de3 !967 Add switch_case primitive
Merge pull request !967 from panyifeng/switch_case_primitive
2020-05-09 14:14:25 +08:00
Xiaoda Zhang 5e041966f1 add a new vritualdataset cell for three inputs 2020-05-09 11:10:33 +08:00
mindspore-ci-bot 0eb32593a6 !958 Add parallel mode configuration for cell
Merge pull request !958 from yangzhenzhang/add_parallel_mode_for_cell
2020-05-09 09:45:25 +08:00
panyifeng b7596e1f33 Add switch_case primitive 2020-05-09 09:38:17 +08:00
mindspore-ci-bot 2860fd9338 !984 Add unit test case for HWC2CHW.
Merge pull request !984 from Tinazhang/hwc2chw
2020-05-09 05:02:41 +08:00
Tinazhang c8b5586c7f add unit test for HWC2CHWC 2020-05-08 13:17:20 -04:00
Cathy Wong 58226addd6 Cleanup dataset UT: use md5 npz in test_zip for images 2020-05-08 11:25:48 -04:00
mindspore-ci-bot 47f5abceb4 !960 Adding example for grayscale
Merge pull request !960 from EricZ/grayscale_fix
2020-05-08 05:08:15 +08:00
mindspore-ci-bot 078dd86cfe !507 Implemented padded_batch
Merge pull request !507 from ZiruiWu/batch_with_padding
2020-05-08 04:54:05 +08:00
mindspore-ci-bot de7625777f !951 fix: MindDataset with columns_name parameter cause errors in some scenes
Merge pull request !951 from guozhijian/fix_read_by_columns
2020-05-08 04:51:03 +08:00
eric 0f0548f21b Added test case for grayscale support 2020-05-07 15:09:57 -04:00
Zirui Wu c2d364a573 batch with padding implemented
support for 1 specific dimension to be None, added validator

fix various CI complains

another round of CI fixes

ci

refactor parts of the code

code refactor

ci fix

comments added, fix bugs

address review comments

address review comments

review cmts

added simple perf test script

update pad code

perf imprv
2020-05-07 11:18:42 -04:00
mindspore-ci-bot 16930c562d !969 [MD] fix bug in pk sampler of minddataset
Merge pull request !969 from liyong126/fix_mindrecord_pk_sampler
2020-05-07 23:01:46 +08:00
liuxiao e97d33f772 add ops for VM 2020-05-07 20:14:18 +08:00
yangzhenzhang 8c9730b3c5 add parallel mode for cell 2020-05-07 20:11:20 +08:00
mindspore-ci-bot 7c64048d76 !935 develop op ScatterMax and dock ge process
Merge pull request !935 from zhangbuxue/develop_scatter_max_op_and_dock_ge
2020-05-07 19:35:57 +08:00
mindspore-ci-bot becaf39262 !957 complete vm ops for BatchToSpace and SpaceToBatch
Merge pull request !957 from jiangjinsheng/space_to_batch
2020-05-07 19:11:32 +08:00
buxue ac86996746 develop op ScatterMax and dock ge process 2020-05-07 18:58:11 +08:00
jonyguo d4d236bcce fix: use MindDataset by column_names get data error in some situation 2020-05-07 18:12:36 +08:00
mindspore-ci-bot 6351f9c837 !859 [Auto parallel] Support searching strategy for inference phase
Merge pull request !859 from Xiaoda/support-inferring-phase-parallel-strategy-searching
2020-05-07 17:38:14 +08:00
mindspore-ci-bot e75d75854d !959 Add Elu\EluGrad ops for VM.
Merge pull request !959 from liuxiao/ops-for-VM
2020-05-07 16:26:41 +08:00
mindspore-ci-bot deae380969 !637 Learning rate and weight decay making group params
Merge pull request !637 from ghzl/learning-rate-make-group-mode
2020-05-07 15:34:10 +08:00
jiangjinsheng a945299e42 update test for batch_to_space 2020-05-07 15:21:33 +08:00
liyong b520ca9087 fix pk sampler in mindrecord 2020-05-07 14:54:23 +08:00
Xiaoda Zhang def8573275 implementing-searching-strategy-for-inference 2020-05-07 14:53:50 +08:00
jiangjinsheng 79a3f0821a add vm for batch_to_space and space_to_batch 2020-05-07 10:49:30 +08:00
liuxiao eba74ca8f7 add ops for VM 2020-05-07 10:44:51 +08:00
guohongzilong 824bc30a94 learning rate and weight decay support group mode 2020-05-07 09:38:03 +08:00
mindspore-ci-bot 3d3b9d5474 !840 [BUG] fix conv2dtranspose bug
Merge pull request !840 from jinyaohui/conv2dtranspose
2020-05-06 16:43:28 +08:00
jinyaohui 88e763a98f modify conv2dtranspose 2020-05-06 10:53:36 +08:00
mindspore-ci-bot 108ef72aaf !904 fix avgpool and add dimension check for groupnorm
Merge pull request !904 from JichenZhao/groupn
2020-05-06 10:42:05 +08:00
mindspore-ci-bot cae8a921e3 !929 Cleanup dataset UT: test_batch, save_and_check support
Merge pull request !929 from cathwong/ckw_dataset_ut_cleanup
2020-05-06 04:40:26 +08:00
Cathy Wong 772e6c1461 Cleanup dataset UT: test_batch, save_and_check support 2020-05-05 15:35:09 -04:00
changzherui ffcbcc8dcb syn code 505 2020-05-05 22:44:20 +08:00
changzherui 446828f221 modify momentum test 2020-05-05 21:56:13 +08:00
zhaojichen 039c75af8e fix avgpool and add check 2020-05-04 22:28:50 -04:00
eric 36fffb7706 Added example md5 generation
Comparison example

Added md5 and comparison example for py_transforms

Added md5 check for images
2020-05-04 21:15:33 -04:00
yangyongjie 3f1c6b7b47 solve the problem when dialtion greater than 1 in Conv2dTranspose ops 2020-05-04 11:55:18 +08:00
Junhan Hu 83c68ca2ef Skip pyfunc test case 2020-05-01 15:14:07 -04:00
mindspore-ci-bot 79f087c2af !909 Adding fix for set seed
Merge pull request !909 from EricZ/test_random
2020-05-01 21:13:44 +08:00
mindspore-ci-bot 200b3f0789 !837 add onnx op converter: ReLU6 and DepthwiseConv2dNative
Merge pull request !837 from chenzupeng/master
2020-05-01 09:20:38 +08:00
eric 26cb3e8a5f Added test function to show that seed doesn't work.
Added testcase to show that c image aug don't use seed properly

Added passing test cases

Added working testcases for using seed

Added additional test cases to show seed use

Added test case for seed
2020-04-30 18:57:59 -04:00
changzherui b323199dc1 syn code 430 2020-04-30 17:55:12 +08:00
mindspore-ci-bot a5b530c427 !857 use parameter name as the key of strategy checkpoint
Merge pull request !857 from yao_yf/strategy_ckpt_key_to_use_param_name
2020-04-30 17:12:51 +08:00
zhaozhenlong 4694c979a5 delete pack description about num and add raise error
SparseApplyAdagrad example format

PReLU and grad state 1-d not supported

atan2 bprop dx dy revert to original shapes
2020-04-30 16:05:03 +08:00
mindspore-ci-bot 0611c1a579 !849 [CT][MS] Wrong format of broadcast output, when multi-output
Merge pull request !849 from vlne-v1/I1FQ76-wrong-format-of-boardcast-output-when-multi-output
2020-04-30 14:27:36 +08:00
mindspore-ci-bot 67f3d0eb5d !871 dataset: repair take op problem when there exist muti-thread in next node
Merge pull request !871 from ms_yan/take_operator
2020-04-30 14:08:38 +08:00
chenzupeng a109bc3d96 add onnx op converter: ReLU6, DepthwiseConv2dNative 2020-04-30 12:59:39 +08:00
Wei Luning 157710ca0f bugfix* fix bug in output tuple of tuple.* check kRWWrite input no-variable* input x of ScatterNdUpdate should be a parameter node 2020-04-30 12:00:56 +08:00
mindspore-ci-bot ff1a05d6c8 !882 fix bug of bprop of FloorMod
Merge pull request !882 from zhangbuxue/fix_bprop_for_floor_mod
2020-04-30 11:44:49 +08:00
buxue 0c6cf98db0 fix bug of brpop of FloorMod 2020-04-30 11:02:02 +08:00
yao_yf 5a6540450e use param name as the key of strategy checkpoint 2020-04-30 11:01:32 +08:00
ms_yan c56fe3aa2d modify take op with an operator 2020-04-30 10:16:36 +08:00
mindspore-ci-bot 8af10eb51e !875 Reject python OP in operations argument for C++ uniform augmentation OP
Merge pull request !875 from AdelShafiei/ua_py
2020-04-30 06:11:17 +08:00
Adel Shafiei d15bd04bfe added input validation to reject python op in C++ uniform augmentation operations list 2020-04-29 16:48:10 -04:00
mindspore-ci-bot a606c2e4da !872 [Dataset] Add schema support for GeneratorDataset
Merge pull request !872 from JunhanHu/generator_schema
2020-04-30 02:58:29 +08:00
mindspore-ci-bot 2303453753 !869 Random data op
Merge pull request !869 from JesseKLee/random_data_op
2020-04-30 02:56:39 +08:00
Junhan Hu c5a8ffe4f4 Add schema support for GeneratorDataset 2020-04-29 13:50:51 -04:00
Jesse Lee 5236d0c3c0 Replace print with logger.info 2020-04-29 12:44:04 -04:00
mindspore-ci-bot 8d3695f666 !672 Added UT for uniform augmentation C++ OP
Merge pull request !672 from AdelShafiei/ua_ut
2020-04-29 23:56:09 +08:00
mindspore-ci-bot 732c7f8266 !794 fix issues image gradients 4d check
Merge pull request !794 from zhaozhenlong/fix-issues-image-gradients-complement-check
2020-04-29 22:26:53 +08:00
Jesse Lee 270bf831a9 Random Data Op 2020-04-29 10:26:00 -04:00
mindspore-ci-bot 98939d839c !856 Fix skip op bug
Merge pull request !856 from jiangzhiwen/dataset/skip_thread
2020-04-29 21:47:50 +08:00
zhaozhenlong 66e7a36846 ImageGradients check 4d
fix DiagPart constant folding issue

fix argmin output type check

fix atan2 doc error

fix remove FusedBatchNorm and its grad
2020-04-29 21:47:33 +08:00
jiangzhiwen 34bfa2f7c9 fix skip 2020-04-29 20:12:37 +08:00
mindspore-ci-bot 8ab5e0118f !829 Add parser of case which parameter in tuple in run_op function
Merge pull request !829 from ghzl/parser-parameter-in-tuple-in-run_op
2020-04-29 19:47:46 +08:00
guohongzilong b96df362f8 add parser of case which parameter in tuple in run_op function 2020-04-29 17:55:12 +08:00
mindspore-ci-bot 883fde0494 !839 add parameter verification for RMSprop
Merge pull request !839 from wangnan39/add_parameter_verification_for_rmsprop
2020-04-29 17:20:21 +08:00
mindspore-ci-bot 728345fdd0 !841 fix bugs of Acosh bprop and Elu bprop
Merge pull request !841 from zhangbuxue/adapt_ExtractImagePatches_and_fix_EluGrad
2020-04-29 17:17:30 +08:00
buxue 064d370a61 fix bug of Acosh bprop and Elu bprop 2020-04-29 16:50:08 +08:00
mindspore-ci-bot 33e427e1c5 !721 Tensor assign by ellipsis
Merge pull request !721 from candanzg/tensor_assgin_ellipsis
2020-04-29 16:31:05 +08:00
wangnan39@huawei.com 7f602016f4 add parameter verification for rmsprop, and modify default value in annotation 2020-04-29 16:12:58 +08:00
mindspore-ci-bot 6241814320 !749 fix np.histogram sometimes calc very large bucket number
Merge pull request !749 from wenkai/wkmaster
2020-04-29 11:36:11 +08:00
candanzg e886a3182c tensor assign with ellpsis
Signed-off-by: candanzg <zhangshucheng@huawei.com>
2020-04-29 11:05:44 +08:00
Adel Shafiei 3322e65da9 added ut for uniform augment C++ op 2020-04-28 21:07:29 -04:00
zhaozhenlong 243cd33203 adapt SparseApplyAdagradD adding output accum 2020-04-28 21:48:04 +08:00
mindspore-ci-bot 9ffb3993e8 !732 dock AcoshGrad for GE and AvgPool AvgPoolGrad for VM
Merge pull request !732 from zhangbuxue/dock_AcoshGrad_AvgPool_AvgPoolGrad_for_vm
2020-04-28 20:22:04 +08:00
mindspore-ci-bot 21d936e656 !728 auto parallel strategy checkpoint full
Merge pull request !728 from yao_yf/strategy_checkpoint_extend
2020-04-28 19:51:15 +08:00
mindspore-ci-bot 4fff5f442c !791 onnx adapter for MaxPoolWithArgmax
Merge pull request !791 from 梅晓蔚/master
2020-04-28 19:24:13 +08:00
buxue 0f89cc1da4 dock AcoshGrad for GE and AvgPool AvgPoolGrad for Vm 2020-04-28 18:52:23 +08:00
meixiaowei cd899fba0a ONNX adapter for the MaxPoolWithArgmax 2020-04-28 16:43:15 +08:00
yao_yf 6cde5f6d91 auto parallel strategy checkpoint 2020-04-28 15:48:41 +08:00
mindspore-ci-bot 9399dffe0e !751 Remove enable hccl
Merge pull request !751 from zjun/remove_enable_hccl
2020-04-28 14:23:40 +08:00
mindspore-ci-bot 5b3327d103 !746 reducescatter backforward operator
Merge pull request !746 from lirongzhen1/bp_reducescatter
2020-04-28 14:11:53 +08:00
mindspore-ci-bot c1813671db !694 Refactor vm module for multigraph sink.
Merge pull request !694 from rick_sanchez/master
2020-04-28 10:42:26 +08:00
mindspore-ci-bot 8bf35b2b0c !700 validate bprop rules
Merge pull request !700 from penn/validate_bprop_rules
2020-04-28 10:40:41 +08:00
zjun c538b83712 remove enbale hccl 2020-04-28 10:37:08 +08:00
lirongzhen1 0b4648881b add reducescatter bprop 2020-04-28 09:58:34 +08:00
rick_sanchez 6ae8345cad refactor vm module for multigraph sink 2020-04-28 09:53:43 +08:00
mindspore-ci-bot b37db1edf5 !603 [MD] update pk sampler in minddataset
Merge pull request !603 from liyong126/update_pk_sampler
2020-04-27 23:17:38 +08:00
mindspore-ci-bot f82e63fecc !671 Added testcase for sync_wait
Merge pull request !671 from EricZ/master
2020-04-27 22:14:10 +08:00
mindspore-ci-bot 0e3054d527 !466 Deepcopy problem when pyfunc cannot be pickled
Merge pull request !466 from h.farahat/deepcopy
2020-04-27 22:07:55 +08:00
liyong bfba630aa2 update pK_sampler 2020-04-27 21:40:49 +08:00
mindspore-ci-bot c47ef8ee4e !711 Address first epoch always shuffle with same seed init of random sampler
Merge pull request !711 from ZiruiWu/mindspore_master_only
2020-04-27 21:39:12 +08:00
mindspore-ci-bot afbd24cb78 !718 Fix dtype judge sentence in infer_dtype function of hcom operations
Merge pull request !718 from zhouyuanshen/master
2020-04-27 21:23:25 +08:00
zhouyuanshen c046874b03 fix bug in infer_dtype function of hcom operations 2020-04-27 18:49:21 +08:00
wenkai ab04b3dc4b fix np.histograms(bins='auto') sometimes calc very small width and very large bucket number, which lead to error/long compute time. 2020-04-27 18:08:17 +08:00
panyifeng 9e633b6c12 validate bprop rules 2020-04-27 11:57:22 +08:00
mindspore-ci-bot ef71ae941f !698 [Auto parallel] Support multi-subgraphs in auto-parallel
Merge pull request !698 from Xiaoda/support-wide-deep-in-auto-parallel
2020-04-27 11:15:40 +08:00
mindspore-ci-bot e213f2a435 !687 Fix bug: Summary tage type checking and exception throwing
Merge pull request !687 from candanzg/summary_tag_check
2020-04-27 09:57:33 +08:00
Xiaoda Zhang e227415673 support-the-multiple-subgraphs-in-the-ANF 2020-04-27 09:34:41 +08:00
Zirui Wu 8c3931cf1d fix first epoch always shuffle with default seed in random sampler
fix ut
2020-04-26 10:58:59 -04:00
mindspore-ci-bot efdcd4c258 !682 fix api comments of some ops
Merge pull request !682 from liuxiao/fix-bug
2020-04-26 19:29:40 +08:00
mindspore-ci-bot da5b10b699 !681 add psnr inputs shape and dtype check
Merge pull request !681 from zhaozhenlong/psnr-check-same-shape
2020-04-26 17:49:05 +08:00
zhaozhenlong c88edfb31d psnr check two input same shape and type 2020-04-26 17:16:58 +08:00
yangzhenzhang 4750861054 fix layernorm bug 2020-04-26 16:39:32 +08:00
mindspore-ci-bot 348b0ef53c !344 add prim name to error message for operators in array_ops.py
Merge pull request !344 from fary86/add_prim_name_to_error_message_for_array_ops
2020-04-26 16:23:33 +08:00
candanzg b84deeeb5c fix summary tage check error
Signed-off-by: candanzg <zhangshucheng@huawei.com>
2020-04-26 15:43:57 +08:00
fary86 2078229436 Add prim name to error message for array_ops 2020-04-26 15:23:04 +08:00
yangzhenzhang 36a62576e8 support forward graph 2020-04-26 14:44:23 +08:00
liuxiao 5e877a7715 modify api and add example 2020-04-26 11:07:18 +08:00
mindspore-ci-bot ad2a5dcad2 !676 [Auto parallel] Add the resnet50 testcase
Merge pull request !676 from Xiaoda/add-the-resnet50-testcase
2020-04-26 11:06:29 +08:00
buxue aff6777ecc fix reviewboot and example of TruncatedNormal and add type mapping 2020-04-26 10:01:20 +08:00
Xiaoda Zhang 3ff9e54734 add the resnet50 32k-8p testcase 2020-04-26 09:07:37 +08:00
eric 2d115cd04e Added example for multiple iterator
Added new testcase for multi iterator

Addressing review

Fixed typo
2020-04-24 17:28:40 -04:00
lirongzhen1 56f785f7e6 add context configration 2020-04-24 19:35:14 +08:00
mindspore-ci-bot 6844ea633d !56 Synchronization code423 to ms-incubator
Merge pull request !56 from changzherui/syn-code423
2020-04-24 19:30:37 +08:00
mindspore-ci-bot a02eb240e9 !595 Tensor assign with int or tuple(int) index
Merge pull request !595 from candanzg/tensor_assign_with_integer
2020-04-24 17:35:58 +08:00
mindspore-ci-bot ce71c17933 !645 auto parallel prelu operator support broadcast
Merge pull request !645 from yao_yf/auto_parallel_prelu_support_broadcast
2020-04-24 17:32:37 +08:00
mindspore-ci-bot 84d5e4f923 !643 [AutoParallel]Support reshape parameter
Merge pull request !643 from lichen/support_reshape_parameter
2020-04-24 16:43:29 +08:00
candanzg 31aae36106 Tensor assign with integer
Signed-off-by: candanzg <zhangshucheng@huawei.com>
2020-04-24 16:28:23 +08:00
mindspore-ci-bot 43a8f829a2 !628 fix the infer of TruncatedNormal and a bug of structure output
Merge pull request !628 from zhangbuxue/fix_example_for_TruncatedNormal
2020-04-24 16:12:05 +08:00
mindspore-ci-bot 00859ae119 !586 enable/disable allreduce_fusion
Merge pull request !586 from lirongzhen1/allreduce_fusion
2020-04-24 16:02:53 +08:00
lichenever 2ab211ae04 support reshape parameter 2020-04-24 15:59:09 +08:00
buxue c8a1a24ce3 fix the infer of TruncatedNormal and a bug of structure output and a bug of tensorslice ellipsis 2020-04-24 15:42:58 +08:00
yao_yf 425276d43d auto parallel prelu support prelu 2020-04-24 14:10:57 +08:00
Xiaoda Zhang dfde76af88 delete the 'simplify_cal' attribute in 'set_algo_parameters' and 'get_algo_parameters' interface 2020-04-24 10:46:38 +08:00
lirongzhen 4ff418084c enable/disable allreduce_fusion 2020-04-24 10:34:59 +08:00
zhaojichen d1add07b5a change error type 2020-04-23 09:49:56 -04:00
zhaojichen 1af894e25f change error type 2020-04-23 09:21:05 -04:00
zhaojichen 57bc30505c change error type 2020-04-23 07:58:44 -04:00
mindspore-ci-bot ad75618ca6 !611 change error message type
Merge pull request !611 from JichenZhao/errormsg
2020-04-23 19:49:59 +08:00
chang zherui bd13f9ba33 modify ResizeNearestNeighborV2D 2020-04-23 18:56:03 +08:00
zhaojichen 8963e39516 change error type 2020-04-23 05:29:26 -04:00
mindspore-ci-bot 5ac07bb695 !504 Support Tensor assign A[slice] = u
Merge pull request !504 from candanzg/tensor_assign_with_slice
2020-04-23 16:24:10 +08:00
candanzg 663d597330 tensor assign with slice index
Signed-off-by: candanzg <zhangshucheng@huawei.com>
2020-04-23 13:07:04 +08:00
mindspore-ci-bot 0bf6717e9a !454 Fix the check of bool type in auto cast
Merge pull request !454 from candanzg/bug_cast_op
2020-04-23 10:54:40 +08:00
mindspore-ci-bot 5cf09405e2 !532 [AutoParallel]support multiple subgraphs
Merge pull request !532 from lichen/support_multiple_subgraphs_in_auto_parallel
2020-04-23 09:04:09 +08:00
hesham a9e9266149 Deepcopy problem when pyfunc cannot be pickled 2020-04-22 11:55:27 -04:00
liuxiao b6e77e5178 Add ReluV2/ReluGradV2/ConfusionMulGrad for VM 2020-04-22 21:09:37 +08:00
mindspore-ci-bot 1a0d2666b7 !559 Add Fill/Erf op for VM.
Merge pull request !559 from liuxiao/fill-op
2020-04-22 19:22:04 +08:00
mindspore-ci-bot 818acd46d4 !569 fix bug in checkpoint when save scaler
Merge pull request !569 from wangnan39/master
2020-04-22 18:55:02 +08:00
lichenever c78630d737 support multiple subgraphs 2020-04-22 17:40:56 +08:00
wangnan39@huawei.com f38d18c665 fix bug in checkpoint when save scaler 2020-04-22 16:04:55 +08:00
mindspore-ci-bot 24a9f4974c !536 support ellipsis and bool for tensor slice
Merge pull request !536 from zhangbuxue/support_elipis_for_tensor_slice
2020-04-22 15:49:33 +08:00
liuxiao 5b6c8fade8 Add Erf\FillD operator for VM 2020-04-22 15:32:42 +08:00
buxue 437bb8c27c support ellipsis and bool for tensor slice 2020-04-22 15:00:04 +08:00
mindspore-ci-bot 67057d1309 !541 add average pooling 1D
Merge pull request !541 from JichenZhao/avgpooling
2020-04-22 14:13:04 +08:00
mindspore-ci-bot 4516b8feff !437 Add L2Loss op for VM.
Merge pull request !437 from liuxiao/add-l2-loss
2020-04-22 10:27:04 +08:00
mindspore-ci-bot 3b083d07bb !550 support one node communication group
Merge pull request !550 from yao_yf/support_one_node_communication_group
2020-04-22 10:17:01 +08:00
liuxiao c874e2d484 Add L2Loss op for VM 2020-04-22 09:31:14 +08:00
mindspore-ci-bot aad5771a62 !524 Added support for UA augmentation ops with tests
Merge pull request !524 from alashkari/ua-ops
2020-04-22 08:28:47 +08:00
Amir Lashkari 56e7a7deb5 Added UniformAugment + Python Augmentation Ops 2020-04-21 19:54:32 -04:00
mindspore-ci-bot dc0491caf9 !508 [Dataset] Adding sync_wait operator for dataset
Merge pull request !508 from EricZ/master
2020-04-22 06:15:24 +08:00
eric cd94518769 X# This is a combination of 2 commits.
Initial commit for dataset op python

Added signature to barrier

Adde compiling barrier code

Rebasing, fixed new compile errors

Final fix for make_unique

Added pybind API for barrier

Fixed pyfunc invocation

python interface - sync_wait

!1 sync_wait python interface
* python interface - sync_wait

fix test

update test

update test

Added new test case

add test case

test for shuffle + batch

Added two-sync test case

Restrited that no shuffle after sync

Added sync to pipeline info

block first databuffer as well

Intelligently get batch size

Fix default case

Lock Pair shares among all iterators

Added fix for empty character

Fixed up test case formatting

Fix end of epoch in sync_wait

Fixing CI
2020-04-21 17:42:13 -04:00
Junhan Hu 78001ac9e6 Add multiprocessing support for Mindspore.Dataset.GeneratorDataset 2020-04-21 16:03:43 -04:00
mindspore-ci-bot fb18671b28 !506 [Dataset] Multiprocessing support for Pyfunc
Merge pull request !506 from JunhanHu/multiprocess_pyfunc
2020-04-22 03:57:26 +08:00
Junhan Hu b13e7bc31a Add python multiprocessing support for Mindspore.dataset 2020-04-21 14:56:25 -04:00
yao_yf 371b3338b6 support one node communication group 2020-04-21 21:16:22 +08:00
mindspore-ci-bot 72f42fc37c !170 Add prim name to error message for operators in nn_ops.py
Merge pull request !170 from fary86/add_prim_name_to_error_message_for_nn_ops
2020-04-21 21:14:44 +08:00
wangnan39@huawei.com b812b18c02 support update parameter for vm 2020-04-21 20:19:46 +08:00
fary86 6dd72f654a Add prim name to error message for nn_ops.py 2020-04-21 19:25:30 +08:00
qianlong db80f4ff92 The num_samples and numRows in schema for TFRecordDataset are conflict 2020-04-21 17:08:59 +08:00
zhaojichen 94c99998ae add AvgPooling layer 2020-04-21 03:17:24 -04:00
mindspore-ci-bot d9e4dcc33b !483 Optimize skip dataset op
Merge pull request !483 from jiangzhiwen/dataset/skip_opt
2020-04-21 15:10:23 +08:00
mindspore-ci-bot 862d23fe90 !481 Move args_type_check function to _checkparam.py
Merge pull request !481 from leonwanghui/rm-code
2020-04-21 11:23:05 +08:00
mindspore-ci-bot 7aac50804a !514 [MD] add Pk Sampler in minddataset
Merge pull request !514 from liyong126/mindrecord_pk_sampler_lee
2020-04-21 11:10:19 +08:00
leonwanghui 24b26ee1a8 Move args_type_check function to _checkparam.py 2020-04-21 10:20:09 +08:00
liyong f1542a90a3 add pk sampler 2020-04-21 10:08:38 +08:00
candanzg 0de05b3949 [bug] fixed bool check for cast op
Signed-off-by: candanzg <zhangshucheng@huawei.com>
2020-04-21 09:48:34 +08:00
mindspore-ci-bot 27a88a6bc3 !456 Auto cast case for NotEqual op
Merge pull request !456 from candanzg/not_equal_auto_cast
2020-04-21 09:20:40 +08:00
jiangzhiwen e1b109e8b8 optimize skip dataset op 2020-04-21 09:16:37 +08:00
Cathy Wong 60df369100 Fixup py Normalize doc: takes input CHW 2020-04-20 15:17:30 -04:00
mindspore-ci-bot 6369cf27bd !406 added first row crc check for when reading tfrecord files
Merge pull request !406 from Peilin/first-row-crc-check
2020-04-21 00:10:18 +08:00
mindspore-ci-bot 98fbd30a5b !460 [Data]Add filter operation
Merge pull request !460 from xulei/filter_master
2020-04-20 23:33:44 +08:00
mindspore-ci-bot 822a3160e4 !404 [Dataset] Add Python Sampler support for CPP dataset
Merge pull request !404 from JunhanHu/python_sampler_for_cpp_dataset
2020-04-20 22:45:51 +08:00
xulei2020 c705ea5e5b add filterOp code 2020-04-20 22:32:19 +08:00
Peilin Wang 9bc2134cb7 added checking of first row crc to find invalid tfrecord files
addressed code review comments. added check in python layer to exclude directories and to raise an error if a pattern does not match any file

fixed clang format

fixed cppcheck

fixed cppcheck (used std::accumulate and std::copy_if). regenerated tfrecord file to contain correct header, it was a dummy header before

fixed cppcheck: added const reference for string parameter for lambdas, fixed clang format: whitespace adjustments

more clang whitespace fixes...

changed print to logger.info
2020-04-20 10:25:26 -04:00
mindspore-ci-bot d8176a77f4 !425 New api "TextFileDataset"
Merge pull request !425 from yanghaitao/yht_textfiledatasetv2
2020-04-20 22:14:26 +08:00
mindspore-ci-bot 5434a96d85 !493 support python func print and != for list with none
Merge pull request !493 from zhangbuxue/support_python_func_print
2020-04-20 20:32:18 +08:00
mindspore-ci-bot 0cdb1171d5 !87 Take AllToAll as a virtual operator in cost model
Merge pull request !87 from gziyan/dev_alltoall
2020-04-20 20:13:15 +08:00
mindspore-ci-bot c3ec9712e0 !403 add cell class name to error message
Merge pull request !403 from fary86/add_cell_name_to_error_message_for_nn_layer
2020-04-20 20:06:12 +08:00
buxue 7c233a57fa support python func print and != for list with none 2020-04-20 19:55:50 +08:00
mindspore-ci-bot 679dbd27b3 !478 fix save_graphs_path and log file mode related issues
Merge pull request !478 from fary86/fix_log_and_ir_issues
2020-04-20 19:07:38 +08:00
fary86 7e23a1a475 Fix issues of save_graphs_path, Type/Value error message and log file mode 2020-04-20 16:23:40 +08:00
mindspore-ci-bot 3ba31ec15a !419 Tensor assign with bool Tensor
Merge pull request !419 from candanzg/tensor_assign_bool_index
2020-04-20 15:00:55 +08:00
yanghaitao 2795e492ff TextFileDataset 2020-04-20 11:18:55 +08:00
mindspore-ci-bot 18580a7867 !261 Add summary module python code to extract histogram info from tensor
Merge pull request !261 from wenkai/histogram_dev3cp
2020-04-20 11:08:34 +08:00
mindspore-ci-bot 3822b4837f !340 Add a HistogramSummary ops to record tensor value
Merge pull request !340 from ougongchang/master
2020-04-20 10:54:04 +08:00
Ziyan 0d208e00bd Model ALLTOALL as a single operator in cost model; scale the ALLTOALL,
ALLGATHER, and REDUCESCATTER with different factors; change the BETA and
GAMMA value in cost model.
2020-04-20 09:11:03 +08:00
candanzg 3f087dba1a Tensor assign syntax:
1) A[B]=U
2) A[A>n]=U
    A.shape == B.shape
    U is a scalar or Tensor(size==1)
    B is Tensor(dtype=bool)
    n is a Number

Signed-off-by: candanzg <zhangshucheng@huawei.com>
2020-04-20 08:44:34 +08:00
Junhan Hu 43a2e99833 Add python sampler support for CPP dataset 2020-04-19 20:36:37 -04:00
candanzg 79c4312e89 NotEqual op auto cast
Signed-off-by: candanzg <zhangshucheng@huawei.com>
2020-04-19 11:41:47 +08:00
ms_yan f0c07c3fa6 Realize take op and add ut 2020-04-18 18:33:57 +08:00
mindspore-ci-bot cc08fdfd9a !420 Fix mixed precision usage when const value passed as argument
Merge pull request !420 from amongo/FixMixedPrecisionForConstParam
2020-04-18 10:31:33 +08:00
ougongchang 0ed6d9178e add Histogram summary operator
clean clang format errors and cpplint errors

add some test cases for histogram summary operator
2020-04-18 09:56:45 +08:00
mindspore-ci-bot 80333e9f55 !435 Fix dataset serialize and deserialize for MindDataset
Merge pull request !435 from anthonyaje/fix_serdes_dataset
2020-04-18 09:37:22 +08:00
mindspore-ci-bot d34afbd61b !400 Support math operation between float and int for scalar
Merge pull request !400 from amongo/FixMathOps
2020-04-18 09:34:42 +08:00
mindspore-ci-bot 40f0a4a4f4 !333 Add skip op to Dataset
Merge pull request !333 from jiangzhiwen/dataset/skip
2020-04-18 09:19:07 +08:00
mindspore-ci-bot 9e1b5efd1d !434 Bug in cleaning dataset iterators
Merge pull request !434 from h.farahat/multi_itr_bug
2020-04-18 05:17:31 +08:00
anthonyaje ea297c0889 Fix dataset serdes for MindDataset 2020-04-17 13:24:02 -04:00
hesham 3c02c82771 Bug in weak reference.
Add new test cases
2020-04-17 11:36:32 -04:00
jzw 3f7054dccb add skip dataset op 2020-04-17 19:48:25 +08:00
huangdongrun 7fae76d10d add support for calculation between float and int
format code

remove test case for fp64

add back scalar manipulation

remove save graph
2020-04-17 19:13:52 +08:00
huangdongrun 9cb665e634 add suport for parameter of const value pass as mixed precision args
fix pylint
2020-04-17 16:27:46 +08:00
mindspore-ci-bot 7214c04114 !402 Add parallel op for Square
Merge pull request !402 from yangzhenzhang/square
2020-04-17 15:06:40 +08:00
fary86 8cbbbd950e Add cell name to error message 2020-04-17 12:58:11 +08:00
yangzhenzhang 36ffb66782 add parallel op for square 2020-04-17 10:42:52 +08:00
mindspore-ci-bot 2d31ae97e8 !383 add cell psnr
Merge pull request !383 from zhaozhenlong/cell/psnr
2020-04-17 10:23:30 +08:00
mindspore-ci-bot 08985a1e56 !286 resolve pynative operator unsupport issue
Merge pull request !286 from wangqiuliang/resolve-pynative-operator-issue
2020-04-17 10:04:54 +08:00
wenkai cce61d462c histogram python dev 2020-04-17 09:42:02 +08:00
zhaozhenlong aa8fbcc06e add cell psnr 2020-04-17 09:15:51 +08:00
mindspore-ci-bot cf026096a6 !183 Mindspore.dataset CPP sampler for GeneratorDataset
Merge pull request !183 from JunhanHu/cpp_sampler
2020-04-16 22:30:59 +08:00
kingfo 75fec82b52 resolve pynative operator issue 2020-04-16 21:02:22 +08:00
mindspore-ci-bot d3e4dd06b0 !386 modify test_cell_bprop.py ut test_with_param
Merge pull request !386 from changzherui/modify-ut
2020-04-16 20:15:15 +08:00
mindspore-ci-bot 549bfb97ad !343 Fix usage of variable arguments in test framework
Merge pull request !343 from amongo/FixGradUsingInterfaceExtend
2020-04-16 19:42:07 +08:00
mindspore-ci-bot 31621467a4 !217 support operator ** // % for scalar and tensor, and "in" "not in" key word, and string concat
Merge pull request !217 from zhangbuxue/support_pow_operator
2020-04-16 18:53:47 +08:00
mindspore-ci-bot 0d0517c22d !379 Add Group normalization
Merge pull request !379 from JichenZhao/groupnorm
2020-04-16 17:30:12 +08:00
buxue 80978cf3cc support operator ** // % for scalar and tensor, and in not in for dict, ang str concat 2020-04-16 17:03:31 +08:00
huangdongrun efedcfb530 add test case of Bprop and tester
add test case for grad concat

fix usage in test framework

fix testcase

format code
2020-04-16 16:59:18 +08:00
chang zherui 8bdcd8c267 modify test_cell_bprop.py ut 2020-04-16 16:20:24 +08:00
yangzhenzhang 57cd9f8188 add parallel op for sigmoidloss 2020-04-16 14:33:24 +08:00
zhaojichen 04c522d0c6 Add Group Normalization 2020-04-16 01:59:32 -04:00
zhaojichen 0b7de6968f Add Group Normalization 2020-04-16 01:56:12 -04:00
zhaojichen ebe6efff71 Add Group Normalization 2020-04-16 01:42:32 -04:00
yangzhenzhang 6d522f0a4f add parallel op for layernorm 2020-04-15 19:30:07 +08:00
mindspore-ci-bot ba55a8ed0b !304 [Auto parallel] Change 'NOT_FULLY_USE_DEVICES' to 'FULLY_USE_DEVICES' and make ALL-1 user-specified-strategy valid in auto-parallel
Merge pull request !304 from Xiaoda/modify-not-fully-use-devices-and-strategy-checking
2020-04-15 17:21:45 +08:00
buxue 62807da0c4 Develop operator Unfold,take the ge backend,dock with tbe's ExtractImagePatches operator 2020-04-15 15:26:44 +08:00
Xiaoda Zhang ffb2cb03a4 Change 'NOT_FULLY_USE_DEVICES' to 'FULLY_USE_DEVICES' and make ALL-1 user-specified-strategy valid in auto-parallel 2020-04-15 10:14:46 +08:00
Junhan Hu 9739d3b048 Add CPP sampler support for GeneratorDataset 2020-04-14 12:09:03 -04:00
mindspore-ci-bot 30de261c3c !243 Support nested repeat
Merge pull request !243 from h.farahat/nested_repeat
2020-04-14 23:07:32 +08:00
mindspore-ci-bot fe4cde6b1e !294 Add cell ssim
Merge pull request !294 from zhaozhenlong/cell/ssim
2020-04-14 22:34:03 +08:00
mindspore-ci-bot 150024f089 !312 Implemention of new dataset ops: apply
Merge pull request !312 from xiefangqi/xfq_apply_branch
2020-04-14 22:29:07 +08:00
hesham 0fc23eee0f Support nested repeat 2020-04-14 10:13:18 -04:00
zhaozhenlong 6a2cf4b6e6 ssim impl code 2020-04-14 21:53:29 +08:00
xiefangqi 1a1cbc6814 implemention of new api: apply 2020-04-14 21:43:53 +08:00
Wei Luning e1c8f248e0 Fix the output is not tuple, when eval 2020-04-14 16:14:41 +08:00
mindspore-ci-bot f1fa2a9941 !273 [MD] update subset random sampler in minddataset
Merge pull request !273 from liyong126/mindrecord_subset_sampler_python
2020-04-14 11:18:36 +08:00
mindspore-ci-bot 7ffb8bb19f !250 Add nn.pad to support three modes
Merge pull request !250 from casgj/gaojing_new4
2020-04-14 10:56:05 +08:00
mindspore-ci-bot 60958d6b25 !239 Add dynamic learning rate decay and review optimizer code
Merge pull request !239 from fanglei/master
2020-04-14 09:24:25 +08:00
gaojing 2db3e64ff2 add operation 2020-04-13 10:38:03 -04:00
root 7d700295f8 add dynamic lr and enhance optim 2020-04-13 13:48:01 +00:00
liyong 0ce83e39e1 fix TestShardSampleWrongNumber
adjust internal api
2020-04-13 21:31:45 +08:00
mindspore-ci-bot 39a46b9342 !245 Add bool type check in communication operator
Merge pull request !245 from chentingting/add_bool_type_check_in_comm_op
2020-04-13 20:19:47 +08:00
mindspore-ci-bot 77725e81a4 !258 add_minimum_distributed_op
Merge pull request !258 from lichen/add_minimum_distributed_op
2020-04-13 20:16:08 +08:00
Wei Luning 37c94a5f76 add pass replace_old_param_ 2020-04-13 17:52:55 +08:00
c00425699 d62f560b50 add_bool_type_check_in_comm_op 2020-04-13 17:34:29 +08:00
lichenever b81cc6ea4f add minimum distributed op 2020-04-13 17:26:31 +08:00
chenzomi d64f662c76 quantization aware training frontend operators define. 2020-04-13 12:02:49 +08:00
mindspore-ci-bot 98e69fc639 !215 fix bprop cache caused error with variable params
Merge pull request !215 from penn/fix_print_bprop_error
2020-04-13 10:10:49 +08:00
mindspore-ci-bot 7bc2cee318 !167 add_squeeze_distributed_op
Merge pull request !167 from lichen/add_squeeze_distributed_op
2020-04-13 10:03:25 +08:00
c00425699 c8cdb6b331 support distributed GatherV2 operator 2020-04-12 16:00:47 +08:00
liyong 11403492ae add mindrecord subset random sampler 2020-04-11 18:48:23 +08:00
buxue 5841fe010e Support pow's second input could be tensor and fix bug in bprop of pow 2020-04-11 16:16:58 +08:00
lichenever 32cd280c1a add squeeze distributed op 2020-04-11 16:03:08 +08:00
mindspore-ci-bot 5141054ecd !220 Add parallel operator for DropoutDoMask
Merge pull request !220 from yangzhenzhang/dropoutdomask
2020-04-11 15:01:43 +08:00
mindspore-ci-bot 066f20e791 !169 fix the method to calculate the children graph
Merge pull request !169 from xychow/fix-manager-children-issue
2020-04-11 14:07:45 +08:00
yangzhenzhang b34c0e7a17 add parallel op for dropoutdomask 2020-04-11 12:11:22 +08:00
jonyguo a9443635b7 fix: mindpage enhance parameter check and search by filename failed 2020-04-11 10:19:14 +08:00
义峰潘 2bef22d8a3 fix bprop cache caused error with variable params 2020-04-10 12:21:40 +08:00
Cathy Wong 59a714c654 Correct shuffle UT buffer_size > #dataset-row as valid 2020-04-09 15:22:33 -04:00
liuxiao 0f0f83e292 modified api name Stack -> Pack, Unstack -> Unpack 2020-04-09 19:02:59 +08:00
mindspore-ci-bot 0565e4641e !185 modify comment about normal mode
Merge pull request !185 from jinyaohui/master
2020-04-09 14:24:28 +08:00
mindspore-ci-bot 2e6e94b2b6 !177 prelu operator support parallel on the channel
Merge pull request !177 from yao_yf/fix_auto_parallel_prelu
2020-04-09 14:08:41 +08:00
zhousiyi 99f22c5b85 fix children issue: missing users of the children's direct users. 2020-04-09 02:18:55 +00:00
jinyaohui 0790ef8a85 modify comment 2020-04-09 09:23:39 +08:00
mindspore-ci-bot 3e36982314 !99 Develop op MaxPoolWithArgMax
Merge pull request !99 from zhangbuxue/Dock_MaxPoolWithArgMax
2020-04-08 22:40:00 +08:00
mindspore-ci-bot 40d4a4baa3 !20 modify _set_dataset_mode_config api param
Merge pull request !20 from jinyaohui/master
2020-04-08 20:58:26 +08:00
buxue 7541d3b067 Develop op MaxPoolWithArgMax 2020-04-08 20:47:49 +08:00
yao_yf b5e3fa9593 fix auto parallel prelu 2020-04-08 20:45:08 +08:00
jinyaohui ac62faa388 modify set_dataset_mode_config api param 2020-04-08 18:30:36 +08:00
liuxiao 47d903ff57 Add pack and unpack 2020-04-08 16:58:53 +08:00
mindspore-ci-bot e6ea09082c !153 add api image_gradients
Merge pull request !153 from zhaozhenlong/cell/image_gradients
2020-04-08 14:55:48 +08:00
zhaozhenlong f9d180d413 add api image gradients 2020-04-08 11:50:22 +08:00
mindspore-ci-bot a24297f547 !122 Support to config whether to save integeated checkpoint, in auto model parallel scene
Merge pull request !122 from WeibiaoYu/master
2020-04-08 09:42:59 +08:00
WeibiaoYu 22c6baeea2 Support to config whether to save integeated checkpoint, in auto model parallel scene 2020-04-07 08:25:27 -04:00
jonyguo c688265671 fix: when use MindDataset block_reade=True hung 2020-04-07 17:53:23 +08:00
chang zherui 7696c21e65 fix runtest.sh for python ut 2020-04-07 13:10:33 +08:00
mindspore-ci-bot 5add5979e8 !92 add prim name to param check error message for math_ops.py
Merge pull request !92 from fary86/add-prim-name-for-param-validator
2020-04-07 10:48:10 +08:00
Wei Luning 113c0d8cd2 fix InsertGradientOf with class method 2020-04-07 02:11:35 +00:00
fary86 69ed72f10d Add primitive name to param error message for math_ops.py 2020-04-07 10:08:04 +08:00
mindspore-ci-bot 7a367af9c6 !135 fix grad missing due to indirect dependent free morphism
Merge pull request !135 from penn/fix_free_morphism_error
2020-04-06 10:17:13 +08:00
panyifeng 1fb776fe09 fix grad missing due to indirect dependent free morphism 2020-04-03 18:22:53 +08:00
mindspore-ci-bot 9e529f9dd0 !54 Interface change :`_Constant` to `Constant`
Merge pull request !54 from ghzl/initializer-change-_Constant-to-Constant
2020-04-03 17:53:51 +08:00
guohongzilong bb5320be13 iterfaces change: _Constant to Constant 2020-04-03 16:19:29 +08:00
mindspore-ci-bot 2c3c1577b1 !115 Add parallel operator for ExpandDims
Merge pull request !115 from yangzhenzhang/expand-dim
2020-04-03 15:54:33 +08:00
mindspore-ci-bot a5d95e472e !106 support comparison ops for python
Merge pull request !106 from amongo/SupportPythonOperators
2020-04-03 15:52:08 +08:00
mindspore-ci-bot acb99f6e8c !123 modify runtest.sh for python ut exec form
Merge pull request !123 from changzherui/modify_runtest_python_ut
2020-04-03 15:35:43 +08:00
yangzhenzhang dd0d4e6b84 add parallel ops for expand dims 2020-04-03 15:17:07 +08:00
huangdongrun 461d8e3a08 add comparison ops
fix pylint

use scalar_lt primitive directly

fix review
2020-04-03 09:58:41 +08:00
chang zherui 86a3398547 modify runtest py ut for parallel exec 2020-04-03 09:38:04 +08:00
xiefangqi bc4602b58e fix and remove useless import of example, st, ut 2020-04-02 22:13:36 +08:00
mindspore-ci-bot d245792842 !94 enhance: reduce execution time for mindrecord test case
Merge pull request !94 from yanzhenxiang2020/fix_mindrecord_ut_long_time
2020-04-02 21:50:43 +08:00
mindspore-ci-bot a5a904fbdf !91 fix bug for allreduce fusion and add resnet unit test
Merge pull request !91 from chentingting/allreduce_fusion_resnet
2020-04-02 21:35:35 +08:00
mindspore-ci-bot cb323eccf0 !71 Add operator adapting in ME for FloorMod, Acosh and SparseApplyFtrlD 【CR】,并主动Acosh and FloorMod operator adapting
Merge pull request !71 from zhangzheng/sparse_acosh_floormod
2020-04-02 21:33:33 +08:00
mindspore-ci-bot 55916351ee !52 remove ge depend
Merge pull request !52 from flywind/remove-ge-depend
2020-04-02 20:59:06 +08:00
zhangz0911gm 6f1747045c Add FloorMod, Acosh in ME 2020-04-02 08:50:39 -04:00
Wei Luning 73ba399364 remove ge depend in cpu 2020-04-02 19:38:42 +08:00
yanzhenxiang2020 5a4f17bfb6 fix mindrecord ut long time 2020-04-02 19:18:49 +08:00
c00425699 ab917a734d fix bug for allreduce fusion and add resnet unit test 2020-04-02 18:55:04 +08:00
mindspore-ci-bot d8b460c780 !96 fix refkey bug for auto parallel
Merge pull request !96 from lichen/fix_ref_key_bug_for_auto_parallel
2020-04-02 17:26:58 +08:00
lichenever 5240b1f603 fix refkey bug for auto parallel 2020-04-02 16:14:29 +08:00
mindspore-ci-bot cf54ecfe6e !62 support grad on python function with variable arguments
Merge pull request !62 from amongo/SupportGradOnVarArgs
2020-04-02 11:21:06 +08:00
zhaoting ed3c2d7229 add RMSProp optimizer 2020-04-02 09:10:58 +08:00
mindspore-ci-bot 5c22c088bb !69 Enable skipped dataset zip operator python unit tests
Merge pull request !69 from cathwong/ckw_dataset_py_ut1
2020-04-01 22:20:37 +08:00
huangdongrun d3f733fa25 support grad on graph with variable arguments
use unpack graph primitive instead

add testcases for all grad interface

remove debug log

format code

remove dumpfuncgraph

resolve clang-format

resolve reviews

resolve cpplint

fix review
2020-04-01 20:24:04 +08:00
mindspore-ci-bot 37dba2ddcf !74 delete longtime python ut
Merge pull request !74 from changzherui/master
2020-04-01 18:29:58 +08:00
mindspore-ci-bot 69d5403319 !14 add adapter for ge atan2
Merge pull request !14 from zhaozhenlong/op/atan2
2020-04-01 18:24:55 +08:00
mindspore-ci-bot a47046652a !76 [Auto parallel] Refining the strategy_checking for resnset50
Merge pull request !76 from Xiaoda/modify-resnet50-strategy-checking
2020-04-01 16:36:13 +08:00
zhaozhenlong bed5997a14 add atan2 operator 2020-04-01 16:27:35 +08:00
mindspore-ci-bot f0bcf90b5b !64 fix error while num_samples equal 0
Merge pull request !64 from anzhengqi/fix-check-num-samples
2020-04-01 15:48:38 +08:00
mindspore-ci-bot 22a9c00bcd !57 Add parallel operators for Neg and BatchMatMul
Merge pull request !57 from yangzhenzhang/master
2020-04-01 15:23:46 +08:00
Xiaoda Zhang fb6eed23ae refining strategy-checking for resnet50 2020-04-01 14:58:58 +08:00
anzhengqi 6a1b865c91 check num_samples 2020-04-01 14:39:23 +08:00
chang zherui 1de7011bc8 delete longtime python ut 2020-04-01 11:53:35 +08:00
mindspore-ci-bot 87040483ee !58 fix two cast bug in auto parallel
Merge pull request !58 from lichen/fix_two_cast_bug_in_auto_parallel
2020-04-01 09:54:10 +08:00
yangzhenzhang 110640e2ad add parallel ops for neg and batchmatmul 2020-04-01 09:36:38 +08:00
Cathy Wong 2e881276ab Enable skipped dataset zip python unit tests
Signed-off-by: Cathy Wong <cathy.wong@huawei.com>
2020-03-31 16:47:13 -04:00
mindspore-ci-bot 045a1c356c !51 add op SpaceToBatch and BatchToSpace for ge
Merge pull request !51 from zhaozhenlong/op/space-to-batch
2020-03-31 21:59:03 +08:00
mindspore-ci-bot e2df848597 !55 modify long time python ut
Merge pull request !55 from changzherui/master
2020-03-31 21:01:40 +08:00
zhaozhenlong cf40305bf0 add operator SpaceToBatch and BatchToSpace for ge 2020-03-31 20:21:47 +08:00
mindspore-ci-bot 352c6faf85 !18 enable use float type learning rate in lars optimizer
Merge pull request !18 from gziyan/master
2020-03-31 18:54:55 +08:00
lichenever 2da38ad401 fix two cast bug in auto parallel 2020-03-31 18:54:21 +08:00
chang zherui eaf7146d46 modify longtime python ut 2020-03-31 16:18:04 +08:00
lichenever f946aea10d fix grpah mode loop sink bug in auto parallel 2020-03-31 16:16:53 +08:00
mindspore-ci-bot 6f03881b04 !39 add op Diag and DiagPart
Merge pull request !39 from zhaozhenlong/op/diag
2020-03-31 14:45:44 +08:00
leonwanghui 976af212e9 回退 'Pull Request !17 : [AutoParallel]Fix bug in the case of two cast' 2020-03-31 10:27:40 +08:00
mindspore-ci-bot 140a15924c !17 [AutoParallel]Fix bug in the case of two cast
Merge pull request !17 from lichen/fix_cast_bug
2020-03-31 10:25:04 +08:00
mindspore-ci-bot e9be3483fe !33 Optimize the execution time of test case test_rgb_hsv.py
Merge pull request !33 from qianlong21st/ql/fix_test_rgb_hsv
2020-03-31 09:53:01 +08:00
zhaozhenlong b12e6ff780 add operator diag and diag_part 2020-03-31 09:44:56 +08:00
mindspore-ci-bot c1c8fef9ca !24 Change strategy for structure output
Merge pull request !24 from 步学/structure-output
2020-03-31 09:38:44 +08:00
qianlong 8c88b39da1 Optimize the execution time of test case test_rgb_hsv.py 2020-03-31 09:23:20 +08:00
lichenever b4d34973bc fix_cast_bug 2020-03-30 21:13:45 +08:00
buxue 0da0bdcf40 Fix bug structure output when there is depend whose first input is constant in outputs 2020-03-30 19:49:46 +08:00
Ziyan 4cbcd8e907 enable use float type learning rate in lars optimizer 2020-03-30 19:05:33 +08:00
jonyguo 34e42bd6f9 1. add more log info for dataset & mindrecord, 2. add two new testcase for MindDataset 2020-03-30 17:24:24 +08:00
zhunaipan 930a1fb0a8 initial version
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
2020-03-27 22:54:54 +08:00