Commit Graph

906 Commits

Author SHA1 Message Date
mindspore-ci-bot aa1cee113d !1279 test(custom_op): clean up custom op test case.
Merge pull request !1279 from gongchen/fix_custom_op_case
2020-05-20 15:21:31 +08:00
mindspore-ci-bot 89470cf29d !1263 Modified clip_gradients to clip_grad
Merge pull request !1263 from Kang/master
2020-05-20 14:15:05 +08:00
mindspore-ci-bot 1ba8e052f8 !1125 support vm for space_to_depth
Merge pull request !1125 from jiangjinsheng/space_to_depth
2020-05-20 11:59:21 +08:00
Kang bfff7c0a2f Modified clip_gradients to clip_grad 2020-05-20 11:58:47 +08:00
mindspore-ci-bot 97ba539e7b !1269 fix issue of loadding control input tensors failed in control sink mode
Merge pull request !1269 from wenchunjiang/fix_task_sink_bug
2020-05-20 11:33:12 +08:00
jiangjinsheng ce09f5e15a vm for prelu and prelugrad 2020-05-20 11:21:56 +08:00
liubuyu 37be555a81 pylint clean 2020-05-20 11:12:14 +08:00
gongchen 44458865b6 test(custom_op): Clean up custom op test case. 2020-05-20 11:03:18 +08:00
wenchunjiang 729ea8cc55 fix bug of loadding ctrl input tensors failed in control sink mode 2020-05-20 10:45:28 +08:00
mindspore-ci-bot 6ffb3c97cd !1058 add host cpu kernel: GatherV2/Concat/Slice/SliceGrad
Merge pull request !1058 from sunsuodong/lstm_ops
2020-05-20 10:26:30 +08:00
mindspore-ci-bot b391e43407 !1262 fix bert precision bug
Merge pull request !1262 from wanghua/master
2020-05-20 10:23:17 +08:00
mindspore-ci-bot 04ac611fe8 !1189 Decoupling py default param from Parameter
Merge pull request !1189 from leopz/master
2020-05-20 10:02:01 +08:00
huangdongrun 3cf94daefc add support for dict setitem operation
format code

remove save_graph

raise exception when dictionary setitem if the key not exists

resolve error

remove unnessary op_
2020-05-20 09:58:30 +08:00
jiangjinsheng ba99cb7bcb support vm for space_to_depth 2020-05-20 09:47:12 +08:00
Tinazhang 17cecf2cf5 Added TCs to RandomCrop and RandomCropAndResize and modified visalize() calling 2020-05-19 15:42:24 -04:00
mindspore-ci-bot fe8b59f26b !1111 support vm for pack and unpack
Merge pull request !1111 from jiangjinsheng/vm_pack
2020-05-19 21:36:16 +08:00
wanghua 2703ac5ba4 fix bert percision problem 2020-05-19 21:01:42 +08:00
leopz 40e15996b0 move default_param out of parameter and remove pybind11 in anf define 2020-05-19 19:11:12 +08:00
Wei Luning 3db8cfa54f add pattern AdjustAllReduceMulAdduse the old opadd test case for bugtemp fix try 2020-05-19 18:46:11 +08:00
mindspore-ci-bot c9ce34ea48 !1194 test(custom_op): add custom op testcase.
Merge pull request !1194 from gongchen/add_custom_op_test
2020-05-19 16:58:36 +08:00
jiangjinsheng f9bd460c96 support vm for pack 2020-05-19 16:52:41 +08:00
gongchen 366364ba38 Add custom op testcases. 2020-05-19 14:38:18 +08:00
mindspore-ci-bot c793540cc9 !1231 Assign label resource for new control sink
Merge pull request !1231 from zhoufeng/label-assign
2020-05-19 10:48:35 +08:00
mindspore-ci-bot 18c9495000 !1228 Adapt tbe op UnsortedSegmentMin for GE.
Merge pull request !1228 from liuxiao/UnsortedSegmentMin
2020-05-19 09:04:22 +08:00
mindspore-ci-bot 9f9af3c59a !1224 add squaresumall op
Merge pull request !1224 from JichenZhao/squaresumall
2020-05-18 22:18:21 +08:00
zhoufeng c99f904276 assign label resource for new control sink
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2020-05-18 21:44:52 +08:00
mindspore-ci-bot 828d0b124e !1209 add format trans function
Merge pull request !1209 from liubuyu/master
2020-05-18 20:59:43 +08:00
liuxiao cc024bb3a1 UnsortedSegmentMin for GE 2020-05-18 20:49:58 +08:00
zhaojichen d1d1766bed add squaresumall op 2020-05-18 08:01:22 -04:00
mindspore-ci-bot 1b7cdc4c61 !1218 clean pylint warning in test about import
Merge pull request !1218 from jinyaohui/pylint1
2020-05-18 19:54:04 +08:00
liubuyu f70429d671 add format transfer 2020-05-18 19:45:04 +08:00
mindspore-ci-bot 3b6de89368 !1187 Checkpoint and restore parameter's shape
Merge pull request !1187 from yangzhenzhang/ckpt-and-restore-parameter-shape
2020-05-18 19:05:45 +08:00
yujianfeng c8d33568f2 Add an new output to FusedMulApplyMomentum 2020-05-18 17:03:21 +08:00
jinyaohui 5a914994ba clean pylint 2020-05-18 16:42:35 +08:00
sunsuodong 28241d0293 lstm ops 2020-05-18 16:39:09 +08:00
yangzhenzhang 6b54a6417d ckpt and restore parameter shape 2020-05-18 15:16:29 +08:00
huanghui c4af71e236 add LarsV2 fission pass 2020-05-18 11:30:45 +08:00
jinyaohui bcfaff97f9 clean pylint 2020-05-18 10:31:46 +08:00
mindspore-ci-bot 93f6fc0ab0 !1188 fine tuning mindspore_test_framework
Merge pull request !1188 from panyifeng/fine_tuning_mindspore_test_framework
2020-05-18 10:23:37 +08:00
mindspore-ci-bot 051567ba20 !1192 Support string type Stage !
Merge pull request !1192 from h.farahat/string_Tensor
2020-05-18 09:51:17 +08:00
mindspore-ci-bot 78a29bba3c !972 Fix CSE bug for some operations like `DropoutGenMask` which may have random effect
Merge pull request !972 from seatea/fix-cse-bug-for-random-effect
2020-05-18 09:39:16 +08:00
mindspore-ci-bot 4efa9717bb !1129 Add op bounding box encoder
Merge pull request !1129 from zhaozhenlong/op/bounding-box-encoder
2020-05-18 09:04:59 +08:00
mindspore-ci-bot 6de7eb2633 !1203 delete ApplyAdamD for master
Merge pull request !1203 from changzherui/code516
2020-05-17 20:14:06 +08:00
changzherui 1e93927772 code 516 for test 2020-05-17 15:28:17 +08:00
mindspore-ci-bot c3d9f18087 !1176 fix validator for transpose
Merge pull request !1176 from jiangjinsheng/issue_transpose
2020-05-16 19:10:35 +08:00
seatea 981b013f81 Fix CSE bug for some operations like `DropoutGenMask` which should not
be optimized as it will generate different values each time.
2020-05-16 18:58:43 +08:00
mindspore-ci-bot c169ac6a18 !1195 add validate for geswitch and merge
Merge pull request !1195 from jiangjinsheng/issue_geswitch
2020-05-16 18:43:19 +08:00
jiangjinsheng e45532b78c fixed transpose 2020-05-16 18:07:52 +08:00
jiangjinsheng c05203ef06 add validate for geswitch and merge 2020-05-16 17:49:21 +08:00
mindspore-ci-bot 0040764dec !1100 delete some context param(enable_loop_sink,enable_mem_reuse,enable_auto_mixed_precision)
Merge pull request !1100 from jinyaohui/context_opt_2
2020-05-16 15:38:40 +08:00
jinyaohui 2907cf4488 remove some context param 2020-05-16 15:07:13 +08:00
zhaozhenlong b54ffdc086 add op BoundingBoxDecode
iou

NMSWithMask

larsupdate testcase

sgd testcase
2020-05-16 02:40:16 -04:00
mindspore-ci-bot 92d196f054 !1178 Complete vm ops for ROIAlign and ROIAlignGrad
Merge pull request !1178 from zhouneng/add_vm_support_roialign
2020-05-16 11:15:13 +08:00
hesham e8ca243364 -Add DE_STRING
-replace switch'case by indexing

- Add test case
- Add constructors
- Add getItem string

- Fix bugs
- Add more tests

- Tensor iterator
- asNumpy
- TextFileDataset

- Tensor(Numpy)

- Super > 2D
- Add more test cases for GeneratorDataset

- Change StartAddr to GetBuffer and GetMutableNuffer

- Raise an error if batch is used with strings

Clean-up work
2020-05-15 20:33:28 -04:00
mindspore-ci-bot 7240c6feff !1061 Add flat_map op to Dataset
Merge pull request !1061 from jiangzhiwen/dataset/flat_map
2020-05-15 20:14:30 +08:00
jiangzhiwen cb2814b498 flat_map first commit 2020-05-15 17:45:39 +08:00
mindspore-ci-bot ca64bfdbab !1120 Code refactoring :modify Infer to Eval
Merge pull request !1120 from Kang/master
2020-05-15 17:44:29 +08:00
mindspore-ci-bot 889d7b6eea !1180 [pre_activate]Fix pylint warning
Merge pull request !1180 from YuJianfeng/master
2020-05-15 17:25:34 +08:00
mindspore-ci-bot efb9672849 !1118 Add BatchNormGrad2BNInferGrad pass
Merge pull request !1118 from huanghui/batchnormgrad-to-bninfergrad-pass
2020-05-15 17:15:38 +08:00
mindspore-ci-bot c680cfbf27 !1157 dataset: add concat operation for dataset
Merge pull request !1157 from ms_yan/concat_dataset
2020-05-15 16:07:19 +08:00
mindspore-ci-bot ab031ee9ea !1126 VOCDataset support object detection function
Merge pull request !1126 from xiefangqi/voc_support_detection
2020-05-15 15:56:39 +08:00
yujianfeng 0f42fdbb80 Fix pylint warning 2020-05-15 15:29:22 +08:00
zhouneng c2a1b5f8c1 add register info for ROIAlign and ROIAlignGrad 2020-05-15 14:58:33 +08:00
mindspore-ci-bot dbac31e787 !1175 LayerNormGrad fix & codex
Merge pull request !1175 from chenweifeng/layernorm
2020-05-15 14:55:36 +08:00
huanghui 709828a98b add BatchNormGrad2BNInferGrad pass 2020-05-15 14:37:50 +08:00
mindspore-ci-bot 42ba885e58 !1098 Add BatchNorm2BNInfer pass
Merge pull request !1098 from huanghui/add-batchnorm-bninfer-pass
2020-05-15 14:33:09 +08:00
xiefangqi c937bad53f minddata support voc 2020-05-15 13:24:03 +08:00
ms_yan c0fa7b4b19 init commit of concat dataset
change to use __add__ operation instead ds.concat
2020-05-15 13:14:13 +08:00
wilfChen 1991a89f40 LayerNormGrad fix & codex 2020-05-15 11:16:30 +08:00
mindspore-ci-bot 6f68dd7d12 !1130 support vm for flatten
Merge pull request !1130 from jiangjinsheng/flatten
2020-05-15 11:06:00 +08:00
mindspore-ci-bot c786596641 !1156 Add batch_norm grad infer fission pass
Merge pull request !1156 from YuJianfeng/master
2020-05-15 10:38:32 +08:00
jiangjinsheng 766906dd6d support vm for flatten 2020-05-15 10:30:58 +08:00
Kang be60bd3d79 Code refactoring for the static_analysis : modified Infer to Eval. 2020-05-15 09:56:41 +08:00
huanghui 6db71e6576 add batchnorm2bninfer pass 2020-05-15 09:56:38 +08:00
mindspore-ci-bot 8a853cec2d !1171 adjust onnx related testcases
Merge pull request !1171 from fary86/adjust_onnx_related_uts
2020-05-15 09:46:11 +08:00
yujianfeng 2b061c84c7 Add batch_norm_grad infer fisson 2020-05-15 09:44:40 +08:00
mindspore-ci-bot 597933b04b !1113 rename kernel/mng to kernel/rts
Merge pull request !1113 from dengwentao/rts
2020-05-15 09:39:18 +08:00
mindspore-ci-bot d2efa20cab !1163 Add BatchNorm fusion pattern with mix precision
Merge pull request !1163 from YuJianfeng/bn_fusion_with_cast
2020-05-15 09:20:36 +08:00
mindspore-ci-bot bb374ebc28 !1015 Support weights to be compiled according to shape
Merge pull request !1015 from candanzg/me_with_shape
2020-05-15 09:13:41 +08:00
fary86 fe2ee14340 Adjust onnx exporting related testcases 2020-05-15 03:21:29 +08:00
mindspore-ci-bot a9816fa779 !1026 Add Logsigmoid and Reduce_logsumexp
Merge pull request !1026 from peixu_ren/custom_pp_ops
2020-05-14 22:02:58 +08:00
yujianfeng 6e89ebe6f0 Add BatchNorm fusion pattern with mix precision 2020-05-14 21:28:08 +08:00
panyifeng 5a7abf0740 tuning mindspore_test_framework 2020-05-14 17:26:52 +08:00
jonyguo be2e7531ca fix: MindDataset parameter shard_id & num_shards check 2020-05-14 17:18:11 +08:00
mindspore-ci-bot 4bb46606db !1149 fix pylint in tests
Merge pull request !1149 from panyifeng/fix_pylint
2020-05-14 15:15:52 +08:00
mindspore-ci-bot 5075f0a27e !1146 add matmul eltwise buffer fusion
Merge pull request !1146 from Etone.Chan/master
2020-05-14 14:54:54 +08:00
panyifeng 755ba75deb fix pylint 2020-05-14 14:22:52 +08:00
mindspore-ci-bot 4bb5c7b39a !1084 add new interface quant combined
Merge pull request !1084 from SanjayChan/04quant
2020-05-14 11:19:00 +08:00
peixu_ren 99fda6f431 Add logsigmoid and reduce_logsumexp 2020-05-13 23:52:10 -03:00
etone-chan c4a5bfb787 add matmul eltwise buffer fusion pass 2020-05-14 10:36:23 +08:00
mindspore-ci-bot a2a3b1c6c5 !1089 Add Optimizer method get_lr_parameter
Merge pull request !1089 from ghzl/add-get-lr-base-on-parameter
2020-05-14 09:40:31 +08:00
mindspore-ci-bot 9e116e15fb !1139 Change Thread::Join to async call with time out
Merge pull request !1139 from JesseKLee/timing_hole
2020-05-14 09:07:06 +08:00
mindspore-ci-bot 1a052f7155 !1131 [Data]fix cmake build format
Merge pull request !1131 from xulei/filter_op
2020-05-14 08:24:35 +08:00
Jesse Lee f2be49d85e Fix a racing condition 2020-05-13 14:59:25 -04:00
Cathy Wong 913074e656 Cleanup dataset UT: resolve skipped test units 2020-05-13 14:41:57 -04:00
mindspore-ci-bot 6b68671805 !1069 Use a resident process to write summary files and SummaryRecord as context manager
Merge pull request !1069 from 李鸿章/context_manager
2020-05-13 22:44:39 +08:00
李鸿章 32c1d558f4 SummaryRecord as context manager 2020-05-13 21:53:24 +08:00
mindspore-ci-bot 7e3ec651dc !1094 Complete vm ops for L2Normalize and L2NormalizeGrad
Merge pull request !1094 from zhouneng/add_vm_support_l2normalize
2020-05-13 21:52:45 +08:00
candanzg 2cc85bdc93 Support weight compile according to shape
Signed-off-by: candanzg <zhangshucheng@huawei.com>
2020-05-13 17:49:07 +08:00
mindspore-ci-bot 21bcdcd8ad !1121 Complete vm ops for ResizeBilinear and ResizeBilinearGrad
Merge pull request !1121 from lihongkang/master
2020-05-13 17:43:04 +08:00
chenzomi 1239cd6135 Merge branch 'master' into 04quant 2020-05-13 17:31:50 +08:00
guohongzilong e70b2f5430 add optimizer.get_lr_parameter() method 2020-05-13 17:21:22 +08:00
chenzomi bf6246e617 add quant combined 2020-05-13 17:05:45 +08:00
xulei2020 903b64daa2 fix cmake build format 2020-05-13 17:00:35 +08:00
mindspore-ci-bot 8b98f921cc !1124 Add broadcast fusion pass
Merge pull request !1124 from YuJianfeng/master
2020-05-13 16:29:33 +08:00
dengwentao fa83fc3e02 rename kernel/mng to kernel/rts 2020-05-13 16:26:17 +08:00
mindspore-ci-bot 1a98c6b459 !999 [MD] mindrecord support reading file list
Merge pull request !999 from liyong126/mindrecord_file_list
2020-05-13 15:53:26 +08:00
mindspore-ci-bot 049d3796a6 !1091 gpu support Cast/RealDiv/Mul/Sub/Softmax kernels enforcement
Merge pull request !1091 from chenweifeng/cast
2020-05-13 15:42:20 +08:00
yujianfeng 31d8db9fc6 Add broadcast fusion pass 2020-05-13 15:30:38 +08:00
mindspore-ci-bot 86d4797399 !1079 Convert AiCpu kernel when aicore not supported
Merge pull request !1079 from lianliguang/convert-to-AICPU-when-AiCore-not-supported-kernel
2020-05-13 15:15:00 +08:00
mindspore-ci-bot 25b2424f9b !1042 clean pylint warning in test_framwork dir
Merge pull request !1042 from jinyaohui/clean_pylint
2020-05-13 14:51:36 +08:00
lihongkang ca8a914736 接入算子resizebilinear and resizebilineargrad 2020-05-13 14:27:35 +08:00
mindspore-ci-bot 6f386c5782 !1082 Support 'break', 'continue' and 'pass' statements
Merge pull request !1082 from hewei/support_cont_break
2020-05-13 14:19:28 +08:00
liyong aa3f89e74f mindrecord support read file list 2020-05-13 14:11:59 +08:00
He Wei 33fa90efc9 Support 'break', 'continue' and 'pass'
To handle 'break' and 'continue' statement, a loop context is pushed
to a stack before we parse the loop body, and pop it after body parsed.
When a 'break', 'continue' statement is encountered, we retrieve current
loop contex from the stack, and let the current block jump to the end
block or header block;

For 'break' statement, we added an extra 'end_block' follow the 'after_block',
because 'after_block' is called from a ContionalJump in 'header_block', it can
not be set as jump target from other place. to support 'break', we let loop
body jump to the 'end_block' at the 'break' point. and 'after_block'
maybe a good place to handle loop 'else' clause in the future.

Handle 'pass' is simple, just bypass it when doing parse.
2020-05-13 12:53:07 +08:00
WilliamLian 691b0648e3 convert unsupported kernel in aicore to aicpu 2020-05-13 11:52:26 +08:00
mindspore-ci-bot 0345995000 !1110 [AutoParallel]fix gatherv2 and dataset bug
Merge pull request !1110 from lichen/fix_gatherv2_and_dataset_bug
2020-05-13 11:42:09 +08:00
jinyaohui 26fd75895d pylint waring clean 2020-05-13 11:30:27 +08:00
mindspore-ci-bot 168dfb2555 !1108 Add input shape condition for transpose_reshape fusion pass
Merge pull request !1108 from YuJianfeng/master
2020-05-13 10:16:39 +08:00
mindspore-ci-bot 18019ad6a5 !1038 clean some context param
Merge pull request !1038 from jinyaohui/clean_context
2020-05-13 09:54:43 +08:00
lichenever debfd38b75 fix gatherv2 and dataset bug 2020-05-13 09:44:37 +08:00
mindspore-ci-bot ba3d48817e !1070 Adapt aicpu op CTCLoss and TBE op L2Loss for GE.
Merge pull request !1070 from liuxiao/ops-for-VM
2020-05-13 09:43:42 +08:00
yujianfeng 85ff90c237 Add input shape condition for transpose_reshape fusion pass 2020-05-12 22:54:21 +08:00
jinyaohui 391a060f21 remove two context param 2020-05-12 22:11:50 +08:00
wilfChen 59c4cf256c gpu support broadcast kernels 2020-05-12 20:59:56 +08:00
mindspore-ci-bot 48e54dcfda !1056 [Auto parallel] Memory calculation in the inference phase
Merge pull request !1056 from Xiaoda/memory-estimation-in-inference-phase
2020-05-12 17:21:05 +08:00
zhouneng 79725af4cd 为L2Normalize/L2NormalizeGrad增加VM支持 2020-05-12 16:46:02 +08:00
liuxiao 10abb68498 add ops CTCLoss 2020-05-12 15:58:51 +08:00
mindspore-ci-bot fdad91355f !1093 reset parallel context before running each parallel test case
Merge pull request !1093 from yihuaijie/master
2020-05-12 15:57:55 +08:00
mindspore-ci-bot da7d605e85 !683 WIP: specialize hyper map parameter
Merge pull request !683 from xychow/bypass-renorm-and-specialize-hypermap-parameter
2020-05-12 15:50:00 +08:00
mindspore-ci-bot 6ab046e4dd !1062 Adapt Softplus\SoftplusGrad for VM, and ApplyFtrlD for both GE and VM.
Merge pull request !1062 from liuxiao/softplus-softplusgrad
2020-05-12 15:35:56 +08:00
Xiaoda Zhang a05aa21cc2 calculating PEAK memory cost in the inference phase 2020-05-12 15:30:59 +08:00
mindspore-ci-bot 06a9eeb3bf !1050 [bug][auto_mixed_precision]fix sens shape error of `TrainOneStepWithLossScaleCell`
Merge pull request !1050 from vlne-v1/I1GEPN-check-bprop-error-loss-scale-wrap
2020-05-12 15:23:46 +08:00
Yi Huaijie 462f30e077 reset auto parallel context before each test 2020-05-12 14:59:45 +08:00
mindspore-ci-bot 98112d1a64 !997 support vm for log1p
Merge pull request !997 from jiangjinsheng/log1p
2020-05-12 14:21:14 +08:00
Wei Luning 3e89f7baaa fix sens shape error in loss_scale one_step_wrap 2020-05-12 14:09:51 +08:00
mindspore-ci-bot 28a6daaed5 !1017 add profiling_mode and profiling_options to context
Merge pull request !1017 from jinyaohui/context_opt
2020-05-12 11:55:14 +08:00
jiangjinsheng c36e7f1564 support vm for log1p 2020-05-12 11:46:18 +08:00
mindspore-ci-bot 8003a89a7b !766 bugfix(SA): Add the support of nested loop.
Merge pull request !766 from gongchen/nest_loop
2020-05-12 11:10:53 +08:00
mindspore-ci-bot fd72534a1c !1065 Seperate lr groups and weight_decay groups
Merge pull request !1065 from ghzl/improve-parameter-groups
2020-05-12 10:13:05 +08:00
mindspore-ci-bot 4fe6ddebd1 !1075 Cleanup dataset UT: util.py internals
Merge pull request !1075 from cathwong/ckw_dataset_ut_cleanup3
2020-05-12 09:58:14 +08:00
jinyaohui 5a9de3716d add profiling mode and profiling options to context 2020-05-12 09:53:08 +08:00
zhousiyi 047ac018da specialize hypermap paramater 2020-05-12 01:51:57 +00:00
mindspore-ci-bot 4a8fcf5d76 !1055 support vm for floor
Merge pull request !1055 from jiangjinsheng/vm_floor
2020-05-12 09:20:16 +08:00
mindspore-ci-bot 05e8b8028b !1060 Fix bug of assigning value to non-Parameter class member
Merge pull request !1060 from fary86/fix_assign_target_not_parameter
2020-05-12 09:20:08 +08:00
mindspore-ci-bot 66667d727e !1034 Gpu Support Dropout operator
Merge pull request !1034 from SanjayChan/dropout
2020-05-12 09:11:30 +08:00
Jesse Lee 3c643e7298 Move from dataset_dev branch to here 2020-05-11 15:11:53 -04:00
Cathy Wong 49ef53f164 Cleanup dataset UT: util.py internals 2020-05-11 14:44:24 -04:00
mindspore-ci-bot 2bc3fcb1c1 !1044 clean pylint warning in test dir
Merge pull request !1044 from jinyaohui/clean_pylint_test
2020-05-11 22:07:46 +08:00
mindspore-ci-bot 2af6ee2482 !1054 Add slice shape for param info
Merge pull request !1054 from yangzhenzhang/add-slice-shape-for-param-info
2020-05-11 21:29:40 +08:00