Commit Graph

1021 Commits

Author SHA1 Message Date
yangzhenzhang 6b54a6417d ckpt and restore parameter shape 2020-05-18 15:16:29 +08:00
huanghui c4af71e236 add LarsV2 fission pass 2020-05-18 11:30:45 +08:00
jinyaohui bcfaff97f9 clean pylint 2020-05-18 10:31:46 +08:00
mindspore-ci-bot 93f6fc0ab0 !1188 fine tuning mindspore_test_framework
Merge pull request !1188 from panyifeng/fine_tuning_mindspore_test_framework
2020-05-18 10:23:37 +08:00
mindspore-ci-bot 051567ba20 !1192 Support string type Stage !
Merge pull request !1192 from h.farahat/string_Tensor
2020-05-18 09:51:17 +08:00
mindspore-ci-bot 78a29bba3c !972 Fix CSE bug for some operations like `DropoutGenMask` which may have random effect
Merge pull request !972 from seatea/fix-cse-bug-for-random-effect
2020-05-18 09:39:16 +08:00
mindspore-ci-bot 4efa9717bb !1129 Add op bounding box encoder
Merge pull request !1129 from zhaozhenlong/op/bounding-box-encoder
2020-05-18 09:04:59 +08:00
mindspore-ci-bot 6de7eb2633 !1203 delete ApplyAdamD for master
Merge pull request !1203 from changzherui/code516
2020-05-17 20:14:06 +08:00
changzherui 1e93927772 code 516 for test 2020-05-17 15:28:17 +08:00
mindspore-ci-bot c3d9f18087 !1176 fix validator for transpose
Merge pull request !1176 from jiangjinsheng/issue_transpose
2020-05-16 19:10:35 +08:00
seatea 981b013f81 Fix CSE bug for some operations like `DropoutGenMask` which should not
be optimized as it will generate different values each time.
2020-05-16 18:58:43 +08:00
mindspore-ci-bot c169ac6a18 !1195 add validate for geswitch and merge
Merge pull request !1195 from jiangjinsheng/issue_geswitch
2020-05-16 18:43:19 +08:00
jiangjinsheng e45532b78c fixed transpose 2020-05-16 18:07:52 +08:00
jiangjinsheng c05203ef06 add validate for geswitch and merge 2020-05-16 17:49:21 +08:00
mindspore-ci-bot 0040764dec !1100 delete some context param(enable_loop_sink,enable_mem_reuse,enable_auto_mixed_precision)
Merge pull request !1100 from jinyaohui/context_opt_2
2020-05-16 15:38:40 +08:00
jinyaohui 2907cf4488 remove some context param 2020-05-16 15:07:13 +08:00
zhaozhenlong b54ffdc086 add op BoundingBoxDecode
iou

NMSWithMask

larsupdate testcase

sgd testcase
2020-05-16 02:40:16 -04:00
mindspore-ci-bot 92d196f054 !1178 Complete vm ops for ROIAlign and ROIAlignGrad
Merge pull request !1178 from zhouneng/add_vm_support_roialign
2020-05-16 11:15:13 +08:00
hesham e8ca243364 -Add DE_STRING
-replace switch'case by indexing

- Add test case
- Add constructors
- Add getItem string

- Fix bugs
- Add more tests

- Tensor iterator
- asNumpy
- TextFileDataset

- Tensor(Numpy)

- Super > 2D
- Add more test cases for GeneratorDataset

- Change StartAddr to GetBuffer and GetMutableNuffer

- Raise an error if batch is used with strings

Clean-up work
2020-05-15 20:33:28 -04:00
mindspore-ci-bot 7240c6feff !1061 Add flat_map op to Dataset
Merge pull request !1061 from jiangzhiwen/dataset/flat_map
2020-05-15 20:14:30 +08:00
jiangzhiwen cb2814b498 flat_map first commit 2020-05-15 17:45:39 +08:00
mindspore-ci-bot ca64bfdbab !1120 Code refactoring :modify Infer to Eval
Merge pull request !1120 from Kang/master
2020-05-15 17:44:29 +08:00
mindspore-ci-bot 889d7b6eea !1180 [pre_activate]Fix pylint warning
Merge pull request !1180 from YuJianfeng/master
2020-05-15 17:25:34 +08:00
mindspore-ci-bot efb9672849 !1118 Add BatchNormGrad2BNInferGrad pass
Merge pull request !1118 from huanghui/batchnormgrad-to-bninfergrad-pass
2020-05-15 17:15:38 +08:00
mindspore-ci-bot c680cfbf27 !1157 dataset: add concat operation for dataset
Merge pull request !1157 from ms_yan/concat_dataset
2020-05-15 16:07:19 +08:00
mindspore-ci-bot ab031ee9ea !1126 VOCDataset support object detection function
Merge pull request !1126 from xiefangqi/voc_support_detection
2020-05-15 15:56:39 +08:00
yujianfeng 0f42fdbb80 Fix pylint warning 2020-05-15 15:29:22 +08:00
zhouneng c2a1b5f8c1 add register info for ROIAlign and ROIAlignGrad 2020-05-15 14:58:33 +08:00
mindspore-ci-bot dbac31e787 !1175 LayerNormGrad fix & codex
Merge pull request !1175 from chenweifeng/layernorm
2020-05-15 14:55:36 +08:00
huanghui 709828a98b add BatchNormGrad2BNInferGrad pass 2020-05-15 14:37:50 +08:00
mindspore-ci-bot 42ba885e58 !1098 Add BatchNorm2BNInfer pass
Merge pull request !1098 from huanghui/add-batchnorm-bninfer-pass
2020-05-15 14:33:09 +08:00
xiefangqi c937bad53f minddata support voc 2020-05-15 13:24:03 +08:00
ms_yan c0fa7b4b19 init commit of concat dataset
change to use __add__ operation instead ds.concat
2020-05-15 13:14:13 +08:00
wilfChen 1991a89f40 LayerNormGrad fix & codex 2020-05-15 11:16:30 +08:00
mindspore-ci-bot 6f68dd7d12 !1130 support vm for flatten
Merge pull request !1130 from jiangjinsheng/flatten
2020-05-15 11:06:00 +08:00
mindspore-ci-bot c786596641 !1156 Add batch_norm grad infer fission pass
Merge pull request !1156 from YuJianfeng/master
2020-05-15 10:38:32 +08:00
jiangjinsheng 766906dd6d support vm for flatten 2020-05-15 10:30:58 +08:00
Kang be60bd3d79 Code refactoring for the static_analysis : modified Infer to Eval. 2020-05-15 09:56:41 +08:00
huanghui 6db71e6576 add batchnorm2bninfer pass 2020-05-15 09:56:38 +08:00
mindspore-ci-bot 8a853cec2d !1171 adjust onnx related testcases
Merge pull request !1171 from fary86/adjust_onnx_related_uts
2020-05-15 09:46:11 +08:00
yujianfeng 2b061c84c7 Add batch_norm_grad infer fisson 2020-05-15 09:44:40 +08:00
mindspore-ci-bot 597933b04b !1113 rename kernel/mng to kernel/rts
Merge pull request !1113 from dengwentao/rts
2020-05-15 09:39:18 +08:00
mindspore-ci-bot d2efa20cab !1163 Add BatchNorm fusion pattern with mix precision
Merge pull request !1163 from YuJianfeng/bn_fusion_with_cast
2020-05-15 09:20:36 +08:00
mindspore-ci-bot bb374ebc28 !1015 Support weights to be compiled according to shape
Merge pull request !1015 from candanzg/me_with_shape
2020-05-15 09:13:41 +08:00
fary86 fe2ee14340 Adjust onnx exporting related testcases 2020-05-15 03:21:29 +08:00
mindspore-ci-bot a9816fa779 !1026 Add Logsigmoid and Reduce_logsumexp
Merge pull request !1026 from peixu_ren/custom_pp_ops
2020-05-14 22:02:58 +08:00
yujianfeng 6e89ebe6f0 Add BatchNorm fusion pattern with mix precision 2020-05-14 21:28:08 +08:00
panyifeng 5a7abf0740 tuning mindspore_test_framework 2020-05-14 17:26:52 +08:00
jonyguo be2e7531ca fix: MindDataset parameter shard_id & num_shards check 2020-05-14 17:18:11 +08:00
mindspore-ci-bot 4bb46606db !1149 fix pylint in tests
Merge pull request !1149 from panyifeng/fix_pylint
2020-05-14 15:15:52 +08:00
mindspore-ci-bot 5075f0a27e !1146 add matmul eltwise buffer fusion
Merge pull request !1146 from Etone.Chan/master
2020-05-14 14:54:54 +08:00
panyifeng 755ba75deb fix pylint 2020-05-14 14:22:52 +08:00
mindspore-ci-bot 4bb5c7b39a !1084 add new interface quant combined
Merge pull request !1084 from SanjayChan/04quant
2020-05-14 11:19:00 +08:00
peixu_ren 99fda6f431 Add logsigmoid and reduce_logsumexp 2020-05-13 23:52:10 -03:00
etone-chan c4a5bfb787 add matmul eltwise buffer fusion pass 2020-05-14 10:36:23 +08:00
mindspore-ci-bot a2a3b1c6c5 !1089 Add Optimizer method get_lr_parameter
Merge pull request !1089 from ghzl/add-get-lr-base-on-parameter
2020-05-14 09:40:31 +08:00
mindspore-ci-bot 9e116e15fb !1139 Change Thread::Join to async call with time out
Merge pull request !1139 from JesseKLee/timing_hole
2020-05-14 09:07:06 +08:00
mindspore-ci-bot 1a052f7155 !1131 [Data]fix cmake build format
Merge pull request !1131 from xulei/filter_op
2020-05-14 08:24:35 +08:00
Jesse Lee f2be49d85e Fix a racing condition 2020-05-13 14:59:25 -04:00
Cathy Wong 913074e656 Cleanup dataset UT: resolve skipped test units 2020-05-13 14:41:57 -04:00
mindspore-ci-bot 6b68671805 !1069 Use a resident process to write summary files and SummaryRecord as context manager
Merge pull request !1069 from 李鸿章/context_manager
2020-05-13 22:44:39 +08:00
李鸿章 32c1d558f4 SummaryRecord as context manager 2020-05-13 21:53:24 +08:00
mindspore-ci-bot 7e3ec651dc !1094 Complete vm ops for L2Normalize and L2NormalizeGrad
Merge pull request !1094 from zhouneng/add_vm_support_l2normalize
2020-05-13 21:52:45 +08:00
candanzg 2cc85bdc93 Support weight compile according to shape
Signed-off-by: candanzg <zhangshucheng@huawei.com>
2020-05-13 17:49:07 +08:00
mindspore-ci-bot 21bcdcd8ad !1121 Complete vm ops for ResizeBilinear and ResizeBilinearGrad
Merge pull request !1121 from lihongkang/master
2020-05-13 17:43:04 +08:00
chenzomi 1239cd6135 Merge branch 'master' into 04quant 2020-05-13 17:31:50 +08:00
guohongzilong e70b2f5430 add optimizer.get_lr_parameter() method 2020-05-13 17:21:22 +08:00
chenzomi bf6246e617 add quant combined 2020-05-13 17:05:45 +08:00
xulei2020 903b64daa2 fix cmake build format 2020-05-13 17:00:35 +08:00
mindspore-ci-bot 8b98f921cc !1124 Add broadcast fusion pass
Merge pull request !1124 from YuJianfeng/master
2020-05-13 16:29:33 +08:00
dengwentao fa83fc3e02 rename kernel/mng to kernel/rts 2020-05-13 16:26:17 +08:00
mindspore-ci-bot 1a98c6b459 !999 [MD] mindrecord support reading file list
Merge pull request !999 from liyong126/mindrecord_file_list
2020-05-13 15:53:26 +08:00
mindspore-ci-bot 049d3796a6 !1091 gpu support Cast/RealDiv/Mul/Sub/Softmax kernels enforcement
Merge pull request !1091 from chenweifeng/cast
2020-05-13 15:42:20 +08:00
yujianfeng 31d8db9fc6 Add broadcast fusion pass 2020-05-13 15:30:38 +08:00
mindspore-ci-bot 86d4797399 !1079 Convert AiCpu kernel when aicore not supported
Merge pull request !1079 from lianliguang/convert-to-AICPU-when-AiCore-not-supported-kernel
2020-05-13 15:15:00 +08:00
mindspore-ci-bot 25b2424f9b !1042 clean pylint warning in test_framwork dir
Merge pull request !1042 from jinyaohui/clean_pylint
2020-05-13 14:51:36 +08:00
lihongkang ca8a914736 接入算子resizebilinear and resizebilineargrad 2020-05-13 14:27:35 +08:00
mindspore-ci-bot 6f386c5782 !1082 Support 'break', 'continue' and 'pass' statements
Merge pull request !1082 from hewei/support_cont_break
2020-05-13 14:19:28 +08:00
liyong aa3f89e74f mindrecord support read file list 2020-05-13 14:11:59 +08:00
He Wei 33fa90efc9 Support 'break', 'continue' and 'pass'
To handle 'break' and 'continue' statement, a loop context is pushed
to a stack before we parse the loop body, and pop it after body parsed.
When a 'break', 'continue' statement is encountered, we retrieve current
loop contex from the stack, and let the current block jump to the end
block or header block;

For 'break' statement, we added an extra 'end_block' follow the 'after_block',
because 'after_block' is called from a ContionalJump in 'header_block', it can
not be set as jump target from other place. to support 'break', we let loop
body jump to the 'end_block' at the 'break' point. and 'after_block'
maybe a good place to handle loop 'else' clause in the future.

Handle 'pass' is simple, just bypass it when doing parse.
2020-05-13 12:53:07 +08:00
WilliamLian 691b0648e3 convert unsupported kernel in aicore to aicpu 2020-05-13 11:52:26 +08:00
mindspore-ci-bot 0345995000 !1110 [AutoParallel]fix gatherv2 and dataset bug
Merge pull request !1110 from lichen/fix_gatherv2_and_dataset_bug
2020-05-13 11:42:09 +08:00
jinyaohui 26fd75895d pylint waring clean 2020-05-13 11:30:27 +08:00
mindspore-ci-bot 168dfb2555 !1108 Add input shape condition for transpose_reshape fusion pass
Merge pull request !1108 from YuJianfeng/master
2020-05-13 10:16:39 +08:00
mindspore-ci-bot 18019ad6a5 !1038 clean some context param
Merge pull request !1038 from jinyaohui/clean_context
2020-05-13 09:54:43 +08:00
lichenever debfd38b75 fix gatherv2 and dataset bug 2020-05-13 09:44:37 +08:00
mindspore-ci-bot ba3d48817e !1070 Adapt aicpu op CTCLoss and TBE op L2Loss for GE.
Merge pull request !1070 from liuxiao/ops-for-VM
2020-05-13 09:43:42 +08:00
yujianfeng 85ff90c237 Add input shape condition for transpose_reshape fusion pass 2020-05-12 22:54:21 +08:00
jinyaohui 391a060f21 remove two context param 2020-05-12 22:11:50 +08:00
wilfChen 59c4cf256c gpu support broadcast kernels 2020-05-12 20:59:56 +08:00
mindspore-ci-bot 48e54dcfda !1056 [Auto parallel] Memory calculation in the inference phase
Merge pull request !1056 from Xiaoda/memory-estimation-in-inference-phase
2020-05-12 17:21:05 +08:00
zhouneng 79725af4cd 为L2Normalize/L2NormalizeGrad增加VM支持 2020-05-12 16:46:02 +08:00
liuxiao 10abb68498 add ops CTCLoss 2020-05-12 15:58:51 +08:00
mindspore-ci-bot fdad91355f !1093 reset parallel context before running each parallel test case
Merge pull request !1093 from yihuaijie/master
2020-05-12 15:57:55 +08:00
mindspore-ci-bot da7d605e85 !683 WIP: specialize hyper map parameter
Merge pull request !683 from xychow/bypass-renorm-and-specialize-hypermap-parameter
2020-05-12 15:50:00 +08:00
mindspore-ci-bot 6ab046e4dd !1062 Adapt Softplus\SoftplusGrad for VM, and ApplyFtrlD for both GE and VM.
Merge pull request !1062 from liuxiao/softplus-softplusgrad
2020-05-12 15:35:56 +08:00
Xiaoda Zhang a05aa21cc2 calculating PEAK memory cost in the inference phase 2020-05-12 15:30:59 +08:00
mindspore-ci-bot 06a9eeb3bf !1050 [bug][auto_mixed_precision]fix sens shape error of `TrainOneStepWithLossScaleCell`
Merge pull request !1050 from vlne-v1/I1GEPN-check-bprop-error-loss-scale-wrap
2020-05-12 15:23:46 +08:00
Yi Huaijie 462f30e077 reset auto parallel context before each test 2020-05-12 14:59:45 +08:00
mindspore-ci-bot 98112d1a64 !997 support vm for log1p
Merge pull request !997 from jiangjinsheng/log1p
2020-05-12 14:21:14 +08:00
Wei Luning 3e89f7baaa fix sens shape error in loss_scale one_step_wrap 2020-05-12 14:09:51 +08:00
mindspore-ci-bot 28a6daaed5 !1017 add profiling_mode and profiling_options to context
Merge pull request !1017 from jinyaohui/context_opt
2020-05-12 11:55:14 +08:00
jiangjinsheng c36e7f1564 support vm for log1p 2020-05-12 11:46:18 +08:00
mindspore-ci-bot 8003a89a7b !766 bugfix(SA): Add the support of nested loop.
Merge pull request !766 from gongchen/nest_loop
2020-05-12 11:10:53 +08:00
mindspore-ci-bot fd72534a1c !1065 Seperate lr groups and weight_decay groups
Merge pull request !1065 from ghzl/improve-parameter-groups
2020-05-12 10:13:05 +08:00
mindspore-ci-bot 4fe6ddebd1 !1075 Cleanup dataset UT: util.py internals
Merge pull request !1075 from cathwong/ckw_dataset_ut_cleanup3
2020-05-12 09:58:14 +08:00
jinyaohui 5a9de3716d add profiling mode and profiling options to context 2020-05-12 09:53:08 +08:00
zhousiyi 047ac018da specialize hypermap paramater 2020-05-12 01:51:57 +00:00
mindspore-ci-bot 4a8fcf5d76 !1055 support vm for floor
Merge pull request !1055 from jiangjinsheng/vm_floor
2020-05-12 09:20:16 +08:00
mindspore-ci-bot 05e8b8028b !1060 Fix bug of assigning value to non-Parameter class member
Merge pull request !1060 from fary86/fix_assign_target_not_parameter
2020-05-12 09:20:08 +08:00
mindspore-ci-bot 66667d727e !1034 Gpu Support Dropout operator
Merge pull request !1034 from SanjayChan/dropout
2020-05-12 09:11:30 +08:00
Jesse Lee 3c643e7298 Move from dataset_dev branch to here 2020-05-11 15:11:53 -04:00
Cathy Wong 49ef53f164 Cleanup dataset UT: util.py internals 2020-05-11 14:44:24 -04:00
mindspore-ci-bot 2bc3fcb1c1 !1044 clean pylint warning in test dir
Merge pull request !1044 from jinyaohui/clean_pylint_test
2020-05-11 22:07:46 +08:00
mindspore-ci-bot 2af6ee2482 !1054 Add slice shape for param info
Merge pull request !1054 from yangzhenzhang/add-slice-shape-for-param-info
2020-05-11 21:29:40 +08:00
guohongzilong c95215bca0 seperate lr groups and weight_decay groups 2020-05-11 21:27:30 +08:00
mindspore-ci-bot c72589aad6 !953 add submodule id for log interface
Merge pull request !953 from fary86/add_submodule_id_for_log_interface
2020-05-11 21:13:05 +08:00
jinyaohui d40e89b1bc clean pylint warning in st/ops/ascend 2020-05-11 20:59:30 +08:00
liuxiao 4335e9bc83 adapt Softplus\SoftplusGrad\ApplyFtrlD for VM 2020-05-11 20:45:12 +08:00
fary86 16b9004d53 Fix bug of assign value to non Parameter class member 2020-05-11 20:15:34 +08:00
mindspore-ci-bot 680ce090a3 !1057 matmul support fp16
Merge pull request !1057 from chenweifeng/matmul
2020-05-11 19:46:45 +08:00
mindspore-ci-bot 5ff79d0204 !1048 Support index to switch_layer
Merge pull request !1048 from panyifeng/index_to_switch_case
2020-05-11 19:30:13 +08:00
chenzomi 661f9dfaf8 add dropout primtive 2020-05-11 19:29:18 +08:00
mindspore-ci-bot 00383fc760 !1040 base attention aggregator for Graph Attention Networks
Merge pull request !1040 from zhangdengcheng/master
2020-05-11 19:25:50 +08:00
fary86 3f323e48e2 Add submodule id for log interface 2020-05-11 19:17:45 +08:00
mindspore-ci-bot 57085bb18d !996 [Auto parallel] Supporting VirtualDataset having three inputs
Merge pull request !996 from Xiaoda/supporting-virtualdataset-has-three-inputs
2020-05-11 18:59:09 +08:00
mindspore-ci-bot 0edc6d254a !370 Gpu Support UnsortedSegmentSum kernel
Merge pull request !370 from chenweifeng/unsorted_segment_sum
2020-05-11 18:48:06 +08:00
mindspore-ci-bot 907b609b05 !994 gpu broadcast kernel support different dims
Merge pull request !994 from chenweifeng/broadcast_unequal_dims
2020-05-11 18:43:14 +08:00
mindspore-ci-bot b5096e1f6c !1021 gpu support MinimumGrad & MaximumGrad kernel
Merge pull request !1021 from chenweifeng/broadcast_grad
2020-05-11 17:43:20 +08:00
mindspore-ci-bot da7054645a !948 gpu support LogSoftmax & LogSoftmaxGrad kernel
Merge pull request !948 from chenweifeng/logsoftmax
2020-05-11 17:15:39 +08:00
jiangjinsheng 2fa654e65c support vm for floor 2020-05-11 16:17:20 +08:00
wilfChen b56572bb89 matmul support fp16 2020-05-11 16:09:32 +08:00
yangzhenzhang 05fde3d23d add slice shape for param info 2020-05-11 16:01:55 +08:00
zhangdengcheng 825d9740fa Fixed the bug that mean aggregator argument can not pass to base class and add attention head for GAT 2020-05-11 07:58:39 +00:00
panyifeng 065e25e1bb Support index to switch_layer 2020-05-11 15:52:30 +08:00
yao_yf 716def7c0a move InferStraByTensorInfo to tensor_info.h 2020-05-11 14:44:06 +08:00
mindspore-ci-bot dd2062bf8d !1023 add_gatherv2_distributed_op
Merge pull request !1023 from lichen/add_gatherv2_distributed_op
2020-05-11 09:18:10 +08:00
mindspore-ci-bot af7c54b12a !920 [MS][Bert]Modify example script of bert model.
Merge pull request !920 from wsc/lossscale_script
2020-05-10 13:56:08 +08:00
mindspore-ci-bot 8a45ab1125 !906 fix a bug that support dilation greater than 1 in conv2dTranspose ops
Merge pull request !906 from yangyongjie/master
2020-05-09 21:58:27 +08:00
wsc 46c175a574 Modify example scripts of bert model 2020-05-09 18:52:40 +08:00
mindspore-ci-bot 22632f2f09 !977 reshape operator support auto strategy search
Merge pull request !977 from yao_yf/reshape_auto_parallel_strategy_search
2020-05-09 17:47:24 +08:00
mindspore-ci-bot b45b6a9fe8 !1037 optimize the gpu context switch
Merge pull request !1037 from limingqi107/master
2020-05-09 17:24:49 +08:00
lichenever 19a24b86ac add gatherv2 distributed op 2020-05-09 17:20:50 +08:00
mindspore-ci-bot 68372231bb !1031 Support transform valuetuple of nested graph to make tuple
Merge pull request !1031 from amongo/ValueTupleOfNestedGraph
2020-05-09 17:15:54 +08:00
yao_yf f0bf438a55 reshape strategy search 2020-05-09 17:00:37 +08:00
gongchen 425a207663 bug(SA): Add the support of nested loop. 2020-05-09 16:18:16 +08:00
limingqi107 05e8d95e7f optimize the gpu context switch 2020-05-09 15:31:32 +08:00
huangdongrun 0e89813759 add resolve
transform valuetuple to maketuple of graphs

add testcase
2020-05-09 14:30:19 +08:00
mindspore-ci-bot affdd22de3 !967 Add switch_case primitive
Merge pull request !967 from panyifeng/switch_case_primitive
2020-05-09 14:14:25 +08:00
mindspore-ci-bot 3c124889f9 !901 Refactor vm module for multigraph sink.
Merge pull request !901 from rick_sanchez/master
2020-05-09 11:55:12 +08:00
Xiaoda Zhang 5e041966f1 add a new vritualdataset cell for three inputs 2020-05-09 11:10:33 +08:00
wilfChen 00e78bf6c4 gpu support MinimumGrad & MaximumGrad kernel 2020-05-09 10:38:38 +08:00
mindspore-ci-bot 0eb32593a6 !958 Add parallel mode configuration for cell
Merge pull request !958 from yangzhenzhang/add_parallel_mode_for_cell
2020-05-09 09:45:25 +08:00
panyifeng b7596e1f33 Add switch_case primitive 2020-05-09 09:38:17 +08:00
wilfChen 31f3611f9a gpu support UnsortedSegmentSum kernel 2020-05-09 09:35:15 +08:00
rick_sanchez 6146424596 refactor vm module for multigraph sink 2020-05-09 09:10:27 +08:00
mindspore-ci-bot 2860fd9338 !984 Add unit test case for HWC2CHW.
Merge pull request !984 from Tinazhang/hwc2chw
2020-05-09 05:02:41 +08:00
mindspore-ci-bot 37f787b657 !1019 Cleanup dataset UT: use md5 npz in test_zip for images
Merge pull request !1019 from cathwong/ckw_dataset_ut_cleanup2
2020-05-09 04:56:02 +08:00
Tinazhang c8b5586c7f add unit test for HWC2CHWC 2020-05-08 13:17:20 -04:00
Cathy Wong 58226addd6 Cleanup dataset UT: use md5 npz in test_zip for images 2020-05-08 11:25:48 -04:00
mindspore-ci-bot 9433ca6468 !998 format the func name
Merge pull request !998 from guozhijian/enhance_format_func_name
2020-05-08 20:18:35 +08:00
mindspore-ci-bot a55cb95589 !993 [IRFusion pass enhancement] mul_add_fusion pass supports when add's 2nd is mul
Merge pull request !993 from huanghui/mul-add-fusion-pass-enhancement
2020-05-08 19:43:58 +08:00
jonyguo cf352d190f format func name for mindrecord 2020-05-08 18:33:13 +08:00
wilfChen 0a1195ddf5 broadcast kernel support unqual dims & half 2020-05-08 16:32:15 +08:00
huanghui 12eaaf710b mul_add_fusion pass supports when add's 2nd is mul 2020-05-08 14:28:39 +08:00
ZPaC d3936b9f2a GPU kernels adapt with special dimensions. 2020-05-08 10:26:36 +08:00
mindspore-ci-bot 47f5abceb4 !960 Adding example for grayscale
Merge pull request !960 from EricZ/grayscale_fix
2020-05-08 05:08:15 +08:00
mindspore-ci-bot 078dd86cfe !507 Implemented padded_batch
Merge pull request !507 from ZiruiWu/batch_with_padding
2020-05-08 04:54:05 +08:00
mindspore-ci-bot de7625777f !951 fix: MindDataset with columns_name parameter cause errors in some scenes
Merge pull request !951 from guozhijian/fix_read_by_columns
2020-05-08 04:51:03 +08:00
eric 0f0548f21b Added test case for grayscale support 2020-05-07 15:09:57 -04:00
Zirui Wu c2d364a573 batch with padding implemented
support for 1 specific dimension to be None, added validator

fix various CI complains

another round of CI fixes

ci

refactor parts of the code

code refactor

ci fix

comments added, fix bugs

address review comments

address review comments

review cmts

added simple perf test script

update pad code

perf imprv
2020-05-07 11:18:42 -04:00
mindspore-ci-bot 16930c562d !969 [MD] fix bug in pk sampler of minddataset
Merge pull request !969 from liyong126/fix_mindrecord_pk_sampler
2020-05-07 23:01:46 +08:00
yangzhenzhang 8c9730b3c5 add parallel mode for cell 2020-05-07 20:11:20 +08:00
wilfChen 1eb60df5d4 gpu support logsoftmax & logsoftmaxgrad kernel 2020-05-07 20:08:31 +08:00
mindspore-ci-bot 7c64048d76 !935 develop op ScatterMax and dock ge process
Merge pull request !935 from zhangbuxue/develop_scatter_max_op_and_dock_ge
2020-05-07 19:35:57 +08:00
mindspore-ci-bot becaf39262 !957 complete vm ops for BatchToSpace and SpaceToBatch
Merge pull request !957 from jiangjinsheng/space_to_batch
2020-05-07 19:11:32 +08:00
mindspore-ci-bot bda4ebd591 !322 Gpu Support RMSProp kernel
Merge pull request !322 from chenweifeng/rmsprop
2020-05-07 19:03:42 +08:00
mindspore-ci-bot f602970990 !323 Gpu Concat support 4 inputs
Merge pull request !323 from chenweifeng/concat
2020-05-07 19:02:46 +08:00
mindspore-ci-bot 4e25fec769 !324 Gpu Slice kernel performance improve
Merge pull request !324 from chenweifeng/slice
2020-05-07 19:01:50 +08:00
mindspore-ci-bot 378a7122a5 !372 Gpu support BatchMatMul kernel
Merge pull request !372 from chenweifeng/batchmatmul
2020-05-07 18:59:28 +08:00
mindspore-ci-bot 97d21ba014 !502 Gpu Support Gelu & GeluGrad
Merge pull request !502 from chenweifeng/gelu
2020-05-07 18:58:45 +08:00
buxue ac86996746 develop op ScatterMax and dock ge process 2020-05-07 18:58:11 +08:00
mindspore-ci-bot a97f30ba7d !516 Gpu support Tanh & TanhGrad kernel
Merge pull request !516 from chenweifeng/tanh
2020-05-07 18:55:37 +08:00
mindspore-ci-bot 38c56fd1a5 !945 gpu queue support Sqrt & Rsqrt kernel
Merge pull request !945 from chenweifeng/unary
2020-05-07 18:51:04 +08:00
jonyguo d4d236bcce fix: use MindDataset by column_names get data error in some situation 2020-05-07 18:12:36 +08:00
mindspore-ci-bot 8a484dbd0b !812 [CR] add lenet train and eval st case
Merge pull request !812 from jinyaohui/train_eval
2020-05-07 18:01:21 +08:00
mindspore-ci-bot 6351f9c837 !859 [Auto parallel] Support searching strategy for inference phase
Merge pull request !859 from Xiaoda/support-inferring-phase-parallel-strategy-searching
2020-05-07 17:38:14 +08:00
mindspore-ci-bot 36970a3b10 !934 gpu support broadcast kernels
Merge pull request !934 from chenweifeng/broadcast
2020-05-07 17:32:34 +08:00
jinyaohui 8b49a4cf0e add lenet train eval gpu st case 2020-05-07 16:59:09 +08:00
mindspore-ci-bot e75d75854d !959 Add Elu\EluGrad ops for VM.
Merge pull request !959 from liuxiao/ops-for-VM
2020-05-07 16:26:41 +08:00
wilfChen a304304c30 gpu support Gelu & GeluGrad kernels 2020-05-07 15:39:27 +08:00
mindspore-ci-bot deae380969 !637 Learning rate and weight decay making group params
Merge pull request !637 from ghzl/learning-rate-make-group-mode
2020-05-07 15:34:10 +08:00
wilfChen 311bf41e6d gpu support tanh & tanhgrad kernel 2020-05-07 15:33:08 +08:00
wilfChen 67a0cc3bf1 gpu queue support unary 2020-05-07 15:25:42 +08:00
jiangjinsheng a945299e42 update test for batch_to_space 2020-05-07 15:21:33 +08:00
liyong b520ca9087 fix pk sampler in mindrecord 2020-05-07 14:54:23 +08:00
Xiaoda Zhang def8573275 implementing-searching-strategy-for-inference 2020-05-07 14:53:50 +08:00
jiangjinsheng 79a3f0821a add vm for batch_to_space and space_to_batch 2020-05-07 10:49:30 +08:00
liuxiao eba74ca8f7 add ops for VM 2020-05-07 10:44:51 +08:00
guohongzilong 824bc30a94 learning rate and weight decay support group mode 2020-05-07 09:38:03 +08:00
mindspore-ci-bot d78b85c8d4 !898 Add batch norm bert fission pass
Merge pull request !898 from YuJianfeng/master
2020-05-06 20:27:17 +08:00
wilfChen 16f0688230 gpu support broadcast kernels 2020-05-06 19:43:37 +08:00
mindspore-ci-bot 3d3b9d5474 !840 [BUG] fix conv2dtranspose bug
Merge pull request !840 from jinyaohui/conv2dtranspose
2020-05-06 16:43:28 +08:00
YuJianfeng aa6f808616 Add batch norm bert fission pass 2020-05-06 16:33:46 +08:00
xiefangqi 9a2daae84c del unused change_mode_op 2020-05-06 11:54:05 +08:00
jinyaohui 88e763a98f modify conv2dtranspose 2020-05-06 10:53:36 +08:00
mindspore-ci-bot 108ef72aaf !904 fix avgpool and add dimension check for groupnorm
Merge pull request !904 from JichenZhao/groupn
2020-05-06 10:42:05 +08:00
mindspore-ci-bot cae8a921e3 !929 Cleanup dataset UT: test_batch, save_and_check support
Merge pull request !929 from cathwong/ckw_dataset_ut_cleanup
2020-05-06 04:40:26 +08:00
Cathy Wong 772e6c1461 Cleanup dataset UT: test_batch, save_and_check support 2020-05-05 15:35:09 -04:00
changzherui ffcbcc8dcb syn code 505 2020-05-05 22:44:20 +08:00
changzherui 446828f221 modify momentum test 2020-05-05 21:56:13 +08:00
zhaojichen 039c75af8e fix avgpool and add check 2020-05-04 22:28:50 -04:00
eric 36fffb7706 Added example md5 generation
Comparison example

Added md5 and comparison example for py_transforms

Added md5 check for images
2020-05-04 21:15:33 -04:00
changzherui 99c9b48a4d delete TestHWBatchNormGradSplit 2020-05-04 19:39:17 +08:00
yangyongjie 3f1c6b7b47 solve the problem when dialtion greater than 1 in Conv2dTranspose ops 2020-05-04 11:55:18 +08:00
Junhan Hu 83c68ca2ef Skip pyfunc test case 2020-05-01 15:14:07 -04:00
mindspore-ci-bot 79f087c2af !909 Adding fix for set seed
Merge pull request !909 from EricZ/test_random
2020-05-01 21:13:44 +08:00
mindspore-ci-bot 200b3f0789 !837 add onnx op converter: ReLU6 and DepthwiseConv2dNative
Merge pull request !837 from chenzupeng/master
2020-05-01 09:20:38 +08:00
eric 26cb3e8a5f Added test function to show that seed doesn't work.
Added testcase to show that c image aug don't use seed properly

Added passing test cases

Added working testcases for using seed

Added additional test cases to show seed use

Added test case for seed
2020-04-30 18:57:59 -04:00
changzherui b323199dc1 syn code 430 2020-04-30 17:55:12 +08:00
mindspore-ci-bot a5b530c427 !857 use parameter name as the key of strategy checkpoint
Merge pull request !857 from yao_yf/strategy_ckpt_key_to_use_param_name
2020-04-30 17:12:51 +08:00
mindspore-ci-bot aaf8ade7ab !886 fix issues pack raise error when input list length is 1
Merge pull request !886 from zhaozhenlong/fix-issues-pack-one-input-error
2020-04-30 16:46:00 +08:00
mindspore-ci-bot d84ba5ae8e !866 Enable BatchNorm fusion pass
Merge pull request !866 from YuJianfeng/bn
2020-04-30 16:14:50 +08:00
zhaozhenlong 4694c979a5 delete pack description about num and add raise error
SparseApplyAdagrad example format

PReLU and grad state 1-d not supported

atan2 bprop dx dy revert to original shapes
2020-04-30 16:05:03 +08:00
YuJianfeng 7185961e89 Enable BatchNorm fusion pass 2020-04-30 15:29:23 +08:00
mindspore-ci-bot 7eaed2463f !786 GPU update testcase for amp
Merge pull request !786 from VectorSL/gpu-add-test-amp
2020-04-30 14:56:59 +08:00
mindspore-ci-bot 0611c1a579 !849 [CT][MS] Wrong format of broadcast output, when multi-output
Merge pull request !849 from vlne-v1/I1FQ76-wrong-format-of-boardcast-output-when-multi-output
2020-04-30 14:27:36 +08:00
mindspore-ci-bot 67f3d0eb5d !871 dataset: repair take op problem when there exist muti-thread in next node
Merge pull request !871 from ms_yan/take_operator
2020-04-30 14:08:38 +08:00
chenzupeng a109bc3d96 add onnx op converter: ReLU6, DepthwiseConv2dNative 2020-04-30 12:59:39 +08:00
Wei Luning 157710ca0f bugfix* fix bug in output tuple of tuple.* check kRWWrite input no-variable* input x of ScatterNdUpdate should be a parameter node 2020-04-30 12:00:56 +08:00
mindspore-ci-bot ff1a05d6c8 !882 fix bug of bprop of FloorMod
Merge pull request !882 from zhangbuxue/fix_bprop_for_floor_mod
2020-04-30 11:44:49 +08:00
VectorSL 1d7fe758a0 gpu add test for amp 2020-04-30 11:44:16 +08:00
mindspore-ci-bot db3dd02838 !847 Optimize the collectors in manager which listen to the graphs and nodes changes.
Merge pull request !847 from ZhangQinghua/opt
2020-04-30 11:12:40 +08:00
mindspore-ci-bot 8c035a5171 !756 Gpu support LayerNorm kernel
Merge pull request !756 from chenweifeng/layer_norm
2020-04-30 11:11:06 +08:00
buxue 0c6cf98db0 fix bug of brpop of FloorMod 2020-04-30 11:02:02 +08:00
yao_yf 5a6540450e use param name as the key of strategy checkpoint 2020-04-30 11:01:32 +08:00
ms_yan c56fe3aa2d modify take op with an operator 2020-04-30 10:16:36 +08:00
mindspore-ci-bot 8af10eb51e !875 Reject python OP in operations argument for C++ uniform augmentation OP
Merge pull request !875 from AdelShafiei/ua_py
2020-04-30 06:11:17 +08:00
Adel Shafiei d15bd04bfe added input validation to reject python op in C++ uniform augmentation operations list 2020-04-29 16:48:10 -04:00
mindspore-ci-bot a606c2e4da !872 [Dataset] Add schema support for GeneratorDataset
Merge pull request !872 from JunhanHu/generator_schema
2020-04-30 02:58:29 +08:00
mindspore-ci-bot 2303453753 !869 Random data op
Merge pull request !869 from JesseKLee/random_data_op
2020-04-30 02:56:39 +08:00
Junhan Hu c5a8ffe4f4 Add schema support for GeneratorDataset 2020-04-29 13:50:51 -04:00
Jesse Lee 5236d0c3c0 Replace print with logger.info 2020-04-29 12:44:04 -04:00
mindspore-ci-bot 8d3695f666 !672 Added UT for uniform augmentation C++ OP
Merge pull request !672 from AdelShafiei/ua_ut
2020-04-29 23:56:09 +08:00
mindspore-ci-bot 732c7f8266 !794 fix issues image gradients 4d check
Merge pull request !794 from zhaozhenlong/fix-issues-image-gradients-complement-check
2020-04-29 22:26:53 +08:00
Jesse Lee 270bf831a9 Random Data Op 2020-04-29 10:26:00 -04:00
mindspore-ci-bot 98939d839c !856 Fix skip op bug
Merge pull request !856 from jiangzhiwen/dataset/skip_thread
2020-04-29 21:47:50 +08:00
zhaozhenlong 66e7a36846 ImageGradients check 4d
fix DiagPart constant folding issue

fix argmin output type check

fix atan2 doc error

fix remove FusedBatchNorm and its grad
2020-04-29 21:47:33 +08:00
mindspore-ci-bot 70f8b66d9f !844 validate the accuracy for resnet cifar
Merge pull request !844 from chujinjin/add_accuracy_for_resnet_cifar
2020-04-29 20:27:58 +08:00
jiangzhiwen 34bfa2f7c9 fix skip 2020-04-29 20:12:37 +08:00
mindspore-ci-bot 8ab5e0118f !829 Add parser of case which parameter in tuple in run_op function
Merge pull request !829 from ghzl/parser-parameter-in-tuple-in-run_op
2020-04-29 19:47:46 +08:00
guohongzilong b96df362f8 add parser of case which parameter in tuple in run_op function 2020-04-29 17:55:12 +08:00
mindspore-ci-bot 883fde0494 !839 add parameter verification for RMSprop
Merge pull request !839 from wangnan39/add_parameter_verification_for_rmsprop
2020-04-29 17:20:21 +08:00
mindspore-ci-bot 728345fdd0 !841 fix bugs of Acosh bprop and Elu bprop
Merge pull request !841 from zhangbuxue/adapt_ExtractImagePatches_and_fix_EluGrad
2020-04-29 17:17:30 +08:00
mindspore-ci-bot f31c659944 !823 Add BatchNormGrad split pass
Merge pull request !823 from huanghui/BatchNormGrad-split-pass
2020-04-29 17:15:50 +08:00
chujinjin d5adfa5210 add accuracy for resnet cifar 2020-04-29 17:08:45 +08:00
buxue 064d370a61 fix bug of Acosh bprop and Elu bprop 2020-04-29 16:50:08 +08:00
mindspore-ci-bot 33e427e1c5 !721 Tensor assign by ellipsis
Merge pull request !721 from candanzg/tensor_assgin_ellipsis
2020-04-29 16:31:05 +08:00
wangnan39@huawei.com 7f602016f4 add parameter verification for rmsprop, and modify default value in annotation 2020-04-29 16:12:58 +08:00
Zhang Qinghua a22a4a57c2 Modify UT case after adjust the collectors of manager. 2020-04-29 15:36:21 +08:00
huanghui 0de0aee54e Add BatchNormGrad split pass 2020-04-29 15:28:23 +08:00
mindspore-ci-bot 6241814320 !749 fix np.histogram sometimes calc very large bucket number
Merge pull request !749 from wenkai/wkmaster
2020-04-29 11:36:11 +08:00
mindspore-ci-bot e64f806a94 !730 Add base aggregator of gnn and its ut
Merge pull request !730 from yuanhan/master
2020-04-29 11:31:11 +08:00
candanzg e886a3182c tensor assign with ellpsis
Signed-off-by: candanzg <zhangshucheng@huawei.com>
2020-04-29 11:05:44 +08:00
hanyuanai 64f824e4fc Add gnn aggregator and its ut 2020-04-29 02:06:32 +00:00
mindspore-ci-bot 3dd369cefa !816 faster combine_like step
Merge pull request !816 from flywind/combine_opt
2020-04-29 09:13:51 +08:00
Adel Shafiei 3322e65da9 added ut for uniform augment C++ op 2020-04-28 21:07:29 -04:00
mindspore-ci-bot decc8404a9 !795 [pylint] clean pylint warning
Merge pull request !795 from jinyaohui/clean_pylint_0428
2020-04-29 08:40:41 +08:00
Jesse Lee 332398d20a Check return code from WaitPost::Register 2020-04-28 15:19:03 -04:00
mindspore-ci-bot 516e16ded0 !792 [Model][bert] Modify ST test script of bert model.
Merge pull request !792 from wsc/lossscale_script
2020-04-28 21:51:56 +08:00
zhaozhenlong 243cd33203 adapt SparseApplyAdagradD adding output accum 2020-04-28 21:48:04 +08:00
kpy 65cd41844d change manager logic to faster combine_like step 2020-04-28 20:54:01 +08:00
wsc d428fc1166 Modify the ST test script and example script of bert model 2020-04-28 20:51:25 +08:00
mindspore-ci-bot e655e0e04c !799 fix tensor dirty flag setting
Merge pull request !799 from dinghao/dirty_flag
2020-04-28 20:30:07 +08:00
mindspore-ci-bot 9ffb3993e8 !732 dock AcoshGrad for GE and AvgPool AvgPoolGrad for VM
Merge pull request !732 from zhangbuxue/dock_AcoshGrad_AvgPool_AvgPoolGrad_for_vm
2020-04-28 20:22:04 +08:00
mindspore-ci-bot 21d936e656 !728 auto parallel strategy checkpoint full
Merge pull request !728 from yao_yf/strategy_checkpoint_extend
2020-04-28 19:51:15 +08:00
mindspore-ci-bot 4fff5f442c !791 onnx adapter for MaxPoolWithArgmax
Merge pull request !791 from 梅晓蔚/master
2020-04-28 19:24:13 +08:00
buxue 0f89cc1da4 dock AcoshGrad for GE and AvgPool AvgPoolGrad for Vm 2020-04-28 18:52:23 +08:00
dinghao f77de54aa4 fix tensor dirty 2020-04-28 18:22:37 +08:00
meixiaowei cd899fba0a ONNX adapter for the MaxPoolWithArgmax 2020-04-28 16:43:15 +08:00
yao_yf 6cde5f6d91 auto parallel strategy checkpoint 2020-04-28 15:48:41 +08:00
jinyaohui 73642ef3d3 clean pylint 2020-04-28 15:35:12 +08:00
mindspore-ci-bot 9399dffe0e !751 Remove enable hccl
Merge pull request !751 from zjun/remove_enable_hccl
2020-04-28 14:23:40 +08:00
mindspore-ci-bot 5b3327d103 !746 reducescatter backforward operator
Merge pull request !746 from lirongzhen1/bp_reducescatter
2020-04-28 14:11:53 +08:00
mindspore-ci-bot c1813671db !694 Refactor vm module for multigraph sink.
Merge pull request !694 from rick_sanchez/master
2020-04-28 10:42:26 +08:00
mindspore-ci-bot 8bf35b2b0c !700 validate bprop rules
Merge pull request !700 from penn/validate_bprop_rules
2020-04-28 10:40:41 +08:00
zjun c538b83712 remove enbale hccl 2020-04-28 10:37:08 +08:00
lirongzhen1 0b4648881b add reducescatter bprop 2020-04-28 09:58:34 +08:00
rick_sanchez 6ae8345cad refactor vm module for multigraph sink 2020-04-28 09:53:43 +08:00
jonyguo 819b102ef8 add performance test for mindrecord 2020-04-28 09:10:22 +08:00
mindspore-ci-bot b37db1edf5 !603 [MD] update pk sampler in minddataset
Merge pull request !603 from liyong126/update_pk_sampler
2020-04-27 23:17:38 +08:00
mindspore-ci-bot 1df8ea2915 !747 change cpu kernel dir
Merge pull request !747 from kisnwang/change-cpu-kernel-dir
2020-04-27 22:18:45 +08:00
mindspore-ci-bot f82e63fecc !671 Added testcase for sync_wait
Merge pull request !671 from EricZ/master
2020-04-27 22:14:10 +08:00
mindspore-ci-bot 0e3054d527 !466 Deepcopy problem when pyfunc cannot be pickled
Merge pull request !466 from h.farahat/deepcopy
2020-04-27 22:07:55 +08:00
liyong bfba630aa2 update pK_sampler 2020-04-27 21:40:49 +08:00
mindspore-ci-bot c47ef8ee4e !711 Address first epoch always shuffle with same seed init of random sampler
Merge pull request !711 from ZiruiWu/mindspore_master_only
2020-04-27 21:39:12 +08:00
mindspore-ci-bot afbd24cb78 !718 Fix dtype judge sentence in infer_dtype function of hcom operations
Merge pull request !718 from zhouyuanshen/master
2020-04-27 21:23:25 +08:00
mindspore-ci-bot 68bdcb4e62 !663 fix tensor equal bug
Merge pull request !663 from flywind/fix_bug
2020-04-27 21:23:20 +08:00
kswang e6f36e050f change cpu kernel dir 2020-04-27 21:14:03 +08:00
wilfChen 53b4529558 Gpu support LayerNorm kernel 2020-04-27 20:06:47 +08:00