Commit Graph

266 Commits

Author SHA1 Message Date
mindspore-ci-bot 86911b7cdc !287 [MS][Docs]Fix "ValueError: The `outputs` is not tuple. ", when use model.eval.
Merge pull request !287 from vlne-v1/I1EFUD-the-output-is-not-tuple
2020-04-14 18:05:37 +08:00
YuJianfeng e5c67b9088 Add cnode to equal map when opt matching 2020-04-14 17:29:47 +08:00
Wei Luning e1c8f248e0 Fix the output is not tuple, when eval 2020-04-14 16:14:41 +08:00
mindspore-ci-bot 9bda080bb5 !260 refactor padding strategy
Merge pull request !260 from lianliguang/refactor-padding-strategy
2020-04-14 15:44:46 +08:00
mindspore-ci-bot 1ab430072e !232 [Auto parallel] Model the memory_cost in cost model
Merge pull request !232 from Xiaoda/model-memory-cost-in-auto-parallel
2020-04-14 15:29:04 +08:00
mindspore-ci-bot 94589ce611 !226 expend conv stride and dilation to 2d
Merge pull request !226 from wangnan39/expend_conv_stride_to_2d
2020-04-14 14:58:22 +08:00
mindspore-ci-bot 0ca4ceb73f !281 bug fix in gpu aware quantizaiton ops
Merge pull request !281 from SanjayChan/origin/quant_liantiao
2020-04-14 14:27:55 +08:00
chenzomi 652ab6c386 add test case for aware quantizaiton 2020-04-14 14:00:35 +08:00
wangnan39@huawei.com 2604acedcb extend conv stride and dilation to 2d 2020-04-14 13:16:27 +08:00
lianliguang 5d225f934f change the padding strategy & refactor insert transdata 2020-04-14 12:57:40 +08:00
Xiaoda Zhang 0ac50a19f5 Model the memory cost in auto-parallel. It is calculated by the output of operators, plus the parameters. Additionally, modify the graph-operations in auto_parallel to include memory_cost. 2020-04-14 11:39:31 +08:00
mindspore-ci-bot f1fa2a9941 !273 [MD] update subset random sampler in minddataset
Merge pull request !273 from liyong126/mindrecord_subset_sampler_python
2020-04-14 11:18:36 +08:00
mindspore-ci-bot 7ffb8bb19f !250 Add nn.pad to support three modes
Merge pull request !250 from casgj/gaojing_new4
2020-04-14 10:56:05 +08:00
mindspore-ci-bot 60958d6b25 !239 Add dynamic learning rate decay and review optimizer code
Merge pull request !239 from fanglei/master
2020-04-14 09:24:25 +08:00
gaojing 2db3e64ff2 add operation 2020-04-13 10:38:03 -04:00
mindspore-ci-bot 298a32f1e2 !132 Add confusion_mul_grad_fusion pass
Merge pull request !132 from huanghui/master
2020-04-13 21:49:06 +08:00
root 7d700295f8 add dynamic lr and enhance optim 2020-04-13 13:48:01 +00:00
liyong 0ce83e39e1 fix TestShardSampleWrongNumber
adjust internal api
2020-04-13 21:31:45 +08:00
mindspore-ci-bot 57f953ca38 !216 Implement addn fusion pass
Merge pull request !216 from YuJianfeng/master
2020-04-13 20:49:32 +08:00
mindspore-ci-bot 39a46b9342 !245 Add bool type check in communication operator
Merge pull request !245 from chentingting/add_bool_type_check_in_comm_op
2020-04-13 20:19:47 +08:00
mindspore-ci-bot 77725e81a4 !258 add_minimum_distributed_op
Merge pull request !258 from lichen/add_minimum_distributed_op
2020-04-13 20:16:08 +08:00
mindspore-ci-bot 5bb4e8120d !208 [mixprecision]fix eval support bug and error cast on ApplyMomentum
Merge pull request !208 from vlne-v1/I1D33P-auto-mix-precision-eval-support
2020-04-13 20:02:25 +08:00
Wei Luning 2fecdede6b support amp when model eval, fix example of UnsortSegmentsSum 2020-04-13 19:17:47 +08:00
huanghui 19ee376cd3 add confusion_mul_grad fusion pass 2020-04-13 19:08:15 +08:00
Wei Luning 37c94a5f76 add pass replace_old_param_ 2020-04-13 17:52:55 +08:00
c00425699 d62f560b50 add_bool_type_check_in_comm_op 2020-04-13 17:34:29 +08:00
lichenever b81cc6ea4f add minimum distributed op 2020-04-13 17:26:31 +08:00
YuJianfeng 7307c81f31 implement AddN fission pass 2020-04-13 16:05:45 +08:00
chenzomi d64f662c76 quantization aware training frontend operators define. 2020-04-13 12:02:49 +08:00
panfengfeng 6a79fc1735 skip mindrecord ut test case 2020-04-13 10:38:54 +08:00
mindspore-ci-bot 98e69fc639 !215 fix bprop cache caused error with variable params
Merge pull request !215 from penn/fix_print_bprop_error
2020-04-13 10:10:49 +08:00
mindspore-ci-bot 7bc2cee318 !167 add_squeeze_distributed_op
Merge pull request !167 from lichen/add_squeeze_distributed_op
2020-04-13 10:03:25 +08:00
c00425699 c8cdb6b331 support distributed GatherV2 operator 2020-04-12 16:00:47 +08:00
liyong 11403492ae add mindrecord subset random sampler 2020-04-11 18:48:23 +08:00
buxue 5841fe010e Support pow's second input could be tensor and fix bug in bprop of pow 2020-04-11 16:16:58 +08:00
lichenever 32cd280c1a add squeeze distributed op 2020-04-11 16:03:08 +08:00
mindspore-ci-bot 5141054ecd !220 Add parallel operator for DropoutDoMask
Merge pull request !220 from yangzhenzhang/dropoutdomask
2020-04-11 15:01:43 +08:00
mindspore-ci-bot 066f20e791 !169 fix the method to calculate the children graph
Merge pull request !169 from xychow/fix-manager-children-issue
2020-04-11 14:07:45 +08:00
yangzhenzhang b34c0e7a17 add parallel op for dropoutdomask 2020-04-11 12:11:22 +08:00
jonyguo a9443635b7 fix: mindpage enhance parameter check and search by filename failed 2020-04-11 10:19:14 +08:00
panfengfeng 53a98210af skip ut test cases temporarily 2020-04-11 09:28:09 +08:00
zjun f5ee197b6c Modify custom op register 2020-04-10 16:52:31 +08:00
义峰潘 2bef22d8a3 fix bprop cache caused error with variable params 2020-04-10 12:21:40 +08:00
mindspore-ci-bot 268d358a1d !187 refactor OperatorCostPtr in OperatorInfo
Merge pull request !187 from chentingting/refactor_OperatorCostPtr_in_OperatorInfo
2020-04-10 09:21:25 +08:00
mindspore-ci-bot 1b3b3b1a1c !198 [opt] momentum duplicate mul constant
Merge pull request !198 from biffex/momentum-duplicate-mul-constant
2020-04-10 08:37:41 +08:00
Cathy Wong 59a714c654 Correct shuffle UT buffer_size > #dataset-row as valid 2020-04-09 15:22:33 -04:00
biffex 62bbf560c6 constant duplicate mul for momentum 2020-04-09 22:28:00 +08:00
c00425699 b413638f23 refactor OperatorCostPtr in OperatorInfo 2020-04-09 20:37:52 +08:00
liuxiao 0f0f83e292 modified api name Stack -> Pack, Unstack -> Unpack 2020-04-09 19:02:59 +08:00
kswang bef62db128 add ascend mem pool 2020-04-09 16:04:59 +08:00
mindspore-ci-bot 0565e4641e !185 modify comment about normal mode
Merge pull request !185 from jinyaohui/master
2020-04-09 14:24:28 +08:00
mindspore-ci-bot 2e6e94b2b6 !177 prelu operator support parallel on the channel
Merge pull request !177 from yao_yf/fix_auto_parallel_prelu
2020-04-09 14:08:41 +08:00
mindspore-ci-bot 31efc8b088 !172 add mem manager
Merge pull request !172 from kisnwang/add-resource-manager
2020-04-09 11:36:33 +08:00
zhousiyi 99f22c5b85 fix children issue: missing users of the children's direct users. 2020-04-09 02:18:55 +00:00
kswang fb343bd607 add mem manager 2020-04-09 10:05:45 +08:00
jinyaohui 0790ef8a85 modify comment 2020-04-09 09:23:39 +08:00
mindspore-ci-bot cc75cb357c !168 remove mindspore::make_unique and make_unique.h
Merge pull request !168 from Alexey_Shevlyakov/remove_mindspore_make_unique
2020-04-09 05:32:52 +08:00
mindspore-ci-bot 3e36982314 !99 Develop op MaxPoolWithArgMax
Merge pull request !99 from zhangbuxue/Dock_MaxPoolWithArgMax
2020-04-08 22:40:00 +08:00
mindspore-ci-bot 68f804255f !174 enhance: the error info is not detail when the column list is invalid by MindDataset
Merge pull request !174 from guozhijian/fix_false_error_info
2020-04-08 21:52:00 +08:00
mindspore-ci-bot 40d4a4baa3 !20 modify _set_dataset_mode_config api param
Merge pull request !20 from jinyaohui/master
2020-04-08 20:58:26 +08:00
mindspore-ci-bot fd7d75aea3 !143 Adapting ops Stack and Unsatck in ME
Merge pull request !143 from liuxiao/temp
2020-04-08 20:56:33 +08:00
buxue 7541d3b067 Develop op MaxPoolWithArgMax 2020-04-08 20:47:49 +08:00
yao_yf b5e3fa9593 fix auto parallel prelu 2020-04-08 20:45:08 +08:00
mindspore-ci-bot 3f5136302a !149 Use TFRecordDataset instead of StorageDataset in Bert model integration test and add absolute position embedding code in bert model
Merge pull request !149 from yoonlee666/master
2020-04-08 20:28:06 +08:00
jinyaohui ac62faa388 modify set_dataset_mode_config api param 2020-04-08 18:30:36 +08:00
liuxiao 47d903ff57 Add pack and unpack 2020-04-08 16:58:53 +08:00
mindspore-ci-bot 2eb71103f9 !82 profiling feature enhancement
Merge pull request !82 from caifubi/dev-profiling
2020-04-08 16:22:35 +08:00
mindspore-ci-bot 22516d3e08 !156 [Auto parallel] Separate memory_cost and computation_cost in cost model
Merge pull request !156 from Xiaoda/implementing-memory-calculation-in-auto-parallel
2020-04-08 16:11:49 +08:00
jonyguo 20d1b64443 fix: error info is not exactly when column list invalid 2020-04-08 16:11:13 +08:00
jojobugfree effdb483d6 profiling feature enhancement 2020-04-08 15:12:06 +08:00
mindspore-ci-bot e6ea09082c !153 add api image_gradients
Merge pull request !153 from zhaozhenlong/cell/image_gradients
2020-04-08 14:55:48 +08:00
yoonlee666 c5bfbc3556 use TFRecordDataset in bert ci script and add absolute position embedding code in bert model 2020-04-08 14:31:18 +08:00
Xiaoda Zhang a153fad874 This commit is to separate the computation cost and memory cost in auto_parallel. Some related memory correction is removed. 2020-04-08 11:52:19 +08:00
zhaozhenlong f9d180d413 add api image gradients 2020-04-08 11:50:22 +08:00
mindspore-ci-bot a24297f547 !122 Support to config whether to save integeated checkpoint, in auto model parallel scene
Merge pull request !122 from WeibiaoYu/master
2020-04-08 09:42:59 +08:00
Jonathan Yan 9d0fde29f4 remove ENABLE_MINDRECORD flag 2020-04-07 14:55:45 -04:00
Alexey Shevlyakov 84d780c1a4 remove make_unique.h 2020-04-07 14:00:09 -04:00
mindspore-ci-bot 475e858474 !158 fix: resolve MindDataset hung when field not in index when using block_reader
Merge pull request !158 from guozhijian/fix_block_reader_hung
2020-04-07 21:49:33 +08:00
mindspore-ci-bot a4b9f8a728 !120 Fix test for RandomCropDecodeResizeOp.
Merge pull request !120 from Alexey_Shevlyakov/master
2020-04-07 20:52:45 +08:00
WeibiaoYu 22c6baeea2 Support to config whether to save integeated checkpoint, in auto model parallel scene 2020-04-07 08:25:27 -04:00
jonyguo c688265671 fix: when use MindDataset block_reade=True hung 2020-04-07 17:53:23 +08:00
mindspore-ci-bot 06e6c6b880 !128 refactor callback for ge backend
Merge pull request !128 from wangqiuliang/refactor-call-back-for-ge
2020-04-07 17:16:02 +08:00
chang zherui 7696c21e65 fix runtest.sh for python ut 2020-04-07 13:10:33 +08:00
mindspore-ci-bot 5add5979e8 !92 add prim name to param check error message for math_ops.py
Merge pull request !92 from fary86/add-prim-name-for-param-validator
2020-04-07 10:48:10 +08:00
Wei Luning 113c0d8cd2 fix InsertGradientOf with class method 2020-04-07 02:11:35 +00:00
fary86 69ed72f10d Add primitive name to param error message for math_ops.py 2020-04-07 10:08:04 +08:00
kingfo 3202fc0df9 refactor callback for ge backend 2020-04-07 09:32:54 +08:00
mindspore-ci-bot 7a367af9c6 !135 fix grad missing due to indirect dependent free morphism
Merge pull request !135 from penn/fix_free_morphism_error
2020-04-06 10:17:13 +08:00
Alexey Shevlyakov d37b8c4f2d fix RandomCropDecodeResize test 2020-04-03 11:13:57 -04:00
mindspore-ci-bot fe49b39c9a !136 modify bert test file
Merge pull request !136 from wanghua/master
2020-04-03 21:13:22 +08:00
panyifeng 1fb776fe09 fix grad missing due to indirect dependent free morphism 2020-04-03 18:22:53 +08:00
wanghua 5b176f258b modify bert test file 2020-04-03 18:20:50 +08:00
mindspore-ci-bot 9e529f9dd0 !54 Interface change :`_Constant` to `Constant`
Merge pull request !54 from ghzl/initializer-change-_Constant-to-Constant
2020-04-03 17:53:51 +08:00
mindspore-ci-bot 9f982b513d !129 fix bert precision bug
Merge pull request !129 from wanghua/master
2020-04-03 17:35:44 +08:00
guohongzilong bb5320be13 iterfaces change: _Constant to Constant 2020-04-03 16:19:29 +08:00
mindspore-ci-bot 2c3c1577b1 !115 Add parallel operator for ExpandDims
Merge pull request !115 from yangzhenzhang/expand-dim
2020-04-03 15:54:33 +08:00
mindspore-ci-bot a5d95e472e !106 support comparison ops for python
Merge pull request !106 from amongo/SupportPythonOperators
2020-04-03 15:52:08 +08:00
mindspore-ci-bot acb99f6e8c !123 modify runtest.sh for python ut exec form
Merge pull request !123 from changzherui/modify_runtest_python_ut
2020-04-03 15:35:43 +08:00
yangzhenzhang dd0d4e6b84 add parallel ops for expand dims 2020-04-03 15:17:07 +08:00
wanghua da123c5b3e fix bert precison bug 2020-04-03 14:55:25 +08:00
huangdongrun 461d8e3a08 add comparison ops
fix pylint

use scalar_lt primitive directly

fix review
2020-04-03 09:58:41 +08:00
chang zherui 86a3398547 modify runtest py ut for parallel exec 2020-04-03 09:38:04 +08:00
xiefangqi bc4602b58e fix and remove useless import of example, st, ut 2020-04-02 22:13:36 +08:00
mindspore-ci-bot 9be1a01db6 !85 Optimize depend edge with make tuple input
Merge pull request !85 from YuJianfeng/master
2020-04-02 22:00:18 +08:00
mindspore-ci-bot d245792842 !94 enhance: reduce execution time for mindrecord test case
Merge pull request !94 from yanzhenxiang2020/fix_mindrecord_ut_long_time
2020-04-02 21:50:43 +08:00
mindspore-ci-bot a5a904fbdf !91 fix bug for allreduce fusion and add resnet unit test
Merge pull request !91 from chentingting/allreduce_fusion_resnet
2020-04-02 21:35:35 +08:00
mindspore-ci-bot cb323eccf0 !71 Add operator adapting in ME for FloorMod, Acosh and SparseApplyFtrlD 【CR】,并主动Acosh and FloorMod operator adapting
Merge pull request !71 from zhangzheng/sparse_acosh_floormod
2020-04-02 21:33:33 +08:00
mindspore-ci-bot 55916351ee !52 remove ge depend
Merge pull request !52 from flywind/remove-ge-depend
2020-04-02 20:59:06 +08:00
zhangz0911gm 6f1747045c Add FloorMod, Acosh in ME 2020-04-02 08:50:39 -04:00
Wei Luning 73ba399364 remove ge depend in cpu 2020-04-02 19:38:42 +08:00
yanzhenxiang2020 5a4f17bfb6 fix mindrecord ut long time 2020-04-02 19:18:49 +08:00
c00425699 ab917a734d fix bug for allreduce fusion and add resnet unit test 2020-04-02 18:55:04 +08:00
mindspore-ci-bot d8b460c780 !96 fix refkey bug for auto parallel
Merge pull request !96 from lichen/fix_ref_key_bug_for_auto_parallel
2020-04-02 17:26:58 +08:00
lichenever 5240b1f603 fix refkey bug for auto parallel 2020-04-02 16:14:29 +08:00
mindspore-ci-bot 9cb219c683 !78 Add ascend st lenet script for pynative mode
Merge pull request !78 from JoyLvliang/pynative-add-lenet
2020-04-02 14:22:39 +08:00
YuJianfeng 7f53bb062d Optimize depend edge with make tuple input 2020-04-02 11:33:34 +08:00
mindspore-ci-bot cf54ecfe6e !62 support grad on python function with variable arguments
Merge pull request !62 from amongo/SupportGradOnVarArgs
2020-04-02 11:21:06 +08:00
lvliang ff4f935e40 pynative-add-lenet 2020-04-02 09:25:25 +08:00
zhaoting ed3c2d7229 add RMSProp optimizer 2020-04-02 09:10:58 +08:00
mindspore-ci-bot 5c22c088bb !69 Enable skipped dataset zip operator python unit tests
Merge pull request !69 from cathwong/ckw_dataset_py_ut1
2020-04-01 22:20:37 +08:00
huangdongrun d3f733fa25 support grad on graph with variable arguments
use unpack graph primitive instead

add testcases for all grad interface

remove debug log

format code

remove dumpfuncgraph

resolve clang-format

resolve reviews

resolve cpplint

fix review
2020-04-01 20:24:04 +08:00
mindspore-ci-bot 37dba2ddcf !74 delete longtime python ut
Merge pull request !74 from changzherui/master
2020-04-01 18:29:58 +08:00
mindspore-ci-bot 69d5403319 !14 add adapter for ge atan2
Merge pull request !14 from zhaozhenlong/op/atan2
2020-04-01 18:24:55 +08:00
mindspore-ci-bot a47046652a !76 [Auto parallel] Refining the strategy_checking for resnset50
Merge pull request !76 from Xiaoda/modify-resnet50-strategy-checking
2020-04-01 16:36:13 +08:00
zhaozhenlong bed5997a14 add atan2 operator 2020-04-01 16:27:35 +08:00
mindspore-ci-bot f0bcf90b5b !64 fix error while num_samples equal 0
Merge pull request !64 from anzhengqi/fix-check-num-samples
2020-04-01 15:48:38 +08:00
mindspore-ci-bot 22a9c00bcd !57 Add parallel operators for Neg and BatchMatMul
Merge pull request !57 from yangzhenzhang/master
2020-04-01 15:23:46 +08:00
mindspore-ci-bot a42eee52ba !67 add cpu st lenet
Merge pull request !67 from kisnwang/add-cpu-st
2020-04-01 15:15:13 +08:00
Xiaoda Zhang fb6eed23ae refining strategy-checking for resnet50 2020-04-01 14:58:58 +08:00
anzhengqi 6a1b865c91 check num_samples 2020-04-01 14:39:23 +08:00
chang zherui 1de7011bc8 delete longtime python ut 2020-04-01 11:53:35 +08:00
VectorSL aea6b0c974 update tests/st/ops/gpu/test_tensoradd.py.
fix pytest.mark for testcase
2020-04-01 11:49:37 +08:00
mindspore-ci-bot 87040483ee !58 fix two cast bug in auto parallel
Merge pull request !58 from lichen/fix_two_cast_bug_in_auto_parallel
2020-04-01 09:54:10 +08:00
yangzhenzhang 110640e2ad add parallel ops for neg and batchmatmul 2020-04-01 09:36:38 +08:00
Cathy Wong 2e881276ab Enable skipped dataset zip python unit tests
Signed-off-by: Cathy Wong <cathy.wong@huawei.com>
2020-03-31 16:47:13 -04:00
mindspore-ci-bot 52166a85cf !43 dump graph with type info when analysis failed
Merge pull request !43 from fary86/dump-typed-graph-when-analyze-fail
2020-03-31 22:23:02 +08:00
mindspore-ci-bot 045a1c356c !51 add op SpaceToBatch and BatchToSpace for ge
Merge pull request !51 from zhaozhenlong/op/space-to-batch
2020-03-31 21:59:03 +08:00
kswang 2dc9f632c1 add cpu st lenet 2020-03-31 21:25:48 +08:00
fary86 816b60491d Dump graph with type info when static analysis failed 2020-03-31 21:08:48 +08:00
mindspore-ci-bot e2df848597 !55 modify long time python ut
Merge pull request !55 from changzherui/master
2020-03-31 21:01:40 +08:00
zhaozhenlong cf40305bf0 add operator SpaceToBatch and BatchToSpace for ge 2020-03-31 20:21:47 +08:00
mindspore-ci-bot 352c6faf85 !18 enable use float type learning rate in lars optimizer
Merge pull request !18 from gziyan/master
2020-03-31 18:54:55 +08:00
lichenever 2da38ad401 fix two cast bug in auto parallel 2020-03-31 18:54:21 +08:00
mindspore-ci-bot da447b8d4d !45 use std::vector instead of std::list to promote performance for parallel module
Merge pull request !45 from chentingting/permote_auto_prallel_performance
2020-03-31 18:25:59 +08:00
chang zherui eaf7146d46 modify longtime python ut 2020-03-31 16:18:04 +08:00
lichenever f946aea10d fix grpah mode loop sink bug in auto parallel 2020-03-31 16:16:53 +08:00
c00425699 3bb48ffee1 use std::vector instead of std::list to promote performance for parallel module 2020-03-31 15:16:00 +08:00
mindspore-ci-bot 976226f9ac !10 Add matmul biasadd fusion pass
Merge pull request !10 from YuJianfeng/master
2020-03-31 14:52:47 +08:00
mindspore-ci-bot 6f03881b04 !39 add op Diag and DiagPart
Merge pull request !39 from zhaozhenlong/op/diag
2020-03-31 14:45:44 +08:00
mindspore-ci-bot 7242c0fad5 !41 Revert 'Pull Request !17 : [AutoParallel]Fix bug in the case of two cast'
Merge pull request !41 from leonwanghui/revert-merge-17-master
2020-03-31 14:18:17 +08:00