Commit Graph

13767 Commits

Author SHA1 Message Date
c00425699 b413638f23 refactor OperatorCostPtr in OperatorInfo 2020-04-09 20:37:52 +08:00
liuxiao 0f0f83e292 modified api name Stack -> Pack, Unstack -> Unpack 2020-04-09 19:02:59 +08:00
kswang bef62db128 add ascend mem pool 2020-04-09 16:04:59 +08:00
mindspore-ci-bot 0565e4641e !185 modify comment about normal mode
Merge pull request !185 from jinyaohui/master
2020-04-09 14:24:28 +08:00
mindspore-ci-bot 2e6e94b2b6 !177 prelu operator support parallel on the channel
Merge pull request !177 from yao_yf/fix_auto_parallel_prelu
2020-04-09 14:08:41 +08:00
mindspore-ci-bot 31efc8b088 !172 add mem manager
Merge pull request !172 from kisnwang/add-resource-manager
2020-04-09 11:36:33 +08:00
zhousiyi 99f22c5b85 fix children issue: missing users of the children's direct users. 2020-04-09 02:18:55 +00:00
kswang fb343bd607 add mem manager 2020-04-09 10:05:45 +08:00
buxue 1d3bb0b731 Develop op MaxPoolWithArgMax 2020-04-09 09:26:56 +08:00
jinyaohui 0790ef8a85 modify comment 2020-04-09 09:23:39 +08:00
mindspore-ci-bot cc75cb357c !168 remove mindspore::make_unique and make_unique.h
Merge pull request !168 from Alexey_Shevlyakov/remove_mindspore_make_unique
2020-04-09 05:32:52 +08:00
mindspore-ci-bot 3e36982314 !99 Develop op MaxPoolWithArgMax
Merge pull request !99 from zhangbuxue/Dock_MaxPoolWithArgMax
2020-04-08 22:40:00 +08:00
mindspore-ci-bot 68f804255f !174 enhance: the error info is not detail when the column list is invalid by MindDataset
Merge pull request !174 from guozhijian/fix_false_error_info
2020-04-08 21:52:00 +08:00
mindspore-ci-bot 40d4a4baa3 !20 modify _set_dataset_mode_config api param
Merge pull request !20 from jinyaohui/master
2020-04-08 20:58:26 +08:00
mindspore-ci-bot fd7d75aea3 !143 Adapting ops Stack and Unsatck in ME
Merge pull request !143 from liuxiao/temp
2020-04-08 20:56:33 +08:00
buxue 7541d3b067 Develop op MaxPoolWithArgMax 2020-04-08 20:47:49 +08:00
yao_yf b5e3fa9593 fix auto parallel prelu 2020-04-08 20:45:08 +08:00
mindspore-ci-bot 3f5136302a !149 Use TFRecordDataset instead of StorageDataset in Bert model integration test and add absolute position embedding code in bert model
Merge pull request !149 from yoonlee666/master
2020-04-08 20:28:06 +08:00
kingfo cdbef85e5e refactor callback for ge backend 2020-04-08 20:00:06 +08:00
chang zherui 286db9b513 fix runtest.sh for python ut 2020-04-08 20:00:06 +08:00
fary86 b1de026c98 Add primitive name to param error message for math_ops.py 2020-04-08 20:00:06 +08:00
Wei Luning 826a7393db fix InsertGradientOf with class method 2020-04-08 20:00:06 +08:00
panyifeng e8ae576d10 fix grad missing due to indirect dependent free morphism 2020-04-08 20:00:06 +08:00
wanghua d42954652c modify bert test file 2020-04-08 20:00:06 +08:00
guohongzilong 2de97f256f iterfaces change: _Constant to Constant 2020-04-08 20:00:06 +08:00
wanghua 1a82ff0a72 fix bert precison bug 2020-04-08 20:00:06 +08:00
yangzhenzhang 8f74aef65d add parallel ops for expand dims 2020-04-08 20:00:06 +08:00
huangdongrun d12a720fc5 add comparison ops
fix pylint

use scalar_lt primitive directly

fix review
2020-04-08 20:00:06 +08:00
chang zherui 9b9a85ba34 modify runtest py ut for parallel exec 2020-04-08 20:00:06 +08:00
xiefangqi 8d554d4322 fix and remove useless import of example, st, ut 2020-04-08 20:00:06 +08:00
YuJianfeng 024706f951 Optimize depend edge with make tuple input 2020-04-08 20:00:06 +08:00
yanzhenxiang2020 948ff63add fix mindrecord ut long time 2020-04-08 20:00:06 +08:00
c00425699 b3fd38c23a fix bug for allreduce fusion and add resnet unit test 2020-04-08 20:00:06 +08:00
zhangz0911gm 65cd9d48fd Add FloorMod, Acosh in ME 2020-04-08 20:00:06 +08:00
Wei Luning b18f634912 remove ge depend in cpu 2020-04-08 20:00:06 +08:00
lichenever 89945c15f5 fix refkey bug for auto parallel 2020-04-08 20:00:06 +08:00
lvliang 244a82b244 pynative-add-lenet 2020-04-08 20:00:06 +08:00
huangdongrun 84e4942ca9 support grad on graph with variable arguments
use unpack graph primitive instead

add testcases for all grad interface

remove debug log

format code

remove dumpfuncgraph

resolve clang-format

resolve reviews

resolve cpplint

fix review
2020-04-08 19:58:14 +08:00
zhaoting dcd1f0a504 add RMSProp optimizer 2020-04-08 19:58:14 +08:00
Cathy Wong 29ab2c1093 Enable skipped dataset zip python unit tests
Signed-off-by: Cathy Wong <cathy.wong@huawei.com>
2020-04-08 19:58:14 +08:00
chang zherui 04471939f5 delete longtime python ut 2020-04-08 19:58:14 +08:00
zhaozhenlong 2498d2c749 add atan2 operator 2020-04-08 19:58:14 +08:00
Xiaoda Zhang 4520469e16 refining strategy-checking for resnet50 2020-04-08 19:58:13 +08:00
anzhengqi 854308ff75 check num_samples 2020-04-08 19:58:13 +08:00
yangzhenzhang c44e12713b add parallel ops for neg and batchmatmul 2020-04-08 19:58:13 +08:00
kswang fe1b73584d add cpu st lenet 2020-04-08 19:58:13 +08:00
VectorSL 3b4d8fce26 update tests/st/ops/gpu/test_tensoradd.py.
fix pytest.mark for testcase
2020-04-08 19:58:13 +08:00
lichenever 8854a6c9f7 fix two cast bug in auto parallel 2020-04-08 19:58:13 +08:00
fary86 73e0bdcd43 Dump graph with type info when static analysis failed 2020-04-08 19:58:13 +08:00
zhaozhenlong cca1d7764a add operator SpaceToBatch and BatchToSpace for ge 2020-04-08 19:58:13 +08:00
chang zherui bd4a206ae8 modify longtime python ut 2020-04-08 19:58:13 +08:00
Ziyan ada46fc219 enable use float type learning rate in lars optimizer 2020-04-08 19:58:13 +08:00
c00425699 c4b03e854c use std::vector instead of std::list to promote performance for parallel module 2020-04-08 19:58:13 +08:00
lichenever 80b8d05c14 fix grpah mode loop sink bug in auto parallel 2020-04-08 19:58:13 +08:00
GinFung 2fd7f67108 Add matmul biasadd fusion pass 2020-04-08 19:58:13 +08:00
zhaozhenlong a6e626f02e add operator diag and diag_part 2020-04-08 19:58:13 +08:00
leonwanghui d2348c7f87 回退 'Pull Request !17 : [AutoParallel]Fix bug in the case of two cast' 2020-04-08 19:58:13 +08:00
lichenever 26a65bee0c fix auto parallel st 2020-04-08 19:58:13 +08:00
lichenever c119f1c29e fix_cast_bug 2020-04-08 19:58:13 +08:00
qianlong df0668390a Optimize the execution time of test case test_rgb_hsv.py 2020-04-08 19:58:13 +08:00
buxue 24d1991cac Fix bug structure output when there is depend whose first input is constant in outputs 2020-04-08 19:58:13 +08:00
Jonathan Yan 295c00ac39 Replace std::cout with MS_LOG in dataset unit test
Signed-off-by: Jonathan Yan <jonathan.yan1@huawei.com>
2020-04-08 19:58:13 +08:00
jonyguo ef1caad11f 1. add more log info for dataset & mindrecord, 2. add two new testcase for MindDataset 2020-04-08 19:58:13 +08:00
jinyaohui ac62faa388 modify set_dataset_mode_config api param 2020-04-08 18:30:36 +08:00
liuxiao 47d903ff57 Add pack and unpack 2020-04-08 16:58:53 +08:00
mindspore-ci-bot 2eb71103f9 !82 profiling feature enhancement
Merge pull request !82 from caifubi/dev-profiling
2020-04-08 16:22:35 +08:00
mindspore-ci-bot 22516d3e08 !156 [Auto parallel] Separate memory_cost and computation_cost in cost model
Merge pull request !156 from Xiaoda/implementing-memory-calculation-in-auto-parallel
2020-04-08 16:11:49 +08:00
jonyguo 20d1b64443 fix: error info is not exactly when column list invalid 2020-04-08 16:11:13 +08:00
lvliang 2da8570a01 pynative-add-lenet 2020-04-08 15:43:17 +08:00
jojobugfree effdb483d6 profiling feature enhancement 2020-04-08 15:12:06 +08:00
mindspore-ci-bot e6ea09082c !153 add api image_gradients
Merge pull request !153 from zhaozhenlong/cell/image_gradients
2020-04-08 14:55:48 +08:00
yoonlee666 c5bfbc3556 use TFRecordDataset in bert ci script and add absolute position embedding code in bert model 2020-04-08 14:31:18 +08:00
Xiaoda Zhang a153fad874 This commit is to separate the computation cost and memory cost in auto_parallel. Some related memory correction is removed. 2020-04-08 11:52:19 +08:00
zhaozhenlong f9d180d413 add api image gradients 2020-04-08 11:50:22 +08:00
mindspore-ci-bot a24297f547 !122 Support to config whether to save integeated checkpoint, in auto model parallel scene
Merge pull request !122 from WeibiaoYu/master
2020-04-08 09:42:59 +08:00
Jonathan Yan 9d0fde29f4 remove ENABLE_MINDRECORD flag 2020-04-07 14:55:45 -04:00
Alexey Shevlyakov 84d780c1a4 remove make_unique.h 2020-04-07 14:00:09 -04:00
mindspore-ci-bot 475e858474 !158 fix: resolve MindDataset hung when field not in index when using block_reader
Merge pull request !158 from guozhijian/fix_block_reader_hung
2020-04-07 21:49:33 +08:00
mindspore-ci-bot a4b9f8a728 !120 Fix test for RandomCropDecodeResizeOp.
Merge pull request !120 from Alexey_Shevlyakov/master
2020-04-07 20:52:45 +08:00
WeibiaoYu 22c6baeea2 Support to config whether to save integeated checkpoint, in auto model parallel scene 2020-04-07 08:25:27 -04:00
jonyguo c688265671 fix: when use MindDataset block_reade=True hung 2020-04-07 17:53:23 +08:00
mindspore-ci-bot 06e6c6b880 !128 refactor callback for ge backend
Merge pull request !128 from wangqiuliang/refactor-call-back-for-ge
2020-04-07 17:16:02 +08:00
chang zherui 7696c21e65 fix runtest.sh for python ut 2020-04-07 13:10:33 +08:00
mindspore-ci-bot 5add5979e8 !92 add prim name to param check error message for math_ops.py
Merge pull request !92 from fary86/add-prim-name-for-param-validator
2020-04-07 10:48:10 +08:00
Wei Luning 113c0d8cd2 fix InsertGradientOf with class method 2020-04-07 02:11:35 +00:00
fary86 69ed72f10d Add primitive name to param error message for math_ops.py 2020-04-07 10:08:04 +08:00
kingfo 3202fc0df9 refactor callback for ge backend 2020-04-07 09:32:54 +08:00
mindspore-ci-bot 7a367af9c6 !135 fix grad missing due to indirect dependent free morphism
Merge pull request !135 from penn/fix_free_morphism_error
2020-04-06 10:17:13 +08:00
Alexey Shevlyakov d37b8c4f2d fix RandomCropDecodeResize test 2020-04-03 11:13:57 -04:00
mindspore-ci-bot fe49b39c9a !136 modify bert test file
Merge pull request !136 from wanghua/master
2020-04-03 21:13:22 +08:00
panyifeng 1fb776fe09 fix grad missing due to indirect dependent free morphism 2020-04-03 18:22:53 +08:00
wanghua 5b176f258b modify bert test file 2020-04-03 18:20:50 +08:00
mindspore-ci-bot 9e529f9dd0 !54 Interface change :`_Constant` to `Constant`
Merge pull request !54 from ghzl/initializer-change-_Constant-to-Constant
2020-04-03 17:53:51 +08:00
mindspore-ci-bot 9f982b513d !129 fix bert precision bug
Merge pull request !129 from wanghua/master
2020-04-03 17:35:44 +08:00
guohongzilong bb5320be13 iterfaces change: _Constant to Constant 2020-04-03 16:19:29 +08:00
mindspore-ci-bot 2c3c1577b1 !115 Add parallel operator for ExpandDims
Merge pull request !115 from yangzhenzhang/expand-dim
2020-04-03 15:54:33 +08:00
mindspore-ci-bot a5d95e472e !106 support comparison ops for python
Merge pull request !106 from amongo/SupportPythonOperators
2020-04-03 15:52:08 +08:00
mindspore-ci-bot acb99f6e8c !123 modify runtest.sh for python ut exec form
Merge pull request !123 from changzherui/modify_runtest_python_ut
2020-04-03 15:35:43 +08:00
yangzhenzhang dd0d4e6b84 add parallel ops for expand dims 2020-04-03 15:17:07 +08:00
wanghua da123c5b3e fix bert precison bug 2020-04-03 14:55:25 +08:00
zhangz0911gm 96e1127edb Adding new operator SparseApplyFtrlD in ME 2020-04-02 22:28:21 -04:00
huangdongrun 461d8e3a08 add comparison ops
fix pylint

use scalar_lt primitive directly

fix review
2020-04-03 09:58:41 +08:00
chang zherui 86a3398547 modify runtest py ut for parallel exec 2020-04-03 09:38:04 +08:00
xiefangqi bc4602b58e fix and remove useless import of example, st, ut 2020-04-02 22:13:36 +08:00
mindspore-ci-bot 9be1a01db6 !85 Optimize depend edge with make tuple input
Merge pull request !85 from YuJianfeng/master
2020-04-02 22:00:18 +08:00
mindspore-ci-bot d245792842 !94 enhance: reduce execution time for mindrecord test case
Merge pull request !94 from yanzhenxiang2020/fix_mindrecord_ut_long_time
2020-04-02 21:50:43 +08:00
mindspore-ci-bot a5a904fbdf !91 fix bug for allreduce fusion and add resnet unit test
Merge pull request !91 from chentingting/allreduce_fusion_resnet
2020-04-02 21:35:35 +08:00
mindspore-ci-bot cb323eccf0 !71 Add operator adapting in ME for FloorMod, Acosh and SparseApplyFtrlD 【CR】,并主动Acosh and FloorMod operator adapting
Merge pull request !71 from zhangzheng/sparse_acosh_floormod
2020-04-02 21:33:33 +08:00
mindspore-ci-bot 55916351ee !52 remove ge depend
Merge pull request !52 from flywind/remove-ge-depend
2020-04-02 20:59:06 +08:00
zhangz0911gm 6f1747045c Add FloorMod, Acosh in ME 2020-04-02 08:50:39 -04:00
Wei Luning 73ba399364 remove ge depend in cpu 2020-04-02 19:38:42 +08:00
yanzhenxiang2020 5a4f17bfb6 fix mindrecord ut long time 2020-04-02 19:18:49 +08:00
c00425699 ab917a734d fix bug for allreduce fusion and add resnet unit test 2020-04-02 18:55:04 +08:00
mindspore-ci-bot d8b460c780 !96 fix refkey bug for auto parallel
Merge pull request !96 from lichen/fix_ref_key_bug_for_auto_parallel
2020-04-02 17:26:58 +08:00
lichenever 5240b1f603 fix refkey bug for auto parallel 2020-04-02 16:14:29 +08:00
mindspore-ci-bot 9cb219c683 !78 Add ascend st lenet script for pynative mode
Merge pull request !78 from JoyLvliang/pynative-add-lenet
2020-04-02 14:22:39 +08:00
YuJianfeng 7f53bb062d Optimize depend edge with make tuple input 2020-04-02 11:33:34 +08:00
mindspore-ci-bot cf54ecfe6e !62 support grad on python function with variable arguments
Merge pull request !62 from amongo/SupportGradOnVarArgs
2020-04-02 11:21:06 +08:00
lvliang ff4f935e40 pynative-add-lenet 2020-04-02 09:25:25 +08:00
zhaoting ed3c2d7229 add RMSProp optimizer 2020-04-02 09:10:58 +08:00
mindspore-ci-bot 5c22c088bb !69 Enable skipped dataset zip operator python unit tests
Merge pull request !69 from cathwong/ckw_dataset_py_ut1
2020-04-01 22:20:37 +08:00
huangdongrun d3f733fa25 support grad on graph with variable arguments
use unpack graph primitive instead

add testcases for all grad interface

remove debug log

format code

remove dumpfuncgraph

resolve clang-format

resolve reviews

resolve cpplint

fix review
2020-04-01 20:24:04 +08:00
mindspore-ci-bot 37dba2ddcf !74 delete longtime python ut
Merge pull request !74 from changzherui/master
2020-04-01 18:29:58 +08:00
mindspore-ci-bot 69d5403319 !14 add adapter for ge atan2
Merge pull request !14 from zhaozhenlong/op/atan2
2020-04-01 18:24:55 +08:00
mindspore-ci-bot a47046652a !76 [Auto parallel] Refining the strategy_checking for resnset50
Merge pull request !76 from Xiaoda/modify-resnet50-strategy-checking
2020-04-01 16:36:13 +08:00
zhaozhenlong bed5997a14 add atan2 operator 2020-04-01 16:27:35 +08:00
mindspore-ci-bot f0bcf90b5b !64 fix error while num_samples equal 0
Merge pull request !64 from anzhengqi/fix-check-num-samples
2020-04-01 15:48:38 +08:00
mindspore-ci-bot 22a9c00bcd !57 Add parallel operators for Neg and BatchMatMul
Merge pull request !57 from yangzhenzhang/master
2020-04-01 15:23:46 +08:00
mindspore-ci-bot a42eee52ba !67 add cpu st lenet
Merge pull request !67 from kisnwang/add-cpu-st
2020-04-01 15:15:13 +08:00
Xiaoda Zhang fb6eed23ae refining strategy-checking for resnet50 2020-04-01 14:58:58 +08:00
anzhengqi 6a1b865c91 check num_samples 2020-04-01 14:39:23 +08:00
chang zherui 1de7011bc8 delete longtime python ut 2020-04-01 11:53:35 +08:00
VectorSL aea6b0c974 update tests/st/ops/gpu/test_tensoradd.py.
fix pytest.mark for testcase
2020-04-01 11:49:37 +08:00
mindspore-ci-bot 87040483ee !58 fix two cast bug in auto parallel
Merge pull request !58 from lichen/fix_two_cast_bug_in_auto_parallel
2020-04-01 09:54:10 +08:00
yangzhenzhang 110640e2ad add parallel ops for neg and batchmatmul 2020-04-01 09:36:38 +08:00
Cathy Wong 2e881276ab Enable skipped dataset zip python unit tests
Signed-off-by: Cathy Wong <cathy.wong@huawei.com>
2020-03-31 16:47:13 -04:00
mindspore-ci-bot 52166a85cf !43 dump graph with type info when analysis failed
Merge pull request !43 from fary86/dump-typed-graph-when-analyze-fail
2020-03-31 22:23:02 +08:00
mindspore-ci-bot 045a1c356c !51 add op SpaceToBatch and BatchToSpace for ge
Merge pull request !51 from zhaozhenlong/op/space-to-batch
2020-03-31 21:59:03 +08:00
kswang 2dc9f632c1 add cpu st lenet 2020-03-31 21:25:48 +08:00
fary86 816b60491d Dump graph with type info when static analysis failed 2020-03-31 21:08:48 +08:00
mindspore-ci-bot e2df848597 !55 modify long time python ut
Merge pull request !55 from changzherui/master
2020-03-31 21:01:40 +08:00
zhaozhenlong cf40305bf0 add operator SpaceToBatch and BatchToSpace for ge 2020-03-31 20:21:47 +08:00
mindspore-ci-bot 352c6faf85 !18 enable use float type learning rate in lars optimizer
Merge pull request !18 from gziyan/master
2020-03-31 18:54:55 +08:00
lichenever 2da38ad401 fix two cast bug in auto parallel 2020-03-31 18:54:21 +08:00
mindspore-ci-bot da447b8d4d !45 use std::vector instead of std::list to promote performance for parallel module
Merge pull request !45 from chentingting/permote_auto_prallel_performance
2020-03-31 18:25:59 +08:00
chang zherui eaf7146d46 modify longtime python ut 2020-03-31 16:18:04 +08:00
lichenever f946aea10d fix grpah mode loop sink bug in auto parallel 2020-03-31 16:16:53 +08:00
c00425699 3bb48ffee1 use std::vector instead of std::list to promote performance for parallel module 2020-03-31 15:16:00 +08:00
mindspore-ci-bot 976226f9ac !10 Add matmul biasadd fusion pass
Merge pull request !10 from YuJianfeng/master
2020-03-31 14:52:47 +08:00
mindspore-ci-bot 6f03881b04 !39 add op Diag and DiagPart
Merge pull request !39 from zhaozhenlong/op/diag
2020-03-31 14:45:44 +08:00
mindspore-ci-bot 7242c0fad5 !41 Revert 'Pull Request !17 : [AutoParallel]Fix bug in the case of two cast'
Merge pull request !41 from leonwanghui/revert-merge-17-master
2020-03-31 14:18:17 +08:00
mindspore-ci-bot 6fb4d9a359 !38 fix st for auto parallel
Merge pull request !38 from lichen/fix_st_for_auto_parallel
2020-03-31 14:12:23 +08:00
lichenever 30231eab2f fix auto parallel st 2020-03-31 11:19:06 +08:00
leonwanghui 976af212e9 回退 'Pull Request !17 : [AutoParallel]Fix bug in the case of two cast' 2020-03-31 10:27:40 +08:00
mindspore-ci-bot 140a15924c !17 [AutoParallel]Fix bug in the case of two cast
Merge pull request !17 from lichen/fix_cast_bug
2020-03-31 10:25:04 +08:00
mindspore-ci-bot e9be3483fe !33 Optimize the execution time of test case test_rgb_hsv.py
Merge pull request !33 from qianlong21st/ql/fix_test_rgb_hsv
2020-03-31 09:53:01 +08:00
zhaozhenlong b12e6ff780 add operator diag and diag_part 2020-03-31 09:44:56 +08:00
mindspore-ci-bot c1c8fef9ca !24 Change strategy for structure output
Merge pull request !24 from 步学/structure-output
2020-03-31 09:38:44 +08:00
qianlong 8c88b39da1 Optimize the execution time of test case test_rgb_hsv.py 2020-03-31 09:23:20 +08:00
mindspore-ci-bot be9aa4a6ee !35 Replace std::cout with MS_LOG in dataset unit test
Merge pull request !35 from jonathan_yan/4SZ
2020-03-31 08:15:37 +08:00
Jonathan Yan 080bcda021 Replace std::cout with MS_LOG in dataset unit test
Signed-off-by: Jonathan Yan <jonathan.yan1@huawei.com>
2020-03-30 11:02:32 -04:00
lichenever b4d34973bc fix_cast_bug 2020-03-30 21:13:45 +08:00
buxue 0da0bdcf40 Fix bug structure output when there is depend whose first input is constant in outputs 2020-03-30 19:49:46 +08:00
Ziyan 4cbcd8e907 enable use float type learning rate in lars optimizer 2020-03-30 19:05:33 +08:00
jonyguo 34e42bd6f9 1. add more log info for dataset & mindrecord, 2. add two new testcase for MindDataset 2020-03-30 17:24:24 +08:00
GinFung 468dbc3557 Add matmul biasadd fusion pass 2020-03-30 10:12:50 +08:00
zhunaipan 930a1fb0a8 initial version
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
2020-03-27 22:54:54 +08:00