Commit Graph

12325 Commits

Author SHA1 Message Date
mindspore-ci-bot 3289d7bb69 !109 Fix some typo errors in session and device module
Merge pull request !109 from leonwanghui/typo-fix
2020-04-03 10:23:53 +08:00
jjfeing 8ece432ae9 tr5 run package update 2020-04-03 10:02:39 +08:00
huangdongrun 461d8e3a08 add comparison ops
fix pylint

use scalar_lt primitive directly

fix review
2020-04-03 09:58:41 +08:00
yanghaoran b53c974513 modify reduceminD and reducemaxD IR 2020-04-02 22:10:03 +08:00
mindspore-ci-bot 9be1a01db6 !85 Optimize depend edge with make tuple input
Merge pull request !85 from YuJianfeng/master
2020-04-02 22:00:18 +08:00
mindspore-ci-bot d245792842 !94 enhance: reduce execution time for mindrecord test case
Merge pull request !94 from yanzhenxiang2020/fix_mindrecord_ut_long_time
2020-04-02 21:50:43 +08:00
mindspore-ci-bot 1ace66c87c !110 Fix RandomCrop parameter check
Merge pull request !110 from pengyanjun/fix_dataset_parameter_check_problem
2020-04-02 21:49:02 +08:00
mindspore-ci-bot b8bfaeb65a !108 dataset: remove feed mode in comment
Merge pull request !108 from ms_yan/feed_mode
2020-04-02 21:48:15 +08:00
mindspore-ci-bot a5a904fbdf !91 fix bug for allreduce fusion and add resnet unit test
Merge pull request !91 from chentingting/allreduce_fusion_resnet
2020-04-02 21:35:35 +08:00
mindspore-ci-bot ad88c55859 !105 register not equal distributed op
Merge pull request !105 from lichen/register_not_equal_distributed_op
2020-04-02 21:34:34 +08:00
mindspore-ci-bot cb323eccf0 !71 Add operator adapting in ME for FloorMod, Acosh and SparseApplyFtrlD 【CR】,并主动Acosh and FloorMod operator adapting
Merge pull request !71 from zhangzheng/sparse_acosh_floormod
2020-04-02 21:33:33 +08:00
mindspore-ci-bot a1d6f42be8 !28 fix custom op bug when custom op has muti-out and not use all of outputs
Merge pull request !28 from geekun/master
2020-04-02 21:02:25 +08:00
mindspore-ci-bot 55916351ee !52 remove ge depend
Merge pull request !52 from flywind/remove-ge-depend
2020-04-02 20:59:06 +08:00
zhangz0911gm 6f1747045c Add FloorMod, Acosh in ME 2020-04-02 08:50:39 -04:00
Wei Luning 73ba399364 remove ge depend in cpu 2020-04-02 19:38:42 +08:00
万万没想到 605d980305 1. add Note refer to nn.SGD for detail
2. delete default value of stat
3. delete examples
4. some comments error from wangting review
5. modify comments from jinyaohui
6. modify examples from wanghao
7. modify Select operation examples
2020-04-02 19:35:19 +08:00
lichenever ff808021c7 register not equal distributed op 2020-04-02 19:28:30 +08:00
yanzhenxiang2020 5a4f17bfb6 fix mindrecord ut long time 2020-04-02 19:18:49 +08:00
c00425699 ab917a734d fix bug for allreduce fusion and add resnet unit test 2020-04-02 18:55:04 +08:00
ms_yan c2fed0b739 remove (feed mode) in comment 2020-04-02 18:43:21 +08:00
mindspore-ci-bot d8b460c780 !96 fix refkey bug for auto parallel
Merge pull request !96 from lichen/fix_ref_key_bug_for_auto_parallel
2020-04-02 17:26:58 +08:00
mindspore-ci-bot 13b6da8602 !103 Sort include file in parallel dir.
Merge pull request !103 from suteng/master
2020-04-02 17:19:06 +08:00
leonwanghui fdb47860cc Fix some typo errors in session and device module
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
2020-04-02 17:02:52 +08:00
万万没想到 c3d210cc31 fix issue I1DBRX
delete duplicated words in comments

fix issue I1CJAP

fix issue I1D3WS

fix issue I1DBA8

fix issue I1CJ77

fix issue I1CJG3

fix review suggestion
2020-04-02 16:54:44 +08:00
Yanjun Peng 49a41bb2cc fix random crop parameter check 2020-04-02 16:37:39 +08:00
lichenever 5240b1f603 fix refkey bug for auto parallel 2020-04-02 16:14:29 +08:00
mindspore-ci-bot 2aae218f4b !88 fix examples of P.Fill()
Merge pull request !88 from 万万没想到/I1DBSX
2020-04-02 16:02:54 +08:00
mindspore-ci-bot 34b74e4430 !89 fix the examples of P.ReLU6
Merge pull request !89 from 万万没想到/I1DBUG
2020-04-02 16:02:09 +08:00
WeibiaoYu b78427e619 the size of tensor may be bigger than 2GB, should use memcpy instead of memcpy_s 2020-04-02 03:52:29 -04:00
Su Teng 60b68a1470 sort include file in parallel dir 2020-04-02 15:14:47 +08:00
geekun c42e53ae5b fix custom op bug and add custom op check 2020-04-02 14:28:37 +08:00
mindspore-ci-bot 5acb93a345 !79 Dump Failed when trans_flag set to true
Merge pull request !79 from laiyongqiang/develop
2020-04-02 14:13:42 +08:00
guohongzilong 15d061f852 pass str to ge.exec.EnableDump 2020-04-02 12:05:28 +08:00
YuJianfeng 7f53bb062d Optimize depend edge with make tuple input 2020-04-02 11:33:34 +08:00
mindspore-ci-bot cf54ecfe6e !62 support grad on python function with variable arguments
Merge pull request !62 from amongo/SupportGradOnVarArgs
2020-04-02 11:21:06 +08:00
mindspore-ci-bot 1857dacac2 !84 dataset: repair unsuitable warning in repeat count and epoch size check
Merge pull request !84 from ms_yan/epoch_repeat_check
2020-04-02 10:58:47 +08:00
mindspore-ci-bot 85df19b23c !66 Add RMSProp optimizer
Merge pull request !66 from zhaoting/add-RMSProp
2020-04-02 09:57:13 +08:00
mindspore-ci-bot a44b5293de !68 fix bug: Failed to get parameter data in model parallel scenes, when the size of tensor large than 2GB
Merge pull request !68 from WeibiaoYu/master
2020-04-02 09:33:12 +08:00
zhaoting ed3c2d7229 add RMSProp optimizer 2020-04-02 09:10:58 +08:00
mindspore-ci-bot f95a5b9027 !81 [Auto parallel] Making non-identity triangle elimination exact in DP algorithm
Merge pull request !81 from Xiaoda/change_star_elimination-make_the_non-identity_triangle_eliminatin_exact
2020-04-02 09:04:03 +08:00
万万没想到 4feba6332d fix the examples of P.ReLU6 2020-04-01 22:16:29 +08:00
mindspore-ci-bot 7341d7ec1e !83 add get ptr for memreuseutil
Merge pull request !83 from kisnwang/add-getptr-for-memreuseutil
2020-04-01 22:08:52 +08:00
万万没想到 b8c16f97f7 fix examples of P.Fill 2020-04-01 22:03:01 +08:00
kswang 04be6a37f0 add getptr for memreuse 2020-04-01 21:37:02 +08:00
huangdongrun d3f733fa25 support grad on graph with variable arguments
use unpack graph primitive instead

add testcases for all grad interface

remove debug log

format code

remove dumpfuncgraph

resolve clang-format

resolve reviews

resolve cpplint

fix review
2020-04-01 20:24:04 +08:00
mindspore-ci-bot 0830ad932b !72 【轻量级 PR】:fix typo in formula
Merge pull request !72 from 万万没想到/N/A
2020-04-01 20:15:18 +08:00
ms_yan b4b1c55ed2 repair unsuitable warning in repeat count and epoch size check 2020-04-01 20:14:46 +08:00
mindspore-ci-bot 43adf281a2 !77 fix bug of bert pre training
Merge pull request !77 from amongo/FixBugOfBertPreTraining
2020-04-01 20:09:38 +08:00
Xiaoda Zhang 3d35792877 change_star_elimination: make the non-identity triangle_eliminatin exact 2020-04-01 19:24:18 +08:00
mindspore-ci-bot 69d5403319 !14 add adapter for ge atan2
Merge pull request !14 from zhaozhenlong/op/atan2
2020-04-01 18:24:55 +08:00
mindspore-ci-bot 0f2ed0b134 !61 Modify log level in DfGraphManager
Merge pull request !61 from chenhaozhe/modify-log-info-of-dfgraphmanager
2020-04-01 18:06:41 +08:00
huangdongrun 2fdf692c2e fix bug of auto control depend for bert pre training
add comment
2020-04-01 16:57:45 +08:00
zhaozhenlong bed5997a14 add atan2 operator 2020-04-01 16:27:35 +08:00
laiyongqiang bb421b70db fix bug when dump op with trans_flag true 2020-04-01 16:21:00 +08:00
mindspore-ci-bot 022c79d34e !70 【轻量级 PR】:fix typo in formula
Merge pull request !70 from 万万没想到/N/A
2020-04-01 15:58:35 +08:00
mindspore-ci-bot f0bcf90b5b !64 fix error while num_samples equal 0
Merge pull request !64 from anzhengqi/fix-check-num-samples
2020-04-01 15:48:38 +08:00
mindspore-ci-bot b829be11a6 !37 Quick fix for pre-opensource TFReaderOp issue
Merge pull request !37 from Peilin/peilin-pre-opensource-tfreader-fix
2020-04-01 15:32:08 +08:00
mindspore-ci-bot 22a9c00bcd !57 Add parallel operators for Neg and BatchMatMul
Merge pull request !57 from yangzhenzhang/master
2020-04-01 15:23:46 +08:00
anzhengqi 6a1b865c91 check num_samples 2020-04-01 14:39:23 +08:00
mindspore-ci-bot 569e5b056e !53 [Auto parallel] Remove the redundant work in star elimination
Merge pull request !53 from Xiaoda/modify_star_and_triangle_elimination
2020-04-01 11:43:31 +08:00
万万没想到 fd96ebe3ea fix typo in formula 2020-04-01 11:42:24 +08:00
万万没想到 849b84abb1 fix typo in formula 2020-04-01 11:14:21 +08:00
mindspore-ci-bot c46e267cfd !21 update lenet , add alexnet in example
Merge pull request !21 from wukesong/add_lenet_alexnet
2020-04-01 11:05:58 +08:00
mindspore-ci-bot 8f76c28017 !56 remove cce dependency
Merge pull request !56 from jojobugfree/dev-rm-cce
2020-04-01 10:12:54 +08:00
mindspore-ci-bot 87040483ee !58 fix two cast bug in auto parallel
Merge pull request !58 from lichen/fix_two_cast_bug_in_auto_parallel
2020-04-01 09:54:10 +08:00
WeibiaoYu 60f7a95b1c the size of tensor may be bigger than 2GB, should use memcpy instead of memcpy_s 2020-03-31 21:47:28 -04:00
yangzhenzhang 110640e2ad add parallel ops for neg and batchmatmul 2020-04-01 09:36:38 +08:00
Xiaoda Zhang c080ec7874 change star elimination: remove some redundant and checking works 2020-04-01 09:16:36 +08:00
Peilin Wang 0ae77bb0db TFReaderOp fix, threads will exit after reading necessary amount of rows
changes from yanpanhui 524009: added set_dataset_size and changed get_dataest_size according to ME requirements

CI fixes
2020-03-31 13:29:54 -04:00
mindspore-ci-bot 52166a85cf !43 dump graph with type info when analysis failed
Merge pull request !43 from fary86/dump-typed-graph-when-analyze-fail
2020-03-31 22:23:02 +08:00
mindspore-ci-bot 045a1c356c !51 add op SpaceToBatch and BatchToSpace for ge
Merge pull request !51 from zhaozhenlong/op/space-to-batch
2020-03-31 21:59:03 +08:00
mindspore-ci-bot 58cd173051 !63 dataset: repair parameter check problem in random_resize_crop and random_crop
Merge pull request !63 from ms_yan/repair_pytrans_check
2020-03-31 21:26:14 +08:00
mindspore-ci-bot 1fc5a69d6f !59 dataset: Repair parameter check problem in TFRecordDataset
Merge pull request !59 from ms_yan/repair_shard_tf
2020-03-31 21:26:05 +08:00
chenhaozhe 0727c2e76a modify log level in DfGraphManager 2020-03-31 21:09:35 +08:00
fary86 816b60491d Dump graph with type info when static analysis failed 2020-03-31 21:08:48 +08:00
mindspore-ci-bot e2df848597 !55 modify long time python ut
Merge pull request !55 from changzherui/master
2020-03-31 21:01:40 +08:00
mxm 2f031e1540 fixed: PrimitiveToInferImplMap map is global, and key of the map PrimitivePtr also a global variable. If key is initialized later than the map initialized during compilation, will cause the primitive map initialize failed. Variable initialization order is not guaranteed during compilation. 2020-03-31 20:49:33 +08:00
mindspore-ci-bot a8450dd761 !47 fix issue about the process don't exit when custom ops run failed
Merge pull request !47 from wchunjiang/master
2020-03-31 20:28:05 +08:00
zhaozhenlong cf40305bf0 add operator SpaceToBatch and BatchToSpace for ge 2020-03-31 20:21:47 +08:00
ms_yan 624ab97de6 repair parameter check problem in random_resize_crop and random_crop 2020-03-31 20:13:49 +08:00
mindspore-ci-bot da4c711dfb !50 fix parallel related valuenode merging error
Merge pull request !50 from penn/fix_parallel_related_valuenode_merging_error
2020-03-31 19:44:37 +08:00
panyifeng feb1c36811 fix parallel related valuenode merging error 2020-03-31 19:40:16 +08:00
ms_yan 7b5640da4e Repair parameter check problem in TFRecordDataset 2020-03-31 18:58:58 +08:00
mindspore-ci-bot 352c6faf85 !18 enable use float type learning rate in lars optimizer
Merge pull request !18 from gziyan/master
2020-03-31 18:54:55 +08:00
lichenever 2da38ad401 fix two cast bug in auto parallel 2020-03-31 18:54:21 +08:00
mindspore-ci-bot da447b8d4d !45 use std::vector instead of std::list to promote performance for parallel module
Merge pull request !45 from chentingting/permote_auto_prallel_performance
2020-03-31 18:25:59 +08:00
mindspore-ci-bot 04c10bb93d !42 add vgg scripts master
Merge pull request !42 from wangjun260/update_vgg_scripts
2020-03-31 17:54:26 +08:00
wukesong 0173c40124 add lenet & alexnet in master branch 2020-03-31 17:14:44 +08:00
jojobugfree e6c15b82c8 remove cce dependency 2020-03-31 17:02:25 +08:00
chang zherui eaf7146d46 modify longtime python ut 2020-03-31 16:18:04 +08:00
lichenever f946aea10d fix grpah mode loop sink bug in auto parallel 2020-03-31 16:16:53 +08:00
wangjun260 31b165a57e add vgg scripts 2020-03-31 16:07:18 +08:00
wenchunjiang 5a00d8cb58 This fixes an issue about mindspore process cannot exit when calling python api op_select_format failed in select kernel steps.
Previously function op_select_format and check_supported raise an exception directly on the tbe_process python side, but we don't deal with the exception, and raise an exeception on c++ side to frontend ME, that will cause some conflict when recycle resource on ME and tbe_process python interpreter.
This changes adding try...catch in function op_select_format and check_supported on the python side, and return the Exception string to c++ side, so that we can raise an exception to frontend ME and ME will deal with resouce clearning and exit.
2020-03-31 15:46:40 +08:00
c00425699 3bb48ffee1 use std::vector instead of std::list to promote performance for parallel module 2020-03-31 15:16:00 +08:00
mindspore-ci-bot 976226f9ac !10 Add matmul biasadd fusion pass
Merge pull request !10 from YuJianfeng/master
2020-03-31 14:52:47 +08:00
mindspore-ci-bot 6f03881b04 !39 add op Diag and DiagPart
Merge pull request !39 from zhaozhenlong/op/diag
2020-03-31 14:45:44 +08:00
mindspore-ci-bot 2753aa8768 !15 Correct the comments for `RandomChoiceWithMask` op.
Merge pull request !15 from seatea/randomchoicewithmask-doc
2020-03-31 14:37:36 +08:00
mindspore-ci-bot 7242c0fad5 !41 Revert 'Pull Request !17 : [AutoParallel]Fix bug in the case of two cast'
Merge pull request !41 from leonwanghui/revert-merge-17-master
2020-03-31 14:18:17 +08:00
mindspore-ci-bot e4b404e8ae !32 auto-enable-dynamic-mem-pool
Merge pull request !32 from JoyLvliang/master
2020-03-31 14:12:24 +08:00
mindspore-ci-bot e535a5f50c !40 fix bug of get a error dst format of transdata
Merge pull request !40 from lianliguang/master
2020-03-31 11:59:10 +08:00
mindspore-ci-bot 84a61bd015 !27 add log for kernel runtime in order to trace performance
Merge pull request !27 from shibeiji/master
2020-03-31 11:13:27 +08:00
lvliang b3a306489d auto enbale dynamic mem pool 2020-03-31 10:30:01 +08:00
leonwanghui 976af212e9 回退 'Pull Request !17 : [AutoParallel]Fix bug in the case of two cast' 2020-03-31 10:27:40 +08:00
mindspore-ci-bot 140a15924c !17 [AutoParallel]Fix bug in the case of two cast
Merge pull request !17 from lichen/fix_cast_bug
2020-03-31 10:25:04 +08:00
mindspore-ci-bot 02a25407c4 !30 use string::find instead of equal to distinguish training graph
Merge pull request !30 from chenhaozhe/enable-variable-acc-for-training-graph
2020-03-31 10:18:06 +08:00
lianliguang 9d5890d9b9 fix bug of got a error transdata's dest format 2020-03-31 10:04:34 +08:00
zhaozhenlong b12e6ff780 add operator diag and diag_part 2020-03-31 09:44:56 +08:00
mindspore-ci-bot c1c8fef9ca !24 Change strategy for structure output
Merge pull request !24 from 步学/structure-output
2020-03-31 09:38:44 +08:00
mindspore-ci-bot 4f5755003a !29 Add some prompt information for ease of use
Merge pull request !29 from jonyguo/add_more_log_info_and_testcase
2020-03-30 22:27:19 +08:00
seatea 840280e784 Correct the comments for `RandomChoiceWithMask` op. 2020-03-30 22:17:32 +08:00
mindspore-ci-bot 062b744b19 !12 Fix dtype bug for loss_scale and weight_decay
Merge pull request !12 from seatea/dynamic-loss-scale
2020-03-30 22:06:35 +08:00
mindspore-ci-bot 3ab402e110 !7 adapt relu6grad
Merge pull request !7 from zhaozhenlong/adapte-relu6grad
2020-03-30 21:58:39 +08:00
lichenever b4d34973bc fix_cast_bug 2020-03-30 21:13:45 +08:00
chenhaozhe cab5503280 use find instead of equal to distinguish training graph 2020-03-30 20:10:56 +08:00
mindspore-ci-bot 44cd0c1f90 !13 Check input shape for `NMSWithMask` op
Merge pull request !13 from seatea/NMSWithMask-check-shape
2020-03-30 19:52:41 +08:00
buxue 0da0bdcf40 Fix bug structure output when there is depend whose first input is constant in outputs 2020-03-30 19:49:46 +08:00
Ziyan 4cbcd8e907 enable use float type learning rate in lars optimizer 2020-03-30 19:05:33 +08:00
zhaozhenlong 9862dea3cf adapt relu6grad and graphengine modified 2020-03-30 19:01:03 +08:00
shibeiji 468e257a14 add log for kernel runtime in order to trace performance 2020-03-30 17:55:28 +08:00
jonyguo 34e42bd6f9 1. add more log info for dataset & mindrecord, 2. add two new testcase for MindDataset 2020-03-30 17:24:24 +08:00
seatea 6c03542eec Fix dtype bug for loss_scale and weight_decay.
1.Change dtype of scale to dtype of grad in loss_scale.py;
2.Change dtype of weight_decay to dtype of weight in optimizer.py.
2020-03-30 17:14:52 +08:00
seatea 7b7a6a45a0 Check if the shape of the input of NMSWithMask is (N, 5). 2020-03-30 12:10:35 +08:00
jjfeing 86f5c69995 change parallel complie num: 32->16 2020-03-30 10:54:53 +08:00
GinFung 468dbc3557 Add matmul biasadd fusion pass 2020-03-30 10:12:50 +08:00
zhunaipan 930a1fb0a8 initial version
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
2020-03-27 22:54:54 +08:00