yystopf
/
mindspore
forked from mindspore-Ecosystem/mindspore
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
45,876 Commits 23 Branches 0 Tags 3.9 GiB
Commit Graph

2085 Commits

Author SHA1 Message Date
zhaoting b16a552d41 Revert "Revert "add pattern AdjustAllReduceMulAdduse the old opadd test case for bugtemp fix try"" 
This reverts commit 705c71a257.
 2020-06-09 20:56:36 +08:00
mindspore-ci-bot beb714d2d0 !1911 add a function to charge the node input and output is a scalar 
Merge pull request !1911 from lianliguang/add-a-function-to-charge-the-node-input-or-output-if-is-a-scalar
 2020-06-09 19:57:01 +08:00
yujianfeng 2ff9e74d07 Add unique process for duplicated indices 2020-06-09 10:12:39 +08:00
WilliamLian 9808e47663 change checkAicpu to CheckAICPU & add charge Scalar function to charge the input or output is scalar 2020-06-09 09:31:43 +08:00
huanghui b4c0ed4b36 add signle batchnorm fission pass 2020-06-08 10:08:23 +08:00
chujinjin 7465abc798 optimize transdata for pynative 2020-06-05 14:10:55 +08:00
mindspore-ci-bot 1973594bd1 !1774 [MD] minddataset support padding samples 
Merge pull request !1774 from liyong126/mindrecord_padded_sample
 2020-06-05 11:27:25 +08:00
mindspore-ci-bot b236beae28 !1615 convert constant bool tensor to bool 
Merge pull request !1615 from amongo/GetBoolValueFromConstantTensor
 2020-06-05 09:46:44 +08:00
liyong feff8899ac support padding samples 2020-06-05 09:14:42 +08:00
mindspore-ci-bot c51d90d84e !1767 Move LayerNormGrad split pass ahead of kernel select 
Merge pull request !1767 from huanghui/LayerNormGrad-split-pass
 2020-06-05 09:13:24 +08:00
mindspore-ci-bot 769ae609b4 !1808 consistent design for num_samples 
Merge pull request !1808 from Jamie/numsamples
 2020-06-04 22:12:55 +08:00
huangdongrun beacc26077 * add isconstant primitive 
* add infer_value for common math ops
* convert constant bool tensor to bool value

* do not infer value when encounter 0 as division

for while condition, do not unrool if condition is a tensor
 2020-06-04 21:51:44 +08:00
yujianfeng e87ac6525e Add batch norm fusion pattern for mix precision 2020-06-04 20:31:15 +08:00
huanghui cf87218fb7 place layernormgrad split pass before kernel select 2020-06-04 19:39:40 +08:00
Jamie Nisbet 51bc0c0460 consistent design for num_samples 
updates

more update

more work

more fixin

post rebase updates

clang formatting

code review recovery

ci fixes

updates

update

update

update
 2020-06-03 15:01:18 -04:00
mindspore-ci-bot 0426ed057b !1777 Remove ZerosLikeTensor and sub with ZerosTensor 
Merge pull request !1777 from BowenK/master
 2020-06-02 10:41:58 +08:00
BowenK 96379faa3a Remove ZerosLikeTensor and sub with ZerosLike 2020-06-02 09:52:12 +08:00
huanghui d1cec14a0c add 2 pattern for softmaxgradext fusion pass 2020-06-01 18:48:41 +08:00
kswang c63729b8e6 support mix target 2020-06-01 14:33:56 +08:00
mindspore-ci-bot cc9c004bc1 !1696 Enable ConfusionMulGrad fusion pass 
Merge pull request !1696 from huanghui/TMP
 2020-05-30 14:44:29 +08:00
mindspore-ci-bot 692f38ded2 !1532 clean pylint warning in test dir 
Merge pull request !1532 from jinyaohui/pylint1
 2020-05-30 10:13:45 +08:00
mindspore-ci-bot 59683a1d90 !1692 Fix topk bug for fasterrcnn 
Merge pull request !1692 from meixiaowei/master
 2020-05-30 09:56:40 +08:00
huanghui 71acaa5300 enable ConfusionMulGrad fusion pass in bert only 2020-05-30 09:46:21 +08:00
mindspore-ci-bot 387bcece9e !1666 Add 5 patterns for AdamApplyOneWithDecay fusion pass 
Merge pull request !1666 from huanghui/AdamApplyOneWithDecay-fusion-pass
 2020-05-30 09:43:07 +08:00
jinyaohui 86d197dfeb clean pylint 2020-05-29 23:00:00 +08:00
huanghui ff05aa1faa add newly 5 patterns for AdamApplyOneWithDecayRule fusion pass 2020-05-29 19:49:44 +08:00
yujianfeng e6f1cfa581 Check the input size of BatchNorm before fission in bert 2020-05-29 19:34:58 +08:00
meixiaowei 1778ec0135 fix topk bug 2020-05-29 19:04:18 +08:00
huanghui 99ca6b3e80 add SoftmaxGradExt fusion pass 2020-05-29 14:30:52 +08:00
mindspore-ci-bot 8556eee3fc !1578 recitify pretrained path and revert AdjustAllReduceMulAdduse 
Merge pull request !1578 from gengdongjie/master
 2020-05-28 20:25:50 +08:00
mindspore-ci-bot 9c858444b0 !1568 Fix pylint warning for test cases of optimizer, infer, parse and pynative. 
Merge pull request !1568 from seatea/fix-pylint-warning
 2020-05-28 16:59:57 +08:00
mindspore-ci-bot 04398cf88e !1433 add tensor_minnie and separate py from ir 
Merge pull request !1433 from leopz/tensor_base
 2020-05-28 16:00:56 +08:00
gengdongjie 705c71a257 Revert "add pattern AdjustAllReduceMulAdduse the old opadd test case for bugtemp fix try" 
This reverts commit 3db8cfa54f.
 2020-05-28 15:21:15 +08:00
leopz 4508134ceb add tensor_minnie and separate py from ir 2020-05-28 14:26:26 +08:00
mindspore-ci-bot c086d91aaf !1505 Add some checks in ConstToAttr[StridedSliceGrad] pass 
Merge pull request !1505 from huanghui/stride-slice
 2020-05-28 11:46:18 +08:00
seatea 7398526abc Fix pylint warning for test cases of optimizer, infer, parse and 
pynative.
 2020-05-28 11:35:33 +08:00
yujianfeng ee087bdf60 Check the size of topk input names before converting input to attr 2020-05-28 10:29:21 +08:00
Jesse Lee 3b80c10b1e Fix some timing hole in these two testcases 2020-05-27 14:22:37 -04:00
mindspore-ci-bot e311473401 !1453 Raise mse threshold in RandomCropDecodeResizeOp 
Merge pull request !1453 from Alexey_Shevlyakov/fix_random_crop_decode_resize_ut
 2020-05-27 23:58:58 +08:00
huanghui 1d65ae598a extract const_to_attr_strided_slice_grad pass 2020-05-27 17:30:17 +08:00
mindspore-ci-bot 5b9c145ff8 !1383 keep different attributes for cnode evaluation 
Merge pull request !1383 from amongo/KeepPrimAttrInCNode
 2020-05-27 13:02:34 +08:00
mindspore-ci-bot 5e2f440eed !1271 refactor of memreuse allocator to adapt the control stream 
Merge pull request !1271 from yangjie159/refactor_memreuse_allocator
 2020-05-27 10:24:16 +08:00
mindspore-ci-bot 650a45b233 !1490 Fix pylint warning 
Merge pull request !1490 from seatea/fix-pylint-warning
 2020-05-27 09:41:31 +08:00
seatea c6d8a4dc98 Fix pylint warning. 2020-05-26 21:23:06 +08:00
yujianfeng 94818cf255 Fix fusion condition of transpose and reshape 2020-05-26 17:30:38 +08:00
yangjie159 cbf5390b34 refactor memreuse allocator 
remove stream id from membuf
add kernel dependence to determine whether is usable
 2020-05-26 17:27:33 +08:00
huangdongrun 1159f2b11e add prim infer attr cache 
modify infer to get abstract value and attr value map together

support get attr in specialize

clone primitive when specialize if attribute is not the same with
infered attribute
 2020-05-26 16:19:58 +08:00
mindspore-ci-bot 2215e3267f !1419 remove old buffer fusion pass 
Merge pull request !1419 from Etone.Chan/Resnet50
 2020-05-26 09:16:06 +08:00
Jesse Lee a8fa847556 Allow join_all to be blocking 2020-05-25 15:24:36 -04:00
Alexey Shevlyakov 7a807cbff9 fix ut 2020-05-25 14:56:58 -04:00
etone-chan 42d724d8b4 remove old buffer fusion pass 2020-05-25 21:25:45 +08:00
mindspore-ci-bot e8980ed298 !1406 Simplify CondVar class 
Merge pull request !1406 from JesseKLee/CondVar
 2020-05-25 21:04:05 +08:00
huanghui a42dd21430 add 3 pattern for lamb_next_mv_rule fusion pass 2020-05-25 14:18:22 +08:00
mindspore-ci-bot 848d19207f !1359 Optimize the IR modules. 
Merge pull request !1359 from ZhangQinghua/master
 2020-05-25 14:14:44 +08:00
Zhang Qinghua dbb86cb1be Adjust some routines of FG and FGM, about the nodes info. IF. 2020-05-25 10:06:27 +08:00
Zhang Qinghua f31564ce98 Remove the useless collectors in manager. 2020-05-25 09:56:28 +08:00
Jesse Lee 641112a40c Initial Drop 2020-05-24 16:57:40 -04:00
mindspore-ci-bot daccfef738 !1361 Refactor multiple output pass 
Merge pull request !1361 from huanghui/LambNextMVRule-fusion-pass
 2020-05-23 17:21:27 +08:00
lizhenyu c5ac2cc38c add memory copy module 2020-05-23 13:04:50 +08:00
huanghui f16ff539ba refactor multiple patterns pass 2020-05-23 09:40:21 +08:00
mindspore-ci-bot 964a757db2 !1378 Just want to debug this case in Jenkin environment 
Merge pull request !1378 from JesseKLee/cond_var_debug
 2020-05-23 05:26:12 +08:00
Jesse Lee 06ae724261 Again 2020-05-22 16:38:03 -04:00
mindspore-ci-bot 458436186c !1365 Clean up work for text python sub-package 
Merge pull request !1365 from h.farahat/text_namespace
 2020-05-22 23:16:31 +08:00
mindspore-ci-bot 6f733ec113 !1308 Stage 2 of adding support for string Tensor 
Merge pull request !1308 from h.farahat/string_tensor2
 2020-05-22 21:17:53 +08:00
mindspore-ci-bot f967700ef4 !1215 [Auto parallel] Changing succive edges orders and add some strategy checkings 
Merge pull request !1215 from Xiaoda/change-succive-edges-order-and-add-checking
 2020-05-22 18:56:35 +08:00
mindspore-ci-bot 3363d4e834 !1249 Add GNN dataset processing API 
Merge pull request !1249 from heleiwang/hlw_gnn_data
 2020-05-22 18:49:36 +08:00
hesham 6c21e556c4 Clean up work for text python package 2020-05-22 04:35:58 -04:00
mindspore-ci-bot 4bdfddedb2 !1358 Link child graphs 
Merge pull request !1358 from zhoufeng/link-child-graph-2
 2020-05-22 16:10:52 +08:00
zhoufeng af5019b94f link child graphs 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2020-05-22 15:37:19 +08:00
heleiwang 599a449e0b Support processing GNN data 2020-05-22 14:15:25 +08:00
jinyaohui fbdba6e4da clean pylint 2020-05-22 13:23:13 +08:00
hesham df361d1d26 Change mem layout of string tensor 
add support for MindRecord and TFRecord
----
optimize tensorshape

optimize tensorshape and FlatIndex

TFRecord and MindRecord support for string tensor

Modify mem layout
Add new constructor
Add method Allocate

Change some GetMutableBuffer usages to AllocateBuffer
 2020-05-22 01:22:29 -04:00
Xiaoda Zhang 9f4b8a3cd1 changing the succive edges order in GetAliveSuccEdges() so that Triangle and Star Elimination can be merged into particular node; adding some check information 2020-05-22 10:57:02 +08:00
mindspore-ci-bot d9c74e0acd !1328 Add 3 patterns support for LambNextMVWithDecay fusion pass 
Merge pull request !1328 from huanghui/LambNextMvWithDecayRuleConds-fusion-pass
 2020-05-22 10:35:17 +08:00
mindspore-ci-bot 2e3d55ed87 !1281 Implementation of SplitOp 
Merge pull request !1281 from Peilin/splitOp
 2020-05-22 09:29:03 +08:00
Peilin Wang 71e8bb1960 general split case done, chaining sampler (basic case) is working 
implementation 99% complete

everything and tested except for repeatable shuffling

tested most basic/typical split usecases

cleanup

some more cleanup

fix CI

more ci fix

more ci fixes

more ci fix

more ci fix

more ci fix

added more tests, fixed some bugs

some more clean up and test cases

added shard/shuffle before split warning/error

addressed code review comments and ci

fixed ci
 2020-05-21 20:42:51 -04:00
mindspore-ci-bot 07b14f32b9 !1296 move signature to primitivepy and bprop_func to utils 
Merge pull request !1296 from leopz/fix_primitive
 2020-05-21 20:44:59 +08:00
huanghui eaff850f11 add 3 patterns for lamb_next_mv_with_decay_rule pass 2020-05-21 17:00:15 +08:00
mindspore-ci-bot e4795974be !1266 Refactor LambNextMVWithDecayRule fusion pass 
Merge pull request !1266 from huanghui/LambNextMvWithDecayRuleConds-fusion-pass
 2020-05-21 11:43:49 +08:00
huanghui 5a68eba585 Refactor LambNextMVWithDecayRule fusion pass 2020-05-21 10:08:50 +08:00
qianlong 451c20a6f5 Add UnicodeCharTokenizer for nlp 2020-05-21 09:22:45 +08:00
leopz 04763b8b76 move signature to primitivepy and bprop_func to utils 2020-05-20 18:06:36 +08:00
xulei2020 163b6b7ea7 add jieba c++ code 2020-05-20 15:55:12 +08:00
mindspore-ci-bot 97ba539e7b !1269 fix issue of loadding control input tensors failed in control sink mode 
Merge pull request !1269 from wenchunjiang/fix_task_sink_bug
 2020-05-20 11:33:12 +08:00
wenchunjiang 729ea8cc55 fix bug of loadding ctrl input tensors failed in control sink mode 2020-05-20 10:45:28 +08:00
mindspore-ci-bot 04ac611fe8 !1189 Decoupling py default param from Parameter 
Merge pull request !1189 from leopz/master
 2020-05-20 10:02:01 +08:00
leopz 40e15996b0 move default_param out of parameter and remove pybind11 in anf define 2020-05-19 19:11:12 +08:00
Wei Luning 3db8cfa54f add pattern AdjustAllReduceMulAdduse the old opadd test case for bugtemp fix try 2020-05-19 18:46:11 +08:00
mindspore-ci-bot c793540cc9 !1231 Assign label resource for new control sink 
Merge pull request !1231 from zhoufeng/label-assign
 2020-05-19 10:48:35 +08:00
zhoufeng c99f904276 assign label resource for new control sink 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2020-05-18 21:44:52 +08:00
mindspore-ci-bot 828d0b124e !1209 add format trans function 
Merge pull request !1209 from liubuyu/master
 2020-05-18 20:59:43 +08:00
mindspore-ci-bot 1b7cdc4c61 !1218 clean pylint warning in test about import 
Merge pull request !1218 from jinyaohui/pylint1
 2020-05-18 19:54:04 +08:00
liubuyu f70429d671 add format transfer 2020-05-18 19:45:04 +08:00
yujianfeng c8d33568f2 Add an new output to FusedMulApplyMomentum 2020-05-18 17:03:21 +08:00
jinyaohui 5a914994ba clean pylint 2020-05-18 16:42:35 +08:00
huanghui c4af71e236 add LarsV2 fission pass 2020-05-18 11:30:45 +08:00
jinyaohui bcfaff97f9 clean pylint 2020-05-18 10:31:46 +08:00
hesham e8ca243364 -Add DE_STRING 
-replace switch'case by indexing

- Add test case
- Add constructors
- Add getItem string

- Fix bugs
- Add more tests

- Tensor iterator
- asNumpy
- TextFileDataset

- Tensor(Numpy)

- Super > 2D
- Add more test cases for GeneratorDataset

- Change StartAddr to GetBuffer and GetMutableNuffer

- Raise an error if batch is used with strings

Clean-up work
 2020-05-15 20:33:28 -04:00
mindspore-ci-bot ca64bfdbab !1120 Code refactoring ：modify Infer to Eval 
Merge pull request !1120 from Kang/master
 2020-05-15 17:44:29 +08:00
mindspore-ci-bot 889d7b6eea !1180 [pre_activate]Fix pylint warning 
Merge pull request !1180 from YuJianfeng/master
 2020-05-15 17:25:34 +08:00
mindspore-ci-bot efb9672849 !1118 Add BatchNormGrad2BNInferGrad pass 
Merge pull request !1118 from huanghui/batchnormgrad-to-bninfergrad-pass
 2020-05-15 17:15:38 +08:00
mindspore-ci-bot c680cfbf27 !1157 dataset: add concat operation for dataset 
Merge pull request !1157 from ms_yan/concat_dataset
 2020-05-15 16:07:19 +08:00
mindspore-ci-bot ab031ee9ea !1126 VOCDataset support object detection function 
Merge pull request !1126 from xiefangqi/voc_support_detection
 2020-05-15 15:56:39 +08:00
yujianfeng 0f42fdbb80 Fix pylint warning 2020-05-15 15:29:22 +08:00
huanghui 709828a98b add BatchNormGrad2BNInferGrad pass 2020-05-15 14:37:50 +08:00
mindspore-ci-bot 42ba885e58 !1098 Add BatchNorm2BNInfer pass 
Merge pull request !1098 from huanghui/add-batchnorm-bninfer-pass
 2020-05-15 14:33:09 +08:00
xiefangqi c937bad53f minddata support voc 2020-05-15 13:24:03 +08:00
ms_yan c0fa7b4b19 init commit of concat dataset 
change to use __add__ operation instead ds.concat
 2020-05-15 13:14:13 +08:00
Kang be60bd3d79 Code refactoring for the static_analysis : modified Infer to Eval. 2020-05-15 09:56:41 +08:00
huanghui 6db71e6576 add batchnorm2bninfer pass 2020-05-15 09:56:38 +08:00
yujianfeng 2b061c84c7 Add batch_norm_grad infer fisson 2020-05-15 09:44:40 +08:00
mindspore-ci-bot 597933b04b !1113 rename kernel/mng to kernel/rts 
Merge pull request !1113 from dengwentao/rts
 2020-05-15 09:39:18 +08:00
yujianfeng 6e89ebe6f0 Add BatchNorm fusion pattern with mix precision 2020-05-14 21:28:08 +08:00
mindspore-ci-bot 4bb46606db !1149 fix pylint in tests 
Merge pull request !1149 from panyifeng/fix_pylint
 2020-05-14 15:15:52 +08:00
panyifeng 755ba75deb fix pylint 2020-05-14 14:22:52 +08:00
etone-chan c4a5bfb787 add matmul eltwise buffer fusion pass 2020-05-14 10:36:23 +08:00
mindspore-ci-bot 9e116e15fb !1139 Change Thread::Join to async call with time out 
Merge pull request !1139 from JesseKLee/timing_hole
 2020-05-14 09:07:06 +08:00
mindspore-ci-bot 1a052f7155 !1131 [Data]fix cmake build format 
Merge pull request !1131 from xulei/filter_op
 2020-05-14 08:24:35 +08:00
Jesse Lee f2be49d85e Fix a racing condition 2020-05-13 14:59:25 -04:00
xulei2020 903b64daa2 fix cmake build format 2020-05-13 17:00:35 +08:00
mindspore-ci-bot 8b98f921cc !1124 Add broadcast fusion pass 
Merge pull request !1124 from YuJianfeng/master
 2020-05-13 16:29:33 +08:00
dengwentao fa83fc3e02 rename kernel/mng to kernel/rts 2020-05-13 16:26:17 +08:00
mindspore-ci-bot 1a98c6b459 !999 [MD] mindrecord support reading file list 
Merge pull request !999 from liyong126/mindrecord_file_list
 2020-05-13 15:53:26 +08:00
yujianfeng 31d8db9fc6 Add broadcast fusion pass 2020-05-13 15:30:38 +08:00
mindspore-ci-bot 86d4797399 !1079 Convert AiCpu kernel when aicore not supported 
Merge pull request !1079 from lianliguang/convert-to-AICPU-when-AiCore-not-supported-kernel
 2020-05-13 15:15:00 +08:00
liyong aa3f89e74f mindrecord support read file list 2020-05-13 14:11:59 +08:00
WilliamLian 691b0648e3 convert unsupported kernel in aicore to aicpu 2020-05-13 11:52:26 +08:00
yujianfeng 85ff90c237 Add input shape condition for transpose_reshape fusion pass 2020-05-12 22:54:21 +08:00
Jesse Lee 3c643e7298 Move from dataset_dev branch to here 2020-05-11 15:11:53 -04:00
fary86 3f323e48e2 Add submodule id for log interface 2020-05-11 19:17:45 +08:00
yao_yf f0bf438a55 reshape strategy search 2020-05-09 17:00:37 +08:00
mindspore-ci-bot 9433ca6468 !998 format the func name 
Merge pull request !998 from guozhijian/enhance_format_func_name
 2020-05-08 20:18:35 +08:00
jonyguo cf352d190f format func name for mindrecord 2020-05-08 18:33:13 +08:00
huanghui 12eaaf710b mul_add_fusion pass supports when add's 2nd is mul 2020-05-08 14:28:39 +08:00
Zirui Wu c2d364a573 batch with padding implemented 
support for 1 specific dimension to be None, added validator

fix various CI complains

another round of CI fixes

ci

refactor parts of the code

code refactor

ci fix

comments added, fix bugs

address review comments

address review comments

review cmts

added simple perf test script

update pad code

perf imprv
 2020-05-07 11:18:42 -04:00
Xiaoda Zhang def8573275 implementing-searching-strategy-for-inference 2020-05-07 14:53:50 +08:00
YuJianfeng aa6f808616 Add batch norm bert fission pass 2020-05-06 16:33:46 +08:00
xiefangqi 9a2daae84c del unused change_mode_op 2020-05-06 11:54:05 +08:00
changzherui 99c9b48a4d delete TestHWBatchNormGradSplit 2020-05-04 19:39:17 +08:00
changzherui b323199dc1 syn code 430 2020-04-30 17:55:12 +08:00
YuJianfeng 7185961e89 Enable BatchNorm fusion pass 2020-04-30 15:29:23 +08:00
mindspore-ci-bot db3dd02838 !847 Optimize the collectors in manager which listen to the graphs and nodes changes. 
Merge pull request !847 from ZhangQinghua/opt
 2020-04-30 11:12:40 +08:00
mindspore-ci-bot 2303453753 !869 Random data op 
Merge pull request !869 from JesseKLee/random_data_op
 2020-04-30 02:56:39 +08:00
mindspore-ci-bot 732c7f8266 !794 fix issues image gradients 4d check 
Merge pull request !794 from zhaozhenlong/fix-issues-image-gradients-complement-check
 2020-04-29 22:26:53 +08:00
Jesse Lee 270bf831a9 Random Data Op 2020-04-29 10:26:00 -04:00
mindspore-ci-bot 98939d839c !856 Fix skip op bug 
Merge pull request !856 from jiangzhiwen/dataset/skip_thread
 2020-04-29 21:47:50 +08:00
zhaozhenlong 66e7a36846 ImageGradients check 4d 
fix DiagPart constant folding issue

fix argmin output type check

fix atan2 doc error

fix remove FusedBatchNorm and its grad
 2020-04-29 21:47:33 +08:00
jiangzhiwen 34bfa2f7c9 fix skip 2020-04-29 20:12:37 +08:00
Zhang Qinghua a22a4a57c2 Modify UT case after adjust the collectors of manager. 2020-04-29 15:36:21 +08:00
huanghui 0de0aee54e Add BatchNormGrad split pass 2020-04-29 15:28:23 +08:00
Jesse Lee 332398d20a Check return code from WaitPost::Register 2020-04-28 15:19:03 -04:00
yao_yf 6cde5f6d91 auto parallel strategy checkpoint 2020-04-28 15:48:41 +08:00
kswang e6f36e050f change cpu kernel dir 2020-04-27 21:14:03 +08:00
mindspore-ci-bot e537a70808 !657 Fix confusionmulgrad fusion pass cannot work 
Merge pull request !657 from huanghui/fix-confusionmulgrad-fusion-pass
 2020-04-27 11:10:25 +08:00
mindspore-ci-bot 3d9f1087c6 !695 Check topk supported before converting input to attr 
Merge pull request !695 from YuJianfeng/master
 2020-04-26 21:38:43 +08:00
YuJianfeng ce2a13fcda Check topk supported before converting input to attr 2020-04-26 18:40:17 +08:00
mindspore-ci-bot fb5cfe31d5 !430 add buffer fusion bnupdate eltwise pass 
Merge pull request !430 from Etone.Chan/bufferfusion
 2020-04-26 17:40:20 +08:00
Etone.Chan d2727d0504 add buffer fusion bnupdate eltwise pass 2020-04-26 17:17:42 +08:00
huanghui 230e77f923 fix confusionmulgrad fusion pass cannot work 2020-04-26 15:35:25 +08:00
huanghui 9e29224af9 move add_memcpy_async pass and transdata_split pass 2020-04-26 10:48:44 +08:00
Wei Luning f305d6f8a7 Revert "add pattern AdjustAllReduceMulAdd" 
This reverts commit ea6958c50a.
 2020-04-25 19:50:50 +08:00
zhaozhenlong 89f82e1a37 fix cpp ut test TestConvertConvBackpropFilter 2020-04-24 19:04:40 +08:00
mindspore-ci-bot 53d2da5fe4 !264 static_analysis: remove useless cache in TrivialPrimEvaluator and add cache for PythonPrimEvaluator 
Merge pull request !264 from xychow/remove-unnecessary-cache-and-add-cache
 2020-04-24 09:22:33 +08:00
mindspore-ci-bot 2440cea732 !621 [MD] adjust mindrecord ut 
Merge pull request !621 from liyong126/mindrecord_ut
 2020-04-24 09:12:32 +08:00
mindspore-ci-bot 928dcf4ec4 !554 Fix derelu fusion pass 
Merge pull request !554 from huanghui/fix_derelu_fusion_pass
 2020-04-23 21:52:55 +08:00
liyong 1f222ddb9e fix mindrecord c ut 2020-04-23 21:48:58 +08:00
huanghui cd6e8d6542 fix ReluV2's mask shape in derelu fusion pass 2020-04-23 21:25:18 +08:00
mindspore-ci-bot 4a3e5cb944 !492 Add AllGather fusion pass 
Merge pull request !492 from YuJianfeng/allgather
 2020-04-23 20:31:12 +08:00
mindspore-ci-bot 54e0fa5c09 !556 [Auto Parallel] use DeviceMemory instead of fixed-size memory check 
Merge pull request !556 from Chong/partition
 2020-04-23 20:03:36 +08:00
YuJianfeng 39945d0f79 Add AllGather fusion pass 2020-04-23 19:05:10 +08:00
ch-l f806b72447 use DeviceMemory for memory control 2020-04-23 17:55:17 +08:00
zhousiyi f6a4f3d155 [static_analysis]: remove the TrivialPrimEvaluator cache. 
add cache for PythonPrimEvaluator. Be careful that
 the infer function of PythonPrimitive in python code should
 be idempotent.
 2020-04-23 09:13:57 +00:00
huanghui 14df771175 fix confusion_softmax_grad_rule pass 2020-04-23 16:45:06 +08:00
chang zherui 3c1785a121 syn code 2020-04-23 14:49:29 +08:00
liubuyu 672244e0ac add keep_bn_fp32 parameter 2020-04-23 11:04:18 +08:00
mindspore-ci-bot 2dabcb9e59 !41 Synchronization code to ms-incubator 
Merge pull request !41 from changzherui/syn-code
 2020-04-23 10:46:02 +08:00
Wei Luning ac25cbae0e Revert "add pattern AdjustAllReduceMulAdd" 
This reverts commit d447364417.
 2020-04-23 10:05:33 +08:00
mindspore-ci-bot d99dfbd83d !390 getnext parallel optimization part III & IV: Loop Control & Stream Dispatch adaptation 
Merge pull request !390 from gukecai/master
 2020-04-21 15:36:44 +08:00
gukecai f8208c7c52 Support GetNext Parallel 2020-04-21 11:39:07 +08:00
liyong f1542a90a3 add pk sampler 2020-04-21 10:08:38 +08:00
mindspore-ci-bot 6369cf27bd !406 added first row crc check for when reading tfrecord files 
Merge pull request !406 from Peilin/first-row-crc-check
 2020-04-21 00:10:18 +08:00
xulei2020 c705ea5e5b add filterOp code 2020-04-20 22:32:19 +08:00
Peilin Wang 9bc2134cb7 added checking of first row crc to find invalid tfrecord files 
addressed code review comments. added check in python layer to exclude directories and to raise an error if a pattern does not match any file

fixed clang format

fixed cppcheck

fixed cppcheck (used std::accumulate and std::copy_if). regenerated tfrecord file to contain correct header, it was a dummy header before

fixed cppcheck: added const reference for string parameter for lambdas, fixed clang format: whitespace adjustments

more clang whitespace fixes...

changed print to logger.info
 2020-04-20 10:25:26 -04:00
mindspore-ci-bot d8176a77f4 !425 New api "TextFileDataset" 
Merge pull request !425 from yanghaitao/yht_textfiledatasetv2
 2020-04-20 22:14:26 +08:00
mindspore-ci-bot 11a4b35caa !472 Fix inputs size and attr for AddN fission pass 
Merge pull request !472 from YuJianfeng/master
 2020-04-20 21:30:52 +08:00
ms_yan c5cfb09e66 Repair some MS_LOG problem 2020-04-20 19:45:46 +08:00
mindspore-ci-bot 679dbd27b3 !478 fix save_graphs_path and log file mode related issues 
Merge pull request !478 from fary86/fix_log_and_ir_issues
 2020-04-20 19:07:38 +08:00
fary86 7e23a1a475 Fix issues of save_graphs_path, Type/Value error message and log file mode 2020-04-20 16:23:40 +08:00
YuJianfeng bc2df2c913 Fix inputs size and attr for AddN fission pass 2020-04-20 15:48:27 +08:00
yanghaitao 2795e492ff TextFileDataset 2020-04-20 11:18:55 +08:00
mindspore-ci-bot 3822b4837f !340 Add a HistogramSummary ops to record tensor value 
Merge pull request !340 from ougongchang/master
 2020-04-20 10:54:04 +08:00
Wei Luning d447364417 add pattern AdjustAllReduceMulAdd 2020-04-18 21:20:15 +08:00
ms_yan f0c07c3fa6 Realize take op and add ut 2020-04-18 18:33:57 +08:00
mindspore-ci-bot 71b63c3fcf !246 [opt pass] AdjustAllReduceMulAdd 
Merge pull request !246 from vlne-v1/I1E3PI-opt-pass-adjust-allreduce-apply-weight-decy-seq
 2020-04-18 18:17:01 +08:00
Wei Luning ea6958c50a add pattern AdjustAllReduceMulAdd 2020-04-18 17:00:55 +08:00
YuJianfeng 5eb5379889 Add AdamApplyOne fusion pass 2020-04-18 10:54:09 +08:00
ougongchang 0ed6d9178e add Histogram summary operator 
clean clang format errors and cpplint errors

add some test cases for histogram summary operator
 2020-04-18 09:56:45 +08:00
jzw 3f7054dccb add skip dataset op 2020-04-17 19:48:25 +08:00
mindspore-ci-bot f69a668d98 !350 change tuple output to make tuple 
Merge pull request !350 from lianliguang/chang-tuple-output-to-make-tuple
 2020-04-17 19:22:41 +08:00
lianliguang 00e4306518 convert all tuple output to maketuple 2020-04-17 17:31:42 +08:00
mindspore-ci-bot f98efafa16 !317 [IRFusion] add derelu_fusion pass 
Merge pull request !317 from huanghui/derelu_fusion_pass
 2020-04-17 16:42:06 +08:00
mindspore-ci-bot cf026096a6 !183 Mindspore.dataset CPP sampler for GeneratorDataset 
Merge pull request !183 from JunhanHu/cpp_sampler
 2020-04-16 22:30:59 +08:00
wenchunjiang ee5f3fa240 add pass to insert memcpy_async for get_next outputs 2020-04-16 14:30:24 +08:00
mindspore-ci-bot 58a70b5f82 !346 getnext parallel optimization part II: Eliminate Memcpy in specify scenario 
Merge pull request !346 from laiyongqiang/develop
 2020-04-15 20:38:42 +08:00
laiyongqiang 3e05f50f5f getnext_memcpy_elimination 2020-04-15 19:38:10 +08:00
yangzhenzhang 6d522f0a4f add parallel op for layernorm 2020-04-15 19:30:07 +08:00
huanghui b02e871c1a [IRFusion] add derelu_fusion pass 2020-04-15 10:20:35 +08:00
Junhan Hu 9739d3b048 Add CPP sampler support for GeneratorDataset 2020-04-14 12:09:03 -04:00
mindspore-ci-bot 30de261c3c !243 Support nested repeat 
Merge pull request !243 from h.farahat/nested_repeat
 2020-04-14 23:07:32 +08:00
hesham 0fc23eee0f Support nested repeat 2020-04-14 10:13:18 -04:00
mindspore-ci-bot b571fabd77 !289 Add cnode mapping after graph match 
Merge pull request !289 from YuJianfeng/find_op
 2020-04-14 18:51:28 +08:00
YuJianfeng e5c67b9088 Add cnode to equal map when opt matching 2020-04-14 17:29:47 +08:00
mindspore-ci-bot 9bda080bb5 !260 refactor padding strategy 
Merge pull request !260 from lianliguang/refactor-padding-strategy
 2020-04-14 15:44:46 +08:00
mindspore-ci-bot 1ab430072e !232 [Auto parallel] Model the memory_cost in cost model 
Merge pull request !232 from Xiaoda/model-memory-cost-in-auto-parallel
 2020-04-14 15:29:04 +08:00
mindspore-ci-bot 94589ce611 !226 expend conv stride and dilation to 2d 
Merge pull request !226 from wangnan39/expend_conv_stride_to_2d
 2020-04-14 14:58:22 +08:00
wangnan39@huawei.com 2604acedcb extend conv stride and dilation to 2d 2020-04-14 13:16:27 +08:00
lianliguang 5d225f934f change the padding strategy & refactor insert transdata 2020-04-14 12:57:40 +08:00
Xiaoda Zhang 0ac50a19f5 Model the memory cost in auto-parallel. It is calculated by the output of operators, plus the parameters. Additionally, modify the graph-operations in auto_parallel to include memory_cost. 2020-04-14 11:39:31 +08:00
mindspore-ci-bot f1fa2a9941 !273 [MD] update subset random sampler in minddataset 
Merge pull request !273 from liyong126/mindrecord_subset_sampler_python
 2020-04-14 11:18:36 +08:00
mindspore-ci-bot 298a32f1e2 !132 Add confusion_mul_grad_fusion pass 
Merge pull request !132 from huanghui/master
 2020-04-13 21:49:06 +08:00
liyong 0ce83e39e1 fix TestShardSampleWrongNumber 
adjust internal api
 2020-04-13 21:31:45 +08:00
mindspore-ci-bot 57f953ca38 !216 Implement addn fusion pass 
Merge pull request !216 from YuJianfeng/master
 2020-04-13 20:49:32 +08:00
huanghui 19ee376cd3 add confusion_mul_grad fusion pass 2020-04-13 19:08:15 +08:00
c00425699 d62f560b50 add_bool_type_check_in_comm_op 2020-04-13 17:34:29 +08:00
YuJianfeng 7307c81f31 implement AddN fission pass 2020-04-13 16:05:45 +08:00
panfengfeng 6a79fc1735 skip mindrecord ut test case 2020-04-13 10:38:54 +08:00
buxue 5841fe010e Support pow's second input could be tensor and fix bug in bprop of pow 2020-04-11 16:16:58 +08:00
yangzhenzhang b34c0e7a17 add parallel op for dropoutdomask 2020-04-11 12:11:22 +08:00
jonyguo a9443635b7 fix: mindpage enhance parameter check and search by filename failed 2020-04-11 10:19:14 +08:00
panfengfeng 53a98210af skip ut test cases temporarily 2020-04-11 09:28:09 +08:00
c00425699 406475160f refactor OperatorCostPtr in OperatorInfo 2020-04-10 19:11:58 +08:00
biffex cc1416bfc2 constant duplicate mul for momentum 2020-04-10 19:11:58 +08:00
kswang a6747c522f add ascend mem pool 2020-04-10 19:10:45 +08:00
yao_yf 513f384c43 fix auto parallel prelu 2020-04-10 19:10:45 +08:00
kswang d84cfb0108 add mem manager 2020-04-10 19:10:45 +08:00
Alexey Shevlyakov 6d1ea7af8e remove make_unique.h 2020-04-10 19:10:45 +08:00
jonyguo 6690a7fd7a fix: error info is not exactly when column list invalid 2020-04-10 19:09:54 +08:00
jojobugfree 89f0b3b1bb profiling feature enhancement 2020-04-10 19:08:25 +08:00
Xiaoda Zhang 7798c85e70 This commit is to separate the computation cost and memory cost in auto_parallel. Some related memory correction is removed. 2020-04-10 19:08:25 +08:00
Jonathan Yan f01098bc12 remove ENABLE_MINDRECORD flag 2020-04-10 19:08:25 +08:00
Alexey Shevlyakov b9701db887 fix RandomCropDecodeResize test 2020-04-10 19:08:25 +08:00
mindspore-ci-bot 268d358a1d !187 refactor OperatorCostPtr in OperatorInfo 
Merge pull request !187 from chentingting/refactor_OperatorCostPtr_in_OperatorInfo
 2020-04-10 09:21:25 +08:00
mindspore-ci-bot 1b3b3b1a1c !198 [opt] momentum duplicate mul constant 
Merge pull request !198 from biffex/momentum-duplicate-mul-constant
 2020-04-10 08:37:41 +08:00
biffex 62bbf560c6 constant duplicate mul for momentum 2020-04-09 22:28:00 +08:00
c00425699 b413638f23 refactor OperatorCostPtr in OperatorInfo 2020-04-09 20:37:52 +08:00
kswang bef62db128 add ascend mem pool 2020-04-09 16:04:59 +08:00
mindspore-ci-bot 2e6e94b2b6 !177 prelu operator support parallel on the channel 
Merge pull request !177 from yao_yf/fix_auto_parallel_prelu
 2020-04-09 14:08:41 +08:00
mindspore-ci-bot 31efc8b088 !172 add mem manager 
Merge pull request !172 from kisnwang/add-resource-manager
 2020-04-09 11:36:33 +08:00
kswang fb343bd607 add mem manager 2020-04-09 10:05:45 +08:00
buxue 1d3bb0b731 Develop op MaxPoolWithArgMax 2020-04-09 09:26:56 +08:00
mindspore-ci-bot cc75cb357c !168 remove mindspore::make_unique and make_unique.h 
Merge pull request !168 from Alexey_Shevlyakov/remove_mindspore_make_unique
 2020-04-09 05:32:52 +08:00
mindspore-ci-bot 3e36982314 !99 Develop op MaxPoolWithArgMax 
Merge pull request !99 from zhangbuxue/Dock_MaxPoolWithArgMax
 2020-04-08 22:40:00 +08:00
mindspore-ci-bot 68f804255f !174 enhance: the error info is not detail when the column list is invalid by MindDataset 
Merge pull request !174 from guozhijian/fix_false_error_info
 2020-04-08 21:52:00 +08:00
buxue 7541d3b067 Develop op MaxPoolWithArgMax 2020-04-08 20:47:49 +08:00
yao_yf b5e3fa9593 fix auto parallel prelu 2020-04-08 20:45:08 +08:00
kingfo cdbef85e5e refactor callback for ge backend 2020-04-08 20:00:06 +08:00
huangdongrun d12a720fc5 add comparison ops 
fix pylint

use scalar_lt primitive directly

fix review
 2020-04-08 20:00:06 +08:00
YuJianfeng 024706f951 Optimize depend edge with make tuple input 2020-04-08 20:00:06 +08:00
Wei Luning b18f634912 remove ge depend in cpu 2020-04-08 20:00:06 +08:00
fary86 73e0bdcd43 Dump graph with type info when static analysis failed 2020-04-08 19:58:13 +08:00
c00425699 c4b03e854c use std::vector instead of std::list to promote performance for parallel module 2020-04-08 19:58:13 +08:00
GinFung 2fd7f67108 Add matmul biasadd fusion pass 2020-04-08 19:58:13 +08:00
Jonathan Yan 295c00ac39 Replace std::cout with MS_LOG in dataset unit test 
Signed-off-by: Jonathan Yan <jonathan.yan1@huawei.com>
 2020-04-08 19:58:13 +08:00
mindspore-ci-bot 2eb71103f9 !82 profiling feature enhancement 
Merge pull request !82 from caifubi/dev-profiling
 2020-04-08 16:22:35 +08:00
jonyguo 20d1b64443 fix: error info is not exactly when column list invalid 2020-04-08 16:11:13 +08:00
jojobugfree effdb483d6 profiling feature enhancement 2020-04-08 15:12:06 +08:00
Xiaoda Zhang a153fad874 This commit is to separate the computation cost and memory cost in auto_parallel. Some related memory correction is removed. 2020-04-08 11:52:19 +08:00
Jonathan Yan 9d0fde29f4 remove ENABLE_MINDRECORD flag 2020-04-07 14:55:45 -04:00
Alexey Shevlyakov 84d780c1a4 remove make_unique.h 2020-04-07 14:00:09 -04:00
mindspore-ci-bot a4b9f8a728 !120 Fix test for RandomCropDecodeResizeOp. 
Merge pull request !120 from Alexey_Shevlyakov/master
 2020-04-07 20:52:45 +08:00
kingfo 3202fc0df9 refactor callback for ge backend 2020-04-07 09:32:54 +08:00
Alexey Shevlyakov d37b8c4f2d fix RandomCropDecodeResize test 2020-04-03 11:13:57 -04:00
mindspore-ci-bot a5d95e472e !106 support comparison ops for python 
Merge pull request !106 from amongo/SupportPythonOperators
 2020-04-03 15:52:08 +08:00
huangdongrun 461d8e3a08 add comparison ops 
fix pylint

use scalar_lt primitive directly

fix review
 2020-04-03 09:58:41 +08:00
mindspore-ci-bot 9be1a01db6 !85 Optimize depend edge with make tuple input 
Merge pull request !85 from YuJianfeng/master
 2020-04-02 22:00:18 +08:00
Wei Luning 73ba399364 remove ge depend in cpu 2020-04-02 19:38:42 +08:00
YuJianfeng 7f53bb062d Optimize depend edge with make tuple input 2020-04-02 11:33:34 +08:00
mindspore-ci-bot 52166a85cf !43 dump graph with type info when analysis failed 
Merge pull request !43 from fary86/dump-typed-graph-when-analyze-fail
 2020-03-31 22:23:02 +08:00
fary86 816b60491d Dump graph with type info when static analysis failed 2020-03-31 21:08:48 +08:00
mindspore-ci-bot da447b8d4d !45 use std::vector instead of std::list to promote performance for parallel module 
Merge pull request !45 from chentingting/permote_auto_prallel_performance
 2020-03-31 18:25:59 +08:00
c00425699 3bb48ffee1 use std::vector instead of std::list to promote performance for parallel module 2020-03-31 15:16:00 +08:00
mindspore-ci-bot 976226f9ac !10 Add matmul biasadd fusion pass 
Merge pull request !10 from YuJianfeng/master
 2020-03-31 14:52:47 +08:00
Jonathan Yan 080bcda021 Replace std::cout with MS_LOG in dataset unit test 
Signed-off-by: Jonathan Yan <jonathan.yan1@huawei.com>
 2020-03-30 11:02:32 -04:00
GinFung 468dbc3557 Add matmul biasadd fusion pass 2020-03-30 10:12:50 +08:00
zhunaipan 930a1fb0a8 initial version 
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
 2020-03-27 22:54:54 +08:00