yystopf
/
mindspore
forked from mindspore-Ecosystem/mindspore
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
45,876 Commits 23 Branches 0 Tags 3.9 GiB
Commit Graph

2085 Commits

Author SHA1 Message Date
Jesse Lee 332398d20a Check return code from WaitPost::Register 2020-04-28 15:19:03 -04:00
yao_yf 6cde5f6d91 auto parallel strategy checkpoint 2020-04-28 15:48:41 +08:00
kswang e6f36e050f change cpu kernel dir 2020-04-27 21:14:03 +08:00
mindspore-ci-bot e537a70808 !657 Fix confusionmulgrad fusion pass cannot work 
Merge pull request !657 from huanghui/fix-confusionmulgrad-fusion-pass
 2020-04-27 11:10:25 +08:00
mindspore-ci-bot 3d9f1087c6 !695 Check topk supported before converting input to attr 
Merge pull request !695 from YuJianfeng/master
 2020-04-26 21:38:43 +08:00
YuJianfeng ce2a13fcda Check topk supported before converting input to attr 2020-04-26 18:40:17 +08:00
mindspore-ci-bot fb5cfe31d5 !430 add buffer fusion bnupdate eltwise pass 
Merge pull request !430 from Etone.Chan/bufferfusion
 2020-04-26 17:40:20 +08:00
Etone.Chan d2727d0504 add buffer fusion bnupdate eltwise pass 2020-04-26 17:17:42 +08:00
huanghui 230e77f923 fix confusionmulgrad fusion pass cannot work 2020-04-26 15:35:25 +08:00
huanghui 9e29224af9 move add_memcpy_async pass and transdata_split pass 2020-04-26 10:48:44 +08:00
Wei Luning f305d6f8a7 Revert "add pattern AdjustAllReduceMulAdd" 
This reverts commit ea6958c50a.
 2020-04-25 19:50:50 +08:00
zhaozhenlong 89f82e1a37 fix cpp ut test TestConvertConvBackpropFilter 2020-04-24 19:04:40 +08:00
mindspore-ci-bot 53d2da5fe4 !264 static_analysis: remove useless cache in TrivialPrimEvaluator and add cache for PythonPrimEvaluator 
Merge pull request !264 from xychow/remove-unnecessary-cache-and-add-cache
 2020-04-24 09:22:33 +08:00
mindspore-ci-bot 2440cea732 !621 [MD] adjust mindrecord ut 
Merge pull request !621 from liyong126/mindrecord_ut
 2020-04-24 09:12:32 +08:00
mindspore-ci-bot 928dcf4ec4 !554 Fix derelu fusion pass 
Merge pull request !554 from huanghui/fix_derelu_fusion_pass
 2020-04-23 21:52:55 +08:00
liyong 1f222ddb9e fix mindrecord c ut 2020-04-23 21:48:58 +08:00
huanghui cd6e8d6542 fix ReluV2's mask shape in derelu fusion pass 2020-04-23 21:25:18 +08:00
mindspore-ci-bot 4a3e5cb944 !492 Add AllGather fusion pass 
Merge pull request !492 from YuJianfeng/allgather
 2020-04-23 20:31:12 +08:00
mindspore-ci-bot 54e0fa5c09 !556 [Auto Parallel] use DeviceMemory instead of fixed-size memory check 
Merge pull request !556 from Chong/partition
 2020-04-23 20:03:36 +08:00
YuJianfeng 39945d0f79 Add AllGather fusion pass 2020-04-23 19:05:10 +08:00
ch-l f806b72447 use DeviceMemory for memory control 2020-04-23 17:55:17 +08:00
zhousiyi f6a4f3d155 [static_analysis]: remove the TrivialPrimEvaluator cache. 
add cache for PythonPrimEvaluator. Be careful that
 the infer function of PythonPrimitive in python code should
 be idempotent.
 2020-04-23 09:13:57 +00:00
huanghui 14df771175 fix confusion_softmax_grad_rule pass 2020-04-23 16:45:06 +08:00
chang zherui 3c1785a121 syn code 2020-04-23 14:49:29 +08:00
liubuyu 672244e0ac add keep_bn_fp32 parameter 2020-04-23 11:04:18 +08:00
mindspore-ci-bot 2dabcb9e59 !41 Synchronization code to ms-incubator 
Merge pull request !41 from changzherui/syn-code
 2020-04-23 10:46:02 +08:00
Wei Luning ac25cbae0e Revert "add pattern AdjustAllReduceMulAdd" 
This reverts commit d447364417.
 2020-04-23 10:05:33 +08:00
mindspore-ci-bot d99dfbd83d !390 getnext parallel optimization part III & IV: Loop Control & Stream Dispatch adaptation 
Merge pull request !390 from gukecai/master
 2020-04-21 15:36:44 +08:00
gukecai f8208c7c52 Support GetNext Parallel 2020-04-21 11:39:07 +08:00
liyong f1542a90a3 add pk sampler 2020-04-21 10:08:38 +08:00
mindspore-ci-bot 6369cf27bd !406 added first row crc check for when reading tfrecord files 
Merge pull request !406 from Peilin/first-row-crc-check
 2020-04-21 00:10:18 +08:00
xulei2020 c705ea5e5b add filterOp code 2020-04-20 22:32:19 +08:00
Peilin Wang 9bc2134cb7 added checking of first row crc to find invalid tfrecord files 
addressed code review comments. added check in python layer to exclude directories and to raise an error if a pattern does not match any file

fixed clang format

fixed cppcheck

fixed cppcheck (used std::accumulate and std::copy_if). regenerated tfrecord file to contain correct header, it was a dummy header before

fixed cppcheck: added const reference for string parameter for lambdas, fixed clang format: whitespace adjustments

more clang whitespace fixes...

changed print to logger.info
 2020-04-20 10:25:26 -04:00
mindspore-ci-bot d8176a77f4 !425 New api "TextFileDataset" 
Merge pull request !425 from yanghaitao/yht_textfiledatasetv2
 2020-04-20 22:14:26 +08:00
mindspore-ci-bot 11a4b35caa !472 Fix inputs size and attr for AddN fission pass 
Merge pull request !472 from YuJianfeng/master
 2020-04-20 21:30:52 +08:00
ms_yan c5cfb09e66 Repair some MS_LOG problem 2020-04-20 19:45:46 +08:00
mindspore-ci-bot 679dbd27b3 !478 fix save_graphs_path and log file mode related issues 
Merge pull request !478 from fary86/fix_log_and_ir_issues
 2020-04-20 19:07:38 +08:00
fary86 7e23a1a475 Fix issues of save_graphs_path, Type/Value error message and log file mode 2020-04-20 16:23:40 +08:00
YuJianfeng bc2df2c913 Fix inputs size and attr for AddN fission pass 2020-04-20 15:48:27 +08:00
yanghaitao 2795e492ff TextFileDataset 2020-04-20 11:18:55 +08:00
mindspore-ci-bot 3822b4837f !340 Add a HistogramSummary ops to record tensor value 
Merge pull request !340 from ougongchang/master
 2020-04-20 10:54:04 +08:00
Wei Luning d447364417 add pattern AdjustAllReduceMulAdd 2020-04-18 21:20:15 +08:00
ms_yan f0c07c3fa6 Realize take op and add ut 2020-04-18 18:33:57 +08:00
mindspore-ci-bot 71b63c3fcf !246 [opt pass] AdjustAllReduceMulAdd 
Merge pull request !246 from vlne-v1/I1E3PI-opt-pass-adjust-allreduce-apply-weight-decy-seq
 2020-04-18 18:17:01 +08:00
Wei Luning ea6958c50a add pattern AdjustAllReduceMulAdd 2020-04-18 17:00:55 +08:00
YuJianfeng 5eb5379889 Add AdamApplyOne fusion pass 2020-04-18 10:54:09 +08:00
ougongchang 0ed6d9178e add Histogram summary operator 
clean clang format errors and cpplint errors

add some test cases for histogram summary operator
 2020-04-18 09:56:45 +08:00
jzw 3f7054dccb add skip dataset op 2020-04-17 19:48:25 +08:00
mindspore-ci-bot f69a668d98 !350 change tuple output to make tuple 
Merge pull request !350 from lianliguang/chang-tuple-output-to-make-tuple
 2020-04-17 19:22:41 +08:00
lianliguang 00e4306518 convert all tuple output to maketuple 2020-04-17 17:31:42 +08:00
mindspore-ci-bot f98efafa16 !317 [IRFusion] add derelu_fusion pass 
Merge pull request !317 from huanghui/derelu_fusion_pass
 2020-04-17 16:42:06 +08:00
mindspore-ci-bot cf026096a6 !183 Mindspore.dataset CPP sampler for GeneratorDataset 
Merge pull request !183 from JunhanHu/cpp_sampler
 2020-04-16 22:30:59 +08:00
wenchunjiang ee5f3fa240 add pass to insert memcpy_async for get_next outputs 2020-04-16 14:30:24 +08:00
mindspore-ci-bot 58a70b5f82 !346 getnext parallel optimization part II: Eliminate Memcpy in specify scenario 
Merge pull request !346 from laiyongqiang/develop
 2020-04-15 20:38:42 +08:00
laiyongqiang 3e05f50f5f getnext_memcpy_elimination 2020-04-15 19:38:10 +08:00
yangzhenzhang 6d522f0a4f add parallel op for layernorm 2020-04-15 19:30:07 +08:00
huanghui b02e871c1a [IRFusion] add derelu_fusion pass 2020-04-15 10:20:35 +08:00
Junhan Hu 9739d3b048 Add CPP sampler support for GeneratorDataset 2020-04-14 12:09:03 -04:00
mindspore-ci-bot 30de261c3c !243 Support nested repeat 
Merge pull request !243 from h.farahat/nested_repeat
 2020-04-14 23:07:32 +08:00
hesham 0fc23eee0f Support nested repeat 2020-04-14 10:13:18 -04:00
mindspore-ci-bot b571fabd77 !289 Add cnode mapping after graph match 
Merge pull request !289 from YuJianfeng/find_op
 2020-04-14 18:51:28 +08:00
YuJianfeng e5c67b9088 Add cnode to equal map when opt matching 2020-04-14 17:29:47 +08:00
mindspore-ci-bot 9bda080bb5 !260 refactor padding strategy 
Merge pull request !260 from lianliguang/refactor-padding-strategy
 2020-04-14 15:44:46 +08:00
mindspore-ci-bot 1ab430072e !232 [Auto parallel] Model the memory_cost in cost model 
Merge pull request !232 from Xiaoda/model-memory-cost-in-auto-parallel
 2020-04-14 15:29:04 +08:00
mindspore-ci-bot 94589ce611 !226 expend conv stride and dilation to 2d 
Merge pull request !226 from wangnan39/expend_conv_stride_to_2d
 2020-04-14 14:58:22 +08:00
wangnan39@huawei.com 2604acedcb extend conv stride and dilation to 2d 2020-04-14 13:16:27 +08:00
lianliguang 5d225f934f change the padding strategy & refactor insert transdata 2020-04-14 12:57:40 +08:00
Xiaoda Zhang 0ac50a19f5 Model the memory cost in auto-parallel. It is calculated by the output of operators, plus the parameters. Additionally, modify the graph-operations in auto_parallel to include memory_cost. 2020-04-14 11:39:31 +08:00
mindspore-ci-bot f1fa2a9941 !273 [MD] update subset random sampler in minddataset 
Merge pull request !273 from liyong126/mindrecord_subset_sampler_python
 2020-04-14 11:18:36 +08:00
mindspore-ci-bot 298a32f1e2 !132 Add confusion_mul_grad_fusion pass 
Merge pull request !132 from huanghui/master
 2020-04-13 21:49:06 +08:00
liyong 0ce83e39e1 fix TestShardSampleWrongNumber 
adjust internal api
 2020-04-13 21:31:45 +08:00
mindspore-ci-bot 57f953ca38 !216 Implement addn fusion pass 
Merge pull request !216 from YuJianfeng/master
 2020-04-13 20:49:32 +08:00
huanghui 19ee376cd3 add confusion_mul_grad fusion pass 2020-04-13 19:08:15 +08:00
c00425699 d62f560b50 add_bool_type_check_in_comm_op 2020-04-13 17:34:29 +08:00
YuJianfeng 7307c81f31 implement AddN fission pass 2020-04-13 16:05:45 +08:00
panfengfeng 6a79fc1735 skip mindrecord ut test case 2020-04-13 10:38:54 +08:00
buxue 5841fe010e Support pow's second input could be tensor and fix bug in bprop of pow 2020-04-11 16:16:58 +08:00
yangzhenzhang b34c0e7a17 add parallel op for dropoutdomask 2020-04-11 12:11:22 +08:00
jonyguo a9443635b7 fix: mindpage enhance parameter check and search by filename failed 2020-04-11 10:19:14 +08:00
panfengfeng 53a98210af skip ut test cases temporarily 2020-04-11 09:28:09 +08:00
c00425699 406475160f refactor OperatorCostPtr in OperatorInfo 2020-04-10 19:11:58 +08:00
biffex cc1416bfc2 constant duplicate mul for momentum 2020-04-10 19:11:58 +08:00
kswang a6747c522f add ascend mem pool 2020-04-10 19:10:45 +08:00
yao_yf 513f384c43 fix auto parallel prelu 2020-04-10 19:10:45 +08:00
kswang d84cfb0108 add mem manager 2020-04-10 19:10:45 +08:00
Alexey Shevlyakov 6d1ea7af8e remove make_unique.h 2020-04-10 19:10:45 +08:00
jonyguo 6690a7fd7a fix: error info is not exactly when column list invalid 2020-04-10 19:09:54 +08:00
jojobugfree 89f0b3b1bb profiling feature enhancement 2020-04-10 19:08:25 +08:00
Xiaoda Zhang 7798c85e70 This commit is to separate the computation cost and memory cost in auto_parallel. Some related memory correction is removed. 2020-04-10 19:08:25 +08:00
Jonathan Yan f01098bc12 remove ENABLE_MINDRECORD flag 2020-04-10 19:08:25 +08:00
Alexey Shevlyakov b9701db887 fix RandomCropDecodeResize test 2020-04-10 19:08:25 +08:00
mindspore-ci-bot 268d358a1d !187 refactor OperatorCostPtr in OperatorInfo 
Merge pull request !187 from chentingting/refactor_OperatorCostPtr_in_OperatorInfo
 2020-04-10 09:21:25 +08:00
mindspore-ci-bot 1b3b3b1a1c !198 [opt] momentum duplicate mul constant 
Merge pull request !198 from biffex/momentum-duplicate-mul-constant
 2020-04-10 08:37:41 +08:00
biffex 62bbf560c6 constant duplicate mul for momentum 2020-04-09 22:28:00 +08:00
c00425699 b413638f23 refactor OperatorCostPtr in OperatorInfo 2020-04-09 20:37:52 +08:00
kswang bef62db128 add ascend mem pool 2020-04-09 16:04:59 +08:00
mindspore-ci-bot 2e6e94b2b6 !177 prelu operator support parallel on the channel 
Merge pull request !177 from yao_yf/fix_auto_parallel_prelu
 2020-04-09 14:08:41 +08:00
mindspore-ci-bot 31efc8b088 !172 add mem manager 
Merge pull request !172 from kisnwang/add-resource-manager
 2020-04-09 11:36:33 +08:00
kswang fb343bd607 add mem manager 2020-04-09 10:05:45 +08:00
buxue 1d3bb0b731 Develop op MaxPoolWithArgMax 2020-04-09 09:26:56 +08:00
mindspore-ci-bot cc75cb357c !168 remove mindspore::make_unique and make_unique.h 
Merge pull request !168 from Alexey_Shevlyakov/remove_mindspore_make_unique
 2020-04-09 05:32:52 +08:00
mindspore-ci-bot 3e36982314 !99 Develop op MaxPoolWithArgMax 
Merge pull request !99 from zhangbuxue/Dock_MaxPoolWithArgMax
 2020-04-08 22:40:00 +08:00
mindspore-ci-bot 68f804255f !174 enhance: the error info is not detail when the column list is invalid by MindDataset 
Merge pull request !174 from guozhijian/fix_false_error_info
 2020-04-08 21:52:00 +08:00
buxue 7541d3b067 Develop op MaxPoolWithArgMax 2020-04-08 20:47:49 +08:00
yao_yf b5e3fa9593 fix auto parallel prelu 2020-04-08 20:45:08 +08:00
kingfo cdbef85e5e refactor callback for ge backend 2020-04-08 20:00:06 +08:00
huangdongrun d12a720fc5 add comparison ops 
fix pylint

use scalar_lt primitive directly

fix review
 2020-04-08 20:00:06 +08:00
YuJianfeng 024706f951 Optimize depend edge with make tuple input 2020-04-08 20:00:06 +08:00
Wei Luning b18f634912 remove ge depend in cpu 2020-04-08 20:00:06 +08:00
fary86 73e0bdcd43 Dump graph with type info when static analysis failed 2020-04-08 19:58:13 +08:00
c00425699 c4b03e854c use std::vector instead of std::list to promote performance for parallel module 2020-04-08 19:58:13 +08:00
GinFung 2fd7f67108 Add matmul biasadd fusion pass 2020-04-08 19:58:13 +08:00
Jonathan Yan 295c00ac39 Replace std::cout with MS_LOG in dataset unit test 
Signed-off-by: Jonathan Yan <jonathan.yan1@huawei.com>
 2020-04-08 19:58:13 +08:00
mindspore-ci-bot 2eb71103f9 !82 profiling feature enhancement 
Merge pull request !82 from caifubi/dev-profiling
 2020-04-08 16:22:35 +08:00
jonyguo 20d1b64443 fix: error info is not exactly when column list invalid 2020-04-08 16:11:13 +08:00
jojobugfree effdb483d6 profiling feature enhancement 2020-04-08 15:12:06 +08:00
Xiaoda Zhang a153fad874 This commit is to separate the computation cost and memory cost in auto_parallel. Some related memory correction is removed. 2020-04-08 11:52:19 +08:00
Jonathan Yan 9d0fde29f4 remove ENABLE_MINDRECORD flag 2020-04-07 14:55:45 -04:00
Alexey Shevlyakov 84d780c1a4 remove make_unique.h 2020-04-07 14:00:09 -04:00
mindspore-ci-bot a4b9f8a728 !120 Fix test for RandomCropDecodeResizeOp. 
Merge pull request !120 from Alexey_Shevlyakov/master
 2020-04-07 20:52:45 +08:00
kingfo 3202fc0df9 refactor callback for ge backend 2020-04-07 09:32:54 +08:00
Alexey Shevlyakov d37b8c4f2d fix RandomCropDecodeResize test 2020-04-03 11:13:57 -04:00
mindspore-ci-bot a5d95e472e !106 support comparison ops for python 
Merge pull request !106 from amongo/SupportPythonOperators
 2020-04-03 15:52:08 +08:00
huangdongrun 461d8e3a08 add comparison ops 
fix pylint

use scalar_lt primitive directly

fix review
 2020-04-03 09:58:41 +08:00
mindspore-ci-bot 9be1a01db6 !85 Optimize depend edge with make tuple input 
Merge pull request !85 from YuJianfeng/master
 2020-04-02 22:00:18 +08:00
Wei Luning 73ba399364 remove ge depend in cpu 2020-04-02 19:38:42 +08:00
YuJianfeng 7f53bb062d Optimize depend edge with make tuple input 2020-04-02 11:33:34 +08:00
mindspore-ci-bot 52166a85cf !43 dump graph with type info when analysis failed 
Merge pull request !43 from fary86/dump-typed-graph-when-analyze-fail
 2020-03-31 22:23:02 +08:00
fary86 816b60491d Dump graph with type info when static analysis failed 2020-03-31 21:08:48 +08:00
mindspore-ci-bot da447b8d4d !45 use std::vector instead of std::list to promote performance for parallel module 
Merge pull request !45 from chentingting/permote_auto_prallel_performance
 2020-03-31 18:25:59 +08:00
c00425699 3bb48ffee1 use std::vector instead of std::list to promote performance for parallel module 2020-03-31 15:16:00 +08:00
mindspore-ci-bot 976226f9ac !10 Add matmul biasadd fusion pass 
Merge pull request !10 from YuJianfeng/master
 2020-03-31 14:52:47 +08:00
Jonathan Yan 080bcda021 Replace std::cout with MS_LOG in dataset unit test 
Signed-off-by: Jonathan Yan <jonathan.yan1@huawei.com>
 2020-03-30 11:02:32 -04:00
GinFung 468dbc3557 Add matmul biasadd fusion pass 2020-03-30 10:12:50 +08:00
zhunaipan 930a1fb0a8 initial version 
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
 2020-03-27 22:54:54 +08:00