yystopf
/
mindspore
forked from mindspore-Ecosystem/mindspore
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
45,876 Commits 23 Branches 0 Tags 3.9 GiB
Commit Graph

2085 Commits

Author SHA1 Message Date
Jesse Lee 7c1bc5192b Initial Drop of CacheOp Phase I 2020-07-13 10:18:53 -04:00
WilliamLian 9682d08d96 refactor primitive hook function 2020-07-13 17:27:39 +08:00
caifubi c577952c9a Async Data Dump 2020-07-13 09:42:37 +08:00
mindspore-ci-bot 65c6e54e2e !2773 Adding cpp_api 
Merge pull request !2773 from 章一智/cpp_api
 2020-07-11 18:58:42 +08:00
ZPaC 8273c2a39c Add ps optimizer info builder. 2020-07-11 16:07:09 +08:00
mindspore-ci-bot 2e45aa6c19 !3014 Add ps optimizer info 
Merge pull request !3014 from ZPaC/add-ps-optim-info
 2020-07-11 14:38:52 +08:00
mindspore-ci-bot 6284c42a76 !2941 MD tokenizer support output offsets 
Merge pull request !2941 from xiefangqi/md_add_offsets_feature
 2020-07-11 14:36:00 +08:00
ZPaC 272e397be7 Add ps optimizer info. 2020-07-11 11:31:58 +08:00
xiefangqi 47060631e5 add offsets feature to tokenizer 2020-07-11 11:20:02 +08:00
ervinzhang bd5a777f81 introducing new C++ API 2020-07-10 16:32:38 -04:00
panbingao 45dbc8bf04 Move model_zoo.resnet.py 2020-07-10 17:36:34 +08:00
heleiwang 7a046a1d70 support get_edge_feature 2020-07-10 17:05:23 +08:00
huanghui 3eaf663545 add tensor scatter update fission pass 2020-07-10 15:41:22 +08:00
mindspore-ci-bot c8d7ac13aa !2976 Add input infos to output for apply op to match the tbe registered info 
Merge pull request !2976 from YuJianfeng/input2output
 2020-07-10 11:56:16 +08:00
mindspore-ci-bot b5e8e2419e !2923 Update arithmetic simplify to use Pattern Matcher 
Merge pull request !2923 from Giancarlo/update_arith_simplify
 2020-07-10 09:36:19 +08:00
mindspore-ci-bot 5f468b65b6 !2798 Decouple ParamValue from python 
Merge pull request !2798 from hewei/decouple_param_value
 2020-07-10 09:33:17 +08:00
mindspore-ci-bot 2c3c204b14 !2982 supporting cpp unit tests for randomresizewithbbox and resizewithbbox 
Merge pull request !2982 from ava/CPP_test3
 2020-07-10 04:56:36 +08:00
mindspore-ci-bot 02e797d130 !2947 CPP UTs for 3 BBoxAugOps + Fix to image_util.cc 
Merge pull request !2947 from danishnxt/AugOps-testing
 2020-07-10 03:31:52 +08:00
avakh b2bfb0342b supporting cpp unit tests for random_resize_with_bbox_op and resize_with_bbox_op. 2020-07-09 14:36:32 -04:00
Danish Farid 506f8f134e fix, cpp ut's 
fix cmakefile

fixed log statments in cpp UT tests
 2020-07-09 11:32:13 -04:00
yujianfeng 24f6b9d77e Add input2output pass 2020-07-09 21:44:43 +08:00
mindspore-ci-bot b23fc4e492 !2938 Decouple the exception routines from Python. 
Merge pull request !2938 from ZhangQinghua/master
 2020-07-09 21:10:02 +08:00
He Wei f337c6bc14 Decouple ParamValue from python 2020-07-09 16:16:22 +08:00
ZPaC 4645a43e08 Add ps module in batches 2020-07-09 15:45:56 +08:00
wuyongkang 4b2b46679a Revert "Optimization for ApplyTransform function" 
This reverts commit 02dd305bb0.
 2020-07-09 11:27:30 +08:00
Zhang Qinghua bde889ffdf Decouple the exception routines from Python. 2020-07-09 11:19:16 +08:00
mindspore-ci-bot 5355deca04 !2946 Added empty tensor support 
Merge pull request !2946 from EricZ/emtpy-tensor
 2020-07-09 09:38:32 +08:00
mindspore-ci-bot 3cc9217f06 !2926 [Dataset C++ UT] Implement C++ UTs for RandomHorizontalFlipWithBBox and BoundingBoxAugment 
Merge pull request !2926 from islam_amin/object_ops_cc_ut_floats
 2020-07-09 05:56:46 +08:00
Eric 79445012bd Tensor ut works 
new test case

Name change for empty check
 2020-07-08 17:28:59 -04:00
Giancarlo Colmenares 7f759c2a4c Updated arithmetic simplify to use Pattern Matcher 2020-07-08 16:01:04 -04:00
mindspore-ci-bot 915ddd25dd !2892 gnn random walk pr 1977 comment follow up 
Merge pull request !2892 from tony_liu2/master
 2020-07-09 03:35:55 +08:00
islam_amin 284cc910d5 C++ UTs for RandomHorizontalFlipWithBBox and Bounding Box Augment 2020-07-08 14:36:27 -04:00
yanghaoran 9ce5c97204 synchronize Ascend software suite 07 Jul 2020 2020-07-08 21:49:09 +08:00
mindspore-ci-bot e26746ad18 !2816 Optimization for ApplyTransform function 
Merge pull request !2816 from Kang/optimization
 2020-07-08 09:10:36 +08:00
tony_liu2 14899a1410 fix gnn random walk pr 1977 comments 
add fix to random resize decode crop test case

fix pylint issues
 2020-07-07 17:32:08 -04:00
mindspore-ci-bot 9ba937b1af !2920 Updating 3 BBox AugOps for Float + Common Files for BBox Float Support - (VertFlip/RandomCrop/RandomResizeCrop) 
Merge pull request !2920 from danishnxt/AugOps-M1-Python
 2020-07-08 05:18:58 +08:00
mindspore-ci-bot 6d946b6a19 !2890 Fix for Alexey's testcase 
Merge pull request !2890 from JesseKLee/queue_perf
 2020-07-08 03:21:50 +08:00
Danish Farid 78c370f72a First Commit - New Infrastructure - Python UT tests + Common Aug Files 
fix accidental change overwrite

fix 2

updated inits from 0 to 0.0 for float

improvd python ut comments

updated macro
 2020-07-07 14:50:34 -04:00
wuyongkang 02dd305bb0 Optimization for ApplyTransform function 2020-07-07 21:15:59 +08:00
kswang a719a9fe3a add two level reduce sparse gradient 2020-07-07 15:40:45 +08:00
Jesse Lee e0ef91a676 Fix Queue::Reset 2020-07-06 11:36:14 -04:00
mindspore-ci-bot f42e36b629 !2845 Fix empty graph dump ir failed 
Merge pull request !2845 from zhoufeng/empty-graph-dump-ir
 2020-07-04 15:49:57 +08:00
zhoufeng 1f8b00dff2 Fix empty graph dump ir 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2020-07-04 14:26:52 +08:00
mindspore-ci-bot 34fadfad31 !2774 fix perf_data test 
Merge pull request !2774 from Alexey_Shevlyakov/fix_perf_data_test
 2020-07-04 03:20:26 +08:00
zhousiyi b29d260be3 reuse AddN primitive in opt as AddN will replicated by program_specialize 2020-07-03 03:18:25 +00:00
ale 383564c417 fix perf_data test 2020-07-02 13:24:45 -04:00
mindspore-ci-bot 709dfd7e81 !2738 [Dataset C++ UT] Implement C++ UT common class for object detection tests. 
Merge pull request !2738 from islam_amin/object_ops_ut_cc
 2020-07-03 01:23:50 +08:00
islam_amin 593ee1eb34 C++ UT common files for object detection tests 2020-06-30 17:54:35 -04:00
panyifeng d6635bbbe2 Add IndexedSlices 2020-06-30 17:38:24 +08:00
Eric 88bb65768e Clean up part 1 
Removed extra fields in schema

Fixed test cases

Fixing CI
 2020-06-29 15:57:53 -04:00
Alexey Shevlyakov 71cede8173 remove de_error.h 2020-06-29 14:01:50 -04:00
mindspore-ci-bot 9b4399480a !2321 Connector throughput performance metric 
Merge pull request !2321 from Alexey_Shevlyakov/connector_throughput_dev
 2020-06-29 23:54:42 +08:00
jonyguo 41d16a3c77 enhance: 1. fix api comment, 2. del dead code 2020-06-29 17:15:44 +08:00
mindspore-ci-bot 1a78794947 !2680 Add ut for cpu kernel implement of sparse optimizer 
Merge pull request !2680 from YuJianfeng/ut
 2020-06-29 11:36:00 +08:00
yujianfeng 91306cbd34 Add ut for cpu kernel of sparse optimizer 2020-06-28 21:12:08 +08:00
wuyongkang e606068585 cache bprop instead of fprop 2020-06-28 14:57:54 +08:00
mindspore-ci-bot 262e4fc041 !2585 Replace TransformFuncType with OptimizerCaller 
Merge pull request !2585 from Giancarlo/remove_transformfunc
 2020-06-28 10:12:18 +08:00
Ziyan 0925e35252 enable optimizer parallel with broadcast 2020-06-27 14:36:17 +08:00
Alexey Shevlyakov 698abf75fc Connector throughput + PerfData + CyclicArray 2020-06-26 14:45:01 -04:00
Jesse Lee 81bf4bde1d AutoIndexObj primary should start with 0 2020-06-26 12:22:44 -04:00
Jamie Nisbet c22eac743d subtree creation in python apis 
updates

fix

fix cpplint

fix
 2020-06-24 17:17:05 -04:00
Giancarlo Colmenares aabec55c79 Removing TransformFuncType 2020-06-24 13:48:57 -04:00
mindspore-ci-bot d9b1825552 !2374 C++ UT for CutOut and Pad 
Merge pull request !2374 from MahdiRahmaniHanzaki/I1L892-pad-cutout-ut
 2020-06-24 22:56:17 +08:00
mindspore-ci-bot 044b214636 !2490 assign hcom op to one stream 
Merge pull request !2490 from gukecai/new-stream-for-commit
 2020-06-24 17:44:34 +08:00
ms_yan e829535a86 change GetTensor into GetRow to avoid NullPtr 2020-06-24 15:07:32 +08:00
He Wei 43e0967024 Decouple ir::Tensor class from python 2020-06-24 10:28:59 +08:00
mindspore-ci-bot ea4800050b !2503 fix misspell and check parameters on graphdata 
Merge pull request !2503 from heleiwang/fix_misspell
 2020-06-24 09:15:33 +08:00
gukecai c703c4d7c8 hcom one stream 2020-06-24 08:59:36 +08:00
heleiwang 0d52888fc5 fix misspell and check parameters 2020-06-23 22:01:36 +08:00
Mahdi bca037e1be added cpp test cases for pad and cut out 2020-06-23 09:55:01 -04:00
zhousiyi b2ec296f99 add opt pass for tuple_getitem with constant input 2020-06-23 07:41:21 +00:00
Shida He 4c056855e0 Implementation for mindspore debugger 2020-06-22 17:15:30 -04:00
gong chen a6dfa281ea Init GraphKernel. 
- It provides a unified style to express graph and kernel for user.
- It provides a unified IR to represent graph and kernel for developer.
- It breaks the boundary between graph and kernel.
- It provides more opportunities to do compile optimization.
 2020-06-20 22:31:54 +08:00
mindspore-ci-bot a3e7b30457 !2384 Add split fission pass 
Merge pull request !2384 from YuJianfeng/split
 2020-06-20 18:11:02 +08:00
mindspore-ci-bot 616cc80d78 !2378 fix tensor id bug and some yolov3 bug 
Merge pull request !2378 from flywind/fix_yolov3_bug
 2020-06-20 17:46:47 +08:00
mindspore-ci-bot 53654f94f2 !2056 Enable new control sink 
Merge pull request !2056 from zhoufeng/enable-new-control-sink
 2020-06-20 17:41:30 +08:00
kpy b79523a994 fix yolov3 multi getitem bug and tensor ptr not unique bug 2020-06-20 17:35:15 +08:00
mindspore-ci-bot 8a913d7586 !2157 mindspore server inference 
Merge pull request !2157 from hangq/master
 2020-06-20 16:22:15 +08:00
zhoufeng bbbfaa2441 enable new control sink 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2020-06-20 14:48:21 +08:00
yujianfeng 7ad877a948 Add Split fission pass 2020-06-20 14:28:25 +08:00
hangangqiang dfbb232468 mindspore server inference 2020-06-20 14:12:56 +08:00
ms_yan cf82aa9035 init remove storage op in c++ 
init remove storage op test case c++

remove source c++ files
 2020-06-20 13:52:07 +08:00
mindspore-ci-bot 182215e060 !2284 Add Pass to Eliminate Redundant Depend 
Merge pull request !2284 from BowenK/fix_depend
 2020-06-19 16:39:55 +08:00
mindspore-ci-bot b6ff27245f !1990 fix profiling stream id 
Merge pull request !1990 from caifubi/fix-profiling-stream-id
 2020-06-19 16:36:34 +08:00
BowenK 8f29e7242f add pass to eliminate depend value 2020-06-19 14:52:52 +08:00
caifubi a49c6f0b13 Fix profiling stream id bug 2020-06-19 14:34:20 +08:00
huanghui c7bda5363d fix ConfusionSoftmaxGrad fusion pass work if the ReduceSum's attr of keep_dims set False 2020-06-19 10:37:15 +08:00
hesham 11826fb256 DuplicateOp 2020-06-18 19:47:27 -04:00
nhussain 5515016dba remove graphengine changes 
remove graphengine changes

concat op

Truncate Pair

concat_op

remove graph engine changes
 2020-06-18 17:17:50 -04:00
mindspore-ci-bot ffc8a3c362 !2274 add PadEndOp 
Merge pull request !2274 from xunxue/padend
 2020-06-19 05:05:14 +08:00
mindspore-ci-bot e4322baece !2316 [Dataset] Move python tree transformation into cpp pass 
Merge pull request !2316 from JunhanHu/alter_node_cpp
 2020-06-19 05:02:03 +08:00
xunxue 87aa9c8f7a PadEndOp 2020-06-18 16:07:34 -04:00
Junhan Hu 57f3732ac3 Move python tree transformation into cpp pass. 2020-06-18 15:52:38 -04:00
mindspore-ci-bot 5850b99161 !2211 Add TruncatePair Op to dataset 
Merge pull request !2211 from h.farahat/pair_truncate
 2020-06-18 20:58:40 +08:00
hesham b9495a9ccc Truncate Pair 2020-06-17 23:11:27 -04:00
mindspore-ci-bot 9ba6f61d01 !2148 fix hook and bprop debug issue in pynative 
Merge pull request !2148 from wangqiuliang/fix-hook-bprop-issue
 2020-06-18 10:44:45 +08:00
mindspore-ci-bot 294449697a !2179 Add sort by index for each group of AllReduce 
Merge pull request !2179 from YuJianfeng/all_reduce_index
 2020-06-18 10:35:48 +08:00
kingfo 358982a98f fix hook and bprop debug issue 2020-06-18 09:50:30 +08:00
yujianfeng f15cb6b7c9 Add sort by index for each group of AllReduce 2020-06-18 09:18:01 +08:00
mindspore-ci-bot a4048e192c !2256 Rename Sampler::Reset() to Sampler::ResetSampler() 
Merge pull request !2256 from JesseKLee/sampler
 2020-06-18 03:33:53 +08:00
mindspore-ci-bot ea829e89c3 !2198 Add MaskOp to dataset 
Merge pull request !2198 from h.farahat/mask_op
 2020-06-18 02:50:16 +08:00
Jesse Lee dcfdff6021 Rename Sampler Reset 2020-06-17 14:43:45 -04:00
mindspore-ci-bot 2865436fee !2092 Tokenizers 
Merge pull request !2092 from qianlong21st/june_third
 2020-06-17 21:40:32 +08:00
mindspore-ci-bot 4b5cbe5d4a !2186 Optimization for opt 
Merge pull request !2186 from Kang/opt
 2020-06-17 17:29:38 +08:00
mindspore-ci-bot 65f2212fd3 !2215 Support hccl profiling 
Merge pull request !2215 from caifubi/support-hccl-profiling
 2020-06-17 17:01:10 +08:00
Kang 2974b906d3 Optimization for opt 2020-06-17 16:04:54 +08:00
qianlong 4f16f036be Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp 
add CaseFold, NormalizeUTF8

add RegexReplace

add RegexTokenizer

add BasicTokenizer

add WordpieceTokenizer

add BertTokenizer
 2020-06-17 15:47:04 +08:00
caifubi 5db0d8129c Support hccl profiling 2020-06-17 15:14:30 +08:00
hesham f2462bb00d Mask Op 2020-06-16 23:51:46 -04:00
mindspore-ci-bot 625f2421b5 !1977 random walk in gnn node2vec 
Merge pull request !1977 from JonathanY/randomwalk
 2020-06-17 03:22:21 +08:00
mindspore-ci-bot a1f194c971 !2188 Remove B+ tree deadcode and add an additional output to Search function 
Merge pull request !2188 from JesseKLee/deadcode
 2020-06-17 01:53:01 +08:00
Jesse Lee 287ca71260 Remove dead code 2020-06-16 11:46:30 -04:00
hesham e2012a1de9 Slice Op 2020-06-16 02:32:40 -04:00
mindspore-ci-bot cb706951c1 !2126 Refactoring the func graph manager module. 
Merge pull request !2126 from ZhangQinghua/master
 2020-06-16 09:17:15 +08:00
mindspore-ci-bot dceb3c2be4 !2026 Change C++ behavior in RandomCropAndResize 
Merge pull request !2026 from MahdiRahmaniHanzaki/I1K3FL-random-resized-crop
 2020-06-16 05:27:36 +08:00
Mahdi add29f95f5 resolved issues in the comments 2020-06-15 16:45:18 -04:00
mindspore-ci-bot 2cab44a637 !2028 FillOp for BERT 
Merge pull request !2028 from nhussain/fillOp_learning
 2020-06-16 02:45:45 +08:00
nhussain dd9bf09f0a added FillOp for #119 - special Ops 2020-06-15 11:30:43 -04:00
Jonathan Yan 87d2c27c7f random walk v1 2020-06-15 08:54:10 -04:00
mindspore-ci-bot 971f10d222 !1790 remove transdata only connected with control depend 
Merge pull request !1790 from lianliguang/remove-the-useless-transdata-connected-with-the-control-depend
 2020-06-15 16:59:33 +08:00
mindspore-ci-bot 928c25ebea !2047 [Code review] check code files in pre_activate/ascend/buffer_fusion 
Merge pull request !2047 from huanghui/code-review
 2020-06-15 16:23:24 +08:00
Zhang Qinghua 923d3fee04 Refactoring the fg manager module. 2020-06-15 15:47:39 +08:00
WilliamLian b86016a26f remove the useless transdata and cast of control depend node 2020-06-15 14:54:47 +08:00
mindspore-ci-bot a8cf83acf2 !1932 Add CLUE dataset 
Merge pull request !1932 from jiangzhiwen/dataset/clue
 2020-06-15 11:48:35 +08:00
jiangzhiwen e0e167a000 add CLUE dataset 2020-06-15 10:40:46 +08:00
huanghui 4acb61d59d code review fix for buffer fusion 2020-06-15 09:35:16 +08:00
mindspore-ci-bot c661087b99 !2029 Create TensorRow class that supports a row id 
Merge pull request !2029 from lixiachen/lixia/tensorrow
 2020-06-13 09:43:58 +08:00
Lixia Chen 6ae88c3987 Create TensorRow class that supports a row id. 2020-06-12 15:06:56 -04:00
mindspore-ci-bot 3b809f2b0b !1996 Fix single BatchNorm fission && SoftmaxGradExt fusion pass 
Merge pull request !1996 from huanghui/single-batchnorm-fission-pass
 2020-06-12 15:38:05 +08:00
huanghui 88eec2b894 fix single-batchnorm-fission && softmax-grad-ext-fusion pass 2020-06-12 14:53:22 +08:00
leopz c45f4d225d dump binary ir 2020-06-12 13:19:41 +08:00
hesham 0c5e47111b - Move MutableBuffer to be protected 
- Add new CreateTensors
 2020-06-11 17:32:03 -04:00
mindspore-ci-bot beefb20c01 !1983 Remove inheritance of Sampler from DatasetOp 
Merge pull request !1983 from JesseKLee/sampler
 2020-06-11 23:14:56 +08:00
huangdongrun 9522f59b87 support for tensor indexing in pynative 
support tensor slice using constexpr

remove tensorslice metagraph

add pynative testcases
 2020-06-11 19:14:22 +08:00
mindspore-ci-bot b3da41bd7a !1913 CocoDataset implementation 
Merge pull request !1913 from xiefangqi/xfq_support_coco
 2020-06-11 14:37:44 +08:00
xiefangqi 097cbcc0cb CocoDataset implementation 2020-06-11 11:52:17 +08:00
mindspore-ci-bot 81ba3b1b99 !1868 Enhance insert memcpy for hccl op 
Merge pull request !1868 from huanghui/insert-memcpy-async-pass
 2020-06-11 09:55:32 +08:00
mindspore-ci-bot 7b7932ced9 !1944 move hook function to PrimitivePy class 
Merge pull request !1944 from wangqiuliang/move-hook-function-to-primitivepy
 2020-06-11 09:29:00 +08:00
Jesse Lee 255adf7c6e Remove inheritance of Sampler from DatasetOp 2020-06-10 18:10:51 -04:00
mindspore-ci-bot 9e1dea1ff9 !1928 delete redundant reshape op 
Merge pull request !1928 from yoonlee666/deletereshape
 2020-06-10 20:11:22 +08:00
yoonlee666 881af56ec3 optimize redundant reshape op 2020-06-10 18:21:00 +08:00
huanghui 118496b3ec enhance insert memcpy 2020-06-10 18:00:08 +08:00
heleiwang 3ece8dd090 1. support get_all_edges, get_nodes_from_edge, get_sampled_neighbors, get_neg_sampled_neighbors and graph_info API 
2. mod cora and citeseer conversion script
 2020-06-10 15:52:26 +08:00
kingfo 38436f929f move hook function to primtivePy class 2020-06-10 15:33:46 +08:00
mindspore-ci-bot 38109a386b !1957 fix cmakelists 
Merge pull request !1957 from jiangjinsheng/issue_merge
 2020-06-10 11:45:23 +08:00
jiangjinsheng 709704d339 fixed CMakeLists.txt 2020-06-10 10:58:26 +08:00
mindspore-ci-bot bfc18f3adc !1873 synchronize latest ascend software 04 Jun 2020 
Merge pull request !1873 from yanghaoran/master
 2020-06-10 01:27:43 +08:00
mindspore-ci-bot 5eb95599f6 !1874 Updates to string tensor 
Merge pull request !1874 from h.farahat/string_tensor_updates
 2020-06-10 00:59:17 +08:00
yanghaoran 8da4c1a763 synchronize latest ascend software 04 Jun 2020 2020-06-09 23:34:13 +08:00
hesham f837ddc956 - Bug when empty strings sent to Python 
- Support accepting Numpy of str as input
- Support batching strings
- Core logic of batch&pad is static
- Make Pad a utility function
 2020-06-09 10:34:38 -04:00
zhaoting b16a552d41 Revert "Revert "add pattern AdjustAllReduceMulAdduse the old opadd test case for bugtemp fix try"" 
This reverts commit 705c71a257.
 2020-06-09 20:56:36 +08:00
mindspore-ci-bot beb714d2d0 !1911 add a function to charge the node input and output is a scalar 
Merge pull request !1911 from lianliguang/add-a-function-to-charge-the-node-input-or-output-if-is-a-scalar
 2020-06-09 19:57:01 +08:00
yujianfeng 2ff9e74d07 Add unique process for duplicated indices 2020-06-09 10:12:39 +08:00
WilliamLian 9808e47663 change checkAicpu to CheckAICPU & add charge Scalar function to charge the input or output is scalar 2020-06-09 09:31:43 +08:00
huanghui b4c0ed4b36 add signle batchnorm fission pass 2020-06-08 10:08:23 +08:00
chujinjin 7465abc798 optimize transdata for pynative 2020-06-05 14:10:55 +08:00
mindspore-ci-bot 1973594bd1 !1774 [MD] minddataset support padding samples 
Merge pull request !1774 from liyong126/mindrecord_padded_sample
 2020-06-05 11:27:25 +08:00
mindspore-ci-bot b236beae28 !1615 convert constant bool tensor to bool 
Merge pull request !1615 from amongo/GetBoolValueFromConstantTensor
 2020-06-05 09:46:44 +08:00
liyong feff8899ac support padding samples 2020-06-05 09:14:42 +08:00
mindspore-ci-bot c51d90d84e !1767 Move LayerNormGrad split pass ahead of kernel select 
Merge pull request !1767 from huanghui/LayerNormGrad-split-pass
 2020-06-05 09:13:24 +08:00
mindspore-ci-bot 769ae609b4 !1808 consistent design for num_samples 
Merge pull request !1808 from Jamie/numsamples
 2020-06-04 22:12:55 +08:00
huangdongrun beacc26077 * add isconstant primitive 
* add infer_value for common math ops
* convert constant bool tensor to bool value

* do not infer value when encounter 0 as division

for while condition, do not unrool if condition is a tensor
 2020-06-04 21:51:44 +08:00
yujianfeng e87ac6525e Add batch norm fusion pattern for mix precision 2020-06-04 20:31:15 +08:00
huanghui cf87218fb7 place layernormgrad split pass before kernel select 2020-06-04 19:39:40 +08:00
Jamie Nisbet 51bc0c0460 consistent design for num_samples 
updates

more update

more work

more fixin

post rebase updates

clang formatting

code review recovery

ci fixes

updates

update

update

update
 2020-06-03 15:01:18 -04:00
mindspore-ci-bot 0426ed057b !1777 Remove ZerosLikeTensor and sub with ZerosTensor 
Merge pull request !1777 from BowenK/master
 2020-06-02 10:41:58 +08:00
BowenK 96379faa3a Remove ZerosLikeTensor and sub with ZerosLike 2020-06-02 09:52:12 +08:00
huanghui d1cec14a0c add 2 pattern for softmaxgradext fusion pass 2020-06-01 18:48:41 +08:00
kswang c63729b8e6 support mix target 2020-06-01 14:33:56 +08:00
mindspore-ci-bot cc9c004bc1 !1696 Enable ConfusionMulGrad fusion pass 
Merge pull request !1696 from huanghui/TMP
 2020-05-30 14:44:29 +08:00
mindspore-ci-bot 692f38ded2 !1532 clean pylint warning in test dir 
Merge pull request !1532 from jinyaohui/pylint1
 2020-05-30 10:13:45 +08:00
mindspore-ci-bot 59683a1d90 !1692 Fix topk bug for fasterrcnn 
Merge pull request !1692 from meixiaowei/master
 2020-05-30 09:56:40 +08:00
huanghui 71acaa5300 enable ConfusionMulGrad fusion pass in bert only 2020-05-30 09:46:21 +08:00
mindspore-ci-bot 387bcece9e !1666 Add 5 patterns for AdamApplyOneWithDecay fusion pass 
Merge pull request !1666 from huanghui/AdamApplyOneWithDecay-fusion-pass
 2020-05-30 09:43:07 +08:00
jinyaohui 86d197dfeb clean pylint 2020-05-29 23:00:00 +08:00
huanghui ff05aa1faa add newly 5 patterns for AdamApplyOneWithDecayRule fusion pass 2020-05-29 19:49:44 +08:00
yujianfeng e6f1cfa581 Check the input size of BatchNorm before fission in bert 2020-05-29 19:34:58 +08:00
meixiaowei 1778ec0135 fix topk bug 2020-05-29 19:04:18 +08:00
huanghui 99ca6b3e80 add SoftmaxGradExt fusion pass 2020-05-29 14:30:52 +08:00
mindspore-ci-bot 8556eee3fc !1578 recitify pretrained path and revert AdjustAllReduceMulAdduse 
Merge pull request !1578 from gengdongjie/master
 2020-05-28 20:25:50 +08:00
mindspore-ci-bot 9c858444b0 !1568 Fix pylint warning for test cases of optimizer, infer, parse and pynative. 
Merge pull request !1568 from seatea/fix-pylint-warning
 2020-05-28 16:59:57 +08:00
mindspore-ci-bot 04398cf88e !1433 add tensor_minnie and separate py from ir 
Merge pull request !1433 from leopz/tensor_base
 2020-05-28 16:00:56 +08:00
gengdongjie 705c71a257 Revert "add pattern AdjustAllReduceMulAdduse the old opadd test case for bugtemp fix try" 
This reverts commit 3db8cfa54f.
 2020-05-28 15:21:15 +08:00
leopz 4508134ceb add tensor_minnie and separate py from ir 2020-05-28 14:26:26 +08:00
mindspore-ci-bot c086d91aaf !1505 Add some checks in ConstToAttr[StridedSliceGrad] pass 
Merge pull request !1505 from huanghui/stride-slice
 2020-05-28 11:46:18 +08:00
seatea 7398526abc Fix pylint warning for test cases of optimizer, infer, parse and 
pynative.
 2020-05-28 11:35:33 +08:00
yujianfeng ee087bdf60 Check the size of topk input names before converting input to attr 2020-05-28 10:29:21 +08:00
Jesse Lee 3b80c10b1e Fix some timing hole in these two testcases 2020-05-27 14:22:37 -04:00
mindspore-ci-bot e311473401 !1453 Raise mse threshold in RandomCropDecodeResizeOp 
Merge pull request !1453 from Alexey_Shevlyakov/fix_random_crop_decode_resize_ut
 2020-05-27 23:58:58 +08:00
huanghui 1d65ae598a extract const_to_attr_strided_slice_grad pass 2020-05-27 17:30:17 +08:00
mindspore-ci-bot 5b9c145ff8 !1383 keep different attributes for cnode evaluation 
Merge pull request !1383 from amongo/KeepPrimAttrInCNode
 2020-05-27 13:02:34 +08:00
mindspore-ci-bot 5e2f440eed !1271 refactor of memreuse allocator to adapt the control stream 
Merge pull request !1271 from yangjie159/refactor_memreuse_allocator
 2020-05-27 10:24:16 +08:00
mindspore-ci-bot 650a45b233 !1490 Fix pylint warning 
Merge pull request !1490 from seatea/fix-pylint-warning
 2020-05-27 09:41:31 +08:00
seatea c6d8a4dc98 Fix pylint warning. 2020-05-26 21:23:06 +08:00
yujianfeng 94818cf255 Fix fusion condition of transpose and reshape 2020-05-26 17:30:38 +08:00
yangjie159 cbf5390b34 refactor memreuse allocator 
remove stream id from membuf
add kernel dependence to determine whether is usable
 2020-05-26 17:27:33 +08:00
huangdongrun 1159f2b11e add prim infer attr cache 
modify infer to get abstract value and attr value map together

support get attr in specialize

clone primitive when specialize if attribute is not the same with
infered attribute
 2020-05-26 16:19:58 +08:00
mindspore-ci-bot 2215e3267f !1419 remove old buffer fusion pass 
Merge pull request !1419 from Etone.Chan/Resnet50
 2020-05-26 09:16:06 +08:00
Jesse Lee a8fa847556 Allow join_all to be blocking 2020-05-25 15:24:36 -04:00
Alexey Shevlyakov 7a807cbff9 fix ut 2020-05-25 14:56:58 -04:00
etone-chan 42d724d8b4 remove old buffer fusion pass 2020-05-25 21:25:45 +08:00
mindspore-ci-bot e8980ed298 !1406 Simplify CondVar class 
Merge pull request !1406 from JesseKLee/CondVar
 2020-05-25 21:04:05 +08:00
huanghui a42dd21430 add 3 pattern for lamb_next_mv_rule fusion pass 2020-05-25 14:18:22 +08:00
mindspore-ci-bot 848d19207f !1359 Optimize the IR modules. 
Merge pull request !1359 from ZhangQinghua/master
 2020-05-25 14:14:44 +08:00
Zhang Qinghua dbb86cb1be Adjust some routines of FG and FGM, about the nodes info. IF. 2020-05-25 10:06:27 +08:00
Zhang Qinghua f31564ce98 Remove the useless collectors in manager. 2020-05-25 09:56:28 +08:00
Jesse Lee 641112a40c Initial Drop 2020-05-24 16:57:40 -04:00
mindspore-ci-bot daccfef738 !1361 Refactor multiple output pass 
Merge pull request !1361 from huanghui/LambNextMVRule-fusion-pass
 2020-05-23 17:21:27 +08:00
lizhenyu c5ac2cc38c add memory copy module 2020-05-23 13:04:50 +08:00
huanghui f16ff539ba refactor multiple patterns pass 2020-05-23 09:40:21 +08:00
mindspore-ci-bot 964a757db2 !1378 Just want to debug this case in Jenkin environment 
Merge pull request !1378 from JesseKLee/cond_var_debug
 2020-05-23 05:26:12 +08:00
Jesse Lee 06ae724261 Again 2020-05-22 16:38:03 -04:00
mindspore-ci-bot 458436186c !1365 Clean up work for text python sub-package 
Merge pull request !1365 from h.farahat/text_namespace
 2020-05-22 23:16:31 +08:00
mindspore-ci-bot 6f733ec113 !1308 Stage 2 of adding support for string Tensor 
Merge pull request !1308 from h.farahat/string_tensor2
 2020-05-22 21:17:53 +08:00
mindspore-ci-bot f967700ef4 !1215 [Auto parallel] Changing succive edges orders and add some strategy checkings 
Merge pull request !1215 from Xiaoda/change-succive-edges-order-and-add-checking
 2020-05-22 18:56:35 +08:00
mindspore-ci-bot 3363d4e834 !1249 Add GNN dataset processing API 
Merge pull request !1249 from heleiwang/hlw_gnn_data
 2020-05-22 18:49:36 +08:00
hesham 6c21e556c4 Clean up work for text python package 2020-05-22 04:35:58 -04:00
mindspore-ci-bot 4bdfddedb2 !1358 Link child graphs 
Merge pull request !1358 from zhoufeng/link-child-graph-2
 2020-05-22 16:10:52 +08:00
zhoufeng af5019b94f link child graphs 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2020-05-22 15:37:19 +08:00
heleiwang 599a449e0b Support processing GNN data 2020-05-22 14:15:25 +08:00
jinyaohui fbdba6e4da clean pylint 2020-05-22 13:23:13 +08:00
hesham df361d1d26 Change mem layout of string tensor 
add support for MindRecord and TFRecord
----
optimize tensorshape

optimize tensorshape and FlatIndex

TFRecord and MindRecord support for string tensor

Modify mem layout
Add new constructor
Add method Allocate

Change some GetMutableBuffer usages to AllocateBuffer
 2020-05-22 01:22:29 -04:00
Xiaoda Zhang 9f4b8a3cd1 changing the succive edges order in GetAliveSuccEdges() so that Triangle and Star Elimination can be merged into particular node; adding some check information 2020-05-22 10:57:02 +08:00
mindspore-ci-bot d9c74e0acd !1328 Add 3 patterns support for LambNextMVWithDecay fusion pass 
Merge pull request !1328 from huanghui/LambNextMvWithDecayRuleConds-fusion-pass
 2020-05-22 10:35:17 +08:00
mindspore-ci-bot 2e3d55ed87 !1281 Implementation of SplitOp 
Merge pull request !1281 from Peilin/splitOp
 2020-05-22 09:29:03 +08:00
Peilin Wang 71e8bb1960 general split case done, chaining sampler (basic case) is working 
implementation 99% complete

everything and tested except for repeatable shuffling

tested most basic/typical split usecases

cleanup

some more cleanup

fix CI

more ci fix

more ci fixes

more ci fix

more ci fix

more ci fix

added more tests, fixed some bugs

some more clean up and test cases

added shard/shuffle before split warning/error

addressed code review comments and ci

fixed ci
 2020-05-21 20:42:51 -04:00
mindspore-ci-bot 07b14f32b9 !1296 move signature to primitivepy and bprop_func to utils 
Merge pull request !1296 from leopz/fix_primitive
 2020-05-21 20:44:59 +08:00
huanghui eaff850f11 add 3 patterns for lamb_next_mv_with_decay_rule pass 2020-05-21 17:00:15 +08:00
mindspore-ci-bot e4795974be !1266 Refactor LambNextMVWithDecayRule fusion pass 
Merge pull request !1266 from huanghui/LambNextMvWithDecayRuleConds-fusion-pass
 2020-05-21 11:43:49 +08:00
huanghui 5a68eba585 Refactor LambNextMVWithDecayRule fusion pass 2020-05-21 10:08:50 +08:00
qianlong 451c20a6f5 Add UnicodeCharTokenizer for nlp 2020-05-21 09:22:45 +08:00
leopz 04763b8b76 move signature to primitivepy and bprop_func to utils 2020-05-20 18:06:36 +08:00
xulei2020 163b6b7ea7 add jieba c++ code 2020-05-20 15:55:12 +08:00
mindspore-ci-bot 97ba539e7b !1269 fix issue of loadding control input tensors failed in control sink mode 
Merge pull request !1269 from wenchunjiang/fix_task_sink_bug
 2020-05-20 11:33:12 +08:00
wenchunjiang 729ea8cc55 fix bug of loadding ctrl input tensors failed in control sink mode 2020-05-20 10:45:28 +08:00
mindspore-ci-bot 04ac611fe8 !1189 Decoupling py default param from Parameter 
Merge pull request !1189 from leopz/master
 2020-05-20 10:02:01 +08:00
leopz 40e15996b0 move default_param out of parameter and remove pybind11 in anf define 2020-05-19 19:11:12 +08:00
Wei Luning 3db8cfa54f add pattern AdjustAllReduceMulAdduse the old opadd test case for bugtemp fix try 2020-05-19 18:46:11 +08:00
mindspore-ci-bot c793540cc9 !1231 Assign label resource for new control sink 
Merge pull request !1231 from zhoufeng/label-assign
 2020-05-19 10:48:35 +08:00
zhoufeng c99f904276 assign label resource for new control sink 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2020-05-18 21:44:52 +08:00
mindspore-ci-bot 828d0b124e !1209 add format trans function 
Merge pull request !1209 from liubuyu/master
 2020-05-18 20:59:43 +08:00
mindspore-ci-bot 1b7cdc4c61 !1218 clean pylint warning in test about import 
Merge pull request !1218 from jinyaohui/pylint1
 2020-05-18 19:54:04 +08:00
liubuyu f70429d671 add format transfer 2020-05-18 19:45:04 +08:00
yujianfeng c8d33568f2 Add an new output to FusedMulApplyMomentum 2020-05-18 17:03:21 +08:00
jinyaohui 5a914994ba clean pylint 2020-05-18 16:42:35 +08:00
huanghui c4af71e236 add LarsV2 fission pass 2020-05-18 11:30:45 +08:00
jinyaohui bcfaff97f9 clean pylint 2020-05-18 10:31:46 +08:00
hesham e8ca243364 -Add DE_STRING 
-replace switch'case by indexing

- Add test case
- Add constructors
- Add getItem string

- Fix bugs
- Add more tests

- Tensor iterator
- asNumpy
- TextFileDataset

- Tensor(Numpy)

- Super > 2D
- Add more test cases for GeneratorDataset

- Change StartAddr to GetBuffer and GetMutableNuffer

- Raise an error if batch is used with strings

Clean-up work
 2020-05-15 20:33:28 -04:00
mindspore-ci-bot ca64bfdbab !1120 Code refactoring ：modify Infer to Eval 
Merge pull request !1120 from Kang/master
 2020-05-15 17:44:29 +08:00
mindspore-ci-bot 889d7b6eea !1180 [pre_activate]Fix pylint warning 
Merge pull request !1180 from YuJianfeng/master
 2020-05-15 17:25:34 +08:00
mindspore-ci-bot efb9672849 !1118 Add BatchNormGrad2BNInferGrad pass 
Merge pull request !1118 from huanghui/batchnormgrad-to-bninfergrad-pass
 2020-05-15 17:15:38 +08:00
mindspore-ci-bot c680cfbf27 !1157 dataset: add concat operation for dataset 
Merge pull request !1157 from ms_yan/concat_dataset
 2020-05-15 16:07:19 +08:00
mindspore-ci-bot ab031ee9ea !1126 VOCDataset support object detection function 
Merge pull request !1126 from xiefangqi/voc_support_detection
 2020-05-15 15:56:39 +08:00
yujianfeng 0f42fdbb80 Fix pylint warning 2020-05-15 15:29:22 +08:00
huanghui 709828a98b add BatchNormGrad2BNInferGrad pass 2020-05-15 14:37:50 +08:00
mindspore-ci-bot 42ba885e58 !1098 Add BatchNorm2BNInfer pass 
Merge pull request !1098 from huanghui/add-batchnorm-bninfer-pass
 2020-05-15 14:33:09 +08:00
xiefangqi c937bad53f minddata support voc 2020-05-15 13:24:03 +08:00
ms_yan c0fa7b4b19 init commit of concat dataset 
change to use __add__ operation instead ds.concat
 2020-05-15 13:14:13 +08:00
Kang be60bd3d79 Code refactoring for the static_analysis : modified Infer to Eval. 2020-05-15 09:56:41 +08:00
huanghui 6db71e6576 add batchnorm2bninfer pass 2020-05-15 09:56:38 +08:00
yujianfeng 2b061c84c7 Add batch_norm_grad infer fisson 2020-05-15 09:44:40 +08:00
mindspore-ci-bot 597933b04b !1113 rename kernel/mng to kernel/rts 
Merge pull request !1113 from dengwentao/rts
 2020-05-15 09:39:18 +08:00
yujianfeng 6e89ebe6f0 Add BatchNorm fusion pattern with mix precision 2020-05-14 21:28:08 +08:00
mindspore-ci-bot 4bb46606db !1149 fix pylint in tests 
Merge pull request !1149 from panyifeng/fix_pylint
 2020-05-14 15:15:52 +08:00
panyifeng 755ba75deb fix pylint 2020-05-14 14:22:52 +08:00
etone-chan c4a5bfb787 add matmul eltwise buffer fusion pass 2020-05-14 10:36:23 +08:00
mindspore-ci-bot 9e116e15fb !1139 Change Thread::Join to async call with time out 
Merge pull request !1139 from JesseKLee/timing_hole
 2020-05-14 09:07:06 +08:00
mindspore-ci-bot 1a052f7155 !1131 [Data]fix cmake build format 
Merge pull request !1131 from xulei/filter_op
 2020-05-14 08:24:35 +08:00
Jesse Lee f2be49d85e Fix a racing condition 2020-05-13 14:59:25 -04:00
xulei2020 903b64daa2 fix cmake build format 2020-05-13 17:00:35 +08:00
mindspore-ci-bot 8b98f921cc !1124 Add broadcast fusion pass 
Merge pull request !1124 from YuJianfeng/master
 2020-05-13 16:29:33 +08:00
dengwentao fa83fc3e02 rename kernel/mng to kernel/rts 2020-05-13 16:26:17 +08:00
mindspore-ci-bot 1a98c6b459 !999 [MD] mindrecord support reading file list 
Merge pull request !999 from liyong126/mindrecord_file_list
 2020-05-13 15:53:26 +08:00
yujianfeng 31d8db9fc6 Add broadcast fusion pass 2020-05-13 15:30:38 +08:00
mindspore-ci-bot 86d4797399 !1079 Convert AiCpu kernel when aicore not supported 
Merge pull request !1079 from lianliguang/convert-to-AICPU-when-AiCore-not-supported-kernel
 2020-05-13 15:15:00 +08:00
liyong aa3f89e74f mindrecord support read file list 2020-05-13 14:11:59 +08:00
WilliamLian 691b0648e3 convert unsupported kernel in aicore to aicpu 2020-05-13 11:52:26 +08:00
yujianfeng 85ff90c237 Add input shape condition for transpose_reshape fusion pass 2020-05-12 22:54:21 +08:00
Jesse Lee 3c643e7298 Move from dataset_dev branch to here 2020-05-11 15:11:53 -04:00
fary86 3f323e48e2 Add submodule id for log interface 2020-05-11 19:17:45 +08:00
yao_yf f0bf438a55 reshape strategy search 2020-05-09 17:00:37 +08:00
mindspore-ci-bot 9433ca6468 !998 format the func name 
Merge pull request !998 from guozhijian/enhance_format_func_name
 2020-05-08 20:18:35 +08:00
jonyguo cf352d190f format func name for mindrecord 2020-05-08 18:33:13 +08:00
huanghui 12eaaf710b mul_add_fusion pass supports when add's 2nd is mul 2020-05-08 14:28:39 +08:00
Zirui Wu c2d364a573 batch with padding implemented 
support for 1 specific dimension to be None, added validator

fix various CI complains

another round of CI fixes

ci

refactor parts of the code

code refactor

ci fix

comments added, fix bugs

address review comments

address review comments

review cmts

added simple perf test script

update pad code

perf imprv
 2020-05-07 11:18:42 -04:00
Xiaoda Zhang def8573275 implementing-searching-strategy-for-inference 2020-05-07 14:53:50 +08:00
YuJianfeng aa6f808616 Add batch norm bert fission pass 2020-05-06 16:33:46 +08:00
xiefangqi 9a2daae84c del unused change_mode_op 2020-05-06 11:54:05 +08:00
changzherui 99c9b48a4d delete TestHWBatchNormGradSplit 2020-05-04 19:39:17 +08:00
changzherui b323199dc1 syn code 430 2020-04-30 17:55:12 +08:00
YuJianfeng 7185961e89 Enable BatchNorm fusion pass 2020-04-30 15:29:23 +08:00
mindspore-ci-bot db3dd02838 !847 Optimize the collectors in manager which listen to the graphs and nodes changes. 
Merge pull request !847 from ZhangQinghua/opt
 2020-04-30 11:12:40 +08:00
mindspore-ci-bot 2303453753 !869 Random data op 
Merge pull request !869 from JesseKLee/random_data_op
 2020-04-30 02:56:39 +08:00
mindspore-ci-bot 732c7f8266 !794 fix issues image gradients 4d check 
Merge pull request !794 from zhaozhenlong/fix-issues-image-gradients-complement-check
 2020-04-29 22:26:53 +08:00
Jesse Lee 270bf831a9 Random Data Op 2020-04-29 10:26:00 -04:00
mindspore-ci-bot 98939d839c !856 Fix skip op bug 
Merge pull request !856 from jiangzhiwen/dataset/skip_thread
 2020-04-29 21:47:50 +08:00
zhaozhenlong 66e7a36846 ImageGradients check 4d 
fix DiagPart constant folding issue

fix argmin output type check

fix atan2 doc error

fix remove FusedBatchNorm and its grad
 2020-04-29 21:47:33 +08:00
jiangzhiwen 34bfa2f7c9 fix skip 2020-04-29 20:12:37 +08:00
Zhang Qinghua a22a4a57c2 Modify UT case after adjust the collectors of manager. 2020-04-29 15:36:21 +08:00
huanghui 0de0aee54e Add BatchNormGrad split pass 2020-04-29 15:28:23 +08:00
Jesse Lee 332398d20a Check return code from WaitPost::Register 2020-04-28 15:19:03 -04:00
yao_yf 6cde5f6d91 auto parallel strategy checkpoint 2020-04-28 15:48:41 +08:00
kswang e6f36e050f change cpu kernel dir 2020-04-27 21:14:03 +08:00
mindspore-ci-bot e537a70808 !657 Fix confusionmulgrad fusion pass cannot work 
Merge pull request !657 from huanghui/fix-confusionmulgrad-fusion-pass
 2020-04-27 11:10:25 +08:00
mindspore-ci-bot 3d9f1087c6 !695 Check topk supported before converting input to attr 
Merge pull request !695 from YuJianfeng/master
 2020-04-26 21:38:43 +08:00
YuJianfeng ce2a13fcda Check topk supported before converting input to attr 2020-04-26 18:40:17 +08:00
mindspore-ci-bot fb5cfe31d5 !430 add buffer fusion bnupdate eltwise pass 
Merge pull request !430 from Etone.Chan/bufferfusion
 2020-04-26 17:40:20 +08:00
Etone.Chan d2727d0504 add buffer fusion bnupdate eltwise pass 2020-04-26 17:17:42 +08:00
huanghui 230e77f923 fix confusionmulgrad fusion pass cannot work 2020-04-26 15:35:25 +08:00
huanghui 9e29224af9 move add_memcpy_async pass and transdata_split pass 2020-04-26 10:48:44 +08:00
Wei Luning f305d6f8a7 Revert "add pattern AdjustAllReduceMulAdd" 
This reverts commit ea6958c50a.
 2020-04-25 19:50:50 +08:00
zhaozhenlong 89f82e1a37 fix cpp ut test TestConvertConvBackpropFilter 2020-04-24 19:04:40 +08:00
mindspore-ci-bot 53d2da5fe4 !264 static_analysis: remove useless cache in TrivialPrimEvaluator and add cache for PythonPrimEvaluator 
Merge pull request !264 from xychow/remove-unnecessary-cache-and-add-cache
 2020-04-24 09:22:33 +08:00
mindspore-ci-bot 2440cea732 !621 [MD] adjust mindrecord ut 
Merge pull request !621 from liyong126/mindrecord_ut
 2020-04-24 09:12:32 +08:00
mindspore-ci-bot 928dcf4ec4 !554 Fix derelu fusion pass 
Merge pull request !554 from huanghui/fix_derelu_fusion_pass
 2020-04-23 21:52:55 +08:00
liyong 1f222ddb9e fix mindrecord c ut 2020-04-23 21:48:58 +08:00
huanghui cd6e8d6542 fix ReluV2's mask shape in derelu fusion pass 2020-04-23 21:25:18 +08:00
mindspore-ci-bot 4a3e5cb944 !492 Add AllGather fusion pass 
Merge pull request !492 from YuJianfeng/allgather
 2020-04-23 20:31:12 +08:00
mindspore-ci-bot 54e0fa5c09 !556 [Auto Parallel] use DeviceMemory instead of fixed-size memory check 
Merge pull request !556 from Chong/partition
 2020-04-23 20:03:36 +08:00
YuJianfeng 39945d0f79 Add AllGather fusion pass 2020-04-23 19:05:10 +08:00
ch-l f806b72447 use DeviceMemory for memory control 2020-04-23 17:55:17 +08:00
zhousiyi f6a4f3d155 [static_analysis]: remove the TrivialPrimEvaluator cache. 
add cache for PythonPrimEvaluator. Be careful that
 the infer function of PythonPrimitive in python code should
 be idempotent.
 2020-04-23 09:13:57 +00:00
huanghui 14df771175 fix confusion_softmax_grad_rule pass 2020-04-23 16:45:06 +08:00
chang zherui 3c1785a121 syn code 2020-04-23 14:49:29 +08:00
liubuyu 672244e0ac add keep_bn_fp32 parameter 2020-04-23 11:04:18 +08:00
mindspore-ci-bot 2dabcb9e59 !41 Synchronization code to ms-incubator 
Merge pull request !41 from changzherui/syn-code
 2020-04-23 10:46:02 +08:00
Wei Luning ac25cbae0e Revert "add pattern AdjustAllReduceMulAdd" 
This reverts commit d447364417.
 2020-04-23 10:05:33 +08:00
mindspore-ci-bot d99dfbd83d !390 getnext parallel optimization part III & IV: Loop Control & Stream Dispatch adaptation 
Merge pull request !390 from gukecai/master
 2020-04-21 15:36:44 +08:00
gukecai f8208c7c52 Support GetNext Parallel 2020-04-21 11:39:07 +08:00
liyong f1542a90a3 add pk sampler 2020-04-21 10:08:38 +08:00
mindspore-ci-bot 6369cf27bd !406 added first row crc check for when reading tfrecord files 
Merge pull request !406 from Peilin/first-row-crc-check
 2020-04-21 00:10:18 +08:00
xulei2020 c705ea5e5b add filterOp code 2020-04-20 22:32:19 +08:00
Peilin Wang 9bc2134cb7 added checking of first row crc to find invalid tfrecord files 
addressed code review comments. added check in python layer to exclude directories and to raise an error if a pattern does not match any file

fixed clang format

fixed cppcheck

fixed cppcheck (used std::accumulate and std::copy_if). regenerated tfrecord file to contain correct header, it was a dummy header before

fixed cppcheck: added const reference for string parameter for lambdas, fixed clang format: whitespace adjustments

more clang whitespace fixes...

changed print to logger.info
 2020-04-20 10:25:26 -04:00
mindspore-ci-bot d8176a77f4 !425 New api "TextFileDataset" 
Merge pull request !425 from yanghaitao/yht_textfiledatasetv2
 2020-04-20 22:14:26 +08:00
mindspore-ci-bot 11a4b35caa !472 Fix inputs size and attr for AddN fission pass 
Merge pull request !472 from YuJianfeng/master
 2020-04-20 21:30:52 +08:00
ms_yan c5cfb09e66 Repair some MS_LOG problem 2020-04-20 19:45:46 +08:00
mindspore-ci-bot 679dbd27b3 !478 fix save_graphs_path and log file mode related issues 
Merge pull request !478 from fary86/fix_log_and_ir_issues
 2020-04-20 19:07:38 +08:00
fary86 7e23a1a475 Fix issues of save_graphs_path, Type/Value error message and log file mode 2020-04-20 16:23:40 +08:00
YuJianfeng bc2df2c913 Fix inputs size and attr for AddN fission pass 2020-04-20 15:48:27 +08:00
yanghaitao 2795e492ff TextFileDataset 2020-04-20 11:18:55 +08:00
mindspore-ci-bot 3822b4837f !340 Add a HistogramSummary ops to record tensor value 
Merge pull request !340 from ougongchang/master
 2020-04-20 10:54:04 +08:00
Wei Luning d447364417 add pattern AdjustAllReduceMulAdd 2020-04-18 21:20:15 +08:00
ms_yan f0c07c3fa6 Realize take op and add ut 2020-04-18 18:33:57 +08:00
mindspore-ci-bot 71b63c3fcf !246 [opt pass] AdjustAllReduceMulAdd 
Merge pull request !246 from vlne-v1/I1E3PI-opt-pass-adjust-allreduce-apply-weight-decy-seq
 2020-04-18 18:17:01 +08:00
Wei Luning ea6958c50a add pattern AdjustAllReduceMulAdd 2020-04-18 17:00:55 +08:00
YuJianfeng 5eb5379889 Add AdamApplyOne fusion pass 2020-04-18 10:54:09 +08:00
ougongchang 0ed6d9178e add Histogram summary operator 
clean clang format errors and cpplint errors

add some test cases for histogram summary operator
 2020-04-18 09:56:45 +08:00
jzw 3f7054dccb add skip dataset op 2020-04-17 19:48:25 +08:00
mindspore-ci-bot f69a668d98 !350 change tuple output to make tuple 
Merge pull request !350 from lianliguang/chang-tuple-output-to-make-tuple
 2020-04-17 19:22:41 +08:00
lianliguang 00e4306518 convert all tuple output to maketuple 2020-04-17 17:31:42 +08:00
mindspore-ci-bot f98efafa16 !317 [IRFusion] add derelu_fusion pass 
Merge pull request !317 from huanghui/derelu_fusion_pass
 2020-04-17 16:42:06 +08:00
mindspore-ci-bot cf026096a6 !183 Mindspore.dataset CPP sampler for GeneratorDataset 
Merge pull request !183 from JunhanHu/cpp_sampler
 2020-04-16 22:30:59 +08:00
wenchunjiang ee5f3fa240 add pass to insert memcpy_async for get_next outputs 2020-04-16 14:30:24 +08:00
mindspore-ci-bot 58a70b5f82 !346 getnext parallel optimization part II: Eliminate Memcpy in specify scenario 
Merge pull request !346 from laiyongqiang/develop
 2020-04-15 20:38:42 +08:00
laiyongqiang 3e05f50f5f getnext_memcpy_elimination 2020-04-15 19:38:10 +08:00
yangzhenzhang 6d522f0a4f add parallel op for layernorm 2020-04-15 19:30:07 +08:00
huanghui b02e871c1a [IRFusion] add derelu_fusion pass 2020-04-15 10:20:35 +08:00
Junhan Hu 9739d3b048 Add CPP sampler support for GeneratorDataset 2020-04-14 12:09:03 -04:00
mindspore-ci-bot 30de261c3c !243 Support nested repeat 
Merge pull request !243 from h.farahat/nested_repeat
 2020-04-14 23:07:32 +08:00
hesham 0fc23eee0f Support nested repeat 2020-04-14 10:13:18 -04:00
mindspore-ci-bot b571fabd77 !289 Add cnode mapping after graph match 
Merge pull request !289 from YuJianfeng/find_op
 2020-04-14 18:51:28 +08:00
YuJianfeng e5c67b9088 Add cnode to equal map when opt matching 2020-04-14 17:29:47 +08:00
mindspore-ci-bot 9bda080bb5 !260 refactor padding strategy 
Merge pull request !260 from lianliguang/refactor-padding-strategy
 2020-04-14 15:44:46 +08:00
mindspore-ci-bot 1ab430072e !232 [Auto parallel] Model the memory_cost in cost model 
Merge pull request !232 from Xiaoda/model-memory-cost-in-auto-parallel
 2020-04-14 15:29:04 +08:00
mindspore-ci-bot 94589ce611 !226 expend conv stride and dilation to 2d 
Merge pull request !226 from wangnan39/expend_conv_stride_to_2d
 2020-04-14 14:58:22 +08:00
wangnan39@huawei.com 2604acedcb extend conv stride and dilation to 2d 2020-04-14 13:16:27 +08:00
lianliguang 5d225f934f change the padding strategy & refactor insert transdata 2020-04-14 12:57:40 +08:00
Xiaoda Zhang 0ac50a19f5 Model the memory cost in auto-parallel. It is calculated by the output of operators, plus the parameters. Additionally, modify the graph-operations in auto_parallel to include memory_cost. 2020-04-14 11:39:31 +08:00
mindspore-ci-bot f1fa2a9941 !273 [MD] update subset random sampler in minddataset 
Merge pull request !273 from liyong126/mindrecord_subset_sampler_python
 2020-04-14 11:18:36 +08:00
mindspore-ci-bot 298a32f1e2 !132 Add confusion_mul_grad_fusion pass 
Merge pull request !132 from huanghui/master
 2020-04-13 21:49:06 +08:00
liyong 0ce83e39e1 fix TestShardSampleWrongNumber 
adjust internal api
 2020-04-13 21:31:45 +08:00
mindspore-ci-bot 57f953ca38 !216 Implement addn fusion pass 
Merge pull request !216 from YuJianfeng/master
 2020-04-13 20:49:32 +08:00
huanghui 19ee376cd3 add confusion_mul_grad fusion pass 2020-04-13 19:08:15 +08:00
c00425699 d62f560b50 add_bool_type_check_in_comm_op 2020-04-13 17:34:29 +08:00
YuJianfeng 7307c81f31 implement AddN fission pass 2020-04-13 16:05:45 +08:00
panfengfeng 6a79fc1735 skip mindrecord ut test case 2020-04-13 10:38:54 +08:00
buxue 5841fe010e Support pow's second input could be tensor and fix bug in bprop of pow 2020-04-11 16:16:58 +08:00
yangzhenzhang b34c0e7a17 add parallel op for dropoutdomask 2020-04-11 12:11:22 +08:00
jonyguo a9443635b7 fix: mindpage enhance parameter check and search by filename failed 2020-04-11 10:19:14 +08:00
panfengfeng 53a98210af skip ut test cases temporarily 2020-04-11 09:28:09 +08:00
c00425699 406475160f refactor OperatorCostPtr in OperatorInfo 2020-04-10 19:11:58 +08:00
biffex cc1416bfc2 constant duplicate mul for momentum 2020-04-10 19:11:58 +08:00
kswang a6747c522f add ascend mem pool 2020-04-10 19:10:45 +08:00
yao_yf 513f384c43 fix auto parallel prelu 2020-04-10 19:10:45 +08:00
kswang d84cfb0108 add mem manager 2020-04-10 19:10:45 +08:00
Alexey Shevlyakov 6d1ea7af8e remove make_unique.h 2020-04-10 19:10:45 +08:00
jonyguo 6690a7fd7a fix: error info is not exactly when column list invalid 2020-04-10 19:09:54 +08:00
jojobugfree 89f0b3b1bb profiling feature enhancement 2020-04-10 19:08:25 +08:00
Xiaoda Zhang 7798c85e70 This commit is to separate the computation cost and memory cost in auto_parallel. Some related memory correction is removed. 2020-04-10 19:08:25 +08:00
Jonathan Yan f01098bc12 remove ENABLE_MINDRECORD flag 2020-04-10 19:08:25 +08:00
Alexey Shevlyakov b9701db887 fix RandomCropDecodeResize test 2020-04-10 19:08:25 +08:00
mindspore-ci-bot 268d358a1d !187 refactor OperatorCostPtr in OperatorInfo 
Merge pull request !187 from chentingting/refactor_OperatorCostPtr_in_OperatorInfo
 2020-04-10 09:21:25 +08:00
mindspore-ci-bot 1b3b3b1a1c !198 [opt] momentum duplicate mul constant 
Merge pull request !198 from biffex/momentum-duplicate-mul-constant
 2020-04-10 08:37:41 +08:00
biffex 62bbf560c6 constant duplicate mul for momentum 2020-04-09 22:28:00 +08:00
c00425699 b413638f23 refactor OperatorCostPtr in OperatorInfo 2020-04-09 20:37:52 +08:00
kswang bef62db128 add ascend mem pool 2020-04-09 16:04:59 +08:00
mindspore-ci-bot 2e6e94b2b6 !177 prelu operator support parallel on the channel 
Merge pull request !177 from yao_yf/fix_auto_parallel_prelu
 2020-04-09 14:08:41 +08:00
mindspore-ci-bot 31efc8b088 !172 add mem manager 
Merge pull request !172 from kisnwang/add-resource-manager
 2020-04-09 11:36:33 +08:00
kswang fb343bd607 add mem manager 2020-04-09 10:05:45 +08:00
buxue 1d3bb0b731 Develop op MaxPoolWithArgMax 2020-04-09 09:26:56 +08:00
mindspore-ci-bot cc75cb357c !168 remove mindspore::make_unique and make_unique.h 
Merge pull request !168 from Alexey_Shevlyakov/remove_mindspore_make_unique
 2020-04-09 05:32:52 +08:00
mindspore-ci-bot 3e36982314 !99 Develop op MaxPoolWithArgMax 
Merge pull request !99 from zhangbuxue/Dock_MaxPoolWithArgMax
 2020-04-08 22:40:00 +08:00
mindspore-ci-bot 68f804255f !174 enhance: the error info is not detail when the column list is invalid by MindDataset 
Merge pull request !174 from guozhijian/fix_false_error_info
 2020-04-08 21:52:00 +08:00
buxue 7541d3b067 Develop op MaxPoolWithArgMax 2020-04-08 20:47:49 +08:00
yao_yf b5e3fa9593 fix auto parallel prelu 2020-04-08 20:45:08 +08:00
kingfo cdbef85e5e refactor callback for ge backend 2020-04-08 20:00:06 +08:00
huangdongrun d12a720fc5 add comparison ops 
fix pylint

use scalar_lt primitive directly

fix review
 2020-04-08 20:00:06 +08:00
YuJianfeng 024706f951 Optimize depend edge with make tuple input 2020-04-08 20:00:06 +08:00
Wei Luning b18f634912 remove ge depend in cpu 2020-04-08 20:00:06 +08:00
fary86 73e0bdcd43 Dump graph with type info when static analysis failed 2020-04-08 19:58:13 +08:00
c00425699 c4b03e854c use std::vector instead of std::list to promote performance for parallel module 2020-04-08 19:58:13 +08:00
GinFung 2fd7f67108 Add matmul biasadd fusion pass 2020-04-08 19:58:13 +08:00
Jonathan Yan 295c00ac39 Replace std::cout with MS_LOG in dataset unit test 
Signed-off-by: Jonathan Yan <jonathan.yan1@huawei.com>
 2020-04-08 19:58:13 +08:00
mindspore-ci-bot 2eb71103f9 !82 profiling feature enhancement 
Merge pull request !82 from caifubi/dev-profiling
 2020-04-08 16:22:35 +08:00
jonyguo 20d1b64443 fix: error info is not exactly when column list invalid 2020-04-08 16:11:13 +08:00
jojobugfree effdb483d6 profiling feature enhancement 2020-04-08 15:12:06 +08:00
Xiaoda Zhang a153fad874 This commit is to separate the computation cost and memory cost in auto_parallel. Some related memory correction is removed. 2020-04-08 11:52:19 +08:00
Jonathan Yan 9d0fde29f4 remove ENABLE_MINDRECORD flag 2020-04-07 14:55:45 -04:00
Alexey Shevlyakov 84d780c1a4 remove make_unique.h 2020-04-07 14:00:09 -04:00
mindspore-ci-bot a4b9f8a728 !120 Fix test for RandomCropDecodeResizeOp. 
Merge pull request !120 from Alexey_Shevlyakov/master
 2020-04-07 20:52:45 +08:00
kingfo 3202fc0df9 refactor callback for ge backend 2020-04-07 09:32:54 +08:00
Alexey Shevlyakov d37b8c4f2d fix RandomCropDecodeResize test 2020-04-03 11:13:57 -04:00
mindspore-ci-bot a5d95e472e !106 support comparison ops for python 
Merge pull request !106 from amongo/SupportPythonOperators
 2020-04-03 15:52:08 +08:00
huangdongrun 461d8e3a08 add comparison ops 
fix pylint

use scalar_lt primitive directly

fix review
 2020-04-03 09:58:41 +08:00
mindspore-ci-bot 9be1a01db6 !85 Optimize depend edge with make tuple input 
Merge pull request !85 from YuJianfeng/master
 2020-04-02 22:00:18 +08:00
Wei Luning 73ba399364 remove ge depend in cpu 2020-04-02 19:38:42 +08:00
YuJianfeng 7f53bb062d Optimize depend edge with make tuple input 2020-04-02 11:33:34 +08:00
mindspore-ci-bot 52166a85cf !43 dump graph with type info when analysis failed 
Merge pull request !43 from fary86/dump-typed-graph-when-analyze-fail
 2020-03-31 22:23:02 +08:00
fary86 816b60491d Dump graph with type info when static analysis failed 2020-03-31 21:08:48 +08:00
mindspore-ci-bot da447b8d4d !45 use std::vector instead of std::list to promote performance for parallel module 
Merge pull request !45 from chentingting/permote_auto_prallel_performance
 2020-03-31 18:25:59 +08:00
c00425699 3bb48ffee1 use std::vector instead of std::list to promote performance for parallel module 2020-03-31 15:16:00 +08:00
mindspore-ci-bot 976226f9ac !10 Add matmul biasadd fusion pass 
Merge pull request !10 from YuJianfeng/master
 2020-03-31 14:52:47 +08:00
Jonathan Yan 080bcda021 Replace std::cout with MS_LOG in dataset unit test 
Signed-off-by: Jonathan Yan <jonathan.yan1@huawei.com>
 2020-03-30 11:02:32 -04:00
GinFung 468dbc3557 Add matmul biasadd fusion pass 2020-03-30 10:12:50 +08:00
zhunaipan 930a1fb0a8 initial version 
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
 2020-03-27 22:54:54 +08:00