Commit Graph

387 Commits

Author SHA1 Message Date
yujianfeng f15cb6b7c9 Add sort by index for each group of AllReduce 2020-06-18 09:18:01 +08:00
mindspore-ci-bot a4048e192c !2256 Rename Sampler::Reset() to Sampler::ResetSampler()
Merge pull request !2256 from JesseKLee/sampler
2020-06-18 03:33:53 +08:00
mindspore-ci-bot ea829e89c3 !2198 Add MaskOp to dataset
Merge pull request !2198 from h.farahat/mask_op
2020-06-18 02:50:16 +08:00
Jesse Lee dcfdff6021 Rename Sampler Reset 2020-06-17 14:43:45 -04:00
mindspore-ci-bot 2865436fee !2092 Tokenizers
Merge pull request !2092 from qianlong21st/june_third
2020-06-17 21:40:32 +08:00
mindspore-ci-bot 4b5cbe5d4a !2186 Optimization for opt
Merge pull request !2186 from Kang/opt
2020-06-17 17:29:38 +08:00
mindspore-ci-bot 65f2212fd3 !2215 Support hccl profiling
Merge pull request !2215 from caifubi/support-hccl-profiling
2020-06-17 17:01:10 +08:00
Kang 2974b906d3 Optimization for opt 2020-06-17 16:04:54 +08:00
qianlong 4f16f036be Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp
add CaseFold, NormalizeUTF8

add RegexReplace

add RegexTokenizer

add BasicTokenizer

add WordpieceTokenizer

add BertTokenizer
2020-06-17 15:47:04 +08:00
caifubi 5db0d8129c Support hccl profiling 2020-06-17 15:14:30 +08:00
hesham f2462bb00d Mask Op 2020-06-16 23:51:46 -04:00
mindspore-ci-bot 625f2421b5 !1977 random walk in gnn node2vec
Merge pull request !1977 from JonathanY/randomwalk
2020-06-17 03:22:21 +08:00
mindspore-ci-bot a1f194c971 !2188 Remove B+ tree deadcode and add an additional output to Search function
Merge pull request !2188 from JesseKLee/deadcode
2020-06-17 01:53:01 +08:00
Jesse Lee 287ca71260 Remove dead code 2020-06-16 11:46:30 -04:00
hesham e2012a1de9 Slice Op 2020-06-16 02:32:40 -04:00
mindspore-ci-bot cb706951c1 !2126 Refactoring the func graph manager module.
Merge pull request !2126 from ZhangQinghua/master
2020-06-16 09:17:15 +08:00
mindspore-ci-bot dceb3c2be4 !2026 Change C++ behavior in RandomCropAndResize
Merge pull request !2026 from MahdiRahmaniHanzaki/I1K3FL-random-resized-crop
2020-06-16 05:27:36 +08:00
Mahdi add29f95f5 resolved issues in the comments 2020-06-15 16:45:18 -04:00
mindspore-ci-bot 2cab44a637 !2028 FillOp for BERT
Merge pull request !2028 from nhussain/fillOp_learning
2020-06-16 02:45:45 +08:00
nhussain dd9bf09f0a added FillOp for #119 - special Ops 2020-06-15 11:30:43 -04:00
Jonathan Yan 87d2c27c7f random walk v1 2020-06-15 08:54:10 -04:00
mindspore-ci-bot 971f10d222 !1790 remove transdata only connected with control depend
Merge pull request !1790 from lianliguang/remove-the-useless-transdata-connected-with-the-control-depend
2020-06-15 16:59:33 +08:00
mindspore-ci-bot 928c25ebea !2047 [Code review] check code files in pre_activate/ascend/buffer_fusion
Merge pull request !2047 from huanghui/code-review
2020-06-15 16:23:24 +08:00
Zhang Qinghua 923d3fee04 Refactoring the fg manager module. 2020-06-15 15:47:39 +08:00
WilliamLian b86016a26f remove the useless transdata and cast of control depend node 2020-06-15 14:54:47 +08:00
mindspore-ci-bot a8cf83acf2 !1932 Add CLUE dataset
Merge pull request !1932 from jiangzhiwen/dataset/clue
2020-06-15 11:48:35 +08:00
jiangzhiwen e0e167a000 add CLUE dataset 2020-06-15 10:40:46 +08:00
huanghui 4acb61d59d code review fix for buffer fusion 2020-06-15 09:35:16 +08:00
mindspore-ci-bot c661087b99 !2029 Create TensorRow class that supports a row id
Merge pull request !2029 from lixiachen/lixia/tensorrow
2020-06-13 09:43:58 +08:00
Lixia Chen 6ae88c3987 Create TensorRow class that supports a row id. 2020-06-12 15:06:56 -04:00
mindspore-ci-bot 3b809f2b0b !1996 Fix single BatchNorm fission && SoftmaxGradExt fusion pass
Merge pull request !1996 from huanghui/single-batchnorm-fission-pass
2020-06-12 15:38:05 +08:00
huanghui 88eec2b894 fix single-batchnorm-fission && softmax-grad-ext-fusion pass 2020-06-12 14:53:22 +08:00
leopz c45f4d225d dump binary ir 2020-06-12 13:19:41 +08:00
hesham 0c5e47111b - Move MutableBuffer to be protected
- Add new CreateTensors
2020-06-11 17:32:03 -04:00
mindspore-ci-bot beefb20c01 !1983 Remove inheritance of Sampler from DatasetOp
Merge pull request !1983 from JesseKLee/sampler
2020-06-11 23:14:56 +08:00
huangdongrun 9522f59b87 support for tensor indexing in pynative
support tensor slice using constexpr

remove tensorslice metagraph

add pynative testcases
2020-06-11 19:14:22 +08:00
mindspore-ci-bot b3da41bd7a !1913 CocoDataset implementation
Merge pull request !1913 from xiefangqi/xfq_support_coco
2020-06-11 14:37:44 +08:00
xiefangqi 097cbcc0cb CocoDataset implementation 2020-06-11 11:52:17 +08:00
mindspore-ci-bot 81ba3b1b99 !1868 Enhance insert memcpy for hccl op
Merge pull request !1868 from huanghui/insert-memcpy-async-pass
2020-06-11 09:55:32 +08:00
mindspore-ci-bot 7b7932ced9 !1944 move hook function to PrimitivePy class
Merge pull request !1944 from wangqiuliang/move-hook-function-to-primitivepy
2020-06-11 09:29:00 +08:00
Jesse Lee 255adf7c6e Remove inheritance of Sampler from DatasetOp 2020-06-10 18:10:51 -04:00
mindspore-ci-bot 9e1dea1ff9 !1928 delete redundant reshape op
Merge pull request !1928 from yoonlee666/deletereshape
2020-06-10 20:11:22 +08:00
yoonlee666 881af56ec3 optimize redundant reshape op 2020-06-10 18:21:00 +08:00
huanghui 118496b3ec enhance insert memcpy 2020-06-10 18:00:08 +08:00
heleiwang 3ece8dd090 1. support get_all_edges, get_nodes_from_edge, get_sampled_neighbors, get_neg_sampled_neighbors and graph_info API
2. mod cora and citeseer conversion script
2020-06-10 15:52:26 +08:00
kingfo 38436f929f move hook function to primtivePy class 2020-06-10 15:33:46 +08:00
mindspore-ci-bot 38109a386b !1957 fix cmakelists
Merge pull request !1957 from jiangjinsheng/issue_merge
2020-06-10 11:45:23 +08:00
jiangjinsheng 709704d339 fixed CMakeLists.txt 2020-06-10 10:58:26 +08:00
mindspore-ci-bot bfc18f3adc !1873 synchronize latest ascend software 04 Jun 2020
Merge pull request !1873 from yanghaoran/master
2020-06-10 01:27:43 +08:00
mindspore-ci-bot 5eb95599f6 !1874 Updates to string tensor
Merge pull request !1874 from h.farahat/string_tensor_updates
2020-06-10 00:59:17 +08:00
yanghaoran 8da4c1a763 synchronize latest ascend software 04 Jun 2020 2020-06-09 23:34:13 +08:00
hesham f837ddc956 - Bug when empty strings sent to Python
- Support accepting Numpy of str as input
- Support batching strings
- Core logic of batch&pad is static
- Make Pad a utility function
2020-06-09 10:34:38 -04:00
zhaoting b16a552d41 Revert "Revert "add pattern AdjustAllReduceMulAdduse the old opadd test case for bugtemp fix try""
This reverts commit 705c71a257.
2020-06-09 20:56:36 +08:00
mindspore-ci-bot beb714d2d0 !1911 add a function to charge the node input and output is a scalar
Merge pull request !1911 from lianliguang/add-a-function-to-charge-the-node-input-or-output-if-is-a-scalar
2020-06-09 19:57:01 +08:00
yujianfeng 2ff9e74d07 Add unique process for duplicated indices 2020-06-09 10:12:39 +08:00
WilliamLian 9808e47663 change checkAicpu to CheckAICPU & add charge Scalar function to charge the input or output is scalar 2020-06-09 09:31:43 +08:00
huanghui b4c0ed4b36 add signle batchnorm fission pass 2020-06-08 10:08:23 +08:00
chujinjin 7465abc798 optimize transdata for pynative 2020-06-05 14:10:55 +08:00
mindspore-ci-bot 1973594bd1 !1774 [MD] minddataset support padding samples
Merge pull request !1774 from liyong126/mindrecord_padded_sample
2020-06-05 11:27:25 +08:00
mindspore-ci-bot b236beae28 !1615 convert constant bool tensor to bool
Merge pull request !1615 from amongo/GetBoolValueFromConstantTensor
2020-06-05 09:46:44 +08:00
liyong feff8899ac support padding samples 2020-06-05 09:14:42 +08:00
mindspore-ci-bot c51d90d84e !1767 Move LayerNormGrad split pass ahead of kernel select
Merge pull request !1767 from huanghui/LayerNormGrad-split-pass
2020-06-05 09:13:24 +08:00
mindspore-ci-bot 769ae609b4 !1808 consistent design for num_samples
Merge pull request !1808 from Jamie/numsamples
2020-06-04 22:12:55 +08:00
huangdongrun beacc26077 * add isconstant primitive
* add infer_value for common math ops
* convert constant bool tensor to bool value

* do not infer value when encounter 0 as division

for while condition, do not unrool if condition is a tensor
2020-06-04 21:51:44 +08:00
yujianfeng e87ac6525e Add batch norm fusion pattern for mix precision 2020-06-04 20:31:15 +08:00
huanghui cf87218fb7 place layernormgrad split pass before kernel select 2020-06-04 19:39:40 +08:00
Jamie Nisbet 51bc0c0460 consistent design for num_samples
updates

more update

more work

more fixin

post rebase updates

clang formatting

code review recovery

ci fixes

updates

update

update

update
2020-06-03 15:01:18 -04:00
mindspore-ci-bot 0426ed057b !1777 Remove ZerosLikeTensor and sub with ZerosTensor
Merge pull request !1777 from BowenK/master
2020-06-02 10:41:58 +08:00
BowenK 96379faa3a Remove ZerosLikeTensor and sub with ZerosLike 2020-06-02 09:52:12 +08:00
huanghui d1cec14a0c add 2 pattern for softmaxgradext fusion pass 2020-06-01 18:48:41 +08:00
kswang c63729b8e6 support mix target 2020-06-01 14:33:56 +08:00
mindspore-ci-bot cc9c004bc1 !1696 Enable ConfusionMulGrad fusion pass
Merge pull request !1696 from huanghui/TMP
2020-05-30 14:44:29 +08:00
mindspore-ci-bot 692f38ded2 !1532 clean pylint warning in test dir
Merge pull request !1532 from jinyaohui/pylint1
2020-05-30 10:13:45 +08:00
mindspore-ci-bot 59683a1d90 !1692 Fix topk bug for fasterrcnn
Merge pull request !1692 from meixiaowei/master
2020-05-30 09:56:40 +08:00
huanghui 71acaa5300 enable ConfusionMulGrad fusion pass in bert only 2020-05-30 09:46:21 +08:00
mindspore-ci-bot 387bcece9e !1666 Add 5 patterns for AdamApplyOneWithDecay fusion pass
Merge pull request !1666 from huanghui/AdamApplyOneWithDecay-fusion-pass
2020-05-30 09:43:07 +08:00
jinyaohui 86d197dfeb clean pylint 2020-05-29 23:00:00 +08:00
huanghui ff05aa1faa add newly 5 patterns for AdamApplyOneWithDecayRule fusion pass 2020-05-29 19:49:44 +08:00
yujianfeng e6f1cfa581 Check the input size of BatchNorm before fission in bert 2020-05-29 19:34:58 +08:00
meixiaowei 1778ec0135 fix topk bug 2020-05-29 19:04:18 +08:00
huanghui 99ca6b3e80 add SoftmaxGradExt fusion pass 2020-05-29 14:30:52 +08:00
mindspore-ci-bot 8556eee3fc !1578 recitify pretrained path and revert AdjustAllReduceMulAdduse
Merge pull request !1578 from gengdongjie/master
2020-05-28 20:25:50 +08:00
mindspore-ci-bot 9c858444b0 !1568 Fix pylint warning for test cases of optimizer, infer, parse and pynative.
Merge pull request !1568 from seatea/fix-pylint-warning
2020-05-28 16:59:57 +08:00
mindspore-ci-bot 04398cf88e !1433 add tensor_minnie and separate py from ir
Merge pull request !1433 from leopz/tensor_base
2020-05-28 16:00:56 +08:00
gengdongjie 705c71a257 Revert "add pattern AdjustAllReduceMulAdduse the old opadd test case for bugtemp fix try"
This reverts commit 3db8cfa54f.
2020-05-28 15:21:15 +08:00
leopz 4508134ceb add tensor_minnie and separate py from ir 2020-05-28 14:26:26 +08:00
mindspore-ci-bot c086d91aaf !1505 Add some checks in ConstToAttr[StridedSliceGrad] pass
Merge pull request !1505 from huanghui/stride-slice
2020-05-28 11:46:18 +08:00
seatea 7398526abc Fix pylint warning for test cases of optimizer, infer, parse and
pynative.
2020-05-28 11:35:33 +08:00
yujianfeng ee087bdf60 Check the size of topk input names before converting input to attr 2020-05-28 10:29:21 +08:00
Jesse Lee 3b80c10b1e Fix some timing hole in these two testcases 2020-05-27 14:22:37 -04:00
mindspore-ci-bot e311473401 !1453 Raise mse threshold in RandomCropDecodeResizeOp
Merge pull request !1453 from Alexey_Shevlyakov/fix_random_crop_decode_resize_ut
2020-05-27 23:58:58 +08:00
huanghui 1d65ae598a extract const_to_attr_strided_slice_grad pass 2020-05-27 17:30:17 +08:00
mindspore-ci-bot 5b9c145ff8 !1383 keep different attributes for cnode evaluation
Merge pull request !1383 from amongo/KeepPrimAttrInCNode
2020-05-27 13:02:34 +08:00
mindspore-ci-bot 5e2f440eed !1271 refactor of memreuse allocator to adapt the control stream
Merge pull request !1271 from yangjie159/refactor_memreuse_allocator
2020-05-27 10:24:16 +08:00
mindspore-ci-bot 650a45b233 !1490 Fix pylint warning
Merge pull request !1490 from seatea/fix-pylint-warning
2020-05-27 09:41:31 +08:00
seatea c6d8a4dc98 Fix pylint warning. 2020-05-26 21:23:06 +08:00
yujianfeng 94818cf255 Fix fusion condition of transpose and reshape 2020-05-26 17:30:38 +08:00
yangjie159 cbf5390b34 refactor memreuse allocator
remove stream id from membuf
add kernel dependence to determine whether is usable
2020-05-26 17:27:33 +08:00
huangdongrun 1159f2b11e add prim infer attr cache
modify infer to get abstract value and attr value map together

support get attr in specialize

clone primitive when specialize if attribute is not the same with
infered attribute
2020-05-26 16:19:58 +08:00
mindspore-ci-bot 2215e3267f !1419 remove old buffer fusion pass
Merge pull request !1419 from Etone.Chan/Resnet50
2020-05-26 09:16:06 +08:00