Commit Graph

956 Commits

Author SHA1 Message Date
mindspore-ci-bot 2fa2f86619 !2135 add tfrecord to mindrecord tool
Merge pull request !2135 from guozhijian/add_tools_tfrecord_to_mindrecord
2020-06-16 14:40:38 +08:00
hesham e2012a1de9 Slice Op 2020-06-16 02:32:40 -04:00
jonyguo 3353a20d8b add tool: tfrecord to mindrecord 2020-06-16 12:09:21 +08:00
mindspore-ci-bot 71d27c6854 !2068 Add InplaceAddD and InplaceSubD vm ops
Merge pull request !2068 from liuwenhao/master
2020-06-16 11:00:32 +08:00
mindspore-ci-bot 105dcb1c1e !2128 hidden range
Merge pull request !2128 from jiangjinsheng/issue_fix3
2020-06-16 10:37:27 +08:00
mindspore-ci-bot ea96cbcef2 !1979 fix partial primitive poly node
Merge pull request !1979 from fary86/fix_patial_primitive_poly_code
2020-06-16 09:35:57 +08:00
liuwenhao4 be40a90ec6 add InplaceAddD and InplaceSubD vm ops 2020-06-16 09:29:11 +08:00
jiangjinsheng 032e921298 hidden range 2020-06-16 09:18:25 +08:00
mindspore-ci-bot dceb3c2be4 !2026 Change C++ behavior in RandomCropAndResize
Merge pull request !2026 from MahdiRahmaniHanzaki/I1K3FL-random-resized-crop
2020-06-16 05:27:36 +08:00
Mahdi add29f95f5 resolved issues in the comments 2020-06-15 16:45:18 -04:00
mindspore-ci-bot 2cab44a637 !2028 FillOp for BERT
Merge pull request !2028 from nhussain/fillOp_learning
2020-06-16 02:45:45 +08:00
nhussain dd9bf09f0a added FillOp for #119 - special Ops 2020-06-15 11:30:43 -04:00
Peilin Wang 848e07d022 initial commit, start of BucketBatchByLengthOp
c implementation done, just need to call batch/pad

added python api and validator

added pybind/de_pipeline stuff, fixed some compile errors, figure out how null py::function works

added tiny bit of doc

integrated with static batch methods

fixed some bugs

some more bug fixes and cleanup

ci fix

fix ci

ci fix

fix ci

added test_cases and debugged

addressed code review comments

addressed code review comments

ci fix

ci fix

addressed code review comments

addressed code review comments
2020-06-15 10:20:01 -04:00
wangnan39@huawei.com d4e3d69f37 support loss scale for sparse situation 2020-06-15 22:17:53 +08:00
mindspore-ci-bot 7b6f13886f !1962 add vm support for operators include ApproximateEqual, InplaceUpdateD and InTopKD
Merge pull request !1962 from zhouneng/add_vm_support_for_ApproximateEqual_InplaceUpdateD_InTopKD
2020-06-15 21:00:35 +08:00
Jonathan Yan 87d2c27c7f random walk v1 2020-06-15 08:54:10 -04:00
mindspore-ci-bot 842f8231ba !2100 add op quant and dequant
Merge pull request !2100 from zhaozhenlong/op/quant-dequant-ge-open
2020-06-15 17:32:13 +08:00
zhaozhenlong ccda0f7b36 add op AscendQuant AscendDequant 2020-06-15 16:42:53 +08:00
mindspore-ci-bot 11f5f88021 !2010 fix operator issues for tuple_to_array and cast
Merge pull request !2010 from wangqiuliang/fix-tuple-to-array-issue
2020-06-15 15:38:47 +08:00
kingfo 9708e58259 fix TupleToArray & Cast operator issue 2020-06-15 14:39:10 +08:00
mindspore-ci-bot 5cd41905c0 !1820 [Auto parallel] Implementing the backward of 'EmbeddingLookup' primitive
Merge pull request !1820 from Xiaoda/the-backward-of-embeddinglookup
2020-06-15 11:53:11 +08:00
mindspore-ci-bot a8cf83acf2 !1932 Add CLUE dataset
Merge pull request !1932 from jiangzhiwen/dataset/clue
2020-06-15 11:48:35 +08:00
fary86 ffa3352088 Fix partial primitive poly node 2020-06-15 10:56:55 +08:00
jiangzhiwen e0e167a000 add CLUE dataset 2020-06-15 10:40:46 +08:00
zhouneng 51fe3501a4 add vm support for ApproximateEqual, InplaceUpdateD and InTopKD. 2020-06-15 10:18:31 +08:00
hesham a22763b612 Bug in CIFAR after removing GetMutabble buffer
Fixes # I1KIPC
2020-06-14 13:27:17 -04:00
jonyguo bb2082daec fix: MindDataset padded log error 2020-06-13 19:46:24 +08:00
Xiaoda Zhang 20d2012a0e implementing the backward of embeddinglookup 2020-06-13 16:57:56 +08:00
mindspore-ci-bot 403c30c7da !1919 change tensor dtype and shape from function to attr
Merge pull request !1919 from zhangbuxue/change_tensor_dtype_and_shape_from_function_to_attr
2020-06-13 10:28:55 +08:00
buxue 66bbdb4a31 change tensor dtype and shape from function to attr 2020-06-12 19:03:23 +08:00
mindspore-ci-bot b285c8fa9d !1973 develop TensorScatterUpdate op and access ge and vm
Merge pull request !1973 from zhangbuxue/develop_TensorScatterUpdate_op_and_access_ge_and_vm
2020-06-12 18:40:06 +08:00
buxue 8aee6b07d6 develop TensorScatterUpdate op and access ge and vm 2020-06-12 17:43:40 +08:00
mindspore-ci-bot 3536185f5b !2007 add lazy adam optimizer and support sparse adam&ftrl for cpu backend
Merge pull request !2007 from wangnan39/add_lazy_adam_optim_and_support_sparse_admm_for_cpu_backend
2020-06-12 17:22:03 +08:00
mindspore-ci-bot a8378a3357 !1924 Add TBE ops ApplyAdaMax\ ApplyAdadelta\ ApplyAdagrad\ ApplyAdagradV2 for VM.
Merge pull request !1924 from liuxiao/ops-for-VM
2020-06-12 17:16:36 +08:00
wangnan39@huawei.com 4042f16ce4 add lazy adam optim and support sparse adam & ftrl for cpu backend 2020-06-12 16:06:11 +08:00
mindspore-ci-bot 11875d8495 !2044 Add_Sparse_GatherV2_distributed_op
Merge pull request !2044 from lichen/add_sparse_gatherv2
2020-06-12 14:19:30 +08:00
mindspore-ci-bot ac5878b4b7 !1939 Complete vm ops for DataFormatDimMap and HistogramFixedWidthD
Merge pull request !1939 from lihongkang/lhk_master
2020-06-12 11:53:21 +08:00
mindspore-ci-bot 5c7cb7bd71 !2023 add op CosineEmbeddingLoss
Merge pull request !2023 from zhaozhenlong/op/cosine-embedding-loss-open
2020-06-12 11:09:55 +08:00
lichenever e0e055a0b8 add sparse gatherv2 2020-06-12 11:09:28 +08:00
mindspore-ci-bot 3085e51e45 !1922 check parameter num_samples of sampler
Merge pull request !1922 from yanghaitao/yht_check_num_samples_sampler
2020-06-12 10:22:14 +08:00
mindspore-ci-bot 5b0472683c !1737 sparse feature backpropagation
Merge pull request !1737 from lirongzhen1/sparse
2020-06-12 09:51:41 +08:00
lihongkang bbbd980728 add vm for histogramfixedwidth and dataformatdimmap 2020-06-12 09:34:58 +08:00
mindspore-ci-bot 4df861cb62 !1672 support load full dataset on each device
Merge pull request !1672 from yihuaijie/dev
2020-06-12 09:24:04 +08:00
mindspore-ci-bot 1b5d9a1194 !1981 Implemented from_dataset, a way to build a vocab from existing dataset
Merge pull request !1981 from ZiruiWu/from_dataset_dev
2020-06-12 08:08:19 +08:00
Zirui Wu 880ce5ea26 implemented from_dataset
fix complie error

more tests

address CI complains

fix ci

adress review comments

address review cmts
2020-06-11 16:20:19 -04:00
Alexey Shevlyakov 4e333a2f22 MindData profiler infrastructure 2020-06-11 14:52:36 -04:00
mindspore-ci-bot 0a95223f25 !1910 RandomColorAdjust error for grayscale images
Merge pull request !1910 from MahdiRahmaniHanzaki/I1J9SQ-random-color-adjust-bug
2020-06-11 23:15:19 +08:00
yanghaitao 8f16cff12e add para check for sampler 2020-06-11 22:26:06 +08:00
mindspore-ci-bot bf172da4c3 !2015 add test case for floatxx / floatxx numpy
Merge pull request !2015 from guozhijian/add_test_case_for_floatxx
2020-06-11 21:59:03 +08:00
Kang 3ba2074213 Add MixedPrecisionCast for Dict 2020-06-11 21:32:08 +08:00
zhaozhenlong 19c5921c06 composed op CosineEmbeddingLoss 2020-06-11 21:28:35 +08:00
mindspore-ci-bot f859dfecc8 !1920 SupportPynativeIndexing
Merge pull request !1920 from amongo/SupportPynativeIndexing
2020-06-11 21:11:36 +08:00
mindspore-ci-bot 961af9fed1 !2014 adapt op SparseGatherV2
Merge pull request !2014 from zhaozhenlong/op/sparse-gather-v2-vm
2020-06-11 20:35:37 +08:00
Yi Huaijie e5c351690b support load full dataset on each device 2020-06-11 19:48:06 +08:00
jonyguo 1de7271afc add floatxx test case 2020-06-11 19:26:54 +08:00
huangdongrun 9522f59b87 support for tensor indexing in pynative
support tensor slice using constexpr

remove tensorslice metagraph

add pynative testcases
2020-06-11 19:14:22 +08:00
zhaozhenlong 562c2b8d3d sparse gather v2 2020-06-11 19:11:56 +08:00
mindspore-ci-bot 9dfb1011fe !1854 add SparseApplyAdam and SparseApplyLazyAdam ops
Merge pull request !1854 from wangnan39/add_ops_sparse_adam_and_sparse_lazy_adam
2020-06-11 16:35:03 +08:00
lirongzhen1 516b56cb64 sparse feature bp 2020-06-11 16:32:24 +08:00
wangnan39@huawei.com de21dbdaef add ops SparseApplyAdam and SparseApplyLazyAdam 2020-06-11 15:50:28 +08:00
ms_yan bc22c172b8 add TensorDataset and its ut 2020-06-11 15:24:12 +08:00
mindspore-ci-bot 251a6667a5 !1989 fix MindDataset distribute shuffle error
Merge pull request !1989 from guozhijian/fix_distribute_shuffle
2020-06-11 14:51:17 +08:00
mindspore-ci-bot b3da41bd7a !1913 CocoDataset implementation
Merge pull request !1913 from xiefangqi/xfq_support_coco
2020-06-11 14:37:44 +08:00
mindspore-ci-bot 3b8edd5a5b !1918 sparse grad for gatherv2
Merge pull request !1918 from riemann_penn/sparse_grad_for_gatherv2
2020-06-11 14:11:49 +08:00
liuxiao cda547e92f add tbe some ops about optimizer for vm 2020-06-11 12:35:00 +08:00
panyifeng acaa66a738 sparse grad for gatherv2 2020-06-11 12:00:53 +08:00
xiefangqi 097cbcc0cb CocoDataset implementation 2020-06-11 11:52:17 +08:00
jonyguo 96859f44b6 fix: MindDataset distribute shuffle bug 2020-06-11 11:06:34 +08:00
mindspore-ci-bot 7b7932ced9 !1944 move hook function to PrimitivePy class
Merge pull request !1944 from wangqiuliang/move-hook-function-to-primitivepy
2020-06-11 09:29:00 +08:00
Mahdi ba2e2dced4 fixed some warnings and typos 2020-06-10 17:18:56 -04:00
Tinazhang 2812cd57db fix pylint error 2020-06-10 15:55:11 -04:00
mindspore-ci-bot fe0c3e9a8f !1908 Add UT to six data vision transforms ops
Merge pull request !1908 from Tinazhang/ut-normalize
2020-06-11 00:43:57 +08:00
mindspore-ci-bot eecf0a9ab8 !1968 support vm for range
Merge pull request !1968 from jiangjinsheng/vm_FusedMulApplyMomentumExtern
2020-06-10 17:51:15 +08:00
heleiwang 3ece8dd090 1. support get_all_edges, get_nodes_from_edge, get_sampled_neighbors, get_neg_sampled_neighbors and graph_info API
2. mod cora and citeseer conversion script
2020-06-10 15:52:26 +08:00
jiangjinsheng a1efe4d14d support vm for range 2020-06-10 15:51:35 +08:00
kingfo 38436f929f move hook function to primtivePy class 2020-06-10 15:33:46 +08:00
mindspore-ci-bot 444d9484d7 !1916 add ProximalAdagrad Optimizer
Merge pull request !1916 from lilei/add_proximal_ada_grad_optimizer
2020-06-10 14:40:20 +08:00
lilei 36d9e353a5 add proximal_ada_grad optimizer 2020-06-10 09:21:36 +08:00
mindspore-ci-bot bfc18f3adc !1873 synchronize latest ascend software 04 Jun 2020
Merge pull request !1873 from yanghaoran/master
2020-06-10 01:27:43 +08:00
mindspore-ci-bot 5eb95599f6 !1874 Updates to string tensor
Merge pull request !1874 from h.farahat/string_tensor_updates
2020-06-10 00:59:17 +08:00
yanghaoran 8da4c1a763 synchronize latest ascend software 04 Jun 2020 2020-06-09 23:34:13 +08:00
mindspore-ci-bot 0e7839826e !1945 [bug]fix bug in '=', use signature to support auto cast in assign.
Merge pull request !1945 from vlne-v1/I1JXUP-resnet50-thor-assign-fail
2020-06-09 22:57:01 +08:00
Tinazhang c3de5c7a54 adding new TCs to six ops and skip md5 case in RandomPerspective 2020-06-09 10:51:45 -04:00
hesham f837ddc956 - Bug when empty strings sent to Python
- Support accepting Numpy of str as input
- Support batching strings
- Core logic of batch&pad is static
- Make Pad a utility function
2020-06-09 10:34:38 -04:00
Wei Luning ee8420aefa Make assign operator to use the signature. 2020-06-09 21:12:56 +08:00
zhaoting b16a552d41 Revert "Revert "add pattern AdjustAllReduceMulAdduse the old opadd test case for bugtemp fix try""
This reverts commit 705c71a257.
2020-06-09 20:56:36 +08:00
liuxiao 6856c2ac7a Adapt ops ApplyProximalAdagrad for GE 2020-06-09 14:20:21 +08:00
wenkai ab6b6add0b cpu support summary 2020-06-09 09:51:28 +08:00
mindspore-ci-bot 10fd781b15 !1831 Add order parameter function in group params
Merge pull request !1831 from ghzl/add-oder-parameters-in-group-functions
2020-06-08 17:38:43 +08:00
mindspore-ci-bot c82a8bf483 !1678 modify print
Merge pull request !1678 from jinyaohui/print
2020-06-08 11:20:53 +08:00
guohongzilong 85a06b00c6 add order function in group params 2020-06-08 11:09:18 +08:00
mindspore-ci-bot 0a897b0ce7 !1865 add inv,invgrad&invert for vm
Merge pull request !1865 from JichenZhao/bnops_for_vm
2020-06-08 10:42:20 +08:00
zhaojichen cdb7ec937b add inv,invgrad&invert for vm 2020-06-05 08:23:51 -04:00
zhaozhenlong 1f342fb926 add op BroadcastTo 2020-06-05 17:45:53 +08:00
mindspore-ci-bot 1c640face9 !1826 fix bug when check learning_rate in AdamWeightDecayDynamicLR
Merge pull request !1826 from wangnan39/fix_lr_check_bug_in_adamweightdecay_dynamic_lr
2020-06-05 14:35:20 +08:00
mindspore-ci-bot bd34c6ec8b !1853 Fix initializer
Merge pull request !1853 from amongo/FixInitializer
2020-06-05 11:46:20 +08:00
mindspore-ci-bot 1973594bd1 !1774 [MD] minddataset support padding samples
Merge pull request !1774 from liyong126/mindrecord_padded_sample
2020-06-05 11:27:25 +08:00
mindspore-ci-bot b236beae28 !1615 convert constant bool tensor to bool
Merge pull request !1615 from amongo/GetBoolValueFromConstantTensor
2020-06-05 09:46:44 +08:00
liyong feff8899ac support padding samples 2020-06-05 09:14:42 +08:00
mindspore-ci-bot 5c21616293 !1807 Implemented Ngram TensorOp for dataset
Merge pull request !1807 from ZiruiWu/ngram_dev
2020-06-05 01:04:27 +08:00
huangdongrun 9081041199 fix initiliazer 2020-06-04 22:22:41 +08:00
mindspore-ci-bot 769ae609b4 !1808 consistent design for num_samples
Merge pull request !1808 from Jamie/numsamples
2020-06-04 22:12:55 +08:00
Zirui Wu dbf9936ec4 Implemented n-gram for dataset TensorOp 2020-06-04 09:57:44 -04:00
huangdongrun beacc26077 * add isconstant primitive
* add infer_value for common math ops
* convert constant bool tensor to bool value

* do not infer value when encounter 0 as division

for while condition, do not unrool if condition is a tensor
2020-06-04 21:51:44 +08:00
jinyaohui 5e43edc474 clean pylint 2020-06-04 21:03:30 +08:00
mindspore-ci-bot 97524b9ddd !1823 support vm for ConfusionMatrix
Merge pull request !1823 from jiangjinsheng/vm_ConfusionMatrix
2020-06-04 20:04:19 +08:00
jiangjinsheng fc4cf5a470 add vm support for ConfusionMatrix 2020-06-04 14:12:13 +08:00
mindspore-ci-bot 0c1674496f !1819 Restricting modify non_Parameter class members
Merge pull request !1819 from zhangbuxue/restricting_modify_non-Parameter_class_members
2020-06-04 09:53:30 +08:00
Jamie Nisbet 51bc0c0460 consistent design for num_samples
updates

more update

more work

more fixin

post rebase updates

clang formatting

code review recovery

ci fixes

updates

update

update

update
2020-06-03 15:01:18 -04:00
mindspore-ci-bot bc7a3a1bef !1806 Add crop size check to python RandomCrop op
Merge pull request !1806 from Tinazhang/random-crop-error-msg
2020-06-03 23:28:22 +08:00
wangnan39@huawei.com c9b7d95c2c fix lr check bug in AdamWeightDecayDynamicLR 2020-06-03 19:20:36 +08:00
buxue 94c9019d8e restricting modify non_Parameter class members 2020-06-03 17:17:46 +08:00
mindspore-ci-bot 5d397d8404 !1804 add tensor compare & len & constexpr feature
Merge pull request !1804 from wangqiuliang/add-tensor-compare-len-consexpr-feature
2020-06-03 15:41:00 +08:00
Xiaoda Zhang 1cfb52bc0e add the reshape part of the embeddinglookup backward operator 2020-06-03 10:39:45 +08:00
kingfo 9785178b88 add tensor compare & len & constexpr operation 2020-06-03 10:27:41 +08:00
Tinazhang 33fe66fd1e fix error handling for bigger crop size case 2020-06-02 11:06:41 -04:00
liuwenhao4 ad4996d528 Register forward and backward operations of Ceil 2020-06-02 20:48:37 +08:00
mindspore-ci-bot 80f581fc02 !1713 [Dataset] Clean pylint.
Merge pull request !1713 from luoyang/pylint
2020-06-02 16:54:29 +08:00
mindspore-ci-bot d5f55f0820 !1769 [AutoParallel]GatherV2_support_host_device
Merge pull request !1769 from lichen/gatherv2_support_host_and_device
2020-06-02 16:52:54 +08:00
mindspore-ci-bot da06310ae0 !1766 [bug][auto cast]fix bug when do auto cast
Merge pull request !1766 from vlne-v1/I1J0M0-amp-do-auto-cast-failed
2020-06-02 15:44:10 +08:00
Wei Luning 7e4d972f6f fix bug in do signature 2020-06-02 11:59:19 +08:00
mindspore-ci-bot e79df7c169 !1697 optimize clip_norm
Merge pull request !1697 from chenhaozhe/bert-optimization
2020-06-02 11:28:53 +08:00
chenhaozhe 435fc12e28 optimize clip_norm 2020-06-02 09:48:29 +08:00
Yang 5522edc4b5 !1713 [Dataset] Clean pylint. 2020-06-02 09:02:19 +08:00
lichenever 1437966c98 gatherv2_support_host_and_device 2020-06-01 21:06:35 +08:00
zhaozhenlong 270f79c8c2 add op BasicLSTMCell vm 2020-06-01 21:06:12 +08:00
mindspore-ci-bot 0b94376bb3 !1762 support auto cast bool scalar and tensor to number tensor
Merge pull request !1762 from zhangbuxue/support_convert_bool_scalar_and_tensor_to_number_tensor
2020-06-01 20:24:38 +08:00
mindspore-ci-bot b9ba99bb13 !1685 [Auto parallel] Fix the bugs in Embeddinglookup forward operator
Merge pull request !1685 from Xiaoda/fix-the-embeddinglookup-bug
2020-06-01 19:31:50 +08:00
mindspore-ci-bot addf8e7d06 !1750 add vm support for operaotr Expm1
Merge pull request !1750 from zhouneng/add_vm_support_for_expm1
2020-06-01 17:43:20 +08:00
buxue 62f7dc49e5 support convert bool scalar and tensor to number tensor 2020-06-01 16:30:50 +08:00
Xiaoda Zhang 55ef468a7f fix the embeddinglookup bug 2020-06-01 15:52:22 +08:00
lihongkang 436b309915 add vm for cosh and sinh 2020-06-01 15:22:12 +08:00
zhouneng e5419f7bd1 add vm support for Expm1 2020-06-01 14:39:04 +08:00
rick_sanchez e2a322b6b7 Modify code to support dynamic graph. 2020-06-01 10:20:24 +08:00
mindspore-ci-bot 3ec8f9bb40 !1695 Fixing some tiny faults about Pylint in my code(ops)
Merge pull request !1695 from liuwenhao/master
2020-06-01 09:30:48 +08:00
mindspore-ci-bot e1eb52738b !1682 Add tbe op SparseApplyProximalAdagradD-SparseApplyFtrlD-ApplyProximalAdagrad for VM.
Merge pull request !1682 from liuxiao/SparseApplyProximalAdagradD-SparseApplyFtrlD-ApplyProximalAdagradD
2020-06-01 09:19:44 +08:00
liuwenhao4 7b911886ec Fixing some tiny faults about Pylint in my code(ops) 2020-05-30 16:55:37 +08:00
mindspore-ci-bot efaaf58074 !1518 add register info for Atan and AtanGrad and Atanh
Merge pull request !1518 from zhouneng/add_vm_support_Atan_AtanGrad_Atanh
2020-05-30 16:48:09 +08:00
liuxiao 4efd151784 add tbe op SparseApplyProximalAdagradD-SparseApplyFtrlD-ApplyProximalAdagradD for VM 2020-05-30 16:00:21 +08:00
mindspore-ci-bot 0920660ecc !1712 clean pylint warnings of parallel test cases
Merge pull request !1712 from yihuaijie/master
2020-05-30 15:39:49 +08:00
mindspore-ci-bot 3d28ba10ef !1631 fix reviewbot of mem_reuse
Merge pull request !1631 from yangjie159/fix_reviewbot_of_mem_reuse
2020-05-30 15:25:43 +08:00
zhouneng e6b9432aca add register for Atan AtanGrad Atanh 2020-05-30 15:08:28 +08:00
Yi Huaijie d7e1ab1445 clean pylint warnings 2020-05-30 11:35:00 +08:00
mindspore-ci-bot bbc64b8873 !1528 support vm for BesselI0e and BesselI1e
Merge pull request !1528 from jiangjinsheng/vm_bessel
2020-05-30 11:30:22 +08:00
mindspore-ci-bot 692f38ded2 !1532 clean pylint warning in test dir
Merge pull request !1532 from jinyaohui/pylint1
2020-05-30 10:13:45 +08:00
mindspore-ci-bot 6f92c4a124 !1501 add vm support for operators in mindspore.ops.operaitons package. Inlcude ACos, ACosGrad, Acosh, AcoshGrad, ArgMinD and ApplyCenteredRMSProp
Merge pull request !1501 from zhouneng/add_vm_support
2020-05-30 09:56:02 +08:00
mindspore-ci-bot 7878743400 !1638 fixed rounding edge case in split
Merge pull request !1638 from Peilin/splitOp-after-testing
2020-05-30 05:31:33 +08:00
mindspore-ci-bot 0e3dd8149a !1703 Adding sync_wait input check
Merge pull request !1703 from EricZ/master
2020-05-30 05:29:38 +08:00
mindspore-ci-bot c366b3fb18 !1704 fix num rows bug in sampler
Merge pull request !1704 from Peilin/fix-random-sampler-bug
2020-05-30 05:27:20 +08:00
Eric 8e1b2107ce Added example for sync_wait bad batch_num
Added broken test case for cv

Fixed error handling in sync_wait
2020-05-29 16:30:12 -04:00
mindspore-ci-bot 976b4793d1 !1544 Python Unit Test for TenCrop
Merge pull request !1544 from MahdiRahmaniHanzaki/I1IHNG-ten-crop
2020-05-30 03:02:29 +08:00
mindspore-ci-bot 15a196eba9 !1636 Add TCs to 3 vision transformation ops and cleanup config settings
Merge pull request !1636 from Tinazhang/randomGray
2020-05-30 03:02:15 +08:00
Peilin Wang 3ef3d1433d fixed num_samples bug for RandomSampler 2020-05-29 13:09:26 -04:00
Tinazhang f4a61fdbb2 Adding new UT cases and missing TCs in PY Ops. 2020-05-29 12:12:17 -04:00
Peilin Wang 5469be2a97 fixed bug for split, RandomSampler and some other cleanup
add another test case

typo

merge conflict

another PR changed testing behavior, updated test cases in this commit

added input check for use_sampler

addressed code review comments

fixed pylint, not related to my changes

fixed edge case of rounding in getting split sizes

fix pylint
2020-05-29 11:27:32 -04:00
jinyaohui 86d197dfeb clean pylint 2020-05-29 23:00:00 +08:00
zhouneng 65b0f8d1b3 为算子进行VM流程对接 2020-05-29 16:45:14 +08:00
jiangjinsheng c3f681f0cf vm for BesselI0e and BesselI1e 2020-05-29 16:04:27 +08:00
mindspore-ci-bot d3dbb10b6d !1563 Fixing some tiny faults about Pylint in my code(ops)
Merge pull request !1563 from liuwenhao/master
2020-05-29 15:04:51 +08:00
mindspore-ci-bot 8316f736ea !1650 Support forward reduce scatter for Matmul
Merge pull request !1650 from yangzhenzhang/forward-reduce-scatter
2020-05-29 14:45:32 +08:00
liuwenhao4 f87c70a9ab Fixing some tiny faults about Pylint in my code(ops) 2020-05-29 12:01:04 +08:00
mindspore-ci-bot 57874cd61f !1372 [Auto parallel] Add a new primitive EmbeddingLookup
Merge pull request !1372 from Xiaoda/add-embedinglookup-primitive
2020-05-29 11:06:25 +08:00
yangzhenzhang 19bd830539 support forward reduce scatter for matmul 2020-05-29 10:48:32 +08:00
mindspore-ci-bot f523a0f83c !1600 [AutoParallel]Fix GatherV2 bug
Merge pull request !1600 from lichen/fix_auto_parallel_gatherv2_bug
2020-05-29 10:27:14 +08:00
Xiaoda Zhang 4154adf196 add embedinglookup primitive 2020-05-29 10:15:09 +08:00
Mahdi dfc097019b Added TenCrop test
Added unit tests for both testing the functinality of the TenCrop and
its error messages. Due to the similarity of this method to FiveCrop the
test cases are similar to FiveCrop test cases.
Signed-off-by: Mahdi <mahdi.rahmani.hanzaki@huawei.com>

added error_msg function call in the main method

refactored the test and added visual representation of the results

Separated the two error cases into two different functions and used the
visualize function in util.py to plot the result of TenCrop.
Signed-off-by: Mahdi <mahdi.rahmani.hanzaki@huawei.com>

Added new test cases

Added new test cases including test case for checking the error message
when the size variable is not a positive integer, test case for
rectangle crop, test case for vertical flip setting, and testing for
similarity of the result of TenCrop for the same input data in different runs.
Signed-off-by: Mahdi <mahdi.rahmani.hanzaki@huawei.com>

changed visualize in test_five_crop

Changed the visualize function in test_five_crop to use the already
existing function in util.py
Signed-off-by: Mahdi <mahdi.rahmani.hanzaki@huawei.com>

made generate_golden variable global
2020-05-28 17:52:56 -04:00
yangjie159 37904cea01 fix reviewBot of mem_reuse 2020-05-28 23:40:20 +08:00
mindspore-ci-bot 21da86b393 !1591 add get_dataset_size for CelebADataset
Merge pull request !1591 from yanghaitao/yht_celeba_get_dataset_size
2020-05-28 22:21:43 +08:00
lichenever c223fde566 fix auto parallel gatherv2 bug 2020-05-28 20:34:35 +08:00
mindspore-ci-bot 8556eee3fc !1578 recitify pretrained path and revert AdjustAllReduceMulAdduse
Merge pull request !1578 from gengdongjie/master
2020-05-28 20:25:50 +08:00
mindspore-ci-bot ec5363ad9d !1593 Fix the bug that there is only return node in the forward graph
Merge pull request !1593 from yangzhenzhang/reshape-optimized
2020-05-28 19:30:26 +08:00
mindspore-ci-bot 4bf1c5099a !1551 add onnx ops for deepfm
Merge pull request !1551 from wandongdong/master
2020-05-28 17:31:05 +08:00
mindspore-ci-bot 39c1966593 !1488 add vm ops: Asin, AsinGrad, Asinh, AsinhGrad
Merge pull request !1488 from fangzehua/fzh_edit
2020-05-28 17:12:01 +08:00
mindspore-ci-bot 19ce0c372a !1257 Implicit type conversion
Merge pull request !1257 from candanzg/implicit_type_conversion2
2020-05-28 17:05:56 +08:00
yanghaitao cc6c7a3f60 add get_dataset_size to celebadataset 2020-05-28 17:00:14 +08:00
mindspore-ci-bot 9c858444b0 !1568 Fix pylint warning for test cases of optimizer, infer, parse and pynative.
Merge pull request !1568 from seatea/fix-pylint-warning
2020-05-28 16:59:57 +08:00
mindspore-ci-bot 1a4abefa9a !1385 support for multi nest switch
Merge pull request !1385 from amongo/SupportMultiSwitch
2020-05-28 16:21:10 +08:00
mindspore-ci-bot 2a6a3e012c !1555 fix bug in lamb warmup step check
Merge pull request !1555 from wangnan39/fix_bug_in_check_lamb_warmup_step
2020-05-28 16:08:43 +08:00
yangzhenzhang 1413f520d7 support reshape optimized 2020-05-28 16:05:36 +08:00
mindspore-ci-bot 0f4dc13e8e !1478 [Dataset] Fix CI warnings, clean pylint.
Merge pull request !1478 from luoyang/pylint
2020-05-28 15:54:52 +08:00
gengdongjie 705c71a257 Revert "add pattern AdjustAllReduceMulAdduse the old opadd test case for bugtemp fix try"
This reverts commit 3db8cfa54f.
2020-05-28 15:21:15 +08:00
wandongdong 9c5f6b9198 add onnx ops for deepfm 2020-05-28 15:06:01 +08:00
fangzehua c0b8a90105 add vm ops: asin asinh asingrad asinhgrad 2020-05-28 14:58:23 +08:00
mindspore-ci-bot dd54ffdbdb !1491 Complete vm ops for ReduceAllD, SparseApplyAdagradD and UnsortedSegmentMinD
Merge pull request !1491 from lihongkang/master
2020-05-28 14:45:59 +08:00
mindspore-ci-bot 3dc061165b !1559 Voc dataset support split ops
Merge pull request !1559 from xiefangqi/xfq_voc_support_split
2020-05-28 14:17:35 +08:00
Yang 9b2a778d94 !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
wangnan39@huawei.com 810ccf80d8 fix_bug_in_check_lamb_warmup_step 2020-05-28 12:15:12 +08:00
seatea 7398526abc Fix pylint warning for test cases of optimizer, infer, parse and
pynative.
2020-05-28 11:35:33 +08:00
xiefangqi 5e4728c50f add voc support split 2020-05-28 11:18:32 +08:00
lihongkang a36880f0ef add vms for reducealld etc. 2020-05-28 11:00:02 +08:00
liuwenhao4 a7ad0d0a49 Fixing some tiny faults about Pylint in my code(ops) 2020-05-28 09:52:42 +08:00
mindspore-ci-bot fb7e4eac76 !1535 change hook function grad input to tuple
Merge pull request !1535 from wangqiuliang/change-hook-grad-input-to-tuple
2020-05-28 09:36:28 +08:00
mindspore-ci-bot ff4e4c2ee2 !1533 Fix pylint warning for pynative test cases
Merge pull request !1533 from seatea/fix-pylint-warning-for-pynative-mode
2020-05-28 08:11:42 +08:00
mindspore-ci-bot 0fe3ff2761 !1506 Setting auto parallel flag for dataset wrap cell
Merge pull request !1506 from yangzhenzhang/set-auto-parallel-for-dataset-wrap
2020-05-27 21:50:43 +08:00
mindspore-ci-bot 77547cdfc0 !1530 support tensor set item the number value type is similar as tensor dtype
Merge pull request !1530 from zhangbuxue/support_tensor_getitem_number_value_type_similar_as_tensor_dtype
2020-05-27 21:29:24 +08:00
mindspore-ci-bot 906389b3a7 !1382 support create new item when dictionary set item key not exist
Merge pull request !1382 from amongo/DictionarySupportSetNewItem
2020-05-27 21:08:39 +08:00
kingfo 8f7e571a0b change hook grad input to tuple 2020-05-27 20:34:07 +08:00
mindspore-ci-bot df347785c3 !1508 add op BitwiseAnd BitwiseOr BitwiseXor vm
Merge pull request !1508 from zhaozhenlong/op/bitwise-and-or-xor
2020-05-27 20:05:23 +08:00
candanzg 2429da19fb implicit type conversion
Signed-off-by: candanzg <zhangshucheng@huawei.com>
2020-05-27 20:04:52 +08:00
seatea 21ab029227 Fix pylint warning for files under `pynative_mode` directory. 2020-05-27 19:28:31 +08:00
mindspore-ci-bot c8b30f9290 !1504 add custom tbe ops for quant aware training
Merge pull request !1504 from wandongdong/master
2020-05-27 19:18:22 +08:00
buxue d226a23b65 support tensor set item the number value type is similar as tensor dtype not same 2020-05-27 18:08:10 +08:00
wandongdong d35c41e737 add custom tbe ops for quant aware training 2020-05-27 17:09:34 +08:00
mindspore-ci-bot 9c20b1d6f7 !1512 fix reshape reshape case
Merge pull request !1512 from yao_yf/fix_reshape_reshape_graph
2020-05-27 16:08:25 +08:00
zhaozhenlong 6fa2813945 add op BitwiseAnd BitwiseOr BitwiseXor 2020-05-27 16:00:25 +08:00
mindspore-ci-bot b46ad9a1bb !1398 Update the bert scripts according to rules of modelzoo
Merge pull request !1398 from chenhaozhe/update_bert_script
2020-05-27 15:55:09 +08:00
yangzhenzhang 2f8516e5d7 set auto parallel for dataset warp cell 2020-05-27 15:27:22 +08:00
mindspore-ci-bot ad279e90fd !1407 support mixed tensor index for tensor get item and set item and support in operator.
Merge pull request !1407 from zhangbuxue/support_mixed_tensor_for_tensor_get_item_and_tensor_set_item
2020-05-27 14:49:21 +08:00
chenhaozhe b6aceddeab update bert scripts according to rules of modelzoo 2020-05-27 14:27:09 +08:00
yao_yf 96c9569dca fix reshape reshape case 2020-05-27 14:25:40 +08:00
mindspore-ci-bot 2e684e89e7 !1446 pylint clean
Merge pull request !1446 from liuxiao78/master
2020-05-27 14:15:14 +08:00
mindspore-ci-bot 5b9c145ff8 !1383 keep different attributes for cnode evaluation
Merge pull request !1383 from amongo/KeepPrimAttrInCNode
2020-05-27 13:02:34 +08:00
mindspore-ci-bot 2eedd32120 !1472 add operator HostAllGather and HostReduceScatter
Merge pull request !1472 from yihuaijie/master
2020-05-27 11:41:45 +08:00
buxue 7ae289a197 Support mixed tensor for tensor getitem or setitem. 2020-05-27 11:19:51 +08:00
huangdongrun e9aa280f86 add support for dictionary set item which does not exist 2020-05-27 11:19:20 +08:00
mindspore-ci-bot b94949ea99 !1477 support vm for SpaceToBatchND and BatchToSpaceND
Merge pull request !1477 from jiangjinsheng/BatchToSpaceND
2020-05-27 10:29:43 +08:00
mindspore-ci-bot 4e8e82f24a !1457 fix 3 bug reports for split
Merge pull request !1457 from Peilin/splitOp-after-testing
2020-05-27 10:08:57 +08:00
jiangjinsheng a45dfca142 support BatchToSpaceND and SpaceToBatchND 2020-05-27 09:13:12 +08:00
Peilin Wang d4c93575e7 fixed bug for split, RandomSampler and some other cleanup
add another test case

typo

merge conflict

another PR changed testing behavior, updated test cases in this commit

added input check for use_sampler

addressed code review comments

fixed pylint, not related to my changes
2020-05-26 16:29:52 -04:00
yangzhenzhang 7c237620ba add sigmoid op 2020-05-26 21:33:32 +08:00
huangdongrun 334d038008 add support for multi switch
resolve review
2020-05-26 21:20:29 +08:00
“liuxiao” 73a287e5e0 pylint clean 2020-05-26 19:46:14 +08:00
“liuxiao” ebbccca78b pylint clean 2020-05-26 19:36:54 +08:00
“liuxiao” f4542f810b pylint clean 2020-05-26 19:11:12 +08:00
Yi Huaijie 2f8e7ff693 add operator HostAllGather and HostReduceScatter 2020-05-26 17:41:20 +08:00
huangdongrun 1159f2b11e add prim infer attr cache
modify infer to get abstract value and attr value map together

support get attr in specialize

clone primitive when specialize if attribute is not the same with
infered attribute
2020-05-26 16:19:58 +08:00
zhaozhenlong 55d1927534 add op scatter add vm 2020-05-26 12:17:23 +08:00
mindspore-ci-bot 831ceba6eb !1277 Fixing some tiny faults about Pylint in ME code
Merge pull request !1277 from liuwenhao/master
2020-05-26 11:08:10 +08:00
Yang abca62f407 10:00 26/5 clean pylint 2020-05-26 10:05:12 +08:00
mindspore-ci-bot 93fc82b8f7 !1447 remove unused variable
Merge pull request !1447 from yihuaijie/master
2020-05-26 09:17:48 +08:00
mindspore-ci-bot 0b191615a9 !1427 fix check bprop attr error
Merge pull request !1427 from panyifeng/fix_check_bprop_attr_error
2020-05-26 09:10:51 +08:00
mindspore-ci-bot 0a8ef2fe72 !1455 Cleanup dataset UT: restore config support
Merge pull request !1455 from cathwong/ckw_dataset_config_util
2020-05-26 05:40:39 +08:00
Cathy Wong f891e1755c Cleanup dataset UT: restore config support 2020-05-25 15:10:03 -04:00
mindspore-ci-bot aeb4c52f2d !1379 Creating new UTs to three vision transformation ops
Merge pull request !1379 from Tinazhang/linearTrans
2020-05-25 23:10:30 +08:00
liuwenhao4 f3f0cbaeee Fixing some tiny faults about Pylint in my code(ops) 2020-05-25 21:27:45 +08:00
“liuxiao” 382a0124c3 pylint clean 2020-05-25 21:16:04 +08:00
mindspore-ci-bot 44bf7c9330 !1414 fix issue use reshape as flatten grad impl
Merge pull request !1414 from zhaozhenlong/fix-issues-reshape-replace-flattern-grad
2020-05-25 20:45:46 +08:00
Yi Huaijie ac484ebbc0 remove unused variable 2020-05-25 19:59:28 +08:00
“liuxiao” 18f0af0529 pylint clean 2020-05-25 19:49:06 +08:00
mindspore-ci-bot 1c8548adb8 !1300 Add TBE op RangeD for GE.
Merge pull request !1300 from liuxiao/RangeD
2020-05-25 17:04:53 +08:00
zhaozhenlong 30b93ecbf8 use reshape as flatten grad 2020-05-25 16:57:26 +08:00
panyifeng 6a57eeb922 fix check_bprop attr error 2020-05-25 16:52:30 +08:00
Yi Huaijie 0b137e5312 delete unused arguments in test cases 2020-05-25 15:46:05 +08:00
liuxiao 627724a205 Add RangeD for GE 2020-05-25 14:49:49 +08:00
Yi Huaijie 8cfc05e4cf clean pylint warnings of parallel test cases 2020-05-25 11:08:29 +08:00
mindspore-ci-bot 0e665616f0 !1160 add backward hook and custom bprop in pynative mode
Merge pull request !1160 from wangqiuliang/add-backward-hook-in-pynative-mode
2020-05-24 18:09:48 +08:00
kingfo 840922e501 add backward hook function in pynative mode 2020-05-24 13:32:44 +08:00
mindspore-ci-bot 718a96430f !1389 Security issues in recent string tensor PR
Merge pull request !1389 from h.farahat/fix_security_issues
2020-05-24 08:45:21 +08:00
mindspore-ci-bot a6b8451a33 !1380 make ShuffleOp have deterministic behavior for subsequent epochs
Merge pull request !1380 from Peilin/shuffle-subsequent-epoch-deterministic
2020-05-23 21:02:30 +08:00
mindspore-ci-bot ad9db524bb !1394 Fix comment error and mod parameter check in graphdata
Merge pull request !1394 from heleiwang/fix_comments_error
2020-05-23 19:47:19 +08:00