Commit Graph

541 Commits

Author SHA1 Message Date
mindspore-ci-bot b86747b9a6 !15813 Convert some pipeline Ops to be inlined
From: @hfarahat
Reviewed-by: 
Signed-off-by:
2021-05-08 05:30:39 +08:00
Lixia Chen 5967cb2cd7 Unblock mindrecord under cache 2021-05-05 13:28:13 -04:00
hesham e4c0bd51a5 Modify concat to be an inlined Op
Modify zip to be an inlined Op
Modify take to be an inlined Op
Modify skip to be an inlined Op
Modify rename to be an inlined Op
Modify filter to consume child's rows using one thread
2021-05-04 12:45:18 -04:00
mindspore-ci-bot 9c7cb65c3b !15801 Split sampler and vision IR files
From: @mhmotallebi
Reviewed-by: 
Signed-off-by:
2021-05-01 05:19:41 +08:00
mindspore-ci-bot cefcf6c2ae !15931 Add eager tests for transform ops, and add a shape comparison in the EXPECT_MSTENSOR_EQ Macro
From: @alexyuyue
Reviewed-by: @nsyca,@robingrosman
Signed-off-by: @robingrosman
2021-04-30 06:15:12 +08:00
mohammad 9ce28cd34c split sampler vision IR files 2021-04-29 16:30:18 -04:00
alex-yuyue 9ef4331f56 Add eager tests for transform ops
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-04-29 13:19:24 -04:00
YangLuo bf48400c10 unify include file of minddata 2021-04-22 10:59:36 +08:00
Cathy Wong 636809c255 dataset: C++ API ToNumber & Lookup: change data_type parm from string to DataType 2021-04-19 12:35:37 -04:00
mindspore-ci-bot bd69a86931 !15124 Remove unused #include in cc files in MindData
From: @hfarahat
Reviewed-by: @nsyca,@mikef,@robingrosman
Signed-off-by: @robingrosman
2021-04-17 02:19:27 +08:00
mindspore-ci-bot 9c81c5d2a0 !15189 Add more ut for transform ops and subset sampler
From: @alexyuyue
Reviewed-by: 
Signed-off-by:
2021-04-17 01:46:13 +08:00
hesham 98f0f36a20 Removed unused include 2021-04-16 11:40:56 -04:00
mindspore-ci-bot 5b7ed56d57 !12521 [WIP] MindData C++ Plugin infrastructure with GDAL decode
From: @ziruiwu
Reviewed-by: 
Signed-off-by:
2021-04-16 20:37:18 +08:00
Zirui Wu 8ebc512d25 plugin infrastruture for mindddata
add single element string tensor support for plugin tensor
2021-04-15 21:11:16 -04:00
alex-yuyue 97e3232b6d Add more ut for transform ops and subset sampler
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-04-15 16:51:41 -04:00
Cathy Wong a2ee0cb3e5 dataset UT: Update UTs to check for return Status 2021-04-14 17:52:31 -04:00
mindspore-ci-bot 1d89109d19 !14929 Cleanup stale comments about DataBuffers
From: @hfarahat
Reviewed-by: @pandoublefeng,@robingrosman
Signed-off-by: @pandoublefeng
2021-04-14 05:33:40 +08:00
mindspore-ci-bot 727203a498 !14911 dataset: Fill op: C++ API support, UTs and Pybind decoupling
From: @cathwong
Reviewed-by: 
Signed-off-by:
2021-04-14 05:32:11 +08:00
Cathy Wong 7e6a03487e dataset: Fill op: C++ API support, UTs and Pybind decoupling 2021-04-13 10:02:39 -04:00
mindspore-ci-bot e07a69d8f8 !14874 GNN dataset new feature
From: @lizhenglong1992
Reviewed-by: 
Signed-off-by:
2021-04-13 10:44:27 +08:00
hesham 15354569f2 Cleanup stale comments about DataBuffers 2021-04-12 14:26:59 -04:00
ms_yan ecb8d6bc08 add pil version cubic resize 2021-04-12 21:56:14 +08:00
Zhenglong Li f3895f2b09 Add get edges from nodes function for gnn network 2021-04-10 18:31:13 +08:00
mindspore-ci-bot 74f4c85315 !14750 Address some code issues in MD
From: @hfarahat
Reviewed-by: @robingrosman,@mikef
Signed-off-by: @robingrosman
2021-04-10 03:55:16 +08:00
hesham 97cf4e516e Address 3 code issues:
1- access out of bound memory in toFlatIndex
2- CreateFromNPArray function is 50>
3- duplicate variable init
2021-04-08 21:50:19 -04:00
Cathy Wong 82f4b3f757 dataset: C++ API TypeCast: change data_type parm from string to DataType 2021-04-08 11:47:58 -04:00
mindspore-ci-bot bdc5a9c88b !14579 TensorOp decoupling stage 3 (transform ops)
From: @alexyuyue
Reviewed-by: 
Signed-off-by:
2021-04-08 21:41:26 +08:00
mindspore-ci-bot b6cf16d8aa !14389 fix codex warning
From: @luoyang42
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
2021-04-08 14:22:39 +08:00
alex-yuyue 83aaed09bb TensorOp decoupling stage 3 (transform ops)
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-04-07 18:46:23 -04:00
mindspore-ci-bot a9ba9b90f6 !14680 MindData Codespell correction
From: @luoyang42
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
2021-04-07 18:28:55 +08:00
luoyang 624511337c MindData Codespell correction 2021-04-07 10:20:29 +08:00
mindspore-ci-bot 3d85930cfe !14639 Remove DataBuffer class
From: @hfarahat
Reviewed-by: @pandoublefeng,@robingrosman
Signed-off-by: @pandoublefeng
2021-04-06 23:49:30 +08:00
hesham 8535e89e6c Remove DataBuffer 2021-04-05 17:55:59 -04:00
mindspore-ci-bot 0cfd8b7c9e !13364 Add WordpieceTokenizer and AddDict to Jieba
From: @alexyuyue
Reviewed-by: 
Signed-off-by:
2021-04-06 05:04:13 +08:00
hesham 0d86cb1423 Remove rows_per_buffer 2021-04-04 00:22:16 -04:00
hesham a9a80693be Replace Databuffers with TensorRows 2021-03-31 17:00:36 -04:00
liyong d5b7a67c71 fix asan issue 2021-03-31 14:18:50 +08:00
YangLuo b85a905eaf fix codex warning 2021-03-30 17:00:37 +08:00
Eric 38944eafc4 Added get dataset size and fix macro 2021-03-29 15:49:29 -04:00
mindspore-ci-bot a91e9c9294 !14106 reduce ut time of cutmix_batch and ConcatOp
From: @luoyang42
Reviewed-by: @pandoublefeng,@liucunwei
Signed-off-by: @pandoublefeng,@liucunwei
2021-03-25 22:58:35 +08:00
YangLuo f7ea18944d reduce ut time of cutmix_batch 2021-03-25 21:59:44 +08:00
mindspore-ci-bot 5926f7c386 !13906 【MD】【BUG】Conventional judgment on the parameter h w not less than zero
From: @xulei2020
Reviewed-by: 
Signed-off-by:
2021-03-25 14:10:42 +08:00
xulei2020 4122d1dcce fix code format bug 2021-03-25 09:18:36 +08:00
mindspore-ci-bot b1b99b97d7 !13750 Add check of ResizePreserveARWithFiller operation
From: @shenwei41
Reviewed-by: 
Signed-off-by:
2021-03-24 15:27:16 +08:00
shenwei41 d3265f0591 Add check of ResizePreserveARWithFiller operation 2021-03-23 23:30:53 +08:00
mindspore-ci-bot 06892b83ff !13575 Add check to RgbToGray
From: @shenwei41
Reviewed-by: @tiancixiao,@liucunwei
Signed-off-by: @liucunwei
2021-03-22 12:11:39 +08:00
Xiao Tianci b88a68c9e8 fix canny when size is 7 2021-03-19 17:26:59 +08:00
mindspore-ci-bot 0451a800bc !13571 Added seed to prevent random failures in ut
From: @ezphlow
Reviewed-by: 
Signed-off-by:
2021-03-19 17:17:42 +08:00
shenwei41 8a1f283efc Add check to RgbToGray 2021-03-19 10:35:35 +08:00
Eric a3c98d9d59 Added fix for random core dump 2021-03-18 21:15:50 -04:00