Commit Graph

43 Commits

Author SHA1 Message Date
YangLuo 60b8e3d985 format minddata log 2022-11-03 21:02:01 +08:00
i-robot ee7f194a58
!44013 del close_pool and to_device operation
Merge pull request !44013 from 刘勇琪/master
2022-10-18 06:39:46 +00:00
liu-yongqi-63 fa8891c68d Delete close_pool and to_device interface 2022-10-18 09:30:58 +08:00
jonyguo 0571532873 del batch param: column_order & pad_info 2022-10-17 09:35:41 +08:00
Cathy Wong b9ac3f7b18 [MD] Serialize Python UDFs - log a warning 2022-09-26 22:48:12 -04:00
Cathy Wong 46d4608fe1 [MD] Fix some serdes bugs for Py UDFs, Py ops (w enum Inter & Border
parms, fill_value). AutoTune scenarios impacted.
2022-09-16 16:02:26 -04:00
i-robot 875f06f060
!35206 [MD] Transform Unification Feature - ToTensor op: Remove Python implementation and regenerate md5 golden result files
Merge pull request !35206 from cathwong/ckw_xtranuni_code4_to_tensor_new_golden
2022-05-31 03:08:44 +00:00
Cathy Wong 1136ee3ffd [MD] Transform Unification Feature - ToTensor op: Remove Python implementation, regenerate golden files 2022-05-30 11:13:29 -04:00
Cathy Wong b9396a32b7 [MD] Update import transforms statements in dataset UT 2022-05-25 19:51:26 -04:00
Cathy Wong 22adb200b2 [MD] Transform Unification Feature - Phase 2 - test_[r-q]*.py Python UT updates 2022-05-04 09:16:46 -04:00
zetongzhao 5e8377ea5c fix multithreading bug 2021-11-05 16:49:18 -04:00
liyong d9aa18dfca refactor md ut 2021-10-18 17:55:28 +08:00
hetshah 2c1666fd06 set num epochs for iterators that use the default value
add explicit paramter for infinite iterators

set appropriate value for num_epoch param for iteratos

fix long lines

remove trailing whitespace

fixed typo

remove comment

fixed comments

fixed test
2021-09-22 17:32:50 +00:00
YangLuo 9d89de5765 minddata error message optimize 2021-09-15 18:05:02 +08:00
zetongzhao 719a207040 deserialize fix 2021-09-10 15:19:59 -04:00
zetongzhao 0d389f3f0c serdes python operations 2021-09-08 09:05:11 -04:00
djc b077aa1cab [feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset 2021-08-22 16:26:45 +08:00
djc 4e6f7dc97d [feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset 2021-08-22 13:39:37 +08:00
zetongzhao 4f199b548c deserialize and tests 2021-08-06 13:35:27 -04:00
Cathy Wong 7e6a03487e dataset: Fill op: C++ API support, UTs and Pybind decoupling 2021-04-13 10:02:39 -04:00
xiefangqi 41f3e02e87 fix pyfunc pickle issue 2021-03-12 15:17:08 +08:00
TinaMengtingZhang ddab5ad417 Add support for vision op and py_transform op to serdes 2021-02-03 12:31:09 -05:00
Mahdi 8f34faeb7a Changed bindings to SamplerObj 2021-01-29 14:20:05 -05:00
TinaMengtingZhang d3fdbceb61 [Part II] Push down json save logic to IR and add getter to each IR node 2021-01-15 18:03:37 -05:00
alex-yuyue b54e01bfb4 Tensor op decoupling stage 2
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-01-14 11:51:16 -05:00
TinaMengtingZhang 4812fece80 [Part I] Push down json save logic to IR and add getter to each IR node 2021-01-12 11:17:45 -05:00
xiefangqi 9b3c33e157 minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
nhussain 92e99ff224 change map calls 2020-09-10 10:25:05 -04:00
Zirui Wu 1bb93580dd Add usage flag to MNIST/CIFAR
ci fix 1

fix ci 2

fix ci 3

fix ci 4

fix ci 5

fix ci 6

fix ci 7

change var name in CelebA from dataset_type to usage

address review cmts

fix cpp ut fail

change mode to usage in VOCDataset

fix cmts

fix ci test case fail
2020-09-09 09:59:55 -04:00
nhussain 3bac9d3713 switch input columns and operation
change ImagefolderDV2 name

change ds.transforms.vision to ds.vision

change batch api to match map api more closely

compose op changes

test_pylint

remove compose op from vision, move to transform module, refactor map and batch to use column_order
2020-09-08 10:26:20 -04:00
mindspore-ci-bot bb84f50407 !5473 optim pylint
Merge pull request !5473 from jinyaohui/master
2020-09-02 15:25:30 +08:00
Lixia Chen 27d5281641 Change epoch count to 1 for python testcases 2020-09-01 11:24:26 -04:00
jinyaohui a9972a7def optim pylint 2020-08-31 14:49:57 +08:00
tony_liu2 269b477684 use np.testing.assert instead of asserting
fix line lengths

fix spacing

reverse a few changes
2020-07-29 14:53:01 -04:00
Tinazhang f4a61fdbb2 Adding new UT cases and missing TCs in PY Ops. 2020-05-29 12:12:17 -04:00
Yang 9b2a778d94 !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
Yang abca62f407 10:00 26/5 clean pylint 2020-05-26 10:05:12 +08:00
ms_yan d5e896b51c delete storageDataset Op API and its test case 2020-05-22 21:23:24 +08:00
jinyaohui 5a914994ba clean pylint 2020-05-18 16:42:35 +08:00
jinyaohui bcfaff97f9 clean pylint 2020-05-18 10:31:46 +08:00
liyong f1542a90a3 add pk sampler 2020-04-21 10:08:38 +08:00
anthonyaje ea297c0889 Fix dataset serdes for MindDataset 2020-04-17 13:24:02 -04:00
zhunaipan 930a1fb0a8 initial version
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
2020-03-27 22:54:54 +08:00