Commit Graph

21 Commits

Author SHA1 Message Date
hesham 7120c66998 Add SubsetSampler 2021-01-27 15:00:18 -05:00
liyong ee042b90f7 fix num_sample in sequentialSampler and randomSampler 2020-10-23 19:26:10 +08:00
xiefangqi 9b3c33e157 minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
Lixia Chen 27d5281641 Change epoch count to 1 for python testcases 2020-09-01 11:24:26 -04:00
liyong 7341421d3b fix num samples in pk sampler 2020-08-10 19:05:47 +08:00
tony_liu2 1f4251a440 add try to minddataset python tests to remove files on fail
delete unrelated file

change finally to except else

fix spacing alignment

fix indentation

fix indentation

fix indentation

add fix to new test case

add if main for pytest

fix spacing
2020-07-22 16:34:10 -04:00
liyong 2412ee09ce fix distributedSampler reshuffle and fix random_device failed 2020-06-21 18:23:47 +08:00
liyong d4f8f57c7e add split in minddataset 2020-06-16 19:50:41 +08:00
Yang 9b2a778d94 !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
Yang abca62f407 10:00 26/5 clean pylint 2020-05-26 10:05:12 +08:00
mindspore-ci-bot 458436186c !1365 Clean up work for text python sub-package
Merge pull request !1365 from h.farahat/text_namespace
2020-05-22 23:16:31 +08:00
mindspore-ci-bot 6f733ec113 !1308 Stage 2 of adding support for string Tensor
Merge pull request !1308 from h.farahat/string_tensor2
2020-05-22 21:17:53 +08:00
hesham 6c21e556c4 Clean up work for text python package 2020-05-22 04:35:58 -04:00
heleiwang 599a449e0b Support processing GNN data 2020-05-22 14:15:25 +08:00
hesham df361d1d26 Change mem layout of string tensor
add support for MindRecord and TFRecord
----
optimize tensorshape

optimize tensorshape and FlatIndex

TFRecord and MindRecord support for string tensor

Modify mem layout
Add new constructor
Add method Allocate

Change some GetMutableBuffer usages to AllocateBuffer
2020-05-22 01:22:29 -04:00
jinyaohui 5a914994ba clean pylint 2020-05-18 16:42:35 +08:00
jinyaohui bcfaff97f9 clean pylint 2020-05-18 10:31:46 +08:00
liyong b520ca9087 fix pk sampler in mindrecord 2020-05-07 14:54:23 +08:00
liyong f1542a90a3 add pk sampler 2020-04-21 10:08:38 +08:00
liyong 0ce83e39e1 fix TestShardSampleWrongNumber
adjust internal api
2020-04-13 21:31:45 +08:00
liyong 11403492ae add mindrecord subset random sampler 2020-04-11 18:48:23 +08:00