Commit Graph

14 Commits

Author SHA1 Message Date
liyong d4f8f57c7e add split in minddataset 2020-06-16 19:50:41 +08:00
Yang 9b2a778d94 !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
Yang abca62f407 10:00 26/5 clean pylint 2020-05-26 10:05:12 +08:00
mindspore-ci-bot 458436186c !1365 Clean up work for text python sub-package
Merge pull request !1365 from h.farahat/text_namespace
2020-05-22 23:16:31 +08:00
mindspore-ci-bot 6f733ec113 !1308 Stage 2 of adding support for string Tensor
Merge pull request !1308 from h.farahat/string_tensor2
2020-05-22 21:17:53 +08:00
hesham 6c21e556c4 Clean up work for text python package 2020-05-22 04:35:58 -04:00
heleiwang 599a449e0b Support processing GNN data 2020-05-22 14:15:25 +08:00
hesham df361d1d26 Change mem layout of string tensor
add support for MindRecord and TFRecord
----
optimize tensorshape

optimize tensorshape and FlatIndex

TFRecord and MindRecord support for string tensor

Modify mem layout
Add new constructor
Add method Allocate

Change some GetMutableBuffer usages to AllocateBuffer
2020-05-22 01:22:29 -04:00
jinyaohui 5a914994ba clean pylint 2020-05-18 16:42:35 +08:00
jinyaohui bcfaff97f9 clean pylint 2020-05-18 10:31:46 +08:00
liyong b520ca9087 fix pk sampler in mindrecord 2020-05-07 14:54:23 +08:00
liyong f1542a90a3 add pk sampler 2020-04-21 10:08:38 +08:00
liyong 0ce83e39e1 fix TestShardSampleWrongNumber
adjust internal api
2020-04-13 21:31:45 +08:00
liyong 11403492ae add mindrecord subset random sampler 2020-04-11 18:48:23 +08:00