Commit Graph

17 Commits

Author SHA1 Message Date
hetshah 2c1666fd06 set num epochs for iterators that use the default value
add explicit paramter for infinite iterators

set appropriate value for num_epoch param for iteratos

fix long lines

remove trailing whitespace

fixed typo

remove comment

fixed comments

fixed test
2021-09-22 17:32:50 +00:00
jonyguo c408867085 fix: hung when user return Tensor in generator 2021-09-15 14:13:33 +08:00
xiefangqi 57f68d35bd fix generator 14 ut problem 2021-09-06 19:01:51 +08:00
YangLuo 17c121b087 Give concreted error when mappable dataset lack __len__ method 2021-06-29 11:13:12 +08:00
ms_yan be65ebcb28 complete dataset log 2021-06-08 16:45:47 +08:00
RobinGrosman ca88d7d76a fix edge case and docstring in minddata multiprocessing shared memory code 2021-05-16 06:46:44 -07:00
RobinGrosman 9a7d1fc034 Optimize multi-process in minddata by passing data via shared memory instead of multiprocessing.queue 2021-05-11 15:16:29 -07:00
hesham 58193bc469 User explicit deepcopy 2021-02-09 17:25:21 -05:00
ms_yan 0cb5c47856 add err modify 2020-11-18 16:30:24 +08:00
YangLuo f5a85510f2 [MD] dataset op log changes 2020-09-12 00:43:36 +08:00
xiefangqi 9b3c33e157 minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
nhussain 92e99ff224 change map calls 2020-09-10 10:25:05 -04:00
nhussain 3bac9d3713 switch input columns and operation
change ImagefolderDV2 name

change ds.transforms.vision to ds.vision

change batch api to match map api more closely

compose op changes

test_pylint

remove compose op from vision, move to transform module, refactor map and batch to use column_order
2020-09-08 10:26:20 -04:00
Lixia Chen 27d5281641 Change epoch count to 1 for python testcases 2020-09-01 11:24:26 -04:00
anzhengqi 3e31ac6d62 all Dataset support get_dataset_size 2020-08-12 15:35:47 +08:00
tony_liu2 269b477684 use np.testing.assert instead of asserting
fix line lengths

fix spacing

reverse a few changes
2020-07-29 14:53:01 -04:00
Cathy Wong 04eb4f89c7 Cleanup dataset UT: Replace save_and_check 2020-07-15 20:47:31 -04:00