Commit Graph

30 Commits

Author SHA1 Message Date
David 229603b4b5 Added docs to ut part 4 2022-06-02 21:37:15 -04:00
Cathy Wong 9d9013ba79 [MD] Chained Sampler UT fixes and updates 2022-01-13 17:39:33 -05:00
liyong 9663884db3 fix occasional failed in random sampler 2021-11-16 09:53:38 +08:00
Eric ed373f61ac Adding inheritance to user defined sampler
what if we just do nothing

trying wrapper approach

Fix yolo
2021-03-09 18:14:49 -05:00
hesham 616d1a1f3d Fix sampler supporting numpy input 2021-03-01 12:41:59 -05:00
hesham aa4298721a Fix sampler error messages 2021-02-23 23:58:19 -05:00
YangLuo d8ace8f041 fix minddata issues 2021-02-19 10:53:49 +08:00
luoyang 416ad23e9d fix resize & randomcoloradjust
fix sampler
2021-02-10 12:53:27 +08:00
hesham 1185218335 Support list of IDs as a sampler 2021-02-02 11:44:38 -05:00
Mahdi 8f34faeb7a Changed bindings to SamplerObj 2021-01-29 14:20:05 -05:00
hesham 7120c66998 Add SubsetSampler 2021-01-27 15:00:18 -05:00
luoyang 415c8b08a5 fix issues of MD:
1. description of num_shard in datasets.py
2. add param validation for sampler
3. add description for add_child in sampler.py
2021-01-27 09:30:42 +08:00
Mahdi 98ea8fa6ea Added tests for chain samplers, fixed GetDatasetSize issue with chained samplers 2020-12-17 13:26:42 -05:00
Xiao Tianci 823e52f1dc add params checking of offset in distributed_sampler
add related comment to explain
add related UT
2020-10-28 16:46:12 +08:00
xiefangqi 9b3c33e157 minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
mindspore-ci-bot bb84f50407 !5473 optim pylint
Merge pull request !5473 from jinyaohui/master
2020-09-02 15:25:30 +08:00
Lixia Chen 27d5281641 Change epoch count to 1 for python testcases 2020-09-01 11:24:26 -04:00
jinyaohui a9972a7def optim pylint 2020-08-31 14:49:57 +08:00
yanghaitao 8f16cff12e add para check for sampler 2020-06-11 22:26:06 +08:00
Jamie Nisbet 51bc0c0460 consistent design for num_samples
updates

more update

more work

more fixin

post rebase updates

clang formatting

code review recovery

ci fixes

updates

update

update

update
2020-06-03 15:01:18 -04:00
Yang 5522edc4b5 !1713 [Dataset] Clean pylint. 2020-06-02 09:02:19 +08:00
Yang 9b2a778d94 !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
Peilin Wang d4c93575e7 fixed bug for split, RandomSampler and some other cleanup
add another test case

typo

merge conflict

another PR changed testing behavior, updated test cases in this commit

added input check for use_sampler

addressed code review comments

fixed pylint, not related to my changes
2020-05-26 16:29:52 -04:00
mindspore-ci-bot 2e3d55ed87 !1281 Implementation of SplitOp
Merge pull request !1281 from Peilin/splitOp
2020-05-22 09:29:03 +08:00
Peilin Wang 71e8bb1960 general split case done, chaining sampler (basic case) is working
implementation 99% complete

everything and tested except for repeatable shuffling

tested most basic/typical split usecases

cleanup

some more cleanup

fix CI

more ci fix

more ci fixes

more ci fix

more ci fix

more ci fix

added more tests, fixed some bugs

some more clean up and test cases

added shard/shuffle before split warning/error

addressed code review comments and ci

fixed ci
2020-05-21 20:42:51 -04:00
jinyaohui 5a914994ba clean pylint 2020-05-18 16:42:35 +08:00
jinyaohui bcfaff97f9 clean pylint 2020-05-18 10:31:46 +08:00
Junhan Hu 43a2e99833 Add python sampler support for CPP dataset 2020-04-19 20:36:37 -04:00
Junhan Hu 9739d3b048 Add CPP sampler support for GeneratorDataset 2020-04-14 12:09:03 -04:00
zhunaipan 930a1fb0a8 initial version
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
2020-03-27 22:54:54 +08:00