Commit Graph

16 Commits

Author SHA1 Message Date
zetongzhao 9d4c8e29f9 add test for skip first epoch sampler 2022-03-14 15:01:08 -04:00
zetongzhao 4cb53823fd all the updated input order
Fix FillOperation to_json function

Fix FillOperation to_json function

serialize tensor without testing

fix unity input order bug, next step is to test the tensor serialization

serialize tensor, testing code in tensor_test.cc

change for tensor serialization

changes after review

changes after review

clang-format the files

rename
2021-05-25 18:26:43 -04:00
hesham 8535e89e6c Remove DataBuffer 2021-04-05 17:55:59 -04:00
hesham 5169fb4c42 Remove api namespace 2020-11-02 20:09:37 -05:00
hesham adfbc891d3 - Add checks and testing for empty tensors
- cleanup work on createTensor and Tensor's constructors
2020-07-24 17:23:18 -04:00
liubuyu 43c79eb853 mindspore path adjust 2020-07-14 18:07:28 +08:00
jonyguo 41d16a3c77 enhance: 1. fix api comment, 2. del dead code 2020-06-29 17:15:44 +08:00
Jesse Lee dcfdff6021 Rename Sampler Reset 2020-06-17 14:43:45 -04:00
hesham 0c5e47111b - Move MutableBuffer to be protected
- Add new CreateTensors
2020-06-11 17:32:03 -04:00
Jesse Lee 255adf7c6e Remove inheritance of Sampler from DatasetOp 2020-06-10 18:10:51 -04:00
Jamie Nisbet 51bc0c0460 consistent design for num_samples
updates

more update

more work

more fixin

post rebase updates

clang formatting

code review recovery

ci fixes

updates

update

update

update
2020-06-03 15:01:18 -04:00
hesham e8ca243364 -Add DE_STRING
-replace switch'case by indexing

- Add test case
- Add constructors
- Add getItem string

- Fix bugs
- Add more tests

- Tensor iterator
- asNumpy
- TextFileDataset

- Tensor(Numpy)

- Super > 2D
- Add more test cases for GeneratorDataset

- Change StartAddr to GetBuffer and GetMutableNuffer

- Raise an error if batch is used with strings

Clean-up work
2020-05-15 20:33:28 -04:00
Junhan Hu 9739d3b048 Add CPP sampler support for GeneratorDataset 2020-04-14 12:09:03 -04:00
Alexey Shevlyakov 84d780c1a4 remove make_unique.h 2020-04-07 14:00:09 -04:00
Jonathan Yan 080bcda021 Replace std::cout with MS_LOG in dataset unit test
Signed-off-by: Jonathan Yan <jonathan.yan1@huawei.com>
2020-03-30 11:02:32 -04:00
zhunaipan 930a1fb0a8 initial version
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
2020-03-27 22:54:54 +08:00