Commit Graph

19 Commits

Author SHA1 Message Date
EricZ 16837a4639 Removing Builder from dataset ops phase 1 2021-06-03 09:09:29 +08:00
zetongzhao 4cb53823fd all the updated input order
Fix FillOperation to_json function

Fix FillOperation to_json function

serialize tensor without testing

fix unity input order bug, next step is to test the tensor serialization

serialize tensor, testing code in tensor_test.cc

change for tensor serialization

changes after review

changes after review

clang-format the files

rename
2021-05-25 18:26:43 -04:00
Cathy Wong a2ee0cb3e5 dataset UT: Update UTs to check for return Status 2021-04-14 17:52:31 -04:00
hesham 15354569f2 Cleanup stale comments about DataBuffers 2021-04-12 14:26:59 -04:00
hesham 0d86cb1423 Remove rows_per_buffer 2021-04-04 00:22:16 -04:00
Nat Sutyanyong 5a7dc0accc Migrate repeat_pass.cc to IR optimizer and remove ExecTree optimizer 2021-02-01 12:30:16 -05:00
Zirui Wu 3555d19b07 fix get num_class in imagefolder
address cmt

review cmts
2020-11-12 14:26:54 -05:00
hesham 5169fb4c42 Remove api namespace 2020-11-02 20:09:37 -05:00
liubuyu d81862a916 decoupling core and context 2020-08-05 08:15:14 +08:00
hesham adfbc891d3 - Add checks and testing for empty tensors
- cleanup work on createTensor and Tensor's constructors
2020-07-24 17:23:18 -04:00
liubuyu 43c79eb853 mindspore path adjust 2020-07-14 18:07:28 +08:00
jonyguo 41d16a3c77 enhance: 1. fix api comment, 2. del dead code 2020-06-29 17:15:44 +08:00
hesham 0c5e47111b - Move MutableBuffer to be protected
- Add new CreateTensors
2020-06-11 17:32:03 -04:00
Jamie Nisbet 51bc0c0460 consistent design for num_samples
updates

more update

more work

more fixin

post rebase updates

clang formatting

code review recovery

ci fixes

updates

update

update

update
2020-06-03 15:01:18 -04:00
Peilin Wang 71e8bb1960 general split case done, chaining sampler (basic case) is working
implementation 99% complete

everything and tested except for repeatable shuffling

tested most basic/typical split usecases

cleanup

some more cleanup

fix CI

more ci fix

more ci fixes

more ci fix

more ci fix

more ci fix

added more tests, fixed some bugs

some more clean up and test cases

added shard/shuffle before split warning/error

addressed code review comments and ci

fixed ci
2020-05-21 20:42:51 -04:00
hesham e8ca243364 -Add DE_STRING
-replace switch'case by indexing

- Add test case
- Add constructors
- Add getItem string

- Fix bugs
- Add more tests

- Tensor iterator
- asNumpy
- TextFileDataset

- Tensor(Numpy)

- Super > 2D
- Add more test cases for GeneratorDataset

- Change StartAddr to GetBuffer and GetMutableNuffer

- Raise an error if batch is used with strings

Clean-up work
2020-05-15 20:33:28 -04:00
Alexey Shevlyakov 84d780c1a4 remove make_unique.h 2020-04-07 14:00:09 -04:00
Jonathan Yan 080bcda021 Replace std::cout with MS_LOG in dataset unit test
Signed-off-by: Jonathan Yan <jonathan.yan1@huawei.com>
2020-03-30 11:02:32 -04:00
zhunaipan 930a1fb0a8 initial version
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
2020-03-27 22:54:54 +08:00