Commit Graph

21 Commits

Author SHA1 Message Date
David 229603b4b5 Added docs to ut part 4 2022-06-02 21:37:15 -04:00
David 5f1849fd1c Added docs to ut part 2 2022-05-27 09:05:14 -04:00
luoyang c248274d91 fix vocab validation 2022-02-07 15:55:59 +08:00
luoyang ca3de66559 Fix Python Vocab validation 2021-12-27 17:12:07 +08:00
luoyang 0288480722 Python Vocab refactoring and add ids_to_tokens & tokens_to_ids 2021-12-24 15:26:15 +08:00
Cathy Wong 636809c255 dataset: C++ API ToNumber & Lookup: change data_type parm from string to DataType 2021-04-19 12:35:37 -04:00
luoyang ec21d3f748 Fix validation of RGB2HSV/HSV2RGB/RandomResizedCrop in py_transform
Fix error msg of pythontokenizer
2021-04-01 19:09:07 +08:00
luoyang fa4f67cbcd LookupOp: default value of unknown_token support NoneType 2021-02-02 16:17:02 +08:00
alex-yuyue 6fd58dc580 Add call for decoupled image and text ops
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-01-29 21:36:31 -05:00
alex-yuyue a8675f8227 TextOp decoupling
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-01-20 21:52:45 -05:00
Zirui Wu 91a6b2b0ca Add checks to RandomData and LookUp 2020-12-09 17:09:34 -05:00
xiefangqi 9b3c33e157 minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
nhussain 92e99ff224 change map calls 2020-09-10 10:25:05 -04:00
Zirui Wu bde9f18f5a update lookup api to take in a type
ci

add test case

address some of the review cmts

address review cmts
2020-09-08 11:59:28 -04:00
Lixia Chen 27d5281641 Change epoch count to 1 for python testcases 2020-09-01 11:24:26 -04:00
Zirui Wu 40ea84ae81 fix from_file validator minor error, 1 line change
add test case
2020-07-21 23:17:26 -04:00
Zirui Wu 63185cb20f fix some validators errors
address review cmts

addr review cmts
2020-07-14 14:04:40 -04:00
Zirui Wu 7b15e5a742 rework on lookup
add test caser

fix ci

address review cmts

ci

addr review cmt

fix typo

address review cmts

add 2 more test cases

cpplint fix

addr cpplint

addr ci

fix tst case err

fix doc str
2020-07-09 17:10:18 -04:00
hesham 11826fb256 DuplicateOp 2020-06-18 19:47:27 -04:00
Zirui Wu b6e9504b31 phase I of Vocab rework
phase II vocab rework

added more test cases

fix api doc string

address review cmts and fix CI

address ci complains

fix review cmts

ci
2020-06-18 15:36:28 -04:00
Zirui Wu 25ab2ef303 Implemented lookup and vocab 2020-05-21 17:17:24 -04:00