Nigel
/
mindspore
forked from mindspore-Ecosystem/mindspore
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
45,876 Commits 24 Branches 0 Tags 3.9 GiB
Commit Graph

201 Commits

Author SHA1 Message Date
vddong 91d3a7543f [feat][assistant][I3T96F] add new data operator SpeechCommands 2021-11-27 11:25:18 +08:00
vddong f465cd0242 [feat][assistant][I3T96L]add new dataset operator YesNo 2021-11-19 13:36:24 +08:00
vddong 6fe2d35ae2 [feat][assistant][I3T96D] add new dataset loading operator LJSpeechDataset 2021-11-14 14:52:15 +08:00
Carry955 0d26c38693 [feat][assistant][I40GXT] add new loader DBpedia 2021-11-11 19:02:22 -08:00
Megalomania c34bbabed9 [feat] [assistant] [I3T96M] add new loader AGNEWS 2021-11-09 23:51:19 -08:00
i-robot f9bd640b09 !16269 [assistant][RandomLighting] 
Merge pull request !16269 from QingfengLi/randomlighting
 2021-10-20 06:42:12 +00:00
yangyueren 6594b90a58 [feat][assistant][I3J6VE] add new data operator PhotoTour 2021-10-19 15:31:32 +00:00
chenx2ovo 77caf907c4 [feat][assistant][I3CEGR] add op random lighting 2021-10-19 20:38:01 +08:00
yangyueren 951193c308 [feat][assistant][I3J6VF] add new data operator Places365 2021-10-15 14:56:09 +00:00
G-Dragon-Liu 32baa520bf [feat][assistant][I3J6V2] add new data operator EMnist 2021-10-08 02:53:00 +00:00
ckczzj 001b68c286 [feat][assistant][I3J6VG] add new data operator QMnist 2021-09-22 12:13:27 +08:00
zetongzhao 860810b9c4 check python interpreter 2021-09-14 16:25:04 -04:00
ckczzj af97ba4a77 [feat][assistant][I3J6VH] add new data operator SBU 2021-09-11 09:58:17 +08:00
wangkc123 3daf3a4d5f [feat] [assistant] [I3CKEK] add new dataset operator DIV2K 2021-09-10 17:55:34 +08:00
ckczzj d7c702e9d4 [feat][assistant][I3J6VL] add new data operator USPS 2021-09-09 21:46:57 +08:00
i-robot 938324b397 !19362 [assistant][ops] Add new dataset operator Cityscapes. 
Merge pull request !19362 from Rainfor/cityscapes
 2021-09-08 09:14:43 +00:00
xiefangqi e4aa1aa119 remove testCOCO 404 link 2021-09-03 10:46:34 +08:00
wangkc123 70f741bcc1 [feat] [assistant] [I3CKEM] add new dataset operator Cityscapes 2021-08-31 20:03:37 +08:00
i-robot 0e7844daa9 !22093 revert merge request 21685 
Merge pull request !22093 from guozhijian/revert-merge-21685-master
 2021-08-21 09:25:32 +00:00
guozhijian e1df9a2152 revert 'Pull Request !21685 : add function to invert_op' 2021-08-19 22:49:51 +08:00
i-robot 4113aee7d6 !18668 [assistant][ops]New operator implementation, include Flowers102Dataset 
Merge pull request !18668 from Wangsong95/flowers102_dataset
 2021-08-19 08:41:44 +00:00
fake_killer b0bc4bf5da [feat] [assistant] [I44TRS] extend invert_op's function 2021-08-18 21:46:15 +08:00
ckczzj 9d9f33be88 [feat][assistant][I3J6VN] add new data operator flowers102 2021-08-06 10:55:12 +08:00
wangkc123 48f5fed1f8 [feat] [assistant] [I3CKEN] add new dataset operator Flickr 2021-08-04 10:20:43 +08:00
wangkc123 b381e0be9d [feat] [assistant] [I3CKER] add new dataset operator SBD 2021-07-17 21:02:30 +08:00
mindspore-ci-bot d3a175e30f !16078 Modify Normalize to accept images with more than 3 channels 
From: @hfarahat
Reviewed-by: @mikef,@robingrosman
Signed-off-by: @robingrosman
 2021-05-11 02:03:34 +08:00
hesham fd943bbdc0 Modify normalize to support multiple of channels 2021-05-07 17:06:26 -04:00
xiefangqi 458ff5fed9 md fix voc and manifest error scenario 2021-04-27 14:24:57 +08:00
RobinGrosman a0e75b845a Increase default level of parallelism in mindddata pipeline to 8. 
Adjust memory usage to not increase as parallelism increases.  it will
stay at same level it would be with 4 parallelism
 2021-03-10 18:38:11 -08:00
alex-yuyue b54e01bfb4 Tensor op decoupling stage 2 
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
 2021-01-14 11:51:16 -05:00
Xiao Tianci 0659473535 add TruncateSequencePair, ToNumber C++ API and enable three test cases 2020-12-08 11:12:16 +08:00
Cathy Wong e5f62013f4 dataset Python UT: Add Sampler Chain Tests, with get_dataset_size 2020-11-17 15:24:44 -05:00
alex-yuyue 913a49f3af Add support for C++ API: GetNumClasses 
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
 2020-10-27 16:26:51 -04:00
Eric 7e21648e16 Added Album empty string tensor support 2020-10-20 16:37:37 -04:00
mindspore-ci-bot 7707bb8540 !7439 [MD] Add YUV to BGR , Split, extractChannel ops 
Merge pull request !7439 from xulei/lite_test0905
 2020-10-20 19:36:19 +08:00
xulei2020 442cee15ad add yuv420sp to bgr, split and extractchannel 2020-10-20 15:05:25 +08:00
Eric 359ad19884 Added float_array support 
Added fix, tests to come
 2020-10-15 00:18:30 -04:00
mindspore-ci-bot 2f3add4acd !6301 [MD] Combine c++ and python ops in map 
Merge pull request !6301 from nhussain/c_py_compose
 2020-09-24 23:10:47 +08:00
nhussain fda9462682 embed python compose op 
Leaf ops do self-reset.

embed python compose op

add implicit compose op

more tests
 2020-09-21 11:24:55 -04:00
yanghaitao1 4ff4c17632 fix get_dataset_size in CelebADataset when usage is not all 2020-09-19 02:16:29 -04:00
Lixia Chen b5b333726f Leaf ops do self-reset. 2020-09-14 09:48:14 -04:00
liyong 16147669a6 fix num_samples in concatDataset 2020-09-12 15:06:18 +08:00
mindspore-ci-bot 2dfb2f3578 !6009 Add Affine transformation ut for Lite Dataset 
Merge pull request !6009 from jiangzhiwen/lite/affine_ut
 2020-09-11 09:57:56 +08:00
nhussain 92e99ff224 change map calls 2020-09-10 10:25:05 -04:00
jiangzhiwen d4ce668b9b add Affine ut 2020-09-10 21:50:56 +08:00
mindspore-ci-bot dff02cc282 !5188 rename image files in imagefolder 
Merge pull request !5188 from tony_liu2/alt
 2020-09-01 11:16:30 +08:00
Cathy Wong 7f6782be2a dataset fixes: Update OneHot API docs; fixup Python UTs 2020-08-31 15:04:26 -04:00
tony_liu2 5e4c314130 rename dataset dir and image files 
change references to use path original

revert folder name

revert graphengine
 2020-08-27 16:49:23 -04:00
islam_amin 94a4a3f20b changing affine and posterize apis 2020-08-26 10:51:54 -04:00
Eric c79db93c48 Initial commit for album 
Added linter fix for album dataset

Added testDataset

Adding signature

Added JsonDataset example API

Example dataset

Resolving format

More fixing

Refactor

Small fix

Added compiling album dataset

Running tests

Added linter fix #1

Passing UT

Added dataset API

Addressing clang

Clang part 2

Fixing pass

Fixed tree check

lint fix

Added lint fix part 2
 2020-08-22 11:07:10 -04:00
jiangzhiwen 39df25f803 c++ api for CSV Dataset 2020-08-19 16:02:11 +08:00
nhussain 738ae2c78d change api to use std_vector 
try to display image
 2020-08-18 15:41:21 -04:00
islam_amin 979111d0ef Added Posterize Op 2020-08-18 13:55:47 -04:00
mindspore-ci-bot 113ff6ca24 !4367 CutMixBatch Augmentation Op 
Merge pull request !4367 from MahdiRahmaniHanzaki/cutmix
 2020-08-18 03:27:33 +08:00
mahdi 3ecc53fb4e Added CutMix 2020-08-17 13:01:47 -04:00
Alexey Shevlyakov 8526d5414d RandomColor 2020-08-13 16:10:21 -04:00
avakh 477528de7f random sharpness cpp op support 2020-08-11 15:30:40 -04:00
nhussain 7766efd58e add files 2020-08-11 11:54:14 -04:00
islam_amin e52d85ba9d Added RandomAffine Op 2020-08-10 17:52:50 -04:00
Mahdi 1896950ae5 Added Mixup 2020-08-07 17:47:16 -04:00
islam_amin 48ec178e77 Fixing AutoContrast/Equalize Bug 2020-07-23 14:32:37 -04:00
Amir Lashkari 6f186aafa0 Update Python UA op, AutoContrast Op and UT 
Updated Validators.py

Fixed UA UT

Fixed UA UT

Fixed PyLint Errors

Added aditional changes

remove old golden AutoContrast UT file

updated Autocontrast python UT

Added golden files

Fixed issue

fixed UT
 2020-07-22 14:16:16 +08:00
mindspore-ci-bot c451146b14 !3255 Added cpp Equalize op to vision api 
Merge pull request !3255 from alashkari/cpp_ops
 2020-07-21 21:56:41 +08:00
mindspore-ci-bot 0e27dccbcf !3093 VOCDataset output change to multi-columns 
Merge pull request !3093 from xiefangqi/md_voc_multi_columns
 2020-07-21 09:12:01 +08:00
Amir Lashkari 572750cd40 Added cpp Equalize op 
adding missed files

Fixed Errors

fixed bugs

fixed bugs

fixed bugs

fixed bugs

fixed bugs

Updated Python UT for Equalize op

Added cpp Equalize op

adding missed files

Fixed Errors

fixed bugs

fixed bugs

fixed bugs

fixed bugs

fixed bugs

Updated Python UT for Equalize op

Fixed comment style

update files

deleted files

added files

added image_utils.h

Fixed PyLint and CPPLint Errors

updated tensor_op.h
 2020-07-20 21:03:26 -04:00
jiangzhiwen 2f506b7985 CSV dataset loader 2020-07-20 20:22:08 +08:00
xulei2020 18b519ae0f add sentence piece 2020-07-20 15:50:35 +08:00
xiefangqi fbd9e3d402 vocdataset output multi-columns 2020-07-20 14:40:30 +08:00
mindspore-ci-bot 1a518e1cff !3144 [MD] Fix ResizeOp behaviour 
Merge pull request !3144 from nhussain/dataset_check
 2020-07-17 06:04:14 +08:00
nhussain c984b0fc88 fix size tuple 2020-07-16 17:02:34 -04:00
islam_amin 5647889c0d Added AutoContrast Op 2020-07-16 13:09:52 -04:00
mindspore-ci-bot 37e8439c0a !3077 supporting cpp invert operation 
Merge pull request !3077 from ava/invert
 2020-07-17 01:04:43 +08:00
avakh 35c3a63701 support cpp invert operation 2020-07-15 23:45:45 -04:00
Cathy Wong 04eb4f89c7 Cleanup dataset UT: Replace save_and_check 2020-07-15 20:47:31 -04:00
mindspore-ci-bot ba0143402c !3067 Cleanup dataset UT: Remove unneeded tf data files and tests 
Merge pull request !3067 from cathwong/ckw_dataset_ut_cleanup6
 2020-07-15 04:44:52 +08:00
Cathy Wong ae1ed327ba Cleanup dataset UT: Remove unneeded data files and tests 2020-07-14 12:24:54 -04:00
tinazhang 340d98a4d1 added test case to cifar_op 
update cifar10 dataset
fixing missing error handling code in validator
 2020-07-14 11:22:38 -04:00
mindspore-ci-bot 48654be14d !3040 BoundingBoxAugment op fix ratio 
Merge pull request !3040 from islam_amin/bounding_box_augment_bugs
 2020-07-14 09:36:34 +08:00
islam_amin 56da3b0ae1 Fixing ratio bug with BoundingBoxAugment 2020-07-13 18:11:19 -04:00
Jesse Lee 7c1bc5192b Initial Drop of CacheOp Phase I 2020-07-13 10:18:53 -04:00
mindspore-ci-bot 2c3c204b14 !2982 supporting cpp unit tests for randomresizewithbbox and resizewithbbox 
Merge pull request !2982 from ava/CPP_test3
 2020-07-10 04:56:36 +08:00
avakh b2bfb0342b supporting cpp unit tests for random_resize_with_bbox_op and resize_with_bbox_op. 2020-07-09 14:36:32 -04:00
Danish Farid 506f8f134e fix, cpp ut's 
fix cmakefile

fixed log statments in cpp UT tests
 2020-07-09 11:32:13 -04:00
mindspore-ci-bot 3cc9217f06 !2926 [Dataset C++ UT] Implement C++ UTs for RandomHorizontalFlipWithBBox and BoundingBoxAugment 
Merge pull request !2926 from islam_amin/object_ops_cc_ut_floats
 2020-07-09 05:56:46 +08:00
islam_amin 284cc910d5 C++ UTs for RandomHorizontalFlipWithBBox and Bounding Box Augment 2020-07-08 14:36:27 -04:00
avakh 421b80bf8f updating python unit tests based on floating point bounding boxes + adding coco dataset in unit tests 2020-07-07 18:05:49 -04:00
mindspore-ci-bot 9ba937b1af !2920 Updating 3 BBox AugOps for Float + Common Files for BBox Float Support - (VertFlip/RandomCrop/RandomResizeCrop) 
Merge pull request !2920 from danishnxt/AugOps-M1-Python
 2020-07-08 05:18:58 +08:00
Danish Farid 78c370f72a First Commit - New Infrastructure - Python UT tests + Common Aug Files 
fix accidental change overwrite

fix 2

updated inits from 0 to 0.0 for float

improvd python ut comments

updated macro
 2020-07-07 14:50:34 -04:00
islam_amin dfc3409f67 Update RandomHorizontalFlipWithBBox and BoundingBouxAugment C++ Ops to use floats 2020-07-06 23:49:21 -04:00
tinazhang dc03019200 unskip md5 testcase for RandomPerspective 2020-07-03 13:10:13 -04:00
mindspore-ci-bot 3197f9fb35 !2733 Schema clean up 
Merge pull request !2733 from EricZ/schema_fix
 2020-06-30 05:31:27 +08:00
Eric 88bb65768e Clean up part 1 
Removed extra fields in schema

Fixed test cases

Fixing CI
 2020-06-29 15:57:53 -04:00
tinazhang66 5cd3136355 remove local defined mse and add missing mse/md5 validation 2020-06-29 11:51:07 -04:00
mindspore-ci-bot 32a2d5d21c !2629 get monitor sampling interval from json file 
Merge pull request !2629 from yanghaitao/yht_sampling_interval
 2020-06-28 20:05:05 +08:00
qianlong cae77c0c22 BasicTokenizer not case fold on preserverd words 2020-06-28 16:28:00 +08:00
yanghaitao fd701b8504 set monitor sampling interval through json file 2020-06-28 15:18:21 +08:00
mindspore-ci-bot a1b17bd2e2 !2593 python unit tests for randomResizeWithBBox and ResizeWithBBox 
Merge pull request !2593 from ava/python_ut_tests
 2020-06-27 02:31:31 +08:00
avakh 1e869146e9 applying comments removing VOC 2020-06-26 12:39:48 -04:00
Cathy Wong 277aba5326 dataset: Fixup docs; remove pylint disabled messages in UT 2020-06-26 12:26:41 -04:00
mindspore-ci-bot e11c953225 !2587 Implementing Python UTs for BoundingBoxAugment and RandomHorizontalFlipWithBBox 
Merge pull request !2587 from imaaamin/object_ops_ut
 2020-06-26 00:43:31 +08:00