mindspore/tests/ut/python/dataset
hesham df361d1d26 Change mem layout of string tensor
add support for MindRecord and TFRecord
----
optimize tensorshape

optimize tensorshape and FlatIndex

TFRecord and MindRecord support for string tensor

Modify mem layout
Add new constructor
Add method Allocate

Change some GetMutableBuffer usages to AllocateBuffer
2020-05-22 01:22:29 -04:00
..
README.md initial version 2020-03-27 22:54:54 +08:00
prep_data.py initial version 2020-03-27 22:54:54 +08:00
test_2ops.py clean pylint 2020-05-18 16:42:35 +08:00
test_HWC2CHW.py Added TCs to RandomCrop and RandomCropAndResize and modified visalize() calling 2020-05-19 15:42:24 -04:00
test_Tensor.py clean pylint 2020-05-18 10:31:46 +08:00
test_apply.py clean pylint 2020-05-18 16:42:35 +08:00
test_autocontrast.py clean pylint 2020-05-18 16:42:35 +08:00
test_batch.py clean pylint 2020-05-18 10:31:46 +08:00
test_center_crop.py Added TCs to RandomCrop and RandomCropAndResize and modified visalize() calling 2020-05-19 15:42:24 -04:00
test_cifarop.py initial version 2020-03-27 22:54:54 +08:00
test_concat.py Cleanup dataset UT: unskip and enhance TFRecord sharding tests 2020-05-20 17:05:38 -04:00
test_config.py clean pylint 2020-05-18 16:42:35 +08:00
test_cut_out.py clean pylint 2020-05-18 10:31:46 +08:00
test_datasets_celeba.py clean pylint 2020-05-18 16:42:35 +08:00
test_datasets_get_dataset_size.py initial version 2020-03-27 22:54:54 +08:00
test_datasets_imagefolder.py initial version 2020-03-27 22:54:54 +08:00
test_datasets_imagenet.py clean pylint 2020-05-18 16:42:35 +08:00
test_datasets_imagenet_distribution.py clean pylint 2020-05-18 16:42:35 +08:00
test_datasets_manifestop.py clean pylint 2020-05-18 16:42:35 +08:00
test_datasets_sharding.py Cleanup dataset UT: unskip and enhance TFRecord sharding tests 2020-05-20 17:05:38 -04:00
test_datasets_textfileop.py add jieba c++ code 2020-05-20 15:55:12 +08:00
test_datasets_voc.py clean pylint 2020-05-18 16:42:35 +08:00
test_decode.py clean pylint 2020-05-18 16:42:35 +08:00
test_deviceop_cpu.py clean pylint 2020-05-18 16:42:35 +08:00
test_equalize.py clean pylint 2020-05-18 16:42:35 +08:00
test_exceptions.py clean pylint 2020-05-18 16:42:35 +08:00
test_filterop.py clean pylint 2020-05-18 16:42:35 +08:00
test_five_crop.py Cleanup dataset UT: unskip and enhance TFRecord sharding tests 2020-05-20 17:05:38 -04:00
test_flat_map.py add jieba c++ code 2020-05-20 15:55:12 +08:00
test_generator.py clean pylint 2020-05-18 10:31:46 +08:00
test_get_size.py initial version 2020-03-27 22:54:54 +08:00
test_invert.py clean pylint 2020-05-18 16:42:35 +08:00
test_iterator.py clean pylint 2020-05-18 16:42:35 +08:00
test_minddataset.py Change mem layout of string tensor 2020-05-22 01:22:29 -04:00
test_minddataset_exception.py clean pylint 2020-05-18 16:42:35 +08:00
test_minddataset_multi_images.py clean pylint 2020-05-18 10:31:46 +08:00
test_minddataset_multi_images_and_ndarray.py clean pylint 2020-05-18 16:42:35 +08:00
test_minddataset_sampler.py Change mem layout of string tensor 2020-05-22 01:22:29 -04:00
test_mixup_label_smoothing.py clean pylint 2020-05-18 16:42:35 +08:00
test_nlp_jieop.py add jieba c++ code 2020-05-20 15:55:12 +08:00
test_normalizeOp.py clean pylint 2020-05-18 16:42:35 +08:00
test_onehot_op.py clean pylint 2020-05-18 16:42:35 +08:00
test_opt.py MindData optimizer infrastructure. 2020-05-20 16:11:26 -04:00
test_pad.py clean pylint 2020-05-18 16:42:35 +08:00
test_pad_batch.py clean pylint 2020-05-18 16:42:35 +08:00
test_project.py clean pylint 2020-05-18 16:42:35 +08:00
test_pyfunc.py clean pylint 2020-05-18 10:31:46 +08:00
test_random_color.py clean pylint 2020-05-18 16:42:35 +08:00
test_random_color_adjust.py clean pylint 2020-05-18 16:42:35 +08:00
test_random_crop.py Added TCs to RandomCrop and RandomCropAndResize and modified visalize() calling 2020-05-19 15:42:24 -04:00
test_random_crop_and_resize.py Added TCs to RandomCrop and RandomCropAndResize and modified visalize() calling 2020-05-19 15:42:24 -04:00
test_random_crop_decode_resize.py clean pylint 2020-05-18 16:42:35 +08:00
test_random_dataset.py clean pylint 2020-05-18 16:42:35 +08:00
test_random_erasing.py Cleanup dataset UT: test_batch, save_and_check support 2020-05-05 15:35:09 -04:00
test_random_horizontal_flip.py clean pylint 2020-05-18 16:42:35 +08:00
test_random_resize.py clean pylint 2020-05-18 16:42:35 +08:00
test_random_rotation.py clean pylint 2020-05-18 16:42:35 +08:00
test_random_sharpness.py clean pylint 2020-05-18 16:42:35 +08:00
test_random_vertical_flip.py clean pylint 2020-05-18 16:42:35 +08:00
test_readdir.py initial version 2020-03-27 22:54:54 +08:00
test_rename.py clean pylint 2020-05-18 16:42:35 +08:00
test_repeat.py clean pylint 2020-05-18 16:42:35 +08:00
test_rescale_op.py clean pylint 2020-05-18 16:42:35 +08:00
test_rgb_hsv.py clean pylint 2020-05-18 16:42:35 +08:00
test_sampler.py !1281 Implementation of SplitOp 2020-05-22 09:29:03 +08:00
test_schema.py initial version 2020-03-27 22:54:54 +08:00
test_serdes_dataset.py clean pylint 2020-05-18 16:42:35 +08:00
test_shuffle.py clean pylint 2020-05-18 10:31:46 +08:00
test_skip.py clean pylint 2020-05-18 16:42:35 +08:00
test_split.py general split case done, chaining sampler (basic case) is working 2020-05-21 20:42:51 -04:00
test_storage.py The num_samples and numRows in schema for TFRecordDataset are conflict 2020-04-21 17:08:59 +08:00
test_sync_wait.py clean pylint 2020-05-18 16:42:35 +08:00
test_take.py clean pylint 2020-05-18 16:42:35 +08:00
test_tensor_string.py Change mem layout of string tensor 2020-05-22 01:22:29 -04:00
test_tfreader_op.py Cleanup dataset UT: unskip and enhance TFRecord sharding tests 2020-05-20 17:05:38 -04:00
test_tokenizer.py Add UnicodeCharTokenizer for nlp 2020-05-21 09:22:45 +08:00
test_type_cast.py clean pylint 2020-05-18 16:42:35 +08:00
test_uniform_augment.py Bug fix 2020-05-21 18:20:00 -04:00
test_var_batch_map.py clean pylint 2020-05-18 16:42:35 +08:00
test_vocab.py Implemented lookup and vocab 2020-05-21 17:17:24 -04:00
test_zip.py clean pylint 2020-05-18 16:42:35 +08:00
util.py clean pylint 2020-05-18 16:42:35 +08:00

README.md

DE Dataset Ops Test (Python)

Environment

Python3.7 (PyCharm IDE is recommended)

Introduce of data

All of data used in this folder created by Huawei Technologies Co.