yystopf
/
mindspore
forked from mindspore-Ecosystem/mindspore
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
45,876 Commits 23 Branches 0 Tags 3.9 GiB
Commit Graph

266 Commits

Author SHA1 Message Date
i-robot daae93cff3 !27633 Parallelize calculating tensor statistics in tensor_summary 
Merge pull request !27633 from Jimmy Qi/timing
 2021-12-15 07:53:58 +00:00
li-qiyao f4bfcb8c25 [feat][assistant][I40GXN] add new loader SogouNews 2021-12-14 22:53:38 -08:00
Jimmy Qi c3ab951fa9 Parallelize calculating tensor statistics 2021-12-14 20:40:11 +00:00
sabrinasun 542d715217 seperate constant from pb 2021-12-14 13:19:14 -05:00
lufei9026 30bc609ce6 [feat][assistant][I40GY8]add new loader IWSLTDataset 2021-12-13 21:47:55 +08:00
Megalomania 259854e040 [feat] [assistant] [I40GY5] add new loader PennTreebankDataset 2021-12-08 01:22:40 -08:00
lufei9026 2947f418b1 [feat][assistant][I3T96N]add new loader YelpReview 2021-12-07 17:09:41 +08:00
RainWang6188 c4063f0f11 [feat][assistant][I3J6VI] add new data operator STL10 2021-12-07 01:21:11 +00:00
i-robot b1eae16a05 !22304 [assistant][ops]New operator implementation, include SVHNDataset 
Merge pull request !22304 from 王睿/svhn_dataset
 2021-12-06 12:30:13 +00:00
zhangyuqwer e934381b08 [feat][assistant][I3ZSQV] add new data operator CharNGram 2021-12-04 22:09:34 +08:00
RainWang6188 340b3b4d5d [feat][assistant][I3J6VJ] add new data operator SVHN 2021-12-04 08:19:47 +00:00
i-robot 93db7f741f !20788 [assistant][ops] Add new dataset loading operator TedliumDataset 
Merge pull request !20788 from 杨旭华/TedliumDataset
 2021-12-03 06:29:29 +00:00
luqilin 34bffbf768 [feat][assistant][I3T96H] add new dataset loading operator TedliumDataset 2021-12-02 09:53:39 +08:00
zy 8f9a09f79c [fix] [assistant] [I3ZSQR] add new data operator GloVe 2021-12-01 17:12:20 +08:00
zy 5ca98a494a [fix] [assistant] [I3ZSQS] add new data operator FastText 2021-12-01 11:12:08 +08:00
i-robot eb9537af11 !21690 [assistant][ops] Add data operator Vectors 
Merge pull request !21690 from 张渝/Vectors
 2021-12-01 01:29:45 +00:00
i-robot 2fd00935ed !20964 [assistant][ops] Add new data operator SpeechCommandsDataset 
Merge pull request !20964 from 杨旭华/SpeechCommandsDataset
 2021-11-30 09:33:03 +00:00
zhangyuqwer 6a6e73ef82 [fix] [assistant] [I3ZSQM] add new data operator Vectors 2021-11-30 14:39:42 +08:00
vddong 91d3a7543f [feat][assistant][I3T96F] add new data operator SpeechCommands 2021-11-27 11:25:18 +08:00
i-robot 875f35d6d8 !26541 Fix file name and field type changes generated by HCCL in profiler. 
Merge pull request !26541 from casgj/master_hccl
 2021-11-23 13:16:28 +00:00
casgj b15c09db6d Fix file name and field type changes generated by HCCL. 2021-11-23 12:48:59 +08:00
vddong f465cd0242 [feat][assistant][I3T96L]add new dataset operator YesNo 2021-11-19 13:36:24 +08:00
vddong 6fe2d35ae2 [feat][assistant][I3T96D] add new dataset loading operator LJSpeechDataset 2021-11-14 14:52:15 +08:00
Carry955 0d26c38693 [feat][assistant][I40GXT] add new loader DBpedia 2021-11-11 19:02:22 -08:00
Megalomania c34bbabed9 [feat] [assistant] [I3T96M] add new loader AGNEWS 2021-11-09 23:51:19 -08:00
i-robot f9bd640b09 !16269 [assistant][RandomLighting] 
Merge pull request !16269 from QingfengLi/randomlighting
 2021-10-20 06:42:12 +00:00
yangyueren 6594b90a58 [feat][assistant][I3J6VE] add new data operator PhotoTour 2021-10-19 15:31:32 +00:00
chenx2ovo 77caf907c4 [feat][assistant][I3CEGR] add op random lighting 2021-10-19 20:38:01 +08:00
yangyueren 951193c308 [feat][assistant][I3J6VF] add new data operator Places365 2021-10-15 14:56:09 +00:00
G-Dragon-Liu 32baa520bf [feat][assistant][I3J6V2] add new data operator EMnist 2021-10-08 02:53:00 +00:00
ckczzj 001b68c286 [feat][assistant][I3J6VG] add new data operator QMnist 2021-09-22 12:13:27 +08:00
i-robot ef425a1321 !23493 Fix Pyfunc C++ deserialize bug 
Merge pull request !23493 from zetongzhao/deserialize
 2021-09-15 08:59:41 +00:00
sabrinasun 3a349a9219 add ut test for offline debugger 2021-09-14 18:46:22 -04:00
zetongzhao 860810b9c4 check python interpreter 2021-09-14 16:25:04 -04:00
ckczzj af97ba4a77 [feat][assistant][I3J6VH] add new data operator SBU 2021-09-11 09:58:17 +08:00
wangkc123 3daf3a4d5f [feat] [assistant] [I3CKEK] add new dataset operator DIV2K 2021-09-10 17:55:34 +08:00
ckczzj d7c702e9d4 [feat][assistant][I3J6VL] add new data operator USPS 2021-09-09 21:46:57 +08:00
i-robot 938324b397 !19362 [assistant][ops] Add new dataset operator Cityscapes. 
Merge pull request !19362 from Rainfor/cityscapes
 2021-09-08 09:14:43 +00:00
xiefangqi e4aa1aa119 remove testCOCO 404 link 2021-09-03 10:46:34 +08:00
wangkc123 70f741bcc1 [feat] [assistant] [I3CKEM] add new dataset operator Cityscapes 2021-08-31 20:03:37 +08:00
Parastoo Ashtari bf034bddb5 Apply comments on tensor stat online and offline debugger 2021-08-26 17:40:01 -04:00
sabrinasun a9c6bf45a3 re-enabling offline debugger ut test 2021-08-25 19:05:19 -04:00
i-robot acee9b24bc !22284 Change Op name in hccl to Op name in step trace 
Merge pull request !22284 from 张毅辉/op_name_of_hccl_to_op_name_of_step_trace
 2021-08-25 09:32:55 +00:00
zhangyihui dab750d1a5 Mapping op_name of hccl to op_name of step trace 2021-08-25 10:51:52 +08:00
i-robot 2edaba38bf !21389 Add Tensor Base and Stat info to offline debugger 
Merge pull request !21389 from parastooashtari/tensor_info_levels
 2021-08-25 02:08:34 +00:00
Parastoo Ashtari ff83dee704 Add tensor base and stat info to offline debugger 2021-08-24 18:19:59 -04:00
i-robot 0e7844daa9 !22093 revert merge request 21685 
Merge pull request !22093 from guozhijian/revert-merge-21685-master
 2021-08-21 09:25:32 +00:00
guozhijian e1df9a2152 revert 'Pull Request !21685 : add function to invert_op' 2021-08-19 22:49:51 +08:00
i-robot 4113aee7d6 !18668 [assistant][ops]New operator implementation, include Flowers102Dataset 
Merge pull request !18668 from Wangsong95/flowers102_dataset
 2021-08-19 08:41:44 +00:00
fake_killer b0bc4bf5da [feat] [assistant] [I44TRS] extend invert_op's function 2021-08-18 21:46:15 +08:00
ckczzj 9d9f33be88 [feat][assistant][I3J6VN] add new data operator flowers102 2021-08-06 10:55:12 +08:00
wangkc123 48f5fed1f8 [feat] [assistant] [I3CKEN] add new dataset operator Flickr 2021-08-04 10:20:43 +08:00
i-robot ef77050348 !18892 [assistant][ops] Add new dataset operator SBD. 
Merge pull request !18892 from Rainfor/sbd
 2021-08-03 03:33:00 +00:00
wangkc123 b381e0be9d [feat] [assistant] [I3CKER] add new dataset operator SBD 2021-07-17 21:02:30 +08:00
zhoufeng 35797bd5da add serialization cpp ut 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-06-26 13:22:10 +08:00
yanghaitao1 d2c01a2ff1 fix vm type error 2021-06-21 04:53:49 -04:00
mindspore-ci-bot 8c5680360d !16200 [Debugger] Fix empty result when reading non-existent tensor 
From: @tina_mengting_zhang
Reviewed-by: @john_tzanakakis,@robingrosman
Signed-off-by: @john_tzanakakis
 2021-05-12 03:08:00 +08:00
mindspore-ci-bot d3a175e30f !16078 Modify Normalize to accept images with more than 3 channels 
From: @hfarahat
Reviewed-by: @mikef,@robingrosman
Signed-off-by: @robingrosman
 2021-05-11 02:03:34 +08:00
TinaMengtingZhang a44376f42a Fix empty tensor issue when reading an non-existing node in sync dump mode 2021-05-10 13:59:05 -04:00
hesham fd943bbdc0 Modify normalize to support multiple of channels 2021-05-07 17:06:26 -04:00
mindspore-ci-bot b85bf60eb8 !15727 VOCDataset read xml will filter invalid bbox automationally 
From: @xiefangqi
Reviewed-by: @heleiwang,@jonyguo
Signed-off-by: @jonyguo
 2021-05-07 09:50:53 +08:00
mindspore-ci-bot 577cf7cd1d !15758 [Offline Debug] Add UT tests to the offline debugger. 
From: @islam_amin
Reviewed-by: @john_tzanakakis,@tom__chen,@robingrosman
Signed-off-by: @john_tzanakakis
 2021-04-29 04:33:02 +08:00
Islam Amin 6bb740f137 added GPU UT tests 2021-04-28 13:03:51 -04:00
xiefangqi 458ff5fed9 md fix voc and manifest error scenario 2021-04-27 14:24:57 +08:00
zhangyunshu d969be9107 profiler: fixed aicpu timeline 2021-04-15 19:35:24 +08:00
RobinGrosman a0e75b845a Increase default level of parallelism in mindddata pipeline to 8. 
Adjust memory usage to not increase as parallelism increases.  it will
stay at same level it would be with 4 parallelism
 2021-03-10 18:38:11 -08:00
heleiwang 2dc9ba761c gnn support weight sampling neighbors. 2021-01-28 15:28:44 +08:00
mindspore-ci-bot a2d9c5914a !10944 Tensor op decoupling stage 2 
From: @alexyuyue
Reviewed-by: 
Signed-off-by:
 2021-01-15 05:28:50 +08:00
alex-yuyue b54e01bfb4 Tensor op decoupling stage 2 
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
 2021-01-14 11:51:16 -05:00
caifubi ab07dbdff2 Change profiling reporter tag 2021-01-12 19:28:53 +08:00
Xiao Tianci 0659473535 add TruncateSequencePair, ToNumber C++ API and enable three test cases 2020-12-08 11:12:16 +08:00
Cathy Wong e5f62013f4 dataset Python UT: Add Sampler Chain Tests, with get_dataset_size 2020-11-17 15:24:44 -05:00
alex-yuyue 913a49f3af Add support for C++ API: GetNumClasses 
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
 2020-10-27 16:26:51 -04:00
Eric 7e21648e16 Added Album empty string tensor support 2020-10-20 16:37:37 -04:00
mindspore-ci-bot 7707bb8540 !7439 [MD] Add YUV to BGR , Split, extractChannel ops 
Merge pull request !7439 from xulei/lite_test0905
 2020-10-20 19:36:19 +08:00
xulei2020 442cee15ad add yuv420sp to bgr, split and extractchannel 2020-10-20 15:05:25 +08:00
Eric 359ad19884 Added float_array support 
Added fix, tests to come
 2020-10-15 00:18:30 -04:00
mindspore-ci-bot 2f3add4acd !6301 [MD] Combine c++ and python ops in map 
Merge pull request !6301 from nhussain/c_py_compose
 2020-09-24 23:10:47 +08:00
nhussain fda9462682 embed python compose op 
Leaf ops do self-reset.

embed python compose op

add implicit compose op

more tests
 2020-09-21 11:24:55 -04:00
yanghaitao1 4ff4c17632 fix get_dataset_size in CelebADataset when usage is not all 2020-09-19 02:16:29 -04:00
Lixia Chen b5b333726f Leaf ops do self-reset. 2020-09-14 09:48:14 -04:00
liyong 16147669a6 fix num_samples in concatDataset 2020-09-12 15:06:18 +08:00
mindspore-ci-bot 2dfb2f3578 !6009 Add Affine transformation ut for Lite Dataset 
Merge pull request !6009 from jiangzhiwen/lite/affine_ut
 2020-09-11 09:57:56 +08:00
nhussain 92e99ff224 change map calls 2020-09-10 10:25:05 -04:00
jiangzhiwen d4ce668b9b add Affine ut 2020-09-10 21:50:56 +08:00
mindspore-ci-bot dff02cc282 !5188 rename image files in imagefolder 
Merge pull request !5188 from tony_liu2/alt
 2020-09-01 11:16:30 +08:00
Cathy Wong 7f6782be2a dataset fixes: Update OneHot API docs; fixup Python UTs 2020-08-31 15:04:26 -04:00
tony_liu2 5e4c314130 rename dataset dir and image files 
change references to use path original

revert folder name

revert graphengine
 2020-08-27 16:49:23 -04:00
islam_amin 94a4a3f20b changing affine and posterize apis 2020-08-26 10:51:54 -04:00
Eric c79db93c48 Initial commit for album 
Added linter fix for album dataset

Added testDataset

Adding signature

Added JsonDataset example API

Example dataset

Resolving format

More fixing

Refactor

Small fix

Added compiling album dataset

Running tests

Added linter fix #1

Passing UT

Added dataset API

Addressing clang

Clang part 2

Fixing pass

Fixed tree check

lint fix

Added lint fix part 2
 2020-08-22 11:07:10 -04:00
mindspore-ci-bot d541e261a0 !4696 C++ API Support for CSV Dataset 
Merge pull request !4696 from jiangzhiwen/jzw/c_api_csv
 2020-08-19 17:08:33 +08:00
mindspore-ci-bot 256dccc651 !4498 Gnn data processing supports distributed scenarios 
Merge pull request !4498 from heleiwang/gnn_distributed
 2020-08-19 16:09:05 +08:00
jiangzhiwen 39df25f803 c++ api for CSV Dataset 2020-08-19 16:02:11 +08:00
heleiwang 8ee4d8e92d Gnn data processing supports distributed scenarios 2020-08-19 11:09:01 +08:00
nhussain 738ae2c78d change api to use std_vector 
try to display image
 2020-08-18 15:41:21 -04:00
islam_amin 979111d0ef Added Posterize Op 2020-08-18 13:55:47 -04:00
mindspore-ci-bot 113ff6ca24 !4367 CutMixBatch Augmentation Op 
Merge pull request !4367 from MahdiRahmaniHanzaki/cutmix
 2020-08-18 03:27:33 +08:00
mahdi 3ecc53fb4e Added CutMix 2020-08-17 13:01:47 -04:00
Alexey Shevlyakov 8526d5414d RandomColor 2020-08-13 16:10:21 -04:00
avakh 477528de7f random sharpness cpp op support 2020-08-11 15:30:40 -04:00