Nigel
/
mindspore
forked from mindspore-Ecosystem/mindspore
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
16,315 Commits 24 Branches 0 Tags 3.9 GiB
Commit Graph

538 Commits

Author SHA1 Message Date
mindspore-ci-bot 20df37e428 !10287 Add ut for dataset to_number 
From: @luoyang42
Reviewed-by: @heleiwang
Signed-off-by:
 2020-12-23 21:14:42 +08:00
Zirui Wu a1355a827c introduce a master switch to turn on and off profiler 2020-12-22 16:48:01 -05:00
YangLuo da6de519ae Add ut for dataset to_number 2020-12-21 20:09:03 +08:00
mindspore-ci-bot d99189f681 !10207 Fix some minor doc, typo related to AutoNumWorker 
From: @ziruiwu
Reviewed-by: @mikef
Signed-off-by:
 2020-12-19 06:35:59 +08:00
Zirui Wu 4ae7102fd3 address 2 tickets 2020-12-18 15:03:32 -05:00
mindspore-ci-bot fc11b7dd68 !10074 Fix a testcase error when shuffle is above cache 
From: @lixiachen
Reviewed-by: @liucunwei,@pandoublefeng
Signed-off-by: @liucunwei,@liucunwei
 2020-12-17 19:56:26 +08:00
mindspore-ci-bot 691e3baab6 !10109 [MD] Fix Decode doc & RandomNode log 
From: @luoyang42
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
 2020-12-17 19:50:19 +08:00
mindspore-ci-bot 6035823c4b !10044 fix get num classes of concat 
From: @luoyang42
Reviewed-by: @liucunwei,@heleiwang,@liucunwei
Signed-off-by: @liucunwei,@liucunwei
 2020-12-17 19:30:50 +08:00
luoyang 595b7a782f [MD] Fix Decode doc & RandomNode log 2020-12-17 17:04:31 +08:00
Lixia Chen a7f0e13234 Remove special treatment for cache above repeat 2020-12-16 21:13:04 -05:00
YangLuo df9f4f41e8 fix get num classes of concat 2020-12-16 14:58:32 +08:00
Xiao Tianci 633f97bb48 fix get dataset size in distributed scenario 2020-12-15 20:41:45 +08:00
mindspore-ci-bot c4f284b928 !9910 [MD][Perf] MindData add NormalizePad for GPU performance 
From: @xiefangqi
Reviewed-by: 
Signed-off-by:
 2020-12-15 16:51:22 +08:00
xiefangqi 3c6cc3c58c Add NormalizePadOp 2020-12-15 11:45:41 +08:00
YangLuo 18e61a627a python eager add decode 2020-12-15 10:00:59 +08:00
mindspore-ci-bot ad6507d88a !9825 [MD] fix pad, normalize in c_trasnform 
From: @luoyang42
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
 2020-12-14 10:48:10 +08:00
luoyang 1cc147df1d fix pad, normalize in c_trasnform 2020-12-11 17:46:29 +08:00
Zirui Wu 77521e78d2 staging 2020-12-10 14:45:04 -05:00
Zirui Wu 91a6b2b0ca Add checks to RandomData and LookUp 2020-12-09 17:09:34 -05:00
mindspore-ci-bot 317a97e6b9 !9336 auto num_parallel_workers setup 
From: @ziruiwu
Reviewed-by: 
Signed-off-by:
 2020-12-09 08:32:55 +08:00
mindspore-ci-bot a2c80435ce !9685 Fix a core dump in TreeConsumer::Terminate() plus minor cache fixes 
From: @lixiachen
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
 2020-12-09 08:21:22 +08:00
Zirui Wu d6df1b0832 Implemented AutoNumWorker Pass which sets num_workers of selected parallel ops automatically if enabled 2020-12-08 17:49:05 -05:00
Lixia Chen 32b82c2737 Fix a core dump in TreeConsumer::Terminate() 
and other minor cache changes
 2020-12-08 15:38:40 -05:00
hesham ff65f6feb8 Remove batch_map multiprocess test case 2020-12-08 00:36:02 -05:00
mindspore-ci-bot aa5d4e08a9 !9544 Fix a possible seg fault in GenerateCRC caused by std::regex 
From: @lixiachen
Reviewed-by: @jonyguo,@heleiwang
Signed-off-by: @heleiwang
 2020-12-05 15:31:40 +08:00
Lixia Chen 27579fe858 Fix a seg fault caused by std::regex 2020-12-04 20:58:11 -05:00
Nat Sutyanyong 4cb78f2e03 Remove Repeat(1),Take(-1), and Skip(0) in NodeRemovalPass 2020-12-04 17:37:07 -05:00
mindspore-ci-bot 3280474d71 !9533 dataset Python Pushdown - more minor code rework; CSVDataset delim_field bug fix 
From: @cathwong
Reviewed-by: @nsyca,@mikef
Signed-off-by: @nsyca
 2020-12-05 06:01:13 +08:00
Jesse Lee 0c8dfc68ec Fix hang on RequestFreeTag 2020-12-04 14:54:30 -05:00
Cathy Wong 69b269c6cf dataset Python Pushdown - more minor code rework; CSVDataset delim_field bug fix 2020-12-04 14:39:52 -05:00
mindspore-ci-bot 4f607e9c26 !9335 Add multiprocessing support to per_batch_map 
From: @hfarahat
Reviewed-by: 
Signed-off-by:
 2020-12-04 15:13:46 +08:00
Nat Sutyanyong d69a29a44e Migrate 3 pre passes to IR optimizer, namely, cache_error_pass, epoch_injection, and removal_pass 2020-12-03 14:40:03 -05:00
alex-yuyue ccff3a5316 Change build to return status 
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
 2020-12-02 22:46:49 -05:00
hesham 809f9c91be Add multiprocessing support to per_batch_map 2020-12-02 15:40:14 -05:00
mindspore-ci-bot df44e1339e !9249 Optimizing GetDatasetSize 
From: @mahdirahmanihanzaki
Reviewed-by: 
Signed-off-by:
 2020-12-02 08:26:34 +08:00
mindspore-ci-bot 4ffd9b578f !9331 More cache minor fix for HQ testers 
From: @lixiachen
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
 2020-12-02 06:45:15 +08:00
Mahdi f80553bc6e Optimization for GetDatasetSize 2020-12-01 17:40:25 -05:00
Lixia Chen 2ddb1fb75e More CRC fix and blocking BatchOp under cache 2020-12-01 15:20:33 -05:00
mindspore-ci-bot 920bbf1541 !9277 fix schema & zip validation 
From: @luoyang42
Reviewed-by: @pandoublefeng,@liucunwei
Signed-off-by: @liucunwei
 2020-12-01 16:28:48 +08:00
YangLuo 5cc3b76577 fix schema & zip validation 2020-12-01 14:23:56 +08:00
mindspore-ci-bot af3c27d354 !9244 Fix core dump with concat and getter_pass 
From: @ziruiwu
Reviewed-by: 
Signed-off-by:
 2020-12-01 06:56:41 +08:00
mindspore-ci-bot c3e7a8255c !9248 Add input check to nlp operators 
From: @ezphlow
Reviewed-by: @nsyca,@mikef
Signed-off-by: @nsyca
 2020-12-01 06:45:26 +08:00
Eric cf802c839c Added missing input check for nlp operator 2020-11-30 16:23:40 -05:00
Zirui Wu 23487fae09 fix get_shape/type and a segfault in getter_pass 
add test case
 2020-11-30 16:22:33 -05:00
mindspore-ci-bot 762793cb8f !9175 fix a bug in random resize crop op and some lint 
From: @tiancixiao
Reviewed-by: @liucunwei,@jonyguo,@liucunwei
Signed-off-by: @liucunwei
 2020-11-30 20:03:51 +08:00
Xiao Tianci 12da8717b7 1.correct param check for vision op 2.fix config review 3.fix api doc 2020-11-30 16:12:31 +08:00
luoyang aa4bf9a3f2 [MD] Support python-eager: Resize, Rescale, Normalize, HWC2CHW, Pad 2020-11-28 10:06:53 +08:00
tinazhang 6f31bdbf67 fix issues for hq testers: I277HD, I277HV 2020-11-27 17:01:23 -05:00
tinazhang 27698866d1 Block take/skip under cache and fix docstring 
and other minor changes per the request of HQ testers
 2020-11-26 17:44:19 -05:00
mindspore-ci-bot adc8e3e707 !8594 [MD] Pybind Pushdown Support for dataset 
From: @cathwong
Reviewed-by: 
Signed-off-by:
 2020-11-26 05:55:49 +08:00