p47068915
/
mindspore
forked from mindspore-Ecosystem/mindspore
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
18,025 Commits 23 Branches 0 Tags 3.9 GiB
Commit Graph

1012 Commits

Author SHA1 Message Date
luoyang d43155b5b0 [MD] Decouple more Transform Ops 2020-11-18 14:50:59 +08:00
mindspore-ci-bot e3b1814401 !8713 Fix for GetDatasetSize issue in TextFile 
From: @mahdirahmanihanzaki
Reviewed-by: @nsyca,@robingrosman
Signed-off-by: @nsyca
 2020-11-18 05:39:51 +08:00
Mahdi 449e1526dc Fixed GetDatasetSize for TextFile 2020-11-17 15:22:58 -05:00
Zirui Wu ff5999fc2f add removal pass for getters 
fix CI round I

fix ci round II

address review cmts

fix ci round II
 2020-11-17 10:49:23 -05:00
Mahdi ecde0f03a2 Updated GetNumSamples logic 2020-11-16 16:03:14 -05:00
jiangzhiwen b30c1045e1 add lite_mat multiply 2020-11-16 15:05:31 +08:00
mindspore-ci-bot 9c957072e2 !8097 Remove redundant phi nodes 
From: @ginfung
Reviewed-by: 
Signed-off-by:
 2020-11-16 14:06:52 +08:00
yujianfeng 3176d377e6 Remove redundant phi nodes 2020-11-16 09:36:55 +08:00
yangzhenzhang 0c2c76d037 update get rank in parallel ops 2020-11-13 16:43:44 +08:00
mindspore-ci-bot edcb0cd86b !8370 [MD] Use neon instruction set to accelerate the Substract and Divide ops 
From: @jiangzhiwen8
Reviewed-by: @xulei2020
Signed-off-by:
 2020-11-13 16:14:00 +08:00
mindspore-ci-bot c54a4a4494 !8540 Added GetColumnNames to C++ 
From: @mahdirahmanihanzaki
Reviewed-by: @nsyca,@jonyguo
Signed-off-by: @nsyca
 2020-11-13 09:33:37 +08:00
Mahdi 5a7515e48f Added GetColumnNames to C++ 2020-11-12 16:36:59 -05:00
Zirui Wu 3555d19b07 fix get num_class in imagefolder 
address cmt

review cmts
 2020-11-12 14:26:54 -05:00
mindspore-ci-bot 7aa7ece5ce !8497 add stage id for pipeline parallel 
From: @yangzhenzhang
Reviewed-by: @stsuteng,@kisnwang
Signed-off-by: @stsuteng
 2020-11-12 17:23:39 +08:00
jiangzhiwen 03bbe5f2a8 neon acceleration for subtract 2020-11-12 16:30:40 +08:00
yangzhenzhang 41d925b68a set stage id 2020-11-12 11:14:31 +08:00
mindspore-ci-bot f60ae8925d !8480 Add RandomNode fix 
From: @ezphlow
Reviewed-by: @pandoublefeng,@heleiwang
Signed-off-by:
 2020-11-12 10:00:03 +08:00
mindspore-ci-bot 510a0399fc !8335 added cluster config and message handler unit test,change namespace from comm to core 
From: @anancds
Reviewed-by: 
Signed-off-by:
 2020-11-12 09:33:29 +08:00
Eric a21eb2d527 Added random node fix 2020-11-11 17:24:48 -05:00
mindspore-ci-bot 0de9d3e5b7 !6989 split sort for parallel run 
From: @kisnwang
Reviewed-by: 
Signed-off-by:
 2020-11-11 18:54:56 +08:00
mindspore-ci-bot 222a0bccf4 !8431 Add more check in unsorted_segment_sum_fission pass to avoid doing wrong optimize which cause runtime error 
From: @irmo
Reviewed-by: 
Signed-off-by:
 2020-11-11 15:44:51 +08:00
anancds 96d8c411e7 added message handler unit test 2020-11-11 14:50:18 +08:00
huanghui 1c6c280da7 fix unsorted_segment_sum_fission pass 2020-11-11 11:25:55 +08:00
mindspore-ci-bot 70f5775711 !8387 Add support for GetClassIndexing in C++ API 
From: @alex-yuyue
Reviewed-by: 
Signed-off-by:
 2020-11-11 03:02:22 +08:00
alex-yuyue d7c3a9ba00 Add GetClassIndexing 
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
 2020-11-10 11:02:02 -05:00
kswang b88e722e12 add graph partition 2020-11-10 22:01:10 +08:00
mindspore-ci-bot bc12c647a5 !8380 [MD]remove opencv api with lite_cv in lite train 
From: @xulei2020
Reviewed-by: @heleiwang
Signed-off-by:
 2020-11-10 14:41:36 +08:00
xulei2020 f8d1b20873 init litemat from memory 2020-11-10 10:12:39 +08:00
mindspore-ci-bot f8f2d127cd !7999 optimize cpu unique 
From: @kisnwang
Reviewed-by: 
Signed-off-by:
 2020-11-10 09:42:01 +08:00
kswang 618c05d454 optimize cpu unique 2020-11-09 17:05:42 +08:00
mindspore-ci-bot 908a494add !8299 [MD] Skip returning IR when meet nullptr in ConcatDataset 
From: @luoyang42
Reviewed-by: @nsyca,@pandoublefeng,@jonyguo
Signed-off-by: @jonyguo
 2020-11-09 11:49:48 +08:00
mindspore-ci-bot 36e69f6ef9 !8162 gpu support dynamic shape 
From: @wilfchen
Reviewed-by: @limingqi107,@cristoval
Signed-off-by: @cristoval
 2020-11-09 09:28:45 +08:00
mindspore-ci-bot 027916cb5f !8315 Cache server stability 
From: @jkl_lee
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
 2020-11-08 20:03:23 +08:00
Lixia Chen f24a788eed Rebase up to 5792d50ca7 2020-11-06 18:39:05 -05:00
Zirui Wu 7538f82da9 add callback to map's c api 
fix test err

fix ci round 1

fix ci round 2

add col_order to batch_node

minor fix
 2020-11-06 16:36:47 -05:00
mindspore-ci-bot a9a9c45662 !8232 C++ api add Filter 
From: @tiancixiao
Reviewed-by: 
Signed-off-by:
 2020-11-07 00:32:15 +08:00
mindspore-ci-bot 97e1f6f438 !8248 Add macro and fix album testcase 
Merge pull request !8248 from EricZ/helper_dep_removal
 2020-11-06 20:33:20 +08:00
mindspore-ci-bot 073d991de4 !8106 add cpu adam delta 
Merge pull request !8106 from kisnwang/add-cpu-adam-delta
 2020-11-06 17:30:24 +08:00
Xiao Tianci 4a5e287b92 add filter c api and ut 2020-11-06 15:49:23 +08:00
luoyang dcb758bc77 [MD] Skip returning IR when meet nullptr in ConcatDataset 2020-11-06 15:08:11 +08:00
wilfChen e4e9362bd0 gpu suppor dynamic shape 2020-11-06 14:16:27 +08:00
kswang cbece74a23 add cpu adam delta 2020-11-06 13:52:54 +08:00
Eric 394dbf50e1 Added testing macro and fix album_op test 2020-11-05 13:22:51 -05:00
mindspore-ci-bot 523c3f07e3 !8194 Optimizer on IR #2 - Call ValidateParams in PrePass 
Merge pull request !8194 from nsyca/opt3
 2020-11-05 22:52:37 +08:00
mindspore-ci-bot 099765bbb7 !8135 [MD] Transform api decouple 
Merge pull request !8135 from luoyang/c-api-pyfunc
 2020-11-05 22:41:44 +08:00
Yi Huaijie d7faa77b5e support int64 shape 2020-11-05 21:15:49 +08:00
luoyang 9a57cbacd9 [MD] Transform api decouple 2020-11-05 19:56:15 +08:00
mindspore-ci-bot 8709005a57 !8200 Add two transforms API 
Merge pull request !8200 from shenwei41/new_master
 2020-11-05 11:19:00 +08:00
Nat Sutyanyong a2a2223373 Add optimizer to IR tree #2 2020-11-04 21:44:17 -05:00
mindspore-ci-bot 7123a2c1d1 !7911 added key value message 
Merge pull request !7911 from anancds/kv-patch
 2020-11-05 09:53:00 +08:00
mindspore-ci-bot ae7384ca2d !8208 Removed dependency on core module in util 
Merge pull request !8208 from EricZ/helper_dep_removal
 2020-11-05 02:44:30 +08:00
Eric 85f0a9bc8f Added dependency removal for data_helper 2020-11-04 12:15:32 -05:00
anancds 87edbdf720 added protobuf message 2020-11-04 22:19:04 +08:00
zhoufeng 183742009f mindspore cxx api for 310 inference 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2020-11-04 13:59:33 +08:00
shenwei41 9ffdf0b6d4 Add transform API 2020-11-04 11:54:33 +08:00
Zirui Wu 5d1ada682c remove uncessary headers 
staging II

clean up

further clean up

fix merge conflict with 8139

fix complie err
 2020-11-03 11:59:55 -05:00
hesham 5169fb4c42 Remove api namespace 2020-11-02 20:09:37 -05:00
mindspore-ci-bot 6e2241d64f !8096 Add DatasetNode as a base Class for IR nodes 
Merge pull request !8096 from h.farahat/datasetNode
 2020-11-03 00:41:42 +08:00
jjfeing 56f1bb1b66 add dump data when task error 2020-11-02 09:42:53 +08:00
hesham 0ba0595caf DatasetNode as a base for all IR nodes 2020-11-01 16:57:10 -05:00
Mahdi 5005b434e6 Fixed repeat issue with GetDatasetSize 2020-10-30 19:36:56 -04:00
mindspore-ci-bot cacebd1211 !7933 Cache performance updates 
Merge pull request !7933 from Jamie/CacheOp_dev
 2020-10-31 04:25:47 +08:00
mindspore-ci-bot 7ef7bef1d8 !7796 [MD] Enable C++ cache api for non-mappable datasets 
Merge pull request !7796 from lixiachen/cache_c_api_nonmappable
 2020-10-30 22:11:13 +08:00
Lixia Chen 572c5e5f29 Rebase up to 542a52fbf8 2020-10-29 20:34:09 -04:00
Cathy Wong 18ecd65f93 C++ API: Delete ValidateParams in dataset APIs; update error input UTs 2020-10-29 16:29:16 -04:00
mindspore-ci-bot 8f44074796 !7866 [MD] C++ API support build_sentence_piece_vocab_node & sentence_piece_tokenizer 
Merge pull request !7866 from luoyang/c-api-pyfunc
 2020-10-29 14:26:13 +08:00
luoyang 52d278e858 [MD] C++ API support build_sentence_piece_vocab_node & sentence_piece_tokenizer 2020-10-29 11:05:28 +08:00
mindspore-ci-bot 2ba20dc8e7 !7848 Add five transforms API 
Merge pull request !7848 from shenwei41/new_master
 2020-10-29 10:18:57 +08:00
Zirui Wu 814044963b add validation check in tfrecord_node 
update ut
 2020-10-28 19:26:51 -04:00
Zirui Wu ea97197311 fix tfrecord_op core dump 
add test case

fix ci

fix ci round 2

address review cmts
 2020-10-28 17:38:43 -04:00
mindspore-ci-bot c39c3ccfbe !7734 Redesigned GetNumClasses 
Merge pull request !7734 from Alex Yuyue/IR_dataset_input
 2020-10-29 01:44:36 +08:00
shenwei41 779f0f387b Add transforms API 2020-10-28 22:06:58 +08:00
Xiao Tianci 823e52f1dc add params checking of offset in distributed_sampler 
add related comment to explain
add related UT
 2020-10-28 16:46:12 +08:00
Lixia Chen 02ddddfe7e Enable caching over non-mappable dataset c++ api 
and caching over Album dataset
 2020-10-27 23:02:13 -04:00
alex-yuyue 913a49f3af Add support for C++ API: GetNumClasses 
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
 2020-10-27 16:26:51 -04:00
anancds 4b995fe170 fixed Destructor and RegisterRoute 2020-10-26 15:53:31 +08:00
mindspore-ci-bot 3376e0d034 !7704 [MD] Add testcases for cache c api 
Merge pull request !7704 from lixiachen/cache_c_api
 2020-10-26 14:31:09 +08:00
mindspore-ci-bot d81bd7b17b !7710 Add c++ API for GetRepeatCount and GetBatchSize 
Merge pull request !7710 from h.farahat/getBatchRepeat
 2020-10-26 09:25:21 +08:00
mindspore-ci-bot 0124eef185 !7729 [MD] Fix log of vision and dataset in C++ api 
Merge pull request !7729 from luoyang/pylint
 2020-10-26 09:23:22 +08:00
mindspore-ci-bot 7982f05038 !7730 [MD] Fix bugs in WeightedRandomSampler & SubsetRandomSampler 
Merge pull request !7730 from luoyang/c-api-pyfunc
 2020-10-26 09:22:14 +08:00
luoyang f0e976dbda [MD] Fix bugs in WeightedRandomSampler & SubsetRandomSampler 2020-10-25 17:58:51 +08:00
hesham f3880f8355 Add GetBatchSizer and GetRepeatCount to c++ API 2020-10-24 22:45:19 -04:00
YangLuo f3fa5a441d [MD] Fix log of vision and dataset in C++ api 2020-10-24 19:24:30 +08:00
mindspore-ci-bot 3d194137da !7702 Redesigned GetOutputType and GetOutputShape 
Merge pull request !7702 from Alex Yuyue/IR_dataset_input
 2020-10-24 14:42:29 +08:00
mindspore-ci-bot 48edd9708c !7690 [MD] fix num_sample in randomsampler and sequential sampler 
Merge pull request !7690 from liyong126/fix_md_num_samples
 2020-10-24 11:13:19 +08:00
alex-yuyue 2906659673 Add support for GetOutputTypes and GetOutputShapes 
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
 2020-10-23 22:21:52 -04:00
mindspore-ci-bot fe2852df82 !7703 C++ API: Add a parameter validation and fix incorrect format of error message for TFrecord 
Merge pull request !7703 from TinaMengtingZhang/fix_tfrecord_issue_I1YKU6_I1YKXL
 2020-10-24 07:33:26 +08:00
Lixia Chen bc396febae Add testcases for cache c api 2020-10-23 17:10:18 -04:00
tinazhang e7346dd3a9 add a validation code to fix issue I1YKU6 and corresponded ut, fix format issue I1YKXL 2020-10-23 17:07:51 -04:00
Mahdi 0e03f5b0dd Added GetDatasetSize 2020-10-23 16:29:11 -04:00
Zirui Wu a85a256749 fix complie err in c_api_dataset_test_save 2020-10-23 10:09:35 -04:00
mindspore-ci-bot 3355bb5f2f !7657 Leaf node IR breakdown, port to engine/ir/datasetops/source/ 
Merge pull request !7657 from ZiruiWu/ir_breakdown_leaf_nodes
 2020-10-23 20:32:31 +08:00
liyong ee042b90f7 fix num_sample in sequentialSampler and randomSampler 2020-10-23 19:26:10 +08:00
mindspore-ci-bot 9d35fdc4e5 !7653 [MD] C++ api SaveOp 
Merge pull request !7653 from luoyang/c-api-pyfunc
 2020-10-23 14:14:11 +08:00
Zirui Wu cfc50e231a Added IR breakdown for remaining ops after PR7596 
fix android build failure

fix include in datasets.cc

attempting fix android build

fix complie err x86
 2020-10-22 23:07:41 -04:00
luoyang 8e60cfe800 [MD] C++ api save 2020-10-23 10:27:35 +08:00
mindspore-ci-bot 19b10d474f !7530 [MD] Add divide image proccessing 
Merge pull request !7530 from jiangzhiwen/lite/image_divide
 2020-10-23 09:22:36 +08:00
anancds 98bbb4ef7a added tcp base on libevent 2020-10-22 17:44:29 +08:00
mindspore-ci-bot 8bfe141680 !7571 fix bug in reshape strategy search when reshape as the first operator 
Merge pull request !7571 from yao_yf/reshape_strategy_search_fix_when_reshape_is_first_op
 2020-10-22 10:16:33 +08:00
yao_yf f7189adb91 fix bug in reshape strategy search when reshape is first operator 2020-10-22 09:15:18 +08:00
Zirui Wu d471552fc5 shuffle take repeat bucketbatch buildvocab repeat shuffle take project concat rename node IR added 
concat, bucketbatch project rename

fix ci round 1

fix ci round 2

fix up

fix ci
 2020-10-21 18:41:34 -04:00
mindspore-ci-bot de7ea8e68c !7540 Extract ImageFolderNode and BatchNode into its own files from datasets.cc/.h 
Merge pull request !7540 from ZiruiWu/refactor_ir_demo
 2020-10-21 19:23:20 +08:00
mindspore-ci-bot 566656ea72 !7558 fix the repeated calculation accuracy error 
Merge pull request !7558 from yangzhenzhang/update-repeated-calculation
 2020-10-21 19:14:13 +08:00
mindspore-ci-bot a8dc0f5c1b !7557 [MD] Add merge image proccessing 
Merge pull request !7557 from jiangzhiwen/lite/merge
 2020-10-21 17:28:55 +08:00
yangzhenzhang eb6f4e3ce8 update repeated calculation 2020-10-21 16:13:58 +08:00
jiangzhiwen 8e785648da add merge image processing 2020-10-21 14:44:22 +08:00
Zirui Wu 52eec881ec Refactor ImageFolderNode and BatchNode into its separate files 
fix ci

fix ci

address review cmmts, fix ci

remove dup code in datasets.cc
 2020-10-20 23:07:51 -04:00
mindspore-ci-bot 643366ea70 !7538 Add empty string tensor support for Album 
Merge pull request !7538 from EricZ/album_empty_string
 2020-10-21 08:41:29 +08:00
Eric 7e21648e16 Added Album empty string tensor support 2020-10-20 16:37:37 -04:00
Zirui Wu aa8442e0a3 add skeleton code for tree_adapter 
stage II tree_adapter

add test case for tree_adapter

use dfs to build tree

add more test case

add test case

fix ci

fix ci round 2

fix ci round 3

fix ci round 4

fix complie error

fix ci round 6

fix ci round 7

fix ci round 8

fix ci round 9
 2020-10-20 12:44:28 -04:00
jiangzhiwen fadc97a18f add divide op 2020-10-20 20:53:01 +08:00
mindspore-ci-bot 48601f51b0 !7295 [MD] C++ api add MindDataset 
Merge pull request !7295 from luoyang/c-api-pyfunc
 2020-10-20 19:45:45 +08:00
mindspore-ci-bot 8ff82843ea !7486 [MD] Add subtract image proccessing 
Merge pull request !7486 from jiangzhiwen/lite/image_subtract
 2020-10-20 19:39:11 +08:00
mindspore-ci-bot 947f6d96d1 !7414 C++ api add config_manager 
Merge pull request !7414 from xiaotianci/c_api_config
 2020-10-20 19:37:18 +08:00
mindspore-ci-bot 7707bb8540 !7439 [MD] Add YUV to BGR , Split, extractChannel ops 
Merge pull request !7439 from xulei/lite_test0905
 2020-10-20 19:36:19 +08:00
Xiao Tianci fb98fbcc9f add c api config 2020-10-20 16:32:57 +08:00
luoyang 2dc8e5f421 [MD] C++ api add MindDataset 2020-10-20 16:12:49 +08:00
xulei2020 442cee15ad add yuv420sp to bgr, split and extractchannel 2020-10-20 15:05:25 +08:00
jiangzhiwen 44f7978f7c add image subtract 2020-10-20 10:53:27 +08:00
yangzhenzhang fc4ed975c4 handle repeated calculation 2020-10-19 10:47:01 +08:00
mindspore-ci-bot 70bd405338 !7375 Change normalize input check 
Merge pull request !7375 from EricZ/change_normalize_check
 2020-10-19 09:14:28 +08:00
anancds 28c9e9d9a5 Added http server based on libevent 2020-10-16 14:26:42 +08:00
Eric d3e89086e5 Removed check for normalize mean 2020-10-15 17:03:41 -04:00
mindspore-ci-bot 0357088a73 !7319 C++ API: vision ops - reorder and add gap UTs; correct parm desc style 
Merge pull request !7319 from cathwong/ckw_c_api_transforms_tests2
 2020-10-16 00:31:24 +08:00
mindspore-ci-bot 15b1725198 !7321 Fix ordering for album dataset 
Merge pull request !7321 from EricZ/album_float_array
 2020-10-15 21:57:36 +08:00
Eric 359ad19884 Added float_array support 
Added fix, tests to come
 2020-10-15 00:18:30 -04:00
huanghui b7519b7418 unify save_graphs_path 2020-10-15 10:15:16 +08:00
Cathy Wong 9f7c1a32e7 C++ API: vision ops - reorder and add gap UTs; correct parm desc style 2020-10-14 19:10:13 -04:00
mindspore-ci-bot 7e7d47db50 !7266 RandomResizedCrop for C API 
Merge pull request !7266 from MahdiRahmaniHanzaki/c-api
 2020-10-14 23:00:15 +08:00
shenwei41 87b108f4e0 C++ api add Rescale 2020-10-14 10:32:48 +08:00
Mahdi c8333accfc RandomResizedCrop C API 2020-10-13 17:27:29 -04:00
mindspore-ci-bot 4a077f6341 !7035 Add validation for input image size of affine transformation 
Merge pull request !7035 from jiangzhiwen/fix/check_affine_size
 2020-10-13 15:03:46 +08:00
mindspore-ci-bot 2d645fdc7e !7184 [MD] C++ api add TypeCaseOp & RandomCropDecodeResizeOp 
Merge pull request !7184 from luoyang/pylint
 2020-10-13 09:08:23 +08:00
jiangzhiwen 197f0cabe0 check affine input size 2020-10-12 17:06:31 +08:00
YangLuo 9e033bbe19 C++ api add TypeCaseOp & RandomCropDecodeResizeOp 2020-10-12 15:13:17 +08:00
mindspore-ci-bot c951d42c2c !6728 [Ascend][DynamicShape] Dynamic shape feature 
Merge pull request !6728 from caifubi/dynamic_shape_share_2
 2020-10-12 09:07:39 +08:00
caifubi d3b978147f Ascend Dynamic Shape 2020-10-10 19:11:47 +08:00
jjfeing 755863ebae insert memcpy when hccl node 2020-10-10 17:03:50 +08:00
mindspore-ci-bot d3bd1cb5b8 !6668 [Data Dump] [master] Fix asynchronous data dump failure 
Merge pull request !6668 from caifubi/dump
 2020-10-09 10:48:24 +08:00
mindspore-ci-bot ccb2e8851c !6782 enable parallel optimizer in auto parallel 
Merge pull request !6782 from gziyan/enable_optimizer_shard_in_auto_parallel
 2020-10-09 09:03:40 +08:00
Cathy Wong 2aa26d245c C++ API: Move vision ops to new vision files; create transforms namespace 2020-10-08 11:59:58 -04:00
Ziyan ddc0113058 enable parallel optimizer in auto parallel 2020-10-08 14:51:15 +08:00
mindspore-ci-bot 03f0e64af9 !7049 Fixes to TensorRow conversion and Tensor 
Merge pull request !7049 from MahdiRahmaniHanzaki/c_func
 2020-10-01 04:19:19 +08:00
caifubi b17b4abf7d Fix async data dump failed 2020-09-30 11:39:19 +08:00
Mahdi e92d4edceb Updated TensorRow conversion 2020-09-29 14:50:44 -04:00
jjfeing 7dda95d247 set soc version 2020-09-28 21:04:07 +08:00
mindspore-ci-bot 9bd34a1b29 !6673 Add stage information for ops and strategy 
Merge pull request !6673 from huangxinjing/stage_strategy
 2020-09-27 11:31:07 +08:00
mindspore-ci-bot 0d8015b043 !5300 [MD] Add nD Slice Support 
Merge pull request !5300 from nhussain/slice_op
 2020-09-25 20:38:19 +08:00
huangxinjing 4ef439e27b Add stage information for ops and strategy 2020-09-25 10:42:43 +08:00
mindspore-ci-bot 70221f5261 !6307 Conversion to and from TensorRow in C++ 
Merge pull request !6307 from MahdiRahmaniHanzaki/c_func
 2020-09-25 04:14:05 +08:00
nhussain 77d507279c first working implementation 
add string implementation, can handle partial string slices

finish core implementation, added Index object

fix up the logic

add in new SliceOption object, cleaning up tests
 2020-09-24 15:39:28 -04:00
Lixia Chen 983827ec5c Rebase up to 88ded11f59 2020-09-24 14:09:08 -04:00
Mahdi 890598d112 Added TensorRow conversion 2020-09-24 11:12:22 -04:00
mindspore-ci-bot f847414117 !6471 Fix AdjustAllReduceMulAdd pass 
Merge pull request !6471 from thlinh/dev_Sep18_fix_AdjustAllReduceMulAdd_pass
 2020-09-19 21:48:46 +08:00
yanghaitao1 4ff4c17632 fix get_dataset_size in CelebADataset when usage is not all 2020-09-19 02:16:29 -04:00
Hoai Linh Tran 46f07efc31 Fix AdjustAllReduceMulAdd pass 
Revive tests in lib_test

Code cleaning
 2020-09-19 01:07:01 -04:00
mindspore-ci-bot c8e9d46391 !6450 Change PS directory. 
Merge pull request !6450 from ZPaC/master-change-ps-dir
 2020-09-18 11:42:41 +08:00
ZPaC 0b49f0fb57 change PS dir 2020-09-18 10:48:09 +08:00
mindspore-ci-bot 5d0b91cb22 !6436 [Ascend Profiling] FIx start profiling failed 
Merge pull request !6436 from caifubi/profiling
 2020-09-18 10:02:19 +08:00
caifubi 39039974b2 fix profiling start up fail 2020-09-18 08:56:13 +08:00
luoyang 9064a5f731 add num_row check & fix api distributed sampler, lookup, default value 
of usage
 2020-09-17 20:31:26 +08:00
mindspore-ci-bot af1c5aba5b !6354 [Data][BUG]add SubStractMeanNormalize input param check 
Merge pull request !6354 from xulei/lite_test0905
 2020-09-17 09:06:19 +08:00
xulei2020 85962adffd add code 2020-09-16 17:01:30 +08:00
wuweikang e24f534002 sync-from-trunk-to-blue-zone-0912-c75b220 2020-09-16 11:28:22 +08:00
mindspore-ci-bot bb4dbf4989 !5803 Combine Async Dump with E2e Dump 
Merge pull request !5803 from caifubi/dump
 2020-09-14 11:47:00 +08:00
caifubi 372c2e7951 Combine Async Dump and E2E Dump 2020-09-14 10:57:46 +08:00
luoyang 581335453e Change return val of GetNextRow 2020-09-12 14:19:46 +08:00
mindspore-ci-bot a084196300 !6094 Adding input checks to C API 
Merge pull request !6094 from EricZ/add_input_check_capi
 2020-09-12 09:47:50 +08:00
eric cd5af9472e Added input check 2020-09-11 20:36:12 -04:00
xulei2020 72861a68f3 add code 2020-09-11 19:28:35 +08:00
jiangzhiwen d4ce668b9b add Affine ut 2020-09-10 21:50:56 +08:00
mindspore-ci-bot c882e4863c !5961 [Data]Add lite_cv lib for mindspore lite data preprocessing 
Merge pull request !5961 from xulei/lite_test0905
 2020-09-10 18:51:07 +08:00
mindspore-ci-bot ea94756839 !5605 Introduce usage flag to MNIST and CIFAR dataset 
Merge pull request !5605 from ZiruiWu/add_usage_to_cifar_mnist_coco
 2020-09-10 15:47:48 +08:00
xulei2020 b356211413 add init code 2020-09-10 15:35:08 +08:00
mindspore-ci-bot 7152fe04be !5783 GraphKernel supports GPU 
Merge pull request !5783 from DeshiChen/graph_kernel_1.0
 2020-09-10 09:15:21 +08:00
Zirui Wu 1bb93580dd Add usage flag to MNIST/CIFAR 
ci fix 1

fix ci 2

fix ci 3

fix ci 4

fix ci 5

fix ci 6

fix ci 7

change var name in CelebA from dataset_type to usage

address review cmts

fix cpp ut fail

change mode to usage in VOCDataset

fix cmts

fix ci test case fail
 2020-09-09 09:59:55 -04:00
dayschan 37a48f6aac GraphKernel supports GPU 
1. Update akg submodule
2. Refactor akg_kernel_build, akg_ascend_kernel_build, akg_gpu_kernel_build
3. Add akg_kernel_json_decoder to support converting kernel_json to AnfNode.
4. Add GraphKernel Cost Model. (mindspore/_extends/graph_kernel)
5. Add some GraphKernel passes to GpuSession, move these passes to backend/optimizer/graph_kernel.
6. Add global id for ir files.
7. Fix bug in ConstInputToAttr.
 2020-09-09 17:46:50 +08:00
Zirui Wu bde9f18f5a update lookup api to take in a type 
ci

add test case

address some of the review cmts

address review cmts
 2020-09-08 11:59:28 -04:00
wuxuejian bd527a331d update aicpu proto and update module: graphengine 
Support Dynamic Shape Aicpu Run Package

adapt tensorengin modify, fix ub fusion
 2020-09-08 11:38:44 +08:00
mindspore-ci-bot 5c7fa52468 !5673 [performance]cell init opt performance 
Merge pull request !5673 from kingxian/master
 2020-09-05 17:10:08 +08:00
kingxian 92bebe65a9 cell init performance opt 2020-09-04 19:52:56 +08:00
mindspore-ci-bot d0c7b1ba24 !5731 Manifest Dataset check invalid filename string 
Merge pull request !5731 from jiangzhiwen/fix/invalid_filename_string
 2020-09-04 16:36:29 +08:00
mindspore-ci-bot bc4c5afc1a !5667 add kernel select after optimize pass 
Merge pull request !5667 from zyli2020/code_refactor
 2020-09-04 14:24:44 +08:00
mindspore-ci-bot 2f3684d4fa !4872 Add C++ API support for TFRecordDataset 
Merge pull request !4872 from TinaMengtingZhang/cpp-api-tfrecord-dataset
 2020-09-04 11:53:08 +08:00
lizhenyu c3d6918649 add kernel select after optimize pass 2020-09-04 10:52:51 +08:00
jiangzhiwen 294f7b620a check invalid filename string 2020-09-03 22:09:26 +08:00
mindspore-ci-bot 527d7f0afb !5580 [MD] remove finish in FileReader 
Merge pull request !5580 from liyong126/rmv_filereader_finish
 2020-09-03 21:18:35 +08:00
mindspore-ci-bot b961d47d40 !5642 UTest compiling performance optimization 
Merge pull request !5642 from zhoufeng/ut-compile-performance
 2020-09-03 20:21:13 +08:00
liyong ac39c20f41 del finish in FileReader 2020-09-03 20:05:38 +08:00
mindspore-ci-bot 01da7d2c1a !5713 Align num_samples of CSV with other dataset 
Merge pull request !5713 from jiangzhiwen/fix/csv_num_samples
 2020-09-03 19:52:43 +08:00
jiangzhiwen 1a1a8893a4 Align num_samples of CSV with other dataset 2020-09-03 17:30:39 +08:00
zhoufeng 6d500223b2 utest compiling performance optimization 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2020-09-03 16:57:19 +08:00
zhousiyi 301aeaaf1d remove gvar source file from compile as ut_tests will use gvar so 2020-09-03 06:49:30 +00:00
tinazhang e430b4056a add tfrecord dataset to cpp api 
fix to support schema=nullptr
 2020-09-02 08:55:47 -04:00
luoyang 8aba39a71b Modify VOCDataset doc & Fix BuildVocab bug 2020-09-02 16:54:50 +08:00
mindspore-ci-bot 5e3e583b47 !5615 Add check for duplicate column to a-cpi & add voc descriptions for class_index 
Merge pull request !5615 from luoyang/c-api-pyfunc
 2020-09-02 11:59:34 +08:00
mindspore-ci-bot 3048240f16 !5508 Add AdamApplyOneWithDecayAssign fusion pass 
Merge pull request !5508 from YuJianfeng/adam_assign
 2020-09-02 11:23:34 +08:00
luoyang ce419404ce Add check for duplicate column for a-cpi 2020-09-02 10:41:52 +08:00
mindspore-ci-bot 0cb6d29f0c !4998 Shared memory pool clean up 
Merge pull request !4998 from JesseKLee/mem_pool
 2020-09-02 02:01:19 +08:00
mindspore-ci-bot dff02cc282 !5188 rename image files in imagefolder 
Merge pull request !5188 from tony_liu2/alt
 2020-09-01 11:16:30 +08:00