p47068915
/
mindspore
forked from mindspore-Ecosystem/mindspore
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
9,551 Commits 23 Branches 0 Tags 3.9 GiB
Commit Graph

2755 Commits

Author SHA1 Message Date
tinazhang e430b4056a add tfrecord dataset to cpp api 
fix to support schema=nullptr
 2020-09-02 08:55:47 -04:00
mindspore-ci-bot 35e6cca1a3 !5634 wrap numpy random seed into an api 
Merge pull request !5634 from yihuaijie/master
 2020-09-02 19:28:33 +08:00
buxue 4d59fe9ee1 add check for mod when y in (-1, 0) 2020-09-02 18:10:00 +08:00
Wei Luning 879a519136 updata signature 2020-09-02 17:29:29 +08:00
Yi Huaijie 4a5d115a66 add get_seed() and set_seed() 2020-09-02 17:17:04 +08:00
luoyang 8aba39a71b Modify VOCDataset doc & Fix BuildVocab bug 2020-09-02 16:54:50 +08:00
He Wei c1469d61ce Fix get_py_obj_dtype() for mindspore type 
Return mstype.type_type if input is mindspore type object,
for example:
```
get_py_obj_dtype(mstype.float32) ---> mstype.type_type
```
 2020-09-02 16:14:25 +08:00
mindspore-ci-bot ccc0ea60ee !5661 fix auto parallel reshape strategy set when it is first operator 
Merge pull request !5661 from yao_yf/auto_parallel_reshape_fix
 2020-09-02 15:42:47 +08:00
mindspore-ci-bot 847fadc8b9 !5516 auto parallel context modify 
Merge pull request !5516 from yao_yf/auto_parallel_context_collation
 2020-09-02 15:41:05 +08:00
mindspore-ci-bot bb84f50407 !5473 optim pylint 
Merge pull request !5473 from jinyaohui/master
 2020-09-02 15:25:30 +08:00
mindspore-ci-bot 4ec343961e !5482 modify save_checkpoint 
Merge pull request !5482 from liuyang/md_save_checkpoint
 2020-09-02 14:20:48 +08:00
yao_yf 755f381406 fix auto parallel reshape strategy set when it is first operator 2020-09-02 14:15:54 +08:00
mindspore-ci-bot 5e3e583b47 !5615 Add check for duplicate column to a-cpi & add voc descriptions for class_index 
Merge pull request !5615 from luoyang/c-api-pyfunc
 2020-09-02 11:59:34 +08:00
mindspore-ci-bot 3048240f16 !5508 Add AdamApplyOneWithDecayAssign fusion pass 
Merge pull request !5508 from YuJianfeng/adam_assign
 2020-09-02 11:23:34 +08:00
luoyang ce419404ce Add check for duplicate column for a-cpi 2020-09-02 10:41:52 +08:00
mindspore-ci-bot 03093778df !5387 Set num_epochs=1 for MindData python testcases 
Merge pull request !5387 from lixiachen/testcase_epoch
 2020-09-02 09:45:13 +08:00
mindspore-ci-bot be3d79cb6b !4204 add dynamic shape support for GatherV2 and others 
Merge pull request !4204 from fary86/adapt_primitive_dynamic_shape
 2020-09-02 09:31:14 +08:00
mindspore-ci-bot 120ab80b23 !5641 check user define bprop when there is parameter in nested network 
Merge pull request !5641 from zhangbuxue/check_user_define_bprop_when_there_is_parameter_in_nested_network
 2020-09-02 09:04:05 +08:00
mindspore-ci-bot 0cb6d29f0c !4998 Shared memory pool clean up 
Merge pull request !4998 from JesseKLee/mem_pool
 2020-09-02 02:01:19 +08:00
Lixia Chen 27d5281641 Change epoch count to 1 for python testcases 2020-09-01 11:24:26 -04:00
mindspore-ci-bot 749979e7c4 !5458 NMS GPU OP Performance improvement 
Merge pull request !5458 from danishnxt/GPU_two
 2020-09-01 23:05:56 +08:00
buxue 359e1f236e check user define bprop when there is parameter in nested network 2020-09-01 21:24:27 +08:00
mindspore-ci-bot 91a0fa75a5 !5594 add st about loss_scale and parser for pynative mode 
Merge pull request !5594 from Simson/push-to-opensource
 2020-09-01 19:30:18 +08:00
fary86 144a35b17e Adapt GatherV2 for dynamic shape 2020-09-01 19:24:21 +08:00
mindspore-ci-bot 8f3ebfd469 !5624 Optimize the performance of GraphData.get_neg_sampled_neighbors 
Merge pull request !5624 from heleiwang/gnn_perf
 2020-09-01 19:22:53 +08:00
heleiwang 857cf2f77f Optimize the negative sampling process 2020-09-01 16:29:59 +08:00
mindspore-ci-bot c2fddb56c8 !4922 Transform tuple parameter to multiple parameters 
Merge pull request !4922 from amongo/TupleTransform
 2020-09-01 15:15:56 +08:00
simson 26fa5c7d8c add st about loss_scale and parser for pynative mode 2020-09-01 15:10:47 +08:00
mindspore-ci-bot 087212441a !5192 Add unit tests for scatternd 
Merge pull request !5192 from Peilin/scatternd-type-support
 2020-09-01 14:26:15 +08:00
huangdongrun 0099da2c99 add support for tuple parameter transform 
add support for pynative pass

add testcases
 2020-09-01 14:17:52 +08:00
mindspore-ci-bot dff02cc282 !5188 rename image files in imagefolder 
Merge pull request !5188 from tony_liu2/alt
 2020-09-01 11:16:30 +08:00
mindspore-ci-bot 5453b40311 !4477 add dataset compare function to utils 
Merge pull request !4477 from tony_liu2/staging
 2020-09-01 11:15:18 +08:00
mindspore-ci-bot b99149dc37 !4901 Adding data_helper for minddata 
Merge pull request !4901 from EricZ/md_helper
 2020-09-01 11:14:11 +08:00
mindspore-ci-bot ab29dbf98b !5385 dataset fixes: Update OneHot API doc; fixup UTs 
Merge pull request !5385 from cathwong/ckw_dataset_ut_cleanup8
 2020-09-01 11:11:49 +08:00
mindspore-ci-bot 8ebc8ce9c6 !5438 support parameter tuple input in pynative mode 
Merge pull request !5438 from wangqiuliang/support-parameter-tuple-input
 2020-09-01 11:04:03 +08:00
mindspore-ci-bot 3be136f6f0 !5354 Fix randomdata issue 
Merge pull request !5354 from xiefangqi/fix_randomdata_columnlist
 2020-09-01 11:03:54 +08:00
mindspore-ci-bot 6cba0deb05 !4877 BucketBatchByLength for C++ API 
Merge pull request !4877 from MahdiRahmaniHanzaki/bucket_batch_by_length_c
 2020-09-01 10:58:51 +08:00
mindspore-ci-bot 1a4d3e351e !5586 Boost python pass compile and train performance 
Merge pull request !5586 from BowenK/performance
 2020-09-01 09:19:02 +08:00
mahdi 84efa0b96b Added BucketBatchByLength for C API 2020-08-31 17:06:16 -04:00
Eric 65bf3ecc3e Adding data_helper class 2020-08-31 16:29:14 -04:00
Cathy Wong 7f6782be2a dataset fixes: Update OneHot API docs; fixup Python UTs 2020-08-31 15:04:26 -04:00
mindspore-ci-bot 65819fb50c !5488 heck arg is tensor when graph output is a const or parameter 
Merge pull request !5488 from zhangbuxue/add_check_tensor_before_compile_graph
 2020-08-31 21:36:04 +08:00
yao_yf 8f7aa5bd5a auto parallel context modify 2020-08-31 21:19:49 +08:00
kingfo 7765d44b76 support parameter tuple input in pynative mode 2020-08-31 20:38:43 +08:00
BowenK d6fb7d2db1 Remove debug drawing and printing to boost compile performance; re-opt after python pass to boost training; fix NewParameter tensor clone 2020-08-31 17:42:00 +08:00
buxue 4168c51f0d add check tensor when graph output is a const or parameter 2020-08-31 17:17:24 +08:00
liuyang_655 4683de3443 modify save_checkpoint 2020-08-31 16:24:57 +08:00
jinyaohui a9972a7def optim pylint 2020-08-31 14:49:57 +08:00
mindspore-ci-bot 8d41931456 !5352 refactor ms_context implementation 
Merge pull request !5352 from fary86/refactor_context_interface
 2020-08-31 09:27:33 +08:00
mindspore-ci-bot 4d963d96f4 !5534 Fix Tensor.from_numpy() returns wrong type 
Merge pull request !5534 from hewei/fix_tensor_from_numpy
 2020-08-31 09:15:48 +08:00
Jesse Lee e89b4648f6 Memory pool clean up 2020-08-30 11:28:24 -04:00
fary86 fcbb3e0edc Refactor ms_context implementation 2020-08-30 22:51:40 +08:00
He Wei 27721ff4ea Fix Tensor.from_numpy() returns wrong type 
Tensor.from_numpy() should return mindspore.Tensor not _c_expression.Tensor.
 2020-08-29 19:05:44 +08:00
yujianfeng 4b77f6b53c Add AdamApplyOneWithDecayAssign fusion pass 2020-08-29 17:54:15 +08:00
mindspore-ci-bot e6a4d932b4 !5350 [AutoParallel]Rectification distributed init 
Merge pull request !5350 from lichen/rectification_init
 2020-08-29 14:55:18 +08:00
mindspore-ci-bot d81b30e6a0 !5312 make backend/optimizer free of pybind 
Merge pull request !5312 from xychow/remove-backend-py-dependency-2
 2020-08-29 14:42:33 +08:00
mindspore-ci-bot be606ba8f5 !5432 Mindspore parallel supports all elementary-wise operators 
Merge pull request !5432 from yihuaijie/master
 2020-08-29 14:16:48 +08:00
lichenever d3e55b543e rectification init 2020-08-29 09:34:58 +08:00
mindspore-ci-bot 1821e98e07 !4087 asyn run graph 
Merge pull request !4087 from kisnwang/async-run-graph
 2020-08-29 09:18:37 +08:00
danish 7d7fa760a0 reduce based nms final pass - speed improv 
refactored faster nms

refactored faster nms + typo fix

added box flipping choice

set choice to true for testing - yz

switching back

new test file
 2020-08-28 13:41:09 -04:00
Yi Huaijie 84948ca730 parallel supports more elementary-wise operators 2020-08-28 18:19:06 +08:00
kswang 756bb6d53f async run graph 2020-08-28 18:18:47 +08:00
zhousiyi c25e37e7bf make backend/optimizer pybind free 2020-08-28 08:56:58 +00:00
mindspore-ci-bot 414184c184 !5367 Check the parameter's split strategies if it has multiple users 
Merge pull request !5367 from yangzhenzhang/check-parameter-split
 2020-08-28 16:26:46 +08:00
mindspore-ci-bot 820f2cb4eb !5351 move ParalleMode to Context 
Merge pull request !5351 from yao_yf/parallel_context_collation
 2020-08-28 16:13:01 +08:00
yao_yf 07117e4dd4 mv ParallelMode to context 2020-08-28 19:13:55 +08:00
xiefangqi e2085a9505 fix randomdata issue 2020-08-28 11:55:49 +08:00
He Wei d7cdda1cb0 Provide Tensor.from_numpy() to avoid copy 2020-08-28 11:03:14 +08:00
yangzhenzhang fbda03bbcc check parameter split 2020-08-28 10:49:27 +08:00
tony_liu2 70bfd506a1 add function 
pr comment fix

revert graphengine
 2020-08-27 16:50:19 -04:00
tony_liu2 5e4c314130 rename dataset dir and image files 
change references to use path original

revert folder name

revert graphengine
 2020-08-27 16:49:23 -04:00
mindspore-ci-bot 716329df6c !5278 Change default value of sampler in c-api 
Merge pull request !5278 from luoyang/c-api
 2020-08-27 21:33:18 +08:00
mindspore-ci-bot 7aaf4118bf !5297 CutMixBatch and MixUpBatch fix for 2D one-hot labels 
Merge pull request !5297 from MahdiRahmaniHanzaki/cutmix-fix
 2020-08-27 21:32:09 +08:00
YangLuo 419478b410 Change default value of sampler to seperate behaviour of default sampler 
& null sampler, add check for duplicate column name
 2020-08-27 21:24:37 +08:00
mindspore-ci-bot 9392623066 !5181 Python pass pattern renaming and interface tweaking 
Merge pull request !5181 from BowenK/new_parameter
 2020-08-27 19:45:36 +08:00
mindspore-ci-bot da8d04e8bd !5237 Enbale ub fusion of Matmul+ConfusionTransposeD 
Merge pull request !5237 from huanghui/ub-fusion-matmul-confusion-transpose
 2020-08-27 18:47:52 +08:00
mindspore-ci-bot a8317acee8 !5111 Support int64 for cpu sparse optimizers 
Merge pull request !5111 from YuJianfeng/int64
 2020-08-27 17:17:05 +08:00
mindspore-ci-bot e94416be0c !5283 Support setting operator io format in the frontend 
Merge pull request !5283 from liangchenghui/io_format
 2020-08-27 15:48:13 +08:00
mindspore-ci-bot fabebb2678 !5264 [bug]fix bugs when parameters updata 
Merge pull request !5264 from vlne-v1/I1SP3I-return-value-not-the-exact-value
 2020-08-27 14:13:20 +08:00
mindspore-ci-bot b346f0b3ec !5026 Fix the problem of resource clear 
Merge pull request !5026 from Simson/enhancement-API
 2020-08-27 11:19:02 +08:00
yujianfeng e949540062 Support int64 for cpu sparse optimizers 2020-08-27 10:57:53 +08:00
simson d4babf190c fix risk of memory leak 2020-08-27 10:54:06 +08:00
mindspore-ci-bot def1ff4307 !5302 Enlarge-the-threshold-of-resnet50-in-pynative 
Merge pull request !5302 from JoyLvliang/enlarge-the-threshold-of-resnet50-in-pynative
 2020-08-27 10:45:54 +08:00
mindspore-ci-bot 042f6a8d97 !5201 serving st time optimization 
Merge pull request !5201 from hexia/st_optimization_time
 2020-08-27 10:43:03 +08:00
mindspore-ci-bot 454ae16335 !4777 Add test cases for uniform ops on GPU 
Merge pull request !4777 from peixu_ren/custom_gpu
 2020-08-27 10:42:39 +08:00
mindspore-ci-bot d1b95ed9bd !5240 Fix remove internal output for unique device target 
Merge pull request !5240 from YuJianfeng/internal_output
 2020-08-27 10:35:37 +08:00
BowenK 641d12d6d9 python pass pattern renaming and interface tweaking 2020-08-27 10:03:46 +08:00
mindspore-ci-bot 66d6320b21 !5224 Add test case about loss scale in parallel mode 
Merge pull request !5224 from yangzhenzhang/add-split-sens-and-loss-scale-test-case
 2020-08-27 09:06:01 +08:00
lvliang 1b018b8167 enlarge-the-threshold-of-resnet50-in-pynative 2020-08-27 08:52:32 +08:00
mahdi 7ad7024c45 Fixed 2D one-hot label problems in CutMix and MixUp 2020-08-26 16:17:21 -04:00
peixu_ren 2d5d44ab22 Add test cases for uniform ops on GPU 2020-08-26 12:02:27 -04:00
islam_amin 94a4a3f20b changing affine and posterize apis 2020-08-26 10:51:54 -04:00
mindspore-ci-bot adbb75556d !4778 Added type support for Reshape gpu kernel for faster RCNN 
Merge pull request !4778 from Peilin/reshape-gpu-kernel-type-support
 2020-08-26 22:41:12 +08:00
Wei Luning 4cc8342b5b fix bug in Parameter init_data 2020-08-26 22:15:22 +08:00
梁成辉 34d433fd9a Set io format for old backend 2020-08-26 20:49:15 +08:00
kpy 44b738e8ac fix grad all ci bug 2020-08-26 18:28:35 +08:00
yujianfeng e688e1df32 Fix remove internal output for unique device target 2020-08-26 17:31:35 +08:00
mindspore-ci-bot 8eff6c96b4 !5045 merge slice parameter checkpoints in wide&deep 
Merge pull request !5045 from yao_yf/wide_and_deep_eval_host_device
 2020-08-26 17:16:30 +08:00
mindspore-ci-bot 314c5ad055 !5172 remove name arg from gradoperation 
Merge pull request !5172 from riemann_penn/remove_name_args_from_gradoperation
 2020-08-26 16:55:57 +08:00
mindspore-ci-bot 8b5c35210f !5208 Modify the name of parameters in uniform 
Merge pull request !5208 from peixu_ren/custom_pp_ops
 2020-08-26 16:06:40 +08:00
huanghui 7755a54452 fix ub-fusion 2020-08-26 16:02:25 +08:00
mindspore-ci-bot 95212b55a0 !3271 make reftype a subtype of MetaTensor and try to mark ref in node input 
Merge pull request !3271 from vlne-v1/ref_demo
 2020-08-26 15:45:48 +08:00
yangzhenzhang 6ae5893681 add test cases 2020-08-26 15:11:44 +08:00
Wei Luning 24a10225cf change base class of ref to tensor in cpp 2020-08-26 12:41:25 +08:00
mindspore-ci-bot e4d2f2fd3b !5030 Adding a BBox class and fixing Posterize C Op testing. 
Merge pull request !5030 from islam_amin/bbox_class
 2020-08-26 11:40:57 +08:00
panyifeng 1a54785fe2 remove name arg from gradoperation 2020-08-26 11:16:57 +08:00
mindspore-ci-bot cd1240180b !5187 C++ API: Lexicographical order support for CLUE, CSV & TextFile Datasets 
Merge pull request !5187 from cathwong/ckw_c_api_fixes2
 2020-08-26 10:48:05 +08:00
yao_yf eeede168fa wide_and_deep merge ckpt in eval 2020-08-26 10:47:26 +08:00
mindspore-ci-bot 20b3134785 !5184 fix: padded dataset when no div and with repeat op 
Merge pull request !5184 from guozhijian/fix_padded_with_no_div_repeat
 2020-08-26 10:47:22 +08:00
peixu_ren 10f381d662 Modify the name of parameters in uniform 2020-08-25 22:44:21 -04:00
mindspore-ci-bot f3fd7a5578 !5073 Add checks and exception handling DS callback 
Merge pull request !5073 from h.farahat/map_callback_end
 2020-08-26 10:40:40 +08:00
hexia e1c240f86a serving st time optimization 2020-08-26 09:51:48 +08:00
mindspore-ci-bot 9e8c4f373f !5070 Fix wrong index error msg 
Merge pull request !5070 from fanglei/new_case
 2020-08-26 09:26:55 +08:00
jonyguo 6df1a43ec2 fix: padded dataset with non div & repeat 2020-08-26 08:56:37 +08:00
Peilin Wang d92a357e4a add scatternd ut 2020-08-25 17:03:57 -04:00
Cathy Wong 46e9d79a50 C++ API: Lexicographical order support for CLUE, CSV & TextFile Datasets 2020-08-25 14:11:19 -04:00
mindspore-ci-bot 971716f4b9 !5136 fix large for loop runtime error due to lacking of backend operators 
Merge pull request !5136 from fary86/fix_large_for_runtime_error
 2020-08-25 22:26:25 +08:00
mindspore-ci-bot 346b97acb8 !5156 fix softdvpp coredump 
Merge pull request !5156 from qianlong21st/master_fix_softdvpp_core
 2020-08-25 22:20:00 +08:00
mindspore-ci-bot 2e3f5cd41b !5114 fix bug in c-api: rename, concat, take 
Merge pull request !5114 from luoyang/c-api-pyfunc
 2020-08-25 20:57:41 +08:00
qianlong 12dfca71f1 fix softdvpp coredump 2020-08-25 18:56:40 +08:00
YangLuo 67f5c89cd6 Check input image type for random posterize 2020-08-25 16:26:17 +08:00
fary86 8d245497a4 Fix large for loop Runtime Error due to backend missing operators 2020-08-25 16:25:41 +08:00
luoyang b26f6b3d5e fix bug in c-api: rename, concat, take 2020-08-25 16:25:00 +08:00
leilei_snow df9df609f8 fix index error 2020-08-25 08:05:07 +00:00
huangdongrun 113641decd fix test cases 2020-08-25 14:38:08 +08:00
mindspore-ci-bot 7d4f481884 !5017 remove internal interface in wide&deep 
Merge pull request !5017 from yao_yf/wide_and_deep_no_internal_interface
 2020-08-25 14:11:51 +08:00
mindspore-ci-bot 957126375b !5095 Adding Float tensor support for CutMixBatch 
Merge pull request !5095 from MahdiRahmaniHanzaki/cutmix-fix
 2020-08-25 10:53:58 +08:00
mindspore-ci-bot afd16fbf0a !4963 fix bug of switch layer join 
Merge pull request !4963 from fary86/fix_switch_layer_join_bug
 2020-08-25 10:47:32 +08:00
mindspore-ci-bot abe6b82138 !5011 remove global grad ops 
Merge pull request !5011 from riemann_penn/remove_global_grad_ops
 2020-08-25 09:47:55 +08:00
fary86 947e19b839 Fix bug of switch layer join 2020-08-25 09:08:53 +08:00
islam_amin 641e751d5e adding bbox class 2020-08-24 18:22:58 -04:00
Mahdi a2c38d89f9 Added float32 support for CutMixBatch 2020-08-24 17:15:25 -04:00
hesham 8eeceb267b - release the wait if training is ended 2020-08-24 13:11:07 -04:00
yao_yf a9a8e323b2 remove internal interface in wide&deep 2020-08-24 19:18:47 +08:00
mindspore-ci-bot 4f6e63fcf8 !4576 Support if by if not inline 
Merge pull request !4576 from amongo/SupportIfByIfNotInline
 2020-08-24 19:15:39 +08:00
mindspore-ci-bot fc6eee3bda !5019 raise RuntimeError when set different mode after Initializer created 
Merge pull request !5019 from yihuaijie/dev
 2020-08-24 18:49:32 +08:00
mindspore-ci-bot be5c455906 !4818 Fix ScatterNdUpdate cpu kernel 
Merge pull request !4818 from huanghui/scatter-nd-update-cpu-kernel
 2020-08-24 17:32:39 +08:00
huangdongrun 1bd9fefd84 support if by if not inline 
add testcase of net of if by if
 2020-08-24 17:11:26 +08:00
panyifeng 637e812347 remove global grad ops 2020-08-24 16:50:09 +08:00
mindspore-ci-bot 226f019e45 !4888 add parallel attention test 
Merge pull request !4888 from hanyang/master
 2020-08-24 15:50:56 +08:00
huanghui b367da88eb fix ScatterNdUpdate cpu kernel 2020-08-24 15:24:51 +08:00
Yi Huaijie 394be43492 raise RuntimeError when set different mode after Initializer created 2020-08-24 14:08:09 +08:00
zhangxinfeng3 6d821235c0 update some comments of api 2020-08-24 11:52:58 +08:00
mindspore-ci-bot 8d693306f4 !4126 Add new parameter 
Merge pull request !4126 from BowenK/new_parameter
 2020-08-24 10:01:46 +08:00
mindspore-ci-bot 56835aaf88 !5005 Fix the bug in the formula in Bernoulli log_probs 
Merge pull request !5005 from zichun_ye/fix_bernoulli_probs
 2020-08-24 09:09:43 +08:00
mindspore-ci-bot 0bbce9367e !4772 Adding AlbumDataset for device training 
Merge pull request !4772 from EricZ/ms-album
 2020-08-24 08:27:14 +08:00
Zichun Ye 9e7d6e2397 fix bernoulli prob formula; fix some other minor bugs 
update threshold of softplus computation

support fp for bernoulli and geometric distribution
 2020-08-23 17:49:09 -04:00
Eric c79db93c48 Initial commit for album 
Added linter fix for album dataset

Added testDataset

Adding signature

Added JsonDataset example API

Example dataset

Resolving format

More fixing

Refactor

Small fix

Added compiling album dataset

Running tests

Added linter fix #1

Passing UT

Added dataset API

Addressing clang

Clang part 2

Fixing pass

Fixed tree check

lint fix

Added lint fix part 2
 2020-08-22 11:07:10 -04:00
mindspore-ci-bot 75fce54208 !4790 Fix a Pynative bug. 
Merge pull request !4790 from jxlang910/push-to-opensource
 2020-08-22 16:45:00 +08:00
mindspore-ci-bot 94a109f476 !4898 Fix coredump caused by function call depth too large 
Merge pull request !4898 from fary86/fix_call_depth_too_large
 2020-08-22 16:08:27 +08:00