p47068915
/
mindspore
forked from mindspore-Ecosystem/mindspore
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
40,945 Commits 23 Branches 0 Tags 3.9 GiB
Commit Graph

8294 Commits

Author SHA1 Message Date
i-robot 67d10ce3be
!31066 Fix a bug where ROIAlign and CropAndResize distributed op do not support GPU 
Merge pull request !31066 from liuluobin/fix_roialign
 2022-03-11 01:16:46 +00:00
i-robot e14d0ca36b
!31124 Split test cases of bfgs method. 
Merge pull request !31124 from hezhenhao1/fix_scipy
 2022-03-11 01:10:00 +00:00
i-robot 3f3c9480dc
!31127 Fix bprop of cg method, support to return CSRTensor. 
Merge pull request !31127 from hezhenhao1/fix_cg
 2022-03-11 01:03:59 +00:00
gaoyong10 3664793fde skip parameter output of kernel graph. 2022-03-10 23:22:45 +08:00
i-robot 687f40a32f
!31050 Dynamic shape for control flow. 
Merge pull request !31050 from gaoyong10/dynamic_shape_01
 2022-03-10 13:25:05 +00:00
hezhenhao1 b63e4b8b20 Fix bprop of cg method, support to return CSRTensor. 2022-03-10 21:24:39 +08:00
Zichun Ye 61469ad999 update ms hybrid test cases 
fix ms hybrid doc

revert changes
 2022-03-10 20:31:56 +08:00
yanglf1121 108fcd750e fix sparse segfault in pynative bprop 2022-03-10 20:17:18 +08:00
huangbingjian 4f7c9cb27f Support user-defined classes through ms_class decorators. 2022-03-10 20:12:54 +08:00
hezhenhao1 892c091582 Split test cases of bfgs method. 2022-03-10 20:02:16 +08:00
i-robot 99910ef27f
!31088 convert C++ data to python when run fallback function 
Merge pull request !31088 from lianliguang/add-fallback-builtin-function
 2022-03-10 11:56:01 +00:00
chenzhuo 3b12614d7a add taylor higher order differentiation 2022-03-10 19:26:14 +08:00
yangzhenzhang c00d29f223 rebase 2022-03-10 19:17:06 +08:00
gaoyong10 a94285147d Dynamic shape support control flow. 2022-03-10 19:10:58 +08:00
liyong 50fc6f5736 Revert "!30810 [MD] add OBSMindDataset " 
This reverts commit 9fcab9184e, reversing
changes made to afb33fff62.
 2022-03-10 19:10:11 +08:00
dayschan 601fb25cb7 Add AkgKernel for lite_adapter 
Implements a temporary solution of InferShape for GraphKernel ops by
saving shape/type/format in custom attributes and decode them in InferShape function.
 2022-03-10 18:19:28 +08:00
liuluobin 8f045d02e3 Fix a bug where ROIAlign and CropAndResize distributed op do not support GPU 2022-03-10 17:31:36 +08:00
i-robot 4623b599b9
!31091 Fix sparse check and refactor the test cases of cg method. 
Merge pull request !31091 from hezhenhao1/fix_cg
 2022-03-10 09:14:21 +00:00
cheng-hao-wang f127db121b modify file and clean src_thor` 2022-03-10 17:00:20 +08:00
lianliguang d9390afad1 convert MS C++ dtype to MS python 2022-03-10 16:09:34 +08:00
xiao_yao1994 94df0869ad uni_backend: add ut ge test 2022-03-10 16:08:36 +08:00
i-robot 872cb74d3f
!30982 Vocab C++ Interface Alignment and SentencePieceVocab C++ interface alignment and Python interface refactoring 
Merge pull request !30982 from 刘勇琪/master-vocab-sentencepiecevocab
 2022-03-10 07:58:41 +00:00
i-robot 9ebaa5ee95
!31031 Add some numpy method 
Merge pull request !31031 from liuyang/ms_numpy
 2022-03-10 07:37:20 +00:00
hezhenhao1 28e74b1e5f Fix sparse check and refactor the test cases of cg method. 2022-03-10 15:33:11 +08:00
i-robot 9fcab9184e
!30810 [MD] add OBSMindDataset 
Merge pull request !30810 from liyong126/add_obs_mindrecord_dataset
 2022-03-10 07:28:46 +00:00
Bert0108 bfc5e4345c add distributed operators for argmax/min sqauresumall and unsortedsetmentprod 2022-03-10 14:44:37 +08:00
i-robot 5ee246e07c
!31038 fix miss x definition in test case 
Merge pull request !31038 from xychow/fix-test-case-m
 2022-03-10 03:45:23 +00:00
liuyang_655 139ee01205 add some numpy method 2022-03-09 22:43:38 -05:00
liu-yongqi-63 457ee03082 Vocab C++ Interface Alignment and SentencePieceVocab C++ interface alignment and Python interface refactoring 2022-03-10 11:33:00 +08:00
i-robot 662a7f8408
!31044 add cpp ut for combine_like_graphs 
Merge pull request !31044 from huanghui/add-ut
 2022-03-10 03:28:56 +00:00
liyong 10ada68fa9 add OBSMindDataset 2022-03-10 11:18:59 +08:00
i-robot 059ac45ae8
!30920 Call Draw function directly 
Merge pull request !30920 from huanghui/fix-draw
 2022-03-10 03:15:56 +00:00
wanyiming a124ec4de7 add dynamic_decay 2022-03-10 11:02:27 +08:00
i-robot 98888f6cd8
!31036 Add support of cg backward in pynative mode. 
Merge pull request !31036 from hezhenhao1/master
 2022-03-10 02:59:24 +00:00
huanghui 1077601e26 add cpp ut for jit_config 2022-03-10 10:56:18 +08:00
i-robot b32daf3cb4
!31000 add fallback example of function 
Merge pull request !31000 from lianliguang/add-fallback-builtin-function
 2022-03-10 01:57:37 +00:00
i-robot 203a22cb46
!31034 priority replay buffer test case 
Merge pull request !31034 from chenweifeng/priority-replay-buffer-parallel-sample
 2022-03-10 01:33:07 +00:00
i-robot 3f1a7f45bb
!30942 Add hwc_to_chw operation on lite 
Merge pull request !30942 from shenwei41/hwc_to_chw
 2022-03-10 01:21:54 +00:00
hezhenhao1 bad551d210 Add support of cg backward in pynative mode. 2022-03-10 09:13:21 +08:00
i-robot f57f862d7b
!30782 [MD] pushdown skip node in MD pipeline 
Merge pull request !30782 from Mohammad Motallebi/failover_pushdown_skipop
 2022-03-10 01:12:46 +00:00
wilfChen 002ef3bb1f priority replay buffer test case 2022-03-10 09:01:54 +08:00
mohammad 260cebf650 [MD] skip node pushdown optimization pass for Reset 2022-03-09 09:52:25 -05:00
i-robot 3fecc04f26
!30886 profiler suport pynative 
Merge pull request !30886 from zangqx/zangqx_8
 2022-03-09 08:45:15 +00:00
zhousiyi f177ff9462 fix miss x definition in test case 2022-03-09 08:00:28 +00:00
shenwei41 7f7bae8bfe add hwc_to_chw operation on lite 2022-03-09 15:43:13 +08:00
i-robot 698b99aaa3
!18945 [assistant][ops]New operator implementation, include OmniglotDataset 
Merge pull request !18945 from Wangsong95/omniglot_dataset
 2022-03-09 06:51:15 +00:00
i-robot 0a1cc0cae4
!31015 [ME] Add some parameter name check testcases. 
Merge pull request !31015 from Margaret_wangrui/param_testcase
 2022-03-09 06:08:26 +00:00
臧庆香 1dd489096e profiler pynative python code 2022-03-09 12:38:39 +08:00
lianliguang f3b1e3291c add jit fallback example 2022-03-09 11:25:03 +08:00
yanghaoran 5352e13329 takedown testcases to ensure gate stability 2022-03-09 10:18:51 +08:00
i-robot cfda27a6c7
!30985 Add TCP communication module into compute graph nodes and meta server node 
Merge pull request !30985 from chengang/topology_2
 2022-03-09 01:51:23 +00:00
Margaret_wangrui 14421c3438 [ME] Add some parameter name check testcases. 2022-03-09 09:50:41 +08:00
i-robot 3641523594
!31001 Add test case for CellList getattr. 
Merge pull request !31001 from huangbingjian/cell_getattr
 2022-03-09 01:22:39 +00:00
i-robot f7068a46ea
!30967 fix Cholesky bprop implement to support symmetric 
Merge pull request !30967 from zhuzhongrui/pub_master2
 2022-03-09 01:13:50 +00:00
Parallels e2125108b8 Add tcp communication into compute graph nodes and meta server node 2022-03-09 00:02:25 +08:00
huangbingjian 9946062c53 Add test case for CellList getattr. 2022-03-08 23:05:07 +08:00
qkeys ce7597f500 [feat][assistant][I3J6VB] add new data operator OmniglotDataset 2022-03-08 21:36:22 +08:00
i-robot c1a9a48d3e
!30945 Modify statistic dump st level to 1 
Merge pull request !30945 from TinaMengtingZhang/test
 2022-03-08 12:14:52 +00:00
i-robot c3b2a08fff
!30571 support sparse op on CPU via AKG 
Merge pull request !30571 from 杨林枫/sparse_cpu
 2022-03-08 08:45:38 +00:00
i-robot 0b207fce31
!29735 unique support multi_dim tensor 
Merge pull request !29735 from jiangzhenguang/unique_multi_tensor
 2022-03-08 08:30:57 +00:00
i-robot eaa07864f5
!30835 All the cells no need to read the cached graphs when check hash consistency failed 
Merge pull request !30835 from YuJianfeng/master
 2022-03-08 07:55:49 +00:00
i-robot 63d7254bd3
!30952 add encryption to lite 
Merge pull request !30952 from yeyunpeng2020/cryption
 2022-03-08 07:30:41 +00:00
z00512249 b368237340 fix Cholesky bprop implement to support symmetric 2022-03-08 14:54:45 +08:00
i-robot 409d0f6715
!30847 Add grad implementation and test cases for cg method. 
Merge pull request !30847 from hezhenhao1/fix_cg
 2022-03-08 06:40:01 +00:00
i-robot f73987dcf2
!30949 Change the Parameter type name from 'ParameterTensor' to 'Parameter' 
Merge pull request !30949 from 张清华/opt
 2022-03-08 06:17:31 +00:00
yanglf1121 893587ae55 support csr cpu 2022-03-08 14:15:06 +08:00
jiangzhenguang 28f89f36b4 unique support multi-dim tensor 2022-03-08 14:09:19 +08:00
Zhang Qinghua 973008ebcf Change the Parameter type name from 'ParameterTensor' to 'Parameter' 2022-03-08 11:23:56 +08:00
TinaMengtingZhang 78449afc49 modify st level for stat dump 2022-03-07 21:56:29 -05:00
i-robot a90d5f6f42
!30948 takedown data_dump to ensure gate stability 
Merge pull request !30948 from yanghaoran/master
 2022-03-08 02:55:14 +00:00
i-robot 82bc2b722d
!30417 add history and lambda callbacks 
Merge pull request !30417 from liutongtong9/add_callbacks
 2022-03-08 02:17:46 +00:00
yanghaoran 70d642e780 takedown data_dump to ensure gate stability 2022-03-08 10:14:04 +08:00
hezhenhao1 9682769a02 Add grad implementation and test cases for cg method. 2022-03-08 10:12:23 +08:00
i-robot 75e1939f50
!30899 Enable python buildin function type for graph fallback and add some ut for python buildin function for graph fallback 
Merge pull request !30899 from LiangZhibo/syntax
 2022-03-08 01:35:47 +00:00
i-robot 64544b142a
!30340 develop maxpool3d, avgpool3d and conv3d on CPU(including farward and backward) 
Merge pull request !30340 from zhangbuxue/develop_conv3d_maxpool3d_and_avgpool3d_on_cpu
 2022-03-08 01:31:54 +00:00
yeyunpeng2020 f670a635f0 add encryption to lite 2022-03-08 09:15:10 +08:00
i-robot 2655d64720
!30865 [MD] Modify Batch number of workers with Python multiprocessing 
Merge pull request !30865 from cathwong/ckw_batch_workers_pymultip
 2022-03-07 18:21:16 +00:00
Cathy Wong bc29dd9d72 [MD] Modify Batch number of workers with Python multiprocessing 2022-03-07 10:39:05 -05:00
i-robot 335ef1c270
!30459 Add ut validate function for parallel 
Merge pull request !30459 from liuluobin/ut_master
 2022-03-07 15:23:14 +00:00
yujianfeng 1fb716d394 All the cells no need to read the cached graphs when check hash consistency failed 2022-03-07 21:37:25 +08:00
buxue 50f3ad00ab develop maxpool3d, avgpool3d and conv3d on CPU(including forward and backward) 2022-03-07 20:44:38 +08:00
i-robot 4a9a65d2a6
!30919 Produce parallel operators for ReduceAll and ReduceProd 
Merge pull request !30919 from Bert0108/reduce_operators_merge
 2022-03-07 11:30:37 +00:00
i-robot d1eec933ae
!30776 change Dynamicshape To TensorShape 
Merge pull request !30776 from lianliguang/master
 2022-03-07 10:57:29 +00:00
yanghaoran a36bb9522f takedown test_dynamic_concat to ensure gate stability 2022-03-07 16:27:16 +08:00
liuluobin b797a410cc Add validate function for parallel ut 2022-03-07 16:19:52 +08:00
huanghui ce0f500a3f convert draw_ to call Draw function derectly 2022-03-07 16:12:52 +08:00
Bert0108 dfc92f1791 add distributed parallel operators for reduceall and reduceprod 2022-03-07 15:40:11 +08:00
liangzhibo 1a81031d92 Add testcases for fallback python buildin function 2022-03-07 14:20:24 +08:00
lianliguang 55e7f2d761 modify DynamicShape to TensorShape 2022-03-07 14:19:12 +08:00
i-robot 960d551b8f
!30889 parse core type from pre-build for tbe kernel compile 
Merge pull request !30889 from liubuyu/master
 2022-03-07 03:53:48 +00:00
i-robot a2303a92bd
!30741 [dataset][dfx] 易用性-Python多进程统一整改专项 
Merge pull request !30741 from xiefangqi/md_add_multiprocessing_optimization
 2022-03-07 01:29:21 +00:00
i-robot c4cc0e6f26
!30742 auto parallel support not ony power of 2 device numbers 
Merge pull request !30742 from yao_yf/auto_parallel_support_not_only_2_power
 2022-03-07 01:09:01 +00:00
yao_yf b60e54e0d5 support not only power of 2 2022-03-06 18:08:46 +08:00
lby 2b1b539b36 parse core type from pre-build for tbe kernel compile 2022-03-06 15:23:50 +08:00
i-robot ad491e39f4
!29855 resize_bilinear_align_corner 
Merge pull request !29855 from jiangzhenguang/resize_bilinear_align_corner
 2022-03-05 12:41:50 +00:00
xiefangqi 2de6c8908b add a clean up subprocess to clean subprocess when main process exit 2022-03-05 17:24:11 +08:00
yanghaoran 92abbd7af1 takedown test_dynamic_ops.py::test_dynamic_layernorm due to probalistic failure 2022-03-05 16:20:24 +08:00
jiangzhenguang 64da650786 add half pixel center to resize bilinear 2022-03-05 15:43:20 +08:00
liutongtong 7afcdfd211 add history and lambda callbacks 2022-03-04 17:24:57 +08:00
i-robot fdf7aebd78
!30746 Fix recv actor stuck issue. 
Merge pull request !30746 from ZPaC/sync-route-table
 2022-03-04 03:01:03 +00:00
i-robot b90cf43562
!30553 Support dataset reset() to recover after failure 
Merge pull request !30553 from h.farahat/reset
 2022-03-04 02:19:45 +00:00
i-robot 28c85ca5fd
!30718 Add test cases of for in while 
Merge pull request !30718 from chenfei_mindspore/master
 2022-03-04 01:25:16 +00:00
i-robot 55c16c6ed8
!30330 Add SparseTensor attr 
Merge pull request !30330 from wangrao124/add_sparse_attr
 2022-03-04 01:22:59 +00:00
i-robot f01d841113
!27943 [MD][Autotune] Save/Load Autotune config 
Merge pull request !27943 from harshvardhangupta/save_load_at_config
 2022-03-03 20:42:23 +00:00
chenfei cf182a803a add testcases of for in while 
update mindir
 2022-03-03 17:48:10 +08:00
i-robot 7b26a32e98
!22608 [assistant][ops]New operator implementation, include KITTIDataset 
Merge pull request !22608 from Wangsong95/kitti_dataset
 2022-03-03 07:05:40 +00:00
h.farahat a3dec34833 Dataset failover reset 2022-03-02 23:53:56 -05:00
i-robot 1eb2975ac2
!30753 Support random port for TCP server 
Merge pull request !30753 from chengang/support_random_port
 2022-03-03 02:08:28 +00:00
i-robot 92770ef12e
!30200 Improve A+M dump performance 
Merge pull request !30200 from TinaMengtingZhang/a_m_dump_perf
 2022-03-03 02:05:04 +00:00
i-robot 2f3aa967fc
!30761 add st case for dynamic data-sink on GPU 
Merge pull request !30761 from wYann/add_st
 2022-03-03 01:51:23 +00:00
i-robot fa2e9b924f
!30735 Add CSRTensor support and test cases for cg method. 
Merge pull request !30735 from hezhenhao1/fix_cg
 2022-03-03 01:18:00 +00:00
harshvardhangupta bd61adbb72 Implement save/load of autotune dataset pipeline configuration #27943 2022-03-02 15:08:08 -05:00
i-robot 70e61e9014
!30781 [MD] test_pyfunc_multiprocess_autotune.py - enable AutoTune 
Merge pull request !30781 from cathwong/ckw_ut_fixup_map_python_multiproc
 2022-03-02 19:50:29 +00:00
i-robot edcc6b790d
!30714 [MD][Offload] Add TypeCast op to offload 
Merge pull request !30714 from markuskunej/offload_typecast
 2022-03-02 19:48:58 +00:00
Cathy Wong eb931c7f88 [MD] test_pyfunc_multiprocess_autotune.py - enable AutoTune 2022-03-02 13:25:35 -05:00
i-robot 4aa82cc21e
!30679 [MD] Add tests for Python Multiprocessing with AutoTune 
Merge pull request !30679 from cathwong/ckw_ut_map_python_multiproc
 2022-03-02 14:26:09 +00:00
Parallels 5e09380eb3 add random port support for tcp server 2022-03-02 21:27:33 +08:00
zx 93617ce91e [feat][assistant][I3J6VO] add new data operator KITTI 2022-03-02 19:29:17 +08:00
ZPaC 4c74b600ea Fix recv actor stuck issue. 2022-03-02 19:26:45 +08:00
hezhenhao1 885210b634 Add CSRTensor support and test cases for cg method. 2022-03-02 19:22:11 +08:00
wYann c6354d06ea add st case for dynamic data-sink on gpu 2022-03-02 17:50:33 +08:00
wangrao124 b643e3f4ff Add CSRTensor/COOTensor attr 2022-03-02 17:37:46 +08:00
TinaMengtingZhang 4a8d3defe7 Enhance the perfomance of A+M dump: Parallelize ConverFormatForTensorAndDump and refactoring 2022-03-01 23:08:38 -05:00
i-robot 9869865c6a
!30701 Add some st test cases for hypermap 
Merge pull request !30701 from LiangZhibo/hypermap
 2022-03-02 02:39:44 +00:00
i-robot 6bc31df410
!30672 delete ut test libgraph and liberror_manager dependency 
Merge pull request !30672 from qujianwei/master
 2022-03-02 02:18:24 +00:00
Cathy Wong b151f90b8d [MD] Add tests for Python Multiprocessing with AutoTune 2022-03-01 20:20:59 -05:00
markuskunej 6de37045ff Added TypeCast op in dataset offload. 2022-03-01 21:55:27 +00:00
qujianwei 7e1aebc2c9 delete ut libgraph.so and liberror_manager.so dependency 2022-03-01 20:50:45 +08:00
l00591931 ee85ce748b Add test case for hypermap 2022-03-01 20:35:12 +08:00
i-robot 4ca1d78e19
!30693 add test for shard function 
Merge pull request !30693 from wangjun/add_tests_for_shard
 2022-03-01 09:21:07 +00:00
wangjun 46612fabfb add st for shard 2022-03-01 15:32:37 +08:00
i-robot 9a5268f2be
!30589 [DynamicShape][GPU]add dynamic shape support some ops for new network 
Merge pull request !30589 from hanhuifeng/dcn_dyn_ops_2_new
 2022-03-01 06:42:59 +00:00
i-robot ad9757ccf0
!30661 [Auto parallel] [MoE] Fix an error of configuring MoE parallel 
Merge pull request !30661 from Xiaoda/124-moe-changes
 2022-03-01 02:26:37 +00:00
i-robot 545a6de696
!30664 Fix grads of Eigh and SolveTriangular operator in PYNATIVE mode. 
Merge pull request !30664 from hezhenhao1/fix_grad
 2022-03-01 01:19:07 +00:00
i-robot 4367377000
!30611 Fix rpc route bugs 
Merge pull request !30611 from ZPaC/sync-route-table
 2022-02-28 15:50:35 +00:00
hanhuifeng2020 b571e67795 [DynamicShape][GPU]add dynamic shape support some ops for new network 2022-02-28 22:09:20 +08:00
ZPaC dc80f9b8d1 Fix rpc route bugs 2022-02-28 19:18:42 +08:00
hezhenhao1 a141c8c8e3 Fix grads of Eigh and SolveTriangular operator in PYNATIVE mode. 2022-02-28 18:06:55 +08:00
i-robot 789c1d6bd3
!30614 [AutoParallel] Fix Overflow As the cast is inserted before Mirror 
Merge pull request !30614 from huangxinjing/fix_cast_error
 2022-02-28 09:04:46 +00:00
Xiaoda Zhang 81e5abe580 fix an error of configuring parallel 2022-02-28 17:03:53 +08:00
i-robot a92c54b206
!30496 [Fallback] Suppport scipy module. 
Merge pull request !30496 from huangbingjian/support_scipy
 2022-02-28 08:33:34 +00:00
i-robot a8686ae3d9
!18827 [assistant][ops]New operator implementation, include LFWDataset 
Merge pull request !18827 from Wangsong95/lfw_dataset
 2022-02-28 08:31:11 +00:00
i-robot 68773a9f93
!30634 [ME][Auto_monad] Fix bug:Remove duplicate loads before Load node grouping. 
Merge pull request !30634 from Margaret_wangrui/auto_monad_eliminate_2
 2022-02-28 06:07:48 +00:00
zx 2132f62d98 [feat][assistant][I3J6VQ] add new data operator LFW 2022-02-28 13:43:05 +08:00
Margaret_wangrui 683381f87b [ME][Auto_monad] Fix bug:Remove duplicate loads before Load node grouping. 2022-02-28 11:36:51 +08:00
i-robot 24cf8e0155
!30596 change lr for server in master 
Merge pull request !30596 from zhoushan33/server0225_master
 2022-02-28 03:30:36 +00:00
i-robot a89564f561
!30057 Add ms_hybrid support in Custom 
Merge pull request !30057 from zichun_ye/ms_script
 2022-02-28 02:50:46 +00:00
Zichun Ye d8087a35e3 add ms_hybrid decorator; add new Custom mode ms_hybrid 
fix code check error

update test cases, update akg version

drop grid for now

update testcase

update benchmark in test case

update test case name

update test cases

update test case

add input num parameterattr in json
 2022-02-27 23:38:54 +08:00
huangxinjing 896daee845 [AutoParallel]Fix insert error for the mirror 2022-02-26 17:54:42 +08:00
i-robot 330cacf905
!30573 Catch abnormals from sto functions in debug 
Merge pull request !30573 from maning202007/master
 2022-02-26 08:52:22 +00:00