yystopf
/
mindspore
forked from mindspore-Ecosystem/mindspore
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
45,876 Commits 23 Branches 0 Tags 3.9 GiB
Commit Graph

2085 Commits

Author SHA1 Message Date
i-robot 0a4c536570
!33287 set symbols of openssl static library to hidden 
Merge pull request !33287 from zhoufeng/fix-openssl-version-conflict
 2022-04-20 06:06:32 +00:00
ttudu ab8b8775b5 delete updateop actor 2022-04-20 09:44:11 +08:00
lianliguang 11b4836040 support list slice assign 2022-04-20 09:32:05 +08:00
i-robot 58d1555ec5
!33190 Improve the stability of dynamic networking 
Merge pull request !33190 from chengang/bugfix_dynamic_networking
 2022-04-19 13:29:39 +00:00
zhoufeng e873f3ac07 set symbols of openssl static library to hidden 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2022-04-19 19:50:23 +08:00
Parallels 4f2f6fc6e0 Improve the stability of dynamic networking 2022-04-19 17:35:22 +08:00
r1chardf1d0 f2464fa8f1 expander fallback 2022-04-19 17:24:37 +08:00
yuchaojie bb52ffb2a9 add TensorScatter op fission 2022-04-16 14:57:04 +08:00
i-robot 5d9e9a2bea
!32987 Move core primtive files into core/ops directory. 
Merge pull request !32987 from 张清华/opt
 2022-04-14 15:44:13 +00:00
Zhang Qinghua 12826b0f6c Add core/abstract/ops directory. 
Move core_ops.h.
 2022-04-14 19:31:28 +08:00
wangshuide2020 6236da16ea fix the register info of Celu. 2022-04-13 16:26:26 +08:00
Parallels df6217f720 bugfix for multi tcp clients connecting to one tcp server 2022-04-13 15:04:08 +08:00
i-robot 602c0d2923
!32755 Add retrieve API for compute graph node 
Merge pull request !32755 from chengang/add_retrieve_for_cgn_3
 2022-04-11 12:07:38 +00:00
Parallels 1590480215 Add retrieve API for compute graph node 2022-04-09 11:15:49 +08:00
i-robot 51e35f7faf
!32082 GraphKernel for Mindpsore-Lite 
Merge pull request !32082 from DeshiChen/0328_graph_kernel_lite
 2022-04-08 08:29:29 +00:00
i-robot efd13aa953
!32551 Change the types of input and output of tcp message handler 
Merge pull request !32551 from chengang/add_retrieve_for_cgn
 2022-04-08 01:25:14 +00:00
dayschan 2026faa695 GraphKernel for MS-lite 
1. move the lite_adapter files to lite directory.
created a directory "graph_kernel" in "mindspore/lite/tools".
we use 3 directory "converter", "runtime" and "common" to hold the different files.

2. modify lite makefiles to support GraphKernel.
a) define a micro "MSLITE_ENABLE_GRAPH_KERNEL" when graphkernel is enabled by building option "-K on".
b) converter's makefile: build the GraphKernel's core code and graph_kernel adapter for converter,
includes some backend's code of mindspore.
c) lite/src/CMakeLists: build graph_kernel adapter for benchmark

3. move the graph_kernel_pass_manager.cc from "graph_kernel/adapter" to "graph_kernel/core".
the original two graph_kernel_pass_manager files are similar, so we unify them.
 2022-04-06 11:02:12 +08:00
Parallels 18eaf2d9dd Add return value for user defined message handler 2022-04-06 10:02:08 +08:00
i-robot b0043637d9
!30709 Delete DynamicKernel 
Merge pull request !30709 from TuDouNi/gpu_cpu_delete_dynamic_kernel
 2022-04-02 01:33:13 +00:00
Parallels 7fa00586af Add return message for message handler 2022-04-01 10:48:12 +08:00
ttudu 4fe7b0d350 delete dynamic_kernel 2022-03-31 20:50:52 +08:00
i-robot c3d7c425e9
!29856 [assistant][GriffinLim] 
Merge pull request !29856 from chenchen/g2
 2022-03-31 09:33:52 +00:00
i-robot 8b13840742
!32327 Add message sending API from compute graph node to meta server node 
Merge pull request !32327 from chengang/add_sendmsg_api
 2022-03-31 06:18:34 +00:00
chenx2ovo e19dc02b47 [feat][assistant][I3CECZ] add op griffinlim 2022-03-31 11:30:26 +08:00
i-robot 9810fa53cb
!31899 [Auto-Par] [D-Rec] Add Mem & Redis coefficient on D-Rec cost model for Pangu-alpha 
Merge pull request !31899 from FRHW-WANG/D-Rec-deliver
 2022-03-31 02:12:26 +00:00
Parallels 4f2e9a77bf Add message sending api for compute graph node to meta server node 2022-03-31 00:39:25 +08:00
haoran.wang 3674e1d713 Add Mem & Redis coefficient for PanGu-alpha 2022-03-29 12:00:34 +00:00
Parallels 300cf56b9d Add unregister API for compute graph node 2022-03-29 13:08:45 +08:00
i-robot 9d2ddbe0ee
!32080 Add cluster topology state 
Merge pull request !32080 from chengang/support_topo_state
 2022-03-29 03:46:40 +00:00
Parallels f660b3c58e Add cluster topology state 2022-03-28 05:48:11 +00:00
Parallels 7bcf3f7b03 Fix exception when sending large messages 2022-03-27 02:10:40 +00:00
lizhenyu 812127940d add ut for recovery 2022-03-25 16:58:08 +08:00
i-robot c6da65ecfa
!31879 Training support recovery 
Merge pull request !31879 from zyli2020/worker_failover_bp
 2022-03-25 07:06:55 +00:00
i-robot 8589335879
!31889 Add some ut pipeline test case for C++ dataset 
Merge pull request !31889 from liucunwei/dataset-lcw-0324
 2022-03-25 03:27:37 +00:00
lizhenyu 275f81c47b failover support exit process when timeout occur 2022-03-25 11:16:04 +08:00
liucunwei 03b32e4eab Add some ut pipeline test case for C++ dataset 2022-03-25 10:25:19 +08:00
i-robot 0b6f330d7e
!31666 [MS][LITE] new core ops api and lite adapter new api 
Merge pull request !31666 from luoyuan/core2
 2022-03-24 08:50:40 +00:00
yanghaoran e0ee78497d takedown tcptest.sendlargemessages to ensure gate stability 2022-03-24 15:20:30 +08:00
luoyuan 3e6e4bfdd3 add core ops api and adapter new mindapi 2022-03-24 10:47:40 +08:00
i-robot a50223f93a
!31680 [assistant][Fade] bug fix 
Merge pull request !31680 from QingfengLi/fade
 2022-03-22 07:58:59 +00:00
i-robot ecde0749bb
!31576 dynamic shape CPU & GPU 
Merge pull request !31576 from TuDouNi/dynamic_shape_gpu_cpu_2
 2022-03-22 07:27:50 +00:00
i-robot 32ecb8cbea
!31664 fix grpc not found in gpu serving 
Merge pull request !31664 from zhoufeng/xiu-ba-ge
 2022-03-22 06:10:24 +00:00
ttudu adb18b82ca dynamic shape CPU & GPU 2022-03-22 13:03:31 +08:00
chenx2ovo c50a4611ec [fix][assistant][I3CEGF] fix can not compute bool tensor 2022-03-22 10:20:01 +08:00
i-robot 3b24d825bf
!31578 Fix exception for sending big message using TCP client. 
Merge pull request !31578 from chengang/fix_rpc_big_msg
 2022-03-22 01:27:29 +00:00
i-robot 9bfa6ebc58
!31611 code check clean 
Merge pull request !31611 from yuchaojie/code-clean
 2022-03-22 01:20:44 +00:00
zhoufeng 55f6d075e8 fix grpc not found in serving 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2022-03-21 22:06:46 +08:00
i-robot 264bed91a4
!31594 Add ps execution mode implementation 
Merge pull request !31594 from ZPaC/add-dist-execution-mode
 2022-03-21 13:07:24 +00:00
yuchaojie 42818b17f6 code check clean 2022-03-21 16:32:22 +08:00
i-robot 4dd3a94d27
!31571 clean code 
Merge pull request !31571 from kisnwang/clean_code
 2022-03-21 08:31:38 +00:00
ZPaC 506989abb8 Add ps execution mode implementation 2022-03-21 14:35:25 +08:00
kswang 70b85a16cb clean code 2022-03-21 09:54:06 +08:00
i-robot 048d089f9a
!31520 test ut 
Merge pull request !31520 from gaoyong10/dynamic_shape_01
 2022-03-20 04:24:23 +00:00
Parallels d3bcc66d15 Fix sending large message using rpc. 2022-03-20 10:42:52 +08:00
gaoyong10 89c98f8b73 Add ut for dynamic shape and control flow. 2022-03-19 19:48:44 +08:00
zhoufeng da11e0f150 change debug.a to object 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2022-03-19 15:39:49 +08:00
i-robot dc5f77f585
!31298 build libmindspore_backend.so 
Merge pull request !31298 from zhoufeng/backend-frontend-decoupling
 2022-03-18 09:41:51 +00:00
i-robot c0c5b8c143
!31480 Reduce UT CPP profiler tests time 
Merge pull request !31480 from zetongzhao/reduce_profiler_test_time
 2022-03-17 19:10:57 +00:00
zetongzhao 694ede05cf change set_dataset 2022-03-17 13:13:01 -04:00
i-robot d37ee6e729
!31173 Stream Assign Refactor 
Merge pull request !31173 from jiaorui/refactor-stream
 2022-03-17 11:39:11 +00:00
zhoufeng b7bb53ff73 build libmindspore_backend.so 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2022-03-17 19:14:45 +08:00
jiaorui 91bd673538 refactor 2022-03-17 10:50:12 +08:00
i-robot e6dadfd999
!31159 Add st and ut testcase for pass tuple_transform 
Merge pull request !31159 from chenfei_mindspore/master-develop
 2022-03-17 02:01:44 +00:00
i-robot c3d15a079e
!31325 Training supports failover 
Merge pull request !31325 from zyli2020/worker_failover_bp
 2022-03-17 01:37:30 +00:00
i-robot 8e1f6d6b9b
!31268 Move UT CPP Helper Functions 
Merge pull request !31268 from zetongzhao/ut_cpp_helper
 2022-03-16 18:20:24 +00:00
lizhenyu 545707b80c Training supports failover 2022-03-16 23:34:29 +08:00
zetongzhao ab5f79f522 move common helper function 2022-03-16 10:30:43 -04:00
chenfei 3872e29c3b add ut for tuple trans 2022-03-16 21:33:54 +08:00
i-robot 272d25b291
!31137 Test SkipFirstEpochSampler 
Merge pull request !31137 from zetongzhao/test_skip_first_epoch_sampler
 2022-03-15 18:26:28 +00:00
i-robot 059c939854
!31269 Fix ut debug mode compile 
Merge pull request !31269 from qujianwei/master
 2022-03-15 12:35:38 +00:00
shenwei41 f1fde6a262 upgrade Ascend package 11 Mar 22 2022-03-15 16:31:27 +08:00
qujianwei d5eb5090d9 fix ut compile in debug mode 2022-03-15 11:04:37 +08:00
i-robot 4b15a46a49
!30858 Refactor cpu kernel factory. 
Merge pull request !30858 from TronZhang/refactor_cpu_factory
 2022-03-15 01:33:14 +00:00
zetongzhao 9d4c8e29f9 add test for skip first epoch sampler 2022-03-14 15:01:08 -04:00
i-robot a33611ce27
!31192 Support sync and async message sending mode for TCP client 
Merge pull request !31192 from chengang/add_send_sync
 2022-03-14 07:55:49 +00:00
TronZhang db2931516e refactor cpu factory 2022-03-14 10:05:56 +08:00
Parallels 6f31f270e9 support sync and async message sending mode for tcp client 2022-03-12 21:14:35 +08:00
xulei bb10249d49 support gcc-8 and gcc-9 2022-03-11 16:12:41 +08:00
i-robot f3b753807b
!30929 Add AkgKernel for lite_adapter 
Merge pull request !30929 from DeshiChen/0307_akgkernel
 2022-03-11 07:01:10 +00:00
i-robot 3375003da9
!31158 Add registration and heartbeat message from compute graph node to meta server node 
Merge pull request !31158 from chengang/add_pb_to_node
 2022-03-11 06:55:03 +00:00
Parallels 5fe6d42fe1 Add registration and heartbeat message from compute graph node to meta server node 2022-03-11 11:42:08 +08:00
dayschan 601fb25cb7 Add AkgKernel for lite_adapter 
Implements a temporary solution of InferShape for GraphKernel ops by
saving shape/type/format in custom attributes and decode them in InferShape function.
 2022-03-10 18:19:28 +08:00
liu-yongqi-63 457ee03082 Vocab C++ Interface Alignment and SentencePieceVocab C++ interface alignment and Python interface refactoring 2022-03-10 11:33:00 +08:00
i-robot 662a7f8408
!31044 add cpp ut for combine_like_graphs 
Merge pull request !31044 from huanghui/add-ut
 2022-03-10 03:28:56 +00:00
huanghui 1077601e26 add cpp ut for jit_config 2022-03-10 10:56:18 +08:00
i-robot 3f1a7f45bb
!30942 Add hwc_to_chw operation on lite 
Merge pull request !30942 from shenwei41/hwc_to_chw
 2022-03-10 01:21:54 +00:00
i-robot f57f862d7b
!30782 [MD] pushdown skip node in MD pipeline 
Merge pull request !30782 from Mohammad Motallebi/failover_pushdown_skipop
 2022-03-10 01:12:46 +00:00
mohammad 260cebf650 [MD] skip node pushdown optimization pass for Reset 2022-03-09 09:52:25 -05:00
shenwei41 7f7bae8bfe add hwc_to_chw operation on lite 2022-03-09 15:43:13 +08:00
i-robot 698b99aaa3
!18945 [assistant][ops]New operator implementation, include OmniglotDataset 
Merge pull request !18945 from Wangsong95/omniglot_dataset
 2022-03-09 06:51:15 +00:00
Parallels e2125108b8 Add tcp communication into compute graph nodes and meta server node 2022-03-09 00:02:25 +08:00
qkeys ce7597f500 [feat][assistant][I3J6VB] add new data operator OmniglotDataset 2022-03-08 21:36:22 +08:00
buxue 50f3ad00ab develop maxpool3d, avgpool3d and conv3d on CPU(including forward and backward) 2022-03-07 20:44:38 +08:00
i-robot 960d551b8f
!30889 parse core type from pre-build for tbe kernel compile 
Merge pull request !30889 from liubuyu/master
 2022-03-07 03:53:48 +00:00
i-robot c4cc0e6f26
!30742 auto parallel support not ony power of 2 device numbers 
Merge pull request !30742 from yao_yf/auto_parallel_support_not_only_2_power
 2022-03-07 01:09:01 +00:00
yao_yf b60e54e0d5 support not only power of 2 2022-03-06 18:08:46 +08:00
lby 2b1b539b36 parse core type from pre-build for tbe kernel compile 2022-03-06 15:23:50 +08:00
i-robot fdf7aebd78
!30746 Fix recv actor stuck issue. 
Merge pull request !30746 from ZPaC/sync-route-table
 2022-03-04 03:01:03 +00:00
i-robot f01d841113
!27943 [MD][Autotune] Save/Load Autotune config 
Merge pull request !27943 from harshvardhangupta/save_load_at_config
 2022-03-03 20:42:23 +00:00
i-robot 7b26a32e98
!22608 [assistant][ops]New operator implementation, include KITTIDataset 
Merge pull request !22608 from Wangsong95/kitti_dataset
 2022-03-03 07:05:40 +00:00
harshvardhangupta bd61adbb72 Implement save/load of autotune dataset pipeline configuration #27943 2022-03-02 15:08:08 -05:00
Parallels 5e09380eb3 add random port support for tcp server 2022-03-02 21:27:33 +08:00
zx 93617ce91e [feat][assistant][I3J6VO] add new data operator KITTI 2022-03-02 19:29:17 +08:00
ZPaC 4c74b600ea Fix recv actor stuck issue. 2022-03-02 19:26:45 +08:00
i-robot 6bc31df410
!30672 delete ut test libgraph and liberror_manager dependency 
Merge pull request !30672 from qujianwei/master
 2022-03-02 02:18:24 +00:00
qujianwei 7e1aebc2c9 delete ut libgraph.so and liberror_manager.so dependency 2022-03-01 20:50:45 +08:00
i-robot 4367377000
!30611 Fix rpc route bugs 
Merge pull request !30611 from ZPaC/sync-route-table
 2022-02-28 15:50:35 +00:00
ZPaC dc80f9b8d1 Fix rpc route bugs 2022-02-28 19:18:42 +08:00
i-robot a8686ae3d9
!18827 [assistant][ops]New operator implementation, include LFWDataset 
Merge pull request !18827 from Wangsong95/lfw_dataset
 2022-02-28 08:31:11 +00:00
zx 2132f62d98 [feat][assistant][I3J6VQ] add new data operator LFW 2022-02-28 13:43:05 +08:00
i-robot 330cacf905
!30573 Catch abnormals from sto functions in debug 
Merge pull request !30573 from maning202007/master
 2022-02-26 08:52:22 +00:00
i-robot 909183a2ef
!30317 extract common as an independent shared library 
Merge pull request !30317 from zhoufeng/backend-compile-independently
 2022-02-26 06:08:17 +00:00
i-robot 17accc12cf
!30238 [GraphKernel] replace nodes in lite and move const_input_to_attr pass. 
Merge pull request !30238 from chenlei_autodiff/lite_callback
 2022-02-26 03:56:57 +00:00
maning202007 9328041de4 Catch abnormals from sto functions in debug 
Fix type errors

Fix bugs

Fix cycle depth
 2022-02-26 11:03:52 +08:00
zhoufeng f49b195c39 extract common as an independent shared library 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2022-02-26 10:55:51 +08:00
shenwei41 ff75314719 upgrade ascend 20220211 2022-02-25 21:19:45 +08:00
chenlei_autodiff 9fabf8ae0d [GraphKernel] replace graph kernel node with custom in lite. 2022-02-25 17:09:24 +08:00
i-robot ac1463a192
!30298 Package the cuda operators as a dynamic link library 
Merge pull request !30298 from jinjiali-kali/cuda_ops
 2022-02-24 11:36:20 +00:00
i-robot eeb731ae3e
!18738 [assistant][ops]New operator implementation, include LSUNDataset 
Merge pull request !18738 from Wangsong95/lsun_dataset
 2022-02-23 02:28:40 +00:00
jinjiali b2d1bad62c package the cuda operations as a dynamic link library 2022-02-22 16:48:19 +08:00
yanghaoran 739c4b236a
回退 'Pull Request !30120 : Package the cuda operators as a dynamic link library' 2022-02-18 08:59:07 +00:00
zhixinaa 4ce6104ff9 [feat][assistant][I3J6V9] add new data operator LSUN 2022-02-18 15:40:32 +08:00
i-robot 8e21ffae65
!30120 Package the cuda operators as a dynamic link library 
Merge pull request !30120 from jinjiali-kali/cuda_ops_3
 2022-02-18 01:28:24 +00:00
jinjiali cd7db0f57f package the cuda operations as a dynamic link library 2022-02-17 16:51:45 +08:00
i-robot 7c32002e0b
!29930 Support List Slice 
Merge pull request !29930 from lianliguang/support-list-slice
 2022-02-17 07:24:40 +00:00
i-robot 2decc54375
!30016 Add distributed meta store module 
Merge pull request !30016 from ZPaC/metadata-store-module
 2022-02-17 02:13:30 +00:00
lianliguang 49608835c1 support list slice 2022-02-17 09:47:26 +08:00
i-robot c4c5a1c6da
!29862 MD Autotune supporting MindRecordOp 
Merge pull request !29862 from Mohammad Motallebi/autotune_addworker_mindrecord
 2022-02-16 23:34:11 +00:00
mohammad ddd3b07648 MD autotune supports mindrecord 2022-02-16 14:00:31 -05:00
ZPaC 191b65b236 Add distributed meta store module 2022-02-16 20:25:20 +08:00
i-robot 3b84ba1f1d
!29940 [GraphKernel] decouple convert_const_input_to_attr. 
Merge pull request !29940 from chenlei_autodiff/gk_lite
 2022-02-16 03:30:38 +00:00
i-robot e57633ec7f
!30027 Fix tensor with dynamic shape problem 
Merge pull request !30027 from hewei/fix_core
 2022-02-15 06:26:51 +00:00
chenlei_autodiff 5df9f01310 [GraphKernel] decouple convert_const_input_to_attr. 2022-02-15 10:27:34 +08:00
He Wei 36ab9c3d4b Fix tensor with dynamic shape problem 
Set data size to zero for tensor with dynamic shape,
prevent unexpected memory allocation for tensor data.
 2022-02-15 09:11:36 +08:00
He Wei 656b89a4da Add MakeValue related functions in MindAPI 
1. NewValueNode() by PrimitivePtr;
2. MakeValue() by vector<bool>.
 2022-02-14 15:08:43 +08:00
marui d47e79b04c Refactor ccsrc directories and CMakeLists files 2022-02-13 14:37:51 +08:00
He Wei 93328bc707 Fix a logging api bug in MindAPI 2022-02-11 08:42:04 +08:00
i-robot a42bc503f0
!29764 Add more required apis in MindAPI 
Merge pull request !29764 from hewei/core_api
 2022-02-10 07:55:37 +00:00
i-robot 7b6f7c9c87
!29786 Add TCP client and TCP server for RPC 
Merge pull request !29786 from chengang/add_tcp_server
 2022-02-10 07:47:12 +00:00
He Wei 21a9a0a73a Add more required apis in MindAPI 
1. AbstractBase::set_shape();
2. Move shape() from AbstractTensor to AbstractBase;
3. AbstractSequence construct from AbstractBasePtrList;
4. Shape construct from ShapeVector.
 2022-02-10 11:19:01 +08:00
cristoval c44d7b9100 add tcp client and tcp server 2022-02-10 09:50:40 +08:00
许志杰 ab9a32ad0d [feat] [assistant] [#I40GYE] add new loader SQuADDataset 2022-02-08 03:00:09 -08:00
zhoufeng b9b2f5bbfd delete core gvar 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2022-02-06 17:21:49 +08:00
i-robot e12d6af257
!29358 MD Child Sampler Code and UT Issues 
Merge pull request !29358 from zetongzhao/sampler_AddChild
 2022-01-31 16:55:22 +00:00
zetongzhao ea9783e18c fix sampler add_child 2022-01-31 07:45:42 -05:00
i-robot 48f4fd2f52
!29639 build core.so 
Merge pull request !29639 from zhoufeng/dynamic-core
 2022-01-30 02:00:21 +00:00
i-robot 02d63d7ad9
!23008 [assistant][ops][FilterWikipediaXML] 
Merge pull request !23008 from Isaac/FilterWikipediaXML
 2022-01-29 08:35:29 +00:00
i-robot 3d5ed14ff8
!29600 Open constrol flow closure feature. 
Merge pull request !29600 from chenfei_mindspore/open-closure
 2022-01-29 08:18:59 +00:00
zhoufeng 8e97ce5cd2 build core.so 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2022-01-29 14:11:02 +08:00
chenfei a96f0b11e0 open closure 2022-01-28 22:04:31 +08:00