Commit Graph

166 Commits

Author SHA1 Message Date
chenfei bcd6ad95a3 add test ut 2022-06-08 15:56:40 +08:00
i-robot 8f373d9466
!33775 compiled macro
Merge pull request !33775 from liubuyu/master
2022-06-01 02:02:19 +00:00
lizhenyu 0b27a636be Add embedding cache scheduler 2022-05-31 14:19:54 +08:00
lby bcf1dfe963 compile macro 2022-05-30 13:50:09 +08:00
ZPaC ab4353206f Support rpc dynamic shape. 2022-05-28 11:07:00 +08:00
lizhenyu 1a30c9cfc9 Embedding cache support multi server 2022-05-17 10:40:38 +08:00
Parallels 8ab2af36a7 Add file configuration util 2022-05-10 00:32:52 +08:00
Parallels 68d8d9ee78 add collective communication topology node 2022-05-05 23:43:50 +08:00
zhoufeng e873f3ac07 set symbols of openssl static library to hidden
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2022-04-19 19:50:23 +08:00
dayschan 2026faa695 GraphKernel for MS-lite
1. move the lite_adapter files to lite directory.
created a directory "graph_kernel" in "mindspore/lite/tools".
we use 3 directory "converter", "runtime" and "common" to hold the different files.

2. modify lite makefiles to support GraphKernel.
a) define a micro "MSLITE_ENABLE_GRAPH_KERNEL" when graphkernel is enabled by building option "-K on".
b) converter's makefile: build the GraphKernel's core code and graph_kernel adapter for converter,
includes some backend's code of mindspore.
c) lite/src/CMakeLists: build graph_kernel adapter for benchmark

3. move the graph_kernel_pass_manager.cc from "graph_kernel/adapter" to "graph_kernel/core".
the original two graph_kernel_pass_manager files are similar, so we unify them.
2022-04-06 11:02:12 +08:00
ttudu 4fe7b0d350 delete dynamic_kernel 2022-03-31 20:50:52 +08:00
lizhenyu 812127940d add ut for recovery 2022-03-25 16:58:08 +08:00
lizhenyu 275f81c47b failover support exit process when timeout occur 2022-03-25 11:16:04 +08:00
i-robot 32ecb8cbea
!31664 fix grpc not found in gpu serving
Merge pull request !31664 from zhoufeng/xiu-ba-ge
2022-03-22 06:10:24 +00:00
zhoufeng 55f6d075e8 fix grpc not found in serving
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2022-03-21 22:06:46 +08:00
ZPaC 506989abb8 Add ps execution mode implementation 2022-03-21 14:35:25 +08:00
i-robot 048d089f9a
!31520 test ut
Merge pull request !31520 from gaoyong10/dynamic_shape_01
2022-03-20 04:24:23 +00:00
gaoyong10 89c98f8b73 Add ut for dynamic shape and control flow. 2022-03-19 19:48:44 +08:00
zhoufeng da11e0f150 change debug.a to object
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2022-03-19 15:39:49 +08:00
zhoufeng b7bb53ff73 build libmindspore_backend.so
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2022-03-17 19:14:45 +08:00
lizhenyu 545707b80c Training supports failover 2022-03-16 23:34:29 +08:00
TronZhang db2931516e refactor cpu factory 2022-03-14 10:05:56 +08:00
xulei bb10249d49 support gcc-8 and gcc-9 2022-03-11 16:12:41 +08:00
i-robot f3b753807b
!30929 Add AkgKernel for lite_adapter
Merge pull request !30929 from DeshiChen/0307_akgkernel
2022-03-11 07:01:10 +00:00
dayschan 601fb25cb7 Add AkgKernel for lite_adapter
Implements a temporary solution of InferShape for GraphKernel ops by
saving shape/type/format in custom attributes and decode them in InferShape function.
2022-03-10 18:19:28 +08:00
Parallels e2125108b8 Add tcp communication into compute graph nodes and meta server node 2022-03-09 00:02:25 +08:00
i-robot 6bc31df410
!30672 delete ut test libgraph and liberror_manager dependency
Merge pull request !30672 from qujianwei/master
2022-03-02 02:18:24 +00:00
qujianwei 7e1aebc2c9 delete ut libgraph.so and liberror_manager.so dependency 2022-03-01 20:50:45 +08:00
ZPaC dc80f9b8d1 Fix rpc route bugs 2022-02-28 19:18:42 +08:00
i-robot 330cacf905
!30573 Catch abnormals from sto functions in debug
Merge pull request !30573 from maning202007/master
2022-02-26 08:52:22 +00:00
i-robot 909183a2ef
!30317 extract common as an independent shared library
Merge pull request !30317 from zhoufeng/backend-compile-independently
2022-02-26 06:08:17 +00:00
maning202007 9328041de4 Catch abnormals from sto functions in debug
Fix type errors

Fix bugs

Fix cycle depth
2022-02-26 11:03:52 +08:00
zhoufeng f49b195c39 extract common as an independent shared library
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2022-02-26 10:55:51 +08:00
chenlei_autodiff 9fabf8ae0d [GraphKernel] replace graph kernel node with custom in lite. 2022-02-25 17:09:24 +08:00
ZPaC 191b65b236 Add distributed meta store module 2022-02-16 20:25:20 +08:00
marui d47e79b04c Refactor ccsrc directories and CMakeLists files 2022-02-13 14:37:51 +08:00
zhoufeng b9b2f5bbfd delete core gvar
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2022-02-06 17:21:49 +08:00
zhoufeng 8e97ce5cd2 build core.so
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2022-01-29 14:11:02 +08:00
xiao_yao1994 54fc038f0a unify infer and train compile binary 2022-01-13 17:04:34 +08:00
i-robot 68ec2be828
!28784 [GraphKernel] add lite pass manager.
Merge pull request !28784 from chenlei_autodiff/lite_callback
2022-01-12 06:52:10 +00:00
chenlei_autodiff 0574995198 [GraphKernel] add lite pass manager. 2022-01-11 12:08:54 +08:00
xiao_yao1994 0843910260 unify ge and vm backend 2022-01-11 11:53:58 +08:00
i-robot e4438f3028
!28310 dynamic_kernel_mod
Merge pull request !28310 from TuDouNi/dynamic_shape_stage1
2022-01-04 12:48:53 +00:00
ttudu 9373679c04 dynamic_kernel_mod 2022-01-04 14:13:19 +08:00
yuchaojie a0a31fe651 convert aicpu op attr to input 2021-12-30 18:59:53 +08:00
kswang af48f201a2 add cpu fused adafactor 2021-12-28 11:05:41 +08:00
cristoval bb5798c391 Add tcp communicator for RPC 2021-12-16 23:32:38 +08:00
w00517672 0064fc7ebc fix bugs triggered by fl 2021-12-09 16:21:17 +08:00
lizhenyu b1a42e3525 add unit test for persistent storage 2021-12-05 13:51:17 +08:00
He Wei d2bb6303b7 Provide new mindspore core API classes
1. namespace is mindspore::api;
2. API header files located in mindspore/core/mindapi;
3. We use pimpl pattern to provide a wrapper layer for api;
4. Check mindapi_test.cc for usage examples.
2021-12-03 11:03:22 +08:00