Commit Graph

2027 Commits

Author SHA1 Message Date
i-robot 5d9e9a2bea
!32987 Move core primtive files into core/ops directory.
Merge pull request !32987 from 张清华/opt
2022-04-14 15:44:13 +00:00
Zhang Qinghua 12826b0f6c Add core/abstract/ops directory.
Move core_ops.h.
2022-04-14 19:31:28 +08:00
wangshuide2020 6236da16ea fix the register info of Celu. 2022-04-13 16:26:26 +08:00
Parallels df6217f720 bugfix for multi tcp clients connecting to one tcp server 2022-04-13 15:04:08 +08:00
i-robot 602c0d2923
!32755 Add retrieve API for compute graph node
Merge pull request !32755 from chengang/add_retrieve_for_cgn_3
2022-04-11 12:07:38 +00:00
Parallels 1590480215 Add retrieve API for compute graph node 2022-04-09 11:15:49 +08:00
i-robot 51e35f7faf
!32082 GraphKernel for Mindpsore-Lite
Merge pull request !32082 from DeshiChen/0328_graph_kernel_lite
2022-04-08 08:29:29 +00:00
i-robot efd13aa953
!32551 Change the types of input and output of tcp message handler
Merge pull request !32551 from chengang/add_retrieve_for_cgn
2022-04-08 01:25:14 +00:00
dayschan 2026faa695 GraphKernel for MS-lite
1. move the lite_adapter files to lite directory.
created a directory "graph_kernel" in "mindspore/lite/tools".
we use 3 directory "converter", "runtime" and "common" to hold the different files.

2. modify lite makefiles to support GraphKernel.
a) define a micro "MSLITE_ENABLE_GRAPH_KERNEL" when graphkernel is enabled by building option "-K on".
b) converter's makefile: build the GraphKernel's core code and graph_kernel adapter for converter,
includes some backend's code of mindspore.
c) lite/src/CMakeLists: build graph_kernel adapter for benchmark

3. move the graph_kernel_pass_manager.cc from "graph_kernel/adapter" to "graph_kernel/core".
the original two graph_kernel_pass_manager files are similar, so we unify them.
2022-04-06 11:02:12 +08:00
Parallels 18eaf2d9dd Add return value for user defined message handler 2022-04-06 10:02:08 +08:00
i-robot b0043637d9
!30709 Delete DynamicKernel
Merge pull request !30709 from TuDouNi/gpu_cpu_delete_dynamic_kernel
2022-04-02 01:33:13 +00:00
Parallels 7fa00586af Add return message for message handler 2022-04-01 10:48:12 +08:00
ttudu 4fe7b0d350 delete dynamic_kernel 2022-03-31 20:50:52 +08:00
i-robot c3d7c425e9
!29856 [assistant][GriffinLim]
Merge pull request !29856 from chenchen/g2
2022-03-31 09:33:52 +00:00
i-robot 8b13840742
!32327 Add message sending API from compute graph node to meta server node
Merge pull request !32327 from chengang/add_sendmsg_api
2022-03-31 06:18:34 +00:00
chenx2ovo e19dc02b47 [feat][assistant][I3CECZ] add op griffinlim 2022-03-31 11:30:26 +08:00
i-robot 9810fa53cb
!31899 [Auto-Par] [D-Rec] Add Mem & Redis coefficient on D-Rec cost model for Pangu-alpha
Merge pull request !31899 from FRHW-WANG/D-Rec-deliver
2022-03-31 02:12:26 +00:00
Parallels 4f2e9a77bf Add message sending api for compute graph node to meta server node 2022-03-31 00:39:25 +08:00
haoran.wang 3674e1d713 Add Mem & Redis coefficient for PanGu-alpha 2022-03-29 12:00:34 +00:00
Parallels 300cf56b9d Add unregister API for compute graph node 2022-03-29 13:08:45 +08:00
i-robot 9d2ddbe0ee
!32080 Add cluster topology state
Merge pull request !32080 from chengang/support_topo_state
2022-03-29 03:46:40 +00:00
Parallels f660b3c58e Add cluster topology state 2022-03-28 05:48:11 +00:00
Parallels 7bcf3f7b03 Fix exception when sending large messages 2022-03-27 02:10:40 +00:00
lizhenyu 812127940d add ut for recovery 2022-03-25 16:58:08 +08:00
i-robot c6da65ecfa
!31879 Training support recovery
Merge pull request !31879 from zyli2020/worker_failover_bp
2022-03-25 07:06:55 +00:00
i-robot 8589335879
!31889 Add some ut pipeline test case for C++ dataset
Merge pull request !31889 from liucunwei/dataset-lcw-0324
2022-03-25 03:27:37 +00:00
lizhenyu 275f81c47b failover support exit process when timeout occur 2022-03-25 11:16:04 +08:00
liucunwei 03b32e4eab Add some ut pipeline test case for C++ dataset 2022-03-25 10:25:19 +08:00
i-robot 0b6f330d7e
!31666 [MS][LITE] new core ops api and lite adapter new api
Merge pull request !31666 from luoyuan/core2
2022-03-24 08:50:40 +00:00
yanghaoran e0ee78497d takedown tcptest.sendlargemessages to ensure gate stability 2022-03-24 15:20:30 +08:00
luoyuan 3e6e4bfdd3 add core ops api and adapter new mindapi 2022-03-24 10:47:40 +08:00
i-robot a50223f93a
!31680 [assistant][Fade] bug fix
Merge pull request !31680 from QingfengLi/fade
2022-03-22 07:58:59 +00:00
i-robot ecde0749bb
!31576 dynamic shape CPU & GPU
Merge pull request !31576 from TuDouNi/dynamic_shape_gpu_cpu_2
2022-03-22 07:27:50 +00:00
i-robot 32ecb8cbea
!31664 fix grpc not found in gpu serving
Merge pull request !31664 from zhoufeng/xiu-ba-ge
2022-03-22 06:10:24 +00:00
ttudu adb18b82ca dynamic shape CPU & GPU 2022-03-22 13:03:31 +08:00
chenx2ovo c50a4611ec [fix][assistant][I3CEGF] fix can not compute bool tensor 2022-03-22 10:20:01 +08:00
i-robot 3b24d825bf
!31578 Fix exception for sending big message using TCP client.
Merge pull request !31578 from chengang/fix_rpc_big_msg
2022-03-22 01:27:29 +00:00
i-robot 9bfa6ebc58
!31611 code check clean
Merge pull request !31611 from yuchaojie/code-clean
2022-03-22 01:20:44 +00:00
zhoufeng 55f6d075e8 fix grpc not found in serving
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2022-03-21 22:06:46 +08:00
i-robot 264bed91a4
!31594 Add ps execution mode implementation
Merge pull request !31594 from ZPaC/add-dist-execution-mode
2022-03-21 13:07:24 +00:00
yuchaojie 42818b17f6 code check clean 2022-03-21 16:32:22 +08:00
i-robot 4dd3a94d27
!31571 clean code
Merge pull request !31571 from kisnwang/clean_code
2022-03-21 08:31:38 +00:00
ZPaC 506989abb8 Add ps execution mode implementation 2022-03-21 14:35:25 +08:00
kswang 70b85a16cb clean code 2022-03-21 09:54:06 +08:00
i-robot 048d089f9a
!31520 test ut
Merge pull request !31520 from gaoyong10/dynamic_shape_01
2022-03-20 04:24:23 +00:00
Parallels d3bcc66d15 Fix sending large message using rpc. 2022-03-20 10:42:52 +08:00
gaoyong10 89c98f8b73 Add ut for dynamic shape and control flow. 2022-03-19 19:48:44 +08:00
zhoufeng da11e0f150 change debug.a to object
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2022-03-19 15:39:49 +08:00
i-robot dc5f77f585
!31298 build libmindspore_backend.so
Merge pull request !31298 from zhoufeng/backend-frontend-decoupling
2022-03-18 09:41:51 +00:00
i-robot c0c5b8c143
!31480 Reduce UT CPP profiler tests time
Merge pull request !31480 from zetongzhao/reduce_profiler_test_time
2022-03-17 19:10:57 +00:00
zetongzhao 694ede05cf change set_dataset 2022-03-17 13:13:01 -04:00
i-robot d37ee6e729
!31173 Stream Assign Refactor
Merge pull request !31173 from jiaorui/refactor-stream
2022-03-17 11:39:11 +00:00
zhoufeng b7bb53ff73 build libmindspore_backend.so
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2022-03-17 19:14:45 +08:00
jiaorui 91bd673538 refactor 2022-03-17 10:50:12 +08:00
i-robot e6dadfd999
!31159 Add st and ut testcase for pass tuple_transform
Merge pull request !31159 from chenfei_mindspore/master-develop
2022-03-17 02:01:44 +00:00
i-robot c3d15a079e
!31325 Training supports failover
Merge pull request !31325 from zyli2020/worker_failover_bp
2022-03-17 01:37:30 +00:00
i-robot 8e1f6d6b9b
!31268 Move UT CPP Helper Functions
Merge pull request !31268 from zetongzhao/ut_cpp_helper
2022-03-16 18:20:24 +00:00
lizhenyu 545707b80c Training supports failover 2022-03-16 23:34:29 +08:00
zetongzhao ab5f79f522 move common helper function 2022-03-16 10:30:43 -04:00
chenfei 3872e29c3b add ut for tuple trans 2022-03-16 21:33:54 +08:00
i-robot 272d25b291
!31137 Test SkipFirstEpochSampler
Merge pull request !31137 from zetongzhao/test_skip_first_epoch_sampler
2022-03-15 18:26:28 +00:00
i-robot 059c939854
!31269 Fix ut debug mode compile
Merge pull request !31269 from qujianwei/master
2022-03-15 12:35:38 +00:00
shenwei41 f1fde6a262 upgrade Ascend package 11 Mar 22 2022-03-15 16:31:27 +08:00
qujianwei d5eb5090d9 fix ut compile in debug mode 2022-03-15 11:04:37 +08:00
i-robot 4b15a46a49
!30858 Refactor cpu kernel factory.
Merge pull request !30858 from TronZhang/refactor_cpu_factory
2022-03-15 01:33:14 +00:00
zetongzhao 9d4c8e29f9 add test for skip first epoch sampler 2022-03-14 15:01:08 -04:00
i-robot a33611ce27
!31192 Support sync and async message sending mode for TCP client
Merge pull request !31192 from chengang/add_send_sync
2022-03-14 07:55:49 +00:00
TronZhang db2931516e refactor cpu factory 2022-03-14 10:05:56 +08:00
Parallels 6f31f270e9 support sync and async message sending mode for tcp client 2022-03-12 21:14:35 +08:00
xulei bb10249d49 support gcc-8 and gcc-9 2022-03-11 16:12:41 +08:00
i-robot f3b753807b
!30929 Add AkgKernel for lite_adapter
Merge pull request !30929 from DeshiChen/0307_akgkernel
2022-03-11 07:01:10 +00:00
i-robot 3375003da9
!31158 Add registration and heartbeat message from compute graph node to meta server node
Merge pull request !31158 from chengang/add_pb_to_node
2022-03-11 06:55:03 +00:00
Parallels 5fe6d42fe1 Add registration and heartbeat message from compute graph node to meta server node 2022-03-11 11:42:08 +08:00
dayschan 601fb25cb7 Add AkgKernel for lite_adapter
Implements a temporary solution of InferShape for GraphKernel ops by
saving shape/type/format in custom attributes and decode them in InferShape function.
2022-03-10 18:19:28 +08:00
liu-yongqi-63 457ee03082 Vocab C++ Interface Alignment and SentencePieceVocab C++ interface alignment and Python interface refactoring 2022-03-10 11:33:00 +08:00
i-robot 662a7f8408
!31044 add cpp ut for combine_like_graphs
Merge pull request !31044 from huanghui/add-ut
2022-03-10 03:28:56 +00:00
huanghui 1077601e26 add cpp ut for jit_config 2022-03-10 10:56:18 +08:00
i-robot 3f1a7f45bb
!30942 Add hwc_to_chw operation on lite
Merge pull request !30942 from shenwei41/hwc_to_chw
2022-03-10 01:21:54 +00:00
i-robot f57f862d7b
!30782 [MD] pushdown skip node in MD pipeline
Merge pull request !30782 from Mohammad Motallebi/failover_pushdown_skipop
2022-03-10 01:12:46 +00:00
mohammad 260cebf650 [MD] skip node pushdown optimization pass for Reset 2022-03-09 09:52:25 -05:00
shenwei41 7f7bae8bfe add hwc_to_chw operation on lite 2022-03-09 15:43:13 +08:00
i-robot 698b99aaa3
!18945 [assistant][ops]New operator implementation, include OmniglotDataset
Merge pull request !18945 from Wangsong95/omniglot_dataset
2022-03-09 06:51:15 +00:00
Parallels e2125108b8 Add tcp communication into compute graph nodes and meta server node 2022-03-09 00:02:25 +08:00
qkeys ce7597f500 [feat][assistant][I3J6VB] add new data operator OmniglotDataset 2022-03-08 21:36:22 +08:00
buxue 50f3ad00ab develop maxpool3d, avgpool3d and conv3d on CPU(including forward and backward) 2022-03-07 20:44:38 +08:00
i-robot 960d551b8f
!30889 parse core type from pre-build for tbe kernel compile
Merge pull request !30889 from liubuyu/master
2022-03-07 03:53:48 +00:00
i-robot c4cc0e6f26
!30742 auto parallel support not ony power of 2 device numbers
Merge pull request !30742 from yao_yf/auto_parallel_support_not_only_2_power
2022-03-07 01:09:01 +00:00
yao_yf b60e54e0d5 support not only power of 2 2022-03-06 18:08:46 +08:00
lby 2b1b539b36 parse core type from pre-build for tbe kernel compile 2022-03-06 15:23:50 +08:00
i-robot fdf7aebd78
!30746 Fix recv actor stuck issue.
Merge pull request !30746 from ZPaC/sync-route-table
2022-03-04 03:01:03 +00:00
i-robot f01d841113
!27943 [MD][Autotune] Save/Load Autotune config
Merge pull request !27943 from harshvardhangupta/save_load_at_config
2022-03-03 20:42:23 +00:00
i-robot 7b26a32e98
!22608 [assistant][ops]New operator implementation, include KITTIDataset
Merge pull request !22608 from Wangsong95/kitti_dataset
2022-03-03 07:05:40 +00:00
harshvardhangupta bd61adbb72 Implement save/load of autotune dataset pipeline configuration #27943 2022-03-02 15:08:08 -05:00
Parallels 5e09380eb3 add random port support for tcp server 2022-03-02 21:27:33 +08:00
zx 93617ce91e [feat][assistant][I3J6VO] add new data operator KITTI 2022-03-02 19:29:17 +08:00
ZPaC 4c74b600ea Fix recv actor stuck issue. 2022-03-02 19:26:45 +08:00
i-robot 6bc31df410
!30672 delete ut test libgraph and liberror_manager dependency
Merge pull request !30672 from qujianwei/master
2022-03-02 02:18:24 +00:00
qujianwei 7e1aebc2c9 delete ut libgraph.so and liberror_manager.so dependency 2022-03-01 20:50:45 +08:00
i-robot 4367377000
!30611 Fix rpc route bugs
Merge pull request !30611 from ZPaC/sync-route-table
2022-02-28 15:50:35 +00:00
ZPaC dc80f9b8d1 Fix rpc route bugs 2022-02-28 19:18:42 +08:00