yystopf
/
mindspore
forked from mindspore-Ecosystem/mindspore
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
45,876 Commits 23 Branches 0 Tags 3.9 GiB
Commit Graph

2085 Commits

Author SHA1 Message Date
wangshengnan12@huawei.com 48065b72a1 adapt_control_flow 2022-05-19 15:50:29 +08:00
He Wei 6313bc0cab Support user data in Tensor 2022-05-18 17:26:52 +08:00
ZPaC 60cc01ed18 Fix recover issue 2022-05-17 16:08:06 +08:00
i-robot e45b151037
!34436 EmbeddingLookup for cache prefetch from remote supports multi server 
Merge pull request !34436 from zyli2020/master
 2022-05-17 06:27:48 +00:00
lizhenyu 1a30c9cfc9 Embedding cache support multi server 2022-05-17 10:40:38 +08:00
Parallels da023206b7 Support reconnect to meta server if needed 2022-05-17 00:01:18 +08:00
i-robot 9503b4f2a1
!34397 Add heartbeat from compute graph node to meta server node 
Merge pull request !34397 from chengang/add_hb_for_cgn
 2022-05-16 06:47:54 +00:00
Parallels 9f458cee1f Add heartbeat from compute graph node to meta server node 2022-05-15 23:23:33 +08:00
i-robot 037733993a
!34278 fix bug for atomic clean 
Merge pull request !34278 from zhupuxu/fix_bug_for_atomic
 2022-05-14 02:34:34 +00:00
zhupuxu 91b09a8e0d fix bug for atomic 
Signed-off-by: zhupuxu <zhupuxu@huawei.com>
 2022-05-13 17:48:26 +08:00
Parallels 1905559fe3 Delete invalid tcp connection for the connection pool of tcp client 2022-05-13 10:04:40 +08:00
fr199787 9e5eb88799 [faet] [assistant] [I4S2FH] add new operator GetImageSize 2022-05-12 11:17:38 +08:00
i-robot 5e31a54cbb
!32787 [assistant][ops]Add GetImageNumChannels 
Merge pull request !32787 from yangwm/channels
 2022-05-12 02:07:12 +00:00
i-robot 2199898e00
!34246 Add unit testcase for recovery of meta server node 
Merge pull request !34246 from chengang/add_ut_for_msn_recovery
 2022-05-12 01:40:42 +00:00
LaiYongqiang 80fd871d2c 1. change DeviceAddressType to DeviceType 
2. change GetDeviceAddressType to GetDeviceType
3. remove AllocateMemory(DeviceAddress *const &address, size_t size) in specific device
4. remove GetDeviceAddressType in specific device
 2022-05-11 20:20:31 +08:00
Parallels e736170669 Add unit testcase for recovery of meta server node 2022-05-11 18:44:16 +08:00
i-robot 8b1af5b007
!34065 Provide helper class to find flat parameter 
Merge pull request !34065 from hewei/flatten_weights
 2022-05-11 09:21:17 +00:00
i-robot b55fe6f3fc
!34190 Remove abstract refkey and don't change order enforce 
Merge pull request !34190 from chenfei_mindspore/rm-abstract-ref-key-simple
 2022-05-11 08:48:24 +00:00
Parallels 9002e03524 Support recovery for the meta server node 2022-05-11 09:51:33 +08:00
i-robot 8831c00010
!34122 Add file configuration util for distributed recovery 
Merge pull request !34122 from chengang/add_recovery_fileutil
 2022-05-11 01:30:41 +00:00
chenfei 7ce82746ab rm abstract ref key 2022-05-10 20:54:21 +08:00
He Wei ac45331d2b Provide helper class to find flat parameter 2022-05-10 19:10:56 +08:00
Parallels 8ab2af36a7 Add file configuration util 2022-05-10 00:32:52 +08:00
shenyu d69c2ce0d1 [feat] [assistant] [I4S2FG] add new operator GetImageNumChannels 2022-05-09 22:32:05 +08:00
i-robot 9b18a85b34
!33673 fix litecv normalize 
Merge pull request !33673 from luoyang/issue2
 2022-05-09 13:55:47 +00:00
i-robot 723e40b7f1
!33521 Modify the printing information of type id 
Merge pull request !33521 from huangbingjian/type_id
 2022-05-07 07:15:07 +00:00
luoyang 418832b20a fix litecv normalize 2022-05-07 10:05:37 +08:00
huangbingjian 087b9f6750 Modify the printing information of type id 2022-05-06 11:31:44 +08:00
Parallels 68d8d9ee78 add collective communication topology node 2022-05-05 23:43:50 +08:00
i-robot 351ce03fb2
!33607 [MD] Transform Unification Feature - Phase 1 - provide main code 
Merge pull request !33607 from cathwong/transforms_uni_phase1_main_code
 2022-05-02 14:26:32 +00:00
hesham 16f8dcea15 [MD] Transform Unification Feature - Phase 1 - main code, C++ UTs 2022-04-29 20:45:33 -04:00
Xiao Tianci 0dc85a15b9 remove sensitive word in test data 2022-04-27 10:51:44 +08:00
i-robot 640f06518f
!33157 flatten concat fission 
Merge pull request !33157 from kisnwang/split-flatten-concat
 2022-04-26 11:22:15 +00:00
i-robot c926660451
!32001 atomic_clean_real_shape 
Merge pull request !32001 from zhupuxu/atomic_clean_real_shape
 2022-04-26 11:13:03 +00:00
i-robot fcb0319747
!33270 [assistant][InverseMelScale] 
Merge pull request !33270 from chenchen/InverseMelScale
 2022-04-26 08:55:58 +00:00
kswang e4ef608d20 add flatten concat fission 2022-04-26 15:40:36 +08:00
Parallels a98d3b632b Add rank id for node base 2022-04-26 00:12:46 +08:00
chenx2ovo cd8395f352 [feat][assistant][I3CEG2] add op inversemelscale 2022-04-25 18:58:38 +08:00
zhupuxu 2eb5d789d9 add dynamic atomic clean 
Signed-off-by: zhupuxu <zhupuxu@huawei.com>
 2022-04-25 16:34:29 +08:00
i-robot 0bb0183e08
!32913 Remove support for dataclass 
Merge pull request !32913 from huangbingjian/test_class
 2022-04-25 02:26:25 +00:00
i-robot f60fbd7508
!33318 Fix multi collect output for construct of tuple-tuple-getitem. 
Merge pull request !33318 from gaoyong10/dynamic_shape_01
 2022-04-24 11:04:24 +00:00
huangbingjian d6485b82f6 Remove support for dataclass 2022-04-24 09:12:50 +08:00
gaoyong10 c2d67a1ba9 Fix multi collect output for construct of tuple-tuple-getitem 2022-04-22 17:22:14 +08:00
i-robot d6482b38d8
!33278 fix bug of python reg 
Merge pull request !33278 from lianliguang/fix-bug-of-reg-pybind
 2022-04-22 09:22:13 +00:00
i-robot aaf0553fa6
!33354 ascend support OpenMPI 
Merge pull request !33354 from baihuawei/mpi_sink_backend
 2022-04-22 08:11:59 +00:00
lianliguang dd34e029a4 fix bug of pybind 2022-04-22 10:50:42 +08:00
baihuawei f64d9813e7 Ascend support mpi 2022-04-21 20:00:52 +08:00
i-robot 61fb221996
!31104 fix the register info of Celu. 
Merge pull request !31104 from wangshuide/wsd_master
 2022-04-21 09:11:53 +00:00
i-robot fd56cac602
!33085 delete updateop actor 
Merge pull request !33085 from TuDouNi/delete_update
 2022-04-20 10:21:28 +00:00
i-robot 14a8b1d18e
!32984 support list slice 
Merge pull request !32984 from lianliguang/supported-list-slice-assign
 2022-04-20 07:30:10 +00:00
i-robot 0a4c536570
!33287 set symbols of openssl static library to hidden 
Merge pull request !33287 from zhoufeng/fix-openssl-version-conflict
 2022-04-20 06:06:32 +00:00
ttudu ab8b8775b5 delete updateop actor 2022-04-20 09:44:11 +08:00
lianliguang 11b4836040 support list slice assign 2022-04-20 09:32:05 +08:00
i-robot 58d1555ec5
!33190 Improve the stability of dynamic networking 
Merge pull request !33190 from chengang/bugfix_dynamic_networking
 2022-04-19 13:29:39 +00:00
zhoufeng e873f3ac07 set symbols of openssl static library to hidden 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2022-04-19 19:50:23 +08:00
Parallels 4f2f6fc6e0 Improve the stability of dynamic networking 2022-04-19 17:35:22 +08:00
r1chardf1d0 f2464fa8f1 expander fallback 2022-04-19 17:24:37 +08:00
yuchaojie bb52ffb2a9 add TensorScatter op fission 2022-04-16 14:57:04 +08:00
i-robot 5d9e9a2bea
!32987 Move core primtive files into core/ops directory. 
Merge pull request !32987 from 张清华/opt
 2022-04-14 15:44:13 +00:00
Zhang Qinghua 12826b0f6c Add core/abstract/ops directory. 
Move core_ops.h.
 2022-04-14 19:31:28 +08:00
wangshuide2020 6236da16ea fix the register info of Celu. 2022-04-13 16:26:26 +08:00
Parallels df6217f720 bugfix for multi tcp clients connecting to one tcp server 2022-04-13 15:04:08 +08:00
i-robot 602c0d2923
!32755 Add retrieve API for compute graph node 
Merge pull request !32755 from chengang/add_retrieve_for_cgn_3
 2022-04-11 12:07:38 +00:00
Parallels 1590480215 Add retrieve API for compute graph node 2022-04-09 11:15:49 +08:00
i-robot 51e35f7faf
!32082 GraphKernel for Mindpsore-Lite 
Merge pull request !32082 from DeshiChen/0328_graph_kernel_lite
 2022-04-08 08:29:29 +00:00
i-robot efd13aa953
!32551 Change the types of input and output of tcp message handler 
Merge pull request !32551 from chengang/add_retrieve_for_cgn
 2022-04-08 01:25:14 +00:00
dayschan 2026faa695 GraphKernel for MS-lite 
1. move the lite_adapter files to lite directory.
created a directory "graph_kernel" in "mindspore/lite/tools".
we use 3 directory "converter", "runtime" and "common" to hold the different files.

2. modify lite makefiles to support GraphKernel.
a) define a micro "MSLITE_ENABLE_GRAPH_KERNEL" when graphkernel is enabled by building option "-K on".
b) converter's makefile: build the GraphKernel's core code and graph_kernel adapter for converter,
includes some backend's code of mindspore.
c) lite/src/CMakeLists: build graph_kernel adapter for benchmark

3. move the graph_kernel_pass_manager.cc from "graph_kernel/adapter" to "graph_kernel/core".
the original two graph_kernel_pass_manager files are similar, so we unify them.
 2022-04-06 11:02:12 +08:00
Parallels 18eaf2d9dd Add return value for user defined message handler 2022-04-06 10:02:08 +08:00
i-robot b0043637d9
!30709 Delete DynamicKernel 
Merge pull request !30709 from TuDouNi/gpu_cpu_delete_dynamic_kernel
 2022-04-02 01:33:13 +00:00
Parallels 7fa00586af Add return message for message handler 2022-04-01 10:48:12 +08:00
ttudu 4fe7b0d350 delete dynamic_kernel 2022-03-31 20:50:52 +08:00
i-robot c3d7c425e9
!29856 [assistant][GriffinLim] 
Merge pull request !29856 from chenchen/g2
 2022-03-31 09:33:52 +00:00
i-robot 8b13840742
!32327 Add message sending API from compute graph node to meta server node 
Merge pull request !32327 from chengang/add_sendmsg_api
 2022-03-31 06:18:34 +00:00
chenx2ovo e19dc02b47 [feat][assistant][I3CECZ] add op griffinlim 2022-03-31 11:30:26 +08:00
i-robot 9810fa53cb
!31899 [Auto-Par] [D-Rec] Add Mem & Redis coefficient on D-Rec cost model for Pangu-alpha 
Merge pull request !31899 from FRHW-WANG/D-Rec-deliver
 2022-03-31 02:12:26 +00:00
Parallels 4f2e9a77bf Add message sending api for compute graph node to meta server node 2022-03-31 00:39:25 +08:00
haoran.wang 3674e1d713 Add Mem & Redis coefficient for PanGu-alpha 2022-03-29 12:00:34 +00:00
Parallels 300cf56b9d Add unregister API for compute graph node 2022-03-29 13:08:45 +08:00
i-robot 9d2ddbe0ee
!32080 Add cluster topology state 
Merge pull request !32080 from chengang/support_topo_state
 2022-03-29 03:46:40 +00:00
Parallels f660b3c58e Add cluster topology state 2022-03-28 05:48:11 +00:00
Parallels 7bcf3f7b03 Fix exception when sending large messages 2022-03-27 02:10:40 +00:00
lizhenyu 812127940d add ut for recovery 2022-03-25 16:58:08 +08:00
i-robot c6da65ecfa
!31879 Training support recovery 
Merge pull request !31879 from zyli2020/worker_failover_bp
 2022-03-25 07:06:55 +00:00
i-robot 8589335879
!31889 Add some ut pipeline test case for C++ dataset 
Merge pull request !31889 from liucunwei/dataset-lcw-0324
 2022-03-25 03:27:37 +00:00
lizhenyu 275f81c47b failover support exit process when timeout occur 2022-03-25 11:16:04 +08:00
liucunwei 03b32e4eab Add some ut pipeline test case for C++ dataset 2022-03-25 10:25:19 +08:00
i-robot 0b6f330d7e
!31666 [MS][LITE] new core ops api and lite adapter new api 
Merge pull request !31666 from luoyuan/core2
 2022-03-24 08:50:40 +00:00
yanghaoran e0ee78497d takedown tcptest.sendlargemessages to ensure gate stability 2022-03-24 15:20:30 +08:00
luoyuan 3e6e4bfdd3 add core ops api and adapter new mindapi 2022-03-24 10:47:40 +08:00
i-robot a50223f93a
!31680 [assistant][Fade] bug fix 
Merge pull request !31680 from QingfengLi/fade
 2022-03-22 07:58:59 +00:00
i-robot ecde0749bb
!31576 dynamic shape CPU & GPU 
Merge pull request !31576 from TuDouNi/dynamic_shape_gpu_cpu_2
 2022-03-22 07:27:50 +00:00
i-robot 32ecb8cbea
!31664 fix grpc not found in gpu serving 
Merge pull request !31664 from zhoufeng/xiu-ba-ge
 2022-03-22 06:10:24 +00:00
ttudu adb18b82ca dynamic shape CPU & GPU 2022-03-22 13:03:31 +08:00
chenx2ovo c50a4611ec [fix][assistant][I3CEGF] fix can not compute bool tensor 2022-03-22 10:20:01 +08:00
i-robot 3b24d825bf
!31578 Fix exception for sending big message using TCP client. 
Merge pull request !31578 from chengang/fix_rpc_big_msg
 2022-03-22 01:27:29 +00:00
i-robot 9bfa6ebc58
!31611 code check clean 
Merge pull request !31611 from yuchaojie/code-clean
 2022-03-22 01:20:44 +00:00
zhoufeng 55f6d075e8 fix grpc not found in serving 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2022-03-21 22:06:46 +08:00
i-robot 264bed91a4
!31594 Add ps execution mode implementation 
Merge pull request !31594 from ZPaC/add-dist-execution-mode
 2022-03-21 13:07:24 +00:00
yuchaojie 42818b17f6 code check clean 2022-03-21 16:32:22 +08:00
i-robot 4dd3a94d27
!31571 clean code 
Merge pull request !31571 from kisnwang/clean_code
 2022-03-21 08:31:38 +00:00