Commit Graph

1988 Commits

Author SHA1 Message Date
i-robot 264bed91a4
!31594 Add ps execution mode implementation
Merge pull request !31594 from ZPaC/add-dist-execution-mode
2022-03-21 13:07:24 +00:00
yuchaojie 42818b17f6 code check clean 2022-03-21 16:32:22 +08:00
i-robot 4dd3a94d27
!31571 clean code
Merge pull request !31571 from kisnwang/clean_code
2022-03-21 08:31:38 +00:00
ZPaC 506989abb8 Add ps execution mode implementation 2022-03-21 14:35:25 +08:00
kswang 70b85a16cb clean code 2022-03-21 09:54:06 +08:00
i-robot 048d089f9a
!31520 test ut
Merge pull request !31520 from gaoyong10/dynamic_shape_01
2022-03-20 04:24:23 +00:00
Parallels d3bcc66d15 Fix sending large message using rpc. 2022-03-20 10:42:52 +08:00
gaoyong10 89c98f8b73 Add ut for dynamic shape and control flow. 2022-03-19 19:48:44 +08:00
zhoufeng da11e0f150 change debug.a to object
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2022-03-19 15:39:49 +08:00
i-robot dc5f77f585
!31298 build libmindspore_backend.so
Merge pull request !31298 from zhoufeng/backend-frontend-decoupling
2022-03-18 09:41:51 +00:00
i-robot c0c5b8c143
!31480 Reduce UT CPP profiler tests time
Merge pull request !31480 from zetongzhao/reduce_profiler_test_time
2022-03-17 19:10:57 +00:00
zetongzhao 694ede05cf change set_dataset 2022-03-17 13:13:01 -04:00
i-robot d37ee6e729
!31173 Stream Assign Refactor
Merge pull request !31173 from jiaorui/refactor-stream
2022-03-17 11:39:11 +00:00
zhoufeng b7bb53ff73 build libmindspore_backend.so
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2022-03-17 19:14:45 +08:00
jiaorui 91bd673538 refactor 2022-03-17 10:50:12 +08:00
i-robot e6dadfd999
!31159 Add st and ut testcase for pass tuple_transform
Merge pull request !31159 from chenfei_mindspore/master-develop
2022-03-17 02:01:44 +00:00
i-robot c3d15a079e
!31325 Training supports failover
Merge pull request !31325 from zyli2020/worker_failover_bp
2022-03-17 01:37:30 +00:00
i-robot 8e1f6d6b9b
!31268 Move UT CPP Helper Functions
Merge pull request !31268 from zetongzhao/ut_cpp_helper
2022-03-16 18:20:24 +00:00
lizhenyu 545707b80c Training supports failover 2022-03-16 23:34:29 +08:00
zetongzhao ab5f79f522 move common helper function 2022-03-16 10:30:43 -04:00
chenfei 3872e29c3b add ut for tuple trans 2022-03-16 21:33:54 +08:00
i-robot 272d25b291
!31137 Test SkipFirstEpochSampler
Merge pull request !31137 from zetongzhao/test_skip_first_epoch_sampler
2022-03-15 18:26:28 +00:00
i-robot 059c939854
!31269 Fix ut debug mode compile
Merge pull request !31269 from qujianwei/master
2022-03-15 12:35:38 +00:00
shenwei41 f1fde6a262 upgrade Ascend package 11 Mar 22 2022-03-15 16:31:27 +08:00
qujianwei d5eb5090d9 fix ut compile in debug mode 2022-03-15 11:04:37 +08:00
i-robot 4b15a46a49
!30858 Refactor cpu kernel factory.
Merge pull request !30858 from TronZhang/refactor_cpu_factory
2022-03-15 01:33:14 +00:00
zetongzhao 9d4c8e29f9 add test for skip first epoch sampler 2022-03-14 15:01:08 -04:00
i-robot a33611ce27
!31192 Support sync and async message sending mode for TCP client
Merge pull request !31192 from chengang/add_send_sync
2022-03-14 07:55:49 +00:00
TronZhang db2931516e refactor cpu factory 2022-03-14 10:05:56 +08:00
Parallels 6f31f270e9 support sync and async message sending mode for tcp client 2022-03-12 21:14:35 +08:00
xulei bb10249d49 support gcc-8 and gcc-9 2022-03-11 16:12:41 +08:00
i-robot f3b753807b
!30929 Add AkgKernel for lite_adapter
Merge pull request !30929 from DeshiChen/0307_akgkernel
2022-03-11 07:01:10 +00:00
i-robot 3375003da9
!31158 Add registration and heartbeat message from compute graph node to meta server node
Merge pull request !31158 from chengang/add_pb_to_node
2022-03-11 06:55:03 +00:00
Parallels 5fe6d42fe1 Add registration and heartbeat message from compute graph node to meta server node 2022-03-11 11:42:08 +08:00
dayschan 601fb25cb7 Add AkgKernel for lite_adapter
Implements a temporary solution of InferShape for GraphKernel ops by
saving shape/type/format in custom attributes and decode them in InferShape function.
2022-03-10 18:19:28 +08:00
liu-yongqi-63 457ee03082 Vocab C++ Interface Alignment and SentencePieceVocab C++ interface alignment and Python interface refactoring 2022-03-10 11:33:00 +08:00
i-robot 662a7f8408
!31044 add cpp ut for combine_like_graphs
Merge pull request !31044 from huanghui/add-ut
2022-03-10 03:28:56 +00:00
huanghui 1077601e26 add cpp ut for jit_config 2022-03-10 10:56:18 +08:00
i-robot 3f1a7f45bb
!30942 Add hwc_to_chw operation on lite
Merge pull request !30942 from shenwei41/hwc_to_chw
2022-03-10 01:21:54 +00:00
i-robot f57f862d7b
!30782 [MD] pushdown skip node in MD pipeline
Merge pull request !30782 from Mohammad Motallebi/failover_pushdown_skipop
2022-03-10 01:12:46 +00:00
mohammad 260cebf650 [MD] skip node pushdown optimization pass for Reset 2022-03-09 09:52:25 -05:00
shenwei41 7f7bae8bfe add hwc_to_chw operation on lite 2022-03-09 15:43:13 +08:00
i-robot 698b99aaa3
!18945 [assistant][ops]New operator implementation, include OmniglotDataset
Merge pull request !18945 from Wangsong95/omniglot_dataset
2022-03-09 06:51:15 +00:00
Parallels e2125108b8 Add tcp communication into compute graph nodes and meta server node 2022-03-09 00:02:25 +08:00
qkeys ce7597f500 [feat][assistant][I3J6VB] add new data operator OmniglotDataset 2022-03-08 21:36:22 +08:00
buxue 50f3ad00ab develop maxpool3d, avgpool3d and conv3d on CPU(including forward and backward) 2022-03-07 20:44:38 +08:00
i-robot 960d551b8f
!30889 parse core type from pre-build for tbe kernel compile
Merge pull request !30889 from liubuyu/master
2022-03-07 03:53:48 +00:00
i-robot c4cc0e6f26
!30742 auto parallel support not ony power of 2 device numbers
Merge pull request !30742 from yao_yf/auto_parallel_support_not_only_2_power
2022-03-07 01:09:01 +00:00
yao_yf b60e54e0d5 support not only power of 2 2022-03-06 18:08:46 +08:00
lby 2b1b539b36 parse core type from pre-build for tbe kernel compile 2022-03-06 15:23:50 +08:00
i-robot fdf7aebd78
!30746 Fix recv actor stuck issue.
Merge pull request !30746 from ZPaC/sync-route-table
2022-03-04 03:01:03 +00:00
i-robot f01d841113
!27943 [MD][Autotune] Save/Load Autotune config
Merge pull request !27943 from harshvardhangupta/save_load_at_config
2022-03-03 20:42:23 +00:00
i-robot 7b26a32e98
!22608 [assistant][ops]New operator implementation, include KITTIDataset
Merge pull request !22608 from Wangsong95/kitti_dataset
2022-03-03 07:05:40 +00:00
harshvardhangupta bd61adbb72 Implement save/load of autotune dataset pipeline configuration #27943 2022-03-02 15:08:08 -05:00
Parallels 5e09380eb3 add random port support for tcp server 2022-03-02 21:27:33 +08:00
zx 93617ce91e [feat][assistant][I3J6VO] add new data operator KITTI 2022-03-02 19:29:17 +08:00
ZPaC 4c74b600ea Fix recv actor stuck issue. 2022-03-02 19:26:45 +08:00
i-robot 6bc31df410
!30672 delete ut test libgraph and liberror_manager dependency
Merge pull request !30672 from qujianwei/master
2022-03-02 02:18:24 +00:00
qujianwei 7e1aebc2c9 delete ut libgraph.so and liberror_manager.so dependency 2022-03-01 20:50:45 +08:00
i-robot 4367377000
!30611 Fix rpc route bugs
Merge pull request !30611 from ZPaC/sync-route-table
2022-02-28 15:50:35 +00:00
ZPaC dc80f9b8d1 Fix rpc route bugs 2022-02-28 19:18:42 +08:00
i-robot a8686ae3d9
!18827 [assistant][ops]New operator implementation, include LFWDataset
Merge pull request !18827 from Wangsong95/lfw_dataset
2022-02-28 08:31:11 +00:00
zx 2132f62d98 [feat][assistant][I3J6VQ] add new data operator LFW 2022-02-28 13:43:05 +08:00
i-robot 330cacf905
!30573 Catch abnormals from sto functions in debug
Merge pull request !30573 from maning202007/master
2022-02-26 08:52:22 +00:00
i-robot 909183a2ef
!30317 extract common as an independent shared library
Merge pull request !30317 from zhoufeng/backend-compile-independently
2022-02-26 06:08:17 +00:00
i-robot 17accc12cf
!30238 [GraphKernel] replace nodes in lite and move const_input_to_attr pass.
Merge pull request !30238 from chenlei_autodiff/lite_callback
2022-02-26 03:56:57 +00:00
maning202007 9328041de4 Catch abnormals from sto functions in debug
Fix type errors

Fix bugs

Fix cycle depth
2022-02-26 11:03:52 +08:00
zhoufeng f49b195c39 extract common as an independent shared library
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2022-02-26 10:55:51 +08:00
shenwei41 ff75314719 upgrade ascend 20220211 2022-02-25 21:19:45 +08:00
chenlei_autodiff 9fabf8ae0d [GraphKernel] replace graph kernel node with custom in lite. 2022-02-25 17:09:24 +08:00
i-robot ac1463a192
!30298 Package the cuda operators as a dynamic link library
Merge pull request !30298 from jinjiali-kali/cuda_ops
2022-02-24 11:36:20 +00:00
i-robot eeb731ae3e
!18738 [assistant][ops]New operator implementation, include LSUNDataset
Merge pull request !18738 from Wangsong95/lsun_dataset
2022-02-23 02:28:40 +00:00
jinjiali b2d1bad62c package the cuda operations as a dynamic link library 2022-02-22 16:48:19 +08:00
yanghaoran 739c4b236a
回退 'Pull Request !30120 : Package the cuda operators as a dynamic link library' 2022-02-18 08:59:07 +00:00
zhixinaa 4ce6104ff9 [feat][assistant][I3J6V9] add new data operator LSUN 2022-02-18 15:40:32 +08:00
i-robot 8e21ffae65
!30120 Package the cuda operators as a dynamic link library
Merge pull request !30120 from jinjiali-kali/cuda_ops_3
2022-02-18 01:28:24 +00:00
jinjiali cd7db0f57f package the cuda operations as a dynamic link library 2022-02-17 16:51:45 +08:00
i-robot 7c32002e0b
!29930 Support List Slice
Merge pull request !29930 from lianliguang/support-list-slice
2022-02-17 07:24:40 +00:00
i-robot 2decc54375
!30016 Add distributed meta store module
Merge pull request !30016 from ZPaC/metadata-store-module
2022-02-17 02:13:30 +00:00
lianliguang 49608835c1 support list slice 2022-02-17 09:47:26 +08:00
i-robot c4c5a1c6da
!29862 MD Autotune supporting MindRecordOp
Merge pull request !29862 from Mohammad Motallebi/autotune_addworker_mindrecord
2022-02-16 23:34:11 +00:00
mohammad ddd3b07648 MD autotune supports mindrecord 2022-02-16 14:00:31 -05:00
ZPaC 191b65b236 Add distributed meta store module 2022-02-16 20:25:20 +08:00
i-robot 3b84ba1f1d
!29940 [GraphKernel] decouple convert_const_input_to_attr.
Merge pull request !29940 from chenlei_autodiff/gk_lite
2022-02-16 03:30:38 +00:00
i-robot e57633ec7f
!30027 Fix tensor with dynamic shape problem
Merge pull request !30027 from hewei/fix_core
2022-02-15 06:26:51 +00:00
chenlei_autodiff 5df9f01310 [GraphKernel] decouple convert_const_input_to_attr. 2022-02-15 10:27:34 +08:00
He Wei 36ab9c3d4b Fix tensor with dynamic shape problem
Set data size to zero for tensor with dynamic shape,
prevent unexpected memory allocation for tensor data.
2022-02-15 09:11:36 +08:00
He Wei 656b89a4da Add MakeValue related functions in MindAPI
1. NewValueNode() by PrimitivePtr;
2. MakeValue() by vector<bool>.
2022-02-14 15:08:43 +08:00
marui d47e79b04c Refactor ccsrc directories and CMakeLists files 2022-02-13 14:37:51 +08:00
He Wei 93328bc707 Fix a logging api bug in MindAPI 2022-02-11 08:42:04 +08:00
i-robot a42bc503f0
!29764 Add more required apis in MindAPI
Merge pull request !29764 from hewei/core_api
2022-02-10 07:55:37 +00:00
i-robot 7b6f7c9c87
!29786 Add TCP client and TCP server for RPC
Merge pull request !29786 from chengang/add_tcp_server
2022-02-10 07:47:12 +00:00
He Wei 21a9a0a73a Add more required apis in MindAPI
1. AbstractBase::set_shape();
2. Move shape() from AbstractTensor to AbstractBase;
3. AbstractSequence construct from AbstractBasePtrList;
4. Shape construct from ShapeVector.
2022-02-10 11:19:01 +08:00
cristoval c44d7b9100 add tcp client and tcp server 2022-02-10 09:50:40 +08:00
许志杰 ab9a32ad0d [feat] [assistant] [#I40GYE] add new loader SQuADDataset 2022-02-08 03:00:09 -08:00
zhoufeng b9b2f5bbfd delete core gvar
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2022-02-06 17:21:49 +08:00
i-robot e12d6af257
!29358 MD Child Sampler Code and UT Issues
Merge pull request !29358 from zetongzhao/sampler_AddChild
2022-01-31 16:55:22 +00:00
zetongzhao ea9783e18c fix sampler add_child 2022-01-31 07:45:42 -05:00
i-robot 48f4fd2f52
!29639 build core.so
Merge pull request !29639 from zhoufeng/dynamic-core
2022-01-30 02:00:21 +00:00
i-robot 02d63d7ad9
!23008 [assistant][ops][FilterWikipediaXML]
Merge pull request !23008 from Isaac/FilterWikipediaXML
2022-01-29 08:35:29 +00:00