Nigel
/
mindspore
forked from mindspore-Ecosystem/mindspore
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
45,876 Commits 24 Branches 0 Tags 3.9 GiB
Commit Graph

166 Commits

Author SHA1 Message Date
twc a5fcb08c00 code sync in federated learning 2021-12-02 14:41:56 +08:00
chenlei_autodiff 54227cae81 [GraphKernel] lite adapt for akg build. 2021-11-27 17:51:54 +08:00
zengzitao 62458b5636 adapt graph kernel for cpu 2021-11-26 18:42:34 +08:00
i-robot 310bbcebe1 !26539 [GraphKernel] support lite_adapter for graph kernel. 
Merge pull request !26539 from chenlei_autodiff/lite_callback
 2021-11-23 02:44:13 +00:00
chenlei_autodiff 4c0d5dcfe7 [GraphKernel] support lite_adapter for graph kernel. 2021-11-22 15:10:30 +08:00
kswang 7c312bd38c add mem offload strategy 2021-11-18 15:54:16 +08:00
ougongchang 9229f1c1ff profiler support to collect parallel strategy info 
If SetNodeOutputType functions forcibly splits into multiple functions, the readability decreases, so it blocks lizard scans
 2021-11-11 20:11:42 +08:00
LaiYongqiang 07e5ed9f16 ascend device context 2021-11-01 11:42:40 +08:00
lby 6872e67131 split compile ang gen kernel mod 2021-10-22 10:13:50 +08:00
kswang 6582744bf6 add utst for mem scheduler 2021-10-12 14:44:17 +08:00
LaiYongqiang 79599546ee add ascend memory adapter for ascend memory management 2021-10-08 11:01:48 +08:00
rescue a67275d857 read ms version from version.txt 2021-09-18 19:52:45 -04:00
i-robot 0fa3fa78fb !23709 Clean security and codex warning 
Merge pull request !23709 from yelihua/dev
 2021-09-18 13:27:39 +00:00
yelihua 83b3f6fef7 delete Common::GetRealPath 2021-09-18 11:11:07 +08:00
jiangshuqiang c2bd061889 fix summary isolation 2021-09-18 10:59:14 +08:00
yanghaitao1 177f3f75bf remove profiler if compiled with -s on 2021-09-14 05:29:18 -04:00
yanghaitao1 83302ad23c remove profiling parameters in set_context function 2021-09-10 04:35:35 -04:00
ms_yan 36a8886ca2 Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset" 
This reverts commit b077aa1cab.

Revert "[feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset"

This reverts commit 4e6f7dc97d.

delete pass_registry_test.cc

comment  hiai_nlu_model_multi.pb related  line
 2021-08-23 01:46:38 +08:00
djc b077aa1cab [feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset 2021-08-22 16:26:45 +08:00
djc 4e6f7dc97d [feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset 2021-08-22 13:39:37 +08:00
lby a5029f061c ascend kernel build refactory 2021-08-10 23:40:49 +08:00
hwjiaorui e498c96a20 tbe json creator UT 2021-08-02 18:51:33 +08:00
zhoufeng 2143241092 change neighbor exchange to all to all 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-08-01 18:21:28 +08:00
ZPaC dc068cb172 Add code for cross-silo with real data femnist and coco 2021-07-24 17:50:53 +08:00
dayschan 137608b518 Add LiteGraph for graphkernel 
Add a subdirectory "model" in the "backend/optimizer/graph_kernel" for litegraph.
Implement two interfaces "AnfGraph2LiteGraph" and "LiteGraph2AnfGraph".

The litegraph will be the base data structure when we migrate the GraphKernel code
from python("mindspore/_extends/graph_kernel") to c++.
 2021-07-21 10:21:11 +08:00
i-robot 3d022c9db8 !20246 Print ascend warning&error message using ErrorManager 
Merge pull request !20246 from tanghuikang/error_manager
 2021-07-16 06:49:31 +00:00
tanghuikang 21c4bf1f27 Print ascend warning and error message using ErrorManager 2021-07-15 11:52:25 +08:00
vector ee057e57ec update signal 2021-07-12 11:24:49 +08:00
i-robot 81dbc13611 !19563 Optimize armour directory 
Merge pull request !19563 from yyuse/fl_op_armour_dir
 2021-07-07 14:41:44 +00:00
i-robot 0e6c4071f5 !18987 use transdata to improve performance in print process 
Merge pull request !18987 from lvchangquan/transdata_formal
 2021-07-07 09:24:02 +00:00
yangyuan 818f608f13 Optimize armour directory 2021-07-07 11:50:16 +08:00
ZPaC 37ce5dd6a7 Optimize federated learning directory 2021-07-06 18:12:23 +08:00
lvchangquan 09c54c7923 use op transdata to improve performance in print process 2021-07-06 15:09:18 +08:00
ql_12345 5af0c890a1 cipher calling code 2021-07-01 00:23:06 +08:00
dingpeifei 63784e49f5 upgrade_ascend_0626_mindspore 2021-06-28 22:03:19 +08:00
chendongsheng bfaab72934 add node recovery 2021-06-17 23:52:09 +08:00
dingpeifei 171d09457f upgrade_ascend_0604 2021-06-07 23:06:58 +08:00
yangjie159 a6622a70ba enable refactor thread pool 2021-05-26 07:58:58 +08:00
zhoufeng 859b4e3ce3 add ge runtime depends 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-05-21 19:00:14 +08:00
zhoufeng 4306145684 fix ut comiple task pb not found 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-05-18 14:12:09 +08:00
zhoufeng ab5b36988e concat allgather pass performance optimization 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-05-17 17:40:34 +08:00
limingqi107 d8399e61e7 graph scheduler support multi graphs 2021-05-10 20:57:04 +08:00
mindspore-ci-bot 7a271987d6 !15269 use avx to optimize cpu op 
From: @wangyanling10
Reviewed-by: 
Signed-off-by:
 2021-05-08 09:40:10 +08:00
wangyanling ee1b803416 optimize cpu adam op 2021-05-07 10:47:57 +08:00
ZPaC 232e525ff2 Add common.h, local_meta_storage.h, param_name_type.h 
Add class Message, AddrStorage

Add Kernel folder

Add consistent hash ring

Add updater for server.

Add iteration timer

Add executor for server
 2021-04-30 15:31:09 +08:00
mindspore-ci-bot 966f89198a !15107 use internal ge runtime 
From: @zhoufeng54
Reviewed-by: 
Signed-off-by:
 2021-04-29 10:05:54 +08:00
mindspore-ci-bot 1e2e554db3 !15380 Unify minddata include files(except for datasets.h) in scenario of cloud and lite 
From: @luoyang42
Reviewed-by: @tiancixiao
Signed-off-by:
 2021-04-28 09:57:46 +08:00
chendongsheng 05d3ae2219 add http communicator 2021-04-27 19:44:57 +08:00
zhoufeng 3d38bcf791 use internal ge runtime 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-04-26 18:56:33 +08:00
YangLuo bf48400c10 unify include file of minddata 2021-04-22 10:59:36 +08:00
chendongsheng ce4d86171f support https 2021-04-06 15:37:59 +08:00
lvchangquan 0a7df321fe add op atomic clean to clear input addr in launch allreduce 2021-03-25 11:19:23 +08:00
yepei6 0cb6adce9e add ENABLE_GLIBCXX param 2021-03-22 20:40:01 +08:00
lvchangquan 31f9e6a42c add op_mul fusion based on allreduce fusion in pynative mode 2021-03-15 21:12:14 +08:00
caifubi 171b468bb3 PyNative AllReduce Bucket 2021-03-03 15:47:18 +08:00
chendongsheng db0a6f1e19 replace ps-lite 2021-03-02 11:19:11 +08:00
chendongsheng febbbf45c8 added server 2021-02-27 15:49:18 +08:00
mindspore-ci-bot 7c32bbe972 !12516 added worker 
From: @anancds
Reviewed-by: 
Signed-off-by:
 2021-02-27 14:22:39 +08:00
chendongsheng 6c22dc0d55 added worker 2021-02-26 21:10:16 +08:00
LianLiguang 2fa4997674 remove all of cpp infer reg 2021-02-26 15:19:26 +08:00
Zhenglong Li e2d3495925 Dvpp refactor and 6 Dvpp operators 2021-02-10 10:34:38 +08:00
He Wei 7d9a783993 [auto-monad] Support side-effects by auto-monad 
The basic idea is: exploits data dependency to control the execution order
of side-effect operations, and keep the semantics of ANF unchanged.

The ControlDepend primitive is removed and there are two primitives added:

1. UpdateState:
```
  a = Assign(para, value)
```
became:
```
  a = Assign(para, value, u)
  u = UpdateState(u, a)
```

2. Load:
```
  x = Add(para, value)
```
became:
```
  p = Load(para, u)
  x = Add(p, value)
  u = UpdateState(u, p)
```
 2021-02-08 09:01:15 +08:00
jinyaohui d9be0c102d add some ops 2021-02-03 19:47:53 +08:00
yanghaitao1 8d147deb07 profiler memory 2021-01-19 10:21:43 +08:00
mindspore-ci-bot ca3ac703c9 !10627 handler signal 
From: @zhupuxu
Reviewed-by: 
Signed-off-by:
 2020-12-29 15:47:30 +08:00
zhupuxu e36175b0dc handler signal 
Signed-off-by: zhupuxu <zhupuxu@huawei.com>
 2020-12-29 09:39:13 +08:00
LianLiguang cb909c7242 add ut for conv2d 2020-12-26 17:04:37 +08:00
yanghaoran b8345d03b6 Synchronize latest Ascend software 18 Dec 2020, with profiler fixes 2020-12-24 15:11:01 +08:00
xuyongfei c9b072b94d remove serving in mindspore repo 2020-12-10 18:50:30 +08:00
limingqi107 eca951c7bc add ps cache manager 2020-12-09 19:48:00 +08:00
limingqi107 a5f57ce8a0 add ps cache 2020-12-08 20:34:51 +08:00
kswang cbece74a23 add cpu adam delta 2020-11-06 13:52:54 +08:00
zhoufeng 183742009f mindspore cxx api for 310 inference 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2020-11-04 13:59:33 +08:00
anancds 28c9e9d9a5 Added http server based on libevent 2020-10-16 14:26:42 +08:00
ZPaC 0b49f0fb57 change PS dir 2020-09-18 10:48:09 +08:00
caifubi 372c2e7951 Combine Async Dump and E2E Dump 2020-09-14 10:57:46 +08:00
xulei2020 b356211413 add init code 2020-09-10 15:35:08 +08:00
dayschan 37a48f6aac GraphKernel supports GPU 
1. Update akg submodule
2. Refactor akg_kernel_build, akg_ascend_kernel_build, akg_gpu_kernel_build
3. Add akg_kernel_json_decoder to support converting kernel_json to AnfNode.
4. Add GraphKernel Cost Model. (mindspore/_extends/graph_kernel)
5. Add some GraphKernel passes to GpuSession, move these passes to backend/optimizer/graph_kernel.
6. Add global id for ir files.
7. Fix bug in ConstInputToAttr.
 2020-09-09 17:46:50 +08:00
lizhenyu c3d6918649 add kernel select after optimize pass 2020-09-04 10:52:51 +08:00
zhoufeng 6d500223b2 utest compiling performance optimization 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2020-09-03 16:57:19 +08:00
zhousiyi 301aeaaf1d remove gvar source file from compile as ut_tests will use gvar so 2020-09-03 06:49:30 +00:00
kswang 756bb6d53f async run graph 2020-08-28 18:18:47 +08:00
mindspore-ci-bot 2db4bda219 !4622 serving restful init 
Merge pull request !4622 from hexia/http_init
 2020-08-19 16:15:58 +08:00
hexia 75d116b5db serving http init 2020-08-18 20:15:47 +08:00
zhoufeng 663278112f optimize code compile performance 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2020-08-18 14:33:24 +08:00
huangdongrun 2a6d346d2f support if by if grad parameter 
add join for ref

adjust env eliminate to eliminate all env ops

add partial app cache

resolve while endless

fix env eliminate

support for "for while" cases

fix join shape error
 2020-08-15 09:47:10 +08:00
huanghui 8f70af7300 add unique_with_pad cpu kernel 2020-08-13 21:55:00 +08:00
huanghui fa081092c8 add Unique cpu kernel 2020-08-11 21:36:55 +08:00
mindspore-ci-bot c6acafcbc6 !4268 fix glog level dont work 
Merge pull request !4268 from liubuyu/master
 2020-08-11 20:05:03 +08:00
liubuyu 25a67602b7 bug fix for glog level don't work 2020-08-11 16:44:50 +08:00
WilliamLian 1f5441d73a remove inferfunction to core 2020-08-11 14:22:29 +08:00
liubuyu 195f04e50e compile the core directory into a separate static library 2020-08-08 21:31:41 +08:00
mindspore-ci-bot 98c415a1d5 !3807 serving support acl dvpp process 
Merge pull request !3807 from 徐永飞/master
 2020-08-05 11:00:21 +08:00
xuyongfei c0b8df4f7c serving add acl dvpp support, ut tests, return input status string message 2020-08-04 21:40:21 +08:00
Zhang Qinghua 960da5cbed Decouple the backend TBE from binding Python API. 2020-08-01 17:09:08 +08:00
nhussain b65125b0a1 add more ifdef and include statments for pybind 2020-07-27 13:51:11 -04:00
liubuyu f4bc0bc9fe move the dependency of utils to core 2020-07-27 10:28:46 +08:00
Zhang Qinghua 18efdc8fe2 Move abstract/base into core, and remove static_analysis including symbols in ir. 2020-07-15 14:04:38 +08:00
liubuyu 43c79eb853 mindspore path adjust 2020-07-14 18:07:28 +08:00
Zhang Qinghua 87715ed127 Refactoring for base and abstract types: Moving Base into base folder; Splitting the abstract type and infer&specialize routines; 2020-07-14 09:38:00 +08:00