Commit Graph

47 Commits

Author SHA1 Message Date
taipingchangan ad44ec72e8 gpu minddata 0921 2022-09-21 19:34:04 +08:00
zhoufeng e0c7fa6136 refactor data queue
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2022-08-19 13:46:23 +08:00
lby 6e86fa29ff backend 2022-06-08 19:51:29 +08:00
lby bcf1dfe963 compile macro 2022-05-30 13:50:09 +08:00
chujinjin 818c542e56 delete useless backendpolicy 2022-01-28 15:41:35 +08:00
i-robot 3a4744ff27
!28995 unify infer and train compile binary
Merge pull request !28995 from xiaoyao/master
2022-01-17 04:43:56 +00:00
fangzehua 66d11d44ab fix random 2022-01-14 17:12:38 +08:00
xiao_yao1994 54fc038f0a unify infer and train compile binary 2022-01-13 17:04:34 +08:00
fangzehua ac11ceeee4 change omp to ms threadpool 2022-01-11 16:10:11 +08:00
xiao_yao1994 0843910260 unify ge and vm backend 2022-01-11 11:53:58 +08:00
zengzitao 6f4aebbe11 adapt ms_cpu ci for graphkernel 2021-12-09 19:44:09 +08:00
xulei 78b37afc30 fix mindspore mac compile
fix debugger, mindarmour, audio, gnn, grpc, ps/fl.
2021-11-29 09:29:02 +08:00
He Wei 41dcac9c49 Replace std::unordered_map/set with robin-hood-hashing
Robin-hood-hashing (https://github.com/martinus/robin-hood-hashing)
is considered faster then std::unordered_map/set,
so we use it to improve mindspore performance.

1. robin_hood head file in `third_party/robin_hood/include`;
2. In `utils/hash_map.h` and `utils/hash_set.h`, we define:
 - mindspore::HashMap as an alias of robin_hood::unordered_map;
 - mindspore::HashSet as an alias of robin_hood::unordered_set;
3. Replace:
 - `#include <unordered_map>` --> `#include "utils/hash_map.h"`;
 - `#include <unordered_set>` --> `#include "utils/hash_set.h"`;
 - `std::unordered_map` --> `mindspore::HashMap`;
 - `std::unordered_set` --> `mindspore::HashSet`;
 - `map.insert(std::pair(key, value))` --> `map.emplace(key, value)`;
 - `[] (const std::pair<K, V> &p) {..} ` --> `[] (const auto &p) {..} `;
4. Fix issues found by switch to robin_hood:
 - AnfNodeConfig hash and equal;
 - Fix a bug in `Slice::operator==()`;
 - Fix a bug in `CNode::HasPrimalAttr()`;
 - Fix map.erase() usage bugs: `map.erase(iter++)` --> `iter = map.erase(iter)`;
 - Fix some iterator invalidated problem;
5. Some std::unordered_map/set can not replace by robin_hood:
 - As parameter of functions that exposed to python by pybind11;
 - Use bad hash that cause robin_hood::map over_flow, such as AbstractBasePtrListHasher;
6. Update cpp unit tests;
7. Add build option '-F' to enable robin_hood, default on.
2021-11-24 10:47:40 +08:00
xiefangqi 24ac2382ff mac compile 2021-11-18 14:20:08 +08:00
yanghaoran 17ce1f5004 add nightly/weekly dev version number 2021-11-06 16:56:44 +08:00
dayschan 32ecd8ee79 GraphKernel supports CPU
only Linux system is supported now.

change the default value of `ENABLE_AKG` to off, and controlled by option `-K`.
the `ENABLE_AKG` is auto enabled when `ENABLE_GPU` or `ENABLE_D` is on.
since now, we can use `ENABLE_AKG` to control the compilation of graphkernel
and akg codes.

fix usage description for option "-K", it should be "[-K on|off]".

LLVM is required by akg for cpu kernels, so AKG for cpu is default disabled now.
2021-09-29 23:34:16 +08:00
djc b077aa1cab [feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset 2021-08-22 16:26:45 +08:00
djc 4e6f7dc97d [feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset 2021-08-22 13:39:37 +08:00
dingpeifei 02878c2378 release debug master 0730 2021-08-05 19:08:30 +08:00
buxue 733f765063 add security compilation options 2021-07-20 22:02:32 +08:00
yangyuan 1495ef8bf6 fix bugs of secure aggregation with albert execution failed 2021-07-14 22:31:10 +08:00
LaiYongqiang d4d6fb940d memory reuse code clean 2021-06-18 09:41:55 +08:00
yanghaoran 8b4ff8708f ascend 310/910 joint compile, and ascend 310 pacakge lose weight 2021-05-28 12:11:20 +08:00
wangshuide2020 b3b8e49e53 fix the ge compilation problem. 2021-04-06 15:18:14 +08:00
yepei6 0cb6adce9e add ENABLE_GLIBCXX param 2021-03-22 20:40:01 +08:00
buxue 30891f34cc modify scripts to support run ut with ASan 2021-03-17 21:25:06 +08:00
LianLiguang 4ea89fd18e fix bug of compile asan ut 2021-02-18 10:43:58 +08:00
xsmq 73b7154e55 fix cmakelint error 2021-01-23 21:04:29 +08:00
zhoufeng a5b2b08035 cpp st fwk and script
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2021-01-07 17:58:38 +08:00
xuyongfei c9b072b94d remove serving in mindspore repo 2020-12-10 18:50:30 +08:00
zhoufeng 183742009f mindspore cxx api for 310 inference
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2020-11-04 13:59:33 +08:00
laiyongqiang 5452e711b5 [MemOpt]Safe Optimized Memory Allocation Solver 2020-10-31 11:51:30 +08:00
caifubi 372c2e7951 Combine Async Dump and E2E Dump 2020-09-14 10:57:46 +08:00
yanghaoran 0bd4c218d4 cmake check if required packages exist 2020-09-11 15:07:17 +08:00
zhoufeng f62067ef83 fix utest asan
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2020-08-28 14:12:46 +08:00
ZPaC 8ff1a9ab47 Use white list to control pslite compilation 2020-07-21 20:29:22 +08:00
mindspore-ci-bot 7233d650f0 !3063 Enable to train in parameter server mode
Merge pull request !3063 from ZPaC/add-ps-training-mode
2020-07-16 22:25:44 +08:00
ZPaC 52022c8013 Enable to train in parameter server mode 2020-07-16 21:39:48 +08:00
caifubi cb8b5dbd76 Remove build option -S 2020-07-16 14:51:48 +08:00
caifubi c577952c9a Async Data Dump 2020-07-13 09:42:37 +08:00
ervinzhang bd5a777f81 introducing new C++ API 2020-07-10 16:32:38 -04:00
ZPaC a057639abc Add pslite dependency 2020-07-01 16:26:24 +08:00
Shida He 4c056855e0 Implementation for mindspore debugger 2020-06-22 17:15:30 -04:00
lianliguang 00e4306518 convert all tuple output to maketuple 2020-04-17 17:31:42 +08:00
chenjianping b6493af6b7 fix gpu init fail 2020-04-15 14:18:50 +00:00
chenjianping 1286767d0e support building on windows 2020-04-15 09:36:48 +00:00
zhunaipan 930a1fb0a8 initial version
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
2020-03-27 22:54:54 +08:00