Nigel
/
mindspore
forked from mindspore-Ecosystem/mindspore
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
56,551 Commits 24 Branches 0 Tags 3.9 GiB
Commit Graph

72 Commits

Author SHA1 Message Date
yao_yf 4a8329acb6 add parallel scatter ops 2022-11-02 14:16:58 +08:00
chujinjin 3711a83f76 change default mode to pynative 2022-10-13 19:48:38 +08:00
yangzhenzhang 115ef88b7c add ut for infer strategy 2022-08-15 15:09:11 +08:00
yangzhenzhang 03106d32ca infer strategy individual mode 2022-08-10 14:44:49 +08:00
yangzhenzhang aa2b4e42b4 add some functions for infer strategy 2022-08-08 14:09:13 +08:00
yangzhenzhang 3b7fc4db29 modify strategys to strategies 2022-07-08 10:48:05 +08:00
yangzhenzhang 85820c2952 create op info for pynative shard 2022-06-21 16:40:07 +08:00
yangzhenzhang e5b62b2714 modify gen strategy for matmul op 2022-06-09 19:50:31 +08:00
wangshengnan12@huawei.com 48065b72a1 adapt_control_flow 2022-05-19 15:50:29 +08:00
haoran.wang 3674e1d713 Add Mem & Redis coefficient for PanGu-alpha 2022-03-29 12:00:34 +00:00
zhoufeng b7bb53ff73 build libmindspore_backend.so 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2022-03-17 19:14:45 +08:00
yao_yf b60e54e0d5 support not only power of 2 2022-03-06 18:08:46 +08:00
zhoufeng f49b195c39 extract common as an independent shared library 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2022-02-26 10:55:51 +08:00
lilei 05189459ab auto insert VirtualDataset node for master 2021-12-06 21:39:37 +08:00
lichenever ae40fea111 add_CN_API 2021-12-03 14:12:43 +08:00
He Wei 41dcac9c49 Replace std::unordered_map/set with robin-hood-hashing 
Robin-hood-hashing (https://github.com/martinus/robin-hood-hashing)
is considered faster then std::unordered_map/set,
so we use it to improve mindspore performance.

1. robin_hood head file in `third_party/robin_hood/include`;
2. In `utils/hash_map.h` and `utils/hash_set.h`, we define:
 - mindspore::HashMap as an alias of robin_hood::unordered_map;
 - mindspore::HashSet as an alias of robin_hood::unordered_set;
3. Replace:
 - `#include <unordered_map>` --> `#include "utils/hash_map.h"`;
 - `#include <unordered_set>` --> `#include "utils/hash_set.h"`;
 - `std::unordered_map` --> `mindspore::HashMap`;
 - `std::unordered_set` --> `mindspore::HashSet`;
 - `map.insert(std::pair(key, value))` --> `map.emplace(key, value)`;
 - `[] (const std::pair<K, V> &p) {..} ` --> `[] (const auto &p) {..} `;
4. Fix issues found by switch to robin_hood:
 - AnfNodeConfig hash and equal;
 - Fix a bug in `Slice::operator==()`;
 - Fix a bug in `CNode::HasPrimalAttr()`;
 - Fix map.erase() usage bugs: `map.erase(iter++)` --> `iter = map.erase(iter)`;
 - Fix some iterator invalidated problem;
5. Some std::unordered_map/set can not replace by robin_hood:
 - As parameter of functions that exposed to python by pybind11;
 - Use bad hash that cause robin_hood::map over_flow, such as AbstractBasePtrListHasher;
6. Update cpp unit tests;
7. Add build option '-F' to enable robin_hood, default on.
 2021-11-24 10:47:40 +08:00
yangzhenzhang 8431ba616c add output strategy for op init 2021-11-10 15:35:45 +08:00
yangzhenzhang 6ad6304b77 add output strategy 2021-11-04 16:28:54 +08:00
huanghui ba66c0d491 add security isolate for save_graphs 2021-09-14 10:24:12 +08:00
Zhang Qinghua 7203989c26 Support fallback feature in Graph mode (1). 2021-09-06 16:00:03 +08:00
lichenever 56b31fce42 add_no_elimilate_for_comm_op 2021-09-03 16:54:56 +08:00
Xiaoda Zhang ae2d3b4832 adjust the device matrix for onehot use in moe 2021-08-25 14:36:06 +08:00
yao_yf dc7dc7d3fa dataset strategy set 2021-07-27 18:44:10 +08:00
lichenever 108967ff7d fix_pipeline_split_bug 2021-07-06 22:51:04 +08:00
chenfei 4f50b3dfe1 add parameter eliminate pass 2021-06-04 11:53:34 +08:00
yangzhenzhang d711d98f07 clean duplicate code 2021-05-25 17:25:34 +08:00
Ziyan 2a0a549ae8 fix codex in tensor_layout.cc 2021-05-20 10:10:20 +08:00
Xiaoda Zhang 5fecfe92a6 code style warnings fixing 2021-04-27 19:54:56 +08:00
l00591931 cf7c5840e3 Change return 2021-03-04 09:38:43 +08:00
jinyaohui 30a27b2adb modify Gelu、FastGelu to GeLU and FastGeLU 2021-02-05 17:19:52 +08:00
mindspore-ci-bot ad5b033cc5 Change L2Norm, r1.1 to master 2021-02-05 09:42:43 +08:00
l00591931 9ec100d069 Change TensorAdd to Add, from r1.1 to master 2021-02-01 17:53:52 +08:00
yangzhenzhang 38ea8784c6 update infer mirror ops 2021-01-15 14:53:21 +08:00
Xiaoda Zhang 3c27c08b46 change memory cost calculation in auto-parallel 2020-12-28 14:38:30 +08:00
yangzhenzhang 0c2c76d037 update get rank in parallel ops 2020-11-13 16:43:44 +08:00
yangzhenzhang 41d925b68a set stage id 2020-11-12 11:14:31 +08:00
Yi Huaijie d7faa77b5e support int64 shape 2020-11-05 21:15:49 +08:00
mindspore-ci-bot 8bfe141680 !7571 fix bug in reshape strategy search when reshape as the first operator 
Merge pull request !7571 from yao_yf/reshape_strategy_search_fix_when_reshape_is_first_op
 2020-10-22 10:16:33 +08:00
yao_yf f7189adb91 fix bug in reshape strategy search when reshape is first operator 2020-10-22 09:15:18 +08:00
yangzhenzhang eb6f4e3ce8 update repeated calculation 2020-10-21 16:13:58 +08:00
yangzhenzhang fc4ed975c4 handle repeated calculation 2020-10-19 10:47:01 +08:00
huanghui b7519b7418 unify save_graphs_path 2020-10-15 10:15:16 +08:00
Ziyan ddc0113058 enable parallel optimizer in auto parallel 2020-10-08 14:51:15 +08:00
huangxinjing 4ef439e27b Add stage information for ops and strategy 2020-09-25 10:42:43 +08:00
zhousiyi c25e37e7bf make backend/optimizer pybind free 2020-08-28 08:56:58 +00:00
Yi Huaijie 80bdcab982 temporarily cast between int64 and int32 to wait ME support int64 2020-08-04 12:21:06 +08:00
Yi Huaijie 518cb80133 change type of Shape from int32 to int64 2020-08-04 11:30:23 +08:00
suteng 19e45ccdb1 回退 'Pull Request !3103 : change type of Shape from int32 to int64' 2020-08-03 22:06:37 +08:00
Yi Huaijie 15d5cc396d change type of Shape from int32 to int64 2020-08-03 16:47:19 +08:00
He Wei 4eb81d7934 Rename AnfNode::user_data related functions to follow naming rule 2020-07-28 15:35:48 +08:00