yystopf
/
mindspore
forked from mindspore-Ecosystem/mindspore
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
45,876 Commits 23 Branches 0 Tags 3.9 GiB
Commit Graph

2085 Commits

Author SHA1 Message Date
twc a5fcb08c00 code sync in federated learning 2021-12-02 14:41:56 +08:00
liyong d35e003def fix mindrecord log part02 2021-12-02 11:28:58 +08:00
luqilin 34bffbf768 [feat][assistant][I3T96H] add new dataset loading operator TedliumDataset 2021-12-02 09:53:39 +08:00
zy 8f9a09f79c [fix] [assistant] [I3ZSQR] add new data operator GloVe 2021-12-01 17:12:20 +08:00
hesham 828120b784 Fix intermittent failure in callback_test.cc 2021-11-30 22:36:55 -05:00
zy 5ca98a494a [fix] [assistant] [I3ZSQS] add new data operator FastText 2021-12-01 11:12:08 +08:00
“uccInf” 92d6d31750 [feat][assistant][I3J6V7] add new data operator KMnist 2021-12-01 03:05:05 +00:00
i-robot eb9537af11 !21690 [assistant][ops] Add data operator Vectors 
Merge pull request !21690 from 张渝/Vectors
 2021-12-01 01:29:45 +00:00
i-robot 2fd00935ed !20964 [assistant][ops] Add new data operator SpeechCommandsDataset 
Merge pull request !20964 from 杨旭华/SpeechCommandsDataset
 2021-11-30 09:33:03 +00:00
zhangyuqwer 6a6e73ef82 [fix] [assistant] [I3ZSQM] add new data operator Vectors 2021-11-30 14:39:42 +08:00
i-robot f513e0bfdd !26743 [GraphKernel] lite adapt for akg build. 
Merge pull request !26743 from chenlei_autodiff/lite_callback
 2021-11-30 03:38:38 +00:00
i-robot b9d56b9cce !26914 fix some error report and remove some useless code 
Merge pull request !26914 from lianliguang/master
 2021-11-29 12:34:41 +00:00
i-robot 16fa10fd38 !26875 add ut for debug info 
Merge pull request !26875 from huanghui/add-ut
 2021-11-29 03:55:52 +00:00
lianliguang 0dc5d7f4f9 modify some eroor log and remove some useless code 2021-11-29 10:23:03 +08:00
chenlei_autodiff 54227cae81 [GraphKernel] lite adapt for akg build. 2021-11-27 17:51:54 +08:00
huanghui 67a6beb1b1 add ut for debug info 2021-11-27 17:29:45 +08:00
i-robot 2bd6deaeeb !26682 GraphKernel For CPU 
Merge pull request !26682 from ZengZitao/gk_cpu
 2021-11-27 06:23:01 +00:00
vddong 91d3a7543f [feat][assistant][I3T96F] add new data operator SpeechCommands 2021-11-27 11:25:18 +08:00
i-robot 4252b24335 !26792 malloc ts memory for label 
Merge pull request !26792 from zhoufeng/change-label-memory-type
 2021-11-27 01:09:03 +00:00
zengzitao 62458b5636 adapt graph kernel for cpu 2021-11-26 18:42:34 +08:00
i-robot 04132e0c50 !26766 fix error log and move some function to inner 
Merge pull request !26766 from lianliguang/master
 2021-11-26 06:09:42 +00:00
lianliguang 5864d6a006 modify some eroor log 2021-11-26 09:24:19 +08:00
zhoufeng 881179fa10 malloc ts memory for label 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-11-26 09:17:02 +08:00
i-robot 3520f1427d !26701 MD C++ UT: Remove old tests part 3 
Merge pull request !26701 from hetshah/hs_remove_old_tests
 2021-11-25 19:29:30 +00:00
hetshah 098ca49dd3 remove instances of datasetiterator from old tests and move coverage to new method 2021-11-25 15:22:34 +00:00
i-robot 3d0f9d8aae !26683 Enable compile cache feature to load hyper parameter data from python 
Merge pull request !26683 from LiangZhibo/mindir
 2021-11-25 03:25:27 +00:00
hesham cf3ff77cfd AutoTune support non-sink mode 
Add time sts to iterator tracing
 2021-11-24 17:51:25 -05:00
i-robot d251800c62 !26705 Add the check of function return None. 
Merge pull request !26705 from Margaret_wangrui/return_none
 2021-11-24 11:09:27 +00:00
i-robot cfc6ea32ff !24714 replace rtmemcpyxx to acl memcpy 
Merge pull request !24714 from jjfeing/br_replace_rtmemcpyxx_with_acl_api
 2021-11-24 07:47:43 +00:00
Margaret_wangrui f9a384456a Add the check of function return None. 2021-11-24 15:30:35 +08:00
l00591931 21df240f23 Enable mindir to load initialize weight from python 2021-11-24 11:33:43 +08:00
He Wei 41dcac9c49 Replace std::unordered_map/set with robin-hood-hashing 
Robin-hood-hashing (https://github.com/martinus/robin-hood-hashing)
is considered faster then std::unordered_map/set,
so we use it to improve mindspore performance.

1. robin_hood head file in `third_party/robin_hood/include`;
2. In `utils/hash_map.h` and `utils/hash_set.h`, we define:
 - mindspore::HashMap as an alias of robin_hood::unordered_map;
 - mindspore::HashSet as an alias of robin_hood::unordered_set;
3. Replace:
 - `#include <unordered_map>` --> `#include "utils/hash_map.h"`;
 - `#include <unordered_set>` --> `#include "utils/hash_set.h"`;
 - `std::unordered_map` --> `mindspore::HashMap`;
 - `std::unordered_set` --> `mindspore::HashSet`;
 - `map.insert(std::pair(key, value))` --> `map.emplace(key, value)`;
 - `[] (const std::pair<K, V> &p) {..} ` --> `[] (const auto &p) {..} `;
4. Fix issues found by switch to robin_hood:
 - AnfNodeConfig hash and equal;
 - Fix a bug in `Slice::operator==()`;
 - Fix a bug in `CNode::HasPrimalAttr()`;
 - Fix map.erase() usage bugs: `map.erase(iter++)` --> `iter = map.erase(iter)`;
 - Fix some iterator invalidated problem;
5. Some std::unordered_map/set can not replace by robin_hood:
 - As parameter of functions that exposed to python by pybind11;
 - Use bad hash that cause robin_hood::map over_flow, such as AbstractBasePtrListHasher;
6. Update cpp unit tests;
7. Add build option '-F' to enable robin_hood, default on.
 2021-11-24 10:47:40 +08:00
i-robot 310bbcebe1 !26539 [GraphKernel] support lite_adapter for graph kernel. 
Merge pull request !26539 from chenlei_autodiff/lite_callback
 2021-11-23 02:44:13 +00:00
jjfeing 05485d991c replace api with acl api 2021-11-23 09:06:28 +08:00
chenlei_autodiff 4c0d5dcfe7 [GraphKernel] support lite_adapter for graph kernel. 2021-11-22 15:10:30 +08:00
i-robot 70363899e7 !24080 [assistant][ops] Add new audio operator ComputeDeltas 
Merge pull request !24080 from Rainfor/compute_detlas
 2021-11-19 12:29:49 +00:00
i-robot c6821bde0a !21648 [assistant][ops] Add new data loading operator YesNoDataset 
Merge pull request !21648 from 杨旭华/YesNoDataset
 2021-11-19 09:05:07 +00:00
vddong f465cd0242 [feat][assistant][I3T96L]add new dataset operator YesNo 2021-11-19 13:36:24 +08:00
i-robot 55463892e4 !26402 add mem offload strategy 
Merge pull request !26402 from kisnwang/add-mem-offload-strategy
 2021-11-19 03:42:52 +00:00
i-robot 3c39afad11 !24547 [MS][crowdfunding]New operator implementation, AutoAugment 
Merge pull request !24547 from yangwm/autoaugment
 2021-11-19 01:00:51 +00:00
i-robot ce00ee1ad1 !25367 use acl api to control profiling 
Merge pull request !25367 from yanghaitao/yht_condation_start_profiler
 2021-11-18 12:36:14 +00:00
zhuchuang 4c3931f5c9 [feat] [assistant] [I3CKEE] add new audio operator ComputeDeltas 2021-11-18 17:18:43 +08:00
i-robot 9d6248194e !26310 MindSpore support load custom aicpu kernels. 
Merge pull request !26310 from linqingke/aicpu
 2021-11-18 08:09:26 +00:00
kswang 7c312bd38c add mem offload strategy 2021-11-18 15:54:16 +08:00
despicablemme 09897ce7ec [feat] [assistant] [I40GZP] add new data op AutoAugment 2021-11-18 11:38:18 +08:00
yanghaitao1 c94aa6b872 use profiler acl api instead 2021-11-17 09:33:31 -05:00
linqingke bef2923acf MindSpore support load custom aicpu ops. 2021-11-17 14:58:50 +08:00
wangkc123 706f9e2cbb [feat] [assistant] [I3CKEH] add new audio operator SlidingWindowCmn 2021-11-16 22:00:09 +08:00
i-robot 58b69a05ee !20576 [assistant][ops] add new dataset loading operator LJSpeechDataset 
Merge pull request !20576 from 杨旭华/LJSpeechDataset
 2021-11-16 07:00:20 +00:00
i-robot 6bdd38399a !25811 fault_recover_by_mirror_group 
Merge pull request !25811 from yao_yf/fault_recover_by_mirror_group
 2021-11-16 02:20:58 +00:00
mohammad 5c8ab5f60c add MD Profiler Save() 2021-11-15 13:18:36 -05:00
vddong 6fe2d35ae2 [feat][assistant][I3T96D] add new dataset loading operator LJSpeechDataset 2021-11-14 14:52:15 +08:00
yao_yf 501b978d16 find data parallel common group in auto parallel 2021-11-13 10:23:45 +08:00
i-robot 04da5c2808 !26140 Add callback support to BatchOp Datasets to enable Add/Remove workers 
Merge pull request !26140 from h.farahat/cb_batch
 2021-11-12 17:23:19 +00:00
i-robot e154dca4b1 !22193 [assistant][ops] Add new loader operator DBpedia 
Merge pull request !22193 from 杨旭华/DBpedia
 2021-11-12 09:02:28 +00:00
i-robot 0f07408425 !26034 F.grad support sens_param and fix graph_mode bug 
Merge pull request !26034 from zhang_sss/grad
 2021-11-12 06:38:15 +00:00
i-robot 6c587dc2d3 !25391 Support to profiling parallel strategy 
Merge pull request !25391 from ougongchang/profiling_stategy
 2021-11-12 06:07:30 +00:00
Carry955 0d26c38693 [feat][assistant][I40GXT] add new loader DBpedia 2021-11-11 19:02:22 -08:00
i-robot 7a73bae5c3 !26036 add output strategy for matmul operator 
Merge pull request !26036 from yangzhenzhang/add-output-strategy-for-op-init
 2021-11-12 01:22:22 +00:00
hesham 2662b6d5c3 Add callback to Batch op 2021-11-11 10:58:01 -05:00
zhang__sss 0dd68aa7eb grad 2021-11-11 23:18:35 +08:00
ougongchang 9229f1c1ff profiler support to collect parallel strategy info 
If SetNodeOutputType functions forcibly splits into multiple functions, the readability decreases, so it blocks lizard scans
 2021-11-11 20:11:42 +08:00
i-robot b910870ecc !19986 [assistant][ops] Add new dataset loading operator AGNEWS 
Merge pull request !19986 from 杨旭华/AGNEWS
 2021-11-11 06:22:25 +00:00
zetongzhao 2de8142c44 profiler test 2021-11-10 11:55:19 -05:00
Megalomania c34bbabed9 [feat] [assistant] [I3T96M] add new loader AGNEWS 2021-11-09 23:51:19 -08:00
yangzhenzhang 8431ba616c add output strategy for op init 2021-11-10 15:35:45 +08:00
i-robot 8bf7e28fa6 !25410 add dump flag for fusion nodes 
Merge pull request !25410 from yuchaojie/ir_fusion3
 2021-11-10 02:25:08 +00:00
i-robot d4c8dde6d2 !25923 Move IsRealKernel and IsRealCNodeKernel from AnfAlgo to AnfUtils 
Merge pull request !25923 from DeshiChen/1101_anfalgo
 2021-11-10 01:56:07 +00:00
i-robot 2e174427c9 !25963 [MD][Autotune] Add WaitFor 
Merge pull request !25963 from harshvardhangupta/hesh_tree_mod
 2021-11-09 22:43:00 +00:00
i-robot b7244ac987 !25852 MD C++ UT: Remove old tests part 2 
Merge pull request !25852 from hetshah/hs_remove_old_tests
 2021-11-09 22:07:59 +00:00
hetshah 5c703015e4 remove old tests and move coverage 2021-11-09 21:27:37 +00:00
i-robot 61b53fee3a !25980 Add callback support to Mappable Datasets to enable Add/Remove workers 
Merge pull request !25980 from h.farahat/cb_mappable
 2021-11-09 20:05:01 +00:00
hesham 17e338e909 Add WaitFor 2021-11-09 10:19:48 -05:00
dayschan cbb84ff580 Move IsRealKernel and IsRealCNodeKernel from AnfAlgo to AnfUtils 
the function IsOneOfPrimitive and IsOneOfPrimitiveCNode is useful,
we can move them into anf.cc
 2021-11-09 14:34:21 +08:00
yuchaojie 0c90aecae4 add dump flag for fusion nodes 2021-11-09 10:48:17 +08:00
hesham 040398a660 Add callback to Mappable ops 
Update mindspore/ccsrc/minddata/dataset/engine/datasetops/source/mappable_leaf_op.cc
 2021-11-08 20:17:34 -05:00
zhang__sss 8bae4d9d50 grad 2021-11-08 14:12:58 +08:00
i-robot 7c14f984ed !25793 add output strategy for shard 
Merge pull request !25793 from yangzhenzhang/add-output-strategy
 2021-11-05 01:19:01 +00:00
i-robot 92b81d3221 !23257 [assistant][ops][DBToAmplitudeOp] 
Merge pull request !23257 from 杨旭华/DBToAmplitude
 2021-11-04 10:32:32 +00:00
yangzhenzhang 6ad6304b77 add output strategy 2021-11-04 16:28:54 +08:00
i-robot 1a2a462c8f !25786 fix resnet pynative performance 
Merge pull request !25786 from baihuawei/fixpynativeperformance
 2021-11-03 08:58:09 +00:00
liucunwei a86ac516fc add some of ut about dataset IteratorOneColumn 2021-11-03 12:02:00 +08:00
baihuawei e59d07899b fix reset8p pynative performance 2021-11-03 09:13:19 +08:00
Isaac 69f57bc5b1 [feat][assistant][I40GXD]add new data operator DBToAmplitude 2021-11-02 23:45:27 +08:00
i-robot 2224f75b47 !25696 add pass switch 
Merge pull request !25696 from zhoufeng/pass-switch
 2021-11-02 01:33:15 +00:00
i-robot 1edd91c974 !25329 MD C++ UT: Remove old tests part 1 
Merge pull request !25329 from hetshah/hs_remove_old_tests
 2021-11-01 19:35:58 +00:00
i-robot eff2318bb6 !25524 [Autotune] Add TreeModifier and Remove Worker logic 
Merge pull request !25524 from h.farahat/tree_modifier
 2021-11-01 13:35:04 +00:00
i-robot 30870cc133 !25443 [MD] mindrecord support overwriting 
Merge pull request !25443 from liyong126/add_mindrecord_overwrite
 2021-11-01 13:20:48 +00:00
zhoufeng fb17c448c2 add pass switch 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-11-01 16:33:02 +08:00
LaiYongqiang 07e5ed9f16 ascend device context 2021-11-01 11:42:40 +08:00
liyong 41e8280f55 add mindrecord overwrite 2021-11-01 10:44:20 +08:00
hesham 62d9004d1e TreeModifier and Remove worker 2021-10-29 17:11:19 -04:00
i-robot 036bc4329f !25447 Check Device Shape 
Merge pull request !25447 from hwjiaorui/check-support-json
 2021-10-28 12:38:06 +00:00
liucunwei f2813b909e add some of ut cases about createIterator columns 2021-10-28 18:57:02 +08:00
i-robot 9e1370515a !25451 Make MD ProfilingManager a singleton class 
Merge pull request !25451 from h.farahat/profiling_manager_singlton
 2021-10-27 20:54:13 +00:00
hesham 843357a6d8 Make ProfilingManager a singleton 2021-10-27 11:37:02 -04:00
i-robot 0d93793e80 !25463 log improvement 
Merge pull request !25463 from laiyongqiang/step_log
 2021-10-27 07:17:27 +00:00
LaiYongqiang dc7988f4bd log improvement 2021-10-27 12:36:47 +08:00
hwjiaorui 5f494aa61b check transfrom device shape 2021-10-27 09:12:41 +08:00
i-robot 74977e548d !24624 [Autotune] Modify MD callback and AddWorker logic to ParallelOps 
Merge pull request !24624 from h.farahat/add_worker
 2021-10-27 00:41:20 +00:00
hetshah 1be909c28e removed old tests and moved additonal coverage to new test files 2021-10-26 20:43:49 +00:00
i-robot 5a49db7a36 !25212 Reduce size of queue and test 
Merge pull request !25212 from zetongzhao/resize_smaller
 2021-10-26 19:36:00 +00:00
zetongzhao 9dad5f1f46 resize to a smaller size 2021-10-25 16:03:57 -04:00
i-robot 9acbf3eb7a !25282 1、Optimize the error message in operator 2、add operator test cases 
Merge pull request !25282 from Margaret_wangrui/operator_cases
 2021-10-25 01:22:42 +00:00
i-robot cb307e24cf !25153 refactor device loop control 
Merge pull request !25153 from laiyongqiang/adjust_kernel_refactory
 2021-10-23 07:42:49 +00:00
i-robot 6f413ee29d !25155 Support ops, nn and numpy namespaces, and add test case. 
Merge pull request !25155 from 张清华/opt_fallback
 2021-10-23 03:50:53 +00:00
Margaret_wangrui 7b93e4e87c 1、Optimize the error message in operator 2、add operator test cases 2021-10-23 10:16:59 +08:00
LaiYongqiang 9bfb2d99fa refactor device loop control 2021-10-22 20:42:38 +08:00
i-robot e05a4393ef !24611 split compile and generate kernel mod 
Merge pull request !24611 from liubuyu/bug_fix2
 2021-10-22 09:02:55 +00:00
Zhang Qinghua 6a79e262ae Support ops, nn and numpy namespaces, and add test case. 2021-10-22 16:31:30 +08:00
lby 6872e67131 split compile ang gen kernel mod 2021-10-22 10:13:50 +08:00
i-robot 782874bf18 !21215 [MS][crowdfunding]New operator implementation, include phaser 
Merge pull request !21215 from Wangsong95/phaser
 2021-10-22 01:08:50 +00:00
hesham 85e077b60b Callback changes 
AddWorker logic to parallel ops
 2021-10-21 17:35:11 -04:00
i-robot 5d8be044c9 !18018 [assistant][ops]New operator implementation, include FashionMnistDataset 
Merge pull request !18018 from 张璇/fashionmnist_dataset
 2021-10-20 06:42:54 +00:00
i-robot f9bd640b09 !16269 [assistant][RandomLighting] 
Merge pull request !16269 from QingfengLi/randomlighting
 2021-10-20 06:42:12 +00:00
“uccInf” fe3123cfe8 [feat][assistant][I3J6V4] add new data operator FashionMnist 2021-10-20 02:37:56 +00:00
i-robot 440036d331 !24362 [assistant][ops]New operator implementation, include PhotoTourDataset 
Merge pull request !24362 from Wangsong95/phototour_dataset
 2021-10-20 01:46:05 +00:00
i-robot 4ea7849908 !24575 Resize operator connector queue 
Merge pull request !24575 from zetongzhao/master
 2021-10-19 20:36:43 +00:00
zetongzhao 10fdbd6c03 resize queue and test 2021-10-19 11:43:53 -04:00
yangyueren 6594b90a58 [feat][assistant][I3J6VE] add new data operator PhotoTour 2021-10-19 15:31:32 +00:00
chenx2ovo 77caf907c4 [feat][assistant][I3CEGR] add op random lighting 2021-10-19 20:38:01 +08:00
i-robot 690642d672 !18664 [assistant][ops]New operator implementation, include Places365Dataset 
Merge pull request !18664 from Wangsong95/places365_dataset
 2021-10-19 07:06:35 +00:00
i-robot 1606f19dfb !18265 [assistant][ops] Add new audio operator CreateDct 
Merge pull request !18265 from 杨旭华/CreateDct
 2021-10-19 06:30:18 +00:00
tophand 4f4777f0da [feat][assistant][I3J6U2] Add new audio operator CreateDct 2021-10-18 03:23:18 -07:00
zx d13d2413f5 [feat][assistant][I3J6UV] add new audio operator Phaser 2021-10-16 08:45:12 +08:00
yangyueren 951193c308 [feat][assistant][I3J6VF] add new data operator Places365 2021-10-15 14:56:09 +00:00
robert_luo_yibo 75e2c3041c [feat][assistant][I3CEG3] add new data OP MuLawEncoding 2021-10-14 20:24:18 +08:00
i-robot 1b9b85bbb2 !17851 [assistant][ops]New operator implementation, include FakeImageDataset 
Merge pull request !17851 from 张璇/fakeimage_dataset
 2021-10-13 09:22:55 +00:00
i-robot 0ba7872f76 !24620 add utst for mem scheduler 
Merge pull request !24620 from kisnwang/add-utst-for-mem-scheduler
 2021-10-13 08:34:46 +00:00
i-robot 18e632c7a1 !21216 [MS][crowdfunding]New operator implementation, include Overdirve 
Merge pull request !21216 from Wangsong95/overdrive
 2021-10-13 01:08:36 +00:00
G-Dragon-Liu d2f22a8726 [feat][assistant][I3J6V3] add new data operator FakeImage 2021-10-12 14:00:43 +00:00
zx 9b7d7be65c [feat][assistant][I3J6UU] add new audio operator Overdrive 2021-10-12 18:10:31 +08:00
kswang 6582744bf6 add utst for mem scheduler 2021-10-12 14:44:17 +08:00
i-robot e920a1c07e !24593 Continue execution when saving and loading mindir failed 
Merge pull request !24593 from YuJianfeng/master
 2021-10-12 01:51:12 +00:00
yujianfeng d384db6c01 Continue execution when saving and loading mindir failed 2021-10-11 19:05:25 +08:00
i-robot b9c2a84d3b !17812 [assistant][ops] Add a new audio operator Flanger 
Merge pull request !17812 from 杨旭华/Flanger
 2021-10-09 08:15:33 +00:00
i-robot 333ca7becd !24585 delete old build process 
Merge pull request !24585 from liubuyu/del_old
 2021-10-09 07:53:01 +00:00
lby 3e9fd763c3 delete old build process 2021-10-09 11:16:09 +08:00
i-robot 59b6125fe7 !24500 add ascend memory adapter for ascend memory management 
Merge pull request !24500 from laiyongqiang/memory_code_check
 2021-10-09 01:20:19 +00:00
li-qiyao 2283442855 [feat][assistant][I3J6U9] add new data operator Flanger 2021-10-08 05:03:31 -07:00
i-robot 8598d08351 !17820 [assistant][ops]New operator implementation, include EMnistDataset 
Merge pull request !17820 from 张璇/emnist_dataset
 2021-10-08 07:18:31 +00:00
i-robot 02f9e3e077 !17805 [assistant][ops] Add new audio operator DetectPitchFrequency 
Merge pull request !17805 from 杨旭华/DetectPitchFrequency
 2021-10-08 03:34:46 +00:00
LaiYongqiang 79599546ee add ascend memory adapter for ascend memory management 2021-10-08 11:01:48 +08:00
G-Dragon-Liu 32baa520bf [feat][assistant][I3J6V2] add new data operator EMnist 2021-10-08 02:53:00 +00:00
i-robot 55e165c50e !24517 MD Profiling: Move ProfilingManager from ExecutionTree to TreeConsumer 
Merge pull request !24517 from cathwong/ckw_prof_mv_to_consumer6
 2021-10-06 14:34:24 +00:00
hesham c3718327f2 Stage 1 2021-10-04 23:34:15 -04:00
Cathy Wong 0665a191dc MD Profiling: Move ProfilingManager from ExecutionTree to TreeConsumer 2021-10-04 11:12:02 -04:00
Zhang Lian b7e6520e62 [feat] [assistant] [I3J6U8] Add a new audio operator DetectPitchFrequency 2021-09-29 15:12:58 +08:00
i-robot dd544a9693 !21406 [MS][crowdfunding]New operator implementation, include TrebleBiquad 
Merge pull request !21406 from 张璇/treble_biquad
 2021-09-27 14:18:00 +00:00
i-robot bf74e7ce44 !24185 Optimize graph_utils 
Merge pull request !24185 from hewei/opt_perf
 2021-09-27 13:26:10 +00:00
i-robot d1d4797079 !24204 [MD] sync code for code review 
Merge pull request !24204 from liyong126/sync_code
 2021-09-27 11:16:03 +00:00
He Wei 205b6357ed Optimize graph_utils 2021-09-27 17:38:19 +08:00
i-robot f16c003dfa !22610 [MS][crowdfunding]New operator implementation, RandomAdjustSharpness 
Merge pull request !22610 from yangwm/sharpness
 2021-09-27 09:20:05 +00:00
liyong 567f137a39 sync code 2021-09-27 14:31:49 +08:00
zx 3da0f0f487 [feat][assistant][I3J6V0] add new audio operator TrebleBiquad 2021-09-27 13:01:26 +08:00
despicablemme d072a4e4bf [feat] [assistant] [I40GZE] add new data operator RandomAdjustSharpness 2021-09-27 11:19:33 +08:00
i-robot ab567574c4 !21451 [MS][crowdfunding]New operator implementation, include RiaaBiquad 
Merge pull request !21451 from 张璇/riaa_biquad
 2021-09-27 03:14:16 +00:00
i-robot 2969688382 !20047 [assistant][ops]New operator implementation, include QmnistDataset 
Merge pull request !20047 from Wangsong95/qmnist_dataset
 2021-09-27 01:36:08 +00:00
i-robot a4459979d4 !24104 unknown_shape attr for fusion json 
Merge pull request !24104 from liubuyu/bug_fix2
 2021-09-27 01:12:48 +00:00
lby 925778015d add unknown_shape attr for fusion json 2021-09-26 14:44:21 +08:00
despicablemme 7063907bdc [feat] [assidtant] [I40GZN] add new data ops RandomEqualize 2021-09-25 18:00:25 +08:00
i-robot ee38ffbd3d !22560 [MS][crowdfunding]New operator implementation, RandomAutoContrast 
Merge pull request !22560 from yangwm/autocontrast
 2021-09-24 09:34:37 +00:00
i-robot 858b985953 !23911 use full attrs info when build/prebuild single op 
Merge pull request !23911 from laiyongqiang/context_attrs
 2021-09-24 02:14:16 +00:00
zx 1d95e6f480 [feat][assistant][I3J6UY] add new audio operator RiaaBiquad 2021-09-23 21:36:59 +08:00
despicablemme 7a6b75c2e8 [feat] [assistant] [I40GZJ] add new data op RandomAutoContrast 2021-09-23 20:17:39 +08:00
LaiYongqiang ba2b68d902 use full attrs info when build/prebuild single op 2021-09-23 12:50:25 +08:00
despicablemme b977d8723b [feat] [assistant] [I40GZC] add new data ops RandomInvert 2021-09-22 16:55:14 +08:00
ckczzj 001b68c286 [feat][assistant][I3J6VG] add new data operator QMnist 2021-09-22 12:13:27 +08:00
i-robot 7cf815bcfa !23509 Reading mindspore version from version.txt 
Merge pull request !23509 from sabrinasun_59ee/version
 2021-09-22 01:36:12 +00:00
zetongzhao a0c203df23 fix deser python operation error 2021-09-20 14:11:02 -04:00
rescue a67275d857 read ms version from version.txt 2021-09-18 19:52:45 -04:00
i-robot 0fa3fa78fb !23709 Clean security and codex warning 
Merge pull request !23709 from yelihua/dev
 2021-09-18 13:27:39 +00:00
i-robot e87f0be14f !23707 fix summary isolation 
Merge pull request !23707 from jiangshuqiang/temp
 2021-09-18 09:23:25 +00:00
i-robot 6489dacdab !18114 [assistant][ops]Add new operator Magphase 
Merge pull request !18114 from YJfuel123/Magphase
 2021-09-18 07:26:34 +00:00
yelihua 83b3f6fef7 delete Common::GetRealPath 2021-09-18 11:11:07 +08:00
jiangshuqiang c2bd061889 fix summary isolation 2021-09-18 10:59:14 +08:00
hwjiaorui 79a69da43f fix tbe check bug 2021-09-18 10:29:59 +08:00
葛崇林 a05a5de073 [feat][assistant][I3ALC5] add new method Magphase 2021-09-17 16:02:46 +08:00
chenx2ovo 9e62623b4a [feat][assistant][I3CEGI] add op vol 2021-09-17 09:34:20 +08:00
i-robot 4a553c8d57 !16607 [assistant][Fade] 
Merge pull request !16607 from QingfengLi/Fade
 2021-09-15 14:54:16 +00:00
i-robot ef425a1321 !23493 Fix Pyfunc C++ deserialize bug 
Merge pull request !23493 from zetongzhao/deserialize
 2021-09-15 08:59:41 +00:00
i-robot bbdacd41f4 !20585 add security isolate for save_graphs 
Merge pull request !20585 from huanghui/add-security-isolate-for-DumpIR
 2021-09-15 01:25:46 +00:00
zetongzhao 860810b9c4 check python interpreter 2021-09-14 16:25:04 -04:00
i-robot dc40225638 !23400 remove profiler if compiled with -s on 
Merge pull request !23400 from yanghaitao/yht_remove_profiler
 2021-09-14 13:11:11 +00:00
chenx2ovo 1a3196b052 [feat][assistant][I3CEGF] add op fade 2021-09-14 19:08:37 +08:00
yanghaitao1 177f3f75bf remove profiler if compiled with -s on 2021-09-14 05:29:18 -04:00
i-robot 2f66938553 !23399 fix bug of tbe check 
Merge pull request !23399 from hwjiaorui/tbe-check
 2021-09-14 08:29:09 +00:00
hwjiaorui fd5d9ee71f fix bug of tbe shape 2021-09-14 11:04:24 +08:00
huanghui ba66c0d491 add security isolate for save_graphs 2021-09-14 10:24:12 +08:00
i-robot 32c2b77595 !19093 [assistant][ops] Add new audio operator Biquad 
Merge pull request !19093 from 杨旭华/Biquad
 2021-09-14 01:52:01 +00:00
i-robot 4342a186de !23180 Refactor FuncGraphManager & FuncGraphTransaction 
Merge pull request !23180 from hewei/opt_manager
 2021-09-14 01:03:46 +00:00
i-robot 3e1d1ff4d3 !18671 [assistant][ops]New operator implementation, include SBUDataset 
Merge pull request !18671 from Wangsong95/sbu_dataset
 2021-09-13 11:56:13 +00:00
liannai 631f49f044 [feat][assistant][I3T96A] Add new audio operator Biquad 2021-09-13 19:18:50 +08:00
He Wei 4f92e0ca11 Refactor FuncGraphManager & FuncGraphTransaction 
Make them more object-oriented, and optimize performance.
 2021-09-13 13:02:30 +08:00
Carry955 0ba84345b0 [feat][assistant][I3J6U3] add new audio operator DCShift 2021-09-11 23:58:18 -07:00
Isaac17555 53fc99b914 [feat][assistant][I3T96B]add new data operator LFilter 2021-09-11 02:05:43 -07:00
i-robot 94f7cba97c !23219 remove profiling parameters in set_context function 
Merge pull request !23219 from yanghaitao/yht_remove_set_context_from_profiling_3
 2021-09-11 07:02:00 +00:00
YJfuel123 16150d394f [feat][assistant][I3ALd1] add new operator EqualizerBiquad 2021-09-11 10:36:20 +08:00
ckczzj af97ba4a77 [feat][assistant][I3J6VH] add new data operator SBU 2021-09-11 09:58:17 +08:00
i-robot cdde54a146 !23202 codedex and pclint warning fix 
Merge pull request !23202 from zetongzhao/warn_fix
 2021-09-10 20:01:22 +00:00
i-robot 6d709c7254 !19624 [assistant][ops] Add new dataset operator DIV2K. 
Merge pull request !19624 from Rainfor/div2k
 2021-09-10 14:59:21 +00:00
i-robot b14297bd06 !18598 [assistant][MulLawDecoding] 
Merge pull request !18598 from QingfengLi/mulawdecoding
 2021-09-10 14:58:05 +00:00
wangkc123 3daf3a4d5f [feat] [assistant] [I3CKEK] add new dataset operator DIV2K 2021-09-10 17:55:34 +08:00
yanghaitao1 83302ad23c remove profiling parameters in set_context function 2021-09-10 04:35:35 -04:00
robert_luo_yibo ce71699734 [feat][assistant][I3CEG5] add new data OP MuLawDecoding 2021-09-10 15:49:46 +08:00
i-robot ceb37595c3 !23163 Compile isolation for Profiling and Dump 
Merge pull request !23163 from caifubi/master-compile-isolation-profiling-dump
 2021-09-10 07:41:56 +00:00
i-robot 32cc5d79b0 !18670 [assistant][ops]New operator implementation, include USPSDataset 
Merge pull request !18670 from Wangsong95/usps_dataset
 2021-09-10 03:06:19 +00:00
i-robot f91e1440c8 !17810 [assistant][ops][DeemphBiquadOp] 
Merge pull request !17810 from Isaac/DeemphBiquad
 2021-09-10 03:05:41 +00:00
i-robot 4a57aa126b !22880 add tune black op list 
Merge pull request !22880 from laiyongqiang/tune_blacklist
 2021-09-10 02:32:58 +00:00
zetongzhao e2a5dafaf3 warning fix 2021-09-09 15:18:51 -04:00
ckczzj d7c702e9d4 [feat][assistant][I3J6VL] add new data operator USPS 2021-09-09 21:46:57 +08:00
liyong 0959c54ae9 fix bug in random posterize 2021-09-09 19:50:57 +08:00
LaiYongqiang 0e4e52afcb add tune black op list 2021-09-09 17:02:17 +08:00
caifubi f092e623e0 Compile isolation for Profiling and Dump 2021-09-09 16:46:43 +08:00
i-robot 936940da8e !22666 [assistant][ComplexNorm] 
Merge pull request !22666 from QingfengLi/ComplexNorm
 2021-09-09 06:41:53 +00:00
Isaac 5dc6c7fe96 [feat][assistant][I3J6U6]add new data operator DeemphBiquad 2021-09-09 14:34:24 +08:00
i-robot 9ad56e86ab !17846 [assistant][ops]Add new operator HighpassBiquad 
Merge pull request !17846 from YJfuel123/HighpassBiquad
 2021-09-09 02:06:41 +00:00
i-robot a918783f1a !22623 Add Random operation with Multi Field 
Merge pull request !22623 from shenwei41/operation_dev
 2021-09-09 01:49:04 +00:00
shenwei41 a8d02ab782 Add Random operation with MultiField 2021-09-08 19:29:23 +08:00
i-robot 938324b397 !19362 [assistant][ops] Add new dataset operator Cityscapes. 
Merge pull request !19362 from Rainfor/cityscapes
 2021-09-08 09:14:43 +00:00
i-robot 4cab7ffbd3 !22909 sync code to gitee according code review 
Merge pull request !22909 from guozhijian/sync_code_review
 2021-09-08 08:26:58 +00:00
i-robot c44c5b494b !22980 Fix a bug for assign in OrderedSet/OrderedMap 
Merge pull request !22980 from hewei/fix_ordered_set_map
 2021-09-08 08:22:53 +00:00
yaoyuan 85a1b55b47 [feat] [assistant] [I3ALCL] add new operator HighpassBiquad 2021-09-08 15:12:40 +08:00
yelihua 801121a140 add common get realpath method 2021-09-08 09:58:48 +08:00
Guo Zhijian 4b413922ac fix: code review new 2021-09-08 09:10:54 +08:00
He Wei 90621de3aa Fix a bug for assign in OrderedSet/OrderedMap 
1. Old data should be cleared before assign to new data;
2. FuncGraph::CopyNodes should use 'update' instead of 'operator='.
 2021-09-07 11:03:54 +08:00
Zhang Qinghua 7203989c26 Support fallback feature in Graph mode (1). 2021-09-06 16:00:03 +08:00
i-robot ff81c3ce13 !22828 [AutoParallel]Add no_elimilate for communication op 
Merge pull request !22828 from lichen/add_no_elimilate_for_comm_op
 2021-09-04 07:21:46 +00:00
lichenever 56b31fce42 add_no_elimilate_for_comm_op 2021-09-03 16:54:56 +08:00
zhouyaqiang dad375abb9 add gpu complex ops 2021-09-03 11:03:28 +08:00
robert_luo_yibo 3d58da9023 [fix][assistant][I47V0O] fix bug about the wrong output in the operator ComplexNorm 2021-09-01 17:55:38 +08:00
i-robot fc9d4ed659 !17813 [assistant][ops] Add new audio operator Contrast 
Merge pull request !17813 from 杨旭华/Contrast
 2021-09-01 06:38:05 +00:00
i-robot 2c692bf7de !22450 insert the overflow check operators according to the "gradients" scope name. 
Merge pull request !22450 from guoqi/overflow-check-master
 2021-08-31 13:37:09 +00:00
wangkc123 70f741bcc1 [feat] [assistant] [I3CKEM] add new dataset operator Cityscapes 2021-08-31 20:03:37 +08:00
i-robot 389f3a6b6c !21835 make alltoall and neighborexchange to be interface && revert pr 21395 
Merge pull request !21835 from zhoufeng/revert-same-input-to-comm-op
 2021-08-31 08:53:46 +00:00
guoqi 8fccec4c20 insert overflow check operaters according to the 'gradients' scope 2021-08-31 16:44:02 +08:00
tongyue 329526dea8 [feat][assistant][I3J6U0] add new data operator Contrast 2021-08-30 19:34:37 -07:00
zhoufeng ecae690a19 Revert "fix same node is used by two comm op" 
This reverts commit b09d411dc4.

add AlltoAll and NeighborExchange as interface
 2021-08-30 16:54:38 +08:00
i-robot a47ab8d643 !18073 [assistant][ops]Add new operator LowpassBiquad 
Merge pull request !18073 from YJfuel123/LowpassBiquad
 2021-08-30 08:33:39 +00:00
i-robot 524caeb5ef !22292 Profiler adapts to the change of training trace interface. 
Merge pull request !22292 from casgj/master_trace
 2021-08-30 07:15:33 +00:00
gaojing fa02606348 step train modified 2021-08-29 23:04:55 -04:00
Zhang Qinghua a137fa1d0b Optimize the Executors routines. 
- Fix the key generating.
- Distinguish the executors.
 2021-08-28 17:36:12 +08:00
i-robot 1639023909 !22263 Add convertcolor operation 
Merge pull request !22263 from shenwei41/operation_dev
 2021-08-27 12:33:43 +00:00
liyong c257cf36e2 refactor mindrecord 2021-08-27 09:15:05 +08:00
shenwei41 1295744524 Add ConvertColor Operation 2021-08-26 21:14:28 +08:00
haizhouye d96d9e64b0 [feat] [assistant] [I3ALCA] add new LowpassBiquad operator 
[feat] [assistant] [I3ALCA] add new LowpassBiquad operator

bugfix

fix

fix
 2021-08-26 18:49:21 +08:00
i-robot 32281f84e7 !19000 update LayerNormGrad split pass to V2 
Merge pull request !19000 from yuchaojie/ir_fusion2
 2021-08-26 08:03:33 +00:00
i-robot 8e39dd4ec7 !22173 ascend add nontask sink mode 
Merge pull request !22173 from baihuawei/graph_mode_nonsink_part3-2
 2021-08-26 06:20:36 +00:00
i-robot 9b28bd6308 !22342 [Auto parallel] Adjust the device matrix of OneHot operator 
Merge pull request !22342 from Xiaoda/85-adapt-onehot
 2021-08-25 09:02:44 +00:00
baihuawei a9694a9230 ascend add nontask sink mode 2021-08-25 14:45:58 +08:00
Xiaoda Zhang ae2d3b4832 adjust the device matrix for onehot use in moe 2021-08-25 14:36:06 +08:00
i-robot abc9d8e6fe !22068 DynamicRNN supports scenarios that hidden_size is not multiples of 16 
Merge pull request !22068 from yuchaojie/op_select2
 2021-08-25 01:32:26 +00:00
yuchaojie 1d1490df0b xupdate LayerNormGrad split pass to V2 2021-08-24 14:43:09 +08:00
yuchaojie 7b3943bc91 DynamicRNN supports scenarios that hidden_size is not multiples of 16 2021-08-24 11:20:44 +08:00
He Wei c9ecb27db8 Change monad.py as internal usage only 2021-08-24 10:45:40 +08:00
i-robot ef195c9de6 !21631 Deserialize part4 
Merge pull request !21631 from zetongzhao/deserialize_3
 2021-08-23 20:09:23 +00:00
zetongzhao b17464e30c deserialize and tests 2021-08-23 14:11:05 -04:00
ms_yan 36a8886ca2 Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset" 
This reverts commit b077aa1cab.

Revert "[feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset"

This reverts commit 4e6f7dc97d.

delete pass_registry_test.cc

comment  hiai_nlu_model_multi.pb related  line
 2021-08-23 01:46:38 +08:00
djc b077aa1cab [feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset 2021-08-22 16:26:45 +08:00
djc 4e6f7dc97d [feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset 2021-08-22 13:39:37 +08:00
i-robot 0f3de77e93 !21149 Sync MD code clean to master 
Merge pull request !21149 from xiefangqi/md_sync_codeclean_master
 2021-08-21 06:43:20 +00:00
i-robot 4ba337e0f5 !16667 [assistant][ComplexNorm] 
Merge pull request !16667 from QingfengLi/ComplexNorm
 2021-08-21 02:44:18 +00:00
robert_luo_yibo d837cbee0f [feat][assistant][I3CEG8] add new data operator ComplexNorm 2021-08-20 09:07:21 +08:00
yanghaitao1 8fc11cb676 adapt delete libms_profiler_fwk.a 2021-08-19 19:33:53 +08:00
i-robot 5e718c5676 !21973 GetRankId failed in PyNative mode 
Merge pull request !21973 from caifubi/master-hccl-get-rank-id
 2021-08-19 01:22:23 +00:00
xiefangqi 0e2efc2501 fix minddata code clean 2021-08-19 09:11:30 +08:00
caifubi dfe0e94466 Fix PyNative get_rank_id/get_rank_size 2021-08-18 16:39:18 +08:00
i-robot 1e4dace193 !20683 deserializer 2nd part 
Merge pull request !20683 from zetongzhao/deserialize_2
 2021-08-17 19:50:43 +00:00
zetongzhao ea1f2d0d7c deserialize and tests 2021-08-16 10:23:36 -04:00
Xiao Tianci aae886bcd7 fix crowd contributing code 2021-08-16 19:33:10 +08:00
liyong c5fefa7523 fix ut bug 2021-08-16 09:15:48 +08:00
i-robot d1112f8e9c !17631 [assistant][FrequencyMasking] 
Merge pull request !17631 from QingfengLi/FreqMask
 2021-08-13 06:48:06 +00:00
i-robot 6afcd815d2 !21362 add pynative profiling codes based on ascend and gpu 
Merge pull request !21362 from lvchangquan/profiling_refactor
 2021-08-13 06:18:31 +00:00
i-robot 2650aae9ba !21351 complex support 
Merge pull request !21351 from zhouyaqiang0/complex_support
 2021-08-12 09:39:15 +00:00
chenx2ovo 53615010a3 [feat][assistant][I3CEGG] add new data OP FrequencyMasking 2021-08-12 15:28:30 +08:00
zhouyaqiang b81ba100b7 add complex number support 2021-08-12 10:36:43 +08:00
zhoufeng 03a56f2bb0 alltoall exception handle 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-08-11 17:30:49 +08:00
i-robot 9eb414b768 !19389 ascend compile reconstruct 
Merge pull request !19389 from liubuyu/compile_re
 2021-08-11 07:19:11 +00:00
lby a5029f061c ascend kernel build refactory 2021-08-10 23:40:49 +08:00
lvchangquan e8d9803258 add profiling codes based on ascend and gpu in pynative mode 2021-08-10 20:46:51 +08:00
chenx2ovo e72acf362c [feat][assistant][I3CEGH] add op timemasking 2021-08-10 12:06:07 +08:00
i-robot dc626617fc !19526 [assistant][TimeStretch] 
Merge pull request !19526 from QingfengLi/TimeStretch
 2021-08-09 09:40:38 +00:00
chenx2ovo 04705e5b0d [feat][assistant][I3CEGC] add op timestretch 2021-08-07 22:53:41 +08:00
i-robot c84e09cf45 !21072 Deserialize - python binding 
Merge pull request !21072 from zetongzhao/deserialize_1
 2021-08-06 21:47:09 +00:00
zetongzhao 4f199b548c deserialize and tests 2021-08-06 13:35:27 -04:00
i-robot 59f4820785 !21383 dynamic shape interface adapter 
Merge pull request !21383 from liubuyu/master
 2021-08-06 12:40:14 +00:00
i-robot 51a1ca61f2 !21357 [MD] fix SlicePatches when dealing with some special tensor. 
Merge pull request !21357 from liyong126/fix_bug
 2021-08-06 08:58:27 +00:00
liyong 5fea72473c fix HW1 issue 2021-08-06 14:07:26 +08:00
lby e6cdf098db op tiling compute interface replace 2021-08-06 11:26:24 +08:00
chenx2ovo aa45e2ebbc [feat] [assistant] [I3CEER] add op AmplitudeToDB 2021-08-06 10:07:29 +08:00
Carry955 98be266585 [feat][assistant][I3J6TQ] add a new operator Angle 2021-08-04 19:41:00 -07:00
i-robot 680e40a43a !16453 [assistant][BassBiquadOp] 
Merge pull request !16453 from StyleHang/BassBiquadOp
 2021-08-04 10:02:34 +00:00
i-robot f4e07c0dce !17486 [assistant][ops] Add new dataset operator Flickr. 
Merge pull request !17486 from Rainfor/wangkc
 2021-08-04 08:52:21 +00:00
i-robot d260f38936 !15722 [assistant][AdjustGamma] 
Merge pull request !15722 from QingfengLi/adjust_gamma
 2021-08-04 03:58:09 +00:00
li-qiyao ba326d76a8 [feat][assistant][I3J6TW] add new data operator BassBiquad 2021-08-03 19:40:12 -07:00
wangkc123 48f5fed1f8 [feat] [assistant] [I3CKEN] add new dataset operator Flickr 2021-08-04 10:20:43 +08:00
i-robot 191c82573f !21208 Ascend support non-task sink mode 
Merge pull request !21208 from baihuawei/graph_mode_nonsink_part2
 2021-08-04 02:00:26 +00:00
chenx2ovo 4191dde45f [feat][assistant][I3CEGM] add op adjust gamma 2021-08-04 02:32:13 +08:00
baihuawei 41de02a58c ascend support nontask sink 2021-08-03 20:55:43 +08:00
tongyue 08469e113a [feat][assistant][I3J6TV]add new audio operator BandrejectBiquad 2021-08-03 05:41:53 -07:00
i-robot 2c7b8e73df !16452 [assistant][BandpassBiquadOp] 
Merge pull request !16452 from StyleHang/BandpassBiquadOp
 2021-08-03 11:08:48 +00:00
i-robot 69c5021bb5 !20995 pyfunc cpu kernel 
Merge pull request !20995 from chenweifeng/cpu-dynamic-input
 2021-08-03 04:51:20 +00:00
administrator 29d57a89fb [feat][assistant][I3TDRD]add new audio operator BandpassBiquad 2021-08-02 07:08:47 -07:00
wilfChen d6fffdad6e support dynamic inputs & outputs 2021-08-02 20:05:46 +08:00
hwjiaorui e498c96a20 tbe json creator UT 2021-08-02 18:51:33 +08:00
i-robot a81fee280c !16458 [assistant][AllpassBiquadOp] 
Merge pull request !16458 from StyleHang/AllpassBiquadOp
 2021-08-02 08:40:06 +00:00
i-robot 00e8645902 !21036 Upgrade Ascend packages 28 Jul 21 
Merge pull request !21036 from yanghaoran/upgrade_ascend_0728
 2021-08-02 06:15:06 +00:00
zhoufeng 2143241092 change neighbor exchange to all to all 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-08-01 18:21:28 +08:00
yanghaoran 0364650eae Upgrade Ascend packages 28 Jul 21, with testcases removed 2021-07-31 18:55:55 +08:00
Isaac b49e1acc3e [feat] [assistant] [I3J6TM] add new audio operator AllpassBiquad 2021-07-31 16:15:17 +08:00
i-robot 6e84bf0f0f !16449 [assistant][ops] Add new audio operator BandBiquad 
Merge pull request !16449 from StyleHang/BandBiquadOp
 2021-07-30 03:35:07 +00:00
liannai 5a341e7e27 [feat] [assistant] [I3J6TS] add new audio operator BandBiquad 2021-07-29 17:57:27 +08:00
yao_yf dc7dc7d3fa dataset strategy set 2021-07-27 18:44:10 +08:00
i-robot 34e2581dfc !20812 Add code for cross-silo with real data femnist and coco 
Merge pull request !20812 from ZPaC/cross-silo
 2021-07-26 13:21:19 +00:00
i-robot fd7c0c1514 !20672 add dump ir for python and add dump more info when dynamic shape 
Merge pull request !20672 from lianliguang/add_dump_func
 2021-07-26 06:53:42 +00:00
ZPaC dc068cb172 Add code for cross-silo with real data femnist and coco 2021-07-24 17:50:53 +08:00
i-robot 21e090062e !18674 deserializer 1st part - vision operations 
Merge pull request !18674 from zetongzhao/deserialize
 2021-07-23 19:25:36 +00:00
lianliguang dd57fcf8d7 add funcgraph py dump and dump more info for dynamic shape 2021-07-23 10:30:27 +08:00
zetongzhao 8693fd730a deserialize and tests 2021-07-21 08:32:00 -04:00
dayschan 137608b518 Add LiteGraph for graphkernel 
Add a subdirectory "model" in the "backend/optimizer/graph_kernel" for litegraph.
Implement two interfaces "AnfGraph2LiteGraph" and "LiteGraph2AnfGraph".

The litegraph will be the base data structure when we migrate the GraphKernel code
from python("mindspore/_extends/graph_kernel") to c++.
 2021-07-21 10:21:11 +08:00
i-robot fd72de08d9 !20174 Send compilation attrs to akg 
Merge pull request !20174 from DeshiChen/0708_compilewithjson
 2021-07-19 08:13:36 +00:00
chendongsheng dc3d6dc915 added cert 2021-07-17 10:14:28 +08:00
dayschan 3ab53dd26d Send compilation attrs to akg 
1. Add a new message type "AKG/ATTR" in AkgKernelBuilder.
   the attrs was sent before the kernel infos.
2. Send "online_tuning" attribute when the flag is not zero,
   but error occurs in the latest akg submodule.
3. Send "repository_path" attribute when the flag is not empty.
4. Add a new value "compute_capability" into kernel info when the processor is GPU.
 2021-07-16 16:52:18 +08:00
i-robot 3d022c9db8 !20246 Print ascend warning&error message using ErrorManager 
Merge pull request !20246 from tanghuikang/error_manager
 2021-07-16 06:49:31 +00:00
tanghuikang 21c4bf1f27 Print ascend warning and error message using ErrorManager 2021-07-15 11:52:25 +08:00
i-robot fd8eda24c4 !19904 fix fusion type 
Merge pull request !19904 from laiyongqiang/fusionType
 2021-07-14 06:08:20 +00:00
i-robot 77cc850c1a !19882 change kMaliGPU to kGPU 
Merge pull request !19882 from yeyunpeng2020/new_api
 2021-07-13 07:08:06 +00:00
LaiYongqiang 898a48d6ea fix fusion type 2021-07-13 10:44:50 +08:00
i-robot 884f5ae1de !19764 [MD] Remove Builder class phase 3 
Merge pull request !19764 from harshvardhangupta/rem-build-2
 2021-07-12 13:25:34 +00:00
i-robot e81aaf5043 !19936 Optimize signal util for ctrl+c 
Merge pull request !19936 from VectorSL/signal
 2021-07-12 11:58:09 +00:00
vector ee057e57ec update signal 2021-07-12 11:24:49 +08:00
yeyunpeng2020 f545bcd9b0 new api use gpu 2021-07-12 11:00:55 +08:00
i-robot 53633ebfd8 !19748 Fix param check and default value of center in Rotate and RandomRotation Ops 
Merge pull request !19748 from xiaotianci/fix_rotate_center
 2021-07-10 08:07:00 +00:00
i-robot d6be7c17af !19771 [MS][LITE][TOD] Add ToD to unified MS API 
Merge pull request !19771 from ehaleva/API2
 2021-07-10 04:12:57 +00:00
Emir Haleva fc6d150485 Add Train API to CXX_API 2021-07-09 19:30:57 +03:00
Zhang Qinghua f7ffc03249 Dump func graph where to call the node. 2021-07-09 21:37:48 +08:00
Xiao Tianci a77ed2a5c0 fix the param check of center in Rotate, and change the default value of center from {-1, -1} to {} 2021-07-09 15:24:27 +08:00
harshvardhangupta 52d1212239 remove builder 2021-07-08 16:55:52 -04:00
i-robot a5118ae5f2 !19507 Remove builder from CacheOp, CacheLookupOp, CacheMergeOp 
Merge pull request !19507 from lixiachen/remove_cacheop_builders
 2021-07-07 21:25:43 +00:00
i-robot 81dbc13611 !19563 Optimize armour directory 
Merge pull request !19563 from yyuse/fl_op_armour_dir
 2021-07-07 14:41:44 +00:00
i-robot 0e6c4071f5 !18987 use transdata to improve performance in print process 
Merge pull request !18987 from lvchangquan/transdata_formal
 2021-07-07 09:24:02 +00:00
i-robot a482cf7dc2 !19458 [AutoParallel]fix pipeline split bug 
Merge pull request !19458 from lichen/fix_pipeline_split_bug
 2021-07-07 07:48:09 +00:00
yangyuan 818f608f13 Optimize armour directory 2021-07-07 11:50:16 +08:00
Lixia Chen 946693e860 Remove builder from cache ops 2021-07-06 17:29:03 -04:00
i-robot 0a6732f6dc !19047 [MD] Remove Builder 
Merge pull request !19047 from harshvardhangupta/remove_builder
 2021-07-06 17:34:35 +00:00
i-robot 1876a359f1 !19457 Optimize federated learning directory 
Merge pull request !19457 from ZPaC/change-fl-dir
 2021-07-06 15:04:34 +00:00
lichenever 108967ff7d fix_pipeline_split_bug 2021-07-06 22:51:04 +08:00
i-robot db0a064cfd !19434 Modify context searching and creating routine, not searching all the time. 
Merge pull request !19434 from 张清华/opt0
 2021-07-06 13:00:32 +00:00
ZPaC 37ce5dd6a7 Optimize federated learning directory 2021-07-06 18:12:23 +08:00
lvchangquan 09c54c7923 use op transdata to improve performance in print process 2021-07-06 15:09:18 +08:00
dingpeifei 24ff7ab8b4 upgrade_ascend_0705 2021-07-06 11:31:45 +08:00
Zhang Qinghua b37a0cef63 Modify context searching and creating routine. 2021-07-06 11:01:52 +08:00
Harshvardhan Gupta 5bd8fb57fc remove builder 2021-07-05 11:17:37 -04:00
liyong 9a1de0af65 add slice patches in python and c++ 2021-07-05 09:16:47 +08:00
i-robot 0022d07d6e !19289 Lift FV before AD pass. 
Merge pull request !19289 from 张清华/cconv_opt0
 2021-07-03 01:27:35 +00:00
zhousiyi a5b4e7bbf8 lift fv before grad except weight, then convert 
switch(cond, partial(g1, xs), partial(g2, ys))(Zs)
 to
 switch(cond, g1, g2)(Xs, Ys, Zs)

 switch_layer(index, make_tuple(partial(g1, xs), partial(g2, ys)))(Zs)
 to
 switch_layer(index, make_tuple(g1, g2))(Xs, Ys, Zs)

put Zs at last when unifyparameter as it may have u-monad or io-monad

use joined args other than broadened one as some extra parameter which is not a parameter of while_header can be add to while_body

inline fprop_switch forcely

reorder the parameter if one of the parameter is Monad when incorporate call

incorporate switch tuple_getitem if item 0 of tuple is EnvInstance or
item 1 of tuple is bprop function

addn with shape() and shape(1)

remove context_ from FuncGraphEvaluator to make it re-entry able to resolve evaluator stuck issue because of re-entry of the same FuncGraphEvaluator
 2021-07-03 00:03:37 +08:00
ql_12345 5af0c890a1 cipher calling code 2021-07-01 00:23:06 +08:00
zhoufeng b9378e36c3 dynamic default memory size for vnpu 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-06-29 19:23:04 +08:00
i-robot 3629df552c !18937 upgrade_ascend_0626_mindspore 
Merge pull request !18937 from mindspore_ding/upgrade_ascend_0626
 2021-06-28 15:50:14 +00:00
dingpeifei 63784e49f5 upgrade_ascend_0626_mindspore 2021-06-28 22:03:19 +08:00
zhoufeng 35797bd5da add serialization cpp ut 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-06-26 13:22:10 +08:00
i-robot 708e56f659 !17899 Fix compile cache bug for resent50 
Merge pull request !17899 from LiangZhibo/cache
 2021-06-24 13:29:58 +00:00
l00591931 8ae5d7cc84 Fix compile cache for resnet50 2021-06-24 14:36:24 +08:00
i-robot 6bd66b3d70 !18729 Add register limit constraint 
Merge pull request !18729 from lishanni/for_regis_limit
 2021-06-24 03:48:17 +00:00
lishanni513 8c98146c76 Add register limit constraint 2021-06-23 17:39:22 +08:00
YangLuo 4e9f6d54f7 update cpp api & doc 2021-06-23 11:14:52 +08:00
i-robot dca5504fd4 !15672 [assistant][RGB2BGR] 
Merge pull request !15672 from QingfengLi/rgb2bgr
 2021-06-22 12:48:04 +00:00
lanzhineng fc8ec7fc49 infer_optv3:infer optimize to find exit of branches and resolve the 
endless issue.
 2021-06-22 11:55:56 +08:00
chenx2ovo 4b98099dcb [feat][assistant][I3CEGQ] add op rgb2bgr 2021-06-21 16:16:50 +08:00
i-robot 35b15bda0b !18465 clean code for memory reuse 
Merge pull request !18465 from laiyongqiang/mem_clean
 2021-06-19 10:12:09 +00:00
LaiYongqiang d4d6fb940d memory reuse code clean 2021-06-18 09:41:55 +08:00
chendongsheng bfaab72934 add node recovery 2021-06-17 23:52:09 +08:00
Xiao Tianci a54e65a7ad add Crop Python API 2021-06-10 09:46:57 +08:00
i-robot 1a626e3ff2 !17952 remove some code 
Merge pull request !17952 from caifubi/clean-codex
 2021-06-10 09:35:20 +08:00
Xiao Tianci 9c4c1c6a77 add Rotate Python API 2021-06-08 22:19:15 +08:00
caifubi 61efa2c23b remove some code 2021-06-08 10:55:41 +08:00
mindspore-ci-bot 8fa9e3e611 !17712 fix pclint & codex in profiler 
From: @yanghaitao1
Reviewed-by: @ouwenchang,@yelihua
Signed-off-by: @yelihua
 2021-06-08 10:31:49 +08:00
mindspore-ci-bot 823468d924 !17766 GNN new feature about two memory effeciency format 
From: @lizhenglong1992
Reviewed-by: @jonyguo,@heleiwang,@jonyguo
Signed-off-by: @jonyguo,@jonyguo
 2021-06-08 09:30:54 +08:00
mindspore-ci-bot 86cb781ce0 !17614 pass optimizer 
From: @zhupuxu
Reviewed-by: @zhoufeng54
Signed-off-by:
 2021-06-08 09:17:33 +08:00
mindspore-ci-bot 5f39e8bd59 !17818 upgrade_ascend_0604 
From: @ding_fei_fei
Reviewed-by: @xsmq,@zhoufeng54
Signed-off-by: @zhoufeng54
 2021-06-07 23:44:49 +08:00
dingpeifei 171d09457f upgrade_ascend_0604 2021-06-07 23:06:58 +08:00
mindspore-ci-bot f606951063 !17790 Fix code warning in master 
From: @liangzhibo
Reviewed-by: @ginfung,@zh_qh
Signed-off-by: @zh_qh
 2021-06-07 19:53:05 +08:00
yanghaitao1 127e4d4068 fix profiler pclint&codex 2021-06-07 02:17:23 -04:00
Zhenglong Li 2c7d1bf603 Implement new gnn feature 2021-06-07 10:20:06 +08:00
zhupuxu c0099abd03 pass optimizer 
Signed-off-by: zhupuxu <zhupuxu@huawei.com>
 2021-06-07 09:54:24 +08:00
mindspore-ci-bot cf27d3c8dc !12972 Removing Builder from dataset ops phase 1 
From: @ezphlow
Reviewed-by: 
Signed-off-by:
 2021-06-05 03:51:49 +08:00
mindspore-ci-bot 08847d2f64 !17635 [ME]Add parameter eliminate pass with func graph used search 
From: @chenfei52
Reviewed-by: @zh_qh,@ginfung
Signed-off-by: @zh_qh
 2021-06-04 17:46:01 +08:00
l00591931 0424b2d8d6 Fix warning in master 2021-06-04 17:40:01 +08:00
chenfei 4f50b3dfe1 add parameter eliminate pass 2021-06-04 11:53:34 +08:00
EricZ 16837a4639 Removing Builder from dataset ops phase 1 2021-06-03 09:09:29 +08:00
Xiao Tianci 9c74d55a49 add HorizontalFlip and VerticalFlip APIs 2021-05-31 15:55:21 +08:00
mindspore-ci-bot aa2093fb7d !17173 Add frontend compile cache 
From: @ginfung
Reviewed-by: @hwhewei,@zh_qh
Signed-off-by: @zh_qh
 2021-05-31 10:26:16 +08:00
yujianfeng 7cea682c7d Add func_graph caching after validate action 2021-05-30 13:00:35 +08:00
mindspore-ci-bot 497505631c !17061 Delete extra files, and change camel format 
From: @zetongzhao
Reviewed-by: @pandoublefeng,@robingrosman
Signed-off-by: @robingrosman
 2021-05-29 09:43:34 +08:00
mindspore-ci-bot 17099b048f !16936 Unify dump directory structure 
From: @tina_mengting_zhang
Reviewed-by: @john_tzanakakis,@pandoublefeng
Signed-off-by: @john_tzanakakis
 2021-05-29 04:12:48 +08:00
zetongzhao 728b180329 delete_extra files 2021-05-26 16:41:27 -04:00
TinaMengtingZhang 4926d74570 unify dir path 
dump hccl and config json files to dir

update filename for sync dump except cpu dump

update testcases
 2021-05-26 16:22:18 -04:00
mindspore-ci-bot 686225ad2a !16382 Unity Input Order 
From: @zetongzhao
Reviewed-by: 
Signed-off-by:
 2021-05-26 21:28:36 +08:00
mindspore-ci-bot b9a12ce3bf !16940 enable refactor thread pool 
From: @yangjie159
Reviewed-by: @zhang_xue_tong,@wangchengyuan
Signed-off-by: @zhang_xue_tong
 2021-05-26 11:07:12 +08:00
mindspore-ci-bot 1e8868cecc !16727 handle duplicate code 
From: @yangzhenzhang
Reviewed-by: @stsuteng,@jjfeing
Signed-off-by: @stsuteng
 2021-05-26 10:58:54 +08:00
yangjie159 a6622a70ba enable refactor thread pool 2021-05-26 07:58:58 +08:00
zetongzhao 4cb53823fd all the updated input order 
Fix FillOperation to_json function

Fix FillOperation to_json function

serialize tensor without testing

fix unity input order bug, next step is to test the tensor serialization

serialize tensor, testing code in tensor_test.cc

change for tensor serialization

changes after review

changes after review

clang-format the files

rename
 2021-05-25 18:26:43 -04:00
yangzhenzhang d711d98f07 clean duplicate code 2021-05-25 17:25:34 +08:00
Xiao Tianci 3f495bbae1 add GaussianBlur API 2021-05-24 16:27:05 +08:00
mindspore-ci-bot d906f15673 !16730 add ge runtime depends 
From: @zhoufeng54
Reviewed-by: @kisnwang,@jjfeing,@majorzhang
Signed-off-by: @jjfeing,@majorzhang
 2021-05-24 14:45:54 +08:00
mindspore-ci-bot 53b25b62c5 !16709 scheduler added client 
From: @anancds
Reviewed-by: 
Signed-off-by:
 2021-05-24 10:01:28 +08:00
chendongsheng 54a331d103 scheduler added client 2021-05-22 17:17:07 +08:00
zhoufeng 859b4e3ce3 add ge runtime depends 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-05-21 19:00:14 +08:00
lianliguang e3d7304208 add function to remove monad abs when using cpp infer 2021-05-21 17:02:52 +08:00
mindspore-ci-bot 51fb25d525 !16540 fix codex in tensor_layout.cc 
From: @gong_zi_yan
Reviewed-by: @stsuteng,@yangzhenzhang
Signed-off-by: @stsuteng
 2021-05-21 09:47:52 +08:00
mindspore-ci-bot 4b4ad59f6a !16632 added cluster metadata 
From: @anancds
Reviewed-by: @cristoval
Signed-off-by:
 2021-05-20 21:57:07 +08:00
chendongsheng 35f6d39127 added cluster metadata 2021-05-20 15:15:06 +08:00
Ziyan 2a0a549ae8 fix codex in tensor_layout.cc 2021-05-20 10:10:20 +08:00
lvliang 116781041a fix ut compile failed 2021-05-19 19:59:10 +08:00
zhousiyi 4ff19b7082 add API to build bprop funcgraph which can be used for higher grad 2021-05-19 19:59:06 +08:00
lvliang c759effa94 fix_compile_ut_failed 2021-05-19 19:59:06 +08:00
zhousiyi 1843740e0d 1. set abstract for node. 2. Adjust the position of sens parameter from last to position just after Inputs. 3. Set debug name for Parameter 2021-05-19 19:58:51 +08:00
zhousiyi b40816e66a add support for stop_gradient primitive. And defer BackPropagation to End API 2021-05-19 19:58:49 +08:00
zhousiyi 0d6a5ccfe4 grad op for pynative 2021-05-19 19:58:46 +08:00
mindspore-ci-bot 84837b0bc9 !16467 modify defination of hccl origin function in hccl plugin 
From: @zhoufeng54
Reviewed-by: @jjfeing,@xu-yfei
Signed-off-by: @xu-yfei
 2021-05-18 17:44:45 +08:00
zhoufeng 4306145684 fix ut comiple task pb not found 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-05-18 14:12:09 +08:00
mindspore-ci-bot 034193f2df !16496 concat allgather pass performance optimization 
From: @zhoufeng54
Reviewed-by: @kisnwang,@jjfeing
Signed-off-by: @jjfeing
 2021-05-17 21:09:44 +08:00
mindspore-ci-bot 601322356b !15638 VOCDataset need to add img_id for evaluation 
From: @xiefangqi
Reviewed-by: @liucunwei
Signed-off-by: @liucunwei
 2021-05-17 19:33:24 +08:00
zhoufeng ab5b36988e concat allgather pass performance optimization 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-05-17 17:40:34 +08:00
xiefangqi 9b846c7873 voc add image_id column 2021-05-17 16:09:04 +08:00
zhoufeng fee35368d1 modify defination of hccl origin function in hccl plugin 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-05-17 14:19:35 +08:00
jonyguo 9452142b50 enhance: enable shuffle infile / files when mindrecord 2021-05-14 17:41:18 +08:00
mindspore-ci-bot eb483a276b !16313 Evaluate the func graph in simulative stack, not to call recursively. 
From: @zh_qh
Reviewed-by: @hwhewei,@ginfung
Signed-off-by: @hwhewei
 2021-05-13 08:56:18 +08:00
mindspore-ci-bot b5cddcb8cc !16036 Improve performance of multi-processing option for dataset 
From: @robingrosman
Reviewed-by: 
Signed-off-by:
 2021-05-13 01:41:16 +08:00
RobinGrosman 9a7d1fc034 Optimize multi-process in minddata by passing data via shared memory instead of multiprocessing.queue 2021-05-11 15:16:29 -07:00
zhoufeng a76d58b52d hccl decouple 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-05-11 22:25:00 +08:00
mindspore-ci-bot f356c51169 !16116 graph scheduler support multi graphs 
From: @limingqi107
Reviewed-by: @cristoval,@wilfchen
Signed-off-by: @wilfchen
 2021-05-11 19:33:57 +08:00
Zhang Qinghua 5ad27e7639 Evaluate the func graph in simulative stack, not to call recursively. 2021-05-11 15:36:22 +08:00
mindspore-ci-bot 6fcd6cab68 !16119 Fix minddata issues 
From: @luoyang42
Reviewed-by: @jonyguo,@liucunwei
Signed-off-by: @jonyguo,@liucunwei
 2021-05-11 14:33:29 +08:00
mindspore-ci-bot d3a175e30f !16078 Modify Normalize to accept images with more than 3 channels 
From: @hfarahat
Reviewed-by: @mikef,@robingrosman
Signed-off-by: @robingrosman
 2021-05-11 02:03:34 +08:00
limingqi107 d8399e61e7 graph scheduler support multi graphs 2021-05-10 20:57:04 +08:00
YangLuo 0a4da64e13 Fix minddata issues 2021-05-10 11:12:00 +08:00
mindspore-ci-bot c74e66e759 !15928 unify dump path and support npy format 
From: @zhangbuxue
Reviewed-by: @guoqi1024,@zhaizhiqiang
Signed-off-by: @zhaizhiqiang
 2021-05-08 11:32:24 +08:00
mindspore-ci-bot 7a271987d6 !15269 use avx to optimize cpu op 
From: @wangyanling10
Reviewed-by: 
Signed-off-by:
 2021-05-08 09:40:10 +08:00
buxue 0eab785cfa unify dump path and support npy format 2021-05-08 09:04:33 +08:00
mindspore-ci-bot b86747b9a6 !15813 Convert some pipeline Ops to be inlined 
From: @hfarahat
Reviewed-by: 
Signed-off-by:
 2021-05-08 05:30:39 +08:00
hesham fd943bbdc0 Modify normalize to support multiple of channels 2021-05-07 17:06:26 -04:00
wangyanling ee1b803416 optimize cpu adam op 2021-05-07 10:47:57 +08:00
Lixia Chen 5967cb2cd7 Unblock mindrecord under cache 2021-05-05 13:28:13 -04:00
hesham e4c0bd51a5 Modify concat to be an inlined Op 
Modify zip to be an inlined Op
Modify take to be an inlined Op
Modify skip to be an inlined Op
Modify rename to be an inlined Op
Modify filter to consume child's rows using one thread
 2021-05-04 12:45:18 -04:00
mindspore-ci-bot 9416502e90 !15916 Add federated learning server part1 
From: @zpac
Reviewed-by: 
Signed-off-by:
 2021-05-01 14:59:47 +08:00
mindspore-ci-bot 9c7cb65c3b !15801 Split sampler and vision IR files 
From: @mhmotallebi
Reviewed-by: 
Signed-off-by:
 2021-05-01 05:19:41 +08:00
ZPaC 232e525ff2 Add common.h, local_meta_storage.h, param_name_type.h 
Add class Message, AddrStorage

Add Kernel folder

Add consistent hash ring

Add updater for server.

Add iteration timer

Add executor for server
 2021-04-30 15:31:09 +08:00
mindspore-ci-bot cefcf6c2ae !15931 Add eager tests for transform ops, and add a shape comparison in the EXPECT_MSTENSOR_EQ Macro 
From: @alexyuyue
Reviewed-by: @nsyca,@robingrosman
Signed-off-by: @robingrosman
 2021-04-30 06:15:12 +08:00
mohammad 9ce28cd34c split sampler vision IR files 2021-04-29 16:30:18 -04:00