Nigel
/
mindspore
forked from mindspore-Ecosystem/mindspore
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
35,316 Commits 24 Branches 0 Tags 3.9 GiB
Commit Graph

3187 Commits

Author SHA1 Message Date
zhuyuxiao 79d99323a2 rename gather 2021-09-16 16:07:05 +08:00
7347157+joylvliang@user.noreply.gitee.com 6e59598f99 correct_wrong_info_when_using_ms_function_with_bprop 2021-09-16 14:12:55 +08:00
huangxinjing 0b89d5c9c4 fix batch size error 2021-09-16 10:56:40 +08:00
Guo Zhijian f49bacde09 fix: pyfunc hung when it's a yield func 2021-09-16 09:20:44 +08:00
i-robot 57b8c8e2d9 !23310 [MD] fix error message of mindrecord 
Merge pull request !23310 from liyong126/fix_log_msg
 2021-09-16 00:45:11 +00:00
i-robot e5af07d519 !23538 minddata error message optimize 
Merge pull request !23538 from luoyang/log_update
 2021-09-16 00:42:42 +00:00
i-robot 4a553c8d57 !16607 [assistant][Fade] 
Merge pull request !16607 from QingfengLi/Fade
 2021-09-15 14:54:16 +00:00
i-robot 87fac9a520 !23476 fix hung when user return Tensor in generator 
Merge pull request !23476 from guozhijian/fix_generator_hung_when_return_mindspore_tensor
 2021-09-15 10:17:24 +00:00
YangLuo 9d89de5765 minddata error message optimize 2021-09-15 18:05:02 +08:00
liyong 65f3365a2a fix mindrecord log 2021-09-15 16:18:40 +08:00
i-robot 0d914dd427 !22638 Add ut test for offline debugger 
Merge pull request !22638 from sabrinasun_59ee/ut
 2021-09-15 06:28:47 +00:00
jonyguo c408867085 fix: hung when user return Tensor in generator 2021-09-15 14:13:33 +08:00
i-robot 0a33f88d48 !23419 log error level information in python when GLOG_v=4 
Merge pull request !23419 from huangbingjian/exception_log
 2021-09-15 01:29:12 +00:00
i-robot bbdacd41f4 !20585 add security isolate for save_graphs 
Merge pull request !20585 from huanghui/add-security-isolate-for-DumpIR
 2021-09-15 01:25:46 +00:00
sabrinasun 3a349a9219 add ut test for offline debugger 2021-09-14 18:46:22 -04:00
xiefangqi a91c87c581 fix some syntax error 2021-09-14 21:29:02 +08:00
chenx2ovo 1a3196b052 [feat][assistant][I3CEGF] add op fade 2021-09-14 19:08:37 +08:00
i-robot db19a40280 !23365 add print op security 
Merge pull request !23365 from fangzehua/print_sec
 2021-09-14 09:01:31 +00:00
i-robot c6a99428cd !23153 Update the operator in order to let users better understand the reason for the error of the operator part: nn_ops and array_ops 
Merge pull request !23153 from dinglinhe/dlh_code_ms_I43QY0_nn_ops
 2021-09-14 06:33:39 +00:00
i-robot 2b4cdea48a !23331 batch parallel operator replace input shape from construct 
Merge pull request !23331 from yangzhenzhang/modify-batch-parallel-info
 2021-09-14 06:32:45 +00:00
huangbingjian 6ba47653bf log error level information in python when GLOG_v=4 2021-09-14 14:23:55 +08:00
huanghui ba66c0d491 add security isolate for save_graphs 2021-09-14 10:24:12 +08:00
i-robot 32c2b77595 !19093 [assistant][ops] Add new audio operator Biquad 
Merge pull request !19093 from 杨旭华/Biquad
 2021-09-14 01:52:01 +00:00
dinglinhe 9a8c1b3c73 array_ops error recti and others 2021-09-14 09:12:02 +08:00
i-robot 6dcfe64501 !23264 python serdes bug fix 
Merge pull request !23264 from zetongzhao/deserialize
 2021-09-13 15:53:05 +00:00
i-robot 0aa167cdf4 !23240 maybe max open files in mr or onehot fail in pytransform 
Merge pull request !23240 from guozhijian/fix_max_open_files_and_onehot
 2021-09-13 13:51:09 +00:00
i-robot e149a15ace !23002 Error log optimizer 
Merge pull request !23002 from zhangzhaoju/master_syntax
 2021-09-13 13:43:40 +00:00
i-robot dc45c64a78 !23207 Adding security isolation to debugger 
Merge pull request !23207 from sabrinasun_59ee/macro
 2021-09-13 12:07:29 +00:00
i-robot 5abd4821ce !23357 Add DatasetName method for out developer 
Merge pull request !23357 from xiefangqi/md_white_list_optimization
 2021-09-13 12:06:49 +00:00
i-robot 3e1d1ff4d3 !18671 [assistant][ops]New operator implementation, include SBUDataset 
Merge pull request !18671 from Wangsong95/sbu_dataset
 2021-09-13 11:56:13 +00:00
liannai 631f49f044 [feat][assistant][I3T96A] Add new audio operator Biquad 2021-09-13 19:18:50 +08:00
fangzehua 4ccc635a07 add print security 2021-09-13 17:45:36 +08:00
i-robot bdfd3877f8 !23300 Optimize of exception log of AD 
Merge pull request !23300 from YuJianfeng/dfx
 2021-09-13 09:35:18 +00:00
yangzhenzhang 1b8eb283e4 modify batch parallel info 2021-09-13 16:28:56 +08:00
zhangzhaoju 4296881a16 syntax 2021-09-13 15:20:53 +08:00
xiefangqi 465dd25d74 add virtual DatasetName method 2021-09-13 15:17:32 +08:00
sabrinasun 220245f592 add security isolation to online and offline debugger 2021-09-12 23:01:15 -04:00
i-robot 87381a1cf9 !17806 [assistant][ops] DcShift Op 
Merge pull request !17806 from 杨旭华/DCShift
 2021-09-13 01:29:14 +00:00
i-robot c9ff7242a4 !23298 minddata engine optimize white list error msg 
Merge pull request !23298 from xiefangqi/md_white_list_optimization
 2021-09-13 01:19:15 +00:00
Carry955 0ba84345b0 [feat][assistant][I3J6U3] add new audio operator DCShift 2021-09-11 23:58:18 -07:00
jonyguo da78a17730 fix: may max openfiles in mindrecord and onehot error in py_transform 
and cache_admin rpath
 2021-09-12 00:25:07 +08:00
yujianfeng 752bdde06d Optimize of exception log of AD 2021-09-11 18:07:50 +08:00
xiefangqi ff73e4ccd7 fix white list error msg 2021-09-11 17:36:23 +08:00
Isaac17555 53fc99b914 [feat][assistant][I3T96B]add new data operator LFilter 2021-09-11 02:05:43 -07:00
i-robot 0071667155 !23039 [Fallback] Fix previous block parameters problem and add test cases. 
Merge pull request !23039 from 张清华/opt_fallback
 2021-09-11 07:39:02 +00:00
i-robot a61c2c5cfe !17885 [assistant][ops]Add new operator EqualizerBiquad 
Merge pull request !17885 from YJfuel123/EqualizerBiquad
 2021-09-11 06:40:29 +00:00
i-robot 9b7a966174 !21262 [assistant][ops]New operator implementation, include SparseApplyRMSPropD 
Merge pull request !21262 from 梁秀波/SparseApplyRMSPropD
 2021-09-11 06:01:29 +00:00
i-robot 76fac95591 !23069 Modify error content 
Merge pull request !23069 from huchunmei/master
 2021-09-11 03:50:52 +00:00
YJfuel123 16150d394f [feat][assistant][I3ALd1] add new operator EqualizerBiquad 2021-09-11 10:36:20 +08:00
ckczzj af97ba4a77 [feat][assistant][I3J6VH] add new data operator SBU 2021-09-11 09:58:17 +08:00
zetongzhao 719a207040 deserialize fix 2021-09-10 15:19:59 -04:00
i-robot 7b4f361ca7 !23232 Fix multiprocessing attr error 
Merge pull request !23232 from xiefangqi/md_fix_map_pool_issue
 2021-09-10 14:59:40 +00:00
i-robot 6d709c7254 !19624 [assistant][ops] Add new dataset operator DIV2K. 
Merge pull request !19624 from Rainfor/div2k
 2021-09-10 14:59:21 +00:00
xiefangqi 66c5f937dd fix attr failed problem 2021-09-10 18:01:04 +08:00
wangkc123 3daf3a4d5f [feat] [assistant] [I3CKEK] add new dataset operator DIV2K 2021-09-10 17:55:34 +08:00
Zhang Qinghua bcfb274074 [Fallback] Fix previous block parameters problem, and add test cases. 2021-09-10 16:43:46 +08:00
robert_luo_yibo ce71699734 [feat][assistant][I3CEG5] add new data OP MuLawDecoding 2021-09-10 15:49:46 +08:00
huchunmei c75773cf37 Modify error content 2021-09-10 15:21:33 +08:00
i-robot 32cc5d79b0 !18670 [assistant][ops]New operator implementation, include USPSDataset 
Merge pull request !18670 from Wangsong95/usps_dataset
 2021-09-10 03:06:19 +00:00
i-robot f91e1440c8 !17810 [assistant][ops][DeemphBiquadOp] 
Merge pull request !17810 from Isaac/DeemphBiquad
 2021-09-10 03:05:41 +00:00
i-robot 2cc8c851c5 !23141 mkdir rank_id 0909 
Merge pull request !23141 from mindspore_ding/mkdir_rankid_master_0909
 2021-09-10 02:45:54 +00:00
i-robot 725cf63118 !23187 upgrade Ascend software package 09 Sep 21 
Merge pull request !23187 from yanghaoran/upgrade_ascend_0909
 2021-09-10 01:55:13 +00:00
i-robot 0abff9ad65 !23108 Fix spelling error for transformer 
Merge pull request !23108 from huangxinjing/fix_spell_error
 2021-09-10 01:29:32 +00:00
ckczzj d7c702e9d4 [feat][assistant][I3J6VL] add new data operator USPS 2021-09-09 21:46:57 +08:00
yanghaoran 0ced8775c4 upgrade Ascend software package 09 Sep 21 2021-09-09 20:30:22 +08:00
huangxinjing e02f553010 Fix spell error and add mode check 2021-09-09 18:50:53 +08:00
i-robot 5c72e9d7c6 !23078 Get bprop from python when the bprop mindir dir does not exist 
Merge pull request !23078 from YuJianfeng/bprop_mindir
 2021-09-09 09:51:14 +00:00
i-robot e37b7374ae !22434 [MoE] Adding a MoE implementation 
Merge pull request !22434 from Xiaoda/84-add-moe-layer
 2021-09-09 09:06:56 +00:00
dingpeifei 992d6a6dbc mkdir rank_id 2021-09-09 16:14:54 +08:00
i-robot 936940da8e !22666 [assistant][ComplexNorm] 
Merge pull request !22666 from QingfengLi/ComplexNorm
 2021-09-09 06:41:53 +00:00
Isaac 5dc6c7fe96 [feat][assistant][I3J6U6]add new data operator DeemphBiquad 2021-09-09 14:34:24 +08:00
Xiaoda Zhang 5613c0b974 add a moe implementation: 
1) extend the Liner cell for including BatchMatMul implementation, in
which the first dimension indicates the expert number;
2) implement a Switch (top1) router;
3) implement a MoE cell, which extends the FeedForward cell.
 2021-09-09 11:53:42 +08:00
i-robot 9ad56e86ab !17846 [assistant][ops]Add new operator HighpassBiquad 
Merge pull request !17846 from YJfuel123/HighpassBiquad
 2021-09-09 02:06:41 +00:00
i-robot a918783f1a !22623 Add Random operation with Multi Field 
Merge pull request !22623 from shenwei41/operation_dev
 2021-09-09 01:49:04 +00:00
yujianfeng dfe1b05b28 Get bprop from python when the bprop mindir dir does not exist 2021-09-09 09:05:19 +08:00
i-robot b21da536d3 !22784 serdes python operations by pyfunc 
Merge pull request !22784 from zetongzhao/deserialize
 2021-09-08 17:18:57 +00:00
zetongzhao 0d389f3f0c serdes python operations 2021-09-08 09:05:11 -04:00
shenwei41 a8d02ab782 Add Random operation with MultiField 2021-09-08 19:29:23 +08:00
i-robot 938324b397 !19362 [assistant][ops] Add new dataset operator Cityscapes. 
Merge pull request !19362 from Rainfor/cityscapes
 2021-09-08 09:14:43 +00:00
i-robot 77424eaad5 !23004 Add args Check for Transformer 
Merge pull request !23004 from huangxinjing/args_check
 2021-09-08 08:24:06 +00:00
yaoyuan 85a1b55b47 [feat] [assistant] [I3ALCL] add new operator HighpassBiquad 2021-09-08 15:12:40 +08:00
huangxinjing 6cea07f749 Add args check 2021-09-08 09:12:35 +08:00
i-robot b1be8dfd31 !22851 MD Profiling: Update Connector Init to Remove any existing file 
Merge pull request !22851 from cathwong/ckw_mon_seq_pipelines_fix
 2021-09-07 19:57:58 +00:00
i-robot d37d57d0fd !22941 parallel_sparse_attention_ops_fix_repeated_cal 
Merge pull request !22941 from yao_yf/parallel_sparse_attention_ops_fix_repeated_cal
 2021-09-07 13:26:19 +00:00
i-robot 5cf19e8aa6 !22986 Add supported namespace for fallback. 
Merge pull request !22986 from 张清华/opt_fallback
 2021-09-07 12:50:32 +00:00
Zhang Qinghua 6edea0ed3c Add supported namespace for fallback. 2021-09-07 16:19:25 +08:00
i-robot 5ed105ec01 !22933 Tensor support complex scalar number input 
Merge pull request !22933 from zhouyaqiang0/complex_ops
 2021-09-06 13:29:21 +00:00
i-robot 990d561ed9 !22974 Fix ut/python/dataset generator 14 occationally segment fault 
Merge pull request !22974 from xiefangqi/md_fix_generator_problem
 2021-09-06 12:25:22 +00:00
yao_yf 3ef26288a2 parallel_sparse_attention_ops_fix_repeated_cal 2021-09-06 19:57:22 +08:00
i-robot 05a0898352 !22843 Support fallback feature in Graph mode. 
Merge pull request !22843 from 张清华/opt_fallback
 2021-09-06 11:35:45 +00:00
xiefangqi 57f68d35bd fix generator 14 ut problem 2021-09-06 19:01:51 +08:00
zhouyaqiang 4e07873378 Tensor support complex input 2021-09-06 18:44:26 +08:00
Zhang Qinghua 7203989c26 Support fallback feature in Graph mode (1). 2021-09-06 16:00:03 +08:00
lilei 62e832eaab modify parallel API 2021-09-06 11:45:10 +08:00
i-robot fa12d62d4d !21776 set device_id master 0813 
Merge pull request !21776 from mindspore_ding/set_device_id_master_0813
 2021-09-06 03:02:58 +00:00
Cathy Wong bc85c606b8 MD Profiling: Update Connector Init to Remove any existing file 
to fix sequential pipeline scenario.
 2021-09-03 15:45:38 -04:00
yao_yf 3ca73a6d6b broadcast using seqarates world group 2021-09-03 11:21:36 +08:00
i-robot 60d583190b !22815 Update bprop error information 
Merge pull request !22815 from JoyLvliang/update_bprop_error_information
 2021-09-03 01:31:15 +00:00
i-robot 90c7804d6b !22500 Sort watchpoint hit for offline debugger based on time stamps of dump files 
Merge pull request !22500 from parastooashtari/offline_wp_hit_order
 2021-09-02 14:47:06 +00:00
dingpeifei b4bc6000dc set device id master 0813 2021-09-02 20:51:50 +08:00
7347157+joylvliang@user.noreply.gitee.com 14d24d4793 update_bprop_error_information 2021-09-02 20:40:55 +08:00
i-robot bbbd6e0254 !22579 modify resizebilinear infer type 
Merge pull request !22579 from Simson/opinfer
 2021-09-02 01:02:00 +00:00
i-robot 3368287aab !22620 add util: browse dataset 
Merge pull request !22620 from luoyang/browse_dataset
 2021-09-02 01:00:46 +00:00
Parastoo Ashtari 65d8272352 sort wp hit for offline debugger with time stamp 2021-09-01 14:40:33 -04:00
robert_luo_yibo 3d58da9023 [fix][assistant][I47V0O] fix bug about the wrong output in the operator ComplexNorm 2021-09-01 17:55:38 +08:00
YangLuo 97c1ba380f add util: browse dataset 2021-09-01 16:13:32 +08:00
i-robot d87d0e07c2 !22255 recompute_interface_modify 
Merge pull request !22255 from yao_yf/recompute_interface_modify
 2021-09-01 08:09:36 +00:00
i-robot fc9d4ed659 !17813 [assistant][ops] Add new audio operator Contrast 
Merge pull request !17813 from 杨旭华/Contrast
 2021-09-01 06:38:05 +00:00
yao_yf 39055af6e4 recompute interface modify 2021-09-01 10:59:59 +08:00
i-robot cc8d614b25 !22650 fixed sparse attention modify 
Merge pull request !22650 from yao_yf/fixed_sparse_attention_modify
 2021-09-01 01:29:45 +00:00
simson 7a2fbdda85 modify resizebilinear infer type 2021-09-01 09:03:55 +08:00
wangkc123 70f741bcc1 [feat] [assistant] [I3CKEM] add new dataset operator Cityscapes 2021-08-31 20:03:37 +08:00
Feve1986 82b04d6a1e [feat][assistant][I40FFX] add new Ascend operator SparseApplyRMSPropD 2021-08-31 17:28:38 +08:00
i-robot 389f3a6b6c !21835 make alltoall and neighborexchange to be interface && revert pr 21395 
Merge pull request !21835 from zhoufeng/revert-same-input-to-comm-op
 2021-08-31 08:53:46 +00:00
yao_yf 82889ec56b fixed sparse attention 2021-08-31 16:11:56 +08:00
i-robot 740c62cbaa !22384 amend_assigin 
Merge pull request !22384 from jiangzhenguang/amend_assigin
 2021-08-31 06:55:02 +00:00
tongyue 329526dea8 [feat][assistant][I3J6U0] add new data operator Contrast 2021-08-30 19:34:37 -07:00
i-robot bbf9c6a9ad !22529 fix: for loop dataset iterator will cause memory leak 
Merge pull request !22529 from guozhijian/fix_for_loop_ds_iter_memory_leak
 2021-08-31 01:15:58 +00:00
jiangzhenguang 8812c8fe9b amend assign 2021-08-31 09:10:21 +08:00
yao_yf 68dd138462 add parallel sparse attention ops: dsd_matmul 2021-08-30 18:46:52 +08:00
i-robot 5b8f9ff398 !22096 add parallel sparse attention ops 
Merge pull request !22096 from yao_yf/parallel_sparse_attention_ops
 2021-08-30 10:43:05 +00:00
i-robot 37ecdba742 !20829 [assistant][ops]New operator implementation, include ApplyAdagradDA 
Merge pull request !20829 from 梁秀波/ApplyAdagradDAD
 2021-08-30 09:16:19 +00:00
zhoufeng ecae690a19 Revert "fix same node is used by two comm op" 
This reverts commit b09d411dc4.

add AlltoAll and NeighborExchange as interface
 2021-08-30 16:54:38 +08:00
i-robot a47ab8d643 !18073 [assistant][ops]Add new operator LowpassBiquad 
Merge pull request !18073 from YJfuel123/LowpassBiquad
 2021-08-30 08:33:39 +00:00
i-robot ff2e34b9f9 !22509 Add ut and st for Jvp, Vjp and Grad 
Merge pull request !22509 from LiangZhibo/fix
 2021-08-30 08:21:54 +00:00
jonyguo 4c915fdcbb fix: for loop dataset iterator will cause memory leak 2021-08-30 16:08:26 +08:00
zx 0efbedd23c [feat][assistant][I40FFF] add new Ascend operator ApplyAdagradDA 2021-08-30 11:01:18 +08:00
liyong 5a4ff8cfdb fix ci issue 2021-08-30 10:18:06 +08:00
yao_yf b8a9cbe2a3 add cus_matmul_dds parallel ops 2021-08-30 09:44:48 +08:00
Zhang Qinghua a137fa1d0b Optimize the Executors routines. 
- Fix the key generating.
- Distinguish the executors.
 2021-08-28 17:36:12 +08:00
l00591931 98fad9f08e Add st and ut for jvp vjp and grad 2021-08-28 17:34:23 +08:00
i-robot 535877a47b !22014 Add Fixed Sparse Attention 
Merge pull request !22014 from zhihenghu/add_sparse_attention
 2021-08-28 07:13:01 +00:00
zhihenghu ce12c02343 Add Sparse Attention 
adjut the file structure and name

Deleted extra information

Do some formatting work

Add test case and fix some document

fix imports
 2021-08-28 11:50:58 +08:00
i-robot 1639023909 !22263 Add convertcolor operation 
Merge pull request !22263 from shenwei41/operation_dev
 2021-08-27 12:33:43 +00:00
i-robot dd907a4d91 !22135 rank id master 0820 
Merge pull request !22135 from mindspore_ding/rank_id_master_0816
 2021-08-27 08:51:05 +00:00
i-robot ebe75e403b !22444 Apply comments on tensor stat online and offline PR 
Merge pull request !22444 from parastooashtari/tensor_level_info_online
 2021-08-27 07:42:51 +00:00
d00455729 34262db65e create rank_id dic 2021-08-27 14:24:06 +08:00
liyong c257cf36e2 refactor mindrecord 2021-08-27 09:15:05 +08:00
Parastoo Ashtari bf034bddb5 Apply comments on tensor stat online and offline debugger 2021-08-26 17:40:01 -04:00
i-robot cd4081ac87 !20676 [assistant][ops] Add array operator SplitV 
Merge pull request !20676 from 孟权令/SplitV
 2021-08-26 13:54:40 +00:00
shenwei41 1295744524 Add ConvertColor Operation 2021-08-26 21:14:28 +08:00
i-robot e6e1f37ae4 !22346 [Core] Fix the bug of scope setting when cloning nodes 
Merge pull request !22346 from Xiaoda/86-fix-the-fullname-scope-bug
 2021-08-26 13:04:15 +00:00
i-robot e753a3f70a !22416 Transform device_id to rank_id for hccl 
Merge pull request !22416 from 张毅辉/Device_id_to_rank_id
 2021-08-26 12:09:38 +00:00
haizhouye d96d9e64b0 [feat] [assistant] [I3ALCA] add new LowpassBiquad operator 
[feat] [assistant] [I3ALCA] add new LowpassBiquad operator

bugfix

fix

fix
 2021-08-26 18:49:21 +08:00
i-robot 7083ec9d37 !21925 add pad mode to maxpool3d 
Merge pull request !21925 from jiangzhenguang/amend_maxpool3d
 2021-08-26 09:08:37 +00:00
i-robot 8d00a8d803 !22360 Fix Transformer Mirror Error 
Merge pull request !22360 from huangxinjing/fix_transformer_mirror_error
 2021-08-26 08:16:33 +00:00
zhangyihui 3e5cb3b506 fix bugs for device_id_to_rank_id 2021-08-26 16:15:18 +08:00
i-robot 28e63116f2 !21921 Re-enabling offline debugger ut test 
Merge pull request !21921 from sabrinasun_59ee/uttest
 2021-08-26 07:50:01 +00:00
i-robot 471c57d3d7 !20046 [assistant][ops] Add New MaskedFill 
Merge pull request !20046 from 孟权令/MaskedFill
 2021-08-26 07:43:18 +00:00
i-robot a646eb27ab !21616 modify ms function cache key 
Merge pull request !21616 from chujinjin/modify_ms_function_cache_key
 2021-08-26 07:36:50 +00:00
i-robot 0faf36d5c5 !22187 modify api comment 
Merge pull request !22187 from changzherui/mod_dir_auth
 2021-08-26 03:01:33 +00:00
i-robot 07eaa1969b !22344 fix compile error when weight is used in while condition 
Merge pull request !22344 from xychow/fix-while-loop-with-weight-in-condition
 2021-08-26 03:00:38 +00:00
Xiaoda Zhang b2703879c6 fix the scope setting error when cloning nodes 2021-08-26 10:25:38 +08:00
i-robot edcbb68d71 !22386 fix neighborexchange empty input case 
Merge pull request !22386 from zhoufeng/fix-neighbor-empty-input-bak
 2021-08-26 01:52:10 +00:00
i-robot 5aeec398bb !22369 add test cases for conv2d 
Merge pull request !22369 from yangzhenzhang/add-test-cases
 2021-08-26 01:46:10 +00:00
i-robot 457a01fd09 !20055 [assistant][ops] Add math operator IndexAdd 
Merge pull request !20055 from 孟权令/IndexAdd
 2021-08-26 01:15:39 +00:00
sabrinasun a9c6bf45a3 re-enabling offline debugger ut test 2021-08-25 19:05:19 -04:00
changzherui 46319f3198 modify comment 2021-08-26 00:44:44 +08:00
zhoufeng e5a1582e4b fix neighborexchange empty input case 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-08-25 21:41:22 +08:00
huangxinjing 62496d75f3 less the interface exposed 2021-08-25 21:22:40 +08:00
i-robot 956ae2bbfd !22223 [assistant][TimeMask and FreqMask] 
Merge pull request !22223 from QingfengLi/TimeFreqMask
 2021-08-25 10:43:24 +00:00
i-robot acee9b24bc !22284 Change Op name in hccl to Op name in step trace 
Merge pull request !22284 from 张毅辉/op_name_of_hccl_to_op_name_of_step_trace
 2021-08-25 09:32:55 +00:00
yangzhenzhang 0b9b2a9458 add test cases 2021-08-25 17:22:20 +08:00
jiangzhenguang 8a78b2b7f6 add pad mode to maxpool3d 2021-08-25 16:24:02 +08:00
i-robot 60634c5d11 !21745 Unified format of single machine and multi machine performance data directory 
Merge pull request !21745 from 张毅辉/Device_id_to_rank_id
 2021-08-25 07:49:29 +00:00
doit a5193df648 [feat] [assistant] [I3T92B] add new array operator MaskedFill 2021-08-25 15:29:37 +08:00
i-robot 36238032a2 !22245 Add pynative switch layer ut test case 
Merge pull request !22245 from zjun/switch_layer_ut_test
 2021-08-25 07:24:28 +00:00
chujinjin 551fa9ab8b modify ms function cache key 2021-08-25 14:40:45 +08:00
hulx c70731d601 [feat][assistant][I3T924] add new math operator IndexAdd 2021-08-25 14:19:17 +08:00
zhangyihui dab750d1a5 Mapping op_name of hccl to op_name of step trace 2021-08-25 10:51:52 +08:00
chenx2ovo 2f1d974eeb [fix] [assistant] [I465ZG] revise error message and change input param datatype 2021-08-25 10:47:27 +08:00
i-robot 698eb406e2 !20129 [assistant][ops] Add math operator Erfinv 
Merge pull request !20129 from 孟权令/Erfinv
 2021-08-25 02:44:18 +00:00
i-robot 2edaba38bf !21389 Add Tensor Base and Stat info to offline debugger 
Merge pull request !21389 from parastooashtari/tensor_info_levels
 2021-08-25 02:08:34 +00:00
i-robot 0adacd1b68 !22226 [AutoParallel]Refacor pipeline code 
Merge pull request !22226 from lichen/Refactor_part_of_pipeline
 2021-08-25 01:54:18 +00:00
zhangyihui 3d19949eb4 device_id to rank_id 2021-08-25 09:52:23 +08:00
zhousiyi 44bdcb101c fix while loop compile error when weight is used in while condition 2021-08-25 01:33:34 +00:00
i-robot 4e81ea7bb0 !22300 Add ut and st case for non tensor input in pynative 
Merge pull request !22300 from JoyLvliang/add_st_ut_case_for_pynative_non_tensor_input
 2021-08-25 01:23:34 +00:00
Parastoo Ashtari ff83dee704 Add tensor base and stat info to offline debugger 2021-08-24 18:19:59 -04:00
lichenever 5812076512 Refactor_part_of_pipeline 2021-08-24 21:37:41 +08:00
hulx ca6f3ef155 [feat][assistant][I3T925] add new math operator Erfinv 2021-08-24 21:25:04 +08:00
i-robot 661c83e17f !22274 MD Profiling UT: Use pytest setup and teardown 
Merge pull request !22274 from cathwong/ckw_mon_py_analyze_ut5
 2021-08-24 13:24:49 +00:00
i-robot 1e47ff7bc3 !22108 modify check strategy for conv2d 
Merge pull request !22108 from yangzhenzhang/modify-check-strategy-for-conv2d
 2021-08-24 12:01:23 +00:00
hedongdong 09bc1bddf1 [feat][assistant][I3T92H] add new array operator SplitV 2021-08-24 19:54:26 +08:00
i-robot ab758a981c !20044 [assistant][ops] Add New Lerp 
Merge pull request !20044 from 孟权令/Lerp
 2021-08-24 11:25:44 +00:00
7347157+joylvliang@user.noreply.gitee.com a30800ecc3 add_st_ut_case_for_pynative_non_tensor_input 2021-08-24 16:44:05 +08:00
i-robot 822cedec0a !22153 Convert some ops bprops to mindir 
Merge pull request !22153 from YuJianfeng/bprop_mindir
 2021-08-24 08:07:46 +00:00
yangzhenzhang f1afaeac5a modify check strategy for conv2d 2021-08-24 16:06:16 +08:00
zjun 779b655cfe Add switch_layter pynative ut test 
Signed-off-by: zjun <zhangjun0@huawei.com>
 2021-08-24 11:21:13 +08:00
i-robot 6082835501 !22146 dataset: support return bytes in GeneratorDataset 
Merge pull request !22146 from ms_yan/decode_bytes
 2021-08-24 02:41:18 +00:00
Cathy Wong 3581e7962e MD Profiling UT: Use pytest setup and teardown 2021-08-23 21:09:48 -04:00
yujianfeng 712b9bd013 convert some ops bprops to mindir 2021-08-24 09:09:09 +08:00
i-robot db44b88e1e !22094 MD Profiling: For mismatch op info btwn files, skip bottleneck analysis 
Merge pull request !22094 from cathwong/ckw_mon_py_analyze_fixes3
 2021-08-23 18:28:51 +00:00
ms_yan 6ecfc34524 add np.frombuffer to support return bytes 2021-08-23 17:31:38 +08:00
ms_yan 36a8886ca2 Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset" 
This reverts commit b077aa1cab.

Revert "[feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset"

This reverts commit 4e6f7dc97d.

delete pass_registry_test.cc

comment  hiai_nlu_model_multi.pb related  line
 2021-08-23 01:46:38 +08:00
djc b077aa1cab [feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset 2021-08-22 16:26:45 +08:00
djc 4e6f7dc97d [feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset 2021-08-22 13:39:37 +08:00
i-robot 0e7844daa9 !22093 revert merge request 21685 
Merge pull request !22093 from guozhijian/revert-merge-21685-master
 2021-08-21 09:25:32 +00:00
i-robot 4ba337e0f5 !16667 [assistant][ComplexNorm] 
Merge pull request !16667 from QingfengLi/ComplexNorm
 2021-08-21 02:44:18 +00:00
doit bf23333b27 [feat] [assistant] [I3T927] add new math operator Lerp 2021-08-20 20:19:41 +08:00
i-robot f34426095c !22084 Move Transformer Code from Mindspore.nn.parallel to mindspore.parallel.nn 
Merge pull request !22084 from huangxinjing/transformer_doc_check
 2021-08-20 10:40:01 +00:00
huangxinjing d777742904 1. Move the class to mindspore.parallel, support activation sharding 2021-08-20 14:34:10 +08:00
i-robot 954864bfba !22037 incoroporate getitem if indexed node is zeros_like 
Merge pull request !22037 from xychow/always-incorporate-getitem-if-zeros-like
 2021-08-20 02:14:35 +00:00
i-robot 5d1bb097e2 !22052 Fix probability core dump in MindData coverage test 
Merge pull request !22052 from luoyang/issues2
 2021-08-20 01:18:06 +00:00
robert_luo_yibo d837cbee0f [feat][assistant][I3CEG8] add new data operator ComplexNorm 2021-08-20 09:07:21 +08:00
Cathy Wong 85931175bc MD Profiling: For mismatch op info btwn files, skip bottleneck analysis. 
Add to summary output: per_pipeline_time and per_push_queue_time.
Enhance UT
 2021-08-19 12:19:59 -04:00
guozhijian e1df9a2152 revert 'Pull Request !21685 : add function to invert_op' 2021-08-19 22:49:51 +08:00
i-robot 4113aee7d6 !18668 [assistant][ops]New operator implementation, include Flowers102Dataset 
Merge pull request !18668 from Wangsong95/flowers102_dataset
 2021-08-19 08:41:44 +00:00
YangLuo 9352935ff6 Fix probability core dump in MindData coverage test 2021-08-19 14:34:57 +08:00
i-robot c93bb9936e !20011 [assistant][ops] Add nn operator Roll 
Merge pull request !20011 from 孟权令/Roll
 2021-08-19 06:28:28 +00:00
i-robot 3ad641cb65 !21685 add function to invert_op 
Merge pull request !21685 from Killer/fake_killer
 2021-08-19 05:13:39 +00:00
zhousiyi dcd374961e incoroporate getitem if indexed node is zeros_like so AddN(MakeTuple(x, zeros_like)) can be optimized 2021-08-19 03:28:24 +00:00
fake_killer b0bc4bf5da [feat] [assistant] [I44TRS] extend invert_op's function 2021-08-18 21:46:15 +08:00
i-robot dde05c36b8 !21551 auto_parallel_context interface dataset_strategy union 
Merge pull request !21551 from yao_yf/auto_parallel_context_dataset_strategy_union
 2021-08-18 09:03:18 +00:00
i-robot 415275ae17 !21805 support adafactor model parallel 
Merge pull request !21805 from yangzhenzhang/auto-parallel-support-adafactor-opt
 2021-08-18 07:20:39 +00:00
hedongdong d76ed25e96 [feat][assistant][I3T92I] add new nn operator Roll 2021-08-18 10:15:17 +08:00
i-robot 264cb4d2e8 !21920 MD Profiling Analyze: Search for device trace file, independent of device_target 
Merge pull request !21920 from cathwong/ckw_mon_py_analyze_device_file
 2021-08-18 00:57:50 +00:00
i-robot 0d839fa7c6 !21809 Improved Transformer Struture and Add Args Check 
Merge pull request !21809 from huangxinjing/transformer_improved
 2021-08-17 12:05:25 +00:00
i-robot a77a0b968d !21761 comm_recompute_interface. 
Merge pull request !21761 from yao_yf/comm_recompute_interface
 2021-08-17 09:14:29 +00:00
yangzhenzhang 7ca64d2235 auto parallel support adafactor opt 2021-08-17 10:36:42 +08:00
yao_yf 5277b229be add cell comm recompute interface 2021-08-17 09:23:21 +08:00
Cathy Wong a2cbd4b5fa MD Profiling Analyze: Search for device trace file 
MinddataProfilingAnalyzer() - remove device_target input parm
 2021-08-16 15:41:11 -04:00
huangxinjing 18044aff0f 1. Add docstring, elimitate attention mask, tuple append the deocoder return layer past 
split attention inputs from two into three

Add input check and modify test case

Fix check error and add check to transformer inputs

add input check to the transformers
 2021-08-16 21:08:48 +08:00
Xiao Tianci aae886bcd7 fix crowd contributing code 2021-08-16 19:33:10 +08:00
yao_yf a83bf73298 union auto_parallel_context interface dataset_strategy 2021-08-16 10:54:46 +08:00
i-robot 530da3e37e !21527 fix_reshape_reshape_in_auto_parallel 
Merge pull request !21527 from yao_yf/fix_reshape_reshape_in_auto_parallel
 2021-08-13 08:29:15 +00:00
i-robot f99effd430 !21755 Fix batch usability problem 
Merge pull request !21755 from xiefangqi/md_fix_batch_usability
 2021-08-13 07:21:49 +00:00
i-robot d1112f8e9c !17631 [assistant][FrequencyMasking] 
Merge pull request !17631 from QingfengLi/FreqMask
 2021-08-13 06:48:06 +00:00
xiefangqi e4894a1bf1 fix batch usability problem 2021-08-12 20:12:43 +08:00
i-robot 2650aae9ba !21351 complex support 
Merge pull request !21351 from zhouyaqiang0/complex_support
 2021-08-12 09:39:15 +00:00
chenx2ovo 53615010a3 [feat][assistant][I3CEGG] add new data OP FrequencyMasking 2021-08-12 15:28:30 +08:00
yao_yf e233880e41 fix reshape depend reshape in auto parallel 2021-08-12 11:45:28 +08:00
i-robot bff5cbda9c !21670 fix: null numpy field in mindrecord will cause read error 
Merge pull request !21670 from guozhijian/fix_null_numpy_field_in_mr
 2021-08-12 03:39:34 +00:00
zhouyaqiang b81ba100b7 add complex number support 2021-08-12 10:36:43 +08:00
i-robot 63445ff6fd !21627 alltoall exception handle 
Merge pull request !21627 from zhoufeng/alltoall_exception
 2021-08-12 01:40:22 +00:00
i-robot 6320bf6b7b !21676 check strategy for conv2d 
Merge pull request !21676 from yangzhenzhang/check-strategy-for-conv2d
 2021-08-12 01:29:37 +00:00
i-robot 73b55cff72 !20794 add adafactor 
Merge pull request !20794 from jiangzhenguang/add_adafactor_optimizer
 2021-08-12 01:27:03 +00:00
yangzhenzhang d18c813ee4 check strategy for conv2d 2021-08-11 19:12:48 +08:00
zhoufeng 03a56f2bb0 alltoall exception handle 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-08-11 17:30:49 +08:00
jonyguo 42b3512a1b fix: when field is none in mr 2021-08-11 17:11:38 +08:00
jiangzhenguang a3bb780ce4 optimize run memory 2021-08-10 20:45:25 +08:00
chenx2ovo e72acf362c [feat][assistant][I3CEGH] add op timemasking 2021-08-10 12:06:07 +08:00
i-robot f154db1bb0 !20680 [assistant][ops] Add New SoftMarginLoss and SoftMarginLossGrad 
Merge pull request !20680 from 孟权令/SoftMarginLoss
 2021-08-10 02:39:28 +00:00
i-robot 4aaa8126a0 !21528 Add Parallel Print Support 
Merge pull request !21528 from huangxinjing/add_print
 2021-08-09 10:55:04 +00:00
i-robot dc626617fc !19526 [assistant][TimeStretch] 
Merge pull request !19526 from QingfengLi/TimeStretch
 2021-08-09 09:40:38 +00:00
i-robot 75429acbe3 !21519 fix waring 
Merge pull request !21519 from shenwei41/fix_sqlite
 2021-08-09 09:09:18 +00:00
shenwei41 59efbb88ec fix waring 2021-08-09 11:40:52 +08:00
i-robot 8306abeb67 !21168 Only replace the primal user with tuple_getitem once 
Merge pull request !21168 from YuJianfeng/ad
 2021-08-09 03:19:07 +00:00
huangxinjing 92bad162bd Add print 2021-08-09 11:14:25 +08:00
chenx2ovo 04705e5b0d [feat][assistant][I3CEGC] add op timestretch 2021-08-07 22:53:41 +08:00
i-robot c84e09cf45 !21072 Deserialize - python binding 
Merge pull request !21072 from zetongzhao/deserialize_1
 2021-08-06 21:47:09 +00:00
zetongzhao 4f199b548c deserialize and tests 2021-08-06 13:35:27 -04:00
yujianfeng cf4121126a Only replace the primal user with tuple_getitem once 2021-08-06 19:23:14 +08:00
i-robot d2ae09d891 !21437 Support ListComp and GeneratorExp in Graph Mode. 
Merge pull request !21437 from 张清华/opt
 2021-08-06 09:09:47 +00:00
i-robot 51a1ca61f2 !21357 [MD] fix SlicePatches when dealing with some special tensor. 
Merge pull request !21357 from liyong126/fix_bug
 2021-08-06 08:58:27 +00:00
i-robot 8a8851dc52 !18667 Remove redundant depend 
Merge pull request !18667 from huangbingjian/remove_redundant_depend
 2021-08-06 07:43:53 +00:00
SichongHao 3d2892b454 [feat][assistant][I3T91Y][I3T91Z]add new operator SoftMarginLoss and SoftMarginLossGrad 2021-08-06 15:13:13 +08:00
liyong 5fea72473c fix HW1 issue 2021-08-06 14:07:26 +08:00
Zhang Qinghua aef396f9f2 Support ListComp and GeneratorExp in Graph Mode. 2021-08-06 11:44:57 +08:00
ckczzj 9d9f33be88 [feat][assistant][I3J6VN] add new data operator flowers102 2021-08-06 10:55:12 +08:00
chenx2ovo aa45e2ebbc [feat] [assistant] [I3CEER] add op AmplitudeToDB 2021-08-06 10:07:29 +08:00
huangbingjian 53b31abf12 remove useless depend 2021-08-05 20:21:24 +08:00
Carry955 98be266585 [feat][assistant][I3J6TQ] add a new operator Angle 2021-08-04 19:41:00 -07:00
i-robot 680e40a43a !16453 [assistant][BassBiquadOp] 
Merge pull request !16453 from StyleHang/BassBiquadOp
 2021-08-04 10:02:34 +00:00
i-robot f4e07c0dce !17486 [assistant][ops] Add new dataset operator Flickr. 
Merge pull request !17486 from Rainfor/wangkc
 2021-08-04 08:52:21 +00:00
i-robot a83f8f6f5d !20284 Unify exception info with using the unsupported numpy method 
Merge pull request !20284 from huanghui/numpy-in-graph-mode
 2021-08-04 08:06:01 +00:00
i-robot d260f38936 !15722 [assistant][AdjustGamma] 
Merge pull request !15722 from QingfengLi/adjust_gamma
 2021-08-04 03:58:09 +00:00
li-qiyao ba326d76a8 [feat][assistant][I3J6TW] add new data operator BassBiquad 2021-08-03 19:40:12 -07:00
wangkc123 48f5fed1f8 [feat] [assistant] [I3CKEN] add new dataset operator Flickr 2021-08-04 10:20:43 +08:00
chenx2ovo 4191dde45f [feat][assistant][I3CEGM] add op adjust gamma 2021-08-04 02:32:13 +08:00
tongyue 08469e113a [feat][assistant][I3J6TV]add new audio operator BandrejectBiquad 2021-08-03 05:41:53 -07:00
i-robot 2c7b8e73df !16452 [assistant][BandpassBiquadOp] 
Merge pull request !16452 from StyleHang/BandpassBiquadOp
 2021-08-03 11:08:48 +00:00
i-robot a70b0f3bf4 !18260 [assistant][ops]New operator implementation, include HShrink and HShrinkGrad 
Merge pull request !18260 from 张璇/hshrink
 2021-08-03 11:00:11 +00:00
i-robot 93af13f332 !19979 dataset: modify some error msg 
Merge pull request !19979 from ms_yan/err_msg
 2021-08-03 08:53:30 +00:00
i-robot 0a3b4ff84b !21207 modify replace graph for conv2d 
Merge pull request !21207 from yangzhenzhang/fix-bugs-for-conv2d
 2021-08-03 08:48:37 +00:00
huanghui 3e17650172 Raise NotImplementedError when parsing the numpy methods, but not the numpy constant. 2021-08-03 14:33:22 +08:00
i-robot ef77050348 !18892 [assistant][ops] Add new dataset operator SBD. 
Merge pull request !18892 from Rainfor/sbd
 2021-08-03 03:33:00 +00:00
yangzhenzhang ef0361a449 fix bugs for conv2d 2021-08-03 10:48:05 +08:00
ms_yan 65870045bc modify some error msg 2021-08-03 09:16:28 +08:00
administrator 29d57a89fb [feat][assistant][I3TDRD]add new audio operator BandpassBiquad 2021-08-02 07:08:47 -07:00
i-robot a81fee280c !16458 [assistant][AllpassBiquadOp] 
Merge pull request !16458 from StyleHang/AllpassBiquadOp
 2021-08-02 08:40:06 +00:00
Xiaoda Zhang 4b4b3cdaf4 add reduceany operator and extend onehot to multi-dimensions 2021-08-02 08:53:43 +08:00
zhangjie b04036e13c [feat][assistant][I3PYD4] add new data operator HShrink and HShrinkGrad 2021-08-01 20:55:58 +08:00
danansheng accb87606a [feat][assistant][I3PYD4] add new data operator HShrink 2021-08-01 20:52:55 +08:00
Isaac b49e1acc3e [feat] [assistant] [I3J6TM] add new audio operator AllpassBiquad 2021-07-31 16:15:17 +08:00
i-robot 9301de1b54 !21098 fix bug 
Merge pull request !21098 from shenwei41/fix_waring
 2021-07-31 01:12:21 +00:00
shenwei41 e3385e2564 fix waring to master 2021-07-30 16:37:27 +08:00
i-robot 6e84bf0f0f !16449 [assistant][ops] Add new audio operator BandBiquad 
Merge pull request !16449 from StyleHang/BandBiquadOp
 2021-07-30 03:35:07 +00:00
liannai 5a341e7e27 [feat] [assistant] [I3J6TS] add new audio operator BandBiquad 2021-07-29 17:57:27 +08:00
huangxinjing 615d1a179d Add transformer layer 2021-07-29 11:10:43 +08:00
i-robot 9f296c58d6 !20960 [AutoParallel]Add replace graph for conv2d 
Merge pull request !20960 from lichen/add_replace_graph_for_conv2d
 2021-07-28 07:06:41 +00:00
lichenever a7f8024c29 add_replace_graph_for_conv2d 2021-07-28 11:02:21 +08:00
yao_yf dc7dc7d3fa dataset strategy set 2021-07-27 18:44:10 +08:00
i-robot b8901526b9 !20882 Fix GradOperation recursive call issues. 
Merge pull request !20882 from 张清华/opt
 2021-07-27 01:00:39 +00:00
Zhang Qinghua 8be269c1cc Fix GradOperation issues: 
- Allow the J CNode used multiple as non-call input.
- Check recursive J FG including FV J CNode.
- Add grad functional api.
 2021-07-26 20:47:49 +08:00
yangzhenzhang 80e5cc0e52 add parallel op for gatherd 2021-07-26 11:14:25 +08:00
i-robot c80098b261 !20712 [Auto parallel] Enable All2All when inferring redistribution ops 
Merge pull request !20712 from Xiaoda/76-change-alltoall-redistribution
 2021-07-24 07:07:16 +00:00
i-robot 26bfbf9124 !18282 [assistant][ops]New operator implementation, include HSigmoid and HSigmoidGrad 
Merge pull request !18282 from 张璇/hsigmoid_grad
 2021-07-24 06:22:46 +00:00
Xiaoda Zhang bb5d4212f7 enable All2All in infering redistribution ops 2021-07-24 09:09:01 +08:00
i-robot 1e1d7d5739 !20443 Add numpy-native ut/st 
Merge pull request !20443 from 杨林枫/add_numpy_ut
 2021-07-23 11:24:39 +00:00
wanglixin 33e93e296c [fix][assistant][I3PYD0] fix bug in the Ascend operator HSigmoid and HSigmoidGrad 2021-07-23 16:33:16 +08:00
wild-fox b6c575689d [feat][assistant][I3PYD0] add new Ascend operator HSigmoid 2021-07-23 16:20:51 +08:00
wanglixin a377ade89f [feat][assistant][I3PYD3] add new Ascend operator HSigmoidGrad 2021-07-23 16:20:51 +08:00
i-robot 0f8a21693b !18266 [assistant][ops]New operator implementation, include SoftShrink and SoftShrinkGrad 
Merge pull request !18266 from 张璇/softshrink
 2021-07-23 06:40:47 +00:00
i-robot 69a7ef8632 !20707 [AutoParallel]AutoParallel support control flow 
Merge pull request !20707 from lichen/auto_parallel_support_control_flow
 2021-07-23 06:22:12 +00:00
i-robot bcb49f10b4 !20702 Fix NumpySlicesDataset not accept NumPy as data 
Merge pull request !20702 from xiaotianci/fix_numpy_slices
 2021-07-23 03:31:29 +00:00
i-robot 7666b6e388 !20708 fix exception type to TypeError 
Merge pull request !20708 from xychow/fix-exception-type
 2021-07-23 02:48:49 +00:00
i-robot e8448f972b !20725 Support the tensor of string dtype. 
Merge pull request !20725 from 张清华/opt
 2021-07-23 02:12:48 +00:00
Zhang Qinghua f91c697efc Support the tensor of string dtype. 2021-07-22 19:05:37 +08:00
lichenever 3c7cfb7c08 auto_parallel_support_control_flow 2021-07-22 17:31:31 +08:00
Xiao Tianci 53c01c437d fix NumpySlicesDataset not accept numpy 2021-07-22 15:46:37 +08:00
wangrao124 463ca2434c add numpy-native ut/st test files 2021-07-22 14:47:00 +08:00
zhousiyi 9319eff958 change the error type from RuntimeError to TypeError 2021-07-22 06:38:12 +00:00
Lizxxy 5d00d482e4 [feat][assistant][I3PYDC] add new Ascend operator SoftShrinkGrad 2021-07-20 17:55:02 +08:00
zx be26e62080 [feat][assistant][I3PYDB] add new Ascend operator SoftShrink 2021-07-20 17:52:46 +08:00
i-robot a7d40fc220 !20520 [AutoParallel]Add op AllToAllv 
Merge pull request !20520 from lichen/add_op_AllToAllv
 2021-07-20 07:57:03 +00:00
i-robot ed4c9682b5 !20505 limit the scope of lift free variable 
Merge pull request !20505 from xychow/limit-lift-scope
 2021-07-20 06:10:17 +00:00
lichenever 8c1998fd6b add_op_AllToAllv 2021-07-20 10:49:28 +08:00
i-robot c9d3c1d346 !20411 enable optimizer parallel for inference 
Merge pull request !20411 from gziyan/enable_opt_shard_predict
 2021-07-20 01:37:06 +00:00
i-robot 6061194083 !20490 update check strategy for conv2d 
Merge pull request !20490 from yangzhenzhang/update-check-strategy-for-conv2d
 2021-07-20 01:23:08 +00:00
zhousiyi 597f29ea7d limit the lambda lift scope to the func_graph passed 2021-07-20 00:37:21 +00:00
zhousiyi b590f6d929 don't replace u with fprop_u in primal_graph and bprop_fg 2021-07-19 08:14:40 +00:00
yangzhenzhang b31cd27a08 update check strategy for conv2d 2021-07-19 15:03:26 +08:00
wangkc123 b381e0be9d [feat] [assistant] [I3CKER] add new dataset operator SBD 2021-07-17 21:02:30 +08:00
Ziyan 1c9166e0a6 remove restriction for opt shard in inference 2021-07-16 17:16:12 +08:00
Xiaoda Zhang 04381273b3 Add the sharding propagation function: 
1) users configure sharding strategies for operators;
2) framework will propagate the strategies from configured-ops to
non-configured ops using BFS;
3) the propagation goal is to minimize redistribution communication
cost;
 2021-07-14 10:54:18 +08:00
i-robot ea440db85e !18488 Remove Parameter Check in PyNative mode 
Merge pull request !18488 from caifubi/master-pynative-no-parameter
 2021-07-05 12:05:46 +00:00
i-robot 8508c9eb45 !18179 [MD] add slice patches op in c++ and python 
Merge pull request !18179 from liyong126/slice_patches_op
 2021-07-05 07:04:45 +00:00
i-robot 4a8225eaf4 !19160 Fix parameter check of Rotate and GaussianBlur API 
Merge pull request !19160 from xiaotianci/fix_rotate_and_gaussian_blur
 2021-07-05 06:30:46 +00:00
i-robot b93907fdca !19246 Change Loss to LossBase 
Merge pull request !19246 from chenhaozhe/change-loss-base
 2021-07-05 01:24:23 +00:00
liyong 9a1de0af65 add slice patches in python and c++ 2021-07-05 09:16:47 +08:00
zhousiyi a5b4e7bbf8 lift fv before grad except weight, then convert 
switch(cond, partial(g1, xs), partial(g2, ys))(Zs)
 to
 switch(cond, g1, g2)(Xs, Ys, Zs)

 switch_layer(index, make_tuple(partial(g1, xs), partial(g2, ys)))(Zs)
 to
 switch_layer(index, make_tuple(g1, g2))(Xs, Ys, Zs)

put Zs at last when unifyparameter as it may have u-monad or io-monad

use joined args other than broadened one as some extra parameter which is not a parameter of while_header can be add to while_body

inline fprop_switch forcely

reorder the parameter if one of the parameter is Monad when incorporate call

incorporate switch tuple_getitem if item 0 of tuple is EnvInstance or
item 1 of tuple is bprop function

addn with shape() and shape(1)

remove context_ from FuncGraphEvaluator to make it re-entry able to resolve evaluator stuck issue because of re-entry of the same FuncGraphEvaluator
 2021-07-03 00:03:37 +08:00
chenhaozhe 086a871975 Change Loss to LossBase 2021-07-02 16:41:02 +08:00
Xiao Tianci 8cdd0d8d90 fix param check for Rotate and GaussianBlur 2021-07-01 20:31:33 +08:00
i-robot 8102d68b8b !18420 Give concreted error when mappable dataset lack __len__ method 
Merge pull request !18420 from luoyang/API-check-pybind-name
 2021-06-29 07:48:03 +00:00
YangLuo 17c121b087 Give concreted error when mappable dataset lack __len__ method 2021-06-29 11:13:12 +08:00
lichenever db8850a4a3 pipeline_support_predict_master 2021-06-26 09:25:59 +08:00
i-robot 905cba5ae0 !18788 Fix cache_admin stderr message and TFRecord get_dataset_size() when cached 
Merge pull request !18788 from lixiachen/fix_stderr_msg
 2021-06-24 17:52:10 +00:00
i-robot 708e56f659 !17899 Fix compile cache bug for resent50 
Merge pull request !17899 from LiangZhibo/cache
 2021-06-24 13:29:58 +00:00
Ziyan be1f5a43d7 opt shard fit micro batch 2021-06-24 14:52:19 +08:00
l00591931 8ae5d7cc84 Fix compile cache for resnet50 2021-06-24 14:36:24 +08:00
yangzhenzhang 69acf757d0 add parallel op for conv2d backprop input 2021-06-24 10:01:49 +08:00
Lixia Chen 1f03b16e0e Fix cache_admin server start stderr output 
Fix TFRecord get_dataset_size() when cached
 2021-06-23 18:32:54 -04:00
Harshvardhan Gupta 6845a16b44 fix coredump with large max_rowsize and add arg validations 2021-06-23 09:31:11 -04:00
YangLuo 4e9f6d54f7 update cpp api & doc 2021-06-23 11:14:52 +08:00
i-robot dca5504fd4 !15672 [assistant][RGB2BGR] 
Merge pull request !15672 from QingfengLi/rgb2bgr
 2021-06-22 12:48:04 +00:00
chenx2ovo 4b98099dcb [feat][assistant][I3CEGQ] add op rgb2bgr 2021-06-21 16:16:50 +08:00
yangzhenzhang 24370b5613 add parallel op for maxpool 2021-06-21 09:00:56 +08:00
i-robot f6cda391a9 !18487 remove the redundant code, add docstring of operator init and add default valuefor args. 
Merge pull request !18487 from wangshuide/wsd_master_warn
 2021-06-18 09:38:26 +00:00
i-robot ec999d3fa5 !18477 Modify the error message of abstract join 
Merge pull request !18477 from huangbingjian/abstract_join
 2021-06-18 09:10:29 +00:00
huangbingjian d695554ae5 modify the error message of abstract join 2021-06-18 14:12:10 +08:00
i-robot ff3ad7428a !18413 add parallel op for batch norm 
Merge pull request !18413 from yangzhenzhang/add-parallel-op-for-batchnorm
 2021-06-18 03:08:07 +00:00
caifubi 95695711d7 Remove PyNative Parameter Check 2021-06-18 09:46:27 +08:00
i-robot ab3259c43a !18292 MD Profiling UT: Check CPU util file. Add sequential pipeline UTs 
Merge pull request !18292 from cathwong/ckw_mon_py_analyze_ut4
 2021-06-17 21:47:10 +08:00
wangshuide2020 185ddbbe66 remove the redundant code, add docstring of operator init and add default value for args. 2021-06-17 20:29:52 +08:00
yangzhenzhang af0d28de48 add parallel op for batchnorm 2021-06-17 15:43:24 +08:00
liyong 2989a5a23b fix some bugs 2021-06-17 11:56:10 +08:00
Cathy Wong c37eb350f6 MD Profiling UT: Check CPU util file. Add sequential pipeline UTs 2021-06-16 15:30:59 -04:00
i-robot 7ff63a8e70 !17894 Add support for mindir encryption 
Merge pull request !17894 from liuluobin/master
 2021-06-15 15:15:40 +08:00
i-robot 85d860e6a2 !16457 [AutoParallel]pipeline_split_adapt_master 
Merge pull request !16457 from lichen/pipeline_split_adapt_master
 2021-06-11 11:37:40 +08:00
liuluobin 5b9b46224b Add encryption support for mindir 2021-06-11 09:33:45 +08:00
i-robot 21513404c4 !17082 set default context mode to GRAPH_MODE 
Merge pull request !17082 from huangbingjian/change_context_mode
 2021-06-10 21:21:46 +08:00
lichenever db5d508356 pipeline_split_adapt_master 2021-06-10 20:17:33 +08:00
i-robot dc9720cbb2 !17999 add parallel operator for conv2d 
Merge pull request !17999 from yangzhenzhang/add-parallel-operator-for-conv2d
 2021-06-10 20:05:45 +08:00
i-robot 62a165a3a2 !16917 Add Crop Python API for CV data processing 
Merge pull request !16917 from xiaotianci/crop
 2021-06-10 17:16:04 +08:00
i-robot c293f06b27 !17373 add docs, user-example and assertion for rearrange_inputs 
Merge pull request !17373 from zhiqwang/rearrange-inputs-docs
 2021-06-10 16:17:23 +08:00
yangzhenzhang 7a40741048 add parallel operator for conv2d 2021-06-10 14:58:51 +08:00
i-robot 3a13dde14d !17761 add save ckpt info 
Merge pull request !17761 from changzherui/add_ckpt_info
 2021-06-10 11:01:18 +08:00
i-robot b79400296a !17959 fix optimizer weight shard config 
Merge pull request !17959 from gziyan/add_optimizer_weight_shard_config
 2021-06-10 10:49:17 +08:00
Xiao Tianci a54e65a7ad add Crop Python API 2021-06-10 09:46:57 +08:00
i-robot e60f5f12f5 !17836 Add Rotate API for CV data processing 
Merge pull request !17836 from xiaotianci/rotate
 2021-06-10 09:29:18 +08:00
changzherui 7a05132ed4 add ckpt save info 2021-06-09 22:42:27 +08:00
Cathy Wong a8de1327d9 MD Profiling Analyze: Add class BottleneckAnalyzer 2021-06-09 09:24:32 -04:00
zhiqiang f43d720eb0 Add docs and user-example for rearrange_inputs 2021-06-09 04:19:32 -04:00
huangbingjian ad8f73f32b set default context mode to GRAPH_MODE 2021-06-09 14:40:49 +08:00
i-robot 50f11d5439 !17503 dataset: enhance the expression of error msg 
Merge pull request !17503 from ms_yan/log_modify
 2021-06-08 22:25:04 +08:00
Xiao Tianci 9c4c1c6a77 add Rotate Python API 2021-06-08 22:19:15 +08:00
i-robot 3a63a66d64 !17807 MD Profiling UT: Add MD Analyze UT for MinddataProfilingAnalyzer 
Merge pull request !17807 from cathwong/ckw_mon_py_analyze_ut3
 2021-06-08 21:52:55 +08:00
ms_yan be65ebcb28 complete dataset log 2021-06-08 16:45:47 +08:00
mindspore-ci-bot 8934e4a513 !17879 dynamic min max shape phase 2 
From: @luoyang42
Reviewed-by: @liucunwei,@jonyguo
Signed-off-by: @liucunwei
 2021-06-08 14:49:13 +08:00
Ziyan 95ac0f6d58 fix optimizer weight shard config 2021-06-08 10:44:17 +08:00
Cathy Wong b7342efe12 MD Profiling UT: Add MD Analyze UT. Add more pipeline profiling UTs. 2021-06-07 11:00:34 -04:00
luoyang dad289c679 dynamic min max shape phase 2 2021-06-07 20:06:26 +08:00
Zhenglong Li 2c7d1bf603 Implement new gnn feature 2021-06-07 10:20:06 +08:00
mindspore-ci-bot e5a189a4f0 !17520 Optimize exception info when compile net failed 
From: @irmo
Reviewed-by: @ginfung,@zh_qh
Signed-off-by: @zh_qh
 2021-06-05 12:04:28 +08:00
mindspore-ci-bot e19e14295a !17773 adapt offline debugger to new dump, sync support for iteration ranges, GPU default dump mode correction 
From: @john_tzanakakis
Reviewed-by: @nsyca,@mikef
Signed-off-by: @mikef
 2021-06-05 02:46:50 +08:00
John Tzanakakis 7d460de8b4 adapt offline debuger to new dump, sync support for iteration ranges, GPU default dump mode correction 2021-06-04 08:38:50 -04:00
mindspore-ci-bot 7d9bf65654 !16755 support list add list in net in GraphMode. 
From: @fenglovebei
Reviewed-by: @zh_qh
Signed-off-by: @zh_qh
 2021-06-04 16:37:40 +08:00
huanghui 29f632613f optimize log 2021-06-04 12:32:44 +08:00
mindspore-ci-bot 97989c3bbc !17669 Substitute _Loss for Loss 
From: @c_34
Reviewed-by: @guoqi1024,@liangchenghui
Signed-off-by: @guoqi1024,@liangchenghui
 2021-06-04 10:20:00 +08:00
mindspore-ci-bot a3f2b92839 !17638 modify vgg16 network for clould 
From: @zhanghuiyao
Reviewed-by: @c_34,@wuxuejian
Signed-off-by: @c_34
 2021-06-04 09:21:30 +08:00
fenglovebei 76b884dea9 list add list 2021-06-03 21:16:30 +08:00
chenhaozhe 9da8534396 change _Loss to Loss 2021-06-03 15:26:59 +08:00
zhanghuiyao 36ec89656a modify vgg16 network for clould 2021-06-03 11:39:27 +08:00
mindspore-ci-bot b52f9ddb08 !17060 Add HorizontalFlip and VerticalFlip for CV data processing 
From: @tiancixiao
Reviewed-by: @liucunwei
Signed-off-by: @liucunwei
 2021-06-02 17:48:28 +08:00
mindspore-ci-bot c4757f0692 !17461 MD Profiling Analyze: Handle cpu util with missing ops. Enhance UTs. 
From: @cathwong
Reviewed-by: @robingrosman
Signed-off-by: @robingrosman
 2021-06-02 11:12:59 +08:00
mindspore-ci-bot c77e7de1dc !17313 fix static check 
From: @jiang-shuqiang
Reviewed-by: @yelihua,@ouwenchang
Signed-off-by: @ouwenchang
 2021-06-02 08:50:37 +08:00
mindspore-ci-bot ae2e7c1288 !17541 Fix MD Cache code check warnings [master] 
From: @lixiachen
Reviewed-by: @pandoublefeng,@robingrosman
Signed-off-by: @robingrosman
 2021-06-02 04:53:54 +08:00
Lixia Chen 8c1b561149 Fix cache code check warnings 2021-06-01 10:02:38 -04:00
mindspore-ci-bot a92a450881 !17383 Optimize exception info print 
From: @irmo
Reviewed-by: @zh_qh,@ginfung,@ginfung
Signed-off-by: @zh_qh
 2021-06-01 17:43:24 +08:00
Cathy Wong f8beb933ad MD Profiling Analyze: Handle cpu util with missing ops. Enhance UTs. 2021-05-31 20:33:19 -04:00