Commit Graph

3703 Commits

Author SHA1 Message Date
Zhang Qinghua 9fbd118319 Handle interpreted node as input, set function Parameters and update local params if need. 2021-09-18 17:34:50 +08:00
i-robot ebe094ac0f !21829 [assistant][ops] Add New Cdist and CdistGrad
Merge pull request !21829 from 孟权令/Cdist
2021-09-18 09:23:27 +00:00
i-robot e87f0be14f !23707 fix summary isolation
Merge pull request !23707 from jiangshuqiang/temp
2021-09-18 09:23:25 +00:00
i-robot 6489dacdab !18114 [assistant][ops]Add new operator Magphase
Merge pull request !18114 from YJfuel123/Magphase
2021-09-18 07:26:34 +00:00
i-robot 92287b86d8 !23471 Fix white list error msg synax error
Merge pull request !23471 from xiefangqi/md_white_list_optimization
2021-09-18 05:03:40 +00:00
jiangshuqiang c2bd061889 fix summary isolation 2021-09-18 10:59:14 +08:00
i-robot 95e56d0912 !23212 enable profiling warning
Merge pull request !23212 from mindspore_ding/enable_profiling_master_0910
2021-09-18 02:04:37 +00:00
zhoufeng 1f934bd782 check neighbor attr type
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2021-09-17 21:15:37 +08:00
dingpeifei 7523b320d7 enable profiling warning 2021-09-17 17:09:56 +08:00
葛崇林 a05a5de073 [feat][assistant][I3ALC5] add new method Magphase 2021-09-17 16:02:46 +08:00
i-robot f5af432e04 !16922 [assistant][Vol]
Merge pull request !16922 from QingfengLi/Vol
2021-09-17 06:51:49 +00:00
SichongHao 5412382e16 [feat][assistant][I3T91W][I3T91X]add new operator Cdist and CdistGrad 2021-09-17 13:58:53 +08:00
chenx2ovo 9e62623b4a [feat][assistant][I3CEGI] add op vol 2021-09-17 09:34:20 +08:00
ms_yan 0a365e91bf modify log in kernel part 2021-09-16 22:09:21 +08:00
i-robot a5b793463a !23099 Correct wrong info when using ms_function to decorate bprop
Merge pull request !23099 from JoyLvliang/correct_wrong_info_when_using_ms_function_with_bprop
2021-09-16 08:46:41 +00:00
i-robot 89119ae470 !23553 fix: pyfunc cause hung when it is a generator which can't be serialize
Merge pull request !23553 from guozhijian/fix_pyfunc_hung_when_yield
2021-09-16 08:44:50 +00:00
zhuyuxiao 79d99323a2 rename gather 2021-09-16 16:07:05 +08:00
7347157+joylvliang@user.noreply.gitee.com 6e59598f99 correct_wrong_info_when_using_ms_function_with_bprop 2021-09-16 14:12:55 +08:00
huangxinjing 0b89d5c9c4 fix batch size error 2021-09-16 10:56:40 +08:00
Guo Zhijian f49bacde09 fix: pyfunc hung when it's a yield func 2021-09-16 09:20:44 +08:00
i-robot 57b8c8e2d9 !23310 [MD] fix error message of mindrecord
Merge pull request !23310 from liyong126/fix_log_msg
2021-09-16 00:45:11 +00:00
i-robot e5af07d519 !23538 minddata error message optimize
Merge pull request !23538 from luoyang/log_update
2021-09-16 00:42:42 +00:00
i-robot 4a553c8d57 !16607 [assistant][Fade]
Merge pull request !16607 from QingfengLi/Fade
2021-09-15 14:54:16 +00:00
i-robot 87fac9a520 !23476 fix hung when user return Tensor in generator
Merge pull request !23476 from guozhijian/fix_generator_hung_when_return_mindspore_tensor
2021-09-15 10:17:24 +00:00
YangLuo 9d89de5765 minddata error message optimize 2021-09-15 18:05:02 +08:00
liyong 65f3365a2a fix mindrecord log 2021-09-15 16:18:40 +08:00
i-robot 0d914dd427 !22638 Add ut test for offline debugger
Merge pull request !22638 from sabrinasun_59ee/ut
2021-09-15 06:28:47 +00:00
jonyguo c408867085 fix: hung when user return Tensor in generator 2021-09-15 14:13:33 +08:00
i-robot 0a33f88d48 !23419 log error level information in python when GLOG_v=4
Merge pull request !23419 from huangbingjian/exception_log
2021-09-15 01:29:12 +00:00
i-robot bbdacd41f4 !20585 add security isolate for save_graphs
Merge pull request !20585 from huanghui/add-security-isolate-for-DumpIR
2021-09-15 01:25:46 +00:00
sabrinasun 3a349a9219 add ut test for offline debugger 2021-09-14 18:46:22 -04:00
xiefangqi a91c87c581 fix some syntax error 2021-09-14 21:29:02 +08:00
chenx2ovo 1a3196b052 [feat][assistant][I3CEGF] add op fade 2021-09-14 19:08:37 +08:00
i-robot db19a40280 !23365 add print op security
Merge pull request !23365 from fangzehua/print_sec
2021-09-14 09:01:31 +00:00
i-robot c6a99428cd !23153 Update the operator in order to let users better understand the reason for the error of the operator part: nn_ops and array_ops
Merge pull request !23153 from dinglinhe/dlh_code_ms_I43QY0_nn_ops
2021-09-14 06:33:39 +00:00
i-robot 2b4cdea48a !23331 batch parallel operator replace input shape from construct
Merge pull request !23331 from yangzhenzhang/modify-batch-parallel-info
2021-09-14 06:32:45 +00:00
huangbingjian 6ba47653bf log error level information in python when GLOG_v=4 2021-09-14 14:23:55 +08:00
huanghui ba66c0d491 add security isolate for save_graphs 2021-09-14 10:24:12 +08:00
i-robot 32c2b77595 !19093 [assistant][ops] Add new audio operator Biquad
Merge pull request !19093 from 杨旭华/Biquad
2021-09-14 01:52:01 +00:00
dinglinhe 9a8c1b3c73 array_ops error recti and others 2021-09-14 09:12:02 +08:00
i-robot 6dcfe64501 !23264 python serdes bug fix
Merge pull request !23264 from zetongzhao/deserialize
2021-09-13 15:53:05 +00:00
i-robot 0aa167cdf4 !23240 maybe max open files in mr or onehot fail in pytransform
Merge pull request !23240 from guozhijian/fix_max_open_files_and_onehot
2021-09-13 13:51:09 +00:00
i-robot e149a15ace !23002 Error log optimizer
Merge pull request !23002 from zhangzhaoju/master_syntax
2021-09-13 13:43:40 +00:00
i-robot dc45c64a78 !23207 Adding security isolation to debugger
Merge pull request !23207 from sabrinasun_59ee/macro
2021-09-13 12:07:29 +00:00
i-robot 5abd4821ce !23357 Add DatasetName method for out developer
Merge pull request !23357 from xiefangqi/md_white_list_optimization
2021-09-13 12:06:49 +00:00
i-robot 3e1d1ff4d3 !18671 [assistant][ops]New operator implementation, include SBUDataset
Merge pull request !18671 from Wangsong95/sbu_dataset
2021-09-13 11:56:13 +00:00
liannai 631f49f044 [feat][assistant][I3T96A] Add new audio operator Biquad 2021-09-13 19:18:50 +08:00
fangzehua 4ccc635a07 add print security 2021-09-13 17:45:36 +08:00
i-robot bdfd3877f8 !23300 Optimize of exception log of AD
Merge pull request !23300 from YuJianfeng/dfx
2021-09-13 09:35:18 +00:00
yangzhenzhang 1b8eb283e4 modify batch parallel info 2021-09-13 16:28:56 +08:00
zhangzhaoju 4296881a16 syntax 2021-09-13 15:20:53 +08:00
xiefangqi 465dd25d74 add virtual DatasetName method 2021-09-13 15:17:32 +08:00
sabrinasun 220245f592 add security isolation to online and offline debugger 2021-09-12 23:01:15 -04:00
i-robot 87381a1cf9 !17806 [assistant][ops] DcShift Op
Merge pull request !17806 from 杨旭华/DCShift
2021-09-13 01:29:14 +00:00
i-robot c9ff7242a4 !23298 minddata engine optimize white list error msg
Merge pull request !23298 from xiefangqi/md_white_list_optimization
2021-09-13 01:19:15 +00:00
Carry955 0ba84345b0 [feat][assistant][I3J6U3] add new audio operator DCShift 2021-09-11 23:58:18 -07:00
jonyguo da78a17730 fix: may max openfiles in mindrecord and onehot error in py_transform
and cache_admin rpath
2021-09-12 00:25:07 +08:00
yujianfeng 752bdde06d Optimize of exception log of AD 2021-09-11 18:07:50 +08:00
xiefangqi ff73e4ccd7 fix white list error msg 2021-09-11 17:36:23 +08:00
Isaac17555 53fc99b914 [feat][assistant][I3T96B]add new data operator LFilter 2021-09-11 02:05:43 -07:00
i-robot 0071667155 !23039 [Fallback] Fix previous block parameters problem and add test cases.
Merge pull request !23039 from 张清华/opt_fallback
2021-09-11 07:39:02 +00:00
i-robot a61c2c5cfe !17885 [assistant][ops]Add new operator EqualizerBiquad
Merge pull request !17885 from YJfuel123/EqualizerBiquad
2021-09-11 06:40:29 +00:00
i-robot 9b7a966174 !21262 [assistant][ops]New operator implementation, include SparseApplyRMSPropD
Merge pull request !21262 from 梁秀波/SparseApplyRMSPropD
2021-09-11 06:01:29 +00:00
i-robot 76fac95591 !23069 Modify error content
Merge pull request !23069 from huchunmei/master
2021-09-11 03:50:52 +00:00
YJfuel123 16150d394f [feat][assistant][I3ALd1] add new operator EqualizerBiquad 2021-09-11 10:36:20 +08:00
ckczzj af97ba4a77 [feat][assistant][I3J6VH] add new data operator SBU 2021-09-11 09:58:17 +08:00
zetongzhao 719a207040 deserialize fix 2021-09-10 15:19:59 -04:00
i-robot 7b4f361ca7 !23232 Fix multiprocessing attr error
Merge pull request !23232 from xiefangqi/md_fix_map_pool_issue
2021-09-10 14:59:40 +00:00
i-robot 6d709c7254 !19624 [assistant][ops] Add new dataset operator DIV2K.
Merge pull request !19624 from Rainfor/div2k
2021-09-10 14:59:21 +00:00
xiefangqi 66c5f937dd fix attr failed problem 2021-09-10 18:01:04 +08:00
wangkc123 3daf3a4d5f [feat] [assistant] [I3CKEK] add new dataset operator DIV2K 2021-09-10 17:55:34 +08:00
Zhang Qinghua bcfb274074 [Fallback] Fix previous block parameters problem, and add test cases. 2021-09-10 16:43:46 +08:00
robert_luo_yibo ce71699734 [feat][assistant][I3CEG5] add new data OP MuLawDecoding 2021-09-10 15:49:46 +08:00
huchunmei c75773cf37 Modify error content 2021-09-10 15:21:33 +08:00
i-robot 32cc5d79b0 !18670 [assistant][ops]New operator implementation, include USPSDataset
Merge pull request !18670 from Wangsong95/usps_dataset
2021-09-10 03:06:19 +00:00
i-robot f91e1440c8 !17810 [assistant][ops][DeemphBiquadOp]
Merge pull request !17810 from Isaac/DeemphBiquad
2021-09-10 03:05:41 +00:00
i-robot 2cc8c851c5 !23141 mkdir rank_id 0909
Merge pull request !23141 from mindspore_ding/mkdir_rankid_master_0909
2021-09-10 02:45:54 +00:00
i-robot 725cf63118 !23187 upgrade Ascend software package 09 Sep 21
Merge pull request !23187 from yanghaoran/upgrade_ascend_0909
2021-09-10 01:55:13 +00:00
i-robot 0abff9ad65 !23108 Fix spelling error for transformer
Merge pull request !23108 from huangxinjing/fix_spell_error
2021-09-10 01:29:32 +00:00
ckczzj d7c702e9d4 [feat][assistant][I3J6VL] add new data operator USPS 2021-09-09 21:46:57 +08:00
yanghaoran 0ced8775c4 upgrade Ascend software package 09 Sep 21 2021-09-09 20:30:22 +08:00
huangxinjing e02f553010 Fix spell error and add mode check 2021-09-09 18:50:53 +08:00
i-robot 5c72e9d7c6 !23078 Get bprop from python when the bprop mindir dir does not exist
Merge pull request !23078 from YuJianfeng/bprop_mindir
2021-09-09 09:51:14 +00:00
i-robot e37b7374ae !22434 [MoE] Adding a MoE implementation
Merge pull request !22434 from Xiaoda/84-add-moe-layer
2021-09-09 09:06:56 +00:00
dingpeifei 992d6a6dbc mkdir rank_id 2021-09-09 16:14:54 +08:00
i-robot 936940da8e !22666 [assistant][ComplexNorm]
Merge pull request !22666 from QingfengLi/ComplexNorm
2021-09-09 06:41:53 +00:00
Isaac 5dc6c7fe96 [feat][assistant][I3J6U6]add new data operator DeemphBiquad 2021-09-09 14:34:24 +08:00
Xiaoda Zhang 5613c0b974 add a moe implementation:
1) extend the Liner cell for including BatchMatMul implementation, in
which the first dimension indicates the expert number;
2) implement a Switch (top1) router;
3) implement a MoE cell, which extends the FeedForward cell.
2021-09-09 11:53:42 +08:00
i-robot 9ad56e86ab !17846 [assistant][ops]Add new operator HighpassBiquad
Merge pull request !17846 from YJfuel123/HighpassBiquad
2021-09-09 02:06:41 +00:00
i-robot a918783f1a !22623 Add Random operation with Multi Field
Merge pull request !22623 from shenwei41/operation_dev
2021-09-09 01:49:04 +00:00
yujianfeng dfe1b05b28 Get bprop from python when the bprop mindir dir does not exist 2021-09-09 09:05:19 +08:00
i-robot b21da536d3 !22784 serdes python operations by pyfunc
Merge pull request !22784 from zetongzhao/deserialize
2021-09-08 17:18:57 +00:00
zetongzhao 0d389f3f0c serdes python operations 2021-09-08 09:05:11 -04:00
shenwei41 a8d02ab782 Add Random operation with MultiField 2021-09-08 19:29:23 +08:00
i-robot 938324b397 !19362 [assistant][ops] Add new dataset operator Cityscapes.
Merge pull request !19362 from Rainfor/cityscapes
2021-09-08 09:14:43 +00:00
i-robot 77424eaad5 !23004 Add args Check for Transformer
Merge pull request !23004 from huangxinjing/args_check
2021-09-08 08:24:06 +00:00
yaoyuan 85a1b55b47 [feat] [assistant] [I3ALCL] add new operator HighpassBiquad 2021-09-08 15:12:40 +08:00
huangxinjing 6cea07f749 Add args check 2021-09-08 09:12:35 +08:00
i-robot b1be8dfd31 !22851 MD Profiling: Update Connector Init to Remove any existing file
Merge pull request !22851 from cathwong/ckw_mon_seq_pipelines_fix
2021-09-07 19:57:58 +00:00
i-robot d37d57d0fd !22941 parallel_sparse_attention_ops_fix_repeated_cal
Merge pull request !22941 from yao_yf/parallel_sparse_attention_ops_fix_repeated_cal
2021-09-07 13:26:19 +00:00
i-robot 5cf19e8aa6 !22986 Add supported namespace for fallback.
Merge pull request !22986 from 张清华/opt_fallback
2021-09-07 12:50:32 +00:00
Zhang Qinghua 6edea0ed3c Add supported namespace for fallback. 2021-09-07 16:19:25 +08:00
i-robot 5ed105ec01 !22933 Tensor support complex scalar number input
Merge pull request !22933 from zhouyaqiang0/complex_ops
2021-09-06 13:29:21 +00:00
i-robot 990d561ed9 !22974 Fix ut/python/dataset generator 14 occationally segment fault
Merge pull request !22974 from xiefangqi/md_fix_generator_problem
2021-09-06 12:25:22 +00:00
yao_yf 3ef26288a2 parallel_sparse_attention_ops_fix_repeated_cal 2021-09-06 19:57:22 +08:00
i-robot 05a0898352 !22843 Support fallback feature in Graph mode.
Merge pull request !22843 from 张清华/opt_fallback
2021-09-06 11:35:45 +00:00
xiefangqi 57f68d35bd fix generator 14 ut problem 2021-09-06 19:01:51 +08:00
zhouyaqiang 4e07873378 Tensor support complex input 2021-09-06 18:44:26 +08:00
Zhang Qinghua 7203989c26 Support fallback feature in Graph mode (1). 2021-09-06 16:00:03 +08:00
lilei 62e832eaab modify parallel API 2021-09-06 11:45:10 +08:00
i-robot fa12d62d4d !21776 set device_id master 0813
Merge pull request !21776 from mindspore_ding/set_device_id_master_0813
2021-09-06 03:02:58 +00:00
Cathy Wong bc85c606b8 MD Profiling: Update Connector Init to Remove any existing file
to fix sequential pipeline scenario.
2021-09-03 15:45:38 -04:00
yao_yf 3ca73a6d6b broadcast using seqarates world group 2021-09-03 11:21:36 +08:00
i-robot 60d583190b !22815 Update bprop error information
Merge pull request !22815 from JoyLvliang/update_bprop_error_information
2021-09-03 01:31:15 +00:00
i-robot 90c7804d6b !22500 Sort watchpoint hit for offline debugger based on time stamps of dump files
Merge pull request !22500 from parastooashtari/offline_wp_hit_order
2021-09-02 14:47:06 +00:00
dingpeifei b4bc6000dc set device id master 0813 2021-09-02 20:51:50 +08:00
7347157+joylvliang@user.noreply.gitee.com 14d24d4793 update_bprop_error_information 2021-09-02 20:40:55 +08:00
i-robot bbbd6e0254 !22579 modify resizebilinear infer type
Merge pull request !22579 from Simson/opinfer
2021-09-02 01:02:00 +00:00
i-robot 3368287aab !22620 add util: browse dataset
Merge pull request !22620 from luoyang/browse_dataset
2021-09-02 01:00:46 +00:00
Parastoo Ashtari 65d8272352 sort wp hit for offline debugger with time stamp 2021-09-01 14:40:33 -04:00
robert_luo_yibo 3d58da9023 [fix][assistant][I47V0O] fix bug about the wrong output in the operator ComplexNorm 2021-09-01 17:55:38 +08:00
YangLuo 97c1ba380f add util: browse dataset 2021-09-01 16:13:32 +08:00
i-robot d87d0e07c2 !22255 recompute_interface_modify
Merge pull request !22255 from yao_yf/recompute_interface_modify
2021-09-01 08:09:36 +00:00
i-robot fc9d4ed659 !17813 [assistant][ops] Add new audio operator Contrast
Merge pull request !17813 from 杨旭华/Contrast
2021-09-01 06:38:05 +00:00
yao_yf 39055af6e4 recompute interface modify 2021-09-01 10:59:59 +08:00
i-robot cc8d614b25 !22650 fixed sparse attention modify
Merge pull request !22650 from yao_yf/fixed_sparse_attention_modify
2021-09-01 01:29:45 +00:00
simson 7a2fbdda85 modify resizebilinear infer type 2021-09-01 09:03:55 +08:00
wangkc123 70f741bcc1 [feat] [assistant] [I3CKEM] add new dataset operator Cityscapes 2021-08-31 20:03:37 +08:00
Feve1986 82b04d6a1e [feat][assistant][I40FFX] add new Ascend operator SparseApplyRMSPropD 2021-08-31 17:28:38 +08:00
i-robot 389f3a6b6c !21835 make alltoall and neighborexchange to be interface && revert pr 21395
Merge pull request !21835 from zhoufeng/revert-same-input-to-comm-op
2021-08-31 08:53:46 +00:00
yao_yf 82889ec56b fixed sparse attention 2021-08-31 16:11:56 +08:00
i-robot 740c62cbaa !22384 amend_assigin
Merge pull request !22384 from jiangzhenguang/amend_assigin
2021-08-31 06:55:02 +00:00
tongyue 329526dea8 [feat][assistant][I3J6U0] add new data operator Contrast 2021-08-30 19:34:37 -07:00
i-robot bbf9c6a9ad !22529 fix: for loop dataset iterator will cause memory leak
Merge pull request !22529 from guozhijian/fix_for_loop_ds_iter_memory_leak
2021-08-31 01:15:58 +00:00
jiangzhenguang 8812c8fe9b amend assign 2021-08-31 09:10:21 +08:00
yao_yf 68dd138462 add parallel sparse attention ops: dsd_matmul 2021-08-30 18:46:52 +08:00
i-robot 5b8f9ff398 !22096 add parallel sparse attention ops
Merge pull request !22096 from yao_yf/parallel_sparse_attention_ops
2021-08-30 10:43:05 +00:00
i-robot 37ecdba742 !20829 [assistant][ops]New operator implementation, include ApplyAdagradDA
Merge pull request !20829 from 梁秀波/ApplyAdagradDAD
2021-08-30 09:16:19 +00:00
zhoufeng ecae690a19 Revert "fix same node is used by two comm op"
This reverts commit b09d411dc4.

add AlltoAll and NeighborExchange as interface
2021-08-30 16:54:38 +08:00
i-robot a47ab8d643 !18073 [assistant][ops]Add new operator LowpassBiquad
Merge pull request !18073 from YJfuel123/LowpassBiquad
2021-08-30 08:33:39 +00:00
i-robot ff2e34b9f9 !22509 Add ut and st for Jvp, Vjp and Grad
Merge pull request !22509 from LiangZhibo/fix
2021-08-30 08:21:54 +00:00
jonyguo 4c915fdcbb fix: for loop dataset iterator will cause memory leak 2021-08-30 16:08:26 +08:00
zx 0efbedd23c [feat][assistant][I40FFF] add new Ascend operator ApplyAdagradDA 2021-08-30 11:01:18 +08:00
liyong 5a4ff8cfdb fix ci issue 2021-08-30 10:18:06 +08:00
yao_yf b8a9cbe2a3 add cus_matmul_dds parallel ops 2021-08-30 09:44:48 +08:00
Zhang Qinghua a137fa1d0b Optimize the Executors routines.
- Fix the key generating.
- Distinguish the executors.
2021-08-28 17:36:12 +08:00
l00591931 98fad9f08e Add st and ut for jvp vjp and grad 2021-08-28 17:34:23 +08:00
i-robot 535877a47b !22014 Add Fixed Sparse Attention
Merge pull request !22014 from zhihenghu/add_sparse_attention
2021-08-28 07:13:01 +00:00
zhihenghu ce12c02343 Add Sparse Attention
adjut the file structure and name

Deleted extra information

Do some formatting work

Add test case and fix some document

fix imports
2021-08-28 11:50:58 +08:00
i-robot 1639023909 !22263 Add convertcolor operation
Merge pull request !22263 from shenwei41/operation_dev
2021-08-27 12:33:43 +00:00
i-robot dd907a4d91 !22135 rank id master 0820
Merge pull request !22135 from mindspore_ding/rank_id_master_0816
2021-08-27 08:51:05 +00:00
i-robot ebe75e403b !22444 Apply comments on tensor stat online and offline PR
Merge pull request !22444 from parastooashtari/tensor_level_info_online
2021-08-27 07:42:51 +00:00
d00455729 34262db65e create rank_id dic 2021-08-27 14:24:06 +08:00
liyong c257cf36e2 refactor mindrecord 2021-08-27 09:15:05 +08:00
Parastoo Ashtari bf034bddb5 Apply comments on tensor stat online and offline debugger 2021-08-26 17:40:01 -04:00
i-robot cd4081ac87 !20676 [assistant][ops] Add array operator SplitV
Merge pull request !20676 from 孟权令/SplitV
2021-08-26 13:54:40 +00:00
shenwei41 1295744524 Add ConvertColor Operation 2021-08-26 21:14:28 +08:00
i-robot e6e1f37ae4 !22346 [Core] Fix the bug of scope setting when cloning nodes
Merge pull request !22346 from Xiaoda/86-fix-the-fullname-scope-bug
2021-08-26 13:04:15 +00:00
i-robot e753a3f70a !22416 Transform device_id to rank_id for hccl
Merge pull request !22416 from 张毅辉/Device_id_to_rank_id
2021-08-26 12:09:38 +00:00
haizhouye d96d9e64b0 [feat] [assistant] [I3ALCA] add new LowpassBiquad operator
[feat] [assistant] [I3ALCA] add new LowpassBiquad operator

bugfix

fix

fix
2021-08-26 18:49:21 +08:00
i-robot 7083ec9d37 !21925 add pad mode to maxpool3d
Merge pull request !21925 from jiangzhenguang/amend_maxpool3d
2021-08-26 09:08:37 +00:00
i-robot 8d00a8d803 !22360 Fix Transformer Mirror Error
Merge pull request !22360 from huangxinjing/fix_transformer_mirror_error
2021-08-26 08:16:33 +00:00
zhangyihui 3e5cb3b506 fix bugs for device_id_to_rank_id 2021-08-26 16:15:18 +08:00
i-robot 28e63116f2 !21921 Re-enabling offline debugger ut test
Merge pull request !21921 from sabrinasun_59ee/uttest
2021-08-26 07:50:01 +00:00
i-robot 471c57d3d7 !20046 [assistant][ops] Add New MaskedFill
Merge pull request !20046 from 孟权令/MaskedFill
2021-08-26 07:43:18 +00:00
i-robot a646eb27ab !21616 modify ms function cache key
Merge pull request !21616 from chujinjin/modify_ms_function_cache_key
2021-08-26 07:36:50 +00:00
i-robot 0faf36d5c5 !22187 modify api comment
Merge pull request !22187 from changzherui/mod_dir_auth
2021-08-26 03:01:33 +00:00
i-robot 07eaa1969b !22344 fix compile error when weight is used in while condition
Merge pull request !22344 from xychow/fix-while-loop-with-weight-in-condition
2021-08-26 03:00:38 +00:00
Xiaoda Zhang b2703879c6 fix the scope setting error when cloning nodes 2021-08-26 10:25:38 +08:00
i-robot edcbb68d71 !22386 fix neighborexchange empty input case
Merge pull request !22386 from zhoufeng/fix-neighbor-empty-input-bak
2021-08-26 01:52:10 +00:00
i-robot 5aeec398bb !22369 add test cases for conv2d
Merge pull request !22369 from yangzhenzhang/add-test-cases
2021-08-26 01:46:10 +00:00
i-robot 457a01fd09 !20055 [assistant][ops] Add math operator IndexAdd
Merge pull request !20055 from 孟权令/IndexAdd
2021-08-26 01:15:39 +00:00
sabrinasun a9c6bf45a3 re-enabling offline debugger ut test 2021-08-25 19:05:19 -04:00
changzherui 46319f3198 modify comment 2021-08-26 00:44:44 +08:00
zhoufeng e5a1582e4b fix neighborexchange empty input case
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2021-08-25 21:41:22 +08:00
huangxinjing 62496d75f3 less the interface exposed 2021-08-25 21:22:40 +08:00
i-robot 956ae2bbfd !22223 [assistant][TimeMask and FreqMask]
Merge pull request !22223 from QingfengLi/TimeFreqMask
2021-08-25 10:43:24 +00:00
i-robot acee9b24bc !22284 Change Op name in hccl to Op name in step trace
Merge pull request !22284 from 张毅辉/op_name_of_hccl_to_op_name_of_step_trace
2021-08-25 09:32:55 +00:00
yangzhenzhang 0b9b2a9458 add test cases 2021-08-25 17:22:20 +08:00
jiangzhenguang 8a78b2b7f6 add pad mode to maxpool3d 2021-08-25 16:24:02 +08:00
i-robot 60634c5d11 !21745 Unified format of single machine and multi machine performance data directory
Merge pull request !21745 from 张毅辉/Device_id_to_rank_id
2021-08-25 07:49:29 +00:00
doit a5193df648 [feat] [assistant] [I3T92B] add new array operator MaskedFill 2021-08-25 15:29:37 +08:00
i-robot 36238032a2 !22245 Add pynative switch layer ut test case
Merge pull request !22245 from zjun/switch_layer_ut_test
2021-08-25 07:24:28 +00:00
chujinjin 551fa9ab8b modify ms function cache key 2021-08-25 14:40:45 +08:00
hulx c70731d601 [feat][assistant][I3T924] add new math operator IndexAdd 2021-08-25 14:19:17 +08:00
zhangyihui dab750d1a5 Mapping op_name of hccl to op_name of step trace 2021-08-25 10:51:52 +08:00
chenx2ovo 2f1d974eeb [fix] [assistant] [I465ZG] revise error message and change input param datatype 2021-08-25 10:47:27 +08:00
i-robot 698eb406e2 !20129 [assistant][ops] Add math operator Erfinv
Merge pull request !20129 from 孟权令/Erfinv
2021-08-25 02:44:18 +00:00
i-robot 2edaba38bf !21389 Add Tensor Base and Stat info to offline debugger
Merge pull request !21389 from parastooashtari/tensor_info_levels
2021-08-25 02:08:34 +00:00
i-robot 0adacd1b68 !22226 [AutoParallel]Refacor pipeline code
Merge pull request !22226 from lichen/Refactor_part_of_pipeline
2021-08-25 01:54:18 +00:00
zhangyihui 3d19949eb4 device_id to rank_id 2021-08-25 09:52:23 +08:00
zhousiyi 44bdcb101c fix while loop compile error when weight is used in while condition 2021-08-25 01:33:34 +00:00
i-robot 4e81ea7bb0 !22300 Add ut and st case for non tensor input in pynative
Merge pull request !22300 from JoyLvliang/add_st_ut_case_for_pynative_non_tensor_input
2021-08-25 01:23:34 +00:00
Parastoo Ashtari ff83dee704 Add tensor base and stat info to offline debugger 2021-08-24 18:19:59 -04:00
lichenever 5812076512 Refactor_part_of_pipeline 2021-08-24 21:37:41 +08:00
hulx ca6f3ef155 [feat][assistant][I3T925] add new math operator Erfinv 2021-08-24 21:25:04 +08:00
i-robot 661c83e17f !22274 MD Profiling UT: Use pytest setup and teardown
Merge pull request !22274 from cathwong/ckw_mon_py_analyze_ut5
2021-08-24 13:24:49 +00:00
i-robot 1e47ff7bc3 !22108 modify check strategy for conv2d
Merge pull request !22108 from yangzhenzhang/modify-check-strategy-for-conv2d
2021-08-24 12:01:23 +00:00
hedongdong 09bc1bddf1 [feat][assistant][I3T92H] add new array operator SplitV 2021-08-24 19:54:26 +08:00
i-robot ab758a981c !20044 [assistant][ops] Add New Lerp
Merge pull request !20044 from 孟权令/Lerp
2021-08-24 11:25:44 +00:00
7347157+joylvliang@user.noreply.gitee.com a30800ecc3 add_st_ut_case_for_pynative_non_tensor_input 2021-08-24 16:44:05 +08:00
i-robot 822cedec0a !22153 Convert some ops bprops to mindir
Merge pull request !22153 from YuJianfeng/bprop_mindir
2021-08-24 08:07:46 +00:00
yangzhenzhang f1afaeac5a modify check strategy for conv2d 2021-08-24 16:06:16 +08:00
zjun 779b655cfe Add switch_layter pynative ut test
Signed-off-by: zjun <zhangjun0@huawei.com>
2021-08-24 11:21:13 +08:00
i-robot 6082835501 !22146 dataset: support return bytes in GeneratorDataset
Merge pull request !22146 from ms_yan/decode_bytes
2021-08-24 02:41:18 +00:00
Cathy Wong 3581e7962e MD Profiling UT: Use pytest setup and teardown 2021-08-23 21:09:48 -04:00
yujianfeng 712b9bd013 convert some ops bprops to mindir 2021-08-24 09:09:09 +08:00
i-robot db44b88e1e !22094 MD Profiling: For mismatch op info btwn files, skip bottleneck analysis
Merge pull request !22094 from cathwong/ckw_mon_py_analyze_fixes3
2021-08-23 18:28:51 +00:00
ms_yan 6ecfc34524 add np.frombuffer to support return bytes 2021-08-23 17:31:38 +08:00
ms_yan 36a8886ca2 Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset"
This reverts commit b077aa1cab.

Revert "[feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset"

This reverts commit 4e6f7dc97d.

delete pass_registry_test.cc

comment  hiai_nlu_model_multi.pb related  line
2021-08-23 01:46:38 +08:00
djc b077aa1cab [feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset 2021-08-22 16:26:45 +08:00
djc 4e6f7dc97d [feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset 2021-08-22 13:39:37 +08:00
i-robot 0e7844daa9 !22093 revert merge request 21685
Merge pull request !22093 from guozhijian/revert-merge-21685-master
2021-08-21 09:25:32 +00:00
i-robot 4ba337e0f5 !16667 [assistant][ComplexNorm]
Merge pull request !16667 from QingfengLi/ComplexNorm
2021-08-21 02:44:18 +00:00
doit bf23333b27 [feat] [assistant] [I3T927] add new math operator Lerp 2021-08-20 20:19:41 +08:00
i-robot f34426095c !22084 Move Transformer Code from Mindspore.nn.parallel to mindspore.parallel.nn
Merge pull request !22084 from huangxinjing/transformer_doc_check
2021-08-20 10:40:01 +00:00
huangxinjing d777742904 1. Move the class to mindspore.parallel, support activation sharding 2021-08-20 14:34:10 +08:00
i-robot 954864bfba !22037 incoroporate getitem if indexed node is zeros_like
Merge pull request !22037 from xychow/always-incorporate-getitem-if-zeros-like
2021-08-20 02:14:35 +00:00
i-robot 5d1bb097e2 !22052 Fix probability core dump in MindData coverage test
Merge pull request !22052 from luoyang/issues2
2021-08-20 01:18:06 +00:00
robert_luo_yibo d837cbee0f [feat][assistant][I3CEG8] add new data operator ComplexNorm 2021-08-20 09:07:21 +08:00
Cathy Wong 85931175bc MD Profiling: For mismatch op info btwn files, skip bottleneck analysis.
Add to summary output: per_pipeline_time and per_push_queue_time.
Enhance UT
2021-08-19 12:19:59 -04:00
guozhijian e1df9a2152 revert 'Pull Request !21685 : add function to invert_op' 2021-08-19 22:49:51 +08:00
i-robot 4113aee7d6 !18668 [assistant][ops]New operator implementation, include Flowers102Dataset
Merge pull request !18668 from Wangsong95/flowers102_dataset
2021-08-19 08:41:44 +00:00
YangLuo 9352935ff6 Fix probability core dump in MindData coverage test 2021-08-19 14:34:57 +08:00
i-robot c93bb9936e !20011 [assistant][ops] Add nn operator Roll
Merge pull request !20011 from 孟权令/Roll
2021-08-19 06:28:28 +00:00
i-robot 3ad641cb65 !21685 add function to invert_op
Merge pull request !21685 from Killer/fake_killer
2021-08-19 05:13:39 +00:00
zhousiyi dcd374961e incoroporate getitem if indexed node is zeros_like so AddN(MakeTuple(x, zeros_like)) can be optimized 2021-08-19 03:28:24 +00:00
fake_killer b0bc4bf5da [feat] [assistant] [I44TRS] extend invert_op's function 2021-08-18 21:46:15 +08:00
i-robot dde05c36b8 !21551 auto_parallel_context interface dataset_strategy union
Merge pull request !21551 from yao_yf/auto_parallel_context_dataset_strategy_union
2021-08-18 09:03:18 +00:00
i-robot 415275ae17 !21805 support adafactor model parallel
Merge pull request !21805 from yangzhenzhang/auto-parallel-support-adafactor-opt
2021-08-18 07:20:39 +00:00
hedongdong d76ed25e96 [feat][assistant][I3T92I] add new nn operator Roll 2021-08-18 10:15:17 +08:00
i-robot 264cb4d2e8 !21920 MD Profiling Analyze: Search for device trace file, independent of device_target
Merge pull request !21920 from cathwong/ckw_mon_py_analyze_device_file
2021-08-18 00:57:50 +00:00
i-robot 0d839fa7c6 !21809 Improved Transformer Struture and Add Args Check
Merge pull request !21809 from huangxinjing/transformer_improved
2021-08-17 12:05:25 +00:00
i-robot a77a0b968d !21761 comm_recompute_interface.
Merge pull request !21761 from yao_yf/comm_recompute_interface
2021-08-17 09:14:29 +00:00
yangzhenzhang 7ca64d2235 auto parallel support adafactor opt 2021-08-17 10:36:42 +08:00
yao_yf 5277b229be add cell comm recompute interface 2021-08-17 09:23:21 +08:00
Cathy Wong a2cbd4b5fa MD Profiling Analyze: Search for device trace file
MinddataProfilingAnalyzer() - remove device_target input parm
2021-08-16 15:41:11 -04:00
huangxinjing 18044aff0f 1. Add docstring, elimitate attention mask, tuple append the deocoder return layer past
split attention inputs from two into three

Add input check and modify test case

Fix check error and add check to transformer inputs

add input check to the transformers
2021-08-16 21:08:48 +08:00
Xiao Tianci aae886bcd7 fix crowd contributing code 2021-08-16 19:33:10 +08:00
yao_yf a83bf73298 union auto_parallel_context interface dataset_strategy 2021-08-16 10:54:46 +08:00
i-robot 530da3e37e !21527 fix_reshape_reshape_in_auto_parallel
Merge pull request !21527 from yao_yf/fix_reshape_reshape_in_auto_parallel
2021-08-13 08:29:15 +00:00
i-robot f99effd430 !21755 Fix batch usability problem
Merge pull request !21755 from xiefangqi/md_fix_batch_usability
2021-08-13 07:21:49 +00:00
i-robot d1112f8e9c !17631 [assistant][FrequencyMasking]
Merge pull request !17631 from QingfengLi/FreqMask
2021-08-13 06:48:06 +00:00
xiefangqi e4894a1bf1 fix batch usability problem 2021-08-12 20:12:43 +08:00
i-robot 2650aae9ba !21351 complex support
Merge pull request !21351 from zhouyaqiang0/complex_support
2021-08-12 09:39:15 +00:00
chenx2ovo 53615010a3 [feat][assistant][I3CEGG] add new data OP FrequencyMasking 2021-08-12 15:28:30 +08:00
yao_yf e233880e41 fix reshape depend reshape in auto parallel 2021-08-12 11:45:28 +08:00
i-robot bff5cbda9c !21670 fix: null numpy field in mindrecord will cause read error
Merge pull request !21670 from guozhijian/fix_null_numpy_field_in_mr
2021-08-12 03:39:34 +00:00
zhouyaqiang b81ba100b7 add complex number support 2021-08-12 10:36:43 +08:00
i-robot 63445ff6fd !21627 alltoall exception handle
Merge pull request !21627 from zhoufeng/alltoall_exception
2021-08-12 01:40:22 +00:00
i-robot 6320bf6b7b !21676 check strategy for conv2d
Merge pull request !21676 from yangzhenzhang/check-strategy-for-conv2d
2021-08-12 01:29:37 +00:00
i-robot 73b55cff72 !20794 add adafactor
Merge pull request !20794 from jiangzhenguang/add_adafactor_optimizer
2021-08-12 01:27:03 +00:00
yangzhenzhang d18c813ee4 check strategy for conv2d 2021-08-11 19:12:48 +08:00
zhoufeng 03a56f2bb0 alltoall exception handle
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2021-08-11 17:30:49 +08:00
jonyguo 42b3512a1b fix: when field is none in mr 2021-08-11 17:11:38 +08:00
jiangzhenguang a3bb780ce4 optimize run memory 2021-08-10 20:45:25 +08:00
chenx2ovo e72acf362c [feat][assistant][I3CEGH] add op timemasking 2021-08-10 12:06:07 +08:00
i-robot f154db1bb0 !20680 [assistant][ops] Add New SoftMarginLoss and SoftMarginLossGrad
Merge pull request !20680 from 孟权令/SoftMarginLoss
2021-08-10 02:39:28 +00:00
i-robot 4aaa8126a0 !21528 Add Parallel Print Support
Merge pull request !21528 from huangxinjing/add_print
2021-08-09 10:55:04 +00:00
i-robot dc626617fc !19526 [assistant][TimeStretch]
Merge pull request !19526 from QingfengLi/TimeStretch
2021-08-09 09:40:38 +00:00
i-robot 75429acbe3 !21519 fix waring
Merge pull request !21519 from shenwei41/fix_sqlite
2021-08-09 09:09:18 +00:00
shenwei41 59efbb88ec fix waring 2021-08-09 11:40:52 +08:00
i-robot 8306abeb67 !21168 Only replace the primal user with tuple_getitem once
Merge pull request !21168 from YuJianfeng/ad
2021-08-09 03:19:07 +00:00
huangxinjing 92bad162bd Add print 2021-08-09 11:14:25 +08:00
chenx2ovo 04705e5b0d [feat][assistant][I3CEGC] add op timestretch 2021-08-07 22:53:41 +08:00
i-robot c84e09cf45 !21072 Deserialize - python binding
Merge pull request !21072 from zetongzhao/deserialize_1
2021-08-06 21:47:09 +00:00
zetongzhao 4f199b548c deserialize and tests 2021-08-06 13:35:27 -04:00
yujianfeng cf4121126a Only replace the primal user with tuple_getitem once 2021-08-06 19:23:14 +08:00
i-robot d2ae09d891 !21437 Support ListComp and GeneratorExp in Graph Mode.
Merge pull request !21437 from 张清华/opt
2021-08-06 09:09:47 +00:00
i-robot 51a1ca61f2 !21357 [MD] fix SlicePatches when dealing with some special tensor.
Merge pull request !21357 from liyong126/fix_bug
2021-08-06 08:58:27 +00:00
i-robot 8a8851dc52 !18667 Remove redundant depend
Merge pull request !18667 from huangbingjian/remove_redundant_depend
2021-08-06 07:43:53 +00:00
SichongHao 3d2892b454 [feat][assistant][I3T91Y][I3T91Z]add new operator SoftMarginLoss and SoftMarginLossGrad 2021-08-06 15:13:13 +08:00
liyong 5fea72473c fix HW1 issue 2021-08-06 14:07:26 +08:00
Zhang Qinghua aef396f9f2 Support ListComp and GeneratorExp in Graph Mode. 2021-08-06 11:44:57 +08:00
ckczzj 9d9f33be88 [feat][assistant][I3J6VN] add new data operator flowers102 2021-08-06 10:55:12 +08:00
chenx2ovo aa45e2ebbc [feat] [assistant] [I3CEER] add op AmplitudeToDB 2021-08-06 10:07:29 +08:00
huangbingjian 53b31abf12 remove useless depend 2021-08-05 20:21:24 +08:00
Carry955 98be266585 [feat][assistant][I3J6TQ] add a new operator Angle 2021-08-04 19:41:00 -07:00
i-robot 680e40a43a !16453 [assistant][BassBiquadOp]
Merge pull request !16453 from StyleHang/BassBiquadOp
2021-08-04 10:02:34 +00:00
i-robot f4e07c0dce !17486 [assistant][ops] Add new dataset operator Flickr.
Merge pull request !17486 from Rainfor/wangkc
2021-08-04 08:52:21 +00:00
i-robot a83f8f6f5d !20284 Unify exception info with using the unsupported numpy method
Merge pull request !20284 from huanghui/numpy-in-graph-mode
2021-08-04 08:06:01 +00:00
i-robot d260f38936 !15722 [assistant][AdjustGamma]
Merge pull request !15722 from QingfengLi/adjust_gamma
2021-08-04 03:58:09 +00:00
li-qiyao ba326d76a8 [feat][assistant][I3J6TW] add new data operator BassBiquad 2021-08-03 19:40:12 -07:00
wangkc123 48f5fed1f8 [feat] [assistant] [I3CKEN] add new dataset operator Flickr 2021-08-04 10:20:43 +08:00
chenx2ovo 4191dde45f [feat][assistant][I3CEGM] add op adjust gamma 2021-08-04 02:32:13 +08:00
tongyue 08469e113a [feat][assistant][I3J6TV]add new audio operator BandrejectBiquad 2021-08-03 05:41:53 -07:00
i-robot 2c7b8e73df !16452 [assistant][BandpassBiquadOp]
Merge pull request !16452 from StyleHang/BandpassBiquadOp
2021-08-03 11:08:48 +00:00
i-robot a70b0f3bf4 !18260 [assistant][ops]New operator implementation, include HShrink and HShrinkGrad
Merge pull request !18260 from 张璇/hshrink
2021-08-03 11:00:11 +00:00
i-robot 93af13f332 !19979 dataset: modify some error msg
Merge pull request !19979 from ms_yan/err_msg
2021-08-03 08:53:30 +00:00
i-robot 0a3b4ff84b !21207 modify replace graph for conv2d
Merge pull request !21207 from yangzhenzhang/fix-bugs-for-conv2d
2021-08-03 08:48:37 +00:00
huanghui 3e17650172 Raise NotImplementedError when parsing the numpy methods, but not the numpy constant. 2021-08-03 14:33:22 +08:00
i-robot ef77050348 !18892 [assistant][ops] Add new dataset operator SBD.
Merge pull request !18892 from Rainfor/sbd
2021-08-03 03:33:00 +00:00
yangzhenzhang ef0361a449 fix bugs for conv2d 2021-08-03 10:48:05 +08:00
ms_yan 65870045bc modify some error msg 2021-08-03 09:16:28 +08:00
administrator 29d57a89fb [feat][assistant][I3TDRD]add new audio operator BandpassBiquad 2021-08-02 07:08:47 -07:00
i-robot a81fee280c !16458 [assistant][AllpassBiquadOp]
Merge pull request !16458 from StyleHang/AllpassBiquadOp
2021-08-02 08:40:06 +00:00
Xiaoda Zhang 4b4b3cdaf4 add reduceany operator and extend onehot to multi-dimensions 2021-08-02 08:53:43 +08:00
zhangjie b04036e13c [feat][assistant][I3PYD4] add new data operator HShrink and HShrinkGrad 2021-08-01 20:55:58 +08:00
danansheng accb87606a [feat][assistant][I3PYD4] add new data operator HShrink 2021-08-01 20:52:55 +08:00
Isaac b49e1acc3e [feat] [assistant] [I3J6TM] add new audio operator AllpassBiquad 2021-07-31 16:15:17 +08:00
i-robot 9301de1b54 !21098 fix bug
Merge pull request !21098 from shenwei41/fix_waring
2021-07-31 01:12:21 +00:00
shenwei41 e3385e2564 fix waring to master 2021-07-30 16:37:27 +08:00
i-robot 6e84bf0f0f !16449 [assistant][ops] Add new audio operator BandBiquad
Merge pull request !16449 from StyleHang/BandBiquadOp
2021-07-30 03:35:07 +00:00
liannai 5a341e7e27 [feat] [assistant] [I3J6TS] add new audio operator BandBiquad 2021-07-29 17:57:27 +08:00
huangxinjing 615d1a179d Add transformer layer 2021-07-29 11:10:43 +08:00
i-robot 9f296c58d6 !20960 [AutoParallel]Add replace graph for conv2d
Merge pull request !20960 from lichen/add_replace_graph_for_conv2d
2021-07-28 07:06:41 +00:00
lichenever a7f8024c29 add_replace_graph_for_conv2d 2021-07-28 11:02:21 +08:00
yao_yf dc7dc7d3fa dataset strategy set 2021-07-27 18:44:10 +08:00
i-robot b8901526b9 !20882 Fix GradOperation recursive call issues.
Merge pull request !20882 from 张清华/opt
2021-07-27 01:00:39 +00:00
Zhang Qinghua 8be269c1cc Fix GradOperation issues:
- Allow the J CNode used multiple as non-call input.
- Check recursive J FG including FV J CNode.
- Add grad functional api.
2021-07-26 20:47:49 +08:00
yangzhenzhang 80e5cc0e52 add parallel op for gatherd 2021-07-26 11:14:25 +08:00
i-robot c80098b261 !20712 [Auto parallel] Enable All2All when inferring redistribution ops
Merge pull request !20712 from Xiaoda/76-change-alltoall-redistribution
2021-07-24 07:07:16 +00:00
i-robot 26bfbf9124 !18282 [assistant][ops]New operator implementation, include HSigmoid and HSigmoidGrad
Merge pull request !18282 from 张璇/hsigmoid_grad
2021-07-24 06:22:46 +00:00
Xiaoda Zhang bb5d4212f7 enable All2All in infering redistribution ops 2021-07-24 09:09:01 +08:00
i-robot 1e1d7d5739 !20443 Add numpy-native ut/st
Merge pull request !20443 from 杨林枫/add_numpy_ut
2021-07-23 11:24:39 +00:00
wanglixin 33e93e296c [fix][assistant][I3PYD0] fix bug in the Ascend operator HSigmoid and HSigmoidGrad 2021-07-23 16:33:16 +08:00
wild-fox b6c575689d [feat][assistant][I3PYD0] add new Ascend operator HSigmoid 2021-07-23 16:20:51 +08:00
wanglixin a377ade89f [feat][assistant][I3PYD3] add new Ascend operator HSigmoidGrad 2021-07-23 16:20:51 +08:00
i-robot 0f8a21693b !18266 [assistant][ops]New operator implementation, include SoftShrink and SoftShrinkGrad
Merge pull request !18266 from 张璇/softshrink
2021-07-23 06:40:47 +00:00
i-robot 69a7ef8632 !20707 [AutoParallel]AutoParallel support control flow
Merge pull request !20707 from lichen/auto_parallel_support_control_flow
2021-07-23 06:22:12 +00:00
i-robot bcb49f10b4 !20702 Fix NumpySlicesDataset not accept NumPy as data
Merge pull request !20702 from xiaotianci/fix_numpy_slices
2021-07-23 03:31:29 +00:00
i-robot 7666b6e388 !20708 fix exception type to TypeError
Merge pull request !20708 from xychow/fix-exception-type
2021-07-23 02:48:49 +00:00
i-robot e8448f972b !20725 Support the tensor of string dtype.
Merge pull request !20725 from 张清华/opt
2021-07-23 02:12:48 +00:00
Zhang Qinghua f91c697efc Support the tensor of string dtype. 2021-07-22 19:05:37 +08:00
lichenever 3c7cfb7c08 auto_parallel_support_control_flow 2021-07-22 17:31:31 +08:00
Xiao Tianci 53c01c437d fix NumpySlicesDataset not accept numpy 2021-07-22 15:46:37 +08:00
wangrao124 463ca2434c add numpy-native ut/st test files 2021-07-22 14:47:00 +08:00
zhousiyi 9319eff958 change the error type from RuntimeError to TypeError 2021-07-22 06:38:12 +00:00
Lizxxy 5d00d482e4 [feat][assistant][I3PYDC] add new Ascend operator SoftShrinkGrad 2021-07-20 17:55:02 +08:00
zx be26e62080 [feat][assistant][I3PYDB] add new Ascend operator SoftShrink 2021-07-20 17:52:46 +08:00
i-robot a7d40fc220 !20520 [AutoParallel]Add op AllToAllv
Merge pull request !20520 from lichen/add_op_AllToAllv
2021-07-20 07:57:03 +00:00
i-robot ed4c9682b5 !20505 limit the scope of lift free variable
Merge pull request !20505 from xychow/limit-lift-scope
2021-07-20 06:10:17 +00:00
lichenever 8c1998fd6b add_op_AllToAllv 2021-07-20 10:49:28 +08:00
i-robot c9d3c1d346 !20411 enable optimizer parallel for inference
Merge pull request !20411 from gziyan/enable_opt_shard_predict
2021-07-20 01:37:06 +00:00
i-robot 6061194083 !20490 update check strategy for conv2d
Merge pull request !20490 from yangzhenzhang/update-check-strategy-for-conv2d
2021-07-20 01:23:08 +00:00
zhousiyi 597f29ea7d limit the lambda lift scope to the func_graph passed 2021-07-20 00:37:21 +00:00
zhousiyi b590f6d929 don't replace u with fprop_u in primal_graph and bprop_fg 2021-07-19 08:14:40 +00:00
yangzhenzhang b31cd27a08 update check strategy for conv2d 2021-07-19 15:03:26 +08:00
wangkc123 b381e0be9d [feat] [assistant] [I3CKER] add new dataset operator SBD 2021-07-17 21:02:30 +08:00
Ziyan 1c9166e0a6 remove restriction for opt shard in inference 2021-07-16 17:16:12 +08:00
Xiaoda Zhang 04381273b3 Add the sharding propagation function:
1) users configure sharding strategies for operators;
2) framework will propagate the strategies from configured-ops to
non-configured ops using BFS;
3) the propagation goal is to minimize redistribution communication
cost;
2021-07-14 10:54:18 +08:00
i-robot ea440db85e !18488 Remove Parameter Check in PyNative mode
Merge pull request !18488 from caifubi/master-pynative-no-parameter
2021-07-05 12:05:46 +00:00
i-robot 8508c9eb45 !18179 [MD] add slice patches op in c++ and python
Merge pull request !18179 from liyong126/slice_patches_op
2021-07-05 07:04:45 +00:00
i-robot 4a8225eaf4 !19160 Fix parameter check of Rotate and GaussianBlur API
Merge pull request !19160 from xiaotianci/fix_rotate_and_gaussian_blur
2021-07-05 06:30:46 +00:00
i-robot b93907fdca !19246 Change Loss to LossBase
Merge pull request !19246 from chenhaozhe/change-loss-base
2021-07-05 01:24:23 +00:00
liyong 9a1de0af65 add slice patches in python and c++ 2021-07-05 09:16:47 +08:00
zhousiyi a5b4e7bbf8 lift fv before grad except weight, then convert
switch(cond, partial(g1, xs), partial(g2, ys))(Zs)
 to
 switch(cond, g1, g2)(Xs, Ys, Zs)

 switch_layer(index, make_tuple(partial(g1, xs), partial(g2, ys)))(Zs)
 to
 switch_layer(index, make_tuple(g1, g2))(Xs, Ys, Zs)

put Zs at last when unifyparameter as it may have u-monad or io-monad

use joined args other than broadened one as some extra parameter which is not a parameter of while_header can be add to while_body

inline fprop_switch forcely

reorder the parameter if one of the parameter is Monad when incorporate call

incorporate switch tuple_getitem if item 0 of tuple is EnvInstance or
item 1 of tuple is bprop function

addn with shape() and shape(1)

remove context_ from FuncGraphEvaluator to make it re-entry able to resolve evaluator stuck issue because of re-entry of the same FuncGraphEvaluator
2021-07-03 00:03:37 +08:00
chenhaozhe 086a871975 Change Loss to LossBase 2021-07-02 16:41:02 +08:00
Xiao Tianci 8cdd0d8d90 fix param check for Rotate and GaussianBlur 2021-07-01 20:31:33 +08:00
i-robot 8102d68b8b !18420 Give concreted error when mappable dataset lack __len__ method
Merge pull request !18420 from luoyang/API-check-pybind-name
2021-06-29 07:48:03 +00:00
YangLuo 17c121b087 Give concreted error when mappable dataset lack __len__ method 2021-06-29 11:13:12 +08:00
lichenever db8850a4a3 pipeline_support_predict_master 2021-06-26 09:25:59 +08:00
i-robot 905cba5ae0 !18788 Fix cache_admin stderr message and TFRecord get_dataset_size() when cached
Merge pull request !18788 from lixiachen/fix_stderr_msg
2021-06-24 17:52:10 +00:00
i-robot 708e56f659 !17899 Fix compile cache bug for resent50
Merge pull request !17899 from LiangZhibo/cache
2021-06-24 13:29:58 +00:00
Ziyan be1f5a43d7 opt shard fit micro batch 2021-06-24 14:52:19 +08:00
l00591931 8ae5d7cc84 Fix compile cache for resnet50 2021-06-24 14:36:24 +08:00
yangzhenzhang 69acf757d0 add parallel op for conv2d backprop input 2021-06-24 10:01:49 +08:00
Lixia Chen 1f03b16e0e Fix cache_admin server start stderr output
Fix TFRecord get_dataset_size() when cached
2021-06-23 18:32:54 -04:00
Harshvardhan Gupta 6845a16b44 fix coredump with large max_rowsize and add arg validations 2021-06-23 09:31:11 -04:00
YangLuo 4e9f6d54f7 update cpp api & doc 2021-06-23 11:14:52 +08:00
i-robot dca5504fd4 !15672 [assistant][RGB2BGR]
Merge pull request !15672 from QingfengLi/rgb2bgr
2021-06-22 12:48:04 +00:00
chenx2ovo 4b98099dcb [feat][assistant][I3CEGQ] add op rgb2bgr 2021-06-21 16:16:50 +08:00
yangzhenzhang 24370b5613 add parallel op for maxpool 2021-06-21 09:00:56 +08:00
i-robot f6cda391a9 !18487 remove the redundant code, add docstring of operator init and add default valuefor args.
Merge pull request !18487 from wangshuide/wsd_master_warn
2021-06-18 09:38:26 +00:00
i-robot ec999d3fa5 !18477 Modify the error message of abstract join
Merge pull request !18477 from huangbingjian/abstract_join
2021-06-18 09:10:29 +00:00
huangbingjian d695554ae5 modify the error message of abstract join 2021-06-18 14:12:10 +08:00
i-robot ff3ad7428a !18413 add parallel op for batch norm
Merge pull request !18413 from yangzhenzhang/add-parallel-op-for-batchnorm
2021-06-18 03:08:07 +00:00
caifubi 95695711d7 Remove PyNative Parameter Check 2021-06-18 09:46:27 +08:00
i-robot ab3259c43a !18292 MD Profiling UT: Check CPU util file. Add sequential pipeline UTs
Merge pull request !18292 from cathwong/ckw_mon_py_analyze_ut4
2021-06-17 21:47:10 +08:00
wangshuide2020 185ddbbe66 remove the redundant code, add docstring of operator init and add default value for args. 2021-06-17 20:29:52 +08:00
yangzhenzhang af0d28de48 add parallel op for batchnorm 2021-06-17 15:43:24 +08:00
liyong 2989a5a23b fix some bugs 2021-06-17 11:56:10 +08:00
Cathy Wong c37eb350f6 MD Profiling UT: Check CPU util file. Add sequential pipeline UTs 2021-06-16 15:30:59 -04:00
i-robot 7ff63a8e70 !17894 Add support for mindir encryption
Merge pull request !17894 from liuluobin/master
2021-06-15 15:15:40 +08:00
i-robot 85d860e6a2 !16457 [AutoParallel]pipeline_split_adapt_master
Merge pull request !16457 from lichen/pipeline_split_adapt_master
2021-06-11 11:37:40 +08:00
liuluobin 5b9b46224b Add encryption support for mindir 2021-06-11 09:33:45 +08:00
i-robot 21513404c4 !17082 set default context mode to GRAPH_MODE
Merge pull request !17082 from huangbingjian/change_context_mode
2021-06-10 21:21:46 +08:00
lichenever db5d508356 pipeline_split_adapt_master 2021-06-10 20:17:33 +08:00
i-robot dc9720cbb2 !17999 add parallel operator for conv2d
Merge pull request !17999 from yangzhenzhang/add-parallel-operator-for-conv2d
2021-06-10 20:05:45 +08:00
i-robot 62a165a3a2 !16917 Add Crop Python API for CV data processing
Merge pull request !16917 from xiaotianci/crop
2021-06-10 17:16:04 +08:00
i-robot c293f06b27 !17373 add docs, user-example and assertion for rearrange_inputs
Merge pull request !17373 from zhiqwang/rearrange-inputs-docs
2021-06-10 16:17:23 +08:00
yangzhenzhang 7a40741048 add parallel operator for conv2d 2021-06-10 14:58:51 +08:00
i-robot 3a13dde14d !17761 add save ckpt info
Merge pull request !17761 from changzherui/add_ckpt_info
2021-06-10 11:01:18 +08:00
i-robot b79400296a !17959 fix optimizer weight shard config
Merge pull request !17959 from gziyan/add_optimizer_weight_shard_config
2021-06-10 10:49:17 +08:00
Xiao Tianci a54e65a7ad add Crop Python API 2021-06-10 09:46:57 +08:00
i-robot e60f5f12f5 !17836 Add Rotate API for CV data processing
Merge pull request !17836 from xiaotianci/rotate
2021-06-10 09:29:18 +08:00
changzherui 7a05132ed4 add ckpt save info 2021-06-09 22:42:27 +08:00
Cathy Wong a8de1327d9 MD Profiling Analyze: Add class BottleneckAnalyzer 2021-06-09 09:24:32 -04:00
zhiqiang f43d720eb0 Add docs and user-example for rearrange_inputs 2021-06-09 04:19:32 -04:00
huangbingjian ad8f73f32b set default context mode to GRAPH_MODE 2021-06-09 14:40:49 +08:00
i-robot 50f11d5439 !17503 dataset: enhance the expression of error msg
Merge pull request !17503 from ms_yan/log_modify
2021-06-08 22:25:04 +08:00
Xiao Tianci 9c4c1c6a77 add Rotate Python API 2021-06-08 22:19:15 +08:00
i-robot 3a63a66d64 !17807 MD Profiling UT: Add MD Analyze UT for MinddataProfilingAnalyzer
Merge pull request !17807 from cathwong/ckw_mon_py_analyze_ut3
2021-06-08 21:52:55 +08:00
ms_yan be65ebcb28 complete dataset log 2021-06-08 16:45:47 +08:00
mindspore-ci-bot 8934e4a513 !17879 dynamic min max shape phase 2
From: @luoyang42
Reviewed-by: @liucunwei,@jonyguo
Signed-off-by: @liucunwei
2021-06-08 14:49:13 +08:00
Ziyan 95ac0f6d58 fix optimizer weight shard config 2021-06-08 10:44:17 +08:00
Cathy Wong b7342efe12 MD Profiling UT: Add MD Analyze UT. Add more pipeline profiling UTs. 2021-06-07 11:00:34 -04:00
luoyang dad289c679 dynamic min max shape phase 2 2021-06-07 20:06:26 +08:00
Zhenglong Li 2c7d1bf603 Implement new gnn feature 2021-06-07 10:20:06 +08:00
mindspore-ci-bot e5a189a4f0 !17520 Optimize exception info when compile net failed
From: @irmo
Reviewed-by: @ginfung,@zh_qh
Signed-off-by: @zh_qh
2021-06-05 12:04:28 +08:00
mindspore-ci-bot e19e14295a !17773 adapt offline debugger to new dump, sync support for iteration ranges, GPU default dump mode correction
From: @john_tzanakakis
Reviewed-by: @nsyca,@mikef
Signed-off-by: @mikef
2021-06-05 02:46:50 +08:00
John Tzanakakis 7d460de8b4 adapt offline debuger to new dump, sync support for iteration ranges, GPU default dump mode correction 2021-06-04 08:38:50 -04:00
mindspore-ci-bot 7d9bf65654 !16755 support list add list in net in GraphMode.
From: @fenglovebei
Reviewed-by: @zh_qh
Signed-off-by: @zh_qh
2021-06-04 16:37:40 +08:00
huanghui 29f632613f optimize log 2021-06-04 12:32:44 +08:00
mindspore-ci-bot 97989c3bbc !17669 Substitute _Loss for Loss
From: @c_34
Reviewed-by: @guoqi1024,@liangchenghui
Signed-off-by: @guoqi1024,@liangchenghui
2021-06-04 10:20:00 +08:00
mindspore-ci-bot a3f2b92839 !17638 modify vgg16 network for clould
From: @zhanghuiyao
Reviewed-by: @c_34,@wuxuejian
Signed-off-by: @c_34
2021-06-04 09:21:30 +08:00
fenglovebei 76b884dea9 list add list 2021-06-03 21:16:30 +08:00
chenhaozhe 9da8534396 change _Loss to Loss 2021-06-03 15:26:59 +08:00
zhanghuiyao 36ec89656a modify vgg16 network for clould 2021-06-03 11:39:27 +08:00
mindspore-ci-bot b52f9ddb08 !17060 Add HorizontalFlip and VerticalFlip for CV data processing
From: @tiancixiao
Reviewed-by: @liucunwei
Signed-off-by: @liucunwei
2021-06-02 17:48:28 +08:00
mindspore-ci-bot c4757f0692 !17461 MD Profiling Analyze: Handle cpu util with missing ops. Enhance UTs.
From: @cathwong
Reviewed-by: @robingrosman
Signed-off-by: @robingrosman
2021-06-02 11:12:59 +08:00
mindspore-ci-bot c77e7de1dc !17313 fix static check
From: @jiang-shuqiang
Reviewed-by: @yelihua,@ouwenchang
Signed-off-by: @ouwenchang
2021-06-02 08:50:37 +08:00
mindspore-ci-bot ae2e7c1288 !17541 Fix MD Cache code check warnings [master]
From: @lixiachen
Reviewed-by: @pandoublefeng,@robingrosman
Signed-off-by: @robingrosman
2021-06-02 04:53:54 +08:00
Lixia Chen 8c1b561149 Fix cache code check warnings 2021-06-01 10:02:38 -04:00
mindspore-ci-bot a92a450881 !17383 Optimize exception info print
From: @irmo
Reviewed-by: @zh_qh,@ginfung,@ginfung
Signed-off-by: @zh_qh
2021-06-01 17:43:24 +08:00
Cathy Wong f8beb933ad MD Profiling Analyze: Handle cpu util with missing ops. Enhance UTs. 2021-05-31 20:33:19 -04:00
mindspore-ci-bot 4338e4abac !17374 files_need_cleanup report fixes to master
From: @hfarahat
Reviewed-by: @pandoublefeng,@robingrosman
Signed-off-by: @robingrosman
2021-06-01 05:21:18 +08:00
jiangshuqiang 6154f957fb fix static check 2021-05-31 16:47:21 +08:00
Xiao Tianci 9c74d55a49 add HorizontalFlip and VerticalFlip APIs 2021-05-31 15:55:21 +08:00
huanghui 5acf3c8ade [dfx]optimize exception info print 2021-05-31 14:57:29 +08:00
mindspore-ci-bot 8c1e7ce231 !16345 [DFX]Optimize exception log
From: @irmo
Reviewed-by: 
Signed-off-by:
2021-05-31 09:22:48 +08:00
mindspore-ci-bot 04341b1dbc !17076 fix log error for pynative mode
From: @chujinjin
Reviewed-by: @zhoufeng54,@kisnwang
Signed-off-by: @kisnwang
2021-05-31 09:22:29 +08:00
hesham 3a9695313b files_need_cleanup fixes 2021-05-30 15:44:08 -04:00
huanghui 0610a8d99c 9fdc0035a0 2021-05-29 10:31:23 +08:00
mindspore-ci-bot 1c8fda25ef !16478 handle load op in step parallel
From: @gong_zi_yan
Reviewed-by: @yangzhenzhang,@stsuteng
Signed-off-by: @stsuteng
2021-05-29 09:32:35 +08:00
mindspore-ci-bot b45b63fc58 !17239 add parallel gathernd test case
From: @hanyang001
Reviewed-by: @stsuteng,@yangzhenzhang
Signed-off-by: @stsuteng
2021-05-29 09:11:25 +08:00
mindspore-ci-bot 5e87097d15 !17240 add parallel layernorm test case
From: @hanyang001
Reviewed-by: @stsuteng,@yangzhenzhang
Signed-off-by: @stsuteng
2021-05-29 09:11:08 +08:00
Wan Hanyang c51dff2634 add parallel gathernd test case 2021-05-28 17:21:11 +08:00
Wan Hanyang 3ce521d78f add parallel layernorm test case 2021-05-28 17:20:04 +08:00
YangLuo ac319b3a79 Fix mindrecord UTs: files existed causes write exception 2021-05-28 15:13:48 +08:00
Ziyan 4b17493e52 handle load in step parallel 2021-05-28 09:16:40 +08:00
chujinjin 7fb3b5ea97 fix log error 2021-05-27 17:19:10 +08:00
mindspore-ci-bot 1e8868cecc !16727 handle duplicate code
From: @yangzhenzhang
Reviewed-by: @stsuteng,@jjfeing
Signed-off-by: @stsuteng
2021-05-26 10:58:54 +08:00
mindspore-ci-bot 2433778dac !15963 Support getting dynamic_min_max_shape of data
From: @luoyang42
Reviewed-by: 
Signed-off-by:
2021-05-26 09:41:02 +08:00
mindspore-ci-bot 730e211e52 !16702 Add GaussianBlur API for CV data processing
From: @tiancixiao
Reviewed-by: @liucunwei,@jonyguo
Signed-off-by: @liucunwei
2021-05-26 09:09:41 +08:00
mindspore-ci-bot d0978f709a !16167 CocoDataset add a new column according a new arg extra_metadata
From: @xiefangqi
Reviewed-by: 
Signed-off-by:
2021-05-25 19:55:41 +08:00
yangzhenzhang d711d98f07 clean duplicate code 2021-05-25 17:25:34 +08:00
mindspore-ci-bot e513786709 !16565 Bug in Normalize when num_channels > 128
From: @hfarahat
Reviewed-by: @robingrosman,@pandoublefeng
Signed-off-by: @robingrosman
2021-05-25 10:24:25 +08:00
xiefangqi 53891dbdf7 coco add img_id column 2021-05-24 17:19:58 +08:00
luoyang 13ef5b61f3 support getting dynamic_min_max_shape of data 2021-05-24 17:04:50 +08:00
Xiao Tianci 3f495bbae1 add GaussianBlur API 2021-05-24 16:27:05 +08:00
liuxiao93 1160088c8f support avgpool3d 2021-05-22 14:44:11 +08:00
yao_yf 732d13ccff parallel dropout support repeated compute 2021-05-20 19:42:13 +08:00
mindspore-ci-bot 05bbd1d8fa !16426 Change the permission of cache shared memory to 600 for security
From: @lixiachen
Reviewed-by: @robingrosman,@pandoublefeng
Signed-off-by: @robingrosman
2021-05-20 02:36:26 +08:00
mindspore-ci-bot c47356d77b !16502 check Optimizer parameters must be list
From: @wangnan39
Reviewed-by: @zh_qh,@kingxian
Signed-off-by: @zh_qh,@kingxian
2021-05-19 09:23:56 +08:00
mindspore-ci-bot 1cb2d31642 !16509 GNN dataset new feature for invalid edge or node id case
From: @lizhenglong1992
Reviewed-by: @liucunwei,@heleiwang
Signed-off-by: @liucunwei
2021-05-19 09:20:24 +08:00
hesham bc92011b5f Bug in Normalize when num_channels > 128 2021-05-18 12:23:11 -04:00
mindspore-ci-bot ed72a0d9c3 !16497 Add more accurate abstract join error information
From: @huangbingjian
Reviewed-by: @zh_qh,@ginfung
Signed-off-by: @zh_qh
2021-05-18 19:36:11 +08:00
Zhenglong Li 9284b6d6af Add special case returned value for get feature function 2021-05-18 15:53:01 +08:00
mindspore-ci-bot ec9fc5fb3b !16384 Fix python multiprocessing with shared memory for edge case
From: @robingrosman
Reviewed-by: @mikef
Signed-off-by: @mikef
2021-05-18 10:30:19 +08:00
Lixia Chen 8812111f94 change shared mem perm to 600 & minor other fixes 2021-05-17 17:19:55 -04:00
wangnan39@huawei.com 2761776699 add check for optimizer parameters 2021-05-17 22:23:03 +08:00
huangbingjian 81624dd501 add more error report to abstract join 2021-05-17 21:14:17 +08:00
mindspore-ci-bot 9d423638b3 !16466 Fix code check of python pass
From: @irmo
Reviewed-by: @ginfung,@zh_qh
Signed-off-by: @zh_qh
2021-05-17 21:00:16 +08:00
mindspore-ci-bot 601322356b !15638 VOCDataset need to add img_id for evaluation
From: @xiefangqi
Reviewed-by: @liucunwei
Signed-off-by: @liucunwei
2021-05-17 19:33:24 +08:00
xiefangqi 9b846c7873 voc add image_id column 2021-05-17 16:09:04 +08:00
huanghui 53e32077c1 fix code check 2021-05-17 11:20:35 +08:00
mindspore-ci-bot 8cfb5b8aea !16332 Add environment variable to enable recursive evaluate.
From: @zh_qh
Reviewed-by: @ginfung,@kingxian
Signed-off-by: @ginfung
2021-05-17 11:00:40 +08:00
RobinGrosman ca88d7d76a fix edge case and docstring in minddata multiprocessing shared memory code 2021-05-16 06:46:44 -07:00
Zhang Qinghua bea16101c3 Add environment variable to enable recursive evaluate. 2021-05-14 20:01:19 +08:00
jonyguo 9452142b50 enhance: enable shuffle infile / files when mindrecord 2021-05-14 17:41:18 +08:00
mindspore-ci-bot b5cddcb8cc !16036 Improve performance of multi-processing option for dataset
From: @robingrosman
Reviewed-by: 
Signed-off-by:
2021-05-13 01:41:16 +08:00
RobinGrosman 9a7d1fc034 Optimize multi-process in minddata by passing data via shared memory instead of multiprocessing.queue 2021-05-11 15:16:29 -07:00
mindspore-ci-bot 8c5680360d !16200 [Debugger] Fix empty result when reading non-existent tensor
From: @tina_mengting_zhang
Reviewed-by: @john_tzanakakis,@robingrosman
Signed-off-by: @john_tzanakakis
2021-05-12 03:08:00 +08:00
mindspore-ci-bot ebed057e72 !16196 If Imagefolder input directory is not right, will occur out of memory error
From: @xiefangqi
Reviewed-by: @ms_yan,@heleiwang,@jonyguo
Signed-off-by: @jonyguo
2021-05-11 17:36:28 +08:00
mindspore-ci-bot 4c71d9d1df !15675 add more tensor methods
From: @yanglf1121
Reviewed-by: @liangchenghui
Signed-off-by:
2021-05-11 14:32:29 +08:00
mindspore-ci-bot 9b4ff99305 !16158 modify check strategy for scatter update
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
2021-05-11 09:41:07 +08:00
mindspore-ci-bot d3a175e30f !16078 Modify Normalize to accept images with more than 3 channels
From: @hfarahat
Reviewed-by: @mikef,@robingrosman
Signed-off-by: @robingrosman
2021-05-11 02:03:34 +08:00
TinaMengtingZhang a44376f42a Fix empty tensor issue when reading an non-existing node in sync dump mode 2021-05-10 13:59:05 -04:00
xiefangqi e0148f7181 fix minddata directory path problem 2021-05-10 22:16:37 +08:00
yepei6 acbd7eb023 add more tensor methods 2021-05-10 14:40:53 +08:00
yangzhenzhang 6aa3859131 modify check strategy for scatter update 2021-05-10 11:22:00 +08:00
mindspore-ci-bot ee885b4e58 !15180 enable not fully use opt shard
From: @gong_zi_yan
Reviewed-by: @stsuteng
Signed-off-by: @stsuteng
2021-05-08 14:57:58 +08:00
mindspore-ci-bot b86747b9a6 !15813 Convert some pipeline Ops to be inlined
From: @hfarahat
Reviewed-by: 
Signed-off-by:
2021-05-08 05:30:39 +08:00
hesham fd943bbdc0 Modify normalize to support multiple of channels 2021-05-07 17:06:26 -04:00
Ziyan 2a752f24bf enable not fully use opt shard 2021-05-07 15:32:48 +08:00
mindspore-ci-bot d76574bbbf !15973 parallel env variables check
From: @yao_yf
Reviewed-by: @yangzhenzhang,@stsuteng
Signed-off-by: @stsuteng
2021-05-07 12:13:41 +08:00
mindspore-ci-bot e0422e972e !16019 If dataset_dir is not a dir or something else validation is not right somehow
From: @xiefangqi
Reviewed-by: @ms_yan,@liucunwei,@jonyguo
Signed-off-by: @liucunwei
2021-05-07 11:57:31 +08:00
mindspore-ci-bot b85bf60eb8 !15727 VOCDataset read xml will filter invalid bbox automationally
From: @xiefangqi
Reviewed-by: @heleiwang,@jonyguo
Signed-off-by: @jonyguo
2021-05-07 09:50:53 +08:00
yao_yf e967f1939b parallel envs variable check 2021-05-07 09:12:53 +08:00
mindspore-ci-bot eb08d2e952 !16024 dataset: modify some error msg in dataset module
From: @ms_yan
Reviewed-by: @jonyguo,@heleiwang
Signed-off-by: @jonyguo
2021-05-07 09:12:46 +08:00
ms_yan 34dcd2b463 modify log of dataset part 2021-05-06 23:33:17 +08:00
xiefangqi b6e1fceedc minddata modify dir validation 2021-05-06 21:35:31 +08:00
Lixia Chen 5967cb2cd7 Unblock mindrecord under cache 2021-05-05 13:28:13 -04:00
hesham e4c0bd51a5 Modify concat to be an inlined Op
Modify zip to be an inlined Op
Modify take to be an inlined Op
Modify skip to be an inlined Op
Modify rename to be an inlined Op
Modify filter to consume child's rows using one thread
2021-05-04 12:45:18 -04:00
mindspore-ci-bot c13ed20dad !15907 add type convert during load checkpoint
From: @changzherui
Reviewed-by: @kingxian,@zh_qh
Signed-off-by: @kingxian
2021-04-30 15:52:41 +08:00
mindspore-ci-bot ee3012fd3f !15303 add lsq quantization method
From: @erpim
Reviewed-by: 
Signed-off-by:
2021-04-30 11:26:42 +08:00
mindspore-ci-bot ac912672bf !15871 Support pass args or|and kwargs for OP CreateInstance.
From: @zh_qh
Reviewed-by: @ginfung,@hwhewei
Signed-off-by: @hwhewei
2021-04-30 10:39:04 +08:00
mindspore-ci-bot cefcf6c2ae !15931 Add eager tests for transform ops, and add a shape comparison in the EXPECT_MSTENSOR_EQ Macro
From: @alexyuyue
Reviewed-by: @nsyca,@robingrosman
Signed-off-by: @robingrosman
2021-04-30 06:15:12 +08:00
alex-yuyue 9ef4331f56 Add eager tests for transform ops
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-04-29 13:19:24 -04:00
changzherui 85025804ef add type convert during load checkpoint 2021-04-29 17:38:16 +08:00
Zhang Qinghua cd7f7d40fb Support pass args or|and kwargs for OP CreateInstance. 2021-04-29 14:14:58 +08:00
mindspore-ci-bot 33966f0cd5 !15744 Add encryption for ckpt file
From: @liu_luobin
Reviewed-by: @baochong,@chongbao
Signed-off-by:
2021-04-29 11:18:50 +08:00
mindspore-ci-bot 577cf7cd1d !15758 [Offline Debug] Add UT tests to the offline debugger.
From: @islam_amin
Reviewed-by: @john_tzanakakis,@tom__chen,@robingrosman
Signed-off-by: @john_tzanakakis
2021-04-29 04:33:02 +08:00
Islam Amin 6bb740f137 added GPU UT tests 2021-04-28 13:03:51 -04:00
liuluobin a40229d171 Add encryption for ckpt file 2021-04-28 16:24:29 +08:00
mindspore-ci-bot 78fcdbc7c9 !15790 modify scatter update op
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
2021-04-28 10:48:19 +08:00
mindspore-ci-bot b663bbd9ca !15597 [MD] save op support variable dimension 0
From: @liyong126
Reviewed-by: @liucunwei,@jonyguo
Signed-off-by: @liucunwei
2021-04-28 09:38:58 +08:00
mindspore-ci-bot cbca36d723 !15766 modify tile op
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
2021-04-28 09:17:17 +08:00
Erpim 90d5d5dab3 add lsq quantization method 2021-04-27 20:48:04 +08:00
yangzhenzhang 075f680a42 modify scatter update op 2021-04-27 20:23:14 +08:00
liyong 587247e793 add support save dynamic shape tensor 2021-04-27 19:15:10 +08:00
mindspore-ci-bot 9e650da6d7 !15578 numpy-native tensor setitem bug fix & restructure
From: @jachua
Reviewed-by: @guoqi1024,@kisnwang
Signed-off-by: @kisnwang
2021-04-27 15:20:25 +08:00
xiefangqi 458ff5fed9 md fix voc and manifest error scenario 2021-04-27 14:24:57 +08:00
Xiaoda Zhang aa52399200 Making the Tile operator to have more parallel strategies 2021-04-27 11:36:40 +08:00
huangmengxi d6be043cb9 fix & restructure setitem 2021-04-27 10:03:10 +08:00
mindspore-ci-bot e3d54b7e3b !15695 dont insert VirtualOutput for scalar
From: @yao_yf
Reviewed-by: @yangzhenzhang,@stsuteng
Signed-off-by: @stsuteng
2021-04-27 09:25:30 +08:00
mindspore-ci-bot 83cdb8bb38 !15560 Optimize cache_admin tool to allow multiple session destroy
From: @lixiachen
Reviewed-by: @robingrosman,@nsyca
Signed-off-by: @robingrosman
2021-04-27 07:55:29 +08:00
yao_yf 093ef784de dont insert virtualoutput for scalar 2021-04-26 19:55:16 +08:00
mindspore-ci-bot d328fdcf61 !15200 profiler: fixed AICPU timeline
From: @zhangyunshu
Reviewed-by: @yelihua,@ouwenchang
Signed-off-by: @ouwenchang
2021-04-26 11:06:50 +08:00
mindspore-ci-bot 3cfd58e8e0 !15643 insert virtual div only for first input of dropout do mask
From: @yangzhenzhang
Reviewed-by: @stsuteng,@kisnwang
Signed-off-by: @stsuteng
2021-04-26 09:21:00 +08:00
mindspore-ci-bot 49d6c029a6 !15542 split axis and batch for gather
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng,@stsuteng
Signed-off-by: @stsuteng,@stsuteng
2021-04-25 19:33:09 +08:00
mindspore-ci-bot 7dc9eb3e0b !15396 add parallel virtual output in eval/predict
From: @yao_yf
Reviewed-by: @yangzhenzhang,@stsuteng
Signed-off-by: @stsuteng
2021-04-25 17:43:13 +08:00
yangzhenzhang 5828973978 fix bug for dropout do mask 2021-04-25 16:47:44 +08:00
yao_yf 21276408b8 parallel virtual_out_ops 2021-04-25 11:18:54 +08:00
Lixia Chen 44fb7ac4bb Add support for multi-session destroy 2021-04-23 11:17:06 -04:00
yangzhenzhang 213922574e split axis and batch for gatherv2 2021-04-23 16:59:35 +08:00
zhiqiang 2a0b443cc4 Add indexes attribute and make metrics indexes recognizable 2021-04-23 04:32:02 -04:00
mindspore-ci-bot b77c3f093d !15436 augassign
From: @yepei6
Reviewed-by: @yanglf1121,@kingxian
Signed-off-by: @kingxian
2021-04-23 14:58:35 +08:00
yepei6 81789ffb5d augassign 2021-04-23 11:58:07 +08:00
changzherui f63a13b2e9 modify check file name bug 2021-04-23 08:57:43 +08:00
mindspore-ci-bot e43a57fd37 !15525 clean code not used
From: @zhangzhaoju
Reviewed-by: @zh_qh,@ginfung
Signed-off-by: @zh_qh
2021-04-22 20:04:57 +08:00
mindspore-ci-bot 1ecc638fad !15442 modify code method metrics
From: @changzherui
Reviewed-by: @kingxian,@zhoufeng54
Signed-off-by: @kingxian
2021-04-22 16:58:36 +08:00
zhangzhaoju 6a2aee492c Clean code that not used 2021-04-22 16:24:05 +08:00
mindspore-ci-bot b760d1235f !15416 Update normalization description at nn/layer/normalization.py
From: @dinglinhe123
Reviewed-by: @liangchenghui,@wuxuejian
Signed-off-by: @liangchenghui
2021-04-21 15:05:33 +08:00
changzherui 1f4c17edca modify clean code 2021-04-21 10:56:16 +08:00
dinglinhe 54fb72e2b3 Update normalization description at nn/layer/normalization.py 2021-04-20 12:30:37 +08:00
yangzhenzhang c2ca2232c5 add select op 2021-04-20 09:23:22 +08:00
mindspore-ci-bot 1c9d3c0aa0 !15353 add parallel operator for scatter update
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
2021-04-20 09:03:08 +08:00
Cathy Wong 636809c255 dataset: C++ API ToNumber & Lookup: change data_type parm from string to DataType 2021-04-19 12:35:37 -04:00
mindspore-ci-bot 0fd1726e79 !15172 Clean GraphKernel's codes from frontend
From: @dayschan
Reviewed-by: @gaoxiong1,@dylangeng,@gaoxiong1
Signed-off-by: @dylangeng,@dylangeng
2021-04-19 09:34:35 +08:00
yangzhenzhang 9cdd70433f add scatterupdate op 2021-04-17 17:32:48 +08:00
yangzhenzhang d070af122f add topk op 2021-04-17 14:12:49 +08:00
dayschan 771e3f61f3 Clean GraphKernel's codes from frontend
1. set class GraphKernel as deprecated, and treat it as Cell
2. set class InplaceAssign as deprecated, suggested using Assign instead.
3. set op_selector as deprecated, removed the _selected_ops and _selected_grad_ops, replaced with real operations
4. removed the two passes of GraphKernel from frontend
5. removed the GraphKernel's codes from other modules
2021-04-17 11:03:34 +08:00
mindspore-ci-bot f9c5060cf2 !14930 Handle ignored returned Status
From: @hfarahat
Reviewed-by: @robingrosman,@pandoublefeng
Signed-off-by: @robingrosman
2021-04-17 03:52:41 +08:00
mindspore-ci-bot 9c81c5d2a0 !15189 Add more ut for transform ops and subset sampler
From: @alexyuyue
Reviewed-by: 
Signed-off-by:
2021-04-17 01:46:13 +08:00
hesham 6e6eaebb77 Fix unused return value in main code 2021-04-16 11:33:35 -04:00
yangzhenzhang f9f5df368e add gathernd op 2021-04-16 14:29:03 +08:00
alex-yuyue 97e3232b6d Add more ut for transform ops and subset sampler
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-04-15 16:51:41 -04:00
mindspore-ci-bot f09df9ac2f !15248 Fix shellcheck warnings for cache shell scripts
From: @lixiachen
Reviewed-by: @pandoublefeng,@robingrosman
Signed-off-by: @robingrosman
2021-04-15 22:47:06 +08:00
Lixia Chen 91f9059263 Fix shellcheck warnings 2021-04-15 09:33:07 -04:00
zhangyunshu d969be9107 profiler: fixed aicpu timeline 2021-04-15 19:35:24 +08:00
yangzhenzhang bcd2ecc403 check layouts for shared parameter 2021-04-15 10:39:05 +08:00
mindspore-ci-bot 727203a498 !14911 dataset: Fill op: C++ API support, UTs and Pybind decoupling
From: @cathwong
Reviewed-by: 
Signed-off-by:
2021-04-14 05:32:11 +08:00
Cathy Wong 7e6a03487e dataset: Fill op: C++ API support, UTs and Pybind decoupling 2021-04-13 10:02:39 -04:00
mindspore-ci-bot e07a69d8f8 !14874 GNN dataset new feature
From: @lizhenglong1992
Reviewed-by: 
Signed-off-by:
2021-04-13 10:44:27 +08:00
Zhenglong Li f3895f2b09 Add get edges from nodes function for gnn network 2021-04-10 18:31:13 +08:00
mindspore-ci-bot f0f7bf1ed1 !14885 fix: wrong input order
From: @jonyguo
Reviewed-by: @liucunwei,@heleiwang
Signed-off-by: @liucunwei
2021-04-10 16:52:41 +08:00
jonyguo a5cc81dc97 fix: wrong input order in test_paddeddataset.py 2021-04-09 17:22:31 +08:00
Lixia Chen 1f2b178a16 Reset CacheClient's status for a new run
Turn off lock only after all data is cached
2021-04-08 15:30:48 -04:00
mindspore-ci-bot a9ba9b90f6 !14680 MindData Codespell correction
From: @luoyang42
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
2021-04-07 18:28:55 +08:00
luoyang 624511337c MindData Codespell correction 2021-04-07 10:20:29 +08:00
hesham 8535e89e6c Remove DataBuffer 2021-04-05 17:55:59 -04:00
hesham 0d86cb1423 Remove rows_per_buffer 2021-04-04 00:22:16 -04:00
mindspore-ci-bot c99fe1e412 !12841 DataBuffer removal from DE
From: @hfarahat
Reviewed-by: 
Signed-off-by:
2021-04-04 03:28:13 +08:00
mindspore-ci-bot 28f4759537 !14606 parallel ut test
From: @yao_yf
Reviewed-by: 
Signed-off-by:
2021-04-02 21:24:43 +08:00
yao_yf a83fb3316b fix parallel timeout 2021-04-02 20:19:26 +08:00
mindspore-ci-bot 5b8a200fa9 !14572 show accurate error line when use user defined class
From: @zhangbuxue
Reviewed-by: @zh_qh,@ginfung
Signed-off-by: @zh_qh
2021-04-02 15:14:31 +08:00
mindspore-ci-bot e034f0294b !14556 Fix validation of RGB2HSV/HSV2RGB/RandomResizedCrop in py_transform & Fix error msg of pythontokenizer
From: @luoyang42
Reviewed-by: @liucunwei,@heleiwang
Signed-off-by: @liucunwei
2021-04-02 14:23:56 +08:00
buxue 6f1105ea79 show accurate error line when use user defined class 2021-04-01 21:52:00 +08:00
luoyang ec21d3f748 Fix validation of RGB2HSV/HSV2RGB/RandomResizedCrop in py_transform
Fix error msg of pythontokenizer
2021-04-01 19:09:07 +08:00
changzherui ffee537387 modify python ut 2021-04-01 16:19:55 +08:00
hesham a9a80693be Replace Databuffers with TensorRows 2021-03-31 17:00:36 -04:00
buxue 8c47ce1803 show accurate error info and error lines when use unsupported builtin function 2021-03-31 12:33:38 +08:00
changzherui fde2856d5d modify python ut 2021-03-30 20:08:26 +08:00
mindspore-ci-bot 7d911cdeeb !14365 set parallel communication init in parallel ut
From: @yao_yf
Reviewed-by: @stsuteng,@kisnwang
Signed-off-by: @stsuteng
2021-03-30 16:30:07 +08:00
yao_yf 4d0635eabe set parallel communication init flag in parallel ut 2021-03-30 11:21:57 +08:00
buxue d830a2b55a optimize exception mode when use undefined name in if for and while 2021-03-27 17:28:52 +08:00
mindspore-ci-bot 5d0490909d !14097 map a fv cnode if it is not mapped and belong to primal_graph_
From: @xychow
Reviewed-by: @ginfung,@zh_qh
Signed-off-by: @zh_qh
2021-03-26 09:20:42 +08:00
zhousiyi 74d500a756 If a fv cnode is not mapped but belong to primal_graph_, then don't propagate this fv to caller, it should mapped instead 2021-03-25 11:49:37 +00:00
mindspore-ci-bot 5926f7c386 !13906 【MD】【BUG】Conventional judgment on the parameter h w not less than zero
From: @xulei2020
Reviewed-by: 
Signed-off-by:
2021-03-25 14:10:42 +08:00
xulei2020 4122d1dcce fix code format bug 2021-03-25 09:18:36 +08:00
mindspore-ci-bot 9023ba2b56 !13745 Enable zero dimension when it comes out of operator.
From: @liangzhibo
Reviewed-by: @ginfung,@zh_qh,@ginfung
Signed-off-by: @zh_qh
2021-03-24 20:34:30 +08:00
l00591931 923dd4b77a enable zero dimension tensor when input is data 2021-03-24 15:46:17 +08:00
mindspore-ci-bot 1bc5a2d8ec !13483 modify ci python ut execution
From: @changzherui
Reviewed-by: 
Signed-off-by:
2021-03-23 14:17:59 +08:00
buxue e3056ed9b2 show accurate code line when use uninitialized var in for 2021-03-21 17:50:58 +08:00
mindspore-ci-bot 8e8f3043f9 !12115 IR operators of GPU and CPU are unified as batchnorm
From: @ding_fei_fei
Reviewed-by: 
Signed-off-by:
2021-03-19 14:51:26 +08:00
mindspore-ci-bot 1d505ebad3 !13528 Optimize the functions of log module
From: @askmiao
Reviewed-by: @ginfung,@zh_qh,@ginfung
Signed-off-by: @zh_qh
2021-03-19 14:06:35 +08:00
askmiao 4e39eab473 modify the log module 2021-03-19 09:59:45 +08:00
dingpeifei 87e41aaeee IR operators of GPU and CPU are unified as batchnorm 2021-03-18 19:02:28 +08:00
YangLuo f99204b292 fix python tokenizer 2021-03-18 15:47:09 +08:00
changzherui 6cd90dc45e modify ci python ut execution 2021-03-18 11:30:49 +08:00
mindspore-ci-bot b61aa9b4cf !13342 Throw exception when tensor with 0 shape is constructed
From: @liangzhibo
Reviewed-by: 
Signed-off-by:
2021-03-17 09:18:27 +08:00
mindspore-ci-bot 7454ac8ecd !13382 [PipelineSplit]change pipeline key word
From: @lichen666
Reviewed-by: @kisnwang,@zhunaipan
Signed-off-by: @zhunaipan
2021-03-16 20:20:32 +08:00
mindspore-ci-bot 48a7a94677 !13397 fix shellcheck error
From: @xsmq
Reviewed-by: @zhoufeng54,@zhunaipan
Signed-off-by: @zhunaipan
2021-03-16 17:42:19 +08:00
mindspore-ci-bot f9c408934e !13380 unify range
From: @lianliguang
Reviewed-by: @zh_qh,@ginfung
Signed-off-by: @zh_qh
2021-03-16 16:56:53 +08:00
xsmq bf6da44f84 fix shellcheck error 2021-03-16 15:43:50 +08:00
lichenever a2b2727ba8 change_pipeline_key_word 2021-03-16 14:02:35 +08:00
LianLiguang 17b9758543 unify range ops 2021-03-16 10:47:42 +08:00
l00591931 bd777e0710 throw exception when tensor has zero in shape 2021-03-16 10:39:48 +08:00
Lixia Chen 30017ea5a0 Fix codex issues 2021-03-15 11:15:15 -04:00
mindspore-ci-bot ac18da3770 !13061 [MD][bugfix] Fix to_json error: can't pickle pyfunc
From: @xiefangqi
Reviewed-by: 
Signed-off-by:
2021-03-13 12:48:26 +08:00
Xiao Tianci 4a7100c7f9 fix RandomAffine degree error and some examples in docs 2021-03-12 17:39:38 +08:00
mindspore-ci-bot 682a8926bd !13176 fix minddata transform issue
From: @luoyang42
Reviewed-by: 
Signed-off-by:
2021-03-12 17:01:56 +08:00
mindspore-ci-bot a1c3f55aca !13197 support item negative index bprop
From: @zhangbuxue
Reviewed-by: @ginfung
Signed-off-by:
2021-03-12 15:52:26 +08:00
xiefangqi 41f3e02e87 fix pyfunc pickle issue 2021-03-12 15:17:08 +08:00
buxue 50ee325b96 support item negative index bprop 2021-03-12 13:58:46 +08:00
YangLuo 74d7bb41a6 fix minddata transform issue 2021-03-12 11:37:14 +08:00
mindspore-ci-bot 1e33df94a5 !13142 support name or attribute ast.Expr
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
2021-03-12 09:27:32 +08:00
mindspore-ci-bot f7040ca134 !13198 Fix get_dataset_size error with PKSampler
From: @ziruiwu
Reviewed-by: 
Signed-off-by:
2021-03-12 06:11:26 +08:00
mindspore-ci-bot 1bb789278d !13200 Fix CI warnings and test team issues
From: @alexyuyue
Reviewed-by: @robingrosman,@nsyca
Signed-off-by: @robingrosman
2021-03-12 05:38:01 +08:00
Zirui Wu 2692e3cc3d fix pk sampler's get_dataset error due to num_class unavaiable at pre-runtime 2021-03-11 15:43:02 -05:00
mindspore-ci-bot 236c874e64 !12862 Increase default level of parallelism in minddata pipeline
From: @robingrosman
Reviewed-by: 
Signed-off-by:
2021-03-12 04:23:02 +08:00
alex-yuyue 2457f52596 Fix CI warning and test team issues
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-03-11 13:34:51 -05:00
buxue 2551f5ea7e support name or attribute ast.Expr 2021-03-11 21:40:33 +08:00
mindspore-ci-bot e1a95b1152 !12714 rebuild getitem
From: @yepei6
Reviewed-by: 
Signed-off-by:
2021-03-11 14:49:21 +08:00
RobinGrosman a0e75b845a Increase default level of parallelism in mindddata pipeline to 8.
Adjust memory usage to not increase as parallelism increases.  it will
stay at same level it would be with 4 parallelism
2021-03-10 18:38:11 -08:00
mindspore-ci-bot 54c37bcd61 !12947 Add MaxPool3D,MaxPool3DGrad,MaxPool3DGradGrad ops for Ascend.
From: @liu_xiao_93
Reviewed-by: @liangchenghui
Signed-off-by: @liangchenghui
2021-03-11 08:55:46 +08:00
liuxiao93 35f6ba9011 Add MaxPool3D,MaxPool3DGrad,MaxPool3DGradGrad ops for Ascend. 2021-03-10 15:33:07 +08:00
mindspore-ci-bot 3c7463bf2c !12943 adding fix to sample script
From: @ezphlow
Reviewed-by: 
Signed-off-by:
2021-03-10 10:22:19 +08:00
Eric ed373f61ac Adding inheritance to user defined sampler
what if we just do nothing

trying wrapper approach

Fix yolo
2021-03-09 18:14:49 -05:00
mindspore-ci-bot fe3b26a637 !12982 dice bug
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
2021-03-09 17:04:16 +08:00
jiaqi cdb7330818 diceloss bug 2021-03-09 16:23:45 +08:00
yepei6 57373ed30a merge getitem the by otehr types to by tuple(success) 2021-03-09 10:47:29 +08:00
ougongchang e8ee209877 Optimize summary ut and delete duplicate test cases
Change the summary test case to stage3 to avoid multiple processes that cause the summary test case to fail
2021-03-08 17:36:17 +08:00
mindspore-ci-bot 91cf88d692 !12883 Fix bugs of minddata transforms
From: @luoyang42
Reviewed-by: 
Signed-off-by:
2021-03-08 09:08:30 +08:00
YangLuo 74431ad117 Fix bugs of minddata transforms 2021-03-06 16:41:51 +08:00
mindspore-ci-bot 7ba21f8d8c !12900 Add communication parallel mode.
From: @liujunzhu
Reviewed-by: @zhoufeng54,@guoqi1024
Signed-off-by: @guoqi1024
2021-03-06 15:55:49 +08:00
mindspore-ci-bot 48d4cca512 !12949 Add TopoSort Rhs First attribute for special CNode, such as Depend CNode with isolated nodes.
From: @zh_qh
Reviewed-by: @hwhewei,@zhunaipan
Signed-off-by: @zhunaipan
2021-03-06 14:41:35 +08:00
Zhang Qinghua df866f7248 Add TopoSort Rhs First attribute for special CNode, such as Depend CNode with isolated nodes. 2021-03-06 12:39:36 +08:00
mindspore-ci-bot fe53c71b3b !12843 Add more callable test and clean the input check for tensor ops
From: @alexyuyue
Reviewed-by: @robingrosman,@nsyca
Signed-off-by: @robingrosman
2021-03-05 22:59:45 +08:00
liujunzhu 6541b96c40 Add communication parallel mode. 2021-03-05 21:36:03 +08:00
mindspore-ci-bot d285692217 !12852 Change maketuple in coreops
From: @liangzhibo
Reviewed-by: 
Signed-off-by:
2021-03-05 19:13:42 +08:00
l00591931 680324f225 Change make tuple in core.ops 2021-03-05 10:54:33 +08:00
Ziyan ec9793861f fix grad accu 2021-03-05 10:28:10 +08:00
Zhang Qinghua 8b8c59f01e Optimize the compile performance in Parser, FG, Manager and Renormalize:
---
Remove the routine of handling isolated nodes in Renormalize.
Add isolated nodes from Parser&Resolver.
Modify isolated nodes handling in FG&Manager.
Optimize the renormalize routines.
Other optimizations.
2021-03-04 16:01:54 +08:00
mindspore-ci-bot 7ff2b3b499 !12781 fix bug of amp bn cast
From: @jojobugfree
Reviewed-by: 
Signed-off-by:
2021-03-04 10:14:51 +08:00
alex-yuyue 6d7be32614 Add more callable test and clean the input check
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-03-03 17:30:36 -05:00
mindspore-ci-bot 1c191a65fb !12765 Fix numpy input to samplers
From: @hfarahat
Reviewed-by: 
Signed-off-by:
2021-03-04 04:57:40 +08:00
mindspore-ci-bot c07371f5c9 !12763 Fix C++ API testcases
From: @ezphlow
Reviewed-by: 
Signed-off-by:
2021-03-04 04:57:28 +08:00
mindspore-ci-bot 8e13667ff4 !12674 Add support to multiple tensor in eager mode
From: @alexyuyue
Reviewed-by: @nsyca
Signed-off-by:
2021-03-04 01:28:34 +08:00
Eric f9a2379a70 Fixing api leftover
Fixed compile error

Fixed more testcases
2021-03-03 09:37:06 -05:00
mindspore-ci-bot e58be0de71 !12737 quantum state evolution operator
From: @donghufeng
Reviewed-by: 
Signed-off-by:
2021-03-03 15:38:42 +08:00
mindspore-ci-bot 7fcce73c51 !12700 add grad accumulation combined with optimizer parallel
From: @yangzhenzhang
Reviewed-by: 
Signed-off-by:
2021-03-03 11:04:19 +08:00
mindspore-ci-bot 8fb01aabd4 !12738 Add heartbeat check in summary and delete test cases that do not exit
From: @ouwenchang
Reviewed-by: @yelihua
Signed-off-by:
2021-03-03 10:11:32 +08:00
alex-yuyue 66aff93940 Fix test team issue: ToNumber in eager mode.
And support multiple tensor as input in call method

Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-03-02 17:39:44 -05:00
caifubi a6959c2a13 fix bn cast bug 2021-03-02 17:24:47 +08:00
ougongchang 4309e20b1b Add heartbeat check in summary and delete test cases that do not exit 2021-03-02 15:29:15 +08:00
hesham 616d1a1f3d Fix sampler supporting numpy input 2021-03-01 12:41:59 -05:00
mindspore-ci-bot 85461bcdb3 !12532 add SyncBatchNorm
From: @yuchaojie
Reviewed-by: 
Signed-off-by:
2021-03-01 19:34:41 +08:00
xuxs 066d23e2ad evolution operator 2021-03-01 14:20:31 +08:00
yangzhenzhang a70d616841 mini step grad accumulation 2021-03-01 10:20:12 +08:00
yujianfeng f0b7c3dd4d Add a switch to control grad for scalar 2021-02-27 18:12:37 +08:00
yuchaojie 6d195f340c add SyncBatchNorm 2021-02-27 14:32:54 +08:00
mindspore-ci-bot f269f3fc8d !12231 Support ad for scalar inputs
From: @ginfung
Reviewed-by: 
Signed-off-by:
2021-02-26 15:50:32 +08:00
mindspore-ci-bot 6808816cb2 !12618 support index by negative number
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
2021-02-26 15:49:14 +08:00
mindspore-ci-bot ed46bf8b18 !12624 add rmse_loss and mae_loss
From: @lijiaqi0612
Reviewed-by: @kingxian,@zh_qh
Signed-off-by: @kingxian
2021-02-26 14:34:03 +08:00
buxue 610300335f support index by negative number 2021-02-26 12:49:25 +08:00
mindspore-ci-bot c8defc2a8a !12558 Fix sampler error messages
From: @hfarahat
Reviewed-by: 
Signed-off-by:
2021-02-26 00:10:17 +08:00
Jiaqi 112b8488c5 add rmse loss 2021-02-25 17:03:07 +08:00
yujianfeng 41189781f3 support scalar input for cell 2021-02-25 09:56:15 +08:00
wangshuide2020 72e938eb06 change dimension of input for FusedBatchNormEx from 2D to 4D in test_two_matmul_batchnorm_ex. 2021-02-25 09:37:59 +08:00
mindspore-ci-bot 5b206557d2 !12586 support invert bool tensor
From: @zhangbuxue
Reviewed-by: @zh_qh,@ginfung,@zh_qh
Signed-off-by: @zh_qh,@zh_qh
2021-02-25 09:37:43 +08:00
buxue f8a00d52af support invert bool tensor 2021-02-24 17:47:07 +08:00
wangshuide2020 b9eb90b198 add GPU for DenseBnAct, Erfc, Log1p, etc. in Supported Platforms. 2021-02-24 16:30:38 +08:00
hesham aa4298721a Fix sampler error messages 2021-02-23 23:58:19 -05:00
mindspore-ci-bot 2e7a785d44 !12535 add raises description for Cast, Diag, Eye, Fill etc. operators
From: @wangshuide2020
Reviewed-by: @liangchenghui
Signed-off-by: @liangchenghui
2021-02-23 22:17:37 +08:00
mindspore-ci-bot e73f43aa85 !12507 support convert ValueDict to py dict
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
2021-02-23 19:19:44 +08:00
wangshuide2020 8a7fa2e651 add raises description for Cast, Diag, Eye, Fill etc. operators. 2021-02-23 17:33:19 +08:00
mindspore-ci-bot bff0fde980 !12249 make slice support tensor
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
2021-02-23 10:55:27 +08:00
mindspore-ci-bot 9893b3d128 !12320 add focal loss
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
2021-02-23 10:35:59 +08:00
xsmq 923b53d2e6 replace tab with spaces 2021-02-23 09:41:47 +08:00
buxue 47dd17a325 support convert ValueDict to py dict 2021-02-23 09:27:46 +08:00
Jiaqi fd1a4726b7 add focal loss 2021-02-22 19:33:26 +08:00
buxue 416017bf65 make slice support tensor 2021-02-22 17:07:37 +08:00
xuxs c70049b190 mindquantum
mindquantum

cmake lint

projectq patch

test pqc

space

pylint

pqc python ops

doc

check

bug

bug

bug

bug

check boundary condition

mindquantum in log_adapter

mindquantum in adapter and recorder cc

substract to subtract

public variable to private variable

public variable to private variable

commit

debug

debug

const in utils

delete dtol

clint
2021-02-20 12:33:51 +08:00
mindspore-ci-bot 4ac1982c58 !12258 add multclass diceloss
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
2021-02-20 09:42:31 +08:00
mindspore-ci-bot f940fe51b1 !12398 fix minddata issues
From: @luoyang42
Reviewed-by: @heleiwang,@pandoublefeng
Signed-off-by: @pandoublefeng
2021-02-19 17:01:06 +08:00
Jiaqi 952e245000 add multclass diceloss 2021-02-19 15:43:30 +08:00
YangLuo d8ace8f041 fix minddata issues 2021-02-19 10:53:49 +08:00
mindspore-ci-bot 166f7e7809 !12248 Fix the bug of calling recompute api after compiled
From: @ginfung
Reviewed-by: 
Signed-off-by:
2021-02-18 19:35:38 +08:00
mindspore-ci-bot c5df707b69 !12327 Block caching after random pyfunc cases
From: @lixiachen
Reviewed-by: 
Signed-off-by:
2021-02-17 08:56:10 +08:00
Lixia Chen 0667818d9a Block caching after random pyfunc 2021-02-12 14:10:00 -05:00
Mahdi 4b106f184c Fixed an issue with SequentialSampler 2021-02-10 12:55:10 -05:00
mindspore-ci-bot 260c77f4ad !12336 [MD] fix sampler log & transform log
From: @luoyang42
Reviewed-by: 
Signed-off-by:
2021-02-10 15:33:15 +08:00
luoyang 416ad23e9d fix resize & randomcoloradjust
fix sampler
2021-02-10 12:53:27 +08:00
mindspore-ci-bot 923dd47b0f !12331 Adding validators back to check method
From: @ezphlow
Reviewed-by: @robingrosman,@nsyca,@robingrosman
Signed-off-by: @robingrosman
2021-02-10 08:58:02 +08:00
Eric 5d91fa6d77 changed discription
Added validator checks

Added builtin sampler check

Added proper input check for samplers
2021-02-09 18:00:53 -05:00
hesham 58193bc469 User explicit deepcopy 2021-02-09 17:25:21 -05:00
yujianfeng 70cc548e32 Fix calling recompute api after compiling 2021-02-08 16:19:49 +08:00
mindspore-ci-bot a063d7633d !12241 [auto-monad] Support side-effects by auto-monad
From: @hwhewei
Reviewed-by: @zhunaipan,@zh_qh
Signed-off-by: @zh_qh
2021-02-08 10:25:57 +08:00
mindspore-ci-bot e6dcb0c31d !12239 [MD] fix bugs of execute & update doc description in minddata
From: @luoyang42
Reviewed-by: @liucunwei
Signed-off-by: @liucunwei
2021-02-08 10:15:08 +08:00
He Wei 7d9a783993 [auto-monad] Support side-effects by auto-monad
The basic idea is: exploits data dependency to control the execution order
of side-effect operations, and keep the semantics of ANF unchanged.

The ControlDepend primitive is removed and there are two primitives added:

1. UpdateState:
```
  a = Assign(para, value)
```
became:
```
  a = Assign(para, value, u)
  u = UpdateState(u, a)
```

2. Load:
```
  x = Add(para, value)
```
became:
```
  p = Load(para, u)
  x = Add(p, value)
  u = UpdateState(u, p)
```
2021-02-08 09:01:15 +08:00
luoyang cd86788cf3 fix bugs of execute & update doc description in minddata 2021-02-07 22:52:52 +08:00
liu_xiao_93 fabc25538e Add BCEWithLogitsLoss 2021-02-07 09:06:16 +08:00
mindspore-ci-bot 26d4b99019 !11056 Modifying profiling_Options parameter
From: @zyhstack
Reviewed-by: @lilongfei15,@xsmq
Signed-off-by: @xsmq
2021-02-06 13:23:21 +08:00
mindspore-ci-bot 4d9551e129 !12046 modify Gelu、FastGelu to GeLU and FastGeLU
From: @jinyaohui
Reviewed-by: 
Signed-off-by:
2021-02-06 09:57:48 +08:00
tom__chen d3330a1087 fix incorrect in_channel size error messages 2021-02-05 11:45:22 -05:00
jinyaohui 30a27b2adb modify Gelu、FastGelu to GeLU and FastGeLU 2021-02-05 17:19:52 +08:00
mindspore-ci-bot 24e528112f !12134 improve grad of first input
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
2021-02-05 15:33:30 +08:00
buxue 899d6114a4 improve grad of first input 2021-02-05 12:36:37 +08:00
zhangyihui bbbffbb6a9 Modify the profiling_options parameter name 2021-02-05 10:15:01 +08:00
mindspore-ci-bot 544da6f845 !11727 [MD] Add vision ops and py_transform ops support to Serdes save
From: @tina_mengting_zhang
Reviewed-by: 
Signed-off-by:
2021-02-05 06:38:54 +08:00
mindspore-ci-bot 74652eb942 !12044 modify pack to stack
From: @jinyaohui
Reviewed-by: 
Signed-off-by:
2021-02-04 21:02:09 +08:00
jinyaohui 8022f9a6ed modify pack to stack 2021-02-04 18:54:31 +08:00
mindspore-ci-bot 8fc5962418 !12055 compile graph for merging parameter slice only once
From: @yangzhenzhang
Reviewed-by: @stsuteng
Signed-off-by: @stsuteng
2021-02-04 14:30:47 +08:00
TinaMengtingZhang ddab5ad417 Add support for vision op and py_transform op to serdes 2021-02-03 12:31:09 -05:00
mindspore-ci-bot e8f4cafd02 !11950 Overwrite default port/hostname from env variables for cache_admin
From: @lixiachen
Reviewed-by: 
Signed-off-by:
2021-02-03 23:38:48 +08:00
yangzhenzhang 726ea32778 merge parameter slice compile graph only once 2021-02-03 19:39:32 +08:00
mindspore-ci-bot cbfba95ad0 !11921 do not broaden when arg is not tensor
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
2021-02-03 17:07:47 +08:00
buxue 6ccc4379b4 do not broaden scalar 2021-02-03 11:30:25 +08:00
mindspore-ci-bot 6378642c8a !11905 add raises description for BCELoss, ReLU, BatchNorm1d, etc. operators
From: @wangshuide2020
Reviewed-by: @liangchenghui,@wuxuejian
Signed-off-by: @liangchenghui
2021-02-03 11:19:00 +08:00
mindspore-ci-bot 78d250c7d5 !11648 fix param check for unexpected_format
From: @jiang-shuqiang
Reviewed-by: @yelihua
Signed-off-by:
2021-02-03 11:18:47 +08:00
Lixia Chen 97cd142f8d Overwrite default port/hostname from env variables
update copyright

add examples to CacheClient docstring
2021-02-02 20:39:19 -05:00
mindspore-ci-bot 840d819d08 !11975 improve isinstance
From: @zhangbuxue
Reviewed-by: @ginfung,@zh_qh
Signed-off-by: @zh_qh
2021-02-03 09:01:57 +08:00
hesham 1185218335 Support list of IDs as a sampler 2021-02-02 11:44:38 -05:00
buxue 5ede9ffcca improve isinstance 2021-02-02 21:12:14 +08:00
wangshuide2020 30f99f2722 add raises description for BCELoss, ReLU, BatchNorm1d, etc. operators. 2021-02-02 20:52:00 +08:00
mindspore-ci-bot 0dcd94d717 !11893 LookupOp: default value of unknown_token support NoneType
From: @luoyang42
Reviewed-by: @liucunwei,@pandoublefeng
Signed-off-by: @liucunwei
2021-02-02 20:13:18 +08:00
luoyang fa4f67cbcd LookupOp: default value of unknown_token support NoneType 2021-02-02 16:17:02 +08:00
mindspore-ci-bot b189f177bb Change tuple_getitem to TupleGetItem and some other ops, merge from r1.1 to master 2021-02-02 15:54:15 +08:00
jiangshuqiang 0bb80995bc fix param check for unexpected_format 2021-02-02 12:03:49 +08:00
mindspore-ci-bot e897eb4c41 !11915 Change TensorAdd to Add, merge from r1.1 to master
From: @liangzhibo
Reviewed-by: @ginfung,@zh_qh
Signed-off-by: @zh_qh
2021-02-02 09:16:08 +08:00
Nat Sutyanyong 5a7dc0accc Migrate repeat_pass.cc to IR optimizer and remove ExecTree optimizer 2021-02-01 12:30:16 -05:00
mindspore-ci-bot 320ea51308 !11853 Add call for decoupled image and text ops
From: @alexyuyue
Reviewed-by: 
Signed-off-by:
2021-02-01 19:47:00 +08:00
l00591931 9ec100d069 Change TensorAdd to Add, from r1.1 to master 2021-02-01 17:53:52 +08:00
mindspore-ci-bot ce89cc5e8b !11761 Change GatherV2 to Gather (merge from r1.1 to master)
From: @liangzhibo
Reviewed-by: 
Signed-off-by:
2021-01-30 17:53:20 +08:00
mindspore-ci-bot 794af6d094 !11834 [MD] Fix error msg description of dataset
From: @xiefangqi
Reviewed-by: @liucunwei,@heleiwang
Signed-off-by: @liucunwei
2021-01-30 14:49:24 +08:00
mindspore-ci-bot 9fa0499fa0 Change GatherV2 to Gather r1.1 to master 2021-01-30 14:13:47 +08:00
mindspore-ci-bot 84afbb510f !11813 modify dice and diceloss
From: @lijiaqi0612
Reviewed-by: @kingxian,@zh_qh
Signed-off-by: @kingxian
2021-01-30 11:08:17 +08:00
xiefangqi 3d72282f26 fix error msg issue 2021-01-30 11:03:53 +08:00
alex-yuyue 6fd58dc580 Add call for decoupled image and text ops
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-01-29 21:36:31 -05:00
Mahdi 8f34faeb7a Changed bindings to SamplerObj 2021-01-29 14:20:05 -05:00
Jiaqi 804ef79c18 modify dice and diceloss 2021-01-29 15:10:05 +08:00
mindspore-ci-bot a2f1a5b4b1 !11278 develop confusion matrix
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
2021-01-29 11:38:28 +08:00
Jiaqi c821a2f3a2 confusion matrix 2021-01-29 09:27:22 +08:00
mindspore-ci-bot 20c1727b2c !11631 Add SubsetSampler
From: @hfarahat
Reviewed-by: 
Signed-off-by:
2021-01-29 03:48:45 +08:00
mindspore-ci-bot 8e4a6842ff !11681 gnn support edge weight sampling
From: @heleiwang
Reviewed-by: @liucunwei
Signed-off-by: @liucunwei
2021-01-28 19:15:37 +08:00
heleiwang 2dc9ba761c gnn support weight sampling neighbors. 2021-01-28 15:28:44 +08:00
hesham 7120c66998 Add SubsetSampler 2021-01-27 15:00:18 -05:00
mindspore-ci-bot 4cd6588af0 !11393 Migrating cache transform pass from execution tree to IR tree
From: @lixiachen
Reviewed-by: 
Signed-off-by:
2021-01-27 22:10:13 +08:00
mindspore-ci-bot b9e1c3f045 !11530 support call inner net attr
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
2021-01-27 16:50:43 +08:00
buxue 3d33c4fed3 support call inner net attr 2021-01-27 15:08:29 +08:00
mindspore-ci-bot f2fd357ffc !11623 fix issues of MD
From: @luoyang42
Reviewed-by: 
Signed-off-by:
2021-01-27 14:37:55 +08:00
mindspore-ci-bot 007bd6c7d3 !11656 add dtype shape and value in __str__ and __repr__ of Parameter
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
2021-01-27 14:06:04 +08:00
mindspore-ci-bot 58b8d8cd02 !11677 add isfinite grad
From: @jiangzg001
Reviewed-by: @liangchenghui,@c_34
Signed-off-by: @liangchenghui
2021-01-27 11:13:58 +08:00
buxue 7c4b7203b0 add dtype shape and value in __str__ and __repr__ of Parameter 2021-01-27 11:04:24 +08:00
luoyang 415c8b08a5 fix issues of MD:
1. description of num_shard in datasets.py
2. add param validation for sampler
3. add description for add_child in sampler.py
2021-01-27 09:30:42 +08:00
jiangzhenguang de8c2c95d1 add isfinite grad 2021-01-27 09:10:49 +08:00
Lixia Chen 922e1f4f36 Migrate CacheTransformPass 2021-01-26 19:24:10 -05:00
mindspore-ci-bot 3708624a25 !11559 [MD] Change the default spill location of cache server
From: @lixiachen
Reviewed-by: 
Signed-off-by:
2021-01-27 03:12:24 +08:00
ougongchang c6e4b0c85f Add more log when collect graph and use summary operators
Fix can not collect input data when batch size is 1 and total step
number is 1

Fixed spelling errors
2021-01-26 11:24:16 +08:00
Lixia Chen be6d310946 Default to memory-only cache server 2021-01-25 18:38:24 -05:00
mindspore-ci-bot 8170669909 !11174 add_mish_mulnonan_selu_operations
From: @jiangzg001
Reviewed-by: @liangchenghui
Signed-off-by: @liangchenghui
2021-01-23 17:24:17 +08:00
mindspore-ci-bot f8f6421459 !10968 Add dynamic shape support for the operator Concat
From: @david-he91
Reviewed-by: 
Signed-off-by:
2021-01-23 16:58:40 +08:00
xiefangqi 3f76abcdee minddata err msg add file path 2021-01-22 16:38:46 +08:00
mindspore-ci-bot fd6dc1b060 !11177 modify Tensor
From: @Somnus2020
Reviewed-by: 
Signed-off-by:
2021-01-22 11:37:11 +08:00
jiangzhenguang 991fb122f3 add_mish_mulnonan_selu_operations 2021-01-22 10:31:31 +08:00
mindspore-ci-bot 2beb916bf5 !11427 TextOp decoupling
From: @alexyuyue
Reviewed-by: 
Signed-off-by:
2021-01-22 09:09:41 +08:00
mindspore-ci-bot fcc4a4eaea !11397 add GetDatasetSize to concat_node
From: @mhmotallebi
Reviewed-by: 
Signed-off-by:
2021-01-22 08:08:41 +08:00
mohammad b5e91139e2 add GetDatasetSize to concat node 2021-01-21 16:25:48 -05:00
mindspore-ci-bot 6394ba3974 !11499 delete useless params in pipeline parallel
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
2021-01-21 21:35:43 +08:00
hedongdong 8241dfa443 Add dynamic shape support for the operator Concat 2021-01-21 20:36:29 +08:00
mindspore-ci-bot 0c5b6107a7 !11475 support dict for isinstance
From: @zhangbuxue
Reviewed-by: @ginfung,@zh_qh,@ginfung
Signed-off-by: @ginfung
2021-01-21 19:31:13 +08:00
yangzhenzhang cbca482e59 delete useless parameter in pipeline parallel 2021-01-21 19:05:40 +08:00
lilei 7d9f5f6dba modify Tensor 2021-01-21 17:46:34 +08:00
buxue 2ea8b9e738 add dict for isinstance 2021-01-21 17:30:35 +08:00
yangzhenzhang 7303c3d3b8 add group ckpt 2021-01-21 14:41:05 +08:00
alex-yuyue a8675f8227 TextOp decoupling
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-01-20 21:52:45 -05:00
mindspore-ci-bot 55594db01c !11348 add check for outermost net inputs type and support isinstance first arg is an empty list
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
2021-01-20 19:00:08 +08:00
buxue e8cd572bc2 add check for outermost net inputs type and support isinstance first arg an empty list 2021-01-20 14:48:06 +08:00
mindspore-ci-bot 775d71f9c1 !11408 Update PP example
From: @zichun_ye
Reviewed-by: @wang_zi_dong,@sunnybeike
Signed-off-by:
2021-01-20 09:17:23 +08:00
Zichun Ye ca316f4422 update doc example in probability
fix typo in probability module

fix pylint in msp
2021-01-19 11:51:43 -05:00
mindspore-ci-bot 60feffad20 !11332 update Pooling's attr kernel_size, pad_mode
From: @yuchaojie
Reviewed-by: 
Signed-off-by:
2021-01-19 16:17:45 +08:00
Lixia Chen 273865a72b Rename SamplerObj::Build() to SamplerBuild() 2021-01-18 15:42:34 -05:00
mindspore-ci-bot 91842af2ad !11245 Pushing down pipeline json serializer logic to C++ IR - PART II
From: @tina_mengting_zhang
Reviewed-by: 
Signed-off-by:
2021-01-19 04:31:32 +08:00
buxue 15593dc98f improve isinstance function in graph mode 2021-01-18 19:18:48 +08:00
yuchaojie b51b3a6764 update Pool's attr kernel_size, pad_mode 2021-01-18 12:10:20 +08:00
mindspore-ci-bot e214c69bc2 !11195 develop dice loss
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
2021-01-18 12:00:41 +08:00
buxue 69d9a33ddb show line of code when parse or resolve phase exception 2021-01-16 16:31:04 +08:00
Jiaqi 87ecd44f67 develop dice loss 2021-01-16 15:54:06 +08:00
TinaMengtingZhang d3fdbceb61 [Part II] Push down json save logic to IR and add getter to each IR node 2021-01-15 18:03:37 -05:00
mindspore-ci-bot eacc8bac89 !10755 [Numpy-Native] Add new numpy-native interfaces to mindspore.numpy
From: @yanglf1121
Reviewed-by: 
Signed-off-by:
2021-01-15 10:04:17 +08:00
mindspore-ci-bot a2d9c5914a !10944 Tensor op decoupling stage 2
From: @alexyuyue
Reviewed-by: 
Signed-off-by:
2021-01-15 05:28:50 +08:00
alex-yuyue b54e01bfb4 Tensor op decoupling stage 2
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-01-14 11:51:16 -05:00
buxue 7eaf84d07a remove attr support_non_tensor_input of cell 2021-01-14 16:19:23 +08:00
yanglf1121 72903c11c8 add array_ops, math_ops and tensor ops 2021-01-14 15:32:36 +08:00
mindspore-ci-bot 44507b4a64 !11200 support non tensor inputs for ms_function and grad of net
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
2021-01-14 14:41:08 +08:00
mindspore-ci-bot 151c0e2977 !11132 modify batchnormal and fusedbatchnormal
From: @Somnus2020
Reviewed-by: 
Signed-off-by:
2021-01-14 10:57:10 +08:00
buxue acec35d4d4 support non tensor inputs 2021-01-14 09:21:01 +08:00
lilei 9a45c4419c modify batch_normal 2021-01-13 20:59:46 +08:00
mindspore-ci-bot 1dd600d416 !11114 add perplexity metric
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
2021-01-13 14:58:59 +08:00
TinaMengtingZhang 4812fece80 [Part I] Push down json save logic to IR and add getter to each IR node 2021-01-12 11:17:45 -05:00
Jiaqi d6f4421a1d perplexity 2021-01-12 20:26:26 +08:00
Nat Sutyanyong 686772cce7 Migrate GeneratorOp resetting logic to IR optimizer (incl. debug code)
with comments from the peer view addressed
2021-01-11 12:20:40 -05:00
mindspore-ci-bot fb97aa327c !10881 add the tensor collection feature when record summary
From: @jiang-shuqiang
Reviewed-by: 
Signed-off-by:
2021-01-11 20:59:07 +08:00
jiangshuqiang ab5cc10250 add the tensor collection feature when record summary 2021-01-11 12:39:36 +08:00
liuxiao93 aacad990c3 Add grad of sort. 2021-01-11 09:07:46 +08:00
mindspore-ci-bot 7957a3b6f5 !10988 Tensor op decoupling stage 1
From: @ezphlow
Reviewed-by: 
Signed-off-by:
2021-01-09 05:12:10 +08:00
Eric be46ccf721 Started vision decoupling
map validate params

Changing bindings

Change behavior of vision.cc

Added signature and changed Cmake

Compiling

Need to fix compile

Added compiling random transforms

python changes for decoupling

two failed test case remaining

Compiling random choice

passes all ut

Changed assert

review comments

Added validate params

add back return value

Fix lint

py lint fix

pylint 2

Addressing comments
2021-01-08 09:42:20 -05:00
mindspore-ci-bot b355f5402b !10309 Port over getter pass and tensor fusion pass to IR
From: @ziruiwu
Reviewed-by: 
Signed-off-by:
2021-01-08 21:37:51 +08:00
Zirui Wu 0e68575e77 port over getter pass
port over tensor_op_fusion pass

add fusion support for prebuildOpeartion (TensorOpeartion)
2021-01-07 10:52:49 -05:00
Jiaqi f6de97fc27 bleu_score 2021-01-07 21:24:38 +08:00
mindspore-ci-bot 62888f23b8 !10400 roc and auc
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
2021-01-07 21:19:41 +08:00
mindspore-ci-bot 274e0aa750 !10885 add nll_loss operation
From: @jiangzg001
Reviewed-by: @liangchenghui,@wuxuejian
Signed-off-by: @liangchenghui
2021-01-07 14:15:22 +08:00
mindspore-ci-bot 1276715c11 !10939 surface distance
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
2021-01-07 11:02:15 +08:00
Jiaqi ef3f6d62db auc_roc 2021-01-07 10:55:16 +08:00
mindspore-ci-bot 09848d7ef3 !9083 add dice and hausdroff
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
2021-01-07 10:31:42 +08:00
mindspore-ci-bot 67296c08c7 !9502 add hausdroff distance
From: @lijiaqi0612
Reviewed-by: 
Signed-off-by:
2021-01-07 10:31:32 +08:00
mindspore-ci-bot 1c942ce49f !10221 support grad accumulation for auto parallel
From: @yangzhenzhang
Reviewed-by: 
Signed-off-by:
2021-01-06 15:27:34 +08:00
mindspore-ci-bot 1f06cd63f3 !10436 Support to control whether to throw runtime exceptions in SummaryRecord
From: @ouwenchang
Reviewed-by: 
Signed-off-by:
2021-01-06 14:21:21 +08:00
mindspore-ci-bot 1d1f6841b9 !10937 keep consistent in Graph mode and PyNative mode for 'isinstance'
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
2021-01-06 10:29:49 +08:00
ougongchang 06be546b52 Support to control whether raise RuntimeError exception in SummaryRecord
1. Support explainer raise an RuntimeError exception
2. fix the ut of SummaryRecord
2021-01-06 10:07:47 +08:00
yangzhenzhang 9da3f9bec9 mini step grad accumulation 2021-01-06 09:25:06 +08:00
jiangzhenguang d3f42e7d6b add nll_loss operation. 2021-01-06 09:11:35 +08:00
mindspore-ci-bot 03e655f14a !10070 Fixing GetDatasetSize issue with chained samplers
From: @mahdirahmanihanzaki
Reviewed-by: 
Signed-off-by:
2021-01-06 05:11:51 +08:00
buxue 6d395c1d3f keep consistent in Graph mode and PyNative mode for 'isinstance' 2021-01-05 21:36:10 +08:00
mindspore-ci-bot a531628dd5 !10325 modify MetaTensor and Tensor
From: @Somnus2020
Reviewed-by: @kingxian
Signed-off-by: @kingxian
2021-01-05 17:50:34 +08:00
Jiaqi 29cd33a542 3d 2021-01-05 17:25:41 +08:00
Jiaqi 9a5b9525de hausdorff_distance 2021-01-05 17:20:57 +08:00
Jiaqi ed7cf87d0b surface distance 2021-01-05 17:13:12 +08:00
lilei b858097ae4 modify MetaTensor and Tensor 2021-01-04 20:58:34 +08:00
Payne b12ca2165c add bool expand dims and wait to test 2020-12-31 14:55:13 +08:00
mindspore-ci-bot 37a4cbfb3b !10772 Prevent the multiprocess.pool from capturing KeyboardInterrupt,
From: @ouwenchang
Reviewed-by: @wenkai_dist,@wangyue01
Signed-off-by: @wangyue01
2020-12-30 10:02:25 +08:00
ougongchang e5529230bf Prevent the multiprocess from capturing KeyboardInterrupt 2020-12-29 17:46:42 +08:00
mindspore-ci-bot 998483e0c3 !10610 add batchnorm3d and check in conv3d
From: @jiangzg001
Reviewed-by: @liangchenghui,@wuxuejian
Signed-off-by: @liangchenghui
2020-12-29 16:56:22 +08:00
jiangzhenguang 9f950fb16c add batchnorm3d 2020-12-29 09:37:35 +08:00
mindspore-ci-bot 2e684df5b1 !10686 fix infer rank list typo and add testcase
From: @gong_zi_yan
Reviewed-by: @stsuteng,@zhunaipan
Signed-off-by: @stsuteng
2020-12-28 21:20:19 +08:00
Ziyan 2c3b99ce91 fix infer rank list typo 2020-12-28 18:46:01 +08:00
mindspore-ci-bot 0d04de8db2 !10455 Expand J for innermost graph first when the graph also contains J primitive
From: @ginfung
Reviewed-by: @zhunaipan
Signed-off-by:
2020-12-28 14:42:07 +08:00
mindspore-ci-bot b67aaf6773 !9832 expose_allgather_fusion_to_users
From: @gong_zi_yan
Reviewed-by: 
Signed-off-by:
2020-12-28 09:54:57 +08:00
yujianfeng 728fac6c9f Expand J for innermost graph first when the graph also contains J primitive 2020-12-28 09:37:23 +08:00
Ziyan bbf8ec82b9 expose allgather fusion interface to users 2020-12-27 17:44:45 +08:00
buxue 1a7c161e73 support len of a Tensor 2020-12-26 17:02:25 +08:00
mindspore-ci-bot 4df0baa6c7 !10392 getitem fix bug
From: @yepei6
Reviewed-by: @zhunaipan,@kingxian,@zhunaipan
Signed-off-by: @kingxian
2020-12-24 20:49:17 +08:00
mindspore-ci-bot 221d5b67d2 !10442 change code in modelzoo to import dataset APIs from mindspore.dataset rather than mindspore.dataset.engine
From: @tiancixiao
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
2020-12-24 19:56:39 +08:00
Xiao Tianci 31fed1a2f6 change code to import APIs from mindspore.dataset rather than mindspore.dataset.engine 2020-12-24 17:30:02 +08:00
mindspore-ci-bot 261bb736de !10063 Modify profiler directory structure to fit the new Run Package
From: @gzhcv
Reviewed-by: 
Signed-off-by:
2020-12-24 16:53:13 +08:00
mindspore-ci-bot 1343c9cca2 !10255 using do_copy option to choose Tensor.from_numpy to do Tensor convert
From: @ms_yan
Reviewed-by: 
Signed-off-by:
2020-12-24 14:53:18 +08:00
mindspore-ci-bot e1248a7246 !10389 Fix the Backward of the AllSwap Operation
From: @huangxinjing
Reviewed-by: @stsuteng,@stsuteng,@zhunaipan
Signed-off-by: @stsuteng,@stsuteng
2020-12-24 09:38:29 +08:00
Payne 4f78ee0077 fix getitem bug 2020-12-23 22:02:23 +08:00
ms_yan deb1e6e965 use from_numpy and add do_copy option 2020-12-23 21:38:05 +08:00
mindspore-ci-bot 70dc40551a !10020 Improve fancy index from 1st dimension to arbitrarily dimension
From: @yepei6
Reviewed-by: 
Signed-off-by:
2020-12-23 21:23:36 +08:00
mindspore-ci-bot 20df37e428 !10287 Add ut for dataset to_number
From: @luoyang42
Reviewed-by: @heleiwang
Signed-off-by:
2020-12-23 21:14:42 +08:00
huangxinjing 565ce81b29 Fix allsawp 2020-12-23 17:17:03 +08:00
Zirui Wu a1355a827c introduce a master switch to turn on and off profiler 2020-12-22 16:48:01 -05:00
mindspore-ci-bot 176ea4676c !10261 change the int32 restrict to int restric
From: @yepei6
Reviewed-by: @kingxian,@kingxian
Signed-off-by: @kingxian,@kingxian
2020-12-22 20:39:29 +08:00
Payne 5c9982729d fancy index getitem 2020-12-22 18:13:16 +08:00
mindspore-ci-bot 9b3226c2b6 !10289 Ignore the graphs with defer_inline flag when specializing on graph arguments
From: @ginfung
Reviewed-by: @zh_qh
Signed-off-by: @zh_qh
2020-12-22 17:41:20 +08:00
Payne 236bfb75e3 change the int32 restrict to int 2020-12-22 17:35:02 +08:00
yujianfeng e1aa34a030 Ignore the graphs with defer_inline flag when specializing on graph arguments 2020-12-22 14:32:44 +08:00
mindspore-ci-bot 00611b1c41 !10175 Add tensor.ndim and rename tensor.size() to tensor.size
From: @yanglf1121
Reviewed-by: @kingxian,@zhunaipan
Signed-off-by: @kingxian
2020-12-22 14:13:10 +08:00
YangLuo da6de519ae Add ut for dataset to_number 2020-12-21 20:09:03 +08:00
mindspore-ci-bot f8e5bffe4d !10286 fix Wrong TypeError in numpy_native
From: @wangrao124
Reviewed-by: @zhunaipan,@kingxian
Signed-off-by: @kingxian
2020-12-21 19:30:08 +08:00
mindspore-ci-bot 441e283e21 !10197 Add input check for the embedding
From: @huangxinjing
Reviewed-by: @stsuteng,@zhunaipan
Signed-off-by: @stsuteng
2020-12-21 19:12:09 +08:00
wangrao 2fb3f0ef4f fix Wrong TypeError in numpy_native 2020-12-21 16:33:36 +08:00
Ziyan c5c905fdf5 add restriction for opt shard 2020-12-19 17:43:55 +08:00
mindspore-ci-bot 5ff6de83eb !10173 Fix Strategy Check for UnsortedSegments
From: @huangxinjing
Reviewed-by: @zhunaipan,@stsuteng
Signed-off-by: @stsuteng
2020-12-19 14:24:58 +08:00
mindspore-ci-bot d99189f681 !10207 Fix some minor doc, typo related to AutoNumWorker
From: @ziruiwu
Reviewed-by: @mikef
Signed-off-by:
2020-12-19 06:35:59 +08:00
Zirui Wu 4ae7102fd3 address 2 tickets 2020-12-18 15:03:32 -05:00
huangxinjing dd0da1542d Add input check 2020-12-18 19:54:49 +08:00
yanglf1121 918679daa3 add tensor.ndim and rename tensor.size() to tensor.size 2020-12-18 17:15:42 +08:00
huangxinjing a8446af1ab Fix condition check 2020-12-18 16:43:43 +08:00
gzhcv bad8c0e422 Modify profiling dir structure to fit the new Run Package 2020-12-18 11:04:07 +08:00
mindspore-ci-bot 893d59afd7 !10097 Fix bugs for np.mean, np.asarray, np.concatenate, np.linspace
From: @yanglf1121
Reviewed-by: 
Signed-off-by:
2020-12-18 09:10:51 +08:00
Mahdi 98ea8fa6ea Added tests for chain samplers, fixed GetDatasetSize issue with chained samplers 2020-12-17 13:26:42 -05:00
mindspore-ci-bot fc11b7dd68 !10074 Fix a testcase error when shuffle is above cache
From: @lixiachen
Reviewed-by: @liucunwei,@pandoublefeng
Signed-off-by: @liucunwei,@liucunwei
2020-12-17 19:56:26 +08:00
mindspore-ci-bot 691e3baab6 !10109 [MD] Fix Decode doc & RandomNode log
From: @luoyang42
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
2020-12-17 19:50:19 +08:00
mindspore-ci-bot 6035823c4b !10044 fix get num classes of concat
From: @luoyang42
Reviewed-by: @liucunwei,@heleiwang,@liucunwei
Signed-off-by: @liucunwei,@liucunwei
2020-12-17 19:30:50 +08:00
yanglf1121 760cd1870a corner cases check for np.asarray, np.mean, np.concatenate 2020-12-17 18:33:10 +08:00
luoyang 595b7a782f [MD] Fix Decode doc & RandomNode log 2020-12-17 17:04:31 +08:00
mindspore-ci-bot 734f50f36e !10083 support non tensor inputs in model predict
From: @zhangbuxue
Reviewed-by: @zhunaipan,@zh_qh
Signed-off-by: @zh_qh
2020-12-17 16:33:52 +08:00
buxue f90f77c16e support non tensor inputs in model predict 2020-12-17 14:17:41 +08:00
buxue aeeef7607a remove the 'raise' in construct of Cell 2020-12-17 10:54:42 +08:00
Lixia Chen a7f0e13234 Remove special treatment for cache above repeat 2020-12-16 21:13:04 -05:00
YangLuo df9f4f41e8 fix get num classes of concat 2020-12-16 14:58:32 +08:00
mindspore-ci-bot 26ff566f90 !10002 fix get dataset size in distributed scenario
From: @tiancixiao
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
2020-12-16 14:25:39 +08:00
Xiao Tianci 633f97bb48 fix get dataset size in distributed scenario 2020-12-15 20:41:45 +08:00
yanglf1121 9072283395 fix mindpsore.numpy packaging issue and format API comments 2020-12-15 18:06:55 +08:00
mindspore-ci-bot c4f284b928 !9910 [MD][Perf] MindData add NormalizePad for GPU performance
From: @xiefangqi
Reviewed-by: 
Signed-off-by:
2020-12-15 16:51:22 +08:00
mindspore-ci-bot b8faa8293b !9920 python eager add decode
From: @luoyang42
Reviewed-by: @liucunwei
Signed-off-by: @liucunwei
2020-12-15 16:37:39 +08:00
mindspore-ci-bot dd134d7554 !9926 optimize list setitem in bprop
From: @zhangbuxue
Reviewed-by: @zh_qh
Signed-off-by: @zh_qh
2020-12-15 16:20:07 +08:00
buxue 2530943a7f optimize list getitem in bprop 2020-12-15 15:00:49 +08:00
xiefangqi 3c6cc3c58c Add NormalizePadOp 2020-12-15 11:45:41 +08:00
YangLuo 18e61a627a python eager add decode 2020-12-15 10:00:59 +08:00
mindspore-ci-bot a9f2de8307 !9737 complete fancy index getitem
From: @yepei6
Reviewed-by: 
Signed-off-by:
2020-12-15 09:44:52 +08:00
Payne 4c8f0914d0 complete fancy index getitem 2020-12-14 22:18:38 +08:00
mindspore-ci-bot ca4225a4f3 !9717 amend some script
From: @jiangzg001
Reviewed-by: @liangchenghui,@c_34
Signed-off-by: @liangchenghui
2020-12-14 19:39:15 +08:00
mindspore-ci-bot 3a803b3c18 !9862 Fix the bug of ImageNetToMR
From: @shenwei41
Reviewed-by: @pandoublefeng,@liucunwei
Signed-off-by: @liucunwei
2020-12-14 15:53:14 +08:00
jiangzhenguang 9cf856dd25 amend some script 2020-12-14 11:08:20 +08:00
mindspore-ci-bot ad6507d88a !9825 [MD] fix pad, normalize in c_trasnform
From: @luoyang42
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
2020-12-14 10:48:10 +08:00
mindspore-ci-bot e10dbb4a7f !9723 add ir passes to unify mindir
From: @yuchaojie
Reviewed-by: 
Signed-off-by:
2020-12-14 10:14:47 +08:00
jjfeing 1984cf8e20 unify mindir 2020-12-12 17:55:16 +08:00
buxue 70d12aae26 add detailed and accurate description for support non tensor inputs for outermost net. 2020-12-12 16:54:08 +08:00
shenwei41 547f96717b Fix Bug 2020-12-12 11:35:34 +08:00
mindspore-ci-bot d5db8872fd !9834 Fix wrong input argument of Reshape for multi field embedding
From: @huangxinjing
Reviewed-by: @zhunaipan,@stsuteng
Signed-off-by: @stsuteng
2020-12-11 21:31:48 +08:00
huangxinjing 996ee72c50 Fix embedding layer
Fix input check
2020-12-11 19:13:09 +08:00
mindspore-ci-bot 5e35bec957 !9799 change_last_nodes_strategy_in_auto_parallel_when_eval_and_predict
From: @yao_yf
Reviewed-by: @zhunaipan,@stsuteng
Signed-off-by: @stsuteng
2020-12-11 17:51:32 +08:00
luoyang 1cc147df1d fix pad, normalize in c_trasnform 2020-12-11 17:46:29 +08:00
mindspore-ci-bot 10d326ee62 !9798 hide arange
From: @bairongz
Reviewed-by: @zh_qh,@zhunaipan
Signed-off-by: @zh_qh
2020-12-11 15:29:33 +08:00
yao_yf 19fe28cb9b hange strategys of last nodes in eval/predict at auto parallel mode 2020-12-11 11:11:28 +08:00
Zirui Wu 77521e78d2 staging 2020-12-10 14:45:04 -05:00
Bairong 8cf43e59e0 hide arange, delete related test case and improve the doc string of nn.Range 2020-12-10 21:42:59 +08:00
mindspore-ci-bot 8c0d066bf9 !9763 Change name from interpolate to resizeBilinear
From: @liangzhibo
Reviewed-by: @ginfung,@zh_qh,@zhunaipan
Signed-off-by: @zh_qh
2020-12-10 17:41:14 +08:00
Xiaoda Zhang e78228603b move parallel-related black-list to core/ir, and fix the cloneCNode bug 2020-12-10 15:57:01 +08:00
l00591931 130c61cfc0 change name from interpolate to resizeBilinear 2020-12-10 11:46:40 +08:00
mindspore-ci-bot 9ecf062581 !9552 change the import level of dynamic_lr
From: @wangnan39
Reviewed-by: @kingxian,@zh_qh,@kingxian
Signed-off-by: @kingxian,@kingxian
2020-12-10 11:15:08 +08:00
mindspore-ci-bot 78fba32865 !9752 Fix potential hang in RandomData and incorrectly named functions
From: @ziruiwu
Reviewed-by: @heleiwang,@pandoublefeng
Signed-off-by: @pandoublefeng
2020-12-10 10:51:01 +08:00
mindspore-ci-bot 3f82405d17 !9639 Add Numpy Native to Mindspore
From: @yanglf1121
Reviewed-by: 
Signed-off-by:
2020-12-10 09:45:16 +08:00
Zirui Wu 91a6b2b0ca Add checks to RandomData and LookUp 2020-12-09 17:09:34 -05:00