Nigel
/
mindspore
forked from mindspore-Ecosystem/mindspore
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
35,316 Commits 24 Branches 0 Tags 3.9 GiB
Commit Graph

3187 Commits

Author SHA1 Message Date
wanyiming 4fbc59a98a utfixs 2021-10-18 18:06:37 +08:00
liyong d9aa18dfca refactor md ut 2021-10-18 17:55:28 +08:00
i-robot 9d0d094437 !24554 support nested call of ms_function 
Merge pull request !24554 from zhangzhaoju/ms_master_ms_function
 2021-10-18 09:36:30 +00:00
zzb 95425b770d iml dict.items() and multiplication op 2021-10-18 12:47:22 +08:00
zx d13d2413f5 [feat][assistant][I3J6UV] add new audio operator Phaser 2021-10-16 08:45:12 +08:00
yangyueren 951193c308 [feat][assistant][I3J6VF] add new data operator Places365 2021-10-15 14:56:09 +00:00
Xiao Tianci 930a5b89c0 fix api docs of audio 2021-10-15 17:17:18 +08:00
i-robot be691284e2 !18407 [assistant][MulLawEncoding] 
Merge pull request !18407 from QingfengLi/mulawencoding
 2021-10-15 09:03:41 +00:00
i-robot 44fe11c656 !24805 fix_fronted_ut 
Merge pull request !24805 from wanyiming/fix_uts
 2021-10-15 09:01:35 +00:00
zhangzhaoju b4453709a2 Support parser decoratored functions 
like nested calling of ms_function
 2021-10-15 16:41:08 +08:00
wanyiming 8b40e77201 ut_fixed 2021-10-15 15:54:26 +08:00
huanghui 3785b6d1b4 change printed log's level 2021-10-15 15:49:08 +08:00
chujinjin 3c3d8c3962 remove useless python ut 2021-10-15 15:26:45 +08:00
i-robot b27623ae37 !24899 modify ut of probability 
Merge pull request !24899 from byweng/master
 2021-10-15 02:02:52 +00:00
robert_luo_yibo 75e2c3041c [feat][assistant][I3CEG3] add new data OP MuLawEncoding 2021-10-14 20:24:18 +08:00
Bingya Weng be20f00299 modify ut of probability 2021-10-14 19:33:34 +08:00
i-robot f83070728d !24790 support user define strategy gen method under auto parallel context 
Merge pull request !24790 from zhuyuxiao/master
 2021-10-14 09:03:36 +00:00
chujinjin 90836f70a0 fix context python ut error 2021-10-14 14:27:50 +08:00
i-robot 957f9a7b4e !24839 UT case runs failed in PyNative mode 
Merge pull request !24839 from JoyLvliang/ut_run_failed_in_pynative_mode
 2021-10-14 06:15:28 +00:00
i-robot 65f08a6c4c !24804 parallel ut modify 
Merge pull request !24804 from yao_yf/parallel_ut_modify
 2021-10-14 01:24:12 +00:00
i-robot 470de9bcaa !21258 [assistant][ops]New operator implementation, include ApplyKerasMomentumD 
Merge pull request !21258 from 梁秀波/ApplyKerasMomentumD
 2021-10-14 01:05:23 +00:00
7347157+joylvliang@user.noreply.gitee.com aecbdf3c3b ut_run_failed_in_pynative_mode 2021-10-13 18:46:27 +08:00
i-robot 1b9b85bbb2 !17851 [assistant][ops]New operator implementation, include FakeImageDataset 
Merge pull request !17851 from 张璇/fakeimage_dataset
 2021-10-13 09:22:55 +00:00
yao_yf 636f82a466 parallel ut modify 2021-10-13 14:28:13 +08:00
zhuyuxiao 1907246931 change api 2021-10-13 10:28:30 +08:00
i-robot 3fd94000c5 !24568 Apply batch parallel in auto_parallel mode when strategies are not specified 
Merge pull request !24568 from zhuyuxiao/master
 2021-10-13 01:20:15 +00:00
i-robot 18e632c7a1 !21216 [MS][crowdfunding]New operator implementation, include Overdirve 
Merge pull request !21216 from Wangsong95/overdrive
 2021-10-13 01:08:36 +00:00
G-Dragon-Liu d2f22a8726 [feat][assistant][I3J6V3] add new data operator FakeImage 2021-10-12 14:00:43 +00:00
zx 9b7d7be65c [feat][assistant][I3J6UU] add new audio operator Overdrive 2021-10-12 18:10:31 +08:00
zhuyuxiao cf76c76745 apply batch parallel in auto_parallel mode when strategies are not specified 2021-10-12 15:44:10 +08:00
yao_yf b303d6001c parallel ut refactor 2021-10-12 15:18:51 +08:00
huanghui 1af32f74f9 support None argument for the outermost net 2021-10-11 16:00:57 +08:00
i-robot b9c2a84d3b !17812 [assistant][ops] Add a new audio operator Flanger 
Merge pull request !17812 from 杨旭华/Flanger
 2021-10-09 08:15:33 +00:00
li-qiyao 2283442855 [feat][assistant][I3J6U9] add new data operator Flanger 2021-10-08 05:03:31 -07:00
i-robot ea53466848 !24490 Extend the completeness of the mindspore static graph mode, so that the filter function is supported in the construct function 
Merge pull request !24490 from 卢逸飞/MindSpore/master
 2021-10-08 10:35:29 +00:00
i-robot 8598d08351 !17820 [assistant][ops]New operator implementation, include EMnistDataset 
Merge pull request !17820 from 张璇/emnist_dataset
 2021-10-08 07:18:31 +00:00
i-robot 02f9e3e077 !17805 [assistant][ops] Add new audio operator DetectPitchFrequency 
Merge pull request !17805 from 杨旭华/DetectPitchFrequency
 2021-10-08 03:34:46 +00:00
G-Dragon-Liu 32baa520bf [feat][assistant][I3J6V2] add new data operator EMnist 2021-10-08 02:53:00 +00:00
John Tzanakakis 7e7b444c63 remove verbose option from DbgServices 2021-10-06 11:38:05 -04:00
Lu 9f68d43c32 Construct supports the filter function. 2021-09-30 15:18:05 +08:00
i-robot dddea1803d !24361 context api 0928 
Merge pull request !24361 from mindspore_ding/context_master_0928
 2021-09-30 06:45:28 +00:00
dingpeifei 89f9d0f263 api context 0927 2021-09-29 23:15:36 +08:00
Zhang Lian b7e6520e62 [feat] [assistant] [I3J6U8] Add a new audio operator DetectPitchFrequency 2021-09-29 15:12:58 +08:00
despicablemme 75ade61acf [feat] [assistant] [I40GGE] add new Ascend operator CeLU 2021-09-28 14:58:25 +08:00
i-robot 2cacf9cdc2 !24231 fix security wrap and code check 
Merge pull request !24231 from jiangshuqiang/fix_code_check_master
 2021-09-28 06:45:19 +00:00
i-robot 2085ab1774 !22831 [assistant][ops]add math ops Ger 
Merge pull request !22831 from yangwm/ger
 2021-09-28 06:27:35 +00:00
jiangshuqiang 13fc005562 fix security wrap 2021-09-28 11:59:45 +08:00
i-robot dd544a9693 !21406 [MS][crowdfunding]New operator implementation, include TrebleBiquad 
Merge pull request !21406 from 张璇/treble_biquad
 2021-09-27 14:18:00 +00:00
i-robot f16c003dfa !22610 [MS][crowdfunding]New operator implementation, RandomAdjustSharpness 
Merge pull request !22610 from yangwm/sharpness
 2021-09-27 09:20:05 +00:00
zorax 6098c1da5e [feat][assistant][I40FFO] add new Ascend operator ApplyKerasMomentum 2021-09-27 16:49:18 +08:00
zx 3da0f0f487 [feat][assistant][I3J6V0] add new audio operator TrebleBiquad 2021-09-27 13:01:26 +08:00
despicablemme d072a4e4bf [feat] [assistant] [I40GZE] add new data operator RandomAdjustSharpness 2021-09-27 11:19:33 +08:00
i-robot ab567574c4 !21451 [MS][crowdfunding]New operator implementation, include RiaaBiquad 
Merge pull request !21451 from 张璇/riaa_biquad
 2021-09-27 03:14:16 +00:00
i-robot 2969688382 !20047 [assistant][ops]New operator implementation, include QmnistDataset 
Merge pull request !20047 from Wangsong95/qmnist_dataset
 2021-09-27 01:36:08 +00:00
despicablemme 84337078b1 [feat] [assistant] [I40GGM] add new ascend operator Ger 2021-09-27 09:28:05 +08:00
i-robot e3bc280f22 !22532 [MS][crowdfunding]New operator implementation, RandomEqualize 
Merge pull request !22532 from yangwm/equalize
 2021-09-27 01:07:04 +00:00
i-robot b10df2da0c !21401 [assistant][ops]New operator implementation, include ExtractVolumePatches 
Merge pull request !21401 from 梁秀波/ExtractVolumePatches
 2021-09-26 09:52:43 +00:00
i-robot bb038292d4 !23905 fix error log 
Merge pull request !23905 from lianliguang/more-info-for-infer-error
 2021-09-26 06:23:34 +00:00
despicablemme 7063907bdc [feat] [assidtant] [I40GZN] add new data ops RandomEqualize 2021-09-25 18:00:25 +08:00
i-robot d0023355a3 !23205 Fix bus error with multiprocessing enabled, large image, shared_memory, single device 
Merge pull request !23205 from RobinGrosman/mem_bus_failure
 2021-09-24 19:16:12 +00:00
RobinGrosman c90efc0403 add check for shm available when num_devices=1 to avoid bus errors 
-Required modifying tests to reduce memory usage to check doesn't fail during CI
-Also required fixing max_rowsize to be externalized from map+batch() function
 2021-09-24 10:24:31 -07:00
hzw 2f5758a4a8 [feat][assistant][#I40FFZ] add new Ascend operator ExtractVolumePatches 2021-09-24 18:36:03 +08:00
i-robot ee38ffbd3d !22560 [MS][crowdfunding]New operator implementation, RandomAutoContrast 
Merge pull request !22560 from yangwm/autocontrast
 2021-09-24 09:34:37 +00:00
i-robot 7cde7731b0 !23537 Update pangu reshape and softmax. 
Merge pull request !23537 from linqingke/pangu
 2021-09-24 08:12:13 +00:00
i-robot 86392fdd3d !23982 fix the debug info about the cell function decorated by @ms_functon 
Merge pull request !23982 from huanghui/fix-filename-error-with-ms_function
 2021-09-24 06:43:35 +00:00
i-robot e7cb505e68 !23569 Produce parallel operators for ResizeBilinear and ResizeNearestNeighbor 
Merge pull request !23569 from Bert0108/resizebilinear_parallel_ops
 2021-09-24 03:05:23 +00:00
i-robot d37fccc56f !23544 remove deprecated gather op 
Merge pull request !23544 from zhuyuxiao/master
 2021-09-24 01:20:53 +00:00
Bert0108 2d3d0b673e parallel operators for ResizeBilinear and ResizeNearestNeighbor 2021-09-24 09:07:49 +08:00
linqingke acde7febef update pangu reshape and softmax performance. 
Add layer norm judge

Fix layer norm name error

Fix input tyoe check

Fix ut test

Add 3d supports
 2021-09-24 09:06:16 +08:00
zx 1d95e6f480 [feat][assistant][I3J6UY] add new audio operator RiaaBiquad 2021-09-23 21:36:59 +08:00
i-robot 79d1f3cfd3 !23854 Fix testcase about modelzoo 
Merge pull request !23854 from chenhaozhe/fix-testcase-about-models
 2021-09-23 12:27:42 +00:00
despicablemme 7a6b75c2e8 [feat] [assistant] [I40GZJ] add new data op RandomAutoContrast 2021-09-23 20:17:39 +08:00
i-robot ab9a7163cb !22175 [assistant][ops]New operator implementation, include Trunc 
Merge pull request !22175 from 梁秀波/Trunc
 2021-09-23 10:04:55 +00:00
i-robot 0c26736da1 !22276 [MS][crowdfunding]New operator implementation, RandomInvert 
Merge pull request !22276 from yangwm/rinvert
 2021-09-23 08:12:57 +00:00
lianliguang 7227b61979 modify info when infer error 2021-09-23 15:54:43 +08:00
i-robot 632e3b8dcd !23663 add exception level to python error report 
Merge pull request !23663 from huangbingjian/py_log
 2021-09-23 07:46:45 +00:00
huanghui 97250978c4 fix the debug info about the function decorated by @ms_functon 2021-09-23 14:43:02 +08:00
echo-yike 785558cdd2 [feat][assistant][I40FGD] add new Ascend operator Trunc 2021-09-23 14:27:35 +08:00
chenhaozhe 12fab451e8 fix test cases about models 2021-09-23 09:19:37 +08:00
i-robot 44b1dbf77f !23827 MD Python UT: Update num_epochs to appropriate value for iterators instead of using default value 
Merge pull request !23827 from hetshah/hs_python_ut
 2021-09-22 21:14:35 +00:00
hetshah 2c1666fd06 set num epochs for iterators that use the default value 
add explicit paramter for infinite iterators

set appropriate value for num_epoch param for iteratos

fix long lines

remove trailing whitespace

fixed typo

remove comment

fixed comments

fixed test
 2021-09-22 17:32:50 +00:00
despicablemme b977d8723b [feat] [assistant] [I40GZC] add new data ops RandomInvert 2021-09-22 16:55:14 +08:00
huangbingjian 3ee5d98a8d add exception level to python error report 2021-09-22 14:34:21 +08:00
ckczzj 001b68c286 [feat][assistant][I3J6VG] add new data operator QMnist 2021-09-22 12:13:27 +08:00
Zhang Qinghua 9fbd118319 Handle interpreted node as input, set function Parameters and update local params if need. 2021-09-18 17:34:50 +08:00
i-robot ebe094ac0f !21829 [assistant][ops] Add New Cdist and CdistGrad 
Merge pull request !21829 from 孟权令/Cdist
 2021-09-18 09:23:27 +00:00
i-robot e87f0be14f !23707 fix summary isolation 
Merge pull request !23707 from jiangshuqiang/temp
 2021-09-18 09:23:25 +00:00
i-robot 6489dacdab !18114 [assistant][ops]Add new operator Magphase 
Merge pull request !18114 from YJfuel123/Magphase
 2021-09-18 07:26:34 +00:00
i-robot 92287b86d8 !23471 Fix white list error msg synax error 
Merge pull request !23471 from xiefangqi/md_white_list_optimization
 2021-09-18 05:03:40 +00:00
jiangshuqiang c2bd061889 fix summary isolation 2021-09-18 10:59:14 +08:00
i-robot 95e56d0912 !23212 enable profiling warning 
Merge pull request !23212 from mindspore_ding/enable_profiling_master_0910
 2021-09-18 02:04:37 +00:00
zhoufeng 1f934bd782 check neighbor attr type 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-09-17 21:15:37 +08:00
dingpeifei 7523b320d7 enable profiling warning 2021-09-17 17:09:56 +08:00
葛崇林 a05a5de073 [feat][assistant][I3ALC5] add new method Magphase 2021-09-17 16:02:46 +08:00
i-robot f5af432e04 !16922 [assistant][Vol] 
Merge pull request !16922 from QingfengLi/Vol
 2021-09-17 06:51:49 +00:00
SichongHao 5412382e16 [feat][assistant][I3T91W][I3T91X]add new operator Cdist and CdistGrad 2021-09-17 13:58:53 +08:00
chenx2ovo 9e62623b4a [feat][assistant][I3CEGI] add op vol 2021-09-17 09:34:20 +08:00
ms_yan 0a365e91bf modify log in kernel part 2021-09-16 22:09:21 +08:00
i-robot a5b793463a !23099 Correct wrong info when using ms_function to decorate bprop 
Merge pull request !23099 from JoyLvliang/correct_wrong_info_when_using_ms_function_with_bprop
 2021-09-16 08:46:41 +00:00
i-robot 89119ae470 !23553 fix: pyfunc cause hung when it is a generator which can't be serialize 
Merge pull request !23553 from guozhijian/fix_pyfunc_hung_when_yield
 2021-09-16 08:44:50 +00:00
zhuyuxiao 79d99323a2 rename gather 2021-09-16 16:07:05 +08:00
7347157+joylvliang@user.noreply.gitee.com 6e59598f99 correct_wrong_info_when_using_ms_function_with_bprop 2021-09-16 14:12:55 +08:00
huangxinjing 0b89d5c9c4 fix batch size error 2021-09-16 10:56:40 +08:00
Guo Zhijian f49bacde09 fix: pyfunc hung when it's a yield func 2021-09-16 09:20:44 +08:00
i-robot 57b8c8e2d9 !23310 [MD] fix error message of mindrecord 
Merge pull request !23310 from liyong126/fix_log_msg
 2021-09-16 00:45:11 +00:00
i-robot e5af07d519 !23538 minddata error message optimize 
Merge pull request !23538 from luoyang/log_update
 2021-09-16 00:42:42 +00:00
i-robot 4a553c8d57 !16607 [assistant][Fade] 
Merge pull request !16607 from QingfengLi/Fade
 2021-09-15 14:54:16 +00:00
i-robot 87fac9a520 !23476 fix hung when user return Tensor in generator 
Merge pull request !23476 from guozhijian/fix_generator_hung_when_return_mindspore_tensor
 2021-09-15 10:17:24 +00:00
YangLuo 9d89de5765 minddata error message optimize 2021-09-15 18:05:02 +08:00
liyong 65f3365a2a fix mindrecord log 2021-09-15 16:18:40 +08:00
i-robot 0d914dd427 !22638 Add ut test for offline debugger 
Merge pull request !22638 from sabrinasun_59ee/ut
 2021-09-15 06:28:47 +00:00
jonyguo c408867085 fix: hung when user return Tensor in generator 2021-09-15 14:13:33 +08:00
i-robot 0a33f88d48 !23419 log error level information in python when GLOG_v=4 
Merge pull request !23419 from huangbingjian/exception_log
 2021-09-15 01:29:12 +00:00
i-robot bbdacd41f4 !20585 add security isolate for save_graphs 
Merge pull request !20585 from huanghui/add-security-isolate-for-DumpIR
 2021-09-15 01:25:46 +00:00
sabrinasun 3a349a9219 add ut test for offline debugger 2021-09-14 18:46:22 -04:00
xiefangqi a91c87c581 fix some syntax error 2021-09-14 21:29:02 +08:00
chenx2ovo 1a3196b052 [feat][assistant][I3CEGF] add op fade 2021-09-14 19:08:37 +08:00
i-robot db19a40280 !23365 add print op security 
Merge pull request !23365 from fangzehua/print_sec
 2021-09-14 09:01:31 +00:00
i-robot c6a99428cd !23153 Update the operator in order to let users better understand the reason for the error of the operator part: nn_ops and array_ops 
Merge pull request !23153 from dinglinhe/dlh_code_ms_I43QY0_nn_ops
 2021-09-14 06:33:39 +00:00
i-robot 2b4cdea48a !23331 batch parallel operator replace input shape from construct 
Merge pull request !23331 from yangzhenzhang/modify-batch-parallel-info
 2021-09-14 06:32:45 +00:00
huangbingjian 6ba47653bf log error level information in python when GLOG_v=4 2021-09-14 14:23:55 +08:00
huanghui ba66c0d491 add security isolate for save_graphs 2021-09-14 10:24:12 +08:00
i-robot 32c2b77595 !19093 [assistant][ops] Add new audio operator Biquad 
Merge pull request !19093 from 杨旭华/Biquad
 2021-09-14 01:52:01 +00:00
dinglinhe 9a8c1b3c73 array_ops error recti and others 2021-09-14 09:12:02 +08:00
i-robot 6dcfe64501 !23264 python serdes bug fix 
Merge pull request !23264 from zetongzhao/deserialize
 2021-09-13 15:53:05 +00:00
i-robot 0aa167cdf4 !23240 maybe max open files in mr or onehot fail in pytransform 
Merge pull request !23240 from guozhijian/fix_max_open_files_and_onehot
 2021-09-13 13:51:09 +00:00
i-robot e149a15ace !23002 Error log optimizer 
Merge pull request !23002 from zhangzhaoju/master_syntax
 2021-09-13 13:43:40 +00:00
i-robot dc45c64a78 !23207 Adding security isolation to debugger 
Merge pull request !23207 from sabrinasun_59ee/macro
 2021-09-13 12:07:29 +00:00
i-robot 5abd4821ce !23357 Add DatasetName method for out developer 
Merge pull request !23357 from xiefangqi/md_white_list_optimization
 2021-09-13 12:06:49 +00:00
i-robot 3e1d1ff4d3 !18671 [assistant][ops]New operator implementation, include SBUDataset 
Merge pull request !18671 from Wangsong95/sbu_dataset
 2021-09-13 11:56:13 +00:00
liannai 631f49f044 [feat][assistant][I3T96A] Add new audio operator Biquad 2021-09-13 19:18:50 +08:00
fangzehua 4ccc635a07 add print security 2021-09-13 17:45:36 +08:00
i-robot bdfd3877f8 !23300 Optimize of exception log of AD 
Merge pull request !23300 from YuJianfeng/dfx
 2021-09-13 09:35:18 +00:00
yangzhenzhang 1b8eb283e4 modify batch parallel info 2021-09-13 16:28:56 +08:00
zhangzhaoju 4296881a16 syntax 2021-09-13 15:20:53 +08:00
xiefangqi 465dd25d74 add virtual DatasetName method 2021-09-13 15:17:32 +08:00
sabrinasun 220245f592 add security isolation to online and offline debugger 2021-09-12 23:01:15 -04:00
i-robot 87381a1cf9 !17806 [assistant][ops] DcShift Op 
Merge pull request !17806 from 杨旭华/DCShift
 2021-09-13 01:29:14 +00:00
i-robot c9ff7242a4 !23298 minddata engine optimize white list error msg 
Merge pull request !23298 from xiefangqi/md_white_list_optimization
 2021-09-13 01:19:15 +00:00
Carry955 0ba84345b0 [feat][assistant][I3J6U3] add new audio operator DCShift 2021-09-11 23:58:18 -07:00
jonyguo da78a17730 fix: may max openfiles in mindrecord and onehot error in py_transform 
and cache_admin rpath
 2021-09-12 00:25:07 +08:00
yujianfeng 752bdde06d Optimize of exception log of AD 2021-09-11 18:07:50 +08:00
xiefangqi ff73e4ccd7 fix white list error msg 2021-09-11 17:36:23 +08:00
Isaac17555 53fc99b914 [feat][assistant][I3T96B]add new data operator LFilter 2021-09-11 02:05:43 -07:00
i-robot 0071667155 !23039 [Fallback] Fix previous block parameters problem and add test cases. 
Merge pull request !23039 from 张清华/opt_fallback
 2021-09-11 07:39:02 +00:00
i-robot a61c2c5cfe !17885 [assistant][ops]Add new operator EqualizerBiquad 
Merge pull request !17885 from YJfuel123/EqualizerBiquad
 2021-09-11 06:40:29 +00:00
i-robot 9b7a966174 !21262 [assistant][ops]New operator implementation, include SparseApplyRMSPropD 
Merge pull request !21262 from 梁秀波/SparseApplyRMSPropD
 2021-09-11 06:01:29 +00:00
i-robot 76fac95591 !23069 Modify error content 
Merge pull request !23069 from huchunmei/master
 2021-09-11 03:50:52 +00:00
YJfuel123 16150d394f [feat][assistant][I3ALd1] add new operator EqualizerBiquad 2021-09-11 10:36:20 +08:00
ckczzj af97ba4a77 [feat][assistant][I3J6VH] add new data operator SBU 2021-09-11 09:58:17 +08:00
zetongzhao 719a207040 deserialize fix 2021-09-10 15:19:59 -04:00
i-robot 7b4f361ca7 !23232 Fix multiprocessing attr error 
Merge pull request !23232 from xiefangqi/md_fix_map_pool_issue
 2021-09-10 14:59:40 +00:00
i-robot 6d709c7254 !19624 [assistant][ops] Add new dataset operator DIV2K. 
Merge pull request !19624 from Rainfor/div2k
 2021-09-10 14:59:21 +00:00
xiefangqi 66c5f937dd fix attr failed problem 2021-09-10 18:01:04 +08:00
wangkc123 3daf3a4d5f [feat] [assistant] [I3CKEK] add new dataset operator DIV2K 2021-09-10 17:55:34 +08:00
Zhang Qinghua bcfb274074 [Fallback] Fix previous block parameters problem, and add test cases. 2021-09-10 16:43:46 +08:00
robert_luo_yibo ce71699734 [feat][assistant][I3CEG5] add new data OP MuLawDecoding 2021-09-10 15:49:46 +08:00
huchunmei c75773cf37 Modify error content 2021-09-10 15:21:33 +08:00
i-robot 32cc5d79b0 !18670 [assistant][ops]New operator implementation, include USPSDataset 
Merge pull request !18670 from Wangsong95/usps_dataset
 2021-09-10 03:06:19 +00:00
i-robot f91e1440c8 !17810 [assistant][ops][DeemphBiquadOp] 
Merge pull request !17810 from Isaac/DeemphBiquad
 2021-09-10 03:05:41 +00:00
i-robot 2cc8c851c5 !23141 mkdir rank_id 0909 
Merge pull request !23141 from mindspore_ding/mkdir_rankid_master_0909
 2021-09-10 02:45:54 +00:00
i-robot 725cf63118 !23187 upgrade Ascend software package 09 Sep 21 
Merge pull request !23187 from yanghaoran/upgrade_ascend_0909
 2021-09-10 01:55:13 +00:00
i-robot 0abff9ad65 !23108 Fix spelling error for transformer 
Merge pull request !23108 from huangxinjing/fix_spell_error
 2021-09-10 01:29:32 +00:00
ckczzj d7c702e9d4 [feat][assistant][I3J6VL] add new data operator USPS 2021-09-09 21:46:57 +08:00
yanghaoran 0ced8775c4 upgrade Ascend software package 09 Sep 21 2021-09-09 20:30:22 +08:00
huangxinjing e02f553010 Fix spell error and add mode check 2021-09-09 18:50:53 +08:00
i-robot 5c72e9d7c6 !23078 Get bprop from python when the bprop mindir dir does not exist 
Merge pull request !23078 from YuJianfeng/bprop_mindir
 2021-09-09 09:51:14 +00:00
i-robot e37b7374ae !22434 [MoE] Adding a MoE implementation 
Merge pull request !22434 from Xiaoda/84-add-moe-layer
 2021-09-09 09:06:56 +00:00
dingpeifei 992d6a6dbc mkdir rank_id 2021-09-09 16:14:54 +08:00
i-robot 936940da8e !22666 [assistant][ComplexNorm] 
Merge pull request !22666 from QingfengLi/ComplexNorm
 2021-09-09 06:41:53 +00:00
Isaac 5dc6c7fe96 [feat][assistant][I3J6U6]add new data operator DeemphBiquad 2021-09-09 14:34:24 +08:00
Xiaoda Zhang 5613c0b974 add a moe implementation: 
1) extend the Liner cell for including BatchMatMul implementation, in
which the first dimension indicates the expert number;
2) implement a Switch (top1) router;
3) implement a MoE cell, which extends the FeedForward cell.
 2021-09-09 11:53:42 +08:00
i-robot 9ad56e86ab !17846 [assistant][ops]Add new operator HighpassBiquad 
Merge pull request !17846 from YJfuel123/HighpassBiquad
 2021-09-09 02:06:41 +00:00
i-robot a918783f1a !22623 Add Random operation with Multi Field 
Merge pull request !22623 from shenwei41/operation_dev
 2021-09-09 01:49:04 +00:00
yujianfeng dfe1b05b28 Get bprop from python when the bprop mindir dir does not exist 2021-09-09 09:05:19 +08:00
i-robot b21da536d3 !22784 serdes python operations by pyfunc 
Merge pull request !22784 from zetongzhao/deserialize
 2021-09-08 17:18:57 +00:00
zetongzhao 0d389f3f0c serdes python operations 2021-09-08 09:05:11 -04:00
shenwei41 a8d02ab782 Add Random operation with MultiField 2021-09-08 19:29:23 +08:00
i-robot 938324b397 !19362 [assistant][ops] Add new dataset operator Cityscapes. 
Merge pull request !19362 from Rainfor/cityscapes
 2021-09-08 09:14:43 +00:00
i-robot 77424eaad5 !23004 Add args Check for Transformer 
Merge pull request !23004 from huangxinjing/args_check
 2021-09-08 08:24:06 +00:00
yaoyuan 85a1b55b47 [feat] [assistant] [I3ALCL] add new operator HighpassBiquad 2021-09-08 15:12:40 +08:00
huangxinjing 6cea07f749 Add args check 2021-09-08 09:12:35 +08:00
i-robot b1be8dfd31 !22851 MD Profiling: Update Connector Init to Remove any existing file 
Merge pull request !22851 from cathwong/ckw_mon_seq_pipelines_fix
 2021-09-07 19:57:58 +00:00
i-robot d37d57d0fd !22941 parallel_sparse_attention_ops_fix_repeated_cal 
Merge pull request !22941 from yao_yf/parallel_sparse_attention_ops_fix_repeated_cal
 2021-09-07 13:26:19 +00:00
i-robot 5cf19e8aa6 !22986 Add supported namespace for fallback. 
Merge pull request !22986 from 张清华/opt_fallback
 2021-09-07 12:50:32 +00:00
Zhang Qinghua 6edea0ed3c Add supported namespace for fallback. 2021-09-07 16:19:25 +08:00
i-robot 5ed105ec01 !22933 Tensor support complex scalar number input 
Merge pull request !22933 from zhouyaqiang0/complex_ops
 2021-09-06 13:29:21 +00:00
i-robot 990d561ed9 !22974 Fix ut/python/dataset generator 14 occationally segment fault 
Merge pull request !22974 from xiefangqi/md_fix_generator_problem
 2021-09-06 12:25:22 +00:00
yao_yf 3ef26288a2 parallel_sparse_attention_ops_fix_repeated_cal 2021-09-06 19:57:22 +08:00
i-robot 05a0898352 !22843 Support fallback feature in Graph mode. 
Merge pull request !22843 from 张清华/opt_fallback
 2021-09-06 11:35:45 +00:00
xiefangqi 57f68d35bd fix generator 14 ut problem 2021-09-06 19:01:51 +08:00
zhouyaqiang 4e07873378 Tensor support complex input 2021-09-06 18:44:26 +08:00
Zhang Qinghua 7203989c26 Support fallback feature in Graph mode (1). 2021-09-06 16:00:03 +08:00
lilei 62e832eaab modify parallel API 2021-09-06 11:45:10 +08:00
i-robot fa12d62d4d !21776 set device_id master 0813 
Merge pull request !21776 from mindspore_ding/set_device_id_master_0813
 2021-09-06 03:02:58 +00:00
Cathy Wong bc85c606b8 MD Profiling: Update Connector Init to Remove any existing file 
to fix sequential pipeline scenario.
 2021-09-03 15:45:38 -04:00
yao_yf 3ca73a6d6b broadcast using seqarates world group 2021-09-03 11:21:36 +08:00
i-robot 60d583190b !22815 Update bprop error information 
Merge pull request !22815 from JoyLvliang/update_bprop_error_information
 2021-09-03 01:31:15 +00:00
i-robot 90c7804d6b !22500 Sort watchpoint hit for offline debugger based on time stamps of dump files 
Merge pull request !22500 from parastooashtari/offline_wp_hit_order
 2021-09-02 14:47:06 +00:00
dingpeifei b4bc6000dc set device id master 0813 2021-09-02 20:51:50 +08:00
7347157+joylvliang@user.noreply.gitee.com 14d24d4793 update_bprop_error_information 2021-09-02 20:40:55 +08:00
i-robot bbbd6e0254 !22579 modify resizebilinear infer type 
Merge pull request !22579 from Simson/opinfer
 2021-09-02 01:02:00 +00:00
i-robot 3368287aab !22620 add util: browse dataset 
Merge pull request !22620 from luoyang/browse_dataset
 2021-09-02 01:00:46 +00:00
Parastoo Ashtari 65d8272352 sort wp hit for offline debugger with time stamp 2021-09-01 14:40:33 -04:00
robert_luo_yibo 3d58da9023 [fix][assistant][I47V0O] fix bug about the wrong output in the operator ComplexNorm 2021-09-01 17:55:38 +08:00
YangLuo 97c1ba380f add util: browse dataset 2021-09-01 16:13:32 +08:00
i-robot d87d0e07c2 !22255 recompute_interface_modify 
Merge pull request !22255 from yao_yf/recompute_interface_modify
 2021-09-01 08:09:36 +00:00
i-robot fc9d4ed659 !17813 [assistant][ops] Add new audio operator Contrast 
Merge pull request !17813 from 杨旭华/Contrast
 2021-09-01 06:38:05 +00:00
yao_yf 39055af6e4 recompute interface modify 2021-09-01 10:59:59 +08:00
i-robot cc8d614b25 !22650 fixed sparse attention modify 
Merge pull request !22650 from yao_yf/fixed_sparse_attention_modify
 2021-09-01 01:29:45 +00:00
simson 7a2fbdda85 modify resizebilinear infer type 2021-09-01 09:03:55 +08:00
wangkc123 70f741bcc1 [feat] [assistant] [I3CKEM] add new dataset operator Cityscapes 2021-08-31 20:03:37 +08:00
Feve1986 82b04d6a1e [feat][assistant][I40FFX] add new Ascend operator SparseApplyRMSPropD 2021-08-31 17:28:38 +08:00
i-robot 389f3a6b6c !21835 make alltoall and neighborexchange to be interface && revert pr 21395 
Merge pull request !21835 from zhoufeng/revert-same-input-to-comm-op
 2021-08-31 08:53:46 +00:00
yao_yf 82889ec56b fixed sparse attention 2021-08-31 16:11:56 +08:00
i-robot 740c62cbaa !22384 amend_assigin 
Merge pull request !22384 from jiangzhenguang/amend_assigin
 2021-08-31 06:55:02 +00:00
tongyue 329526dea8 [feat][assistant][I3J6U0] add new data operator Contrast 2021-08-30 19:34:37 -07:00
i-robot bbf9c6a9ad !22529 fix: for loop dataset iterator will cause memory leak 
Merge pull request !22529 from guozhijian/fix_for_loop_ds_iter_memory_leak
 2021-08-31 01:15:58 +00:00
jiangzhenguang 8812c8fe9b amend assign 2021-08-31 09:10:21 +08:00
yao_yf 68dd138462 add parallel sparse attention ops: dsd_matmul 2021-08-30 18:46:52 +08:00
i-robot 5b8f9ff398 !22096 add parallel sparse attention ops 
Merge pull request !22096 from yao_yf/parallel_sparse_attention_ops
 2021-08-30 10:43:05 +00:00
i-robot 37ecdba742 !20829 [assistant][ops]New operator implementation, include ApplyAdagradDA 
Merge pull request !20829 from 梁秀波/ApplyAdagradDAD
 2021-08-30 09:16:19 +00:00
zhoufeng ecae690a19 Revert "fix same node is used by two comm op" 
This reverts commit b09d411dc4.

add AlltoAll and NeighborExchange as interface
 2021-08-30 16:54:38 +08:00
i-robot a47ab8d643 !18073 [assistant][ops]Add new operator LowpassBiquad 
Merge pull request !18073 from YJfuel123/LowpassBiquad
 2021-08-30 08:33:39 +00:00
i-robot ff2e34b9f9 !22509 Add ut and st for Jvp, Vjp and Grad 
Merge pull request !22509 from LiangZhibo/fix
 2021-08-30 08:21:54 +00:00
jonyguo 4c915fdcbb fix: for loop dataset iterator will cause memory leak 2021-08-30 16:08:26 +08:00
zx 0efbedd23c [feat][assistant][I40FFF] add new Ascend operator ApplyAdagradDA 2021-08-30 11:01:18 +08:00
liyong 5a4ff8cfdb fix ci issue 2021-08-30 10:18:06 +08:00
yao_yf b8a9cbe2a3 add cus_matmul_dds parallel ops 2021-08-30 09:44:48 +08:00
Zhang Qinghua a137fa1d0b Optimize the Executors routines. 
- Fix the key generating.
- Distinguish the executors.
 2021-08-28 17:36:12 +08:00
l00591931 98fad9f08e Add st and ut for jvp vjp and grad 2021-08-28 17:34:23 +08:00
i-robot 535877a47b !22014 Add Fixed Sparse Attention 
Merge pull request !22014 from zhihenghu/add_sparse_attention
 2021-08-28 07:13:01 +00:00
zhihenghu ce12c02343 Add Sparse Attention 
adjut the file structure and name

Deleted extra information

Do some formatting work

Add test case and fix some document

fix imports
 2021-08-28 11:50:58 +08:00
i-robot 1639023909 !22263 Add convertcolor operation 
Merge pull request !22263 from shenwei41/operation_dev
 2021-08-27 12:33:43 +00:00
i-robot dd907a4d91 !22135 rank id master 0820 
Merge pull request !22135 from mindspore_ding/rank_id_master_0816
 2021-08-27 08:51:05 +00:00
i-robot ebe75e403b !22444 Apply comments on tensor stat online and offline PR 
Merge pull request !22444 from parastooashtari/tensor_level_info_online
 2021-08-27 07:42:51 +00:00
d00455729 34262db65e create rank_id dic 2021-08-27 14:24:06 +08:00
liyong c257cf36e2 refactor mindrecord 2021-08-27 09:15:05 +08:00
Parastoo Ashtari bf034bddb5 Apply comments on tensor stat online and offline debugger 2021-08-26 17:40:01 -04:00
i-robot cd4081ac87 !20676 [assistant][ops] Add array operator SplitV 
Merge pull request !20676 from 孟权令/SplitV
 2021-08-26 13:54:40 +00:00
shenwei41 1295744524 Add ConvertColor Operation 2021-08-26 21:14:28 +08:00
i-robot e6e1f37ae4 !22346 [Core] Fix the bug of scope setting when cloning nodes 
Merge pull request !22346 from Xiaoda/86-fix-the-fullname-scope-bug
 2021-08-26 13:04:15 +00:00
i-robot e753a3f70a !22416 Transform device_id to rank_id for hccl 
Merge pull request !22416 from 张毅辉/Device_id_to_rank_id
 2021-08-26 12:09:38 +00:00
haizhouye d96d9e64b0 [feat] [assistant] [I3ALCA] add new LowpassBiquad operator 
[feat] [assistant] [I3ALCA] add new LowpassBiquad operator

bugfix

fix

fix
 2021-08-26 18:49:21 +08:00
i-robot 7083ec9d37 !21925 add pad mode to maxpool3d 
Merge pull request !21925 from jiangzhenguang/amend_maxpool3d
 2021-08-26 09:08:37 +00:00
i-robot 8d00a8d803 !22360 Fix Transformer Mirror Error 
Merge pull request !22360 from huangxinjing/fix_transformer_mirror_error
 2021-08-26 08:16:33 +00:00
zhangyihui 3e5cb3b506 fix bugs for device_id_to_rank_id 2021-08-26 16:15:18 +08:00
i-robot 28e63116f2 !21921 Re-enabling offline debugger ut test 
Merge pull request !21921 from sabrinasun_59ee/uttest
 2021-08-26 07:50:01 +00:00
i-robot 471c57d3d7 !20046 [assistant][ops] Add New MaskedFill 
Merge pull request !20046 from 孟权令/MaskedFill
 2021-08-26 07:43:18 +00:00
i-robot a646eb27ab !21616 modify ms function cache key 
Merge pull request !21616 from chujinjin/modify_ms_function_cache_key
 2021-08-26 07:36:50 +00:00
i-robot 0faf36d5c5 !22187 modify api comment 
Merge pull request !22187 from changzherui/mod_dir_auth
 2021-08-26 03:01:33 +00:00
i-robot 07eaa1969b !22344 fix compile error when weight is used in while condition 
Merge pull request !22344 from xychow/fix-while-loop-with-weight-in-condition
 2021-08-26 03:00:38 +00:00
Xiaoda Zhang b2703879c6 fix the scope setting error when cloning nodes 2021-08-26 10:25:38 +08:00
i-robot edcbb68d71 !22386 fix neighborexchange empty input case 
Merge pull request !22386 from zhoufeng/fix-neighbor-empty-input-bak
 2021-08-26 01:52:10 +00:00
i-robot 5aeec398bb !22369 add test cases for conv2d 
Merge pull request !22369 from yangzhenzhang/add-test-cases
 2021-08-26 01:46:10 +00:00
i-robot 457a01fd09 !20055 [assistant][ops] Add math operator IndexAdd 
Merge pull request !20055 from 孟权令/IndexAdd
 2021-08-26 01:15:39 +00:00
sabrinasun a9c6bf45a3 re-enabling offline debugger ut test 2021-08-25 19:05:19 -04:00
changzherui 46319f3198 modify comment 2021-08-26 00:44:44 +08:00
zhoufeng e5a1582e4b fix neighborexchange empty input case 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-08-25 21:41:22 +08:00
huangxinjing 62496d75f3 less the interface exposed 2021-08-25 21:22:40 +08:00
i-robot 956ae2bbfd !22223 [assistant][TimeMask and FreqMask] 
Merge pull request !22223 from QingfengLi/TimeFreqMask
 2021-08-25 10:43:24 +00:00
i-robot acee9b24bc !22284 Change Op name in hccl to Op name in step trace 
Merge pull request !22284 from 张毅辉/op_name_of_hccl_to_op_name_of_step_trace
 2021-08-25 09:32:55 +00:00
yangzhenzhang 0b9b2a9458 add test cases 2021-08-25 17:22:20 +08:00
jiangzhenguang 8a78b2b7f6 add pad mode to maxpool3d 2021-08-25 16:24:02 +08:00
i-robot 60634c5d11 !21745 Unified format of single machine and multi machine performance data directory 
Merge pull request !21745 from 张毅辉/Device_id_to_rank_id
 2021-08-25 07:49:29 +00:00
doit a5193df648 [feat] [assistant] [I3T92B] add new array operator MaskedFill 2021-08-25 15:29:37 +08:00
i-robot 36238032a2 !22245 Add pynative switch layer ut test case 
Merge pull request !22245 from zjun/switch_layer_ut_test
 2021-08-25 07:24:28 +00:00
chujinjin 551fa9ab8b modify ms function cache key 2021-08-25 14:40:45 +08:00
hulx c70731d601 [feat][assistant][I3T924] add new math operator IndexAdd 2021-08-25 14:19:17 +08:00
zhangyihui dab750d1a5 Mapping op_name of hccl to op_name of step trace 2021-08-25 10:51:52 +08:00
chenx2ovo 2f1d974eeb [fix] [assistant] [I465ZG] revise error message and change input param datatype 2021-08-25 10:47:27 +08:00
i-robot 698eb406e2 !20129 [assistant][ops] Add math operator Erfinv 
Merge pull request !20129 from 孟权令/Erfinv
 2021-08-25 02:44:18 +00:00
i-robot 2edaba38bf !21389 Add Tensor Base and Stat info to offline debugger 
Merge pull request !21389 from parastooashtari/tensor_info_levels
 2021-08-25 02:08:34 +00:00
i-robot 0adacd1b68 !22226 [AutoParallel]Refacor pipeline code 
Merge pull request !22226 from lichen/Refactor_part_of_pipeline
 2021-08-25 01:54:18 +00:00
zhangyihui 3d19949eb4 device_id to rank_id 2021-08-25 09:52:23 +08:00
zhousiyi 44bdcb101c fix while loop compile error when weight is used in while condition 2021-08-25 01:33:34 +00:00
i-robot 4e81ea7bb0 !22300 Add ut and st case for non tensor input in pynative 
Merge pull request !22300 from JoyLvliang/add_st_ut_case_for_pynative_non_tensor_input
 2021-08-25 01:23:34 +00:00
Parastoo Ashtari ff83dee704 Add tensor base and stat info to offline debugger 2021-08-24 18:19:59 -04:00
lichenever 5812076512 Refactor_part_of_pipeline 2021-08-24 21:37:41 +08:00
hulx ca6f3ef155 [feat][assistant][I3T925] add new math operator Erfinv 2021-08-24 21:25:04 +08:00
i-robot 661c83e17f !22274 MD Profiling UT: Use pytest setup and teardown 
Merge pull request !22274 from cathwong/ckw_mon_py_analyze_ut5
 2021-08-24 13:24:49 +00:00
i-robot 1e47ff7bc3 !22108 modify check strategy for conv2d 
Merge pull request !22108 from yangzhenzhang/modify-check-strategy-for-conv2d
 2021-08-24 12:01:23 +00:00
hedongdong 09bc1bddf1 [feat][assistant][I3T92H] add new array operator SplitV 2021-08-24 19:54:26 +08:00
i-robot ab758a981c !20044 [assistant][ops] Add New Lerp 
Merge pull request !20044 from 孟权令/Lerp
 2021-08-24 11:25:44 +00:00
7347157+joylvliang@user.noreply.gitee.com a30800ecc3 add_st_ut_case_for_pynative_non_tensor_input 2021-08-24 16:44:05 +08:00
i-robot 822cedec0a !22153 Convert some ops bprops to mindir 
Merge pull request !22153 from YuJianfeng/bprop_mindir
 2021-08-24 08:07:46 +00:00
yangzhenzhang f1afaeac5a modify check strategy for conv2d 2021-08-24 16:06:16 +08:00
zjun 779b655cfe Add switch_layter pynative ut test 
Signed-off-by: zjun <zhangjun0@huawei.com>
 2021-08-24 11:21:13 +08:00
i-robot 6082835501 !22146 dataset: support return bytes in GeneratorDataset 
Merge pull request !22146 from ms_yan/decode_bytes
 2021-08-24 02:41:18 +00:00
Cathy Wong 3581e7962e MD Profiling UT: Use pytest setup and teardown 2021-08-23 21:09:48 -04:00
yujianfeng 712b9bd013 convert some ops bprops to mindir 2021-08-24 09:09:09 +08:00
i-robot db44b88e1e !22094 MD Profiling: For mismatch op info btwn files, skip bottleneck analysis 
Merge pull request !22094 from cathwong/ckw_mon_py_analyze_fixes3
 2021-08-23 18:28:51 +00:00
ms_yan 6ecfc34524 add np.frombuffer to support return bytes 2021-08-23 17:31:38 +08:00
ms_yan 36a8886ca2 Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset" 
This reverts commit b077aa1cab.

Revert "[feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset"

This reverts commit 4e6f7dc97d.

delete pass_registry_test.cc

comment  hiai_nlu_model_multi.pb related  line
 2021-08-23 01:46:38 +08:00
djc b077aa1cab [feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset 2021-08-22 16:26:45 +08:00
djc 4e6f7dc97d [feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset 2021-08-22 13:39:37 +08:00
i-robot 0e7844daa9 !22093 revert merge request 21685 
Merge pull request !22093 from guozhijian/revert-merge-21685-master
 2021-08-21 09:25:32 +00:00
i-robot 4ba337e0f5 !16667 [assistant][ComplexNorm] 
Merge pull request !16667 from QingfengLi/ComplexNorm
 2021-08-21 02:44:18 +00:00
doit bf23333b27 [feat] [assistant] [I3T927] add new math operator Lerp 2021-08-20 20:19:41 +08:00
i-robot f34426095c !22084 Move Transformer Code from Mindspore.nn.parallel to mindspore.parallel.nn 
Merge pull request !22084 from huangxinjing/transformer_doc_check
 2021-08-20 10:40:01 +00:00