Commit Graph

6195 Commits

Author SHA1 Message Date
i-robot 0d839fa7c6 !21809 Improved Transformer Struture and Add Args Check
Merge pull request !21809 from huangxinjing/transformer_improved
2021-08-17 12:05:25 +00:00
i-robot a77a0b968d !21761 comm_recompute_interface.
Merge pull request !21761 from yao_yf/comm_recompute_interface
2021-08-17 09:14:29 +00:00
i-robot debf4d8ece !21785 Fix Programming Specifications of Crowd Contributing Code
Merge pull request !21785 from xiaotianci/fix_crowd_contributing
2021-08-17 07:53:50 +00:00
cristoval 0a3e584eec add multinomial cpu kernel 2021-08-17 14:54:38 +08:00
yangzhenzhang 7ca64d2235 auto parallel support adafactor opt 2021-08-17 10:36:42 +08:00
yao_yf 5277b229be add cell comm recompute interface 2021-08-17 09:23:21 +08:00
Cathy Wong a2cbd4b5fa MD Profiling Analyze: Search for device trace file
MinddataProfilingAnalyzer() - remove device_target input parm
2021-08-16 15:41:11 -04:00
zetongzhao ea1f2d0d7c deserialize and tests 2021-08-16 10:23:36 -04:00
huangxinjing 18044aff0f 1. Add docstring, elimitate attention mask, tuple append the deocoder return layer past
split attention inputs from two into three

Add input check and modify test case

Fix check error and add check to transformer inputs

add input check to the transformers
2021-08-16 21:08:48 +08:00
i-robot 16d5427743 !21863 update the method for get rank_id
Merge pull request !21863 from yelihua/new-dev
2021-08-16 12:13:01 +00:00
cristoval b7c6f7ec07 add uniform_int and uniform_real on cpu 2021-08-16 20:11:18 +08:00
Xiao Tianci aae886bcd7 fix crowd contributing code 2021-08-16 19:33:10 +08:00
i-robot 692b39f306 !21821 RL add buffer sample update
Merge pull request !21821 from VectorSL/buffer-sample-update
2021-08-16 09:16:28 +00:00
i-robot ecb2f35665 !21818 add logs when query running jobs
Merge pull request !21818 from laiyongqiang/fusion_dbg
2021-08-16 06:13:58 +00:00
VectorSL 680d319290 update buffer sample gpu 2021-08-16 14:05:51 +08:00
yelihua a6dc9a0a07 get rank id when set hccl env for single card train 2021-08-16 13:44:02 +08:00
i-robot fca1cb34c8 !21490 Ascend control use vm
Merge pull request !21490 from chenfei_mindspore/ascend-control-use-vm
2021-08-16 03:34:54 +00:00
yao_yf a83bf73298 union auto_parallel_context interface dataset_strategy 2021-08-16 10:54:46 +08:00
i-robot 223f500bab !21803 mindir: support control flow switch layer
Merge pull request !21803 from lanzhineng/mindir_control_flow
2021-08-16 02:15:16 +00:00
liyong c5fefa7523 fix ut bug 2021-08-16 09:15:48 +08:00
lanzhineng 93a1956978 mindir:support switchlayer 2021-08-15 11:40:05 +08:00
LaiYongqiang c6f5a02237 add logs when querying job 2021-08-14 16:45:05 +08:00
i-robot 2151b927ba !21682 RL add buffer cpu kernel
Merge pull request !21682 from VectorSL/push-buffer-op-cpu
2021-08-14 01:37:30 +00:00
i-robot 69e8603a2b !21774 handle replace in updatestate_eliminate
Merge pull request !21774 from huangbingjian/replace_dev
2021-08-13 11:56:20 +00:00
VectorSL d7232b6630 add buffer cpu kernels 2021-08-13 18:22:18 +08:00
i-robot 724ba3c0bf !21731 Add expanders in c++ code
Merge pull request !21731 from DeshiChen/0809_expander
2021-08-13 10:19:34 +00:00
chenfei d6bc8c2fe3 ascend control in vm
inner test case fix

rm MS_CTX_MULTIGRAPH in ME func grpah cloner

add logs
2021-08-13 17:45:45 +08:00
i-robot 7996b4ec2d !21650 add Shift cpu OP
Merge pull request !21650 from zhujingxuan/master
2021-08-13 09:03:21 +00:00
i-robot 530da3e37e !21527 fix_reshape_reshape_in_auto_parallel
Merge pull request !21527 from yao_yf/fix_reshape_reshape_in_auto_parallel
2021-08-13 08:29:15 +00:00
huangbingjian 88059b76ee handle replace in updatestate_eliminate 2021-08-13 15:54:48 +08:00
i-robot f99effd430 !21755 Fix batch usability problem
Merge pull request !21755 from xiefangqi/md_fix_batch_usability
2021-08-13 07:21:49 +00:00
i-robot d1112f8e9c !17631 [assistant][FrequencyMasking]
Merge pull request !17631 from QingfengLi/FreqMask
2021-08-13 06:48:06 +00:00
i-robot 6afcd815d2 !21362 add pynative profiling codes based on ascend and gpu
Merge pull request !21362 from lvchangquan/profiling_refactor
2021-08-13 06:18:31 +00:00
i-robot 114f419d0a !21710 fix cropandresize, randomchoicewithmask and pad in CPU
Merge pull request !21710 from huangbo/pclint_fix_master
2021-08-13 01:27:17 +00:00
i-robot 2a9f1bf768 !21714 unify softplus data description and verification
Merge pull request !21714 from zhangbuxue/unify_softplus_data_description_and_verification
2021-08-12 13:39:28 +00:00
i-robot d8d7e261f6 !21683 move useless testcases from level0 to level1
Merge pull request !21683 from yanghaoran/master
2021-08-12 13:02:03 +00:00
xiefangqi e4894a1bf1 fix batch usability problem 2021-08-12 20:12:43 +08:00
i-robot 8c2b6d0e17 !21675 RL add buffer gpu kernel
Merge pull request !21675 from VectorSL/push-buffer-op-gpu
2021-08-12 11:31:30 +00:00
i-robot 2650aae9ba !21351 complex support
Merge pull request !21351 from zhouyaqiang0/complex_support
2021-08-12 09:39:15 +00:00
huangbo77 984e004b44 fix cropandresize and randomchoicewithmask 2021-08-12 16:56:29 +08:00
dayschan 9add26ad99 Add expanders in c++ code
transplant the op expander code from python to c++, base on LiteGraph.
the c++ expander will be called in priority if it was registered in OpExpanderFactory.

add two examples, BiasAdd and ExpandDims.
remove BiasAdd from python expanders.
since the ExpandDims is also imported by other ops (e.g. BatchNorm), we don't remove it now.
2021-08-12 16:22:56 +08:00
zhujingxuan c7febdcca4 add Shift cpu OP 2021-08-12 15:36:57 +08:00
chenx2ovo 53615010a3 [feat][assistant][I3CEGG] add new data OP FrequencyMasking 2021-08-12 15:28:30 +08:00
buxue f4ea9bd616 unify softplus data description and verification 2021-08-12 13:07:04 +08:00
yao_yf e233880e41 fix reshape depend reshape in auto parallel 2021-08-12 11:45:28 +08:00
i-robot bff5cbda9c !21670 fix: null numpy field in mindrecord will cause read error
Merge pull request !21670 from guozhijian/fix_null_numpy_field_in_mr
2021-08-12 03:39:34 +00:00
zhouyaqiang b81ba100b7 add complex number support 2021-08-12 10:36:43 +08:00
i-robot f936fe9c2e !21661 support more high rank for activation op
Merge pull request !21661 from zhangbuxue/support_more_high_rank_for_activation_op
2021-08-12 02:28:33 +00:00
i-robot 63445ff6fd !21627 alltoall exception handle
Merge pull request !21627 from zhoufeng/alltoall_exception
2021-08-12 01:40:22 +00:00
i-robot 6320bf6b7b !21676 check strategy for conv2d
Merge pull request !21676 from yangzhenzhang/check-strategy-for-conv2d
2021-08-12 01:29:37 +00:00
i-robot 73b55cff72 !20794 add adafactor
Merge pull request !20794 from jiangzhenguang/add_adafactor_optimizer
2021-08-12 01:27:03 +00:00
yanghaoran 64d34104e5 move useless testcases from level0 to level1 2021-08-11 23:11:34 +08:00
VectorSL 6b4f02af58 add gpu buffer kernel 2021-08-11 22:00:05 +08:00
yangzhenzhang d18c813ee4 check strategy for conv2d 2021-08-11 19:12:48 +08:00
zhoufeng 03a56f2bb0 alltoall exception handle
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2021-08-11 17:30:49 +08:00
jonyguo 42b3512a1b fix: when field is none in mr 2021-08-11 17:11:38 +08:00
buxue 2808460567 support more high rank for activation op 2021-08-11 16:49:04 +08:00
i-robot 9eb414b768 !19389 ascend compile reconstruct
Merge pull request !19389 from liubuyu/compile_re
2021-08-11 07:19:11 +00:00
i-robot 9211814983 !21606 mindir: support control flow_ while
Merge pull request !21606 from lanzhineng/mindir_control_flow
2021-08-11 01:26:35 +00:00
i-robot 8947a11e49 !21544 [GraphKernel] fix bert and add graph kernel ops.
Merge pull request !21544 from chenlei_autodiff/add_sin
2021-08-11 01:04:12 +00:00
lby a5029f061c ascend kernel build refactory 2021-08-10 23:40:49 +08:00
i-robot ace6e49e00 !21494 pyfunc primitive register
Merge pull request !21494 from chenweifeng/pyfunc-primitive-register
2021-08-10 13:43:46 +00:00
lvchangquan e8d9803258 add profiling codes based on ascend and gpu in pynative mode 2021-08-10 20:46:51 +08:00
jiangzhenguang a3bb780ce4 optimize run memory 2021-08-10 20:45:25 +08:00
lanzhineng 787b19c014 mindir:support control flow while 2021-08-10 17:01:26 +08:00
chenlei_autodiff 0271535429 [GraphKernel] fix bert and add graph kernel ops. 2021-08-10 16:02:00 +08:00
wilfChen 95ab172c56 pyfunc primitive register 2021-08-10 15:47:07 +08:00
chenx2ovo e72acf362c [feat][assistant][I3CEGH] add op timemasking 2021-08-10 12:06:07 +08:00
i-robot f154db1bb0 !20680 [assistant][ops] Add New SoftMarginLoss and SoftMarginLossGrad
Merge pull request !20680 from 孟权令/SoftMarginLoss
2021-08-10 02:39:28 +00:00
i-robot 4aaa8126a0 !21528 Add Parallel Print Support
Merge pull request !21528 from huangxinjing/add_print
2021-08-09 10:55:04 +00:00
i-robot dc626617fc !19526 [assistant][TimeStretch]
Merge pull request !19526 from QingfengLi/TimeStretch
2021-08-09 09:40:38 +00:00
i-robot 75429acbe3 !21519 fix waring
Merge pull request !21519 from shenwei41/fix_sqlite
2021-08-09 09:09:18 +00:00
shenwei41 59efbb88ec fix waring 2021-08-09 11:40:52 +08:00
i-robot 8306abeb67 !21168 Only replace the primal user with tuple_getitem once
Merge pull request !21168 from YuJianfeng/ad
2021-08-09 03:19:07 +00:00
huangxinjing 92bad162bd Add print 2021-08-09 11:14:25 +08:00
lanzhineng dc63dea103 mindIR support control flow 2021-08-08 19:02:18 +08:00
chenx2ovo 04705e5b0d [feat][assistant][I3CEGC] add op timestretch 2021-08-07 22:53:41 +08:00
i-robot c84e09cf45 !21072 Deserialize - python binding
Merge pull request !21072 from zetongzhao/deserialize_1
2021-08-06 21:47:09 +00:00
zetongzhao 4f199b548c deserialize and tests 2021-08-06 13:35:27 -04:00
i-robot 59f4820785 !21383 dynamic shape interface adapter
Merge pull request !21383 from liubuyu/master
2021-08-06 12:40:14 +00:00
yujianfeng cf4121126a Only replace the primal user with tuple_getitem once 2021-08-06 19:23:14 +08:00
i-robot d2ae09d891 !21437 Support ListComp and GeneratorExp in Graph Mode.
Merge pull request !21437 from 张清华/opt
2021-08-06 09:09:47 +00:00
i-robot 51a1ca61f2 !21357 [MD] fix SlicePatches when dealing with some special tensor.
Merge pull request !21357 from liyong126/fix_bug
2021-08-06 08:58:27 +00:00
i-robot 8a8851dc52 !18667 Remove redundant depend
Merge pull request !18667 from huangbingjian/remove_redundant_depend
2021-08-06 07:43:53 +00:00
i-robot e18c277304 !17630 [assistant][AmplitudeToDB]
Merge pull request !17630 from QingfengLi/AmplitudeToDB
2021-08-06 07:14:59 +00:00
SichongHao 3d2892b454 [feat][assistant][I3T91Y][I3T91Z]add new operator SoftMarginLoss and SoftMarginLossGrad 2021-08-06 15:13:13 +08:00
liyong 5fea72473c fix HW1 issue 2021-08-06 14:07:26 +08:00
Zhang Qinghua aef396f9f2 Support ListComp and GeneratorExp in Graph Mode. 2021-08-06 11:44:57 +08:00
lby e6cdf098db op tiling compute interface replace 2021-08-06 11:26:24 +08:00
ckczzj 9d9f33be88 [feat][assistant][I3J6VN] add new data operator flowers102 2021-08-06 10:55:12 +08:00
chenx2ovo aa45e2ebbc [feat] [assistant] [I3CEER] add op AmplitudeToDB 2021-08-06 10:07:29 +08:00
huangbingjian 53b31abf12 remove useless depend 2021-08-05 20:21:24 +08:00
yelihua ca835a7d2d change the async dump testcase level to level1 2021-08-05 19:52:35 +08:00
i-robot 447f3e5746 !16447 [assistant][AngleOp]
Merge pull request !16447 from StyleHang/AngleOp
2021-08-05 08:29:12 +00:00
Carry955 98be266585 [feat][assistant][I3J6TQ] add a new operator Angle 2021-08-04 19:41:00 -07:00
i-robot 4eca597368 !21306 Add gpu testcase and skip decorator.
Merge pull request !21306 from gaoyong10/runtime_002
2021-08-05 02:06:40 +00:00
i-robot 9629b4ebd9 !21071 [Graph Kernel] Add Low Precision Optimition
Merge pull request !21071 from cyun/master_729
2021-08-05 00:50:58 +00:00
i-robot 680e40a43a !16453 [assistant][BassBiquadOp]
Merge pull request !16453 from StyleHang/BassBiquadOp
2021-08-04 10:02:34 +00:00
gaoyong10 2c96987222 add skip decorator and gpu testcase 2021-08-04 17:23:00 +08:00
i-robot f4e07c0dce !17486 [assistant][ops] Add new dataset operator Flickr.
Merge pull request !17486 from Rainfor/wangkc
2021-08-04 08:52:21 +00:00
i-robot a83f8f6f5d !20284 Unify exception info with using the unsupported numpy method
Merge pull request !20284 from huanghui/numpy-in-graph-mode
2021-08-04 08:06:01 +00:00
i-robot d260f38936 !15722 [assistant][AdjustGamma]
Merge pull request !15722 from QingfengLi/adjust_gamma
2021-08-04 03:58:09 +00:00
i-robot 770d2a994e !20767 add CPU L2Loss op
Merge pull request !20767 from 范吉斌/master_l2loss
2021-08-04 03:26:29 +00:00
i-robot 1245eed4d1 !21283 VM bug fix and test_cont_case add gpu
Merge pull request !21283 from chenfei_mindspore/vm-bug-fix
2021-08-04 02:44:04 +00:00
li-qiyao ba326d76a8 [feat][assistant][I3J6TW] add new data operator BassBiquad 2021-08-03 19:40:12 -07:00
wangkc123 48f5fed1f8 [feat] [assistant] [I3CKEN] add new dataset operator Flickr 2021-08-04 10:20:43 +08:00
i-robot 191c82573f !21208 Ascend support non-task sink mode
Merge pull request !21208 from baihuawei/graph_mode_nonsink_part2
2021-08-04 02:00:26 +00:00
cy 4105a247b7 add low precison 2021-08-04 09:52:42 +08:00
i-robot 74b860d69d !16450 [assistant][BandrejectBiquadOp]
Merge pull request !16450 from StyleHang/BandrejectBiqaudOp
2021-08-04 01:30:35 +00:00
zhangzhenghai b0d1f64b37 !21326 upgrade Ascend software pacakage 03 Aug 21
Merge pull request !21326 from yanghaoran/upgrade_ascend_0803
2021-08-04 00:58:19 +00:00
chenx2ovo 4191dde45f [feat][assistant][I3CEGM] add op adjust gamma 2021-08-04 02:32:13 +08:00
baihuawei 41de02a58c ascend support nontask sink 2021-08-03 20:55:43 +08:00
tongyue 08469e113a [feat][assistant][I3J6TV]add new audio operator BandrejectBiquad 2021-08-03 05:41:53 -07:00
fanjibin 9e5618a5b8 add CPU l2loss op 2021-08-03 20:19:15 +08:00
yanghaoran afd9c8c9de upgrade Ascend software pacakage 03 Aug 21 2021-08-03 19:24:18 +08:00
i-robot 2c7b8e73df !16452 [assistant][BandpassBiquadOp]
Merge pull request !16452 from StyleHang/BandpassBiquadOp
2021-08-03 11:08:48 +00:00
i-robot a70b0f3bf4 !18260 [assistant][ops]New operator implementation, include HShrink and HShrinkGrad
Merge pull request !18260 from 张璇/hshrink
2021-08-03 11:00:11 +00:00
i-robot 5ec20c7665 !21240 develop softplus for cpu
Merge pull request !21240 from zhangbuxue/develop_softplus_for_cpu
2021-08-03 10:59:01 +00:00
i-robot e3564b78dc !21085 add gpu scripts to resnet18
Merge pull request !21085 from ZeyangGAO/resnet18ci
2021-08-03 10:58:52 +00:00
chenfei 709b1e80db add control test cases and vm bug fix 2021-08-03 18:43:22 +08:00
i-robot 93af13f332 !19979 dataset: modify some error msg
Merge pull request !19979 from ms_yan/err_msg
2021-08-03 08:53:30 +00:00
i-robot 0a3b4ff84b !21207 modify replace graph for conv2d
Merge pull request !21207 from yangzhenzhang/fix-bugs-for-conv2d
2021-08-03 08:48:37 +00:00
huanghui 3e17650172 Raise NotImplementedError when parsing the numpy methods, but not the numpy constant. 2021-08-03 14:33:22 +08:00
i-robot 69c5021bb5 !20995 pyfunc cpu kernel
Merge pull request !20995 from chenweifeng/cpu-dynamic-input
2021-08-03 04:51:20 +00:00
buxue 0bdf08a90e develop softplus for cpu 2021-08-03 11:40:09 +08:00
i-robot ef77050348 !18892 [assistant][ops] Add new dataset operator SBD.
Merge pull request !18892 from Rainfor/sbd
2021-08-03 03:33:00 +00:00
yangzhenzhang ef0361a449 fix bugs for conv2d 2021-08-03 10:48:05 +08:00
ZeyangGao 44833d7886 add gpu scripts to resnet18 2021-08-03 10:32:09 +08:00
ms_yan 65870045bc modify some error msg 2021-08-03 09:16:28 +08:00
administrator 29d57a89fb [feat][assistant][I3TDRD]add new audio operator BandpassBiquad 2021-08-02 07:08:47 -07:00
wilfChen d6fffdad6e support dynamic inputs & outputs 2021-08-02 20:05:46 +08:00
hwjiaorui e498c96a20 tbe json creator UT 2021-08-02 18:51:33 +08:00
i-robot a81fee280c !16458 [assistant][AllpassBiquadOp]
Merge pull request !16458 from StyleHang/AllpassBiquadOp
2021-08-02 08:40:06 +00:00
i-robot 00e8645902 !21036 Upgrade Ascend packages 28 Jul 21
Merge pull request !21036 from yanghaoran/upgrade_ascend_0728
2021-08-02 06:15:06 +00:00
i-robot 0c369e4ea5 !21170 [Auto parallel] Add ReduceAny operator in Parallel module; Extend Onehot operator to multi-dimensions
Merge pull request !21170 from Xiaoda/77-add-reduceany-and-onehot
2021-08-02 03:05:34 +00:00
i-robot bb6d1a3019 !21180 alltoall and neighbor-exchange op
Merge pull request !21180 from zhoufeng/all-to-all-op
2021-08-02 01:42:42 +00:00
Xiaoda Zhang 4b4b3cdaf4 add reduceany operator and extend onehot to multi-dimensions 2021-08-02 08:53:43 +08:00
zhangjie b04036e13c [feat][assistant][I3PYD4] add new data operator HShrink and HShrinkGrad 2021-08-01 20:55:58 +08:00
danansheng accb87606a [feat][assistant][I3PYD4] add new data operator HShrink 2021-08-01 20:52:55 +08:00
zhoufeng 2143241092 change neighbor exchange to all to all
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2021-08-01 18:21:28 +08:00
yanghaoran 0364650eae Upgrade Ascend packages 28 Jul 21, with testcases removed 2021-07-31 18:55:55 +08:00
i-robot 27e0c7d8b8 !21004 Add CPU Sort OP
Merge pull request !21004 from zhujingxuan/master
2021-07-31 08:15:54 +00:00
Isaac b49e1acc3e [feat] [assistant] [I3J6TM] add new audio operator AllpassBiquad 2021-07-31 16:15:17 +08:00
i-robot 7b55c9858b !21103 Reorganize Empty Graph
Merge pull request !21103 from jiaoy1224/eliminate_empty
2021-07-31 01:33:34 +00:00
i-robot 9301de1b54 !21098 fix bug
Merge pull request !21098 from shenwei41/fix_waring
2021-07-31 01:12:21 +00:00
shenwei41 e3385e2564 fix waring to master 2021-07-30 16:37:27 +08:00
zhujingxuan 23dee0e232 Add CPU Sort OP 2021-07-30 16:21:02 +08:00
Yang Jiao fd7ab25fc2 reorganiz empty graph 2021-07-30 15:37:47 +08:00
i-robot 7b20a5adf7 !20966 Update graph kernel support for argmax/argmin
Merge pull request !20966 from zichun_ye/argmax_min_kernelgraph
2021-07-30 06:15:03 +00:00
i-robot 6e84bf0f0f !16449 [assistant][ops] Add new audio operator BandBiquad
Merge pull request !16449 from StyleHang/BandBiquadOp
2021-07-30 03:35:07 +00:00