Commit Graph

2688 Commits

Author SHA1 Message Date
i-robot f34426095c !22084 Move Transformer Code from Mindspore.nn.parallel to mindspore.parallel.nn
Merge pull request !22084 from huangxinjing/transformer_doc_check
2021-08-20 10:40:01 +00:00
huangxinjing d777742904 1. Move the class to mindspore.parallel, support activation sharding 2021-08-20 14:34:10 +08:00
i-robot 954864bfba !22037 incoroporate getitem if indexed node is zeros_like
Merge pull request !22037 from xychow/always-incorporate-getitem-if-zeros-like
2021-08-20 02:14:35 +00:00
i-robot 5d1bb097e2 !22052 Fix probability core dump in MindData coverage test
Merge pull request !22052 from luoyang/issues2
2021-08-20 01:18:06 +00:00
robert_luo_yibo d837cbee0f [feat][assistant][I3CEG8] add new data operator ComplexNorm 2021-08-20 09:07:21 +08:00
Cathy Wong 85931175bc MD Profiling: For mismatch op info btwn files, skip bottleneck analysis.
Add to summary output: per_pipeline_time and per_push_queue_time.
Enhance UT
2021-08-19 12:19:59 -04:00
guozhijian e1df9a2152 revert 'Pull Request !21685 : add function to invert_op' 2021-08-19 22:49:51 +08:00
i-robot 4113aee7d6 !18668 [assistant][ops]New operator implementation, include Flowers102Dataset
Merge pull request !18668 from Wangsong95/flowers102_dataset
2021-08-19 08:41:44 +00:00
YangLuo 9352935ff6 Fix probability core dump in MindData coverage test 2021-08-19 14:34:57 +08:00
i-robot c93bb9936e !20011 [assistant][ops] Add nn operator Roll
Merge pull request !20011 from 孟权令/Roll
2021-08-19 06:28:28 +00:00
i-robot 3ad641cb65 !21685 add function to invert_op
Merge pull request !21685 from Killer/fake_killer
2021-08-19 05:13:39 +00:00
zhousiyi dcd374961e incoroporate getitem if indexed node is zeros_like so AddN(MakeTuple(x, zeros_like)) can be optimized 2021-08-19 03:28:24 +00:00
fake_killer b0bc4bf5da [feat] [assistant] [I44TRS] extend invert_op's function 2021-08-18 21:46:15 +08:00
i-robot dde05c36b8 !21551 auto_parallel_context interface dataset_strategy union
Merge pull request !21551 from yao_yf/auto_parallel_context_dataset_strategy_union
2021-08-18 09:03:18 +00:00
i-robot 415275ae17 !21805 support adafactor model parallel
Merge pull request !21805 from yangzhenzhang/auto-parallel-support-adafactor-opt
2021-08-18 07:20:39 +00:00
hedongdong d76ed25e96 [feat][assistant][I3T92I] add new nn operator Roll 2021-08-18 10:15:17 +08:00
i-robot 264cb4d2e8 !21920 MD Profiling Analyze: Search for device trace file, independent of device_target
Merge pull request !21920 from cathwong/ckw_mon_py_analyze_device_file
2021-08-18 00:57:50 +00:00
i-robot 0d839fa7c6 !21809 Improved Transformer Struture and Add Args Check
Merge pull request !21809 from huangxinjing/transformer_improved
2021-08-17 12:05:25 +00:00
i-robot a77a0b968d !21761 comm_recompute_interface.
Merge pull request !21761 from yao_yf/comm_recompute_interface
2021-08-17 09:14:29 +00:00
yangzhenzhang 7ca64d2235 auto parallel support adafactor opt 2021-08-17 10:36:42 +08:00
yao_yf 5277b229be add cell comm recompute interface 2021-08-17 09:23:21 +08:00
Cathy Wong a2cbd4b5fa MD Profiling Analyze: Search for device trace file
MinddataProfilingAnalyzer() - remove device_target input parm
2021-08-16 15:41:11 -04:00
huangxinjing 18044aff0f 1. Add docstring, elimitate attention mask, tuple append the deocoder return layer past
split attention inputs from two into three

Add input check and modify test case

Fix check error and add check to transformer inputs

add input check to the transformers
2021-08-16 21:08:48 +08:00
Xiao Tianci aae886bcd7 fix crowd contributing code 2021-08-16 19:33:10 +08:00
yao_yf a83bf73298 union auto_parallel_context interface dataset_strategy 2021-08-16 10:54:46 +08:00
i-robot 530da3e37e !21527 fix_reshape_reshape_in_auto_parallel
Merge pull request !21527 from yao_yf/fix_reshape_reshape_in_auto_parallel
2021-08-13 08:29:15 +00:00
i-robot f99effd430 !21755 Fix batch usability problem
Merge pull request !21755 from xiefangqi/md_fix_batch_usability
2021-08-13 07:21:49 +00:00
i-robot d1112f8e9c !17631 [assistant][FrequencyMasking]
Merge pull request !17631 from QingfengLi/FreqMask
2021-08-13 06:48:06 +00:00
xiefangqi e4894a1bf1 fix batch usability problem 2021-08-12 20:12:43 +08:00
i-robot 2650aae9ba !21351 complex support
Merge pull request !21351 from zhouyaqiang0/complex_support
2021-08-12 09:39:15 +00:00
chenx2ovo 53615010a3 [feat][assistant][I3CEGG] add new data OP FrequencyMasking 2021-08-12 15:28:30 +08:00
yao_yf e233880e41 fix reshape depend reshape in auto parallel 2021-08-12 11:45:28 +08:00
i-robot bff5cbda9c !21670 fix: null numpy field in mindrecord will cause read error
Merge pull request !21670 from guozhijian/fix_null_numpy_field_in_mr
2021-08-12 03:39:34 +00:00
zhouyaqiang b81ba100b7 add complex number support 2021-08-12 10:36:43 +08:00
i-robot 63445ff6fd !21627 alltoall exception handle
Merge pull request !21627 from zhoufeng/alltoall_exception
2021-08-12 01:40:22 +00:00
i-robot 6320bf6b7b !21676 check strategy for conv2d
Merge pull request !21676 from yangzhenzhang/check-strategy-for-conv2d
2021-08-12 01:29:37 +00:00
i-robot 73b55cff72 !20794 add adafactor
Merge pull request !20794 from jiangzhenguang/add_adafactor_optimizer
2021-08-12 01:27:03 +00:00
yangzhenzhang d18c813ee4 check strategy for conv2d 2021-08-11 19:12:48 +08:00
zhoufeng 03a56f2bb0 alltoall exception handle
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2021-08-11 17:30:49 +08:00
jonyguo 42b3512a1b fix: when field is none in mr 2021-08-11 17:11:38 +08:00
jiangzhenguang a3bb780ce4 optimize run memory 2021-08-10 20:45:25 +08:00
chenx2ovo e72acf362c [feat][assistant][I3CEGH] add op timemasking 2021-08-10 12:06:07 +08:00
i-robot f154db1bb0 !20680 [assistant][ops] Add New SoftMarginLoss and SoftMarginLossGrad
Merge pull request !20680 from 孟权令/SoftMarginLoss
2021-08-10 02:39:28 +00:00
i-robot 4aaa8126a0 !21528 Add Parallel Print Support
Merge pull request !21528 from huangxinjing/add_print
2021-08-09 10:55:04 +00:00
i-robot dc626617fc !19526 [assistant][TimeStretch]
Merge pull request !19526 from QingfengLi/TimeStretch
2021-08-09 09:40:38 +00:00
i-robot 75429acbe3 !21519 fix waring
Merge pull request !21519 from shenwei41/fix_sqlite
2021-08-09 09:09:18 +00:00
shenwei41 59efbb88ec fix waring 2021-08-09 11:40:52 +08:00
i-robot 8306abeb67 !21168 Only replace the primal user with tuple_getitem once
Merge pull request !21168 from YuJianfeng/ad
2021-08-09 03:19:07 +00:00
huangxinjing 92bad162bd Add print 2021-08-09 11:14:25 +08:00
chenx2ovo 04705e5b0d [feat][assistant][I3CEGC] add op timestretch 2021-08-07 22:53:41 +08:00
i-robot c84e09cf45 !21072 Deserialize - python binding
Merge pull request !21072 from zetongzhao/deserialize_1
2021-08-06 21:47:09 +00:00
zetongzhao 4f199b548c deserialize and tests 2021-08-06 13:35:27 -04:00
yujianfeng cf4121126a Only replace the primal user with tuple_getitem once 2021-08-06 19:23:14 +08:00
i-robot d2ae09d891 !21437 Support ListComp and GeneratorExp in Graph Mode.
Merge pull request !21437 from 张清华/opt
2021-08-06 09:09:47 +00:00
i-robot 51a1ca61f2 !21357 [MD] fix SlicePatches when dealing with some special tensor.
Merge pull request !21357 from liyong126/fix_bug
2021-08-06 08:58:27 +00:00
i-robot 8a8851dc52 !18667 Remove redundant depend
Merge pull request !18667 from huangbingjian/remove_redundant_depend
2021-08-06 07:43:53 +00:00
SichongHao 3d2892b454 [feat][assistant][I3T91Y][I3T91Z]add new operator SoftMarginLoss and SoftMarginLossGrad 2021-08-06 15:13:13 +08:00
liyong 5fea72473c fix HW1 issue 2021-08-06 14:07:26 +08:00
Zhang Qinghua aef396f9f2 Support ListComp and GeneratorExp in Graph Mode. 2021-08-06 11:44:57 +08:00
ckczzj 9d9f33be88 [feat][assistant][I3J6VN] add new data operator flowers102 2021-08-06 10:55:12 +08:00
chenx2ovo aa45e2ebbc [feat] [assistant] [I3CEER] add op AmplitudeToDB 2021-08-06 10:07:29 +08:00
huangbingjian 53b31abf12 remove useless depend 2021-08-05 20:21:24 +08:00
Carry955 98be266585 [feat][assistant][I3J6TQ] add a new operator Angle 2021-08-04 19:41:00 -07:00
i-robot 680e40a43a !16453 [assistant][BassBiquadOp]
Merge pull request !16453 from StyleHang/BassBiquadOp
2021-08-04 10:02:34 +00:00
i-robot f4e07c0dce !17486 [assistant][ops] Add new dataset operator Flickr.
Merge pull request !17486 from Rainfor/wangkc
2021-08-04 08:52:21 +00:00
i-robot a83f8f6f5d !20284 Unify exception info with using the unsupported numpy method
Merge pull request !20284 from huanghui/numpy-in-graph-mode
2021-08-04 08:06:01 +00:00
i-robot d260f38936 !15722 [assistant][AdjustGamma]
Merge pull request !15722 from QingfengLi/adjust_gamma
2021-08-04 03:58:09 +00:00
li-qiyao ba326d76a8 [feat][assistant][I3J6TW] add new data operator BassBiquad 2021-08-03 19:40:12 -07:00
wangkc123 48f5fed1f8 [feat] [assistant] [I3CKEN] add new dataset operator Flickr 2021-08-04 10:20:43 +08:00
chenx2ovo 4191dde45f [feat][assistant][I3CEGM] add op adjust gamma 2021-08-04 02:32:13 +08:00
tongyue 08469e113a [feat][assistant][I3J6TV]add new audio operator BandrejectBiquad 2021-08-03 05:41:53 -07:00
i-robot 2c7b8e73df !16452 [assistant][BandpassBiquadOp]
Merge pull request !16452 from StyleHang/BandpassBiquadOp
2021-08-03 11:08:48 +00:00
i-robot a70b0f3bf4 !18260 [assistant][ops]New operator implementation, include HShrink and HShrinkGrad
Merge pull request !18260 from 张璇/hshrink
2021-08-03 11:00:11 +00:00
i-robot 93af13f332 !19979 dataset: modify some error msg
Merge pull request !19979 from ms_yan/err_msg
2021-08-03 08:53:30 +00:00
i-robot 0a3b4ff84b !21207 modify replace graph for conv2d
Merge pull request !21207 from yangzhenzhang/fix-bugs-for-conv2d
2021-08-03 08:48:37 +00:00
huanghui 3e17650172 Raise NotImplementedError when parsing the numpy methods, but not the numpy constant. 2021-08-03 14:33:22 +08:00
i-robot ef77050348 !18892 [assistant][ops] Add new dataset operator SBD.
Merge pull request !18892 from Rainfor/sbd
2021-08-03 03:33:00 +00:00
yangzhenzhang ef0361a449 fix bugs for conv2d 2021-08-03 10:48:05 +08:00
ms_yan 65870045bc modify some error msg 2021-08-03 09:16:28 +08:00
administrator 29d57a89fb [feat][assistant][I3TDRD]add new audio operator BandpassBiquad 2021-08-02 07:08:47 -07:00
i-robot a81fee280c !16458 [assistant][AllpassBiquadOp]
Merge pull request !16458 from StyleHang/AllpassBiquadOp
2021-08-02 08:40:06 +00:00
Xiaoda Zhang 4b4b3cdaf4 add reduceany operator and extend onehot to multi-dimensions 2021-08-02 08:53:43 +08:00
zhangjie b04036e13c [feat][assistant][I3PYD4] add new data operator HShrink and HShrinkGrad 2021-08-01 20:55:58 +08:00
danansheng accb87606a [feat][assistant][I3PYD4] add new data operator HShrink 2021-08-01 20:52:55 +08:00
Isaac b49e1acc3e [feat] [assistant] [I3J6TM] add new audio operator AllpassBiquad 2021-07-31 16:15:17 +08:00
i-robot 9301de1b54 !21098 fix bug
Merge pull request !21098 from shenwei41/fix_waring
2021-07-31 01:12:21 +00:00
shenwei41 e3385e2564 fix waring to master 2021-07-30 16:37:27 +08:00
i-robot 6e84bf0f0f !16449 [assistant][ops] Add new audio operator BandBiquad
Merge pull request !16449 from StyleHang/BandBiquadOp
2021-07-30 03:35:07 +00:00
liannai 5a341e7e27 [feat] [assistant] [I3J6TS] add new audio operator BandBiquad 2021-07-29 17:57:27 +08:00
huangxinjing 615d1a179d Add transformer layer 2021-07-29 11:10:43 +08:00
i-robot 9f296c58d6 !20960 [AutoParallel]Add replace graph for conv2d
Merge pull request !20960 from lichen/add_replace_graph_for_conv2d
2021-07-28 07:06:41 +00:00
lichenever a7f8024c29 add_replace_graph_for_conv2d 2021-07-28 11:02:21 +08:00
yao_yf dc7dc7d3fa dataset strategy set 2021-07-27 18:44:10 +08:00
i-robot b8901526b9 !20882 Fix GradOperation recursive call issues.
Merge pull request !20882 from 张清华/opt
2021-07-27 01:00:39 +00:00
Zhang Qinghua 8be269c1cc Fix GradOperation issues:
- Allow the J CNode used multiple as non-call input.
- Check recursive J FG including FV J CNode.
- Add grad functional api.
2021-07-26 20:47:49 +08:00
yangzhenzhang 80e5cc0e52 add parallel op for gatherd 2021-07-26 11:14:25 +08:00
i-robot c80098b261 !20712 [Auto parallel] Enable All2All when inferring redistribution ops
Merge pull request !20712 from Xiaoda/76-change-alltoall-redistribution
2021-07-24 07:07:16 +00:00
i-robot 26bfbf9124 !18282 [assistant][ops]New operator implementation, include HSigmoid and HSigmoidGrad
Merge pull request !18282 from 张璇/hsigmoid_grad
2021-07-24 06:22:46 +00:00
Xiaoda Zhang bb5d4212f7 enable All2All in infering redistribution ops 2021-07-24 09:09:01 +08:00
i-robot 1e1d7d5739 !20443 Add numpy-native ut/st
Merge pull request !20443 from 杨林枫/add_numpy_ut
2021-07-23 11:24:39 +00:00