Commit Graph

8037 Commits

Author SHA1 Message Date
i-robot 17accc12cf
!30238 [GraphKernel] replace nodes in lite and move const_input_to_attr pass.
Merge pull request !30238 from chenlei_autodiff/lite_callback
2022-02-26 03:56:57 +00:00
i-robot c54100b3e8
!30578 Solve the Problem of ST testcase probabilistic failure
Merge pull request !30578 from zong_shuai/st_einsum
2022-02-26 03:20:35 +00:00
i-robot 5deccfe64b
!30260 [MD][AutoTune] Re-enable AT for non-sink models
Merge pull request !30260 from danishfarid/re-enable_AT
2022-02-25 22:26:14 +00:00
i-robot c4843c4085
!29958 upgrade ascend 20220211
Merge pull request !29958 from shenwei41/upgrade_ascend_20220211
2022-02-25 14:55:12 +00:00
shenwei41 ff75314719 upgrade ascend 20220211 2022-02-25 21:19:45 +08:00
zong-shuai 5547c8620c debug 2022-02-25 17:41:25 +08:00
chenlei_autodiff 9fabf8ae0d [GraphKernel] replace graph kernel node with custom in lite. 2022-02-25 17:09:24 +08:00
i-robot 0341d96dd6
!30469 add shard function to support part of the graph executed in auto_parallel under pynative mode
Merge pull request !30469 from wangjun/0223_pp
2022-02-25 06:52:24 +00:00
i-robot 9067fe6c20
!30511 Add st for pynative hook function
Merge pull request !30511 from JoyLvliang/add_st_cases_for_pynative_hook
2022-02-25 02:55:14 +00:00
i-robot 3e246484f0
!30539 Fix bug of grad implementation of solve_triangular.
Merge pull request !30539 from hezhenhao1/fix_trsm_grad
2022-02-25 02:52:43 +00:00
i-robot cfe0f76d2b
!30491 ut for allgather fusion
Merge pull request !30491 from jiahongQian/master
2022-02-25 01:30:24 +00:00
i-robot 2dbb931663
!30538 fix scipy st utils to creat_sys_pos_martix
Merge pull request !30538 from zhuzhongrui/pub_master2
2022-02-25 01:29:16 +00:00
i-robot c2c06d990c
!30498 remove windows cpu testcase
Merge pull request !30498 from caifubi/master-pynative-run-in-graph
2022-02-25 01:09:02 +00:00
danishfarid 6c4697fc8b reenable AT for non-sink
tests re-enable

code check fix 1

remove self

lint fixing

lint fix 2

remove test as per req
2022-02-25 00:02:58 +00:00
i-robot b3c5943bf8
!30373 [DynamicShape][GPU]add dynamic shape support of Concat op and its backward for new Network
Merge pull request !30373 from hanhuifeng/dcn_dyn_ops_1
2022-02-24 13:21:57 +00:00
wangjun 24d448239c add pynative_parallel 2022-02-24 21:07:51 +08:00
7347157+joylvliang@user.noreply.gitee.com 4a8b220879 add_st_cases_for_pynative_hook 2022-02-24 20:57:55 +08:00
hezhenhao1 9468e2dc84 Fix bug of grad implementation of solve_triangular. 2022-02-24 19:56:34 +08:00
i-robot 5de0d89eba
!30447 add landscape doc to summary_record and modify st
Merge pull request !30447 from Songyuanwei/test
2022-02-24 11:52:25 +00:00
z00512249 8bba3a063a fix scipy st utils to creat_sys_pos_martix 2022-02-24 19:52:19 +08:00
i-robot ac1463a192
!30298 Package the cuda operators as a dynamic link library
Merge pull request !30298 from jinjiali-kali/cuda_ops
2022-02-24 11:36:20 +00:00
i-robot 1c186ce115
!29107 add sparse tensor gradient operations && tensor methods
Merge pull request !29107 from huangmengxi/csr_method
2022-02-24 11:28:21 +00:00
i-robot 981eae461a
!30118 自动优化器并行特性
Merge pull request !30118 from zhuyuxiao/I4S85V
2022-02-24 11:09:44 +00:00
jiahongQian 25f57505bf ut for allgather fusion 2022-02-24 17:40:32 +08:00
i-robot bbcfbce9e0
!29997 [Auto parallel] [MoE] Support data_parallel + expert_parallel
Merge pull request !29997 from Xiaoda/124-moe-changes
2022-02-24 09:23:47 +00:00
i-robot b349e441b3
!30507 [ME] Fix testcase.
Merge pull request !30507 from Margaret_wangrui/test
2022-02-24 08:33:02 +00:00
zhuyuxiao d0e0e305d3 good 2022-02-24 16:10:18 +08:00
huangmengxi 080ad981d6 add csr bprop && csr method 2022-02-24 15:53:56 +08:00
Margaret_wangrui 1fef801371 Fix testcast 2022-02-24 14:41:46 +08:00
i-robot 9b86b7ef6b
!30215 support arbitrary sink_size when data is dynamic-shape
Merge pull request !30215 from wYann/ascend_data_sink
2022-02-24 06:38:54 +00:00
caifubi 44b98fcf7d delete windows cpu testcase 2022-02-24 11:43:11 +08:00
i-robot f2130e7434
!30483 [AutoParallel]Pipeline Automatic detection Opt
Merge pull request !30483 from lichen/pipeline_opt_detection
2022-02-24 03:40:15 +00:00
i-robot 080e17dfb0
!30487 adasum_ut_fix
Merge pull request !30487 from yao_yf/adasum_ut_fix1
2022-02-24 03:39:52 +00:00
i-robot e0da695ba2
!30465 dont evaluated to specific SymbolicKey if not direct weight parameter
Merge pull request !30465 from xychow/dont-specialze-refembed-if-not-direct-weight-master
2022-02-24 03:33:35 +00:00
i-robot 94dbb58240
!30453 Fix Bug of Debugging TBE compiling
Merge pull request !30453 from jiaorui/test_compile
2022-02-24 02:42:40 +00:00
i-robot 9d4ac769bf
!30390 Apply value and type checking for all functions in mindspore.scipy module.
Merge pull request !30390 from hezhenhao1/add_checker
2022-02-24 02:03:23 +00:00
yao_yf e21f878e14 adasum ut fix 2022-02-24 09:31:04 +08:00
Xiaoda Zhang b714451937 implementing expert_parallel+data_parallel in MoE:
1) extending _Linear's input as 4-dimension tensor: [outer_batch, expert_dim, -1, hidden], and _Liner's BatchMatMul becomes BatchMatMul(4_dim_tensor, 3_dim_tensor);
2) configuring the _Linear's BatchMatMul sharding strategy as [[dp, ep, 1, 1], [ep, 1, mp]];
3) introducing a new parameter 'expert_parallel' in TransformerOpParallelConfig, creating a new class MoEParallelConfig to include 'data_parallel', 'model_parallel' and 'expert_parallel';
4) changing parallel config for FeedForward, TransformerEncoderLayer, TransformerDecoderLayer.
2022-02-24 09:24:27 +08:00
wangshengnan12@huawei.com acbefd80ea pipeline_opt_detection 2022-02-24 09:23:17 +08:00
zhousiyi 38ac9041d6 dont evaluated to specific SymbolicKey if not direct weight parameter 2022-02-24 01:08:47 +00:00
i-robot 2a00ffd3b1
!30259 [MD]Update set_autotune_enable API to add save filepath
Merge pull request !30259 from cathwong/ckw_at_save_api
2022-02-24 01:00:59 +00:00
Cathy Wong 46e223e569 [MD] Update set_autotune_enable API to add save filepath 2022-02-23 14:50:55 -05:00
wYann 57cb72e2b7 dynamic data sink on Ascend 2022-02-23 22:03:14 +08:00
hanhuifeng2020 662c51c019 [DynamicShape][GPU]add dynamic shape support of Concat and its backward for DCN 2022-02-23 19:18:21 +08:00
i-robot 81260a2319
!30466 takedown test_auto_parallel_adasum.py to ensure stability, again
Merge pull request !30466 from yanghaoran/master
2022-02-23 09:15:58 +00:00
i-robot 14393503b7
!30431 allreduce allgather fusion
Merge pull request !30431 from jiahongQian/master
2022-02-23 08:52:40 +00:00
yanghaoran 71d6b7d506 takedown test_auto_parallel_adasum.py to ensure stability, again 2022-02-23 16:42:13 +08:00
i-robot 0ade79cb84
!30391 add julia cache and row-major api
Merge pull request !30391 from r1chardf1d0/master
2022-02-23 08:40:21 +00:00
jiaorui 063ee8b825 tbe ops debug 2022-02-23 15:07:16 +08:00
i-robot 243fb6bb0f
!29991 dynamic shape
Merge pull request !29991 from TuDouNi/dynamic_shape_stage3
2022-02-23 07:03:32 +00:00