Commit Graph

8027 Commits

Author SHA1 Message Date
i-robot 9067fe6c20
!30511 Add st for pynative hook function
Merge pull request !30511 from JoyLvliang/add_st_cases_for_pynative_hook
2022-02-25 02:55:14 +00:00
i-robot 3e246484f0
!30539 Fix bug of grad implementation of solve_triangular.
Merge pull request !30539 from hezhenhao1/fix_trsm_grad
2022-02-25 02:52:43 +00:00
i-robot cfe0f76d2b
!30491 ut for allgather fusion
Merge pull request !30491 from jiahongQian/master
2022-02-25 01:30:24 +00:00
i-robot 2dbb931663
!30538 fix scipy st utils to creat_sys_pos_martix
Merge pull request !30538 from zhuzhongrui/pub_master2
2022-02-25 01:29:16 +00:00
i-robot c2c06d990c
!30498 remove windows cpu testcase
Merge pull request !30498 from caifubi/master-pynative-run-in-graph
2022-02-25 01:09:02 +00:00
i-robot b3c5943bf8
!30373 [DynamicShape][GPU]add dynamic shape support of Concat op and its backward for new Network
Merge pull request !30373 from hanhuifeng/dcn_dyn_ops_1
2022-02-24 13:21:57 +00:00
7347157+joylvliang@user.noreply.gitee.com 4a8b220879 add_st_cases_for_pynative_hook 2022-02-24 20:57:55 +08:00
hezhenhao1 9468e2dc84 Fix bug of grad implementation of solve_triangular. 2022-02-24 19:56:34 +08:00
i-robot 5de0d89eba
!30447 add landscape doc to summary_record and modify st
Merge pull request !30447 from Songyuanwei/test
2022-02-24 11:52:25 +00:00
z00512249 8bba3a063a fix scipy st utils to creat_sys_pos_martix 2022-02-24 19:52:19 +08:00
i-robot ac1463a192
!30298 Package the cuda operators as a dynamic link library
Merge pull request !30298 from jinjiali-kali/cuda_ops
2022-02-24 11:36:20 +00:00
i-robot 1c186ce115
!29107 add sparse tensor gradient operations && tensor methods
Merge pull request !29107 from huangmengxi/csr_method
2022-02-24 11:28:21 +00:00
i-robot 981eae461a
!30118 自动优化器并行特性
Merge pull request !30118 from zhuyuxiao/I4S85V
2022-02-24 11:09:44 +00:00
jiahongQian 25f57505bf ut for allgather fusion 2022-02-24 17:40:32 +08:00
i-robot bbcfbce9e0
!29997 [Auto parallel] [MoE] Support data_parallel + expert_parallel
Merge pull request !29997 from Xiaoda/124-moe-changes
2022-02-24 09:23:47 +00:00
i-robot b349e441b3
!30507 [ME] Fix testcase.
Merge pull request !30507 from Margaret_wangrui/test
2022-02-24 08:33:02 +00:00
zhuyuxiao d0e0e305d3 good 2022-02-24 16:10:18 +08:00
huangmengxi 080ad981d6 add csr bprop && csr method 2022-02-24 15:53:56 +08:00
Margaret_wangrui 1fef801371 Fix testcast 2022-02-24 14:41:46 +08:00
i-robot 9b86b7ef6b
!30215 support arbitrary sink_size when data is dynamic-shape
Merge pull request !30215 from wYann/ascend_data_sink
2022-02-24 06:38:54 +00:00
caifubi 44b98fcf7d delete windows cpu testcase 2022-02-24 11:43:11 +08:00
i-robot f2130e7434
!30483 [AutoParallel]Pipeline Automatic detection Opt
Merge pull request !30483 from lichen/pipeline_opt_detection
2022-02-24 03:40:15 +00:00
i-robot 080e17dfb0
!30487 adasum_ut_fix
Merge pull request !30487 from yao_yf/adasum_ut_fix1
2022-02-24 03:39:52 +00:00
i-robot e0da695ba2
!30465 dont evaluated to specific SymbolicKey if not direct weight parameter
Merge pull request !30465 from xychow/dont-specialze-refembed-if-not-direct-weight-master
2022-02-24 03:33:35 +00:00
i-robot 94dbb58240
!30453 Fix Bug of Debugging TBE compiling
Merge pull request !30453 from jiaorui/test_compile
2022-02-24 02:42:40 +00:00
i-robot 9d4ac769bf
!30390 Apply value and type checking for all functions in mindspore.scipy module.
Merge pull request !30390 from hezhenhao1/add_checker
2022-02-24 02:03:23 +00:00
yao_yf e21f878e14 adasum ut fix 2022-02-24 09:31:04 +08:00
Xiaoda Zhang b714451937 implementing expert_parallel+data_parallel in MoE:
1) extending _Linear's input as 4-dimension tensor: [outer_batch, expert_dim, -1, hidden], and _Liner's BatchMatMul becomes BatchMatMul(4_dim_tensor, 3_dim_tensor);
2) configuring the _Linear's BatchMatMul sharding strategy as [[dp, ep, 1, 1], [ep, 1, mp]];
3) introducing a new parameter 'expert_parallel' in TransformerOpParallelConfig, creating a new class MoEParallelConfig to include 'data_parallel', 'model_parallel' and 'expert_parallel';
4) changing parallel config for FeedForward, TransformerEncoderLayer, TransformerDecoderLayer.
2022-02-24 09:24:27 +08:00
wangshengnan12@huawei.com acbefd80ea pipeline_opt_detection 2022-02-24 09:23:17 +08:00
zhousiyi 38ac9041d6 dont evaluated to specific SymbolicKey if not direct weight parameter 2022-02-24 01:08:47 +00:00
i-robot 2a00ffd3b1
!30259 [MD]Update set_autotune_enable API to add save filepath
Merge pull request !30259 from cathwong/ckw_at_save_api
2022-02-24 01:00:59 +00:00
Cathy Wong 46e223e569 [MD] Update set_autotune_enable API to add save filepath 2022-02-23 14:50:55 -05:00
wYann 57cb72e2b7 dynamic data sink on Ascend 2022-02-23 22:03:14 +08:00
hanhuifeng2020 662c51c019 [DynamicShape][GPU]add dynamic shape support of Concat and its backward for DCN 2022-02-23 19:18:21 +08:00
i-robot 81260a2319
!30466 takedown test_auto_parallel_adasum.py to ensure stability, again
Merge pull request !30466 from yanghaoran/master
2022-02-23 09:15:58 +00:00
i-robot 14393503b7
!30431 allreduce allgather fusion
Merge pull request !30431 from jiahongQian/master
2022-02-23 08:52:40 +00:00
yanghaoran 71d6b7d506 takedown test_auto_parallel_adasum.py to ensure stability, again 2022-02-23 16:42:13 +08:00
i-robot 0ade79cb84
!30391 add julia cache and row-major api
Merge pull request !30391 from r1chardf1d0/master
2022-02-23 08:40:21 +00:00
jiaorui 063ee8b825 tbe ops debug 2022-02-23 15:07:16 +08:00
i-robot 243fb6bb0f
!29991 dynamic shape
Merge pull request !29991 from TuDouNi/dynamic_shape_stage3
2022-02-23 07:03:32 +00:00
i-robot 2e8eac8341
!30367 auto_parallel_adasum_support_data_parallel
Merge pull request !30367 from yao_yf/auto_parallel_adasum_support_data_parallel
2022-02-23 06:50:26 +00:00
[songyuanwei] ecaa85fc09 add landscape doc and st 2022-02-23 14:19:49 +08:00
hezhenhao1 bcb936373e Apply value and type checking for all functions in mindspore.scipy module. 2022-02-23 14:04:39 +08:00
ttudu 451ebd1bd1 dynamic_shape 2022-02-23 11:38:17 +08:00
i-robot 4c4a682b7a
!30350 add MaxPoolGradGrad on GPU
Merge pull request !30350 from zhaoting/master
2022-02-23 02:47:55 +00:00
jiahongQian 8a2151d8bb allgather reducescatter fusion 2022-02-23 10:47:30 +08:00
i-robot eeb731ae3e
!18738 [assistant][ops]New operator implementation, include LSUNDataset
Merge pull request !18738 from Wangsong95/lsun_dataset
2022-02-23 02:28:40 +00:00
i-robot 5bee7156b9
!30369 add_virtualdataset_ut
Merge pull request !30369 from lilei/add_virtualdataset_ut
2022-02-23 02:21:34 +00:00
i-robot 0f24b679ec
!29819 Add GlobalNorm Search
Merge pull request !29819 from huangxinjing/add_global_norm_search
2022-02-23 01:15:08 +00:00
i-robot abb89d3f06
!29705 [MD][Offload] Support Multi-Column Datasets and Map Column Names to Index
Merge pull request !29705 from markuskunej/offload_multi_col_ds
2022-02-22 22:48:38 +00:00