yystopf
/
mindspore
forked from mindspore-Ecosystem/mindspore
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
45,876 Commits 23 Branches 0 Tags 3.9 GiB
Commit Graph

4041 Commits

Author SHA1 Message Date
i-robot e672e261ed
!33935 add get_bprop_p_s_roi_pooling 
Merge pull request !33935 from ms_yan/add_bprop
 2022-05-07 08:36:04 +00:00
lilinjie 5cd5177dae unify format under dir: mindspore/nn & ops 2022-05-07 16:14:09 +08:00
zx 63f08d4b36 [feat][assistant][I4CRK7] add new Ascend operator BesselJ0 and BesselJ1 2022-05-07 15:20:29 +08:00
ms_yan 2346c2c8cf add get_bprop_p_s_r_o_i_pooling 2022-05-07 09:32:35 +08:00
changzherui deacc65ffd add specify_prefix for load_checkpoint 2022-05-06 23:42:40 +08:00
i-robot 7171c4806e
!33812 [MD] Transform Unification Feature - Phase 2C - legacy deprecated Python UT tests 
Merge pull request !33812 from cathwong/ckw_xtranuni_phase2c_uts_deprecated
 2022-05-06 14:52:06 +00:00
i-robot 6c78153ef8
!33948 add softmax mul parallel tests 
Merge pull request !33948 from wanhanyang/new_softmax
 2022-05-06 09:00:41 +00:00
i-robot 3409f924bc
!33947 Add softmax gather parallel tests 
Merge pull request !33947 from wanhanyang/test_softmax_gather
 2022-05-06 08:31:38 +00:00
i-robot 8f565f098e
!33904 use _inner_ops shard instand of array_ops range 
Merge pull request !33904 from yanzhenxiang2020/range_shard_inner
 2022-05-06 08:10:46 +00:00
fangzhibin f6adbe957a [feat] [assistant] [I40GJ8] add new Ascend and CPU calculate operator Trace and TraceGrad 2022-05-06 15:28:00 +08:00
Wan Hanyang 2cf05811b8 add test softmax gather net tests 2022-05-06 14:59:27 +08:00
Wan Hanyang d16b2c15b1 Add mul softmax net tests 2022-05-06 14:53:30 +08:00
i-robot 1b01960935
!33923 回退 'Pull Request !33791 : Add gather with softmax parallel tests' 
Merge pull request !33923 from suteng/revert-merge-33791-master
 2022-05-06 05:42:18 +00:00
suteng 5c9f240735
回退 'Pull Request !33791 : Add gather with softmax parallel tests' 2022-05-06 03:20:35 +00:00
suteng 9c5d75d416
回退 'Pull Request !33790 : Add parallel fused softmax parallel tests' 2022-05-06 03:20:18 +00:00
i-robot 02f58183c5
!33644 add PSROIPoolingV2 op 
Merge pull request !33644 from guozhijian/add_PSROIPoolingV2
 2022-05-06 03:11:43 +00:00
yanzhenxiang2020 04c5a582da use _inner_ops shard instand of array_ops range 2022-05-06 10:36:57 +08:00
Cathy Wong a275b8b267 [MD] Transform Unification Feature - Phase 2C - legacy deprecated Python UT tests 2022-05-05 17:21:27 -04:00
i-robot 0828efe02e
!33811 [MD] Transform Unification Feature - Phase 2B - test_[r-z]*.py Python UT updates 
Merge pull request !33811 from cathwong/ckw_xtranuni_phase2b_uts_r_to_z
 2022-05-05 18:48:57 +00:00
i-robot fddb926dd5
!33807 [MD] Transform Unification Feature - Phase 2A - test_[a-q]*.py Python UT Updates 
Merge pull request !33807 from cathwong/ckw_xtranuni_phase2a_uts
 2022-05-05 12:43:58 +00:00
i-robot 4451a6a3ae
!33831 Change graph isinstance runtimeerror to typeerror 
Merge pull request !33831 from LiangZhibo/master
 2022-05-05 11:26:43 +00:00
xiefangqi a396140a4a add PSROIPoolingV2 ops 2022-05-05 19:13:06 +08:00
i-robot 43fd864c10
!31745 Enable if parallel call flag by default 
Merge pull request !31745 from xychow/enable-if-parallel-call-by-default
 2022-05-05 09:28:39 +00:00
i-robot ad304d342e
!33747 rewrite subgraph 
Merge pull request !33747 from 于振华/rewrite_subgraph01
 2022-05-05 07:07:47 +00:00
liangzhibo 5cb03b22c1 change isinstance error to typeerror 2022-05-05 09:28:52 +08:00
Cathy Wong eb4fd20bac [MD] Transform Unification Feature - Phase 2A - test_[a-q]*.py Python UT updates 2022-05-04 15:24:18 -04:00
Cathy Wong 22adb200b2 [MD] Transform Unification Feature - Phase 2 - test_[r-q]*.py Python UT updates 2022-05-04 09:16:46 -04:00
yuzhenhua ef28e8aa7f modify for subgraph and node visitor 2022-04-30 14:30:24 +08:00
i-robot 3d1060dcdb
!33790 Add parallel fused softmax parallel tests 
Merge pull request !33790 from wanhanyang/softmax2
 2022-04-29 13:02:50 +00:00
Su Teng 1686559b0d add gather with softmax parallel tests 2022-04-29 18:18:01 +08:00
Su Teng 1e1eaedec7 add parallel fused softmax tests 2022-04-29 18:14:43 +08:00
zhousiyi d4aba77d3d enable if parallel call transformation by default; fix test case ut/python/pipeline/parse/test_fix_bug.py::test_fix_expanddims_loss_scale 
Check only if all branch of middle graph's output are scalar, parallel_if transformation should be ignored

fix test_auto_monad.py::test_while_if geswitch input shape check failed

fix ut/python/pipeline/parse/test_super.py::test_super_cell core dump as varg and kwarg parameter are removed but those flags are not set, it will cause FuncGraph::GetPositionArgsCount be negative

skip test_control_flow in ut/python/paralle as Parallel team is working on contro flow adaption.

fix ut/python/ir/test_row_tensor.py::test_row_tensor_with_control_flow_if

fix for kwonlyargs when eliminate_parameter and add testdases

fix cannot join for st/control/inner/test_012_if_in_for.py

fix pclint errors

fix test/st/scipy_st/sparse/test_linalg.py, if the output cnode of former funcgraph is Depend CNode with input 1 as middle funcgraph call, then keep the output of former funcgraph as Depend other than middle funcgraph tail call.

log as exception

If the output of middle funcgraph contain PyInterpret CNode, then ignore
the transformation as the Value in Abstract will be kAnyValue after join
of the PyInterpret CNode value.

Backend cannot support for RealDiv with Int64, so change one operand to Float
 2022-04-29 08:22:56 +00:00
i-robot 3e80716b0c
!33437 SactterMin operator supports GPU, and add function interface 
Merge pull request !33437 from hujiahui8/scatter_min
 2022-04-28 02:39:44 +00:00
i-robot fd22d69ca7
!33475 Remove test data containing sensitive word 
Merge pull request !33475 from xiaotianci/fix_examples
 2022-04-28 02:05:09 +00:00
i-robot 37a28be84a
!33574 [MD] fix test case 
Merge pull request !33574 from liyong126/fix_test_case1
 2022-04-27 20:59:48 +00:00
i-robot 406eaf37b1
!33497 Support custom cell bprop when using Parameter in primal graph 
Merge pull request !33497 from YuJianfeng/custom_bprop
 2022-04-27 12:30:02 +00:00
hujiahui8 b8ec35c3b7 SactterMin operator supports GPU, and add function interface 2022-04-27 16:42:21 +08:00
yujianfeng 5f6bb3132e Support custom cell bprop when using Parameter in primal graph 2022-04-27 14:08:17 +08:00
Xiao Tianci 0dc85a15b9 remove sensitive word in test data 2022-04-27 10:51:44 +08:00
i-robot 6c9590d13d
!32632 add new Ascend operator TruncatedNormal 
Merge pull request !32632 from yyxhgg/TruncatedNormal
 2022-04-26 13:04:03 +00:00
liyong 29855385a5 fix random dataset 2022-04-26 19:48:17 +08:00
i-robot fcb0319747
!33270 [assistant][InverseMelScale] 
Merge pull request !33270 from chenchen/InverseMelScale
 2022-04-26 08:55:58 +00:00
i-robot 16794f27b9
!32789 [assistant][ops] Add math operator ReduceStd 
Merge pull request !32789 from 孟权令/ReduceStd
 2022-04-25 13:50:34 +00:00
i-robot 31bb95306e
!32715 [assistant][ops]New operator implementation, include NthElement 
Merge pull request !32715 from 宋梦雨/NthElement
 2022-04-25 11:29:39 +00:00
chenx2ovo cd8395f352 [feat][assistant][I3CEG2] add op inversemelscale 2022-04-25 18:58:38 +08:00
i-robot 2b6d6b6b33
!33488 Add CPU/GPU implementation of Cummax operator. 
Merge pull request !33488 from hezhenhao1/add_cumop
 2022-04-25 07:12:23 +00:00
ZCX 58b468fdce [feat] [assistant] [I471DN] add new Ascend operator TruncatedNormal 2022-04-25 12:51:26 +08:00
hezhenhao1 9f7db2afab Add CPU/GPU implementation of Cummax operator. 2022-04-25 12:32:29 +08:00
i-robot e65e14e35a
!31061 [feat] [assistant] [I4CRJI] Add new aicpu operator RaggedRange 
Merge pull request !31061 from 路雄博/raggedrange
 2022-04-25 04:09:20 +00:00
i-robot 0bb0183e08
!32913 Remove support for dataclass 
Merge pull request !32913 from huangbingjian/test_class
 2022-04-25 02:26:25 +00:00
宋梦雨 aaa4b75791 add the NthElement 2022-04-25 09:15:48 +08:00
huangbingjian d6485b82f6 Remove support for dataclass 2022-04-24 09:12:50 +08:00
i-robot 887f815e2f
!33377 [Fallback][Control_flow] Add control flow fallback testcases. 
Merge pull request !33377 from Margaret_wangrui/control_flow_testcases
 2022-04-24 01:09:06 +00:00
wyj a01dd47844 [feat] [assistant] [I4804K] Add new aicpu operator RaggedRange 2022-04-22 18:59:39 +08:00
i-robot 756bfdbb73
!33112 [assistant][ops] Add FractionalAvgPool 
Merge pull request !33112 from 徐喻琳/FractionalAvgPool
 2022-04-22 09:04:18 +00:00
Sawyer Zheng d31e8e5200 [feat][assistant][I3T92E] add new math operator ReduceStd 2022-04-22 15:39:43 +08:00
Margaret_wangrui c8a853114c [Fallback][Control_flow] Add control flow fallback testcases. 2022-04-22 11:36:19 +08:00
i-robot 5524b9d4e0
!33333 Refactor optimizers to support flatten parameters 
Merge pull request !33333 from hewei/flatten_weights
 2022-04-21 12:14:30 +00:00
“xuyulina” f412c6ee28 [feat] [assistant] [I471D8] add new Ascend operator FractionalAvgPool 2022-04-21 17:42:36 +08:00
Zhang Qinghua 329c4f23c8 Throw an exception if the side-effect op is ignored in the func graph who returned constant result. 2022-04-21 14:24:15 +08:00
He Wei 8b0d4e7751 Refactor optimizers to support flatten parameters 2022-04-20 20:23:31 +08:00
i-robot 5e57d3e4a2
!33213 [assistant][ops]New operator implementation, include BesselK0, BesselK1, BesselK0e, BesselK1e 
Merge pull request !33213 from 张璇/BesselK
 2022-04-20 07:51:44 +00:00
i-robot 14a8b1d18e
!32984 support list slice 
Merge pull request !32984 from lianliguang/supported-list-slice-assign
 2022-04-20 07:30:10 +00:00
zx 14c4c0a51b [feat][assistant][ops] New operator implementation, include BesselK0，BesselK1，BesselK0e and BesselK1e 2022-04-20 13:48:33 +08:00
lianliguang 11b4836040 support list slice assign 2022-04-20 09:32:05 +08:00
i-robot 49f030358e
!33263 [MD] UT Updates - more eager tests, minor updates 
Merge pull request !33263 from cathwong/ckw_ut_misc_fixes
 2022-04-19 20:34:16 +00:00
liangzhibo 8f2bf65f80 Graph isinstance extends 2022-04-19 10:49:09 +08:00
Cathy Wong 907194dfb8 [MD] UT Updates - more eager tests, minor updates 2022-04-18 22:03:32 -04:00
liangzhibo 78a542164c Delete convert_python_data in ValueToPyData 2022-04-18 19:19:19 +08:00
i-robot 813d0505ac
!33016 [MS][ops]add new cpu array operators BitwiseAnd BitwiseOr BitwiseXor 
Merge pull request !33016 from KXiong/master
 2022-04-16 09:01:44 +00:00
i-robot a1da426c78
!33082 Add convert_python_data ro the output of ValueToPyData 
Merge pull request !33082 from LiangZhibo/pydata
 2022-04-16 08:09:58 +00:00
xiongkun c9704b92bb [MS][ops]add new array operator BitwiseAnd BitwiseOr BitwiseXor 
[MS][ops]add new array operator BitwiseAnd BitwiseOr BitwiseXor

[MS][ops]add new array operator BitwiseAnd BitwiseOr BitwiseXor

[MS][ops]add new array operator BitwiseAnd BitwiseOr BitwiseXor

[MS][ops]add new array operator BitwiseAnd BitwiseOr BitwiseXor

[MS][ops]add new array operator BitwiseAnd BitwiseOr BitwiseXor

[MS][ops]add new array operator BitwiseAnd BitwiseOr BitwiseXor

[MS][ops]add new array operator BitwiseAnd BitwiseOr BitwiseXor

[MS][ops]add new array operator BitwiseAnd BitwiseOr BitwiseXor

[MS][ops]add new array operator BitwiseAnd BitwiseOr BitwiseXor

[MS][ops]add new array operator BitwiseAnd BitwiseOr BitwiseXor

[MS][ops]add new array operator BitwiseAnd BitwiseOr BitwiseXor
 2022-04-16 15:06:38 +08:00
i-robot b3cc429b09
!32645 [assistant][ops] Add FractionalMaxPool3DWithFixedKsize 
Merge pull request !32645 from 徐强/FractionalMaxPool3DWithFixedKsize
 2022-04-16 06:31:16 +00:00
liangzhibo 7b9bc36a11 Add convert_python_data at the end ot ValueToPyData 2022-04-16 14:19:20 +08:00
i-robot 4c3faa7f8f
!32613 Supports creating and calling instances of ms_class 
Merge pull request !32613 from huangbingjian/class_dev
 2022-04-16 06:14:29 +00:00
i-robot 7e75db0979
!33066 Add docs and ut for Variable api 
Merge pull request !33066 from YuJianfeng/mutable
 2022-04-16 03:26:26 +00:00
huangbingjian a20579cef3 Support for creating and calling instances of ms_class 2022-04-16 10:08:11 +08:00
xuqiang b6ae8d9a85 [feat] [assistant] [I40GGU] add new operator FractionalMaxPool3DWithFixedKsize 2022-04-15 20:48:15 +08:00
He Wei 0d12199928 Enable flatten_gradients for Adam optimizer 2022-04-15 19:49:57 +08:00
yujianfeng a4575fcf9a Add docs and ut for Variable api 2022-04-15 15:01:04 +08:00
He Wei 9a0a0ad5e8 Add inner operator FlattenConcat 2022-04-15 09:30:39 +08:00
i-robot 2d0b9f9a7b
!33007 modify constant shard 
Merge pull request !33007 from wangshengnan123/master
 2022-04-15 01:15:06 +00:00
i-robot 4aa67f7e1b
!27893 [feat] [assistant] [I4CRJN] [I4CRJM] [I4CRJL] Add MatrixDiagV3, MatrixSetDiagV3 and MatrixDiagPartV3 
Merge pull request !27893 from 杜闯/MatrixDiagV3_
 2022-04-14 06:34:36 +00:00
wangshengnan123 f7949289e6 rm constant sharding 2022-04-14 11:15:42 +08:00
i-robot 4442e0f654
!32711 [MD] fix mindrecord rename issue 
Merge pull request !32711 from liyong126/fix_rename_mindrecord_issue
 2022-04-13 06:58:28 +00:00
chauneahhin e9bbec3b4c [feat] [assistant] [I4CRJN] [I4CRJM] [I4CRJL] Add MatrixDiagV3, MatrixSetDiagV3 and MatrixDiagPartV3 2022-04-13 10:23:51 +08:00
i-robot fb4ac3e4cb
!32672 add ut for save_graphs 
Merge pull request !32672 from huanghui/add-ut-for-save_graphs
 2022-04-13 01:33:12 +00:00
liyong 830e76656a fix mindrecord rename issue 2022-04-12 19:36:24 +08:00
i-robot 1405c59a4f
!32853 fallback lossmonitor has_trained_epoch 
Merge pull request !32853 from changzherui/fallback_lossmonitor
 2022-04-12 02:34:11 +00:00
huanghui f8b93ebc39 add ut for save_graphs 2022-04-12 09:13:00 +08:00
changzherui 865a5de03d fallback lossmonitor has_trained_epoch 2022-04-11 23:24:24 +08:00
xiongkun 317f59a0ae [MS][Rewrite]Move return out of if and support multiple targets 
[MS][Rewrite]Move return out of if and support multiple targets

[MS][Rewrite]Move return out of if and support multiple targets

[MS][Rewrite]Move return out of if and support multiple targets

[MS][Rewrite]Move return out of if and support multiple targets

[MS][Rewrite]Move return out of if and support multiple targets

[MS][Rewrite]Move return out of if and support multiple targets

[MS][Rewrite]Move return out of if and support multiple targets

[MS][Rewrite]Move return out of if and support multiple targets
 2022-04-11 20:39:42 +08:00
i-robot 92655adb3b
!32622 fix_white_list 
Merge pull request !32622 from 冯一航/fix_white_list_master2
 2022-04-09 02:34:34 +00:00
fengyihang 5572c797b8 test 2022-04-08 16:44:18 +08:00
i-robot 3416b3a94b
!32630 Modify Optimizer to support flatten parameters 
Merge pull request !32630 from hewei/flatten_weights
 2022-04-08 06:48:09 +00:00
i-robot c1bacb39dc
!32644 [MD] fix doc issue2 in master 
Merge pull request !32644 from liyong126/fix_doc_issue2
 2022-04-08 06:32:34 +00:00
i-robot 0af661659c
!32534 [MD][Autotune] Add rank to filename 
Merge pull request !32534 from harshvardhangupta/rank_id_suffix_at_config
 2022-04-08 02:51:17 +00:00
liyong 2172934177 fix doc issue2 2022-04-08 10:46:08 +08:00
i-robot 4636851fc5
!32351 reinforce subtree support in Rewrite 
Merge pull request !32351 from hangq/mscompression-pr
 2022-04-08 01:24:27 +00:00
harshvardhangupta 6b8a76c59d add rank to filename 2022-04-07 16:12:06 -04:00
He Wei 723543eb5d Modify Optimizer to support flatten parameters 
1. Provide method to create Parameter from Tensor without copy;
2. Adapt optimizer.py to support flattened parameters;
3. Add unit test cases for parameter and optimizer.
 2022-04-07 14:11:32 +08:00
jonyguo b8205ee995 add testcase 2022-04-07 09:49:23 +08:00
liyong 3191160eca fix some issue 2022-04-06 17:48:55 +08:00
i-robot e611ca2907
!32524 [dataset][bugfix] Fix hang bug of output_types when dataset launch two-level pipeline + multiprocessing 
Merge pull request !32524 from xiefangqi/md_fix_two_level_pipeline_hang
 2022-04-06 09:13:29 +00:00
i-robot 41f1f48ed9
!32465 [Fallback][Control_flow] Ensure the information of the Interpret node is transmitted normally when function block jumps. 
Merge pull request !32465 from Margaret_wangrui/fallback_control_flow_2
 2022-04-06 07:06:45 +00:00
unknown a9e6a151da fix dataset two level pipeline hang problem 2022-04-06 12:39:48 +08:00
i-robot e09a674bcc
!32529 Fix optimizer limit for the Parallel Optimizer 
Merge pull request !32529 from huangxinjing/fix_model_limit
 2022-04-06 03:39:36 +00:00
Margaret_wangrui dcda778f8a [ME][Fallback][Control_flow] Ensure the information of the Interpret node is transmitted normally when function block jumps. 2022-04-06 09:27:55 +08:00
huangxinjing b16dbf2b5d 1. Fix optimizer check error, as the check is done by the class name, too naive 
2. Add virutal assign add to the operator
 2022-04-05 20:16:03 +08:00
hangangqiang 0e213ca36c reinforce subtree in Rewrite 
reinforce Primitive op support in Rewrite
 2022-04-02 16:14:18 +08:00
i-robot 41615d4833
!32099 Fix the error is reported when the file name is directly transferred 
Merge pull request !32099 from 刘勇琪/master
 2022-04-02 07:59:44 +00:00
i-robot b12fefbded
!32373 Add class Variable to set constant mutable 
Merge pull request !32373 from YuJianfeng/mutable
 2022-04-02 07:35:02 +00:00
i-robot feac726ec7
!32363 add AstFinder, AstReplacer, Observer, Observable and ClassNamer in Rewrite 
Merge pull request !32363 from hangq/mscompression-pr-dev
 2022-04-02 05:04:37 +00:00
liu-yongqi-63 b125369f1e Fix the error is reported when the file name is directly transferred 2022-04-02 11:51:57 +08:00
yujianfeng 507c2cb2a7 Add Variable to set constant mutable 2022-04-02 11:08:43 +08:00
i-robot a49b9877a9
!32381 Add APIs to support flatten weights 
Merge pull request !32381 from hewei/flatten_weights
 2022-04-01 12:59:40 +00:00
i-robot c4993cb3b6
!27361 [assistant][ops]New operator implementation, include Bucketize 
Merge pull request !27361 from 傅嘉俊/Bucketize
 2022-04-01 11:11:27 +00:00
He Wei ba0e450078 Add APIs to support flatten weights 
```
Cell.flatten_weights()

Tensor._flatten_tensors()
Tensor._is_flattened()
Tensor._get_flattened_tensors()
```
 2022-04-01 15:56:38 +08:00
i-robot 3e7694ff85
!26342 [assistant][ops] Add FractionalMaxPool 
Merge pull request !26342 from 徐喻琳/FractionalMaxPool
 2022-04-01 03:44:30 +00:00
i-robot acce047dfe
!32341 add parallel ops about Invert CheckValid PopulationCount 
Merge pull request !32341 from yangzhenzhang/add-parallel-operators
 2022-04-01 02:53:58 +00:00
i-robot ed2ed45482
!32111 Support assert in constant scenarios 
Merge pull request !32111 from huanghui/assert
 2022-04-01 02:45:44 +00:00
i-robot d73ccd17f6
!32328 [MD][Offload] Reduce Offload UT Computation Time 
Merge pull request !32328 from alashkari/update-ut
 2022-03-31 14:55:28 +00:00
i-robot 39b97d8641
!32224 fix the log info and exception message in profiler and summary 
Merge pull request !32224 from maoyaomin/mym_fix
 2022-03-31 12:18:11 +00:00
hangangqiang 082d5eeda9 add AstFinder, AstReplacer, Observer, Observable and ClassNamer in Rewrite 2022-03-31 19:00:32 +08:00
i-robot c3d7c425e9
!29856 [assistant][GriffinLim] 
Merge pull request !29856 from chenchen/g2
 2022-03-31 09:33:52 +00:00
i-robot 72414ff8d9
!31941 modify Strided_slice for master 
Merge pull request !31941 from lilei/modify_stridedslice_for_master
 2022-03-31 09:11:24 +00:00
yanghaoran c44de68591 takedown test_datasets_generator to ensure gate stability 2022-03-31 16:56:03 +08:00
yangzhenzhang c927da3b41 add parallel operators 2022-03-31 15:11:25 +08:00
“xuyulina” d147959bac [feat] [assistant] [I471DB] add new Ascend operator FractionalMaxPool 2022-03-31 15:11:13 +08:00
Arielxyx 8f9226666f cpu_0329 2022-03-31 14:49:29 +08:00
maoyaomin 99a3abe2bb fix the logger info and exception message in profiler and summary 2022-03-31 14:26:58 +08:00
chenx2ovo e19dc02b47 [feat][assistant][I3CECZ] add op griffinlim 2022-03-31 11:30:26 +08:00
i-robot fdb08994f0
!30974 add mindpore rewrite 
Merge pull request !30974 from hangq/mscompression-pr
 2022-03-31 02:59:06 +00:00
i-robot 9810fa53cb
!31899 [Auto-Par] [D-Rec] Add Mem & Redis coefficient on D-Rec cost model for Pangu-alpha 
Merge pull request !31899 from FRHW-WANG/D-Rec-deliver
 2022-03-31 02:12:26 +00:00
i-robot 8ea9ceaecd
!32231 fix: when return numpy in GeneratorDataset 
Merge pull request !32231 from guozhijian/fix_generator_with_numpy
 2022-03-31 01:21:20 +00:00
Rescue 60d895fcd8 Decrease test_map_offload.py computation time. 2022-03-30 16:40:19 +00:00
jonyguo 4378014ffb fix: when return numpy in GeneratorDataset 2022-03-30 20:21:41 +08:00
hangangqiang de196f3a25 add mindpore rewrite 2022-03-30 17:40:27 +08:00
huanghui c222f7d226 support asert 2022-03-30 14:54:38 +08:00
i-robot 6bf4f98752
!32089 me master 0328 
Merge pull request !32089 from mindspore_ding/me_master_0328
 2022-03-30 06:39:02 +00:00
i-robot b67ba47446
!30266 [assistant] [ops] [I4CRJJ] add new array operator Triu 
Merge pull request !30266 from ruili/Triu
 2022-03-30 03:00:48 +00:00
i-robot abf0c022a9
!26505 [assistant] [ops] [I48O8K] add new array operator RightShift 
Merge pull request !26505 from 王超/rightshift
 2022-03-29 13:14:24 +00:00
haoran.wang 3674e1d713 Add Mem & Redis coefficient for PanGu-alpha 2022-03-29 12:00:34 +00:00
i-robot 7906cef56f
!31989 [MD] fix GIL acquire issue 
Merge pull request !31989 from liyong126/fix_gil_issue
 2022-03-29 08:35:04 +00:00
i-robot e897c98b1f
!31988 Implementation of SquaredDifferenceInfo, ErfinvInfo, MaskedFillInfo, SplitVInfo, GammaInfo, KLDivLossInfo and LinSpaceInfo. 
Merge pull request !31988 from liuluobin/ops_impl
 2022-03-29 08:08:32 +00:00
dingpeifei c688f0a490 me master 0325 2022-03-29 15:54:49 +08:00
liyong f703f66f6c fix gis issue 2022-03-29 11:17:01 +08:00
liuluobin 6f914b8b3c Implementation of SquaredDifferenceInfo, ErfinvInfo, MaskedFillInfo, SplitVInfo, GammaInfo, KLDivLossInfo and LinSpaceInfo 2022-03-29 09:30:21 +08:00
i-robot a9cdbd5ae8
!32005 fix bugs of moe 
Merge pull request !32005 from bichaoyang/master
 2022-03-29 01:30:10 +00:00
larrygld aeb0b2090b [assistant][ops] Add array operators Triu 2022-03-28 21:25:29 +08:00
王超 0cf25e180f [assistant] [ops] [I48O8K] add new array operator RightShift 2022-03-28 18:51:44 +08:00
i-robot c2e0796bdb
!25339 [assistant][ops] Add new Tril 
Merge pull request !25339 from 张凯磊/Tril
 2022-03-28 09:26:13 +00:00
b00518648 93da6bab46 fix bugs of moe: only use a fewer dp in moe 2022-03-28 17:22:48 +08:00
i-robot 8add6a926c
!31925 modify interface of shard function 
Merge pull request !31925 from wangjun/interface_modify_0325
 2022-03-28 02:24:16 +00:00
i-robot a15f682803
!31603 support str.format 
Merge pull request !31603 from lianliguang/supported-str-format
 2022-03-28 01:33:58 +00:00
lilei 452362332e xmodify stridedslice for master 2022-03-28 09:24:13 +08:00
Carry955 3d182380d8 [feat][assistant][I4862P] add new aicpu operator Tril 2022-03-26 19:36:29 +08:00
i-robot 5a4e25db92
!26226 [assistant][ops] Add NonDeterministicInts 
Merge pull request !26226 from yyxhgg/NonDeterministicInts
 2022-03-26 09:42:53 +00:00
i-robot d66af6eb86
!26399 [assistant][ops] Add CropAndResizeGradBoxes 
Merge pull request !26399 from wangyantao/CropAndResizeGradBoxes
 2022-03-26 09:41:38 +00:00
lianliguang 6304c2ef3d support str.format 2022-03-26 14:53:06 +08:00
lianliguang 424c16d116 fix abs(tensor) when tesnor data is a 0-dim number 2022-03-26 14:20:03 +08:00
wangjun 789539cbaa modify interface name for shard 2022-03-26 09:10:14 +08:00
i-robot 3f18180606
!31742 [MD][Autotune] Change autotune config 
Merge pull request !31742 from harshvardhangupta/at_config_suggestion
 2022-03-25 21:00:12 +00:00
wangyantao 668cdb936f [feat] [assistant] [I471CP] add new operator CropAndResizeGradBoxes 2022-03-26 00:30:34 +08:00
ZCX 0cb72a21f3 [feat] [assistant] [I471DI] add new Ascend operator NonDeterministicInts 2022-03-25 22:29:47 +08:00
harshvardhangupta 0086f4ee05 Modify the Dataset AutoTune config #31742 2022-03-25 09:03:38 -04:00
i-robot 40015e003f
!31896 fix isolated node error 
Merge pull request !31896 from lianliguang/fix-isolated-node-bug
 2022-03-25 11:52:21 +00:00
lianliguang 3d7c56c4cc fix isolate node bug when using fallback interpret node 2022-03-25 16:41:16 +08:00
i-robot 1af8b365de
!31880 [MD] add OBSMindDataset 
Merge pull request !31880 from liyong126/add_obs_mindrecord_dataset
 2022-03-25 06:50:58 +00:00
i-robot 5f343bcd09
!31824 add waring suggestion log and map op error check 
Merge pull request !31824 from guozhijian/fix_more_info
 2022-03-25 03:24:07 +00:00
liyong 419109cf0a add OBSMindDataset 2022-03-25 11:03:53 +08:00
i-robot 3c83d3f600
!31668 [Auto-Par] [D-Rec] Modify the name of the functions and variables of Parameter shared User strategy treatment & Add new treatment case of MatMul/Gather 
Merge pull request !31668 from 王浩然/D-Rec-deliver
 2022-03-25 02:11:41 +00:00
jonyguo 317c48a933 add log warning and op error check 2022-03-25 09:26:29 +08:00
7347157+joylvliang@user.noreply.gitee.com 39e70e8519 fix_bug_of_tensor_copy_canot_work_in_int64_with_D 2022-03-24 20:47:42 +08:00
haoran.wang fdfbe2dedc Modify the name of the funtions and variables of Parameter shared User strategy treatment 2022-03-24 06:16:55 +00:00
liyong bff0fbc76f fix GIL acquire Misuse 2022-03-24 08:45:30 +08:00
i-robot 4110c3d6d6
!31646 [dataset][bugfix] 修复config 接口typeerror的问题 
Merge pull request !31646 from xiefangqi/md_fix_interface_comments
 2022-03-23 02:45:01 +00:00
i-robot f59de99ed6
!31654 [ME]Support raise in constant scenarios. 
Merge pull request !31654 from Margaret_wangrui/raise
 2022-03-23 02:28:37 +00:00
Margaret_wangrui 6d10adc9c5 [ME]Support raise in constant scenarios. 2022-03-22 19:33:47 +08:00
i-robot 200a77c3d1
!31393 fix csr/coo docs and checks 
Merge pull request !31393 from wangrao124/pr_0316
 2022-03-22 05:15:38 +00:00
xiefangqi f81c7967ec fix config interface comments 2022-03-22 10:04:12 +08:00
yux1ng 0b6b9e02cb [feat][assistant][I4XJG3] add new Ascend operator Identity 2022-03-21 20:06:53 +08:00
i-robot 4bb2fbdb5f
!30695 Support third-party modules 
Merge pull request !30695 from huangbingjian/import_module
 2022-03-21 08:36:39 +00:00
huangbingjian a62484c5ad Added recognition of third-party libraries 2022-03-21 14:10:23 +08:00
i-robot 91d9585df7
!31346 add vmap ut and st 
Merge pull request !31346 from Erpim/vmap_v12
 2022-03-21 03:49:08 +00:00
Erpim 0e7e1f8400 add vmap st and ut 2022-03-21 09:38:38 +08:00
liyong 00371d523f fix mindrecord issue 2022-03-19 12:04:27 +08:00
wangrao124 5e5415f617 fix csr/coo 2022-03-18 16:46:38 +08:00
i-robot 2e516c735b
!28640 [assistant] [ops] Add the FillV2 operator 
Merge pull request !28640 from 爱科学的小松鼠/OpFill
 2022-03-17 09:48:14 +00:00
hu-daiwang 3b093696e7 [feat] [assistant] [I48O6L] add the fillV2 operator 2022-03-17 11:19:59 +08:00
jonyguo 11079eabbb fix: code check 2022-03-17 08:23:12 +08:00
i-robot 1d6834ce4d
!31334 [MD][Autotune] Modify the generated autotune config to improve readability 
Merge pull request !31334 from harshvardhangupta/modify_at_config
 2022-03-16 18:18:57 +00:00
i-robot 88691d054e
!31321 Convert AbstractList to AbstractTuple recursively 
Merge pull request !31321 from hewei/fix_opt_perf
 2022-03-16 07:09:52 +00:00
i-robot c2212f88b4
!31164 Fix the global norm missing insert allreduce 
Merge pull request !31164 from huangxinjing/fx_global_norm_error
 2022-03-16 06:46:13 +00:00
i-robot 72ea797e4d
!30339 [BUG][MD][FUNC]RandomInvert 
Merge pull request !30339 from yangwm/randominvert
 2022-03-16 06:39:53 +00:00
i-robot 8e8391dadb
!30429 BUG][MD][FUNC]RandomAutoContrast 
Merge pull request !30429 from yangwm/autocontrast
 2022-03-16 06:38:54 +00:00
He Wei 51c147ab12 Convert AbstractList to AbstractTuple recursively 2022-03-16 09:59:27 +08:00
i-robot bf03f0e030
!31252 Implementation of element wise parallel ops 
Merge pull request !31252 from liuluobin/element_wise_ops
 2022-03-16 01:32:29 +00:00
i-robot 5f75c701d5
!31332 Fix bug in terminating a failed pipeline 
Merge pull request !31332 from h.farahat/fix_reset
 2022-03-15 20:17:05 +00:00
harshvardhangupta accc32da6c modify the at config file 2022-03-15 13:49:00 -04:00
i-robot 12d8906e2e
!30253 Support more ops for dump flag 
Merge pull request !30253 from huanghui/enhance-dump-flag
 2022-03-15 16:49:11 +00:00
hesham 3d16a4dee2 Fix bug in terminating a failed pipeline 2022-03-15 11:35:28 -04:00
liuluobin f13d342986 Implementation of element wise parallel ops 2022-03-15 19:24:17 +08:00
i-robot 313a247ae8
!31178 upgrade Ascend package 11 Mar 22 
Merge pull request !31178 from shenwei41/upgrade_ascend_20220311
 2022-03-15 11:08:32 +00:00
i-robot 3be552ca39
!31156 test centos ut 
Merge pull request !31156 from luoyang/test_centos
 2022-03-15 09:38:15 +00:00
shenwei41 f1fde6a262 upgrade Ascend package 11 Mar 22 2022-03-15 16:31:27 +08:00
huangxinjing 31f55b6525 1. The main gol: Fix mixing inserting the AllReduce when where is no mirror appeared 
2. remove pattern match error as the origin pattern match will find no operator if there is only one parameter
 2022-03-15 15:54:06 +08:00
i-robot 01078763df
!31227 don't handle reshape when using adafactor optimizer in auto parallel 
Merge pull request !31227 from yangzhenzhang/adafactor-parallel-skip-handle-reshape
 2022-03-15 02:47:31 +00:00
huanghui 4482acf586 Support API set_dump for more type of ops 2022-03-15 10:24:15 +08:00
i-robot d4fc47ef0c
!31211 Clean iterators before forking 
Merge pull request !31211 from h.farahat/pytest_problem
 2022-03-15 01:47:28 +00:00
yangzhenzhang 1f98ffb79c adafactor parallel skip handle reshape 2022-03-15 09:18:19 +08:00
i-robot 6be7c42052
!31191 [MD] more tests for failover reset 
Merge pull request !31191 from Mohammad Motallebi/failover_more_tests
 2022-03-14 21:50:37 +00:00
h.farahat 318e6b8803 fix segfault 2022-03-14 14:55:21 -04:00
mohammad 583eb32723 [MD] Add more UT and a ST for failover reset 2022-03-14 13:52:09 -04:00
luoyang 74d8969b91 ut failed with pillow>=9.0.0, need more validation 2022-03-14 23:58:09 +08:00
i-robot dcb5cd670c
!30953 Dynamic Weight Decay 
Merge pull request !30953 from wanyiming/dynamic_wd
 2022-03-14 06:03:24 +00:00
lilei 690c58ebcf modify virtualdataset bug for master 2022-03-13 10:49:15 +08:00
i-robot 8b7d7a1e1a
!31141 [MD][Offload] Offload RandomSharpness Op Pure Sharpness Support & UT 
Merge pull request !31141 from alashkari/fix-random-sharpness
 2022-03-11 21:06:13 +00:00
Rescue face5e51a0 Added sharpness without randomness support and sharpnes op ut. 
fix pad issue
 2022-03-11 17:30:49 +00:00
i-robot 603ff25afb
!31177 Add ut for fallback python buildin function with tensor input 
Merge pull request !31177 from LiangZhibo/syntax
 2022-03-11 08:38:53 +00:00
i-robot 3c0e34ada0
!30855 Support user-defined classes by ms_class decorators 
Merge pull request !30855 from huangbingjian/ms_class_dev
 2022-03-11 08:37:12 +00:00
liangzhibo a3f183bdad Add test case for fallback buildin function with constant tensor 2022-03-11 15:35:29 +08:00
i-robot c2a5cc1486
!31040 Produce parallel operators for Argmin/max, SquareSumAll and UnsortedSegmentProd 
Merge pull request !31040 from Bert0108/reduce_operators_arg
 2022-03-11 06:15:56 +00:00
shenyu 443da2280d [FIX][BUG][MD][FUNC] RandomInvert 2022-03-11 11:53:04 +08:00
shenyu c14a8084c7 [FIX][BUG][MD][FUNC] RandomAuoContrast 2022-03-11 10:29:49 +08:00
i-robot a064d0855b
!30728 add ci test for unify backend 
Merge pull request !30728 from xiaoyao/master
 2022-03-11 01:50:03 +00:00
i-robot eecf6db426
!31121 [MD] revert OBSMindDataset 
Merge pull request !31121 from liyong126/revert_OBSMindDataset
 2022-03-11 01:21:10 +00:00
i-robot 216e7c6a92
!31041 add check for conv2d 
Merge pull request !31041 from yangzhenzhang/add-check-for-conv2d
 2022-03-11 01:20:52 +00:00
i-robot 67d10ce3be
!31066 Fix a bug where ROIAlign and CropAndResize distributed op do not support GPU 
Merge pull request !31066 from liuluobin/fix_roialign
 2022-03-11 01:16:46 +00:00
huangbingjian 4f7c9cb27f Support user-defined classes through ms_class decorators. 2022-03-10 20:12:54 +08:00
i-robot 99910ef27f
!31088 convert C++ data to python when run fallback function 
Merge pull request !31088 from lianliguang/add-fallback-builtin-function
 2022-03-10 11:56:01 +00:00
yangzhenzhang c00d29f223 rebase 2022-03-10 19:17:06 +08:00
liyong 50fc6f5736 Revert "!30810 [MD] add OBSMindDataset " 
This reverts commit 9fcab9184e, reversing
changes made to afb33fff62.
 2022-03-10 19:10:11 +08:00
liuluobin 8f045d02e3 Fix a bug where ROIAlign and CropAndResize distributed op do not support GPU 2022-03-10 17:31:36 +08:00
lianliguang d9390afad1 convert MS C++ dtype to MS python 2022-03-10 16:09:34 +08:00
xiao_yao1994 94df0869ad uni_backend: add ut ge test 2022-03-10 16:08:36 +08:00
Bert0108 bfc5e4345c add distributed operators for argmax/min sqauresumall and unsortedsetmentprod 2022-03-10 14:44:37 +08:00
liyong 10ada68fa9 add OBSMindDataset 2022-03-10 11:18:59 +08:00
i-robot 059ac45ae8
!30920 Call Draw function directly 
Merge pull request !30920 from huanghui/fix-draw
 2022-03-10 03:15:56 +00:00
wanyiming a124ec4de7 add dynamic_decay 2022-03-10 11:02:27 +08:00
i-robot b32daf3cb4
!31000 add fallback example of function 
Merge pull request !31000 from lianliguang/add-fallback-builtin-function
 2022-03-10 01:57:37 +00:00
i-robot 698b99aaa3
!18945 [assistant][ops]New operator implementation, include OmniglotDataset 
Merge pull request !18945 from Wangsong95/omniglot_dataset
 2022-03-09 06:51:15 +00:00
lianliguang f3b1e3291c add jit fallback example 2022-03-09 11:25:03 +08:00
qkeys ce7597f500 [feat][assistant][I3J6VB] add new data operator OmniglotDataset 2022-03-08 21:36:22 +08:00
i-robot 0b207fce31
!29735 unique support multi_dim tensor 
Merge pull request !29735 from jiangzhenguang/unique_multi_tensor
 2022-03-08 08:30:57 +00:00
i-robot f73987dcf2
!30949 Change the Parameter type name from 'ParameterTensor' to 'Parameter' 
Merge pull request !30949 from 张清华/opt
 2022-03-08 06:17:31 +00:00
jiangzhenguang 28f89f36b4 unique support multi-dim tensor 2022-03-08 14:09:19 +08:00
Zhang Qinghua 973008ebcf Change the Parameter type name from 'ParameterTensor' to 'Parameter' 2022-03-08 11:23:56 +08:00
i-robot 82bc2b722d
!30417 add history and lambda callbacks 
Merge pull request !30417 from liutongtong9/add_callbacks
 2022-03-08 02:17:46 +00:00
i-robot 75e1939f50
!30899 Enable python buildin function type for graph fallback and add some ut for python buildin function for graph fallback 
Merge pull request !30899 from LiangZhibo/syntax
 2022-03-08 01:35:47 +00:00
i-robot 2655d64720
!30865 [MD] Modify Batch number of workers with Python multiprocessing 
Merge pull request !30865 from cathwong/ckw_batch_workers_pymultip
 2022-03-07 18:21:16 +00:00
Cathy Wong bc29dd9d72 [MD] Modify Batch number of workers with Python multiprocessing 2022-03-07 10:39:05 -05:00
i-robot 335ef1c270
!30459 Add ut validate function for parallel 
Merge pull request !30459 from liuluobin/ut_master
 2022-03-07 15:23:14 +00:00
i-robot 4a9a65d2a6
!30919 Produce parallel operators for ReduceAll and ReduceProd 
Merge pull request !30919 from Bert0108/reduce_operators_merge
 2022-03-07 11:30:37 +00:00
liuluobin b797a410cc Add validate function for parallel ut 2022-03-07 16:19:52 +08:00
huanghui ce0f500a3f convert draw_ to call Draw function derectly 2022-03-07 16:12:52 +08:00
Bert0108 dfc92f1791 add distributed parallel operators for reduceall and reduceprod 2022-03-07 15:40:11 +08:00
liangzhibo 1a81031d92 Add testcases for fallback python buildin function 2022-03-07 14:20:24 +08:00
lianliguang 55e7f2d761 modify DynamicShape to TensorShape 2022-03-07 14:19:12 +08:00
i-robot a2303a92bd
!30741 [dataset][dfx] 易用性-Python多进程统一整改专项 
Merge pull request !30741 from xiefangqi/md_add_multiprocessing_optimization
 2022-03-07 01:29:21 +00:00
i-robot c4cc0e6f26
!30742 auto parallel support not ony power of 2 device numbers 
Merge pull request !30742 from yao_yf/auto_parallel_support_not_only_2_power
 2022-03-07 01:09:01 +00:00
yao_yf b60e54e0d5 support not only power of 2 2022-03-06 18:08:46 +08:00
xiefangqi 2de6c8908b add a clean up subprocess to clean subprocess when main process exit 2022-03-05 17:24:11 +08:00
liutongtong 7afcdfd211 add history and lambda callbacks 2022-03-04 17:24:57 +08:00
i-robot b90cf43562
!30553 Support dataset reset() to recover after failure 
Merge pull request !30553 from h.farahat/reset
 2022-03-04 02:19:45 +00:00
i-robot f01d841113
!27943 [MD][Autotune] Save/Load Autotune config 
Merge pull request !27943 from harshvardhangupta/save_load_at_config
 2022-03-03 20:42:23 +00:00
i-robot 7b26a32e98
!22608 [assistant][ops]New operator implementation, include KITTIDataset 
Merge pull request !22608 from Wangsong95/kitti_dataset
 2022-03-03 07:05:40 +00:00
h.farahat a3dec34833 Dataset failover reset 2022-03-02 23:53:56 -05:00
harshvardhangupta bd61adbb72 Implement save/load of autotune dataset pipeline configuration #27943 2022-03-02 15:08:08 -05:00
i-robot 70e61e9014
!30781 [MD] test_pyfunc_multiprocess_autotune.py - enable AutoTune 
Merge pull request !30781 from cathwong/ckw_ut_fixup_map_python_multiproc
 2022-03-02 19:50:29 +00:00
i-robot edcc6b790d
!30714 [MD][Offload] Add TypeCast op to offload 
Merge pull request !30714 from markuskunej/offload_typecast
 2022-03-02 19:48:58 +00:00
Cathy Wong eb931c7f88 [MD] test_pyfunc_multiprocess_autotune.py - enable AutoTune 2022-03-02 13:25:35 -05:00
i-robot 4aa82cc21e
!30679 [MD] Add tests for Python Multiprocessing with AutoTune 
Merge pull request !30679 from cathwong/ckw_ut_map_python_multiproc
 2022-03-02 14:26:09 +00:00
zx 93617ce91e [feat][assistant][I3J6VO] add new data operator KITTI 2022-03-02 19:29:17 +08:00
Cathy Wong b151f90b8d [MD] Add tests for Python Multiprocessing with AutoTune 2022-03-01 20:20:59 -05:00
markuskunej 6de37045ff Added TypeCast op in dataset offload. 2022-03-01 21:55:27 +00:00
wangjun 46612fabfb add st for shard 2022-03-01 15:32:37 +08:00
i-robot ad9757ccf0
!30661 [Auto parallel] [MoE] Fix an error of configuring MoE parallel 
Merge pull request !30661 from Xiaoda/124-moe-changes
 2022-03-01 02:26:37 +00:00
i-robot 789c1d6bd3
!30614 [AutoParallel] Fix Overflow As the cast is inserted before Mirror 
Merge pull request !30614 from huangxinjing/fix_cast_error
 2022-02-28 09:04:46 +00:00
Xiaoda Zhang 81e5abe580 fix an error of configuring parallel 2022-02-28 17:03:53 +08:00
i-robot a92c54b206
!30496 [Fallback] Suppport scipy module. 
Merge pull request !30496 from huangbingjian/support_scipy
 2022-02-28 08:33:34 +00:00
i-robot a8686ae3d9
!18827 [assistant][ops]New operator implementation, include LFWDataset 
Merge pull request !18827 from Wangsong95/lfw_dataset
 2022-02-28 08:31:11 +00:00
zx 2132f62d98 [feat][assistant][I3J6VQ] add new data operator LFW 2022-02-28 13:43:05 +08:00
huangxinjing 896daee845 [AutoParallel]Fix insert error for the mirror 2022-02-26 17:54:42 +08:00
yangzhenzhang 43e6e16da3 check platform for resizebilinear 2022-02-26 09:11:32 +08:00
i-robot 5deccfe64b
!30260 [MD][AutoTune] Re-enable AT for non-sink models 
Merge pull request !30260 from danishfarid/re-enable_AT
 2022-02-25 22:26:14 +00:00
i-robot 0341d96dd6
!30469 add shard function to support part of the graph executed in auto_parallel under pynative mode 
Merge pull request !30469 from wangjun/0223_pp
 2022-02-25 06:52:24 +00:00
huangbingjian a69d13bc44 [Fallback] Suppport scipy module. 2022-02-25 10:13:43 +08:00
i-robot cfe0f76d2b
!30491 ut for allgather fusion 
Merge pull request !30491 from jiahongQian/master
 2022-02-25 01:30:24 +00:00
danishfarid 6c4697fc8b reenable AT for non-sink 
tests re-enable

code check fix 1

remove self

lint fixing

lint fix 2

remove test as per req
 2022-02-25 00:02:58 +00:00
wangjun 24d448239c add pynative_parallel 2022-02-24 21:07:51 +08:00
i-robot 981eae461a
!30118 自动优化器并行特性 
Merge pull request !30118 from zhuyuxiao/I4S85V
 2022-02-24 11:09:44 +00:00
jiahongQian 25f57505bf ut for allgather fusion 2022-02-24 17:40:32 +08:00
i-robot bbcfbce9e0
!29997 [Auto parallel] [MoE] Support data_parallel + expert_parallel 
Merge pull request !29997 from Xiaoda/124-moe-changes
 2022-02-24 09:23:47 +00:00
zhuyuxiao d0e0e305d3 good 2022-02-24 16:10:18 +08:00
i-robot f2130e7434
!30483 [AutoParallel]Pipeline Automatic detection Opt 
Merge pull request !30483 from lichen/pipeline_opt_detection
 2022-02-24 03:40:15 +00:00
yao_yf e21f878e14 adasum ut fix 2022-02-24 09:31:04 +08:00
Xiaoda Zhang b714451937 implementing expert_parallel+data_parallel in MoE: 
1) extending _Linear's input as 4-dimension tensor: [outer_batch, expert_dim, -1, hidden], and _Liner's BatchMatMul becomes BatchMatMul(4_dim_tensor, 3_dim_tensor);
2) configuring the _Linear's BatchMatMul sharding strategy as [[dp, ep, 1, 1], [ep, 1, mp]];
3) introducing a new parameter 'expert_parallel' in TransformerOpParallelConfig, creating a new class MoEParallelConfig to include 'data_parallel', 'model_parallel' and 'expert_parallel';
4) changing parallel config for FeedForward, TransformerEncoderLayer, TransformerDecoderLayer.
 2022-02-24 09:24:27 +08:00
wangshengnan12@huawei.com acbefd80ea pipeline_opt_detection 2022-02-24 09:23:17 +08:00
i-robot 2a00ffd3b1
!30259 [MD]Update set_autotune_enable API to add save filepath 
Merge pull request !30259 from cathwong/ckw_at_save_api
 2022-02-24 01:00:59 +00:00