Commit Graph

3732 Commits

Author SHA1 Message Date
i-robot d4fc47ef0c
!31211 Clean iterators before forking
Merge pull request !31211 from h.farahat/pytest_problem
2022-03-15 01:47:28 +00:00
yangzhenzhang 1f98ffb79c adafactor parallel skip handle reshape 2022-03-15 09:18:19 +08:00
i-robot 6be7c42052
!31191 [MD] more tests for failover reset
Merge pull request !31191 from Mohammad Motallebi/failover_more_tests
2022-03-14 21:50:37 +00:00
h.farahat 318e6b8803 fix segfault 2022-03-14 14:55:21 -04:00
mohammad 583eb32723 [MD] Add more UT and a ST for failover reset 2022-03-14 13:52:09 -04:00
luoyang 74d8969b91 ut failed with pillow>=9.0.0, need more validation 2022-03-14 23:58:09 +08:00
i-robot dcb5cd670c
!30953 Dynamic Weight Decay
Merge pull request !30953 from wanyiming/dynamic_wd
2022-03-14 06:03:24 +00:00
lilei 690c58ebcf modify virtualdataset bug for master 2022-03-13 10:49:15 +08:00
i-robot 8b7d7a1e1a
!31141 [MD][Offload] Offload RandomSharpness Op Pure Sharpness Support & UT
Merge pull request !31141 from alashkari/fix-random-sharpness
2022-03-11 21:06:13 +00:00
Rescue face5e51a0 Added sharpness without randomness support and sharpnes op ut.
fix pad issue
2022-03-11 17:30:49 +00:00
i-robot 603ff25afb
!31177 Add ut for fallback python buildin function with tensor input
Merge pull request !31177 from LiangZhibo/syntax
2022-03-11 08:38:53 +00:00
i-robot 3c0e34ada0
!30855 Support user-defined classes by ms_class decorators
Merge pull request !30855 from huangbingjian/ms_class_dev
2022-03-11 08:37:12 +00:00
liangzhibo a3f183bdad Add test case for fallback buildin function with constant tensor 2022-03-11 15:35:29 +08:00
i-robot c2a5cc1486
!31040 Produce parallel operators for Argmin/max, SquareSumAll and UnsortedSegmentProd
Merge pull request !31040 from Bert0108/reduce_operators_arg
2022-03-11 06:15:56 +00:00
shenyu 443da2280d [FIX][BUG][MD][FUNC] RandomInvert 2022-03-11 11:53:04 +08:00
shenyu c14a8084c7 [FIX][BUG][MD][FUNC] RandomAuoContrast 2022-03-11 10:29:49 +08:00
i-robot a064d0855b
!30728 add ci test for unify backend
Merge pull request !30728 from xiaoyao/master
2022-03-11 01:50:03 +00:00
i-robot eecf6db426
!31121 [MD] revert OBSMindDataset
Merge pull request !31121 from liyong126/revert_OBSMindDataset
2022-03-11 01:21:10 +00:00
i-robot 216e7c6a92
!31041 add check for conv2d
Merge pull request !31041 from yangzhenzhang/add-check-for-conv2d
2022-03-11 01:20:52 +00:00
i-robot 67d10ce3be
!31066 Fix a bug where ROIAlign and CropAndResize distributed op do not support GPU
Merge pull request !31066 from liuluobin/fix_roialign
2022-03-11 01:16:46 +00:00
huangbingjian 4f7c9cb27f Support user-defined classes through ms_class decorators. 2022-03-10 20:12:54 +08:00
i-robot 99910ef27f
!31088 convert C++ data to python when run fallback function
Merge pull request !31088 from lianliguang/add-fallback-builtin-function
2022-03-10 11:56:01 +00:00
yangzhenzhang c00d29f223 rebase 2022-03-10 19:17:06 +08:00
liyong 50fc6f5736 Revert "!30810 [MD] add OBSMindDataset "
This reverts commit 9fcab9184e, reversing
changes made to afb33fff62.
2022-03-10 19:10:11 +08:00
liuluobin 8f045d02e3 Fix a bug where ROIAlign and CropAndResize distributed op do not support GPU 2022-03-10 17:31:36 +08:00
lianliguang d9390afad1 convert MS C++ dtype to MS python 2022-03-10 16:09:34 +08:00
xiao_yao1994 94df0869ad uni_backend: add ut ge test 2022-03-10 16:08:36 +08:00
Bert0108 bfc5e4345c add distributed operators for argmax/min sqauresumall and unsortedsetmentprod 2022-03-10 14:44:37 +08:00
liyong 10ada68fa9 add OBSMindDataset 2022-03-10 11:18:59 +08:00
i-robot 059ac45ae8
!30920 Call Draw function directly
Merge pull request !30920 from huanghui/fix-draw
2022-03-10 03:15:56 +00:00
wanyiming a124ec4de7 add dynamic_decay 2022-03-10 11:02:27 +08:00
i-robot b32daf3cb4
!31000 add fallback example of function
Merge pull request !31000 from lianliguang/add-fallback-builtin-function
2022-03-10 01:57:37 +00:00
i-robot 698b99aaa3
!18945 [assistant][ops]New operator implementation, include OmniglotDataset
Merge pull request !18945 from Wangsong95/omniglot_dataset
2022-03-09 06:51:15 +00:00
lianliguang f3b1e3291c add jit fallback example 2022-03-09 11:25:03 +08:00
qkeys ce7597f500 [feat][assistant][I3J6VB] add new data operator OmniglotDataset 2022-03-08 21:36:22 +08:00
i-robot 0b207fce31
!29735 unique support multi_dim tensor
Merge pull request !29735 from jiangzhenguang/unique_multi_tensor
2022-03-08 08:30:57 +00:00
i-robot f73987dcf2
!30949 Change the Parameter type name from 'ParameterTensor' to 'Parameter'
Merge pull request !30949 from 张清华/opt
2022-03-08 06:17:31 +00:00
jiangzhenguang 28f89f36b4 unique support multi-dim tensor 2022-03-08 14:09:19 +08:00
Zhang Qinghua 973008ebcf Change the Parameter type name from 'ParameterTensor' to 'Parameter' 2022-03-08 11:23:56 +08:00
i-robot 82bc2b722d
!30417 add history and lambda callbacks
Merge pull request !30417 from liutongtong9/add_callbacks
2022-03-08 02:17:46 +00:00
i-robot 75e1939f50
!30899 Enable python buildin function type for graph fallback and add some ut for python buildin function for graph fallback
Merge pull request !30899 from LiangZhibo/syntax
2022-03-08 01:35:47 +00:00
i-robot 2655d64720
!30865 [MD] Modify Batch number of workers with Python multiprocessing
Merge pull request !30865 from cathwong/ckw_batch_workers_pymultip
2022-03-07 18:21:16 +00:00
Cathy Wong bc29dd9d72 [MD] Modify Batch number of workers with Python multiprocessing 2022-03-07 10:39:05 -05:00
i-robot 335ef1c270
!30459 Add ut validate function for parallel
Merge pull request !30459 from liuluobin/ut_master
2022-03-07 15:23:14 +00:00
i-robot 4a9a65d2a6
!30919 Produce parallel operators for ReduceAll and ReduceProd
Merge pull request !30919 from Bert0108/reduce_operators_merge
2022-03-07 11:30:37 +00:00
liuluobin b797a410cc Add validate function for parallel ut 2022-03-07 16:19:52 +08:00
huanghui ce0f500a3f convert draw_ to call Draw function derectly 2022-03-07 16:12:52 +08:00
Bert0108 dfc92f1791 add distributed parallel operators for reduceall and reduceprod 2022-03-07 15:40:11 +08:00
liangzhibo 1a81031d92 Add testcases for fallback python buildin function 2022-03-07 14:20:24 +08:00
lianliguang 55e7f2d761 modify DynamicShape to TensorShape 2022-03-07 14:19:12 +08:00
i-robot a2303a92bd
!30741 [dataset][dfx] 易用性-Python多进程统一整改专项
Merge pull request !30741 from xiefangqi/md_add_multiprocessing_optimization
2022-03-07 01:29:21 +00:00
i-robot c4cc0e6f26
!30742 auto parallel support not ony power of 2 device numbers
Merge pull request !30742 from yao_yf/auto_parallel_support_not_only_2_power
2022-03-07 01:09:01 +00:00
yao_yf b60e54e0d5 support not only power of 2 2022-03-06 18:08:46 +08:00
xiefangqi 2de6c8908b add a clean up subprocess to clean subprocess when main process exit 2022-03-05 17:24:11 +08:00
liutongtong 7afcdfd211 add history and lambda callbacks 2022-03-04 17:24:57 +08:00
i-robot b90cf43562
!30553 Support dataset reset() to recover after failure
Merge pull request !30553 from h.farahat/reset
2022-03-04 02:19:45 +00:00
i-robot f01d841113
!27943 [MD][Autotune] Save/Load Autotune config
Merge pull request !27943 from harshvardhangupta/save_load_at_config
2022-03-03 20:42:23 +00:00
i-robot 7b26a32e98
!22608 [assistant][ops]New operator implementation, include KITTIDataset
Merge pull request !22608 from Wangsong95/kitti_dataset
2022-03-03 07:05:40 +00:00
h.farahat a3dec34833 Dataset failover reset 2022-03-02 23:53:56 -05:00
harshvardhangupta bd61adbb72 Implement save/load of autotune dataset pipeline configuration #27943 2022-03-02 15:08:08 -05:00
i-robot 70e61e9014
!30781 [MD] test_pyfunc_multiprocess_autotune.py - enable AutoTune
Merge pull request !30781 from cathwong/ckw_ut_fixup_map_python_multiproc
2022-03-02 19:50:29 +00:00
i-robot edcc6b790d
!30714 [MD][Offload] Add TypeCast op to offload
Merge pull request !30714 from markuskunej/offload_typecast
2022-03-02 19:48:58 +00:00
Cathy Wong eb931c7f88 [MD] test_pyfunc_multiprocess_autotune.py - enable AutoTune 2022-03-02 13:25:35 -05:00
i-robot 4aa82cc21e
!30679 [MD] Add tests for Python Multiprocessing with AutoTune
Merge pull request !30679 from cathwong/ckw_ut_map_python_multiproc
2022-03-02 14:26:09 +00:00
zx 93617ce91e [feat][assistant][I3J6VO] add new data operator KITTI 2022-03-02 19:29:17 +08:00
Cathy Wong b151f90b8d [MD] Add tests for Python Multiprocessing with AutoTune 2022-03-01 20:20:59 -05:00
markuskunej 6de37045ff Added TypeCast op in dataset offload. 2022-03-01 21:55:27 +00:00
wangjun 46612fabfb add st for shard 2022-03-01 15:32:37 +08:00
i-robot ad9757ccf0
!30661 [Auto parallel] [MoE] Fix an error of configuring MoE parallel
Merge pull request !30661 from Xiaoda/124-moe-changes
2022-03-01 02:26:37 +00:00
i-robot 789c1d6bd3
!30614 [AutoParallel] Fix Overflow As the cast is inserted before Mirror
Merge pull request !30614 from huangxinjing/fix_cast_error
2022-02-28 09:04:46 +00:00
Xiaoda Zhang 81e5abe580 fix an error of configuring parallel 2022-02-28 17:03:53 +08:00
i-robot a92c54b206
!30496 [Fallback] Suppport scipy module.
Merge pull request !30496 from huangbingjian/support_scipy
2022-02-28 08:33:34 +00:00
i-robot a8686ae3d9
!18827 [assistant][ops]New operator implementation, include LFWDataset
Merge pull request !18827 from Wangsong95/lfw_dataset
2022-02-28 08:31:11 +00:00
zx 2132f62d98 [feat][assistant][I3J6VQ] add new data operator LFW 2022-02-28 13:43:05 +08:00
huangxinjing 896daee845 [AutoParallel]Fix insert error for the mirror 2022-02-26 17:54:42 +08:00
yangzhenzhang 43e6e16da3 check platform for resizebilinear 2022-02-26 09:11:32 +08:00
i-robot 5deccfe64b
!30260 [MD][AutoTune] Re-enable AT for non-sink models
Merge pull request !30260 from danishfarid/re-enable_AT
2022-02-25 22:26:14 +00:00
i-robot 0341d96dd6
!30469 add shard function to support part of the graph executed in auto_parallel under pynative mode
Merge pull request !30469 from wangjun/0223_pp
2022-02-25 06:52:24 +00:00
huangbingjian a69d13bc44 [Fallback] Suppport scipy module. 2022-02-25 10:13:43 +08:00
i-robot cfe0f76d2b
!30491 ut for allgather fusion
Merge pull request !30491 from jiahongQian/master
2022-02-25 01:30:24 +00:00
danishfarid 6c4697fc8b reenable AT for non-sink
tests re-enable

code check fix 1

remove self

lint fixing

lint fix 2

remove test as per req
2022-02-25 00:02:58 +00:00
wangjun 24d448239c add pynative_parallel 2022-02-24 21:07:51 +08:00
i-robot 981eae461a
!30118 自动优化器并行特性
Merge pull request !30118 from zhuyuxiao/I4S85V
2022-02-24 11:09:44 +00:00
jiahongQian 25f57505bf ut for allgather fusion 2022-02-24 17:40:32 +08:00
i-robot bbcfbce9e0
!29997 [Auto parallel] [MoE] Support data_parallel + expert_parallel
Merge pull request !29997 from Xiaoda/124-moe-changes
2022-02-24 09:23:47 +00:00
zhuyuxiao d0e0e305d3 good 2022-02-24 16:10:18 +08:00
i-robot f2130e7434
!30483 [AutoParallel]Pipeline Automatic detection Opt
Merge pull request !30483 from lichen/pipeline_opt_detection
2022-02-24 03:40:15 +00:00
yao_yf e21f878e14 adasum ut fix 2022-02-24 09:31:04 +08:00
Xiaoda Zhang b714451937 implementing expert_parallel+data_parallel in MoE:
1) extending _Linear's input as 4-dimension tensor: [outer_batch, expert_dim, -1, hidden], and _Liner's BatchMatMul becomes BatchMatMul(4_dim_tensor, 3_dim_tensor);
2) configuring the _Linear's BatchMatMul sharding strategy as [[dp, ep, 1, 1], [ep, 1, mp]];
3) introducing a new parameter 'expert_parallel' in TransformerOpParallelConfig, creating a new class MoEParallelConfig to include 'data_parallel', 'model_parallel' and 'expert_parallel';
4) changing parallel config for FeedForward, TransformerEncoderLayer, TransformerDecoderLayer.
2022-02-24 09:24:27 +08:00
wangshengnan12@huawei.com acbefd80ea pipeline_opt_detection 2022-02-24 09:23:17 +08:00
i-robot 2a00ffd3b1
!30259 [MD]Update set_autotune_enable API to add save filepath
Merge pull request !30259 from cathwong/ckw_at_save_api
2022-02-24 01:00:59 +00:00
Cathy Wong 46e223e569 [MD] Update set_autotune_enable API to add save filepath 2022-02-23 14:50:55 -05:00
i-robot 81260a2319
!30466 takedown test_auto_parallel_adasum.py to ensure stability, again
Merge pull request !30466 from yanghaoran/master
2022-02-23 09:15:58 +00:00
i-robot 14393503b7
!30431 allreduce allgather fusion
Merge pull request !30431 from jiahongQian/master
2022-02-23 08:52:40 +00:00
yanghaoran 71d6b7d506 takedown test_auto_parallel_adasum.py to ensure stability, again 2022-02-23 16:42:13 +08:00
i-robot 2e8eac8341
!30367 auto_parallel_adasum_support_data_parallel
Merge pull request !30367 from yao_yf/auto_parallel_adasum_support_data_parallel
2022-02-23 06:50:26 +00:00
jiahongQian 8a2151d8bb allgather reducescatter fusion 2022-02-23 10:47:30 +08:00
i-robot eeb731ae3e
!18738 [assistant][ops]New operator implementation, include LSUNDataset
Merge pull request !18738 from Wangsong95/lsun_dataset
2022-02-23 02:28:40 +00:00
i-robot 5bee7156b9
!30369 add_virtualdataset_ut
Merge pull request !30369 from lilei/add_virtualdataset_ut
2022-02-23 02:21:34 +00:00
i-robot 0f24b679ec
!29819 Add GlobalNorm Search
Merge pull request !29819 from huangxinjing/add_global_norm_search
2022-02-23 01:15:08 +00:00
i-robot abb89d3f06
!29705 [MD][Offload] Support Multi-Column Datasets and Map Column Names to Index
Merge pull request !29705 from markuskunej/offload_multi_col_ds
2022-02-22 22:48:38 +00:00
i-robot 6edc6fccee
!30189 Optimize error message while outmost network input is wrong
Merge pull request !30189 from zhangzhaoju/master_outmost
2022-02-22 13:05:23 +00:00
yao_yf 19236b1a70 auto parallel adasum support data parallel and hybrid parallel 2022-02-22 20:14:00 +08:00
huangxinjing 092ba035e3 Add global norm parallel support 2022-02-22 16:08:53 +08:00
liyong 3e1c668247 fix mnist dataset 2022-02-22 15:25:13 +08:00
yanghaoran bfe139b662 takedonw test_auto_parallel_adasum.py to ensure gate stability 2022-02-22 14:51:03 +08:00
lilei bc62e24d94 add_virtualdataset_ut 2022-02-22 11:38:10 +08:00
i-robot ce5e93593d
!30301 modify error log
Merge pull request !30301 from lianliguang/change-error-log
2022-02-22 02:29:48 +00:00
i-robot 94c8c6355c
!30294 auto_parallel_adasum_checks_and_ut.
Merge pull request !30294 from yao_yf/auto_parallel_adasum_checks_and_ut
2022-02-22 01:10:24 +00:00
i-robot 926fb6f5ae
!25559 [feat] [assistant] [I48O7X, I48O6R] Add Asin, AsinGrad
Merge pull request !25559 from 桂宁馨/Asin
2022-02-21 14:00:58 +00:00
zhangzhaoju e000889265 Fix issue I4KVTZ
The description of "outmost network" in error message instead by
method/function name
2022-02-21 19:52:53 +08:00
i-robot 95f5075371
!30190 [AUTO_PARALLEL]Fix CI error
Merge pull request !30190 from huangxinjing/fix_ci_error
2022-02-21 11:50:28 +00:00
lianliguang efabace125 change error log 2022-02-21 17:48:16 +08:00
i-robot 908beb6b2f
!26420 [feat] [assistant] [I48O90, I48O4P] Add AsinhGrad,Asinh
Merge pull request !26420 from 桂宁馨/Asinh
2022-02-21 09:33:18 +00:00
i-robot f6215c614c
!30064 modify ckpt type error
Merge pull request !30064 from changzherui/mod_ckpt_type_err
2022-02-21 08:59:00 +00:00
huangxinjing 5e325ac336 [AUTO_PARALLEL]Fix insert nodes error 2022-02-21 16:39:50 +08:00
i-robot a5242d33e1
!30181 support TensorShape ops
Merge pull request !30181 from lianliguang/change-dynshape-to-tensorshape
2022-02-21 07:36:40 +00:00
i-robot 7386612515
!29820 moe_topk routing
Merge pull request !29820 from wangshengnan123/moe_topk_routing
2022-02-21 06:21:55 +00:00
yao_yf 4b79d4c425 auto parallel adasum uts and checks 2022-02-21 10:41:09 +08:00
lianliguang 5c8af66e53 support TensorShape ops to instead of DynamicShape ops 2022-02-21 09:33:32 +08:00
markuskunej 87a45b239b Add offload support for multi-column datasets and map offload operations
to specific columns.
2022-02-18 20:09:49 +00:00
zhixinaa 4ce6104ff9 [feat][assistant][I3J6V9] add new data operator LSUN 2022-02-18 15:40:32 +08:00
桂宁馨 caf54a52f0 [feat] [assistant] [I48O90, I48O4P] Add Asinh, AsinhGrad 2022-02-18 15:08:55 +08:00
桂宁馨 911c6eb144 [feat] [assistant] [I48O7X, I48O6R] Add Asin, AsinGrad 2022-02-18 14:11:41 +08:00
wangshengnan123 7322426648 top_k routing 2022-02-18 14:10:22 +08:00
changzherui 05dca07cf6 modify ckpt type error 2022-02-18 00:42:55 +08:00
i-robot 48d4f34576
!30167 Add UT case for 'Convolution+Transformer' structure
Merge pull request !30167 from Bert0108/ut_conformer
2022-02-17 07:43:58 +00:00
i-robot 7c32002e0b
!29930 Support List Slice
Merge pull request !29930 from lianliguang/support-list-slice
2022-02-17 07:24:40 +00:00
Bert0108 25a9c73a08 add ut case for monitoring the conformer structure 2022-02-17 15:08:01 +08:00
i-robot 465f21a3ea
!30133 Add backend check for RandomChoiceWithMask
Merge pull request !30133 from liuluobin/rnd_fix_master
2022-02-17 02:11:54 +00:00
lianliguang 49608835c1 support list slice 2022-02-17 09:47:26 +08:00
i-robot c4c5a1c6da
!29862 MD Autotune supporting MindRecordOp
Merge pull request !29862 from Mohammad Motallebi/autotune_addworker_mindrecord
2022-02-16 23:34:11 +00:00
mohammad ddd3b07648 MD autotune supports mindrecord 2022-02-16 14:00:31 -05:00
liuluobin b0b79ef8fb Add backend check for RandomChoiceWithMask 2022-02-16 18:56:57 +08:00
i-robot 1ceecd9f58
!24412 [assistant][ops] Add LogicalXor
Merge pull request !24412 from 李定维/LogicalXor
2022-02-16 06:21:39 +00:00
i-robot 7d356fbee8
!30088 [MD] Disable shared memory in Python Multiprocessing UTs for CI
Merge pull request !30088 from cathwong/ckw_ut_fixup_python_multiproc
2022-02-15 21:36:34 +00:00
Cathy Wong 6c5dbf937f [MD] Disable shared memory in Python Multiprocessing UTs for CI 2022-02-15 11:00:44 -05:00
i-robot d5100190c9
!29612 Impementatin of CropAndResizeInfo and ROIAlignInfo.
Merge pull request !29612 from liuluobin/crop_resize_master
2022-02-15 11:36:06 +00:00
lvxinyu 28a08b3cf6 LogicalXor 2022-02-15 13:31:49 +08:00
i-robot c45e8b5c9b
!29797 [MD]Enhance Python Multiprocessing test coverage
Merge pull request !29797 from cathwong/ckw_ut_python_multiproc
2022-02-14 18:41:22 +00:00
liuluobin 80fd640819 Implementation of ROIAlignInfo and CropAndResizeInfo 2022-02-14 10:46:09 +08:00
Margaret_wangrui 462c38813d [ME] Add parameter name check. 2022-02-14 10:07:43 +08:00
Cathy Wong befe8f4837 [MD]Enhance Python Multiprocessing test coverage 2022-02-11 12:31:21 -05:00
i-robot 81bcff32ad
!29825 support pad mode for conv2d_transpose
Merge pull request !29825 from yangzhenzhang/support-pad-mode-for-conv2d-transpose
2022-02-11 01:34:30 +00:00
i-robot 5858a06689
!29700 [MD] Tidy up UT and device queue info messages
Merge pull request !29700 from cathwong/ckw_device_queue_probes
2022-02-09 12:47:27 +00:00
yangzhenzhang 4061c11e18 support pad mode for conv2d transpose 2022-02-09 11:52:47 +08:00
Cathy Wong fb469f1ad2 [MD] Tidy up UT and device queue info messages 2022-02-08 17:51:11 -05:00
许志杰 ab9a32ad0d [feat] [assistant] [#I40GYE] add new loader SQuADDataset 2022-02-08 03:00:09 -08:00
i-robot f17b96ac68
!29719 fix vocab validation
Merge pull request !29719 from luoyang/fix_vocab
2022-02-08 01:10:56 +00:00
luoyang c248274d91 fix vocab validation 2022-02-07 15:55:59 +08:00
i-robot a55b1b5e05
!29453 support pad mode for conv2d parallel operator
Merge pull request !29453 from yangzhenzhang/support-pad-mode-for-conv2d
2022-02-07 06:58:00 +00:00
i-robot e1c2c4c268
!29699 Fix duplicate wp hit bug in offline debugger
Merge pull request !29699 from TinaMengtingZhang/bugfix_dbg
2022-02-01 21:43:24 +00:00
i-robot a1b5f06407
!29535 [MD] Profiler Memory Tooling Support
Merge pull request !29535 from cathwong/ckw_memory_tool
2022-02-01 21:39:05 +00:00
TinaMengtingZhang 23eb886d11 bugfix: duplicate wp hit results in offline dbg 2022-02-01 11:58:42 -05:00
Cathy Wong 3fe9a05341 [MD] Profiler Memory Tool Support 2022-01-31 17:46:17 -05:00
i-robot e12d6af257
!29358 MD Child Sampler Code and UT Issues
Merge pull request !29358 from zetongzhao/sampler_AddChild
2022-01-31 16:55:22 +00:00
zetongzhao ea9783e18c fix sampler add_child 2022-01-31 07:45:42 -05:00
i-robot 48f4fd2f52
!29639 build core.so
Merge pull request !29639 from zhoufeng/dynamic-core
2022-01-30 02:00:21 +00:00
i-robot 02d63d7ad9
!23008 [assistant][ops][FilterWikipediaXML]
Merge pull request !23008 from Isaac/FilterWikipediaXML
2022-01-29 08:35:29 +00:00
i-robot ea391f6eb1
!29505 Fix AllGather Cast when the parameters are shared
Merge pull request !29505 from huangxinjing/fx_allgather_cast
2022-01-29 07:46:10 +00:00
i-robot f5392f2460
!22443 [assistant][ops] Add new data operator MaskAlongAxis
Merge pull request !22443 from TR-nbu/MaskAlongAxis
2022-01-29 07:19:20 +00:00
zhoufeng 8e97ce5cd2 build core.so
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2022-01-29 14:11:02 +08:00
tophand 797cd52c96 [feat][assistant][I40GXK]add new data operator Filter_Wikipedia_XML 2022-01-28 02:26:20 -08:00
QRICK 52c73ff1b3 [assistant][ops][I3T96S] Add new data operator MaskAlongAxis 2022-01-28 14:53:38 +08:00
i-robot 47a4860043
!27184 [assistant][ops]Add Cummax
Merge pull request !27184 from 陈钧/cummax
2022-01-28 06:40:25 +00:00
i-robot 92c59c3401
!25289 [assistant][ops] Add Coalesce
Merge pull request !25289 from 李定维/Coalesce
2022-01-27 12:31:30 +00:00
i-robot a24709b46a
!22446 [assistant][ops] Add new data operator MaskAlongAxisIID
Merge pull request !22446 from TR-nbu/MaskAlongAxisIID
2022-01-27 08:45:24 +00:00
王泰格 cc8d3e6279 [assistant][ops][I40FKE] add operator Coalesce 2022-01-27 16:08:31 +08:00
QRICK 9ed73eae94 [assistant][ops][I3T96P] Add new data operator MaskAlongAxisIID 2022-01-27 12:20:26 +08:00
chen-jun0211 5343a83f79 Add Cummax 2022-01-27 10:53:51 +08:00
i-robot 4861e9abab
!24098 [assistant][ops] Add UpperBound
Merge pull request !24098 from 王刚克/UpperBound
2022-01-26 10:46:26 +00:00
i-robot 2b82ba1e49
!26244 [assistant][ops] Add new data PhaseVocoder
Merge pull request !26244 from TR-nbu/PhaseVocoder
2022-01-26 06:46:36 +00:00
i-robot b0b3d7ede7
!29421 Implementation of BoundingBoxEncodeInfo, IOUInfo and RandomChoickWithMaskInfo
Merge pull request !29421 from liuluobin/parallel_ops_master
2022-01-26 06:40:32 +00:00
i-robot 6fac9c5d1d
!28505 Change SparseTensor to COOTensor
Merge pull request !28505 from wangrao124/COOTensor
2022-01-26 06:22:28 +00:00
i-robot 55ba926a04
!29087 optimize sharding propagation&add ut on pangu
Merge pull request !29087 from bichaoyang/master
2022-01-25 11:59:25 +00:00
huangxinjing 34101d748d Add cast ut and fix juge condition 2022-01-25 18:14:11 +08:00
yangzhenzhang 6df5e9aa5d support pad mode for conv2d 2022-01-25 17:26:47 +08:00
liuluobin fb79c508f2 Implementation of BoundingBoxEncodeInfo, IOUInfo, RandomChoiceWithMaskInfo. 2022-01-25 15:49:48 +08:00
wang-gangke e912bc8a24 UpperBound 2022-01-25 15:45:33 +08:00
wangrao124 9dfc703f7a change sparsetensor to cootensor 2022-01-25 15:39:37 +08:00
b00518648 2ff3425c76 1.consider comm cost inside a op when select a strategy;2.deal with the ops that share same param;3.add ut to fix the perfermence at pangu_alpha 2022-01-25 15:05:37 +08:00
i-robot bff5afe2bb
!25078 [assistant][ops] Add Cross
Merge pull request !25078 from 冯钰/cross
2022-01-25 02:16:41 +00:00
donrichnx eee07047a0 [feat] [assistant] [I40GYJ] add Captioning task of CocoDataset 2022-01-24 17:24:16 +08:00
minatofy 7832d77718 cross 2022-01-24 17:09:36 +08:00
QRICK 859f90cb85 [assistant][ops][I3T96R] Add new data operator PhaseVocoder 2022-01-24 16:00:24 +08:00
i-robot 8284a5590d
!29427 clean code
Merge pull request !29427 from huangbingjian/clean_code
2022-01-24 01:35:29 +00:00
i-robot 85ac17a8c6
!22736 [assistant][ops] Add new dataset operator LibriTTSDataset
Merge pull request !22736 from TR-nbu/LibriTTSDataset
2022-01-22 10:03:40 +00:00
i-robot ee8fba498a
!29376 support config allreduce group size for batch norm
Merge pull request !29376 from yangzhenzhang/support-config-group-for-batchnorm
2022-01-22 06:20:20 +00:00
huangbingjian c36a85e00d clean code 2022-01-22 11:39:12 +08:00
i-robot fe2a557901
!23919 [assistant][ops] Add HSVToRGB
Merge pull request !23919 from 苏家毅/HSVToRGB
2022-01-22 02:11:13 +00:00
yangzhenzhang 4d0b1a47ee support config group for batchnorm 2022-01-22 09:29:52 +08:00
davilsu af1333e1cc HSVToRGB 2022-01-21 20:57:30 +08:00
i-robot 690a660919
!17918 [assistant][MelScale]
Merge pull request !17918 from QingfengLi/MelScale
2022-01-21 09:52:56 +00:00
ZJM 8d339ccfea [assistant][ops][22736] Add new dataset operator LibriTTSDataset 2022-01-21 17:34:42 +08:00
i-robot b1213abe7d
!23937 [assistant][ops]Add GridSampler3D and GridSampler3DGrad
Merge pull request !23937 from 梁天凯/GridSampler3D
2022-01-21 07:09:17 +00:00
chenx2ovo bbba4fb940 [feat][assistant][I3CEG0] add op melscale 2022-01-21 11:30:34 +08:00
i-robot 4d81f9737f
!29324 support dilation for conv2d
Merge pull request !29324 from yangzhenzhang/support-dilation-for-conv2d
2022-01-21 02:57:15 +00:00
bubtltk f5ffb282ee Add GridSampler3D and GridSampler3DGrad 2022-01-20 22:23:30 +08:00
yangzhenzhang 000c5b5394 support dilation for conv2d 2022-01-20 19:04:52 +08:00
ZJM fff47f3886 [assistant][ops][I3T96T] Add new dataset operator CMUArcticDataset 2022-01-20 17:40:35 +08:00