Commit Graph

8027 Commits

Author SHA1 Message Date
changzherui 05dca07cf6 modify ckpt type error 2022-02-18 00:42:55 +08:00
i-robot e9b4b4ae61
!29555 Custom Op Inplace Assign
Merge pull request !29555 from jiaoy1224/customop
2022-02-17 11:21:27 +00:00
i-robot 0efb23fd96
!30121 Optimize eigh ops, backend suppor t 1/2 output,
Merge pull request !30121 from wuwenbing/master
2022-02-17 09:24:01 +00:00
jinjiali cd7db0f57f package the cuda operations as a dynamic link library 2022-02-17 16:51:45 +08:00
i-robot 48d4f34576
!30167 Add UT case for 'Convolution+Transformer' structure
Merge pull request !30167 from Bert0108/ut_conformer
2022-02-17 07:43:58 +00:00
i-robot 7c32002e0b
!29930 Support List Slice
Merge pull request !29930 from lianliguang/support-list-slice
2022-02-17 07:24:40 +00:00
Bert0108 25a9c73a08 add ut case for monitoring the conformer structure 2022-02-17 15:08:01 +08:00
wenbean ba3b65b9af Optimize eigh, backend support 1 or 2 output for GPU/CPU 2022-02-17 10:45:00 +08:00
i-robot 2decc54375
!30016 Add distributed meta store module
Merge pull request !30016 from ZPaC/metadata-store-module
2022-02-17 02:13:30 +00:00
i-robot 465f21a3ea
!30133 Add backend check for RandomChoiceWithMask
Merge pull request !30133 from liuluobin/rnd_fix_master
2022-02-17 02:11:54 +00:00
lianliguang 49608835c1 support list slice 2022-02-17 09:47:26 +08:00
i-robot c4c5a1c6da
!29862 MD Autotune supporting MindRecordOp
Merge pull request !29862 from Mohammad Motallebi/autotune_addworker_mindrecord
2022-02-16 23:34:11 +00:00
mohammad ddd3b07648 MD autotune supports mindrecord 2022-02-16 14:00:31 -05:00
ZPaC 191b65b236 Add distributed meta store module 2022-02-16 20:25:20 +08:00
liuluobin b0b79ef8fb Add backend check for RandomChoiceWithMask 2022-02-16 18:56:57 +08:00
i-robot c3af0e2543
!30117 julia testcase only support linux now
Merge pull request !30117 from r1chardf1d0/master
2022-02-16 09:41:32 +00:00
Yang Jiao b35cedeb62 hybrid inplace assign 2022-02-16 16:25:16 +08:00
i-robot 9d1839119d
!30095 Remove CholeskySolve and replace it by using solve_triangular
Merge pull request !30095 from zhuzhongrui/pub_master3
2022-02-16 08:10:56 +00:00
r1chardf1d0 aef9e0841c julia test only support linux now 2022-02-16 15:08:40 +08:00
i-robot 1ceecd9f58
!24412 [assistant][ops] Add LogicalXor
Merge pull request !24412 from 李定维/LogicalXor
2022-02-16 06:21:39 +00:00
z00512249 f066e36fe4 Remove CholeskySolve and replace it by using solve_triangular 2022-02-16 14:08:55 +08:00
i-robot 3b84ba1f1d
!29940 [GraphKernel] decouple convert_const_input_to_attr.
Merge pull request !29940 from chenlei_autodiff/gk_lite
2022-02-16 03:30:38 +00:00
i-robot 5b86aa48ee
!30090 Fix statistic dump in kernel by kernel mode
Merge pull request !30090 from TinaMengtingZhang/kernel_by_kernel_stat_dump
2022-02-16 03:20:56 +00:00
TinaMengtingZhang e576292862 dump statistic file in kernel by kernel mode 2022-02-15 16:58:00 -05:00
i-robot 7d356fbee8
!30088 [MD] Disable shared memory in Python Multiprocessing UTs for CI
Merge pull request !30088 from cathwong/ckw_ut_fixup_python_multiproc
2022-02-15 21:36:34 +00:00
Cathy Wong 6c5dbf937f [MD] Disable shared memory in Python Multiprocessing UTs for CI 2022-02-15 11:00:44 -05:00
i-robot d5100190c9
!29612 Impementatin of CropAndResizeInfo and ROIAlignInfo.
Merge pull request !29612 from liuluobin/crop_resize_master
2022-02-15 11:36:06 +00:00
i-robot 27e6f6d791
!30056 relax ps acc
Merge pull request !30056 from ZPaC/relax-ps-acc
2022-02-15 08:15:57 +00:00
i-robot 63069d2217
!29950 fix exception info of dtype
Merge pull request !29950 from wangrao124/pr_0211
2022-02-15 07:25:00 +00:00
i-robot 1168b59baa
!29917 add julia custom op error log
Merge pull request !29917 from r1chardf1d0/master
2022-02-15 07:13:11 +00:00
i-robot e57633ec7f
!30027 Fix tensor with dynamic shape problem
Merge pull request !30027 from hewei/fix_core
2022-02-15 06:26:51 +00:00
lvxinyu 28a08b3cf6 LogicalXor 2022-02-15 13:31:49 +08:00
ZPaC 49a7147696 relax ps acc 2022-02-15 11:59:53 +08:00
chenlei_autodiff 5df9f01310 [GraphKernel] decouple convert_const_input_to_attr. 2022-02-15 10:27:34 +08:00
r1chardf1d0 6074fa8aae add julia error log 2022-02-15 09:50:16 +08:00
i-robot a8c9db15ea
!30009 Add MakeValue related functions in MindAPI
Merge pull request !30009 from hewei/core_api
2022-02-15 01:15:40 +00:00
He Wei 36ab9c3d4b Fix tensor with dynamic shape problem
Set data size to zero for tensor with dynamic shape,
prevent unexpected memory allocation for tensor data.
2022-02-15 09:11:36 +08:00
i-robot c45e8b5c9b
!29797 [MD]Enhance Python Multiprocessing test coverage
Merge pull request !29797 from cathwong/ckw_ut_python_multiproc
2022-02-14 18:41:22 +00:00
i-robot 7e6f3dec6d
!29987 Change sequence node insert fail log level.
Merge pull request !29987 from 张清华/eliminate_tuple_unused_item
2022-02-14 11:15:07 +00:00
i-robot 705134e01a
!29609 update tensorarray stack for static size
Merge pull request !29609 from VectorSL/static_tensorarray_stack
2022-02-14 09:19:20 +00:00
wangrao124 234b80a8d6 fix exception info of dtype 2022-02-14 17:05:33 +08:00
i-robot 8d3584675e
!29979 thor test modify
Merge pull request !29979 from melody/master
2022-02-14 07:54:45 +00:00
LaiYongqiang dcd83c5275 construct cache dir with rank_id directly 2022-02-14 15:39:53 +08:00
He Wei 656b89a4da Add MakeValue related functions in MindAPI
1. NewValueNode() by PrimitivePtr;
2. MakeValue() by vector<bool>.
2022-02-14 15:08:43 +08:00
i-robot 2a3957e598
!29822 [ME] Add parameter name check.
Merge pull request !29822 from Margaret_wangrui/param_name
2022-02-14 06:14:55 +00:00
i-robot 449f52012e
!28406 Add compile cache support for ms_function
Merge pull request !28406 from YuJianfeng/compile_cache1
2022-02-14 06:14:11 +00:00
cmy_melody caf0e74545 thor_test
thor_test

test thor

thor test

modify thor
2022-02-14 11:56:49 +08:00
yujianfeng caac1e326a Add compile cache support for ms_function 2022-02-14 11:06:59 +08:00
liuluobin 80fd640819 Implementation of ROIAlignInfo and CropAndResizeInfo 2022-02-14 10:46:09 +08:00
Zhang Qinghua 07d8b59b0b Change sequence node insert fail log level. 2022-02-14 10:23:36 +08:00
i-robot 18350a7443
!29973 The `solve_triangular` API fallback.
Merge pull request !29973 from zhujingxuan/master
2022-02-14 02:15:01 +00:00
Margaret_wangrui 462c38813d [ME] Add parameter name check. 2022-02-14 10:07:43 +08:00
VectorSL 8b45b00f7c update tensorarry stack for static usage 2022-02-14 09:14:35 +08:00
marui d47e79b04c Refactor ccsrc directories and CMakeLists files 2022-02-13 14:37:51 +08:00
zhujingxuan e30847cac0 The `solve_triangular` API fallback.
Now only the `SolveTriangular` op supports batch computation, the `solve_triangular` API only accept 2D matrix input.
2022-02-12 18:10:29 +08:00
Cathy Wong befe8f4837 [MD]Enhance Python Multiprocessing test coverage 2022-02-11 12:31:21 -05:00
i-robot 5b360e39fb
!29912 Fix a logging api bug in MindAPI
Merge pull request !29912 from hewei/core_api
2022-02-11 07:55:30 +00:00
i-robot fe74be4830
!29701 Support dump parameters using origin_parameter_order, fix DumpConstantData issue and refactor debugger mindRT code
Merge pull request !29701 from parastooashtari/kernel_level_dump
2022-02-11 07:49:30 +00:00
i-robot f97f16dfb0
!29711 return Tensor value for AbstractRef when infer EnvironGet primitive
Merge pull request !29711 from xychow/return-dflt-when-infer-environ-get
2022-02-11 05:09:42 +00:00
i-robot 81bcff32ad
!29825 support pad mode for conv2d_transpose
Merge pull request !29825 from yangzhenzhang/support-pad-mode-for-conv2d-transpose
2022-02-11 01:34:30 +00:00
zhousiyi 6248262449 return Tensor value for AbstractRef when infer EnvironGet primitive as
Value type.
2022-02-11 01:18:10 +00:00
He Wei 93328bc707 Fix a logging api bug in MindAPI 2022-02-11 08:42:04 +08:00
Parastoo Ashtari f6bebc7d97 use origin_parameter_order to load and dump params mindRT
Refactor mindRT code
Fix DumpConstantData issue
2022-02-10 14:18:08 -05:00
zhujingxuan 933f99f917 batch support for solve_triangular
Add batch support for solve_triangular and the corresponding test cases
2022-02-10 17:34:46 +08:00
i-robot 4a0ff61efa
!29881 takedown test_hccl_allreduce due to probalistic failure
Merge pull request !29881 from yanghaoran/master
2022-02-10 08:02:24 +00:00
i-robot a42bc503f0
!29764 Add more required apis in MindAPI
Merge pull request !29764 from hewei/core_api
2022-02-10 07:55:37 +00:00
i-robot 7b6f7c9c87
!29786 Add TCP client and TCP server for RPC
Merge pull request !29786 from chengang/add_tcp_server
2022-02-10 07:47:12 +00:00
yanghaoran adc36b00c3 takedown test_hccl_allreduce.py due to probalistic failure 2022-02-10 15:41:06 +08:00
i-robot d786e0e5a3
!29868 Skip onednn dfx testcase on mac and windows
Merge pull request !29868 from zuochuanyong/onednn_dfx_testcase
2022-02-10 06:29:53 +00:00
He Wei 21a9a0a73a Add more required apis in MindAPI
1. AbstractBase::set_shape();
2. Move shape() from AbstractTensor to AbstractBase;
3. AbstractSequence construct from AbstractBasePtrList;
4. Shape construct from ShapeVector.
2022-02-10 11:19:01 +08:00
zuochuanyong 9aa370ddda onednn dfx testcase skip win and mac 2022-02-10 11:07:43 +08:00
i-robot e03d1bfb82
!27854 Enable hypermap to use tuple/list as input
Merge pull request !27854 from LiangZhibo/hypermap
2022-02-10 03:07:02 +00:00
cristoval c44d7b9100 add tcp client and tcp server 2022-02-10 09:50:40 +08:00
i-robot 5858a06689
!29700 [MD] Tidy up UT and device queue info messages
Merge pull request !29700 from cathwong/ckw_device_queue_probes
2022-02-09 12:47:27 +00:00
i-robot d0877dda3c
!29838 add gpu cholesky_grad st case
Merge pull request !29838 from zhuzhongrui/pub_master2
2022-02-09 10:02:25 +00:00
i-robot 07823a918f
!29813 PyNative 8P performance
Merge pull request !29813 from caifubi/master-pynative-perfmance-testcase
2022-02-09 09:36:12 +00:00
i-robot f3b2886096
!29680 Refine CPU thread and blocknumber to automatic calucate
Merge pull request !29680 from wuwenbing/master
2022-02-09 08:40:35 +00:00
z00512249 1e5d22a7fa add gpu cholesky_grad st case 2022-02-09 16:36:16 +08:00
i-robot 834877027b
!29687 add ascend aicpu env ops
Merge pull request !29687 from laiyongqiang/env_ops_commit
2022-02-09 06:26:16 +00:00
yangzhenzhang 4061c11e18 support pad mode for conv2d transpose 2022-02-09 11:52:47 +08:00
caifubi 37836f61f6 Fix ci pynative testcase failure 2022-02-09 11:24:02 +08:00
i-robot cd4194e80f
!22777 [assistant][ops] Add new loader SQuADDataset
Merge pull request !22777 from 杨旭华/SQuADDataset
2022-02-09 02:44:33 +00:00
i-robot 6396c079f9
!29766 fix linalg type check
Merge pull request !29766 from zhuzhongrui/pub_master2
2022-02-09 02:25:55 +00:00
l00591931 cd476c69e7 Enable hypermap to use tuple as input 2022-02-09 10:25:17 +08:00
wenbean 224feb8c45 Refine lambda to name function, optmize py ops, add validate 2022-02-09 09:19:53 +08:00
Cathy Wong fb469f1ad2 [MD] Tidy up UT and device queue info messages 2022-02-08 17:51:11 -05:00
i-robot bc693e14c5
!29737 Opt Eig operator to support batch shape.
Merge pull request !29737 from hezhenhao1/fix_eig
2022-02-08 11:45:17 +00:00
许志杰 ab9a32ad0d [feat] [assistant] [#I40GYE] add new loader SQuADDataset 2022-02-08 03:00:09 -08:00
i-robot 9d8cb9162a
!29725 Parse kernel level by kernel graph.
Merge pull request !29725 from gaoyong10/runtime_second12
2022-02-08 09:43:06 +00:00
z00512249 9390d67adf fix linalg type check 2022-02-08 17:14:02 +08:00
hezhenhao1 ace447279e Opt Eig operator to support batch shape. 2022-02-08 16:00:27 +08:00
i-robot 6573bdd809
!29750 add GRU support info and fix RNN ut
Merge pull request !29750 from 吕昱峰(Nate.River)/master
2022-02-08 07:22:44 +00:00
i-robot 41d634e995
!29727 update op info config file for serving
Merge pull request !29727 from laiyongqiang/tensor_move_config
2022-02-08 06:32:01 +00:00
LaiYongqiang 6099c54ca1 add ascend aicpu env ops 2022-02-08 12:51:00 +08:00
LaiYongqiang 374f6dfa31 update op info config file for serving 2022-02-08 12:47:54 +08:00
lvyufeng 69944cbbe9 add GRU support info and fix RNN ut 2022-02-08 10:22:35 +08:00
gaoyong10 7633f93a07 Parse kernel level by kernel graph. 2022-02-08 09:38:18 +08:00
i-robot f17b96ac68
!29719 fix vocab validation
Merge pull request !29719 from luoyang/fix_vocab
2022-02-08 01:10:56 +00:00
i-robot 26d54856f7
!29720 refine eigh API exception
Merge pull request !29720 from zhujingxuan/master
2022-02-07 09:33:53 +00:00
zhujingxuan aec3357a03 refine eigh API exception
Make sure msp.linalg.eigh throw exceptions when given wrong parameter and behaves the same between GPU and CPU.
2022-02-07 16:12:20 +08:00
luoyang c248274d91 fix vocab validation 2022-02-07 15:55:59 +08:00
i-robot a55b1b5e05
!29453 support pad mode for conv2d parallel operator
Merge pull request !29453 from yangzhenzhang/support-pad-mode-for-conv2d
2022-02-07 06:58:00 +00:00
i-robot fb1396283a
!29693 unfied runtime adapt the env MS_DEV_ENABLE_CLOSURE
Merge pull request !29693 from limingqi107/new_actor_runtime
2022-02-07 03:28:44 +00:00
zhoufeng b9b2f5bbfd delete core gvar
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2022-02-06 17:21:49 +08:00
i-robot e1c2c4c268
!29699 Fix duplicate wp hit bug in offline debugger
Merge pull request !29699 from TinaMengtingZhang/bugfix_dbg
2022-02-01 21:43:24 +00:00
i-robot a1b5f06407
!29535 [MD] Profiler Memory Tooling Support
Merge pull request !29535 from cathwong/ckw_memory_tool
2022-02-01 21:39:05 +00:00
TinaMengtingZhang 23eb886d11 bugfix: duplicate wp hit results in offline dbg 2022-02-01 11:58:42 -05:00
Cathy Wong 3fe9a05341 [MD] Profiler Memory Tool Support 2022-01-31 17:46:17 -05:00
i-robot e12d6af257
!29358 MD Child Sampler Code and UT Issues
Merge pull request !29358 from zetongzhao/sampler_AddChild
2022-01-31 16:55:22 +00:00
zetongzhao ea9783e18c fix sampler add_child 2022-01-31 07:45:42 -05:00
limingqi107 127e147f5c unfied runtime adapt the env MS_DEV_ENABLE_CLOSURE 2022-01-30 15:33:55 +08:00
i-robot a182cba0d1
!29635 Solve the problem that the path on Windows platform contains both slash and backslash
Merge pull request !29635 from guozhijian/fix_path_with_backslash
2022-01-30 06:32:32 +00:00
i-robot b131e45669
!29617 add test case for exceptions
Merge pull request !29617 from zhujingxuan/master
2022-01-30 03:12:14 +00:00
i-robot aae56dbae4
!28962 Change aot error code strategy and modify logs
Merge pull request !28962 from jiaoy1224/aot
2022-01-30 03:03:03 +00:00
jonyguo 911bdb297f fix: on windows platform with mix back slash path 2022-01-30 10:30:30 +08:00
i-robot 48f4fd2f52
!29639 build core.so
Merge pull request !29639 from zhoufeng/dynamic-core
2022-01-30 02:00:21 +00:00
i-robot 2d85475207
!29657 opt test matrix_set_diag test codes
Merge pull request !29657 from zhuzhongrui/pub_master
2022-01-30 01:05:41 +00:00
Yang Jiao 7d4599e65a change aot func return code 2022-01-29 19:25:42 +08:00
i-robot 8f784d40c1
!29570 add julia version check and platform check
Merge pull request !29570 from r1chardf1d0/master
2022-01-29 08:47:54 +00:00
i-robot 02d63d7ad9
!23008 [assistant][ops][FilterWikipediaXML]
Merge pull request !23008 from Isaac/FilterWikipediaXML
2022-01-29 08:35:29 +00:00
i-robot 3d5ed14ff8
!29600 Open constrol flow closure feature.
Merge pull request !29600 from chenfei_mindspore/open-closure
2022-01-29 08:18:59 +00:00
i-robot 9f84dacfe9
!29643 takedown test_SSD_mobilenet_v1_fpn_coco2017 due to probalistic failures
Merge pull request !29643 from yanghaoran/master
2022-01-29 07:48:34 +00:00
i-robot ea391f6eb1
!29505 Fix AllGather Cast when the parameters are shared
Merge pull request !29505 from huangxinjing/fx_allgather_cast
2022-01-29 07:46:10 +00:00
i-robot f5392f2460
!22443 [assistant][ops] Add new data operator MaskAlongAxis
Merge pull request !22443 from TR-nbu/MaskAlongAxis
2022-01-29 07:19:20 +00:00
z00512249 528e957d92 opt test matrix_set_diag test codes 2022-01-29 15:13:08 +08:00
zhujingxuan 3adaa8922d add test case for exceptions 2022-01-29 14:54:37 +08:00
i-robot 42ecfb797e
!29564 Add Parallel to matrix_diag_part/matrix_band_part, add ops wrapper
Merge pull request !29564 from wuwenbing/master
2022-01-29 06:40:59 +00:00
i-robot 776d937266
!29625 Add GPU matrix_diag_part ops, optimize related testcase
Merge pull request !29625 from wuwenbing/dev
2022-01-29 06:40:11 +00:00
yanghaoran 6128ed4091 takedown test_SSD_mobilenet_v1_fpn_coco2017 due to probalistic failures 2022-01-29 14:20:43 +08:00
zhoufeng 8e97ce5cd2 build core.so
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2022-01-29 14:11:02 +08:00
r1chardf1d0 ed4624c879 add version check 2022-01-29 12:16:13 +08:00
wenbean 860f52e45d Add ops warpper and test, add parralel launch 2022-01-29 11:38:30 +08:00
wenbean b9872dd961 Add GPU matrix_diag_part ops, optimize related testcase 2022-01-29 11:26:29 +08:00
z00512249 b5ff033ff5 opt cholesky to support batch shape 2022-01-29 11:08:04 +08:00
chenfei a96f0b11e0 open closure 2022-01-28 22:04:31 +08:00
tophand 797cd52c96 [feat][assistant][I40GXK]add new data operator Filter_Wikipedia_XML 2022-01-28 02:26:20 -08:00
i-robot e318954f06
!29596 GraphKernel Run test case only on linux
Merge pull request !29596 from ZengZitao/llvm_bugfix
2022-01-28 07:58:56 +00:00
i-robot 04d7f716e7
!29597 opt cholesky attributes.
Merge pull request !29597 from zhuzhongrui/pub_master2
2022-01-28 07:55:38 +00:00
QRICK 52c73ff1b3 [assistant][ops][I3T96S] Add new data operator MaskAlongAxis 2022-01-28 14:53:38 +08:00
i-robot 47a4860043
!27184 [assistant][ops]Add Cummax
Merge pull request !27184 from 陈钧/cummax
2022-01-28 06:40:25 +00:00
zengzitao 0f06988c46 only run this case in linux 2022-01-28 14:31:06 +08:00
z00512249 f96d40db22 opt cholesky attributes. 2022-01-28 10:40:35 +08:00
i-robot 5e6d6ee63e
!29576 Add matrix_band_part gpu kernel and test cases
Merge pull request !29576 from wuwenbing/dev
2022-01-28 01:44:50 +00:00
i-robot 33d8542427
!29582 takedown resnet50_imagenet due to probalistic failures
Merge pull request !29582 from yanghaoran/master
2022-01-28 01:36:18 +00:00
i-robot fff767f694
!29545 opt test_ops value name.
Merge pull request !29545 from zhuzhongrui/pub_master
2022-01-27 13:22:23 +00:00
i-robot 92c59c3401
!25289 [assistant][ops] Add Coalesce
Merge pull request !25289 from 李定维/Coalesce
2022-01-27 12:31:30 +00:00
wenbean 28ec747fe5 Add GPU matrix_band_part 2022-01-27 17:22:09 +08:00
i-robot a24709b46a
!22446 [assistant][ops] Add new data operator MaskAlongAxisIID
Merge pull request !22446 from TR-nbu/MaskAlongAxisIID
2022-01-27 08:45:24 +00:00
王泰格 cc8d3e6279 [assistant][ops][I40FKE] add operator Coalesce 2022-01-27 16:08:31 +08:00
i-robot 8611d0d1ea
!29258 support isinstance(x, CSRTensor) in graph mode and support F.dtype(csr_tensor)
Merge pull request !29258 from wangrao124/add_dtype_isinstance
2022-01-27 07:59:02 +00:00