Commit Graph

3187 Commits

Author SHA1 Message Date
i-robot 357ad46cb1 !25585 Enable JIT Fallback in default.
Merge pull request !25585 from 张清华/opt_jit_fallback
2021-10-28 17:30:50 +00:00
Zhang Qinghua e8b421fe6e Enable JIT Fallback in default. 2021-10-28 20:18:06 +08:00
i-robot 8758830723 !25479 delete mindquantum c++ simulator
Merge pull request !25479 from donghufeng/master
2021-10-28 08:14:18 +00:00
luoyang b47ac46e92 Support bytes input for decode op 2021-10-28 15:22:50 +08:00
yangzhenzhang c42081619e add parallel op for resizenearestneighbor 2021-10-28 11:31:00 +08:00
i-robot a7834c382f !25511 Add some fallback testcases
Merge pull request !25511 from Margaret_wangrui/fallback_tests
2021-10-28 02:28:20 +00:00
Margaret_wangrui 7738f55f44 Add some fallback testcases 2021-10-28 09:15:24 +08:00
i-robot 418e1b425b !23490 [assistant][ops] Add New Math Operator IsNan
Merge pull request !23490 from 孟权令/IsNan
2021-10-27 12:15:41 +00:00
xuxusheng 7a9a4d0515 delete mindquantum simulator 2021-10-27 18:35:35 +08:00
i-robot 360e228f45 !25358 Fix fallback and cell kwargs issues.
Merge pull request !25358 from 张清华/opt_fallback
2021-10-27 09:07:55 +00:00
Sawyer c032d1f83c [feat][assistant][I3T92O]add new operator IsNan 2021-10-27 16:14:03 +08:00
i-robot 180b071122 !22149 [assistant][ops] Add New IsInf
Merge pull request !22149 from 孟权令/IsInf
2021-10-27 07:41:15 +00:00
Zhang Qinghua b43693be23 Fix fallback and cell kwargs issues. 2021-10-27 14:06:02 +08:00
i-robot 74977e548d !24624 [Autotune] Modify MD callback and AddWorker logic to ParallelOps
Merge pull request !24624 from h.farahat/add_worker
2021-10-27 00:41:20 +00:00
i-robot c0f6286fcb !25092 [MD] API for autotune
Merge pull request !25092 from harshvardhangupta/auto_tune_api
2021-10-26 18:14:43 +00:00
i-robot 704c490e80 !25449 MD UT - Add missing set and restore seed for parallel test execution
Merge pull request !25449 from cathwong/ckw_ut_py_parallel
2021-10-26 17:53:39 +00:00
Cathy Wong e66aba9ef5 MD UT - Add missing set and restore seed.
test_places365_content_check - delete visualize_dataset
2021-10-26 13:19:47 -04:00
harshvardhangupta 1bb45142c9 Implement autotune api 2021-10-26 11:26:13 -04:00
doit cd9242eaa9 [feat] [assistant] [I3T92M] add new math operator IsInf 2021-10-25 14:40:40 +08:00
huangbingjian d7e97dd74a change EXCEPTION level to CRITICAL level 2021-10-25 14:25:50 +08:00
i-robot 6f413ee29d !25155 Support ops, nn and numpy namespaces, and add test case.
Merge pull request !25155 from 张清华/opt_fallback
2021-10-23 03:50:53 +00:00
Zhang Qinghua 6a79e262ae Support ops, nn and numpy namespaces, and add test case. 2021-10-22 16:31:30 +08:00
i-robot c544af28b6 !25286 dataset: modify profiling ut for parallel running
Merge pull request !25286 from ms_yan/ut_parallel
2021-10-22 08:09:03 +00:00
ms_yan bb314ad07f make ut parallel 2021-10-22 13:17:43 +08:00
i-robot cf0029b33a !25277 [MD] fix mindrecord ut part05
Merge pull request !25277 from liyong126/fix_md_ut_05
2021-10-22 01:43:03 +00:00
i-robot 782874bf18 !21215 [MS][crowdfunding]New operator implementation, include phaser
Merge pull request !21215 from Wangsong95/phaser
2021-10-22 01:08:50 +00:00
hesham 85e077b60b Callback changes
AddWorker logic to parallel ops
2021-10-21 17:35:11 -04:00
liyong 7c9f6899a3 fix md ut part05 2021-10-21 20:40:09 +08:00
i-robot b7d8bcfe8d !25177 [MD] fix mindrecord ut part04
Merge pull request !25177 from liyong126/fix_md_ut_part04
2021-10-21 01:39:26 +00:00
i-robot 5d8be044c9 !18018 [assistant][ops]New operator implementation, include FashionMnistDataset
Merge pull request !18018 from 张璇/fashionmnist_dataset
2021-10-20 06:42:54 +00:00
i-robot f9bd640b09 !16269 [assistant][RandomLighting]
Merge pull request !16269 from QingfengLi/randomlighting
2021-10-20 06:42:12 +00:00
liyong fc5ea9cc1c fix dataset ut for running independently 2021-10-20 14:27:36 +08:00
i-robot ae87f31dea !25088 Optimize the comment and log descriptions for the python source code
Merge pull request !25088 from zhunaipan/master
2021-10-20 06:26:56 +00:00
zhunaipan 8ce4e62725 optimize the comment and log description
修改:     ops/operations/_inner_ops.py
	修改:     ops/operations/_quant_ops.py
	修改:     ops/operations/array_ops.py
	修改:     ops/operations/comm_ops.py
	修改:     ops/operations/math_ops.py
	修改:     ops/operations/quantum_ops.py
	修改:     ops/operations/rl_ops.py
	修改:     ops/operations/sponge_ops.py
	修改:     ops/operations/sponge_update_ops.py
	修改:     train/__init__.py
	修改:     common/tensor.py
	修改:     train/serialization.py
	修改:     ccsrc/pipeline/jit/parse/parse.h
	修改:     explainer/benchmark/_attribution/metric.py
	修改:     ops/composite/multitype_ops/_constexpr_utils.py
	修改:     ops/operations/comm_ops.py

	修改:     RELEASE.md
	修改:     mindspore/_extends/parse/standard_method.py
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/concat_offset_cpu_kernel.cc
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/dynamic_shape_cpu_kernel.cc
	修改:     mindspore/ccsrc/frontend/parallel/ops_info/reshape_info.cc
	修改:     mindspore/ccsrc/frontend/parallel/ops_info/tile_info.cc
	修改:     mindspore/ccsrc/frontend/parallel/ops_info/transpose_info.cc
	修改:     mindspore/ccsrc/frontend/parallel/strategy.h
	修改:     mindspore/common/tensor.py
	修改:     mindspore/core/abstract/prim_arrays.cc
	修改:     mindspore/core/abstract/prim_nn.cc
	修改:     mindspore/core/ops/conv2d.cc
	修改:     mindspore/core/ops/logical_and.h
	修改:     mindspore/core/ops/logical_not.h
	修改:     mindspore/core/ops/logical_or.h
	修改:     mindspore/core/ops/reduce_all.h
	修改:     mindspore/core/ops/reduce_any.h
	修改:     mindspore/lite/src/runtime/kernel/arm/fp32_grad/sgd.cc
	修改:     mindspore/nn/layer/quant.py
	修改:     mindspore/nn/optim/sgd.py
	修改:     mindspore/nn/sparse/sparse.py
	修改:     mindspore/numpy/array_creations.py
	修改:     mindspore/numpy/array_ops.py
	修改:     mindspore/numpy/logic_ops.py
	修改:     mindspore/numpy/math_ops.py
	修改:     mindspore/ops/operations/_inner_ops.py
	修改:     mindspore/ops/operations/array_ops.py
	修改:     mindspore/ops/operations/rl_ops.py
	修改:     mindspore/train/_utils.py
	修改:     tests/ut/python/model/test_lenet_core_after_exception.py

	修改:     mindspore/_extends/parse/standard_method.py
	修改:     mindspore/ops/operations/rl_ops.py

	修改:     mindspore/core/abstract/prim_nn.cc
	修改:     mindspore/core/ops/conv2d.cc

	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/ctcloss_cpu_kernel.cc
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/fl/fused_pull_weight_kernel.h
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/fl/fused_push_weight_kernel.h
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/mkldnn/conv2d_grad_filter_cpu_kernel.cc
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/mkldnn/conv2d_grad_input_cpu_kernel.cc
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/ps/sparse_apply_ftrl_ps_kernel.cc
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/ps/sparse_apply_lazy_adam_ps_kernel.cc
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/rolling_cpu_kernel.cc
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/scatter_arithmetic_cpu_kernel.cc
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/split_cpu_kernel.cc
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/update_cache_cpu_kernel.cc
	修改:     mindspore/ccsrc/backend/kernel_compiler/gpu/arrays/split_gpu_kernel.h
	修改:     mindspore/ccsrc/backend/kernel_compiler/gpu/math/broadcast_gpu_kernel.h
	修改:     mindspore/ccsrc/backend/kernel_compiler/gpu/nn/conv2d_grad_input_gpu_kernel.h
	修改:     mindspore/ccsrc/fl/server/server.cc
	修改:     mindspore/ccsrc/frontend/optimizer/ad/kpynative.cc
	修改:     mindspore/ccsrc/frontend/optimizer/irpass/incorporate_getitem.h
	修改:     mindspore/ccsrc/frontend/optimizer/irpass/inline.h
	修改:     mindspore/ccsrc/minddata/dataset/core/device_tensor.cc
	修改:     mindspore/ccsrc/minddata/dataset/core/tensor.cc
	修改:     mindspore/ccsrc/minddata/dataset/engine/datasetops/source/emnist_op.cc
	修改:     mindspore/ccsrc/minddata/dataset/engine/datasetops/source/mnist_op.cc
	修改:     mindspore/ccsrc/minddata/dataset/engine/datasetops/source/qmnist_op.cc
	修改:     mindspore/ccsrc/minddata/dataset/engine/ir/datasetops/dataset_node.cc
	修改:     mindspore/ccsrc/minddata/dataset/engine/opt/pre/epoch_ctrl_pass.cc
	修改:     mindspore/ccsrc/minddata/dataset/kernels/image/lite_image_utils.cc
	修改:     mindspore/ccsrc/pipeline/jit/action.cc
	修改:     mindspore/ccsrc/pipeline/jit/static_analysis/evaluator.cc
	修改:     mindspore/ccsrc/runtime/device/ascend/executor/tiling/op_tiling_adapter.cc
	修改:     mindspore/compression/quant/quant_utils.py
	修改:     mindspore/core/abstract/prim_nn.cc
	修改:     mindspore/dataset/engine/validators.py
	修改:     mindspore/lite/micro/coder/opcoders/nnacl/fp32/affine_fp32_coder.cc
	修改:     mindspore/lite/micro/coder/opcoders/nnacl/int8/affine_int8_coder.cc
	修改:     mindspore/lite/src/runtime/kernel/ascend310/src/custom_kernel.cc
	修改:     mindspore/lite/src/runtime/kernel/opencl/kernel/matmul.cc
	修改:     mindspore/lite/src/runtime/kernel/opencl/kernel/strassen.cc
	修改:     mindspore/lite/tools/common/graph_util.h
	修改:     mindspore/lite/tools/optimizer/fisson/fisson_util.cc
	修改:     mindspore/ops/composite/math_ops.py
	修改:     mindspore/ops/operations/_inner_ops.py
	修改:     mindspore/ops/operations/array_ops.py
	修改:     mindspore/ops/operations/math_ops.py
	修改:     mindspore/ops/operations/other_ops.py

	修改:     mindspore/boost/boost_cell_wrapper.py
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/update_cache_cpu_kernel.cc
	修改:     mindspore/ccsrc/common/trans.cc
	修改:     mindspore/ccsrc/frontend/parallel/cache_embedding/cache_embedding.cc
	修改:     mindspore/ccsrc/frontend/parallel/ops_info/gather_info.cc
	修改:     mindspore/lite/src/common/log_util.h
	修改:     mindspore/nn/wrap/loss_scale.py
	修改:     mindspore/parallel/nn/moe.py
	修改:     tests/mindspore_test_framework/mindspore_test.py

	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/split_cpu_kernel.cc
	修改:     mindspore/lite/tools/common/graph_util.h

	修改:     mindspore/ccsrc/frontend/parallel/ops_info/gather_info.cc

	修改:     mindspore/core/ops/conv2d.cc

	修改:     tests/ut/python/model/test_lenet_core_after_exception.py
2021-10-20 12:02:40 +08:00
i-robot ef7bc4ddda !25079 Change dir hash to file hash in bprop mindir
Merge pull request !25079 from YuJianfeng/bprop_mindir
2021-10-20 02:54:05 +00:00
“uccInf” fe3123cfe8 [feat][assistant][I3J6V4] add new data operator FashionMnist 2021-10-20 02:37:56 +00:00
i-robot 440036d331 !24362 [assistant][ops]New operator implementation, include PhotoTourDataset
Merge pull request !24362 from Wangsong95/phototour_dataset
2021-10-20 01:46:05 +00:00
yangyueren 6594b90a58 [feat][assistant][I3J6VE] add new data operator PhotoTour 2021-10-19 15:31:32 +00:00
chenx2ovo 77caf907c4 [feat][assistant][I3CEGR] add op random lighting 2021-10-19 20:38:01 +08:00
yujianfeng 42079ac087 Change dir hash to file hash in bprop mindir 2021-10-19 19:22:25 +08:00
liyong a89741c32e fix md ut part03 2021-10-19 16:52:57 +08:00
i-robot 690642d672 !18664 [assistant][ops]New operator implementation, include Places365Dataset
Merge pull request !18664 from Wangsong95/places365_dataset
2021-10-19 07:06:35 +00:00
i-robot c97d3eeef7 !25100 [MD] fix mindrecord ut part02
Merge pull request !25100 from liyong126/fix_md_ut_part02
2021-10-19 06:30:57 +00:00
i-robot 1606f19dfb !18265 [assistant][ops] Add new audio operator CreateDct
Merge pull request !18265 from 杨旭华/CreateDct
2021-10-19 06:30:18 +00:00
liyong d23961b98f fix mindrecord ut 2021-10-19 11:43:52 +08:00
i-robot e7ea546194 !25006 [MD] fix mindrecord ut
Merge pull request !25006 from liyong126/fix_md_ut
2021-10-19 02:02:13 +00:00
i-robot d9cfda44c4 !25060 ut_fix
Merge pull request !25060 from wanyiming/ut_fix
2021-10-19 00:59:01 +00:00
i-robot e3d8edc530 !24475 Implement the dict.items() interface and the multiplication operation of numbers and lists or tuples
Merge pull request !24475 from 翟之博/master
2021-10-18 11:39:27 +00:00
i-robot 8df1bd14a1 !24986 Change printed log's level in dump_proto.cc
Merge pull request !24986 from huanghui/change-log-level
2021-10-18 11:36:44 +00:00
tophand 4f4777f0da [feat][assistant][I3J6U2] Add new audio operator CreateDct 2021-10-18 03:23:18 -07:00
wanyiming 4fbc59a98a utfixs 2021-10-18 18:06:37 +08:00
liyong d9aa18dfca refactor md ut 2021-10-18 17:55:28 +08:00
i-robot 9d0d094437 !24554 support nested call of ms_function
Merge pull request !24554 from zhangzhaoju/ms_master_ms_function
2021-10-18 09:36:30 +00:00
zzb 95425b770d iml dict.items() and multiplication op 2021-10-18 12:47:22 +08:00
zx d13d2413f5 [feat][assistant][I3J6UV] add new audio operator Phaser 2021-10-16 08:45:12 +08:00
yangyueren 951193c308 [feat][assistant][I3J6VF] add new data operator Places365 2021-10-15 14:56:09 +00:00
Xiao Tianci 930a5b89c0 fix api docs of audio 2021-10-15 17:17:18 +08:00
i-robot be691284e2 !18407 [assistant][MulLawEncoding]
Merge pull request !18407 from QingfengLi/mulawencoding
2021-10-15 09:03:41 +00:00
i-robot 44fe11c656 !24805 fix_fronted_ut
Merge pull request !24805 from wanyiming/fix_uts
2021-10-15 09:01:35 +00:00
zhangzhaoju b4453709a2 Support parser decoratored functions
like nested calling of ms_function
2021-10-15 16:41:08 +08:00
wanyiming 8b40e77201 ut_fixed 2021-10-15 15:54:26 +08:00
huanghui 3785b6d1b4 change printed log's level 2021-10-15 15:49:08 +08:00
chujinjin 3c3d8c3962 remove useless python ut 2021-10-15 15:26:45 +08:00
i-robot b27623ae37 !24899 modify ut of probability
Merge pull request !24899 from byweng/master
2021-10-15 02:02:52 +00:00
robert_luo_yibo 75e2c3041c [feat][assistant][I3CEG3] add new data OP MuLawEncoding 2021-10-14 20:24:18 +08:00
Bingya Weng be20f00299 modify ut of probability 2021-10-14 19:33:34 +08:00
i-robot f83070728d !24790 support user define strategy gen method under auto parallel context
Merge pull request !24790 from zhuyuxiao/master
2021-10-14 09:03:36 +00:00
chujinjin 90836f70a0 fix context python ut error 2021-10-14 14:27:50 +08:00
i-robot 957f9a7b4e !24839 UT case runs failed in PyNative mode
Merge pull request !24839 from JoyLvliang/ut_run_failed_in_pynative_mode
2021-10-14 06:15:28 +00:00
i-robot 65f08a6c4c !24804 parallel ut modify
Merge pull request !24804 from yao_yf/parallel_ut_modify
2021-10-14 01:24:12 +00:00
i-robot 470de9bcaa !21258 [assistant][ops]New operator implementation, include ApplyKerasMomentumD
Merge pull request !21258 from 梁秀波/ApplyKerasMomentumD
2021-10-14 01:05:23 +00:00
7347157+joylvliang@user.noreply.gitee.com aecbdf3c3b ut_run_failed_in_pynative_mode 2021-10-13 18:46:27 +08:00
i-robot 1b9b85bbb2 !17851 [assistant][ops]New operator implementation, include FakeImageDataset
Merge pull request !17851 from 张璇/fakeimage_dataset
2021-10-13 09:22:55 +00:00
yao_yf 636f82a466 parallel ut modify 2021-10-13 14:28:13 +08:00
zhuyuxiao 1907246931 change api 2021-10-13 10:28:30 +08:00
i-robot 3fd94000c5 !24568 Apply batch parallel in auto_parallel mode when strategies are not specified
Merge pull request !24568 from zhuyuxiao/master
2021-10-13 01:20:15 +00:00
i-robot 18e632c7a1 !21216 [MS][crowdfunding]New operator implementation, include Overdirve
Merge pull request !21216 from Wangsong95/overdrive
2021-10-13 01:08:36 +00:00
G-Dragon-Liu d2f22a8726 [feat][assistant][I3J6V3] add new data operator FakeImage 2021-10-12 14:00:43 +00:00
zx 9b7d7be65c [feat][assistant][I3J6UU] add new audio operator Overdrive 2021-10-12 18:10:31 +08:00
zhuyuxiao cf76c76745 apply batch parallel in auto_parallel mode when strategies are not specified 2021-10-12 15:44:10 +08:00
yao_yf b303d6001c parallel ut refactor 2021-10-12 15:18:51 +08:00
huanghui 1af32f74f9 support None argument for the outermost net 2021-10-11 16:00:57 +08:00
i-robot b9c2a84d3b !17812 [assistant][ops] Add a new audio operator Flanger
Merge pull request !17812 from 杨旭华/Flanger
2021-10-09 08:15:33 +00:00
li-qiyao 2283442855 [feat][assistant][I3J6U9] add new data operator Flanger 2021-10-08 05:03:31 -07:00
i-robot ea53466848 !24490 Extend the completeness of the mindspore static graph mode, so that the filter function is supported in the construct function
Merge pull request !24490 from 卢逸飞/MindSpore/master
2021-10-08 10:35:29 +00:00
i-robot 8598d08351 !17820 [assistant][ops]New operator implementation, include EMnistDataset
Merge pull request !17820 from 张璇/emnist_dataset
2021-10-08 07:18:31 +00:00
i-robot 02f9e3e077 !17805 [assistant][ops] Add new audio operator DetectPitchFrequency
Merge pull request !17805 from 杨旭华/DetectPitchFrequency
2021-10-08 03:34:46 +00:00
G-Dragon-Liu 32baa520bf [feat][assistant][I3J6V2] add new data operator EMnist 2021-10-08 02:53:00 +00:00
John Tzanakakis 7e7b444c63 remove verbose option from DbgServices 2021-10-06 11:38:05 -04:00
Lu 9f68d43c32 Construct supports the filter function. 2021-09-30 15:18:05 +08:00
i-robot dddea1803d !24361 context api 0928
Merge pull request !24361 from mindspore_ding/context_master_0928
2021-09-30 06:45:28 +00:00
dingpeifei 89f9d0f263 api context 0927 2021-09-29 23:15:36 +08:00
Zhang Lian b7e6520e62 [feat] [assistant] [I3J6U8] Add a new audio operator DetectPitchFrequency 2021-09-29 15:12:58 +08:00
despicablemme 75ade61acf [feat] [assistant] [I40GGE] add new Ascend operator CeLU 2021-09-28 14:58:25 +08:00
i-robot 2cacf9cdc2 !24231 fix security wrap and code check
Merge pull request !24231 from jiangshuqiang/fix_code_check_master
2021-09-28 06:45:19 +00:00
i-robot 2085ab1774 !22831 [assistant][ops]add math ops Ger
Merge pull request !22831 from yangwm/ger
2021-09-28 06:27:35 +00:00
jiangshuqiang 13fc005562 fix security wrap 2021-09-28 11:59:45 +08:00
i-robot dd544a9693 !21406 [MS][crowdfunding]New operator implementation, include TrebleBiquad
Merge pull request !21406 from 张璇/treble_biquad
2021-09-27 14:18:00 +00:00
i-robot f16c003dfa !22610 [MS][crowdfunding]New operator implementation, RandomAdjustSharpness
Merge pull request !22610 from yangwm/sharpness
2021-09-27 09:20:05 +00:00
zorax 6098c1da5e [feat][assistant][I40FFO] add new Ascend operator ApplyKerasMomentum 2021-09-27 16:49:18 +08:00
zx 3da0f0f487 [feat][assistant][I3J6V0] add new audio operator TrebleBiquad 2021-09-27 13:01:26 +08:00
despicablemme d072a4e4bf [feat] [assistant] [I40GZE] add new data operator RandomAdjustSharpness 2021-09-27 11:19:33 +08:00
i-robot ab567574c4 !21451 [MS][crowdfunding]New operator implementation, include RiaaBiquad
Merge pull request !21451 from 张璇/riaa_biquad
2021-09-27 03:14:16 +00:00
i-robot 2969688382 !20047 [assistant][ops]New operator implementation, include QmnistDataset
Merge pull request !20047 from Wangsong95/qmnist_dataset
2021-09-27 01:36:08 +00:00
despicablemme 84337078b1 [feat] [assistant] [I40GGM] add new ascend operator Ger 2021-09-27 09:28:05 +08:00
i-robot e3bc280f22 !22532 [MS][crowdfunding]New operator implementation, RandomEqualize
Merge pull request !22532 from yangwm/equalize
2021-09-27 01:07:04 +00:00
i-robot b10df2da0c !21401 [assistant][ops]New operator implementation, include ExtractVolumePatches
Merge pull request !21401 from 梁秀波/ExtractVolumePatches
2021-09-26 09:52:43 +00:00
i-robot bb038292d4 !23905 fix error log
Merge pull request !23905 from lianliguang/more-info-for-infer-error
2021-09-26 06:23:34 +00:00
despicablemme 7063907bdc [feat] [assidtant] [I40GZN] add new data ops RandomEqualize 2021-09-25 18:00:25 +08:00
i-robot d0023355a3 !23205 Fix bus error with multiprocessing enabled, large image, shared_memory, single device
Merge pull request !23205 from RobinGrosman/mem_bus_failure
2021-09-24 19:16:12 +00:00
RobinGrosman c90efc0403 add check for shm available when num_devices=1 to avoid bus errors
-Required modifying tests to reduce memory usage to check doesn't fail during CI
-Also required fixing max_rowsize to be externalized from map+batch() function
2021-09-24 10:24:31 -07:00
hzw 2f5758a4a8 [feat][assistant][#I40FFZ] add new Ascend operator ExtractVolumePatches 2021-09-24 18:36:03 +08:00
i-robot ee38ffbd3d !22560 [MS][crowdfunding]New operator implementation, RandomAutoContrast
Merge pull request !22560 from yangwm/autocontrast
2021-09-24 09:34:37 +00:00
i-robot 7cde7731b0 !23537 Update pangu reshape and softmax.
Merge pull request !23537 from linqingke/pangu
2021-09-24 08:12:13 +00:00
i-robot 86392fdd3d !23982 fix the debug info about the cell function decorated by @ms_functon
Merge pull request !23982 from huanghui/fix-filename-error-with-ms_function
2021-09-24 06:43:35 +00:00
i-robot e7cb505e68 !23569 Produce parallel operators for ResizeBilinear and ResizeNearestNeighbor
Merge pull request !23569 from Bert0108/resizebilinear_parallel_ops
2021-09-24 03:05:23 +00:00
i-robot d37fccc56f !23544 remove deprecated gather op
Merge pull request !23544 from zhuyuxiao/master
2021-09-24 01:20:53 +00:00
Bert0108 2d3d0b673e parallel operators for ResizeBilinear and ResizeNearestNeighbor 2021-09-24 09:07:49 +08:00
linqingke acde7febef update pangu reshape and softmax performance.
Add layer norm judge

Fix layer norm name error

Fix input tyoe check

Fix ut test

Add 3d supports
2021-09-24 09:06:16 +08:00
zx 1d95e6f480 [feat][assistant][I3J6UY] add new audio operator RiaaBiquad 2021-09-23 21:36:59 +08:00
i-robot 79d1f3cfd3 !23854 Fix testcase about modelzoo
Merge pull request !23854 from chenhaozhe/fix-testcase-about-models
2021-09-23 12:27:42 +00:00
despicablemme 7a6b75c2e8 [feat] [assistant] [I40GZJ] add new data op RandomAutoContrast 2021-09-23 20:17:39 +08:00
i-robot ab9a7163cb !22175 [assistant][ops]New operator implementation, include Trunc
Merge pull request !22175 from 梁秀波/Trunc
2021-09-23 10:04:55 +00:00
i-robot 0c26736da1 !22276 [MS][crowdfunding]New operator implementation, RandomInvert
Merge pull request !22276 from yangwm/rinvert
2021-09-23 08:12:57 +00:00
lianliguang 7227b61979 modify info when infer error 2021-09-23 15:54:43 +08:00
i-robot 632e3b8dcd !23663 add exception level to python error report
Merge pull request !23663 from huangbingjian/py_log
2021-09-23 07:46:45 +00:00
huanghui 97250978c4 fix the debug info about the function decorated by @ms_functon 2021-09-23 14:43:02 +08:00
echo-yike 785558cdd2 [feat][assistant][I40FGD] add new Ascend operator Trunc 2021-09-23 14:27:35 +08:00
chenhaozhe 12fab451e8 fix test cases about models 2021-09-23 09:19:37 +08:00
i-robot 44b1dbf77f !23827 MD Python UT: Update num_epochs to appropriate value for iterators instead of using default value
Merge pull request !23827 from hetshah/hs_python_ut
2021-09-22 21:14:35 +00:00
hetshah 2c1666fd06 set num epochs for iterators that use the default value
add explicit paramter for infinite iterators

set appropriate value for num_epoch param for iteratos

fix long lines

remove trailing whitespace

fixed typo

remove comment

fixed comments

fixed test
2021-09-22 17:32:50 +00:00
despicablemme b977d8723b [feat] [assistant] [I40GZC] add new data ops RandomInvert 2021-09-22 16:55:14 +08:00
huangbingjian 3ee5d98a8d add exception level to python error report 2021-09-22 14:34:21 +08:00
ckczzj 001b68c286 [feat][assistant][I3J6VG] add new data operator QMnist 2021-09-22 12:13:27 +08:00
Zhang Qinghua 9fbd118319 Handle interpreted node as input, set function Parameters and update local params if need. 2021-09-18 17:34:50 +08:00
i-robot ebe094ac0f !21829 [assistant][ops] Add New Cdist and CdistGrad
Merge pull request !21829 from 孟权令/Cdist
2021-09-18 09:23:27 +00:00
i-robot e87f0be14f !23707 fix summary isolation
Merge pull request !23707 from jiangshuqiang/temp
2021-09-18 09:23:25 +00:00
i-robot 6489dacdab !18114 [assistant][ops]Add new operator Magphase
Merge pull request !18114 from YJfuel123/Magphase
2021-09-18 07:26:34 +00:00
i-robot 92287b86d8 !23471 Fix white list error msg synax error
Merge pull request !23471 from xiefangqi/md_white_list_optimization
2021-09-18 05:03:40 +00:00
jiangshuqiang c2bd061889 fix summary isolation 2021-09-18 10:59:14 +08:00
i-robot 95e56d0912 !23212 enable profiling warning
Merge pull request !23212 from mindspore_ding/enable_profiling_master_0910
2021-09-18 02:04:37 +00:00
zhoufeng 1f934bd782 check neighbor attr type
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2021-09-17 21:15:37 +08:00
dingpeifei 7523b320d7 enable profiling warning 2021-09-17 17:09:56 +08:00
葛崇林 a05a5de073 [feat][assistant][I3ALC5] add new method Magphase 2021-09-17 16:02:46 +08:00
i-robot f5af432e04 !16922 [assistant][Vol]
Merge pull request !16922 from QingfengLi/Vol
2021-09-17 06:51:49 +00:00
SichongHao 5412382e16 [feat][assistant][I3T91W][I3T91X]add new operator Cdist and CdistGrad 2021-09-17 13:58:53 +08:00
chenx2ovo 9e62623b4a [feat][assistant][I3CEGI] add op vol 2021-09-17 09:34:20 +08:00
ms_yan 0a365e91bf modify log in kernel part 2021-09-16 22:09:21 +08:00
i-robot a5b793463a !23099 Correct wrong info when using ms_function to decorate bprop
Merge pull request !23099 from JoyLvliang/correct_wrong_info_when_using_ms_function_with_bprop
2021-09-16 08:46:41 +00:00
i-robot 89119ae470 !23553 fix: pyfunc cause hung when it is a generator which can't be serialize
Merge pull request !23553 from guozhijian/fix_pyfunc_hung_when_yield
2021-09-16 08:44:50 +00:00
zhuyuxiao 79d99323a2 rename gather 2021-09-16 16:07:05 +08:00
7347157+joylvliang@user.noreply.gitee.com 6e59598f99 correct_wrong_info_when_using_ms_function_with_bprop 2021-09-16 14:12:55 +08:00
huangxinjing 0b89d5c9c4 fix batch size error 2021-09-16 10:56:40 +08:00
Guo Zhijian f49bacde09 fix: pyfunc hung when it's a yield func 2021-09-16 09:20:44 +08:00
i-robot 57b8c8e2d9 !23310 [MD] fix error message of mindrecord
Merge pull request !23310 from liyong126/fix_log_msg
2021-09-16 00:45:11 +00:00
i-robot e5af07d519 !23538 minddata error message optimize
Merge pull request !23538 from luoyang/log_update
2021-09-16 00:42:42 +00:00
i-robot 4a553c8d57 !16607 [assistant][Fade]
Merge pull request !16607 from QingfengLi/Fade
2021-09-15 14:54:16 +00:00
i-robot 87fac9a520 !23476 fix hung when user return Tensor in generator
Merge pull request !23476 from guozhijian/fix_generator_hung_when_return_mindspore_tensor
2021-09-15 10:17:24 +00:00
YangLuo 9d89de5765 minddata error message optimize 2021-09-15 18:05:02 +08:00
liyong 65f3365a2a fix mindrecord log 2021-09-15 16:18:40 +08:00
i-robot 0d914dd427 !22638 Add ut test for offline debugger
Merge pull request !22638 from sabrinasun_59ee/ut
2021-09-15 06:28:47 +00:00
jonyguo c408867085 fix: hung when user return Tensor in generator 2021-09-15 14:13:33 +08:00
i-robot 0a33f88d48 !23419 log error level information in python when GLOG_v=4
Merge pull request !23419 from huangbingjian/exception_log
2021-09-15 01:29:12 +00:00
i-robot bbdacd41f4 !20585 add security isolate for save_graphs
Merge pull request !20585 from huanghui/add-security-isolate-for-DumpIR
2021-09-15 01:25:46 +00:00
sabrinasun 3a349a9219 add ut test for offline debugger 2021-09-14 18:46:22 -04:00
xiefangqi a91c87c581 fix some syntax error 2021-09-14 21:29:02 +08:00
chenx2ovo 1a3196b052 [feat][assistant][I3CEGF] add op fade 2021-09-14 19:08:37 +08:00
i-robot db19a40280 !23365 add print op security
Merge pull request !23365 from fangzehua/print_sec
2021-09-14 09:01:31 +00:00
i-robot c6a99428cd !23153 Update the operator in order to let users better understand the reason for the error of the operator part: nn_ops and array_ops
Merge pull request !23153 from dinglinhe/dlh_code_ms_I43QY0_nn_ops
2021-09-14 06:33:39 +00:00
i-robot 2b4cdea48a !23331 batch parallel operator replace input shape from construct
Merge pull request !23331 from yangzhenzhang/modify-batch-parallel-info
2021-09-14 06:32:45 +00:00
huangbingjian 6ba47653bf log error level information in python when GLOG_v=4 2021-09-14 14:23:55 +08:00
huanghui ba66c0d491 add security isolate for save_graphs 2021-09-14 10:24:12 +08:00
i-robot 32c2b77595 !19093 [assistant][ops] Add new audio operator Biquad
Merge pull request !19093 from 杨旭华/Biquad
2021-09-14 01:52:01 +00:00
dinglinhe 9a8c1b3c73 array_ops error recti and others 2021-09-14 09:12:02 +08:00
i-robot 6dcfe64501 !23264 python serdes bug fix
Merge pull request !23264 from zetongzhao/deserialize
2021-09-13 15:53:05 +00:00
i-robot 0aa167cdf4 !23240 maybe max open files in mr or onehot fail in pytransform
Merge pull request !23240 from guozhijian/fix_max_open_files_and_onehot
2021-09-13 13:51:09 +00:00
i-robot e149a15ace !23002 Error log optimizer
Merge pull request !23002 from zhangzhaoju/master_syntax
2021-09-13 13:43:40 +00:00
i-robot dc45c64a78 !23207 Adding security isolation to debugger
Merge pull request !23207 from sabrinasun_59ee/macro
2021-09-13 12:07:29 +00:00
i-robot 5abd4821ce !23357 Add DatasetName method for out developer
Merge pull request !23357 from xiefangqi/md_white_list_optimization
2021-09-13 12:06:49 +00:00
i-robot 3e1d1ff4d3 !18671 [assistant][ops]New operator implementation, include SBUDataset
Merge pull request !18671 from Wangsong95/sbu_dataset
2021-09-13 11:56:13 +00:00
liannai 631f49f044 [feat][assistant][I3T96A] Add new audio operator Biquad 2021-09-13 19:18:50 +08:00
fangzehua 4ccc635a07 add print security 2021-09-13 17:45:36 +08:00
i-robot bdfd3877f8 !23300 Optimize of exception log of AD
Merge pull request !23300 from YuJianfeng/dfx
2021-09-13 09:35:18 +00:00
yangzhenzhang 1b8eb283e4 modify batch parallel info 2021-09-13 16:28:56 +08:00
zhangzhaoju 4296881a16 syntax 2021-09-13 15:20:53 +08:00
xiefangqi 465dd25d74 add virtual DatasetName method 2021-09-13 15:17:32 +08:00
sabrinasun 220245f592 add security isolation to online and offline debugger 2021-09-12 23:01:15 -04:00
i-robot 87381a1cf9 !17806 [assistant][ops] DcShift Op
Merge pull request !17806 from 杨旭华/DCShift
2021-09-13 01:29:14 +00:00
i-robot c9ff7242a4 !23298 minddata engine optimize white list error msg
Merge pull request !23298 from xiefangqi/md_white_list_optimization
2021-09-13 01:19:15 +00:00
Carry955 0ba84345b0 [feat][assistant][I3J6U3] add new audio operator DCShift 2021-09-11 23:58:18 -07:00
jonyguo da78a17730 fix: may max openfiles in mindrecord and onehot error in py_transform
and cache_admin rpath
2021-09-12 00:25:07 +08:00
yujianfeng 752bdde06d Optimize of exception log of AD 2021-09-11 18:07:50 +08:00
xiefangqi ff73e4ccd7 fix white list error msg 2021-09-11 17:36:23 +08:00
Isaac17555 53fc99b914 [feat][assistant][I3T96B]add new data operator LFilter 2021-09-11 02:05:43 -07:00
i-robot 0071667155 !23039 [Fallback] Fix previous block parameters problem and add test cases.
Merge pull request !23039 from 张清华/opt_fallback
2021-09-11 07:39:02 +00:00
i-robot a61c2c5cfe !17885 [assistant][ops]Add new operator EqualizerBiquad
Merge pull request !17885 from YJfuel123/EqualizerBiquad
2021-09-11 06:40:29 +00:00
i-robot 9b7a966174 !21262 [assistant][ops]New operator implementation, include SparseApplyRMSPropD
Merge pull request !21262 from 梁秀波/SparseApplyRMSPropD
2021-09-11 06:01:29 +00:00
i-robot 76fac95591 !23069 Modify error content
Merge pull request !23069 from huchunmei/master
2021-09-11 03:50:52 +00:00
YJfuel123 16150d394f [feat][assistant][I3ALd1] add new operator EqualizerBiquad 2021-09-11 10:36:20 +08:00
ckczzj af97ba4a77 [feat][assistant][I3J6VH] add new data operator SBU 2021-09-11 09:58:17 +08:00
zetongzhao 719a207040 deserialize fix 2021-09-10 15:19:59 -04:00
i-robot 7b4f361ca7 !23232 Fix multiprocessing attr error
Merge pull request !23232 from xiefangqi/md_fix_map_pool_issue
2021-09-10 14:59:40 +00:00
i-robot 6d709c7254 !19624 [assistant][ops] Add new dataset operator DIV2K.
Merge pull request !19624 from Rainfor/div2k
2021-09-10 14:59:21 +00:00
xiefangqi 66c5f937dd fix attr failed problem 2021-09-10 18:01:04 +08:00
wangkc123 3daf3a4d5f [feat] [assistant] [I3CKEK] add new dataset operator DIV2K 2021-09-10 17:55:34 +08:00
Zhang Qinghua bcfb274074 [Fallback] Fix previous block parameters problem, and add test cases. 2021-09-10 16:43:46 +08:00
robert_luo_yibo ce71699734 [feat][assistant][I3CEG5] add new data OP MuLawDecoding 2021-09-10 15:49:46 +08:00
huchunmei c75773cf37 Modify error content 2021-09-10 15:21:33 +08:00
i-robot 32cc5d79b0 !18670 [assistant][ops]New operator implementation, include USPSDataset
Merge pull request !18670 from Wangsong95/usps_dataset
2021-09-10 03:06:19 +00:00
i-robot f91e1440c8 !17810 [assistant][ops][DeemphBiquadOp]
Merge pull request !17810 from Isaac/DeemphBiquad
2021-09-10 03:05:41 +00:00
i-robot 2cc8c851c5 !23141 mkdir rank_id 0909
Merge pull request !23141 from mindspore_ding/mkdir_rankid_master_0909
2021-09-10 02:45:54 +00:00
i-robot 725cf63118 !23187 upgrade Ascend software package 09 Sep 21
Merge pull request !23187 from yanghaoran/upgrade_ascend_0909
2021-09-10 01:55:13 +00:00
i-robot 0abff9ad65 !23108 Fix spelling error for transformer
Merge pull request !23108 from huangxinjing/fix_spell_error
2021-09-10 01:29:32 +00:00
ckczzj d7c702e9d4 [feat][assistant][I3J6VL] add new data operator USPS 2021-09-09 21:46:57 +08:00
yanghaoran 0ced8775c4 upgrade Ascend software package 09 Sep 21 2021-09-09 20:30:22 +08:00
huangxinjing e02f553010 Fix spell error and add mode check 2021-09-09 18:50:53 +08:00
i-robot 5c72e9d7c6 !23078 Get bprop from python when the bprop mindir dir does not exist
Merge pull request !23078 from YuJianfeng/bprop_mindir
2021-09-09 09:51:14 +00:00
i-robot e37b7374ae !22434 [MoE] Adding a MoE implementation
Merge pull request !22434 from Xiaoda/84-add-moe-layer
2021-09-09 09:06:56 +00:00
dingpeifei 992d6a6dbc mkdir rank_id 2021-09-09 16:14:54 +08:00
i-robot 936940da8e !22666 [assistant][ComplexNorm]
Merge pull request !22666 from QingfengLi/ComplexNorm
2021-09-09 06:41:53 +00:00
Isaac 5dc6c7fe96 [feat][assistant][I3J6U6]add new data operator DeemphBiquad 2021-09-09 14:34:24 +08:00
Xiaoda Zhang 5613c0b974 add a moe implementation:
1) extend the Liner cell for including BatchMatMul implementation, in
which the first dimension indicates the expert number;
2) implement a Switch (top1) router;
3) implement a MoE cell, which extends the FeedForward cell.
2021-09-09 11:53:42 +08:00
i-robot 9ad56e86ab !17846 [assistant][ops]Add new operator HighpassBiquad
Merge pull request !17846 from YJfuel123/HighpassBiquad
2021-09-09 02:06:41 +00:00
i-robot a918783f1a !22623 Add Random operation with Multi Field
Merge pull request !22623 from shenwei41/operation_dev
2021-09-09 01:49:04 +00:00
yujianfeng dfe1b05b28 Get bprop from python when the bprop mindir dir does not exist 2021-09-09 09:05:19 +08:00
i-robot b21da536d3 !22784 serdes python operations by pyfunc
Merge pull request !22784 from zetongzhao/deserialize
2021-09-08 17:18:57 +00:00
zetongzhao 0d389f3f0c serdes python operations 2021-09-08 09:05:11 -04:00
shenwei41 a8d02ab782 Add Random operation with MultiField 2021-09-08 19:29:23 +08:00
i-robot 938324b397 !19362 [assistant][ops] Add new dataset operator Cityscapes.
Merge pull request !19362 from Rainfor/cityscapes
2021-09-08 09:14:43 +00:00
i-robot 77424eaad5 !23004 Add args Check for Transformer
Merge pull request !23004 from huangxinjing/args_check
2021-09-08 08:24:06 +00:00
yaoyuan 85a1b55b47 [feat] [assistant] [I3ALCL] add new operator HighpassBiquad 2021-09-08 15:12:40 +08:00
huangxinjing 6cea07f749 Add args check 2021-09-08 09:12:35 +08:00
i-robot b1be8dfd31 !22851 MD Profiling: Update Connector Init to Remove any existing file
Merge pull request !22851 from cathwong/ckw_mon_seq_pipelines_fix
2021-09-07 19:57:58 +00:00
i-robot d37d57d0fd !22941 parallel_sparse_attention_ops_fix_repeated_cal
Merge pull request !22941 from yao_yf/parallel_sparse_attention_ops_fix_repeated_cal
2021-09-07 13:26:19 +00:00
i-robot 5cf19e8aa6 !22986 Add supported namespace for fallback.
Merge pull request !22986 from 张清华/opt_fallback
2021-09-07 12:50:32 +00:00
Zhang Qinghua 6edea0ed3c Add supported namespace for fallback. 2021-09-07 16:19:25 +08:00
i-robot 5ed105ec01 !22933 Tensor support complex scalar number input
Merge pull request !22933 from zhouyaqiang0/complex_ops
2021-09-06 13:29:21 +00:00
i-robot 990d561ed9 !22974 Fix ut/python/dataset generator 14 occationally segment fault
Merge pull request !22974 from xiefangqi/md_fix_generator_problem
2021-09-06 12:25:22 +00:00
yao_yf 3ef26288a2 parallel_sparse_attention_ops_fix_repeated_cal 2021-09-06 19:57:22 +08:00
i-robot 05a0898352 !22843 Support fallback feature in Graph mode.
Merge pull request !22843 from 张清华/opt_fallback
2021-09-06 11:35:45 +00:00
xiefangqi 57f68d35bd fix generator 14 ut problem 2021-09-06 19:01:51 +08:00
zhouyaqiang 4e07873378 Tensor support complex input 2021-09-06 18:44:26 +08:00
Zhang Qinghua 7203989c26 Support fallback feature in Graph mode (1). 2021-09-06 16:00:03 +08:00
lilei 62e832eaab modify parallel API 2021-09-06 11:45:10 +08:00
i-robot fa12d62d4d !21776 set device_id master 0813
Merge pull request !21776 from mindspore_ding/set_device_id_master_0813
2021-09-06 03:02:58 +00:00
Cathy Wong bc85c606b8 MD Profiling: Update Connector Init to Remove any existing file
to fix sequential pipeline scenario.
2021-09-03 15:45:38 -04:00
yao_yf 3ca73a6d6b broadcast using seqarates world group 2021-09-03 11:21:36 +08:00
i-robot 60d583190b !22815 Update bprop error information
Merge pull request !22815 from JoyLvliang/update_bprop_error_information
2021-09-03 01:31:15 +00:00
i-robot 90c7804d6b !22500 Sort watchpoint hit for offline debugger based on time stamps of dump files
Merge pull request !22500 from parastooashtari/offline_wp_hit_order
2021-09-02 14:47:06 +00:00
dingpeifei b4bc6000dc set device id master 0813 2021-09-02 20:51:50 +08:00