Commit Graph

3187 Commits

Author SHA1 Message Date
i-robot e773f0621e !25918 add Function jvp and vjp
Merge pull request !25918 from chenzhuo/jvp
2021-11-12 06:37:46 +00:00
i-robot 5869e02fa1 !26135 Enable tuple input of optimizer as variable
Merge pull request !26135 from LiangZhibo/broaden3
2021-11-12 06:29:35 +00:00
Carry955 0d26c38693 [feat][assistant][I40GXT] add new loader DBpedia 2021-11-11 19:02:22 -08:00
i-robot 7a73bae5c3 !26036 add output strategy for matmul operator
Merge pull request !26036 from yangzhenzhang/add-output-strategy-for-op-init
2021-11-12 01:22:22 +00:00
i-robot e03544685b !26049 [Auto parallel] Support reshape in sharding propagation
Merge pull request !26049 from Xiaoda/99-ad-reshape-adjusting-in-sharding-propagation
2021-11-12 01:14:18 +00:00
chenzhuo f36edec3ff add function jvp 2021-11-12 08:44:41 +08:00
i-robot 1792d5f8a4 !26131 Offload Hardware Acceleration Computing
Merge pull request !26131 from alashkari/hw_accel_move_copy
2021-11-11 13:18:07 +00:00
i-robot b910870ecc !19986 [assistant][ops] Add new dataset loading operator AGNEWS
Merge pull request !19986 from 杨旭华/AGNEWS
2021-11-11 06:22:25 +00:00
Xiaoda Zhang a772767265 support reshape in sharding propagation:
1) using 'swc index of strategy_cost_' as reshape's selected strategy;
2) when encountering reshape in BFS, select the 'swc index' with zero communication cost;
3) when encountering a reshape that is already visited, check whether there exists communication between reshape and current operator. It is OK if communication happens between two configured operators;
4) currently, two consecutive reshapes are not supported;
5) adjusting BFS structure in graph_costmodel.cc;
6) adjusting some code in step_auto_parallel.cc to avoid cyclomatic complexity.
2021-11-11 11:35:43 +08:00
l00591931 9353bd10a4 Enable tuple as variable in optimizer 2021-11-11 11:31:05 +08:00
Megalomania c34bbabed9 [feat] [assistant] [I3T96M] add new loader AGNEWS 2021-11-09 23:51:19 -08:00
yangzhenzhang 8431ba616c add output strategy for op init 2021-11-10 15:35:45 +08:00
rescue 22e03ab12e Adding offload hardware accelerator. 2021-11-10 07:03:43 +00:00
i-robot f1f7731fb2 !25964 Fix serdes multithreading bug
Merge pull request !25964 from zetongzhao/serdes_multithreading
2021-11-09 15:48:06 +00:00
i-robot 14c3517b9a !25452 Add Gradient Sharding
Merge pull request !25452 from huangxinjing/pipeline_shard_mini_step
2021-11-09 08:15:23 +00:00
huangbingjian d0ca18b921 Add global Py param when processing global namespace info. 2021-11-09 09:34:30 +08:00
huangxinjing f354ab22a3 add pipeline shard interface
Add support for no pipeline accugradient

Add delay tag for fusion op

Optimizer the visite order

add mirror for mini step control

Move the group to attributes

Add gradient_shard control for the mini step

Fix code stype

Fix ut description

Add interface
2021-11-09 09:11:13 +08:00
i-robot d89a39c661 !25851 MD Profiling Start and Stop Support
Merge pull request !25851 from cathwong/ckw_prof_startstop4
2021-11-08 16:16:42 +00:00
i-robot 527abb8ede !26003 [MD] Added restrictions on shuffle and num_samples
Merge pull request !26003 from liyong126/fix_shuffle_and_num_samples
2021-11-08 11:58:08 +00:00
kman066 4ebec36ab2 add lpnorm 2021-11-08 19:36:13 +08:00
i-robot efc33a8225 !25745 F.grad support get gradient by position
Merge pull request !25745 from zhang_sss/grad
2021-11-08 08:59:23 +00:00
liyong 79891feadb fix shuffle and num_samples issue 2021-11-08 15:33:01 +08:00
zhang__sss 8bae4d9d50 grad 2021-11-08 14:12:58 +08:00
Cathy Wong cdf3126459 MD Profiler Start Stop Support 2021-11-05 19:46:39 -04:00
zetongzhao 5e8377ea5c fix multithreading bug 2021-11-05 16:49:18 -04:00
i-robot ded1c77bbf !25765 neighborExchangeV2 & grad
Merge pull request !25765 from TuDouNi/neighborExchangeV2
2021-11-05 09:31:03 +00:00
ttudu e953c15cd2 NeighborExchangeV2 & Grad 2021-11-05 11:00:46 +08:00
i-robot 7c14f984ed !25793 add output strategy for shard
Merge pull request !25793 from yangzhenzhang/add-output-strategy
2021-11-05 01:19:01 +00:00
i-robot 76f4f77cc2 !24520 Add graph run history to dump structure
Merge pull request !24520 from parastooashtari/multi_root_graph_dump
2021-11-04 12:55:01 +00:00
i-robot 92b81d3221 !23257 [assistant][ops][DBToAmplitudeOp]
Merge pull request !23257 from 杨旭华/DBToAmplitude
2021-11-04 10:32:32 +00:00
yangzhenzhang 6ad6304b77 add output strategy 2021-11-04 16:28:54 +08:00
i-robot 2828f317f7 !25718 optimize implicit convert error message
Merge pull request !25718 from chujinjin/optimize_implicit_convert_error_msg
2021-11-03 12:31:56 +00:00
yujianfeng fc769a79fe Fix the unloadable bprop mindir files 2021-11-03 14:29:56 +08:00
Isaac 69f57bc5b1 [feat][assistant][I40GXD]add new data operator DBToAmplitude 2021-11-02 23:45:27 +08:00
parastooashtari 1a59dc37bf add graph execution order history to dump 2021-11-02 11:00:38 -04:00
chujinjin 26410ccf75 optimize implicit convert error message 2021-11-01 17:34:11 +08:00
liyong 41e8280f55 add mindrecord overwrite 2021-11-01 10:44:20 +08:00
i-robot 45882752ba !25644 [Fallback] Support builtin type
Merge pull request !25644 from huangbingjian/fallback_set
2021-10-30 10:01:52 +00:00
i-robot f16ed11237 !25651 Add some fallback testcases
Merge pull request !25651 from Margaret_wangrui/fallback_tests
2021-10-30 09:21:46 +00:00
huangbingjian 5063ee55bc [Fallback] Support builtin type: set, dict, slice, bool, int, float, str 2021-10-30 14:54:59 +08:00
yujianfeng 195563c67f Fix the random failure of ut tests in ci 2021-10-30 14:09:12 +08:00
i-robot b27520b6ae !25640 fix minddata ut core
Merge pull request !25640 from luoyang/serving
2021-10-30 01:35:32 +00:00
i-robot 7d50c3d5d7 !25551 [Fallback] Added test cases for python built-in functions
Merge pull request !25551 from huangbingjian/add_fallback_testcases
2021-10-29 09:15:19 +00:00
luoyang beba798e00 fix minddata ut core 2021-10-29 16:28:22 +08:00
i-robot 958c2a8e00 !25560 Support bytes input for decode op
Merge pull request !25560 from luoyang/serving
2021-10-29 06:47:02 +00:00
Margaret_wangrui 6275cdcf7a add fallback testcases 2021-10-29 12:02:16 +08:00
i-robot e43d0ee554 !25613 [MD] fix dataset ut part06
Merge pull request !25613 from liyong126/fix_md_ut_part06
2021-10-29 03:32:27 +00:00
i-robot 48699c939c !25544 add parallel op for resizenearestneighbor
Merge pull request !25544 from yangzhenzhang/add-parallel-op-for-resizenearestneighbor
2021-10-29 02:47:49 +00:00
liyong b9bad0bdbb fix md ut part06 2021-10-29 10:26:34 +08:00
huangbingjian 02f72ab3ae [Fallback] Added test cases for python built-in functions 2021-10-29 09:33:16 +08:00
i-robot 357ad46cb1 !25585 Enable JIT Fallback in default.
Merge pull request !25585 from 张清华/opt_jit_fallback
2021-10-28 17:30:50 +00:00
Zhang Qinghua e8b421fe6e Enable JIT Fallback in default. 2021-10-28 20:18:06 +08:00
i-robot 8758830723 !25479 delete mindquantum c++ simulator
Merge pull request !25479 from donghufeng/master
2021-10-28 08:14:18 +00:00
luoyang b47ac46e92 Support bytes input for decode op 2021-10-28 15:22:50 +08:00
yangzhenzhang c42081619e add parallel op for resizenearestneighbor 2021-10-28 11:31:00 +08:00
i-robot a7834c382f !25511 Add some fallback testcases
Merge pull request !25511 from Margaret_wangrui/fallback_tests
2021-10-28 02:28:20 +00:00
Margaret_wangrui 7738f55f44 Add some fallback testcases 2021-10-28 09:15:24 +08:00
i-robot 418e1b425b !23490 [assistant][ops] Add New Math Operator IsNan
Merge pull request !23490 from 孟权令/IsNan
2021-10-27 12:15:41 +00:00
xuxusheng 7a9a4d0515 delete mindquantum simulator 2021-10-27 18:35:35 +08:00
i-robot 360e228f45 !25358 Fix fallback and cell kwargs issues.
Merge pull request !25358 from 张清华/opt_fallback
2021-10-27 09:07:55 +00:00
Sawyer c032d1f83c [feat][assistant][I3T92O]add new operator IsNan 2021-10-27 16:14:03 +08:00
i-robot 180b071122 !22149 [assistant][ops] Add New IsInf
Merge pull request !22149 from 孟权令/IsInf
2021-10-27 07:41:15 +00:00
Zhang Qinghua b43693be23 Fix fallback and cell kwargs issues. 2021-10-27 14:06:02 +08:00
i-robot 74977e548d !24624 [Autotune] Modify MD callback and AddWorker logic to ParallelOps
Merge pull request !24624 from h.farahat/add_worker
2021-10-27 00:41:20 +00:00
i-robot c0f6286fcb !25092 [MD] API for autotune
Merge pull request !25092 from harshvardhangupta/auto_tune_api
2021-10-26 18:14:43 +00:00
i-robot 704c490e80 !25449 MD UT - Add missing set and restore seed for parallel test execution
Merge pull request !25449 from cathwong/ckw_ut_py_parallel
2021-10-26 17:53:39 +00:00
Cathy Wong e66aba9ef5 MD UT - Add missing set and restore seed.
test_places365_content_check - delete visualize_dataset
2021-10-26 13:19:47 -04:00
harshvardhangupta 1bb45142c9 Implement autotune api 2021-10-26 11:26:13 -04:00
doit cd9242eaa9 [feat] [assistant] [I3T92M] add new math operator IsInf 2021-10-25 14:40:40 +08:00
huangbingjian d7e97dd74a change EXCEPTION level to CRITICAL level 2021-10-25 14:25:50 +08:00
i-robot 6f413ee29d !25155 Support ops, nn and numpy namespaces, and add test case.
Merge pull request !25155 from 张清华/opt_fallback
2021-10-23 03:50:53 +00:00
Zhang Qinghua 6a79e262ae Support ops, nn and numpy namespaces, and add test case. 2021-10-22 16:31:30 +08:00
i-robot c544af28b6 !25286 dataset: modify profiling ut for parallel running
Merge pull request !25286 from ms_yan/ut_parallel
2021-10-22 08:09:03 +00:00
ms_yan bb314ad07f make ut parallel 2021-10-22 13:17:43 +08:00
i-robot cf0029b33a !25277 [MD] fix mindrecord ut part05
Merge pull request !25277 from liyong126/fix_md_ut_05
2021-10-22 01:43:03 +00:00
i-robot 782874bf18 !21215 [MS][crowdfunding]New operator implementation, include phaser
Merge pull request !21215 from Wangsong95/phaser
2021-10-22 01:08:50 +00:00
hesham 85e077b60b Callback changes
AddWorker logic to parallel ops
2021-10-21 17:35:11 -04:00
liyong 7c9f6899a3 fix md ut part05 2021-10-21 20:40:09 +08:00
i-robot b7d8bcfe8d !25177 [MD] fix mindrecord ut part04
Merge pull request !25177 from liyong126/fix_md_ut_part04
2021-10-21 01:39:26 +00:00
i-robot 5d8be044c9 !18018 [assistant][ops]New operator implementation, include FashionMnistDataset
Merge pull request !18018 from 张璇/fashionmnist_dataset
2021-10-20 06:42:54 +00:00
i-robot f9bd640b09 !16269 [assistant][RandomLighting]
Merge pull request !16269 from QingfengLi/randomlighting
2021-10-20 06:42:12 +00:00
liyong fc5ea9cc1c fix dataset ut for running independently 2021-10-20 14:27:36 +08:00
i-robot ae87f31dea !25088 Optimize the comment and log descriptions for the python source code
Merge pull request !25088 from zhunaipan/master
2021-10-20 06:26:56 +00:00
zhunaipan 8ce4e62725 optimize the comment and log description
修改:     ops/operations/_inner_ops.py
	修改:     ops/operations/_quant_ops.py
	修改:     ops/operations/array_ops.py
	修改:     ops/operations/comm_ops.py
	修改:     ops/operations/math_ops.py
	修改:     ops/operations/quantum_ops.py
	修改:     ops/operations/rl_ops.py
	修改:     ops/operations/sponge_ops.py
	修改:     ops/operations/sponge_update_ops.py
	修改:     train/__init__.py
	修改:     common/tensor.py
	修改:     train/serialization.py
	修改:     ccsrc/pipeline/jit/parse/parse.h
	修改:     explainer/benchmark/_attribution/metric.py
	修改:     ops/composite/multitype_ops/_constexpr_utils.py
	修改:     ops/operations/comm_ops.py

	修改:     RELEASE.md
	修改:     mindspore/_extends/parse/standard_method.py
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/concat_offset_cpu_kernel.cc
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/dynamic_shape_cpu_kernel.cc
	修改:     mindspore/ccsrc/frontend/parallel/ops_info/reshape_info.cc
	修改:     mindspore/ccsrc/frontend/parallel/ops_info/tile_info.cc
	修改:     mindspore/ccsrc/frontend/parallel/ops_info/transpose_info.cc
	修改:     mindspore/ccsrc/frontend/parallel/strategy.h
	修改:     mindspore/common/tensor.py
	修改:     mindspore/core/abstract/prim_arrays.cc
	修改:     mindspore/core/abstract/prim_nn.cc
	修改:     mindspore/core/ops/conv2d.cc
	修改:     mindspore/core/ops/logical_and.h
	修改:     mindspore/core/ops/logical_not.h
	修改:     mindspore/core/ops/logical_or.h
	修改:     mindspore/core/ops/reduce_all.h
	修改:     mindspore/core/ops/reduce_any.h
	修改:     mindspore/lite/src/runtime/kernel/arm/fp32_grad/sgd.cc
	修改:     mindspore/nn/layer/quant.py
	修改:     mindspore/nn/optim/sgd.py
	修改:     mindspore/nn/sparse/sparse.py
	修改:     mindspore/numpy/array_creations.py
	修改:     mindspore/numpy/array_ops.py
	修改:     mindspore/numpy/logic_ops.py
	修改:     mindspore/numpy/math_ops.py
	修改:     mindspore/ops/operations/_inner_ops.py
	修改:     mindspore/ops/operations/array_ops.py
	修改:     mindspore/ops/operations/rl_ops.py
	修改:     mindspore/train/_utils.py
	修改:     tests/ut/python/model/test_lenet_core_after_exception.py

	修改:     mindspore/_extends/parse/standard_method.py
	修改:     mindspore/ops/operations/rl_ops.py

	修改:     mindspore/core/abstract/prim_nn.cc
	修改:     mindspore/core/ops/conv2d.cc

	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/ctcloss_cpu_kernel.cc
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/fl/fused_pull_weight_kernel.h
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/fl/fused_push_weight_kernel.h
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/mkldnn/conv2d_grad_filter_cpu_kernel.cc
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/mkldnn/conv2d_grad_input_cpu_kernel.cc
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/ps/sparse_apply_ftrl_ps_kernel.cc
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/ps/sparse_apply_lazy_adam_ps_kernel.cc
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/rolling_cpu_kernel.cc
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/scatter_arithmetic_cpu_kernel.cc
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/split_cpu_kernel.cc
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/update_cache_cpu_kernel.cc
	修改:     mindspore/ccsrc/backend/kernel_compiler/gpu/arrays/split_gpu_kernel.h
	修改:     mindspore/ccsrc/backend/kernel_compiler/gpu/math/broadcast_gpu_kernel.h
	修改:     mindspore/ccsrc/backend/kernel_compiler/gpu/nn/conv2d_grad_input_gpu_kernel.h
	修改:     mindspore/ccsrc/fl/server/server.cc
	修改:     mindspore/ccsrc/frontend/optimizer/ad/kpynative.cc
	修改:     mindspore/ccsrc/frontend/optimizer/irpass/incorporate_getitem.h
	修改:     mindspore/ccsrc/frontend/optimizer/irpass/inline.h
	修改:     mindspore/ccsrc/minddata/dataset/core/device_tensor.cc
	修改:     mindspore/ccsrc/minddata/dataset/core/tensor.cc
	修改:     mindspore/ccsrc/minddata/dataset/engine/datasetops/source/emnist_op.cc
	修改:     mindspore/ccsrc/minddata/dataset/engine/datasetops/source/mnist_op.cc
	修改:     mindspore/ccsrc/minddata/dataset/engine/datasetops/source/qmnist_op.cc
	修改:     mindspore/ccsrc/minddata/dataset/engine/ir/datasetops/dataset_node.cc
	修改:     mindspore/ccsrc/minddata/dataset/engine/opt/pre/epoch_ctrl_pass.cc
	修改:     mindspore/ccsrc/minddata/dataset/kernels/image/lite_image_utils.cc
	修改:     mindspore/ccsrc/pipeline/jit/action.cc
	修改:     mindspore/ccsrc/pipeline/jit/static_analysis/evaluator.cc
	修改:     mindspore/ccsrc/runtime/device/ascend/executor/tiling/op_tiling_adapter.cc
	修改:     mindspore/compression/quant/quant_utils.py
	修改:     mindspore/core/abstract/prim_nn.cc
	修改:     mindspore/dataset/engine/validators.py
	修改:     mindspore/lite/micro/coder/opcoders/nnacl/fp32/affine_fp32_coder.cc
	修改:     mindspore/lite/micro/coder/opcoders/nnacl/int8/affine_int8_coder.cc
	修改:     mindspore/lite/src/runtime/kernel/ascend310/src/custom_kernel.cc
	修改:     mindspore/lite/src/runtime/kernel/opencl/kernel/matmul.cc
	修改:     mindspore/lite/src/runtime/kernel/opencl/kernel/strassen.cc
	修改:     mindspore/lite/tools/common/graph_util.h
	修改:     mindspore/lite/tools/optimizer/fisson/fisson_util.cc
	修改:     mindspore/ops/composite/math_ops.py
	修改:     mindspore/ops/operations/_inner_ops.py
	修改:     mindspore/ops/operations/array_ops.py
	修改:     mindspore/ops/operations/math_ops.py
	修改:     mindspore/ops/operations/other_ops.py

	修改:     mindspore/boost/boost_cell_wrapper.py
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/update_cache_cpu_kernel.cc
	修改:     mindspore/ccsrc/common/trans.cc
	修改:     mindspore/ccsrc/frontend/parallel/cache_embedding/cache_embedding.cc
	修改:     mindspore/ccsrc/frontend/parallel/ops_info/gather_info.cc
	修改:     mindspore/lite/src/common/log_util.h
	修改:     mindspore/nn/wrap/loss_scale.py
	修改:     mindspore/parallel/nn/moe.py
	修改:     tests/mindspore_test_framework/mindspore_test.py

	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/split_cpu_kernel.cc
	修改:     mindspore/lite/tools/common/graph_util.h

	修改:     mindspore/ccsrc/frontend/parallel/ops_info/gather_info.cc

	修改:     mindspore/core/ops/conv2d.cc

	修改:     tests/ut/python/model/test_lenet_core_after_exception.py
2021-10-20 12:02:40 +08:00
i-robot ef7bc4ddda !25079 Change dir hash to file hash in bprop mindir
Merge pull request !25079 from YuJianfeng/bprop_mindir
2021-10-20 02:54:05 +00:00
“uccInf” fe3123cfe8 [feat][assistant][I3J6V4] add new data operator FashionMnist 2021-10-20 02:37:56 +00:00
i-robot 440036d331 !24362 [assistant][ops]New operator implementation, include PhotoTourDataset
Merge pull request !24362 from Wangsong95/phototour_dataset
2021-10-20 01:46:05 +00:00
yangyueren 6594b90a58 [feat][assistant][I3J6VE] add new data operator PhotoTour 2021-10-19 15:31:32 +00:00
chenx2ovo 77caf907c4 [feat][assistant][I3CEGR] add op random lighting 2021-10-19 20:38:01 +08:00
yujianfeng 42079ac087 Change dir hash to file hash in bprop mindir 2021-10-19 19:22:25 +08:00
liyong a89741c32e fix md ut part03 2021-10-19 16:52:57 +08:00
i-robot 690642d672 !18664 [assistant][ops]New operator implementation, include Places365Dataset
Merge pull request !18664 from Wangsong95/places365_dataset
2021-10-19 07:06:35 +00:00
i-robot c97d3eeef7 !25100 [MD] fix mindrecord ut part02
Merge pull request !25100 from liyong126/fix_md_ut_part02
2021-10-19 06:30:57 +00:00
i-robot 1606f19dfb !18265 [assistant][ops] Add new audio operator CreateDct
Merge pull request !18265 from 杨旭华/CreateDct
2021-10-19 06:30:18 +00:00
liyong d23961b98f fix mindrecord ut 2021-10-19 11:43:52 +08:00
i-robot e7ea546194 !25006 [MD] fix mindrecord ut
Merge pull request !25006 from liyong126/fix_md_ut
2021-10-19 02:02:13 +00:00
i-robot d9cfda44c4 !25060 ut_fix
Merge pull request !25060 from wanyiming/ut_fix
2021-10-19 00:59:01 +00:00
i-robot e3d8edc530 !24475 Implement the dict.items() interface and the multiplication operation of numbers and lists or tuples
Merge pull request !24475 from 翟之博/master
2021-10-18 11:39:27 +00:00
i-robot 8df1bd14a1 !24986 Change printed log's level in dump_proto.cc
Merge pull request !24986 from huanghui/change-log-level
2021-10-18 11:36:44 +00:00
tophand 4f4777f0da [feat][assistant][I3J6U2] Add new audio operator CreateDct 2021-10-18 03:23:18 -07:00
wanyiming 4fbc59a98a utfixs 2021-10-18 18:06:37 +08:00
liyong d9aa18dfca refactor md ut 2021-10-18 17:55:28 +08:00
i-robot 9d0d094437 !24554 support nested call of ms_function
Merge pull request !24554 from zhangzhaoju/ms_master_ms_function
2021-10-18 09:36:30 +00:00
zzb 95425b770d iml dict.items() and multiplication op 2021-10-18 12:47:22 +08:00
zx d13d2413f5 [feat][assistant][I3J6UV] add new audio operator Phaser 2021-10-16 08:45:12 +08:00
yangyueren 951193c308 [feat][assistant][I3J6VF] add new data operator Places365 2021-10-15 14:56:09 +00:00
Xiao Tianci 930a5b89c0 fix api docs of audio 2021-10-15 17:17:18 +08:00
i-robot be691284e2 !18407 [assistant][MulLawEncoding]
Merge pull request !18407 from QingfengLi/mulawencoding
2021-10-15 09:03:41 +00:00
i-robot 44fe11c656 !24805 fix_fronted_ut
Merge pull request !24805 from wanyiming/fix_uts
2021-10-15 09:01:35 +00:00
zhangzhaoju b4453709a2 Support parser decoratored functions
like nested calling of ms_function
2021-10-15 16:41:08 +08:00
wanyiming 8b40e77201 ut_fixed 2021-10-15 15:54:26 +08:00
huanghui 3785b6d1b4 change printed log's level 2021-10-15 15:49:08 +08:00
chujinjin 3c3d8c3962 remove useless python ut 2021-10-15 15:26:45 +08:00
i-robot b27623ae37 !24899 modify ut of probability
Merge pull request !24899 from byweng/master
2021-10-15 02:02:52 +00:00
robert_luo_yibo 75e2c3041c [feat][assistant][I3CEG3] add new data OP MuLawEncoding 2021-10-14 20:24:18 +08:00
Bingya Weng be20f00299 modify ut of probability 2021-10-14 19:33:34 +08:00
i-robot f83070728d !24790 support user define strategy gen method under auto parallel context
Merge pull request !24790 from zhuyuxiao/master
2021-10-14 09:03:36 +00:00
chujinjin 90836f70a0 fix context python ut error 2021-10-14 14:27:50 +08:00
i-robot 957f9a7b4e !24839 UT case runs failed in PyNative mode
Merge pull request !24839 from JoyLvliang/ut_run_failed_in_pynative_mode
2021-10-14 06:15:28 +00:00
i-robot 65f08a6c4c !24804 parallel ut modify
Merge pull request !24804 from yao_yf/parallel_ut_modify
2021-10-14 01:24:12 +00:00
i-robot 470de9bcaa !21258 [assistant][ops]New operator implementation, include ApplyKerasMomentumD
Merge pull request !21258 from 梁秀波/ApplyKerasMomentumD
2021-10-14 01:05:23 +00:00
7347157+joylvliang@user.noreply.gitee.com aecbdf3c3b ut_run_failed_in_pynative_mode 2021-10-13 18:46:27 +08:00
i-robot 1b9b85bbb2 !17851 [assistant][ops]New operator implementation, include FakeImageDataset
Merge pull request !17851 from 张璇/fakeimage_dataset
2021-10-13 09:22:55 +00:00
yao_yf 636f82a466 parallel ut modify 2021-10-13 14:28:13 +08:00
zhuyuxiao 1907246931 change api 2021-10-13 10:28:30 +08:00
i-robot 3fd94000c5 !24568 Apply batch parallel in auto_parallel mode when strategies are not specified
Merge pull request !24568 from zhuyuxiao/master
2021-10-13 01:20:15 +00:00
i-robot 18e632c7a1 !21216 [MS][crowdfunding]New operator implementation, include Overdirve
Merge pull request !21216 from Wangsong95/overdrive
2021-10-13 01:08:36 +00:00
G-Dragon-Liu d2f22a8726 [feat][assistant][I3J6V3] add new data operator FakeImage 2021-10-12 14:00:43 +00:00
zx 9b7d7be65c [feat][assistant][I3J6UU] add new audio operator Overdrive 2021-10-12 18:10:31 +08:00
zhuyuxiao cf76c76745 apply batch parallel in auto_parallel mode when strategies are not specified 2021-10-12 15:44:10 +08:00
yao_yf b303d6001c parallel ut refactor 2021-10-12 15:18:51 +08:00
huanghui 1af32f74f9 support None argument for the outermost net 2021-10-11 16:00:57 +08:00
i-robot b9c2a84d3b !17812 [assistant][ops] Add a new audio operator Flanger
Merge pull request !17812 from 杨旭华/Flanger
2021-10-09 08:15:33 +00:00
li-qiyao 2283442855 [feat][assistant][I3J6U9] add new data operator Flanger 2021-10-08 05:03:31 -07:00
i-robot ea53466848 !24490 Extend the completeness of the mindspore static graph mode, so that the filter function is supported in the construct function
Merge pull request !24490 from 卢逸飞/MindSpore/master
2021-10-08 10:35:29 +00:00
i-robot 8598d08351 !17820 [assistant][ops]New operator implementation, include EMnistDataset
Merge pull request !17820 from 张璇/emnist_dataset
2021-10-08 07:18:31 +00:00
i-robot 02f9e3e077 !17805 [assistant][ops] Add new audio operator DetectPitchFrequency
Merge pull request !17805 from 杨旭华/DetectPitchFrequency
2021-10-08 03:34:46 +00:00
G-Dragon-Liu 32baa520bf [feat][assistant][I3J6V2] add new data operator EMnist 2021-10-08 02:53:00 +00:00
John Tzanakakis 7e7b444c63 remove verbose option from DbgServices 2021-10-06 11:38:05 -04:00
Lu 9f68d43c32 Construct supports the filter function. 2021-09-30 15:18:05 +08:00
i-robot dddea1803d !24361 context api 0928
Merge pull request !24361 from mindspore_ding/context_master_0928
2021-09-30 06:45:28 +00:00
dingpeifei 89f9d0f263 api context 0927 2021-09-29 23:15:36 +08:00
Zhang Lian b7e6520e62 [feat] [assistant] [I3J6U8] Add a new audio operator DetectPitchFrequency 2021-09-29 15:12:58 +08:00
despicablemme 75ade61acf [feat] [assistant] [I40GGE] add new Ascend operator CeLU 2021-09-28 14:58:25 +08:00
i-robot 2cacf9cdc2 !24231 fix security wrap and code check
Merge pull request !24231 from jiangshuqiang/fix_code_check_master
2021-09-28 06:45:19 +00:00
i-robot 2085ab1774 !22831 [assistant][ops]add math ops Ger
Merge pull request !22831 from yangwm/ger
2021-09-28 06:27:35 +00:00
jiangshuqiang 13fc005562 fix security wrap 2021-09-28 11:59:45 +08:00
i-robot dd544a9693 !21406 [MS][crowdfunding]New operator implementation, include TrebleBiquad
Merge pull request !21406 from 张璇/treble_biquad
2021-09-27 14:18:00 +00:00
i-robot f16c003dfa !22610 [MS][crowdfunding]New operator implementation, RandomAdjustSharpness
Merge pull request !22610 from yangwm/sharpness
2021-09-27 09:20:05 +00:00
zorax 6098c1da5e [feat][assistant][I40FFO] add new Ascend operator ApplyKerasMomentum 2021-09-27 16:49:18 +08:00
zx 3da0f0f487 [feat][assistant][I3J6V0] add new audio operator TrebleBiquad 2021-09-27 13:01:26 +08:00
despicablemme d072a4e4bf [feat] [assistant] [I40GZE] add new data operator RandomAdjustSharpness 2021-09-27 11:19:33 +08:00
i-robot ab567574c4 !21451 [MS][crowdfunding]New operator implementation, include RiaaBiquad
Merge pull request !21451 from 张璇/riaa_biquad
2021-09-27 03:14:16 +00:00
i-robot 2969688382 !20047 [assistant][ops]New operator implementation, include QmnistDataset
Merge pull request !20047 from Wangsong95/qmnist_dataset
2021-09-27 01:36:08 +00:00
despicablemme 84337078b1 [feat] [assistant] [I40GGM] add new ascend operator Ger 2021-09-27 09:28:05 +08:00
i-robot e3bc280f22 !22532 [MS][crowdfunding]New operator implementation, RandomEqualize
Merge pull request !22532 from yangwm/equalize
2021-09-27 01:07:04 +00:00
i-robot b10df2da0c !21401 [assistant][ops]New operator implementation, include ExtractVolumePatches
Merge pull request !21401 from 梁秀波/ExtractVolumePatches
2021-09-26 09:52:43 +00:00
i-robot bb038292d4 !23905 fix error log
Merge pull request !23905 from lianliguang/more-info-for-infer-error
2021-09-26 06:23:34 +00:00
despicablemme 7063907bdc [feat] [assidtant] [I40GZN] add new data ops RandomEqualize 2021-09-25 18:00:25 +08:00
i-robot d0023355a3 !23205 Fix bus error with multiprocessing enabled, large image, shared_memory, single device
Merge pull request !23205 from RobinGrosman/mem_bus_failure
2021-09-24 19:16:12 +00:00
RobinGrosman c90efc0403 add check for shm available when num_devices=1 to avoid bus errors
-Required modifying tests to reduce memory usage to check doesn't fail during CI
-Also required fixing max_rowsize to be externalized from map+batch() function
2021-09-24 10:24:31 -07:00
hzw 2f5758a4a8 [feat][assistant][#I40FFZ] add new Ascend operator ExtractVolumePatches 2021-09-24 18:36:03 +08:00
i-robot ee38ffbd3d !22560 [MS][crowdfunding]New operator implementation, RandomAutoContrast
Merge pull request !22560 from yangwm/autocontrast
2021-09-24 09:34:37 +00:00
i-robot 7cde7731b0 !23537 Update pangu reshape and softmax.
Merge pull request !23537 from linqingke/pangu
2021-09-24 08:12:13 +00:00
i-robot 86392fdd3d !23982 fix the debug info about the cell function decorated by @ms_functon
Merge pull request !23982 from huanghui/fix-filename-error-with-ms_function
2021-09-24 06:43:35 +00:00
i-robot e7cb505e68 !23569 Produce parallel operators for ResizeBilinear and ResizeNearestNeighbor
Merge pull request !23569 from Bert0108/resizebilinear_parallel_ops
2021-09-24 03:05:23 +00:00
i-robot d37fccc56f !23544 remove deprecated gather op
Merge pull request !23544 from zhuyuxiao/master
2021-09-24 01:20:53 +00:00
Bert0108 2d3d0b673e parallel operators for ResizeBilinear and ResizeNearestNeighbor 2021-09-24 09:07:49 +08:00
linqingke acde7febef update pangu reshape and softmax performance.
Add layer norm judge

Fix layer norm name error

Fix input tyoe check

Fix ut test

Add 3d supports
2021-09-24 09:06:16 +08:00
zx 1d95e6f480 [feat][assistant][I3J6UY] add new audio operator RiaaBiquad 2021-09-23 21:36:59 +08:00
i-robot 79d1f3cfd3 !23854 Fix testcase about modelzoo
Merge pull request !23854 from chenhaozhe/fix-testcase-about-models
2021-09-23 12:27:42 +00:00
despicablemme 7a6b75c2e8 [feat] [assistant] [I40GZJ] add new data op RandomAutoContrast 2021-09-23 20:17:39 +08:00
i-robot ab9a7163cb !22175 [assistant][ops]New operator implementation, include Trunc
Merge pull request !22175 from 梁秀波/Trunc
2021-09-23 10:04:55 +00:00
i-robot 0c26736da1 !22276 [MS][crowdfunding]New operator implementation, RandomInvert
Merge pull request !22276 from yangwm/rinvert
2021-09-23 08:12:57 +00:00
lianliguang 7227b61979 modify info when infer error 2021-09-23 15:54:43 +08:00
i-robot 632e3b8dcd !23663 add exception level to python error report
Merge pull request !23663 from huangbingjian/py_log
2021-09-23 07:46:45 +00:00
huanghui 97250978c4 fix the debug info about the function decorated by @ms_functon 2021-09-23 14:43:02 +08:00
echo-yike 785558cdd2 [feat][assistant][I40FGD] add new Ascend operator Trunc 2021-09-23 14:27:35 +08:00
chenhaozhe 12fab451e8 fix test cases about models 2021-09-23 09:19:37 +08:00
i-robot 44b1dbf77f !23827 MD Python UT: Update num_epochs to appropriate value for iterators instead of using default value
Merge pull request !23827 from hetshah/hs_python_ut
2021-09-22 21:14:35 +00:00
hetshah 2c1666fd06 set num epochs for iterators that use the default value
add explicit paramter for infinite iterators

set appropriate value for num_epoch param for iteratos

fix long lines

remove trailing whitespace

fixed typo

remove comment

fixed comments

fixed test
2021-09-22 17:32:50 +00:00
despicablemme b977d8723b [feat] [assistant] [I40GZC] add new data ops RandomInvert 2021-09-22 16:55:14 +08:00
huangbingjian 3ee5d98a8d add exception level to python error report 2021-09-22 14:34:21 +08:00
ckczzj 001b68c286 [feat][assistant][I3J6VG] add new data operator QMnist 2021-09-22 12:13:27 +08:00
Zhang Qinghua 9fbd118319 Handle interpreted node as input, set function Parameters and update local params if need. 2021-09-18 17:34:50 +08:00
i-robot ebe094ac0f !21829 [assistant][ops] Add New Cdist and CdistGrad
Merge pull request !21829 from 孟权令/Cdist
2021-09-18 09:23:27 +00:00
i-robot e87f0be14f !23707 fix summary isolation
Merge pull request !23707 from jiangshuqiang/temp
2021-09-18 09:23:25 +00:00
i-robot 6489dacdab !18114 [assistant][ops]Add new operator Magphase
Merge pull request !18114 from YJfuel123/Magphase
2021-09-18 07:26:34 +00:00
i-robot 92287b86d8 !23471 Fix white list error msg synax error
Merge pull request !23471 from xiefangqi/md_white_list_optimization
2021-09-18 05:03:40 +00:00
jiangshuqiang c2bd061889 fix summary isolation 2021-09-18 10:59:14 +08:00
i-robot 95e56d0912 !23212 enable profiling warning
Merge pull request !23212 from mindspore_ding/enable_profiling_master_0910
2021-09-18 02:04:37 +00:00
zhoufeng 1f934bd782 check neighbor attr type
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2021-09-17 21:15:37 +08:00
dingpeifei 7523b320d7 enable profiling warning 2021-09-17 17:09:56 +08:00
葛崇林 a05a5de073 [feat][assistant][I3ALC5] add new method Magphase 2021-09-17 16:02:46 +08:00
i-robot f5af432e04 !16922 [assistant][Vol]
Merge pull request !16922 from QingfengLi/Vol
2021-09-17 06:51:49 +00:00
SichongHao 5412382e16 [feat][assistant][I3T91W][I3T91X]add new operator Cdist and CdistGrad 2021-09-17 13:58:53 +08:00
chenx2ovo 9e62623b4a [feat][assistant][I3CEGI] add op vol 2021-09-17 09:34:20 +08:00
ms_yan 0a365e91bf modify log in kernel part 2021-09-16 22:09:21 +08:00
i-robot a5b793463a !23099 Correct wrong info when using ms_function to decorate bprop
Merge pull request !23099 from JoyLvliang/correct_wrong_info_when_using_ms_function_with_bprop
2021-09-16 08:46:41 +00:00
i-robot 89119ae470 !23553 fix: pyfunc cause hung when it is a generator which can't be serialize
Merge pull request !23553 from guozhijian/fix_pyfunc_hung_when_yield
2021-09-16 08:44:50 +00:00