Nigel
/
mindspore
forked from mindspore-Ecosystem/mindspore
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
42,838 Commits 24 Branches 0 Tags 3.9 GiB
Commit Graph

3732 Commits

Author SHA1 Message Date
chenzhuo f36edec3ff add function jvp 2021-11-12 08:44:41 +08:00
i-robot 1792d5f8a4 !26131 Offload Hardware Acceleration Computing 
Merge pull request !26131 from alashkari/hw_accel_move_copy
 2021-11-11 13:18:07 +00:00
i-robot b910870ecc !19986 [assistant][ops] Add new dataset loading operator AGNEWS 
Merge pull request !19986 from 杨旭华/AGNEWS
 2021-11-11 06:22:25 +00:00
Xiaoda Zhang a772767265 support reshape in sharding propagation: 
1) using 'swc index of strategy_cost_' as reshape's selected strategy;
2) when encountering reshape in BFS, select the 'swc index' with zero communication cost;
3) when encountering a reshape that is already visited, check whether there exists communication between reshape and current operator. It is OK if communication happens between two configured operators;
4) currently, two consecutive reshapes are not supported;
5) adjusting BFS structure in graph_costmodel.cc;
6) adjusting some code in step_auto_parallel.cc to avoid cyclomatic complexity.
 2021-11-11 11:35:43 +08:00
l00591931 9353bd10a4 Enable tuple as variable in optimizer 2021-11-11 11:31:05 +08:00
Megalomania c34bbabed9 [feat] [assistant] [I3T96M] add new loader AGNEWS 2021-11-09 23:51:19 -08:00
yangzhenzhang 8431ba616c add output strategy for op init 2021-11-10 15:35:45 +08:00
rescue 22e03ab12e Adding offload hardware accelerator. 2021-11-10 07:03:43 +00:00
i-robot f1f7731fb2 !25964 Fix serdes multithreading bug 
Merge pull request !25964 from zetongzhao/serdes_multithreading
 2021-11-09 15:48:06 +00:00
i-robot 14c3517b9a !25452 Add Gradient Sharding 
Merge pull request !25452 from huangxinjing/pipeline_shard_mini_step
 2021-11-09 08:15:23 +00:00
huangbingjian d0ca18b921 Add global Py param when processing global namespace info. 2021-11-09 09:34:30 +08:00
huangxinjing f354ab22a3 add pipeline shard interface 
Add support for no pipeline accugradient

Add delay tag for fusion op

Optimizer the visite order

add mirror for mini step control

Move the group to attributes

Add gradient_shard control for the mini step

Fix code stype

Fix ut description

Add interface
 2021-11-09 09:11:13 +08:00
i-robot d89a39c661 !25851 MD Profiling Start and Stop Support 
Merge pull request !25851 from cathwong/ckw_prof_startstop4
 2021-11-08 16:16:42 +00:00
i-robot 527abb8ede !26003 [MD] Added restrictions on shuffle and num_samples 
Merge pull request !26003 from liyong126/fix_shuffle_and_num_samples
 2021-11-08 11:58:08 +00:00
kman066 4ebec36ab2 add lpnorm 2021-11-08 19:36:13 +08:00
i-robot efc33a8225 !25745 F.grad support get gradient by position 
Merge pull request !25745 from zhang_sss/grad
 2021-11-08 08:59:23 +00:00
liyong 79891feadb fix shuffle and num_samples issue 2021-11-08 15:33:01 +08:00
zhang__sss 8bae4d9d50 grad 2021-11-08 14:12:58 +08:00
Cathy Wong cdf3126459 MD Profiler Start Stop Support 2021-11-05 19:46:39 -04:00
zetongzhao 5e8377ea5c fix multithreading bug 2021-11-05 16:49:18 -04:00
i-robot ded1c77bbf !25765 neighborExchangeV2 & grad 
Merge pull request !25765 from TuDouNi/neighborExchangeV2
 2021-11-05 09:31:03 +00:00
ttudu e953c15cd2 NeighborExchangeV2 & Grad 2021-11-05 11:00:46 +08:00
i-robot 7c14f984ed !25793 add output strategy for shard 
Merge pull request !25793 from yangzhenzhang/add-output-strategy
 2021-11-05 01:19:01 +00:00
i-robot 76f4f77cc2 !24520 Add graph run history to dump structure 
Merge pull request !24520 from parastooashtari/multi_root_graph_dump
 2021-11-04 12:55:01 +00:00
i-robot 92b81d3221 !23257 [assistant][ops][DBToAmplitudeOp] 
Merge pull request !23257 from 杨旭华/DBToAmplitude
 2021-11-04 10:32:32 +00:00
yangzhenzhang 6ad6304b77 add output strategy 2021-11-04 16:28:54 +08:00
i-robot 2828f317f7 !25718 optimize implicit convert error message 
Merge pull request !25718 from chujinjin/optimize_implicit_convert_error_msg
 2021-11-03 12:31:56 +00:00
yujianfeng fc769a79fe Fix the unloadable bprop mindir files 2021-11-03 14:29:56 +08:00
Isaac 69f57bc5b1 [feat][assistant][I40GXD]add new data operator DBToAmplitude 2021-11-02 23:45:27 +08:00
parastooashtari 1a59dc37bf add graph execution order history to dump 2021-11-02 11:00:38 -04:00
chujinjin 26410ccf75 optimize implicit convert error message 2021-11-01 17:34:11 +08:00
liyong 41e8280f55 add mindrecord overwrite 2021-11-01 10:44:20 +08:00
i-robot 45882752ba !25644 [Fallback] Support builtin type 
Merge pull request !25644 from huangbingjian/fallback_set
 2021-10-30 10:01:52 +00:00
i-robot f16ed11237 !25651 Add some fallback testcases 
Merge pull request !25651 from Margaret_wangrui/fallback_tests
 2021-10-30 09:21:46 +00:00
huangbingjian 5063ee55bc [Fallback] Support builtin type: set, dict, slice, bool, int, float, str 2021-10-30 14:54:59 +08:00
yujianfeng 195563c67f Fix the random failure of ut tests in ci 2021-10-30 14:09:12 +08:00
i-robot b27520b6ae !25640 fix minddata ut core 
Merge pull request !25640 from luoyang/serving
 2021-10-30 01:35:32 +00:00
i-robot 7d50c3d5d7 !25551 [Fallback] Added test cases for python built-in functions 
Merge pull request !25551 from huangbingjian/add_fallback_testcases
 2021-10-29 09:15:19 +00:00
luoyang beba798e00 fix minddata ut core 2021-10-29 16:28:22 +08:00
i-robot 958c2a8e00 !25560 Support bytes input for decode op 
Merge pull request !25560 from luoyang/serving
 2021-10-29 06:47:02 +00:00
Margaret_wangrui 6275cdcf7a add fallback testcases 2021-10-29 12:02:16 +08:00
i-robot e43d0ee554 !25613 [MD] fix dataset ut part06 
Merge pull request !25613 from liyong126/fix_md_ut_part06
 2021-10-29 03:32:27 +00:00
i-robot 48699c939c !25544 add parallel op for resizenearestneighbor 
Merge pull request !25544 from yangzhenzhang/add-parallel-op-for-resizenearestneighbor
 2021-10-29 02:47:49 +00:00
liyong b9bad0bdbb fix md ut part06 2021-10-29 10:26:34 +08:00
huangbingjian 02f72ab3ae [Fallback] Added test cases for python built-in functions 2021-10-29 09:33:16 +08:00
i-robot 357ad46cb1 !25585 Enable JIT Fallback in default. 
Merge pull request !25585 from 张清华/opt_jit_fallback
 2021-10-28 17:30:50 +00:00
Zhang Qinghua e8b421fe6e Enable JIT Fallback in default. 2021-10-28 20:18:06 +08:00
i-robot 8758830723 !25479 delete mindquantum c++ simulator 
Merge pull request !25479 from donghufeng/master
 2021-10-28 08:14:18 +00:00
luoyang b47ac46e92 Support bytes input for decode op 2021-10-28 15:22:50 +08:00
yangzhenzhang c42081619e add parallel op for resizenearestneighbor 2021-10-28 11:31:00 +08:00
i-robot a7834c382f !25511 Add some fallback testcases 
Merge pull request !25511 from Margaret_wangrui/fallback_tests
 2021-10-28 02:28:20 +00:00
Margaret_wangrui 7738f55f44 Add some fallback testcases 2021-10-28 09:15:24 +08:00
i-robot 418e1b425b !23490 [assistant][ops] Add New Math Operator IsNan 
Merge pull request !23490 from 孟权令/IsNan
 2021-10-27 12:15:41 +00:00
xuxusheng 7a9a4d0515 delete mindquantum simulator 2021-10-27 18:35:35 +08:00
i-robot 360e228f45 !25358 Fix fallback and cell kwargs issues. 
Merge pull request !25358 from 张清华/opt_fallback
 2021-10-27 09:07:55 +00:00
Sawyer c032d1f83c [feat][assistant][I3T92O]add new operator IsNan 2021-10-27 16:14:03 +08:00
i-robot 180b071122 !22149 [assistant][ops] Add New IsInf 
Merge pull request !22149 from 孟权令/IsInf
 2021-10-27 07:41:15 +00:00
Zhang Qinghua b43693be23 Fix fallback and cell kwargs issues. 2021-10-27 14:06:02 +08:00
i-robot 74977e548d !24624 [Autotune] Modify MD callback and AddWorker logic to ParallelOps 
Merge pull request !24624 from h.farahat/add_worker
 2021-10-27 00:41:20 +00:00
i-robot c0f6286fcb !25092 [MD] API for autotune 
Merge pull request !25092 from harshvardhangupta/auto_tune_api
 2021-10-26 18:14:43 +00:00
i-robot 704c490e80 !25449 MD UT - Add missing set and restore seed for parallel test execution 
Merge pull request !25449 from cathwong/ckw_ut_py_parallel
 2021-10-26 17:53:39 +00:00
Cathy Wong e66aba9ef5 MD UT - Add missing set and restore seed. 
test_places365_content_check - delete visualize_dataset
 2021-10-26 13:19:47 -04:00
harshvardhangupta 1bb45142c9 Implement autotune api 2021-10-26 11:26:13 -04:00
doit cd9242eaa9 [feat] [assistant] [I3T92M] add new math operator IsInf 2021-10-25 14:40:40 +08:00
huangbingjian d7e97dd74a change EXCEPTION level to CRITICAL level 2021-10-25 14:25:50 +08:00
i-robot 6f413ee29d !25155 Support ops, nn and numpy namespaces, and add test case. 
Merge pull request !25155 from 张清华/opt_fallback
 2021-10-23 03:50:53 +00:00
Zhang Qinghua 6a79e262ae Support ops, nn and numpy namespaces, and add test case. 2021-10-22 16:31:30 +08:00
i-robot c544af28b6 !25286 dataset: modify profiling ut for parallel running 
Merge pull request !25286 from ms_yan/ut_parallel
 2021-10-22 08:09:03 +00:00
ms_yan bb314ad07f make ut parallel 2021-10-22 13:17:43 +08:00
i-robot cf0029b33a !25277 [MD] fix mindrecord ut part05 
Merge pull request !25277 from liyong126/fix_md_ut_05
 2021-10-22 01:43:03 +00:00
i-robot 782874bf18 !21215 [MS][crowdfunding]New operator implementation, include phaser 
Merge pull request !21215 from Wangsong95/phaser
 2021-10-22 01:08:50 +00:00
hesham 85e077b60b Callback changes 
AddWorker logic to parallel ops
 2021-10-21 17:35:11 -04:00
liyong 7c9f6899a3 fix md ut part05 2021-10-21 20:40:09 +08:00
i-robot b7d8bcfe8d !25177 [MD] fix mindrecord ut part04 
Merge pull request !25177 from liyong126/fix_md_ut_part04
 2021-10-21 01:39:26 +00:00
i-robot 5d8be044c9 !18018 [assistant][ops]New operator implementation, include FashionMnistDataset 
Merge pull request !18018 from 张璇/fashionmnist_dataset
 2021-10-20 06:42:54 +00:00
i-robot f9bd640b09 !16269 [assistant][RandomLighting] 
Merge pull request !16269 from QingfengLi/randomlighting
 2021-10-20 06:42:12 +00:00
liyong fc5ea9cc1c fix dataset ut for running independently 2021-10-20 14:27:36 +08:00
i-robot ae87f31dea !25088 Optimize the comment and log descriptions for the python source code 
Merge pull request !25088 from zhunaipan/master
 2021-10-20 06:26:56 +00:00
zhunaipan 8ce4e62725 optimize the comment and log description 
修改：     ops/operations/_inner_ops.py
	修改：     ops/operations/_quant_ops.py
	修改：     ops/operations/array_ops.py
	修改：     ops/operations/comm_ops.py
	修改：     ops/operations/math_ops.py
	修改：     ops/operations/quantum_ops.py
	修改：     ops/operations/rl_ops.py
	修改：     ops/operations/sponge_ops.py
	修改：     ops/operations/sponge_update_ops.py
	修改：     train/__init__.py
	修改：     common/tensor.py
	修改：     train/serialization.py
	修改：     ccsrc/pipeline/jit/parse/parse.h
	修改：     explainer/benchmark/_attribution/metric.py
	修改：     ops/composite/multitype_ops/_constexpr_utils.py
	修改：     ops/operations/comm_ops.py

	修改：     RELEASE.md
	修改：     mindspore/_extends/parse/standard_method.py
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/concat_offset_cpu_kernel.cc
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/dynamic_shape_cpu_kernel.cc
	修改：     mindspore/ccsrc/frontend/parallel/ops_info/reshape_info.cc
	修改：     mindspore/ccsrc/frontend/parallel/ops_info/tile_info.cc
	修改：     mindspore/ccsrc/frontend/parallel/ops_info/transpose_info.cc
	修改：     mindspore/ccsrc/frontend/parallel/strategy.h
	修改：     mindspore/common/tensor.py
	修改：     mindspore/core/abstract/prim_arrays.cc
	修改：     mindspore/core/abstract/prim_nn.cc
	修改：     mindspore/core/ops/conv2d.cc
	修改：     mindspore/core/ops/logical_and.h
	修改：     mindspore/core/ops/logical_not.h
	修改：     mindspore/core/ops/logical_or.h
	修改：     mindspore/core/ops/reduce_all.h
	修改：     mindspore/core/ops/reduce_any.h
	修改：     mindspore/lite/src/runtime/kernel/arm/fp32_grad/sgd.cc
	修改：     mindspore/nn/layer/quant.py
	修改：     mindspore/nn/optim/sgd.py
	修改：     mindspore/nn/sparse/sparse.py
	修改：     mindspore/numpy/array_creations.py
	修改：     mindspore/numpy/array_ops.py
	修改：     mindspore/numpy/logic_ops.py
	修改：     mindspore/numpy/math_ops.py
	修改：     mindspore/ops/operations/_inner_ops.py
	修改：     mindspore/ops/operations/array_ops.py
	修改：     mindspore/ops/operations/rl_ops.py
	修改：     mindspore/train/_utils.py
	修改：     tests/ut/python/model/test_lenet_core_after_exception.py

	修改：     mindspore/_extends/parse/standard_method.py
	修改：     mindspore/ops/operations/rl_ops.py

	修改：     mindspore/core/abstract/prim_nn.cc
	修改：     mindspore/core/ops/conv2d.cc

	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/ctcloss_cpu_kernel.cc
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/fl/fused_pull_weight_kernel.h
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/fl/fused_push_weight_kernel.h
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/mkldnn/conv2d_grad_filter_cpu_kernel.cc
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/mkldnn/conv2d_grad_input_cpu_kernel.cc
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/ps/sparse_apply_ftrl_ps_kernel.cc
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/ps/sparse_apply_lazy_adam_ps_kernel.cc
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/rolling_cpu_kernel.cc
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/scatter_arithmetic_cpu_kernel.cc
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/split_cpu_kernel.cc
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/update_cache_cpu_kernel.cc
	修改：     mindspore/ccsrc/backend/kernel_compiler/gpu/arrays/split_gpu_kernel.h
	修改：     mindspore/ccsrc/backend/kernel_compiler/gpu/math/broadcast_gpu_kernel.h
	修改：     mindspore/ccsrc/backend/kernel_compiler/gpu/nn/conv2d_grad_input_gpu_kernel.h
	修改：     mindspore/ccsrc/fl/server/server.cc
	修改：     mindspore/ccsrc/frontend/optimizer/ad/kpynative.cc
	修改：     mindspore/ccsrc/frontend/optimizer/irpass/incorporate_getitem.h
	修改：     mindspore/ccsrc/frontend/optimizer/irpass/inline.h
	修改：     mindspore/ccsrc/minddata/dataset/core/device_tensor.cc
	修改：     mindspore/ccsrc/minddata/dataset/core/tensor.cc
	修改：     mindspore/ccsrc/minddata/dataset/engine/datasetops/source/emnist_op.cc
	修改：     mindspore/ccsrc/minddata/dataset/engine/datasetops/source/mnist_op.cc
	修改：     mindspore/ccsrc/minddata/dataset/engine/datasetops/source/qmnist_op.cc
	修改：     mindspore/ccsrc/minddata/dataset/engine/ir/datasetops/dataset_node.cc
	修改：     mindspore/ccsrc/minddata/dataset/engine/opt/pre/epoch_ctrl_pass.cc
	修改：     mindspore/ccsrc/minddata/dataset/kernels/image/lite_image_utils.cc
	修改：     mindspore/ccsrc/pipeline/jit/action.cc
	修改：     mindspore/ccsrc/pipeline/jit/static_analysis/evaluator.cc
	修改：     mindspore/ccsrc/runtime/device/ascend/executor/tiling/op_tiling_adapter.cc
	修改：     mindspore/compression/quant/quant_utils.py
	修改：     mindspore/core/abstract/prim_nn.cc
	修改：     mindspore/dataset/engine/validators.py
	修改：     mindspore/lite/micro/coder/opcoders/nnacl/fp32/affine_fp32_coder.cc
	修改：     mindspore/lite/micro/coder/opcoders/nnacl/int8/affine_int8_coder.cc
	修改：     mindspore/lite/src/runtime/kernel/ascend310/src/custom_kernel.cc
	修改：     mindspore/lite/src/runtime/kernel/opencl/kernel/matmul.cc
	修改：     mindspore/lite/src/runtime/kernel/opencl/kernel/strassen.cc
	修改：     mindspore/lite/tools/common/graph_util.h
	修改：     mindspore/lite/tools/optimizer/fisson/fisson_util.cc
	修改：     mindspore/ops/composite/math_ops.py
	修改：     mindspore/ops/operations/_inner_ops.py
	修改：     mindspore/ops/operations/array_ops.py
	修改：     mindspore/ops/operations/math_ops.py
	修改：     mindspore/ops/operations/other_ops.py

	修改：     mindspore/boost/boost_cell_wrapper.py
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/update_cache_cpu_kernel.cc
	修改：     mindspore/ccsrc/common/trans.cc
	修改：     mindspore/ccsrc/frontend/parallel/cache_embedding/cache_embedding.cc
	修改：     mindspore/ccsrc/frontend/parallel/ops_info/gather_info.cc
	修改：     mindspore/lite/src/common/log_util.h
	修改：     mindspore/nn/wrap/loss_scale.py
	修改：     mindspore/parallel/nn/moe.py
	修改：     tests/mindspore_test_framework/mindspore_test.py

	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/split_cpu_kernel.cc
	修改：     mindspore/lite/tools/common/graph_util.h

	修改：     mindspore/ccsrc/frontend/parallel/ops_info/gather_info.cc

	修改：     mindspore/core/ops/conv2d.cc

	修改：     tests/ut/python/model/test_lenet_core_after_exception.py
 2021-10-20 12:02:40 +08:00
i-robot ef7bc4ddda !25079 Change dir hash to file hash in bprop mindir 
Merge pull request !25079 from YuJianfeng/bprop_mindir
 2021-10-20 02:54:05 +00:00
“uccInf” fe3123cfe8 [feat][assistant][I3J6V4] add new data operator FashionMnist 2021-10-20 02:37:56 +00:00
i-robot 440036d331 !24362 [assistant][ops]New operator implementation, include PhotoTourDataset 
Merge pull request !24362 from Wangsong95/phototour_dataset
 2021-10-20 01:46:05 +00:00
yangyueren 6594b90a58 [feat][assistant][I3J6VE] add new data operator PhotoTour 2021-10-19 15:31:32 +00:00
chenx2ovo 77caf907c4 [feat][assistant][I3CEGR] add op random lighting 2021-10-19 20:38:01 +08:00
yujianfeng 42079ac087 Change dir hash to file hash in bprop mindir 2021-10-19 19:22:25 +08:00
liyong a89741c32e fix md ut part03 2021-10-19 16:52:57 +08:00
i-robot 690642d672 !18664 [assistant][ops]New operator implementation, include Places365Dataset 
Merge pull request !18664 from Wangsong95/places365_dataset
 2021-10-19 07:06:35 +00:00
i-robot c97d3eeef7 !25100 [MD] fix mindrecord ut part02 
Merge pull request !25100 from liyong126/fix_md_ut_part02
 2021-10-19 06:30:57 +00:00
i-robot 1606f19dfb !18265 [assistant][ops] Add new audio operator CreateDct 
Merge pull request !18265 from 杨旭华/CreateDct
 2021-10-19 06:30:18 +00:00
liyong d23961b98f fix mindrecord ut 2021-10-19 11:43:52 +08:00
i-robot e7ea546194 !25006 [MD] fix mindrecord ut 
Merge pull request !25006 from liyong126/fix_md_ut
 2021-10-19 02:02:13 +00:00
i-robot d9cfda44c4 !25060 ut_fix 
Merge pull request !25060 from wanyiming/ut_fix
 2021-10-19 00:59:01 +00:00
i-robot e3d8edc530 !24475 Implement the dict.items() interface and the multiplication operation of numbers and lists or tuples 
Merge pull request !24475 from 翟之博/master
 2021-10-18 11:39:27 +00:00
i-robot 8df1bd14a1 !24986 Change printed log's level in dump_proto.cc 
Merge pull request !24986 from huanghui/change-log-level
 2021-10-18 11:36:44 +00:00
tophand 4f4777f0da [feat][assistant][I3J6U2] Add new audio operator CreateDct 2021-10-18 03:23:18 -07:00
wanyiming 4fbc59a98a utfixs 2021-10-18 18:06:37 +08:00
liyong d9aa18dfca refactor md ut 2021-10-18 17:55:28 +08:00
i-robot 9d0d094437 !24554 support nested call of ms_function 
Merge pull request !24554 from zhangzhaoju/ms_master_ms_function
 2021-10-18 09:36:30 +00:00
zzb 95425b770d iml dict.items() and multiplication op 2021-10-18 12:47:22 +08:00
zx d13d2413f5 [feat][assistant][I3J6UV] add new audio operator Phaser 2021-10-16 08:45:12 +08:00
yangyueren 951193c308 [feat][assistant][I3J6VF] add new data operator Places365 2021-10-15 14:56:09 +00:00
Xiao Tianci 930a5b89c0 fix api docs of audio 2021-10-15 17:17:18 +08:00
i-robot be691284e2 !18407 [assistant][MulLawEncoding] 
Merge pull request !18407 from QingfengLi/mulawencoding
 2021-10-15 09:03:41 +00:00
i-robot 44fe11c656 !24805 fix_fronted_ut 
Merge pull request !24805 from wanyiming/fix_uts
 2021-10-15 09:01:35 +00:00
zhangzhaoju b4453709a2 Support parser decoratored functions 
like nested calling of ms_function
 2021-10-15 16:41:08 +08:00
wanyiming 8b40e77201 ut_fixed 2021-10-15 15:54:26 +08:00
huanghui 3785b6d1b4 change printed log's level 2021-10-15 15:49:08 +08:00
chujinjin 3c3d8c3962 remove useless python ut 2021-10-15 15:26:45 +08:00
i-robot b27623ae37 !24899 modify ut of probability 
Merge pull request !24899 from byweng/master
 2021-10-15 02:02:52 +00:00
robert_luo_yibo 75e2c3041c [feat][assistant][I3CEG3] add new data OP MuLawEncoding 2021-10-14 20:24:18 +08:00
Bingya Weng be20f00299 modify ut of probability 2021-10-14 19:33:34 +08:00
i-robot f83070728d !24790 support user define strategy gen method under auto parallel context 
Merge pull request !24790 from zhuyuxiao/master
 2021-10-14 09:03:36 +00:00
chujinjin 90836f70a0 fix context python ut error 2021-10-14 14:27:50 +08:00
i-robot 957f9a7b4e !24839 UT case runs failed in PyNative mode 
Merge pull request !24839 from JoyLvliang/ut_run_failed_in_pynative_mode
 2021-10-14 06:15:28 +00:00
i-robot 65f08a6c4c !24804 parallel ut modify 
Merge pull request !24804 from yao_yf/parallel_ut_modify
 2021-10-14 01:24:12 +00:00
i-robot 470de9bcaa !21258 [assistant][ops]New operator implementation, include ApplyKerasMomentumD 
Merge pull request !21258 from 梁秀波/ApplyKerasMomentumD
 2021-10-14 01:05:23 +00:00
7347157+joylvliang@user.noreply.gitee.com aecbdf3c3b ut_run_failed_in_pynative_mode 2021-10-13 18:46:27 +08:00
i-robot 1b9b85bbb2 !17851 [assistant][ops]New operator implementation, include FakeImageDataset 
Merge pull request !17851 from 张璇/fakeimage_dataset
 2021-10-13 09:22:55 +00:00
yao_yf 636f82a466 parallel ut modify 2021-10-13 14:28:13 +08:00
zhuyuxiao 1907246931 change api 2021-10-13 10:28:30 +08:00
i-robot 3fd94000c5 !24568 Apply batch parallel in auto_parallel mode when strategies are not specified 
Merge pull request !24568 from zhuyuxiao/master
 2021-10-13 01:20:15 +00:00
i-robot 18e632c7a1 !21216 [MS][crowdfunding]New operator implementation, include Overdirve 
Merge pull request !21216 from Wangsong95/overdrive
 2021-10-13 01:08:36 +00:00
G-Dragon-Liu d2f22a8726 [feat][assistant][I3J6V3] add new data operator FakeImage 2021-10-12 14:00:43 +00:00
zx 9b7d7be65c [feat][assistant][I3J6UU] add new audio operator Overdrive 2021-10-12 18:10:31 +08:00
zhuyuxiao cf76c76745 apply batch parallel in auto_parallel mode when strategies are not specified 2021-10-12 15:44:10 +08:00
yao_yf b303d6001c parallel ut refactor 2021-10-12 15:18:51 +08:00
huanghui 1af32f74f9 support None argument for the outermost net 2021-10-11 16:00:57 +08:00
i-robot b9c2a84d3b !17812 [assistant][ops] Add a new audio operator Flanger 
Merge pull request !17812 from 杨旭华/Flanger
 2021-10-09 08:15:33 +00:00
li-qiyao 2283442855 [feat][assistant][I3J6U9] add new data operator Flanger 2021-10-08 05:03:31 -07:00
i-robot ea53466848 !24490 Extend the completeness of the mindspore static graph mode, so that the filter function is supported in the construct function 
Merge pull request !24490 from 卢逸飞/MindSpore/master
 2021-10-08 10:35:29 +00:00
i-robot 8598d08351 !17820 [assistant][ops]New operator implementation, include EMnistDataset 
Merge pull request !17820 from 张璇/emnist_dataset
 2021-10-08 07:18:31 +00:00
i-robot 02f9e3e077 !17805 [assistant][ops] Add new audio operator DetectPitchFrequency 
Merge pull request !17805 from 杨旭华/DetectPitchFrequency
 2021-10-08 03:34:46 +00:00
G-Dragon-Liu 32baa520bf [feat][assistant][I3J6V2] add new data operator EMnist 2021-10-08 02:53:00 +00:00
John Tzanakakis 7e7b444c63 remove verbose option from DbgServices 2021-10-06 11:38:05 -04:00
Lu 9f68d43c32 Construct supports the filter function. 2021-09-30 15:18:05 +08:00
i-robot dddea1803d !24361 context api 0928 
Merge pull request !24361 from mindspore_ding/context_master_0928
 2021-09-30 06:45:28 +00:00
dingpeifei 89f9d0f263 api context 0927 2021-09-29 23:15:36 +08:00
Zhang Lian b7e6520e62 [feat] [assistant] [I3J6U8] Add a new audio operator DetectPitchFrequency 2021-09-29 15:12:58 +08:00
despicablemme 75ade61acf [feat] [assistant] [I40GGE] add new Ascend operator CeLU 2021-09-28 14:58:25 +08:00
i-robot 2cacf9cdc2 !24231 fix security wrap and code check 
Merge pull request !24231 from jiangshuqiang/fix_code_check_master
 2021-09-28 06:45:19 +00:00
i-robot 2085ab1774 !22831 [assistant][ops]add math ops Ger 
Merge pull request !22831 from yangwm/ger
 2021-09-28 06:27:35 +00:00
jiangshuqiang 13fc005562 fix security wrap 2021-09-28 11:59:45 +08:00
i-robot dd544a9693 !21406 [MS][crowdfunding]New operator implementation, include TrebleBiquad 
Merge pull request !21406 from 张璇/treble_biquad
 2021-09-27 14:18:00 +00:00
i-robot f16c003dfa !22610 [MS][crowdfunding]New operator implementation, RandomAdjustSharpness 
Merge pull request !22610 from yangwm/sharpness
 2021-09-27 09:20:05 +00:00
zorax 6098c1da5e [feat][assistant][I40FFO] add new Ascend operator ApplyKerasMomentum 2021-09-27 16:49:18 +08:00
zx 3da0f0f487 [feat][assistant][I3J6V0] add new audio operator TrebleBiquad 2021-09-27 13:01:26 +08:00
despicablemme d072a4e4bf [feat] [assistant] [I40GZE] add new data operator RandomAdjustSharpness 2021-09-27 11:19:33 +08:00
i-robot ab567574c4 !21451 [MS][crowdfunding]New operator implementation, include RiaaBiquad 
Merge pull request !21451 from 张璇/riaa_biquad
 2021-09-27 03:14:16 +00:00
i-robot 2969688382 !20047 [assistant][ops]New operator implementation, include QmnistDataset 
Merge pull request !20047 from Wangsong95/qmnist_dataset
 2021-09-27 01:36:08 +00:00
despicablemme 84337078b1 [feat] [assistant] [I40GGM] add new ascend operator Ger 2021-09-27 09:28:05 +08:00
i-robot e3bc280f22 !22532 [MS][crowdfunding]New operator implementation, RandomEqualize 
Merge pull request !22532 from yangwm/equalize
 2021-09-27 01:07:04 +00:00
i-robot b10df2da0c !21401 [assistant][ops]New operator implementation, include ExtractVolumePatches 
Merge pull request !21401 from 梁秀波/ExtractVolumePatches
 2021-09-26 09:52:43 +00:00
i-robot bb038292d4 !23905 fix error log 
Merge pull request !23905 from lianliguang/more-info-for-infer-error
 2021-09-26 06:23:34 +00:00
despicablemme 7063907bdc [feat] [assidtant] [I40GZN] add new data ops RandomEqualize 2021-09-25 18:00:25 +08:00
i-robot d0023355a3 !23205 Fix bus error with multiprocessing enabled, large image, shared_memory, single device 
Merge pull request !23205 from RobinGrosman/mem_bus_failure
 2021-09-24 19:16:12 +00:00
RobinGrosman c90efc0403 add check for shm available when num_devices=1 to avoid bus errors 
-Required modifying tests to reduce memory usage to check doesn't fail during CI
-Also required fixing max_rowsize to be externalized from map+batch() function
 2021-09-24 10:24:31 -07:00
hzw 2f5758a4a8 [feat][assistant][#I40FFZ] add new Ascend operator ExtractVolumePatches 2021-09-24 18:36:03 +08:00
i-robot ee38ffbd3d !22560 [MS][crowdfunding]New operator implementation, RandomAutoContrast 
Merge pull request !22560 from yangwm/autocontrast
 2021-09-24 09:34:37 +00:00
i-robot 7cde7731b0 !23537 Update pangu reshape and softmax. 
Merge pull request !23537 from linqingke/pangu
 2021-09-24 08:12:13 +00:00
i-robot 86392fdd3d !23982 fix the debug info about the cell function decorated by @ms_functon 
Merge pull request !23982 from huanghui/fix-filename-error-with-ms_function
 2021-09-24 06:43:35 +00:00
i-robot e7cb505e68 !23569 Produce parallel operators for ResizeBilinear and ResizeNearestNeighbor 
Merge pull request !23569 from Bert0108/resizebilinear_parallel_ops
 2021-09-24 03:05:23 +00:00
i-robot d37fccc56f !23544 remove deprecated gather op 
Merge pull request !23544 from zhuyuxiao/master
 2021-09-24 01:20:53 +00:00
Bert0108 2d3d0b673e parallel operators for ResizeBilinear and ResizeNearestNeighbor 2021-09-24 09:07:49 +08:00
linqingke acde7febef update pangu reshape and softmax performance. 
Add layer norm judge

Fix layer norm name error

Fix input tyoe check

Fix ut test

Add 3d supports
 2021-09-24 09:06:16 +08:00
zx 1d95e6f480 [feat][assistant][I3J6UY] add new audio operator RiaaBiquad 2021-09-23 21:36:59 +08:00
i-robot 79d1f3cfd3 !23854 Fix testcase about modelzoo 
Merge pull request !23854 from chenhaozhe/fix-testcase-about-models
 2021-09-23 12:27:42 +00:00
despicablemme 7a6b75c2e8 [feat] [assistant] [I40GZJ] add new data op RandomAutoContrast 2021-09-23 20:17:39 +08:00
i-robot ab9a7163cb !22175 [assistant][ops]New operator implementation, include Trunc 
Merge pull request !22175 from 梁秀波/Trunc
 2021-09-23 10:04:55 +00:00
i-robot 0c26736da1 !22276 [MS][crowdfunding]New operator implementation, RandomInvert 
Merge pull request !22276 from yangwm/rinvert
 2021-09-23 08:12:57 +00:00
lianliguang 7227b61979 modify info when infer error 2021-09-23 15:54:43 +08:00
i-robot 632e3b8dcd !23663 add exception level to python error report 
Merge pull request !23663 from huangbingjian/py_log
 2021-09-23 07:46:45 +00:00
huanghui 97250978c4 fix the debug info about the function decorated by @ms_functon 2021-09-23 14:43:02 +08:00
echo-yike 785558cdd2 [feat][assistant][I40FGD] add new Ascend operator Trunc 2021-09-23 14:27:35 +08:00
chenhaozhe 12fab451e8 fix test cases about models 2021-09-23 09:19:37 +08:00
i-robot 44b1dbf77f !23827 MD Python UT: Update num_epochs to appropriate value for iterators instead of using default value 
Merge pull request !23827 from hetshah/hs_python_ut
 2021-09-22 21:14:35 +00:00
hetshah 2c1666fd06 set num epochs for iterators that use the default value 
add explicit paramter for infinite iterators

set appropriate value for num_epoch param for iteratos

fix long lines

remove trailing whitespace

fixed typo

remove comment

fixed comments

fixed test
 2021-09-22 17:32:50 +00:00
despicablemme b977d8723b [feat] [assistant] [I40GZC] add new data ops RandomInvert 2021-09-22 16:55:14 +08:00
huangbingjian 3ee5d98a8d add exception level to python error report 2021-09-22 14:34:21 +08:00
ckczzj 001b68c286 [feat][assistant][I3J6VG] add new data operator QMnist 2021-09-22 12:13:27 +08:00
Zhang Qinghua 9fbd118319 Handle interpreted node as input, set function Parameters and update local params if need. 2021-09-18 17:34:50 +08:00
i-robot ebe094ac0f !21829 [assistant][ops] Add New Cdist and CdistGrad 
Merge pull request !21829 from 孟权令/Cdist
 2021-09-18 09:23:27 +00:00
i-robot e87f0be14f !23707 fix summary isolation 
Merge pull request !23707 from jiangshuqiang/temp
 2021-09-18 09:23:25 +00:00
i-robot 6489dacdab !18114 [assistant][ops]Add new operator Magphase 
Merge pull request !18114 from YJfuel123/Magphase
 2021-09-18 07:26:34 +00:00
i-robot 92287b86d8 !23471 Fix white list error msg synax error 
Merge pull request !23471 from xiefangqi/md_white_list_optimization
 2021-09-18 05:03:40 +00:00
jiangshuqiang c2bd061889 fix summary isolation 2021-09-18 10:59:14 +08:00
i-robot 95e56d0912 !23212 enable profiling warning 
Merge pull request !23212 from mindspore_ding/enable_profiling_master_0910
 2021-09-18 02:04:37 +00:00
zhoufeng 1f934bd782 check neighbor attr type 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-09-17 21:15:37 +08:00
dingpeifei 7523b320d7 enable profiling warning 2021-09-17 17:09:56 +08:00
葛崇林 a05a5de073 [feat][assistant][I3ALC5] add new method Magphase 2021-09-17 16:02:46 +08:00
i-robot f5af432e04 !16922 [assistant][Vol] 
Merge pull request !16922 from QingfengLi/Vol
 2021-09-17 06:51:49 +00:00
SichongHao 5412382e16 [feat][assistant][I3T91W][I3T91X]add new operator Cdist and CdistGrad 2021-09-17 13:58:53 +08:00
chenx2ovo 9e62623b4a [feat][assistant][I3CEGI] add op vol 2021-09-17 09:34:20 +08:00
ms_yan 0a365e91bf modify log in kernel part 2021-09-16 22:09:21 +08:00
i-robot a5b793463a !23099 Correct wrong info when using ms_function to decorate bprop 
Merge pull request !23099 from JoyLvliang/correct_wrong_info_when_using_ms_function_with_bprop
 2021-09-16 08:46:41 +00:00
i-robot 89119ae470 !23553 fix: pyfunc cause hung when it is a generator which can't be serialize 
Merge pull request !23553 from guozhijian/fix_pyfunc_hung_when_yield
 2021-09-16 08:44:50 +00:00
zhuyuxiao 79d99323a2 rename gather 2021-09-16 16:07:05 +08:00
7347157+joylvliang@user.noreply.gitee.com 6e59598f99 correct_wrong_info_when_using_ms_function_with_bprop 2021-09-16 14:12:55 +08:00
huangxinjing 0b89d5c9c4 fix batch size error 2021-09-16 10:56:40 +08:00
Guo Zhijian f49bacde09 fix: pyfunc hung when it's a yield func 2021-09-16 09:20:44 +08:00
i-robot 57b8c8e2d9 !23310 [MD] fix error message of mindrecord 
Merge pull request !23310 from liyong126/fix_log_msg
 2021-09-16 00:45:11 +00:00
i-robot e5af07d519 !23538 minddata error message optimize 
Merge pull request !23538 from luoyang/log_update
 2021-09-16 00:42:42 +00:00
i-robot 4a553c8d57 !16607 [assistant][Fade] 
Merge pull request !16607 from QingfengLi/Fade
 2021-09-15 14:54:16 +00:00
i-robot 87fac9a520 !23476 fix hung when user return Tensor in generator 
Merge pull request !23476 from guozhijian/fix_generator_hung_when_return_mindspore_tensor
 2021-09-15 10:17:24 +00:00
YangLuo 9d89de5765 minddata error message optimize 2021-09-15 18:05:02 +08:00
liyong 65f3365a2a fix mindrecord log 2021-09-15 16:18:40 +08:00
i-robot 0d914dd427 !22638 Add ut test for offline debugger 
Merge pull request !22638 from sabrinasun_59ee/ut
 2021-09-15 06:28:47 +00:00
jonyguo c408867085 fix: hung when user return Tensor in generator 2021-09-15 14:13:33 +08:00
i-robot 0a33f88d48 !23419 log error level information in python when GLOG_v=4 
Merge pull request !23419 from huangbingjian/exception_log
 2021-09-15 01:29:12 +00:00
i-robot bbdacd41f4 !20585 add security isolate for save_graphs 
Merge pull request !20585 from huanghui/add-security-isolate-for-DumpIR
 2021-09-15 01:25:46 +00:00
sabrinasun 3a349a9219 add ut test for offline debugger 2021-09-14 18:46:22 -04:00
xiefangqi a91c87c581 fix some syntax error 2021-09-14 21:29:02 +08:00
chenx2ovo 1a3196b052 [feat][assistant][I3CEGF] add op fade 2021-09-14 19:08:37 +08:00
i-robot db19a40280 !23365 add print op security 
Merge pull request !23365 from fangzehua/print_sec
 2021-09-14 09:01:31 +00:00
i-robot c6a99428cd !23153 Update the operator in order to let users better understand the reason for the error of the operator part: nn_ops and array_ops 
Merge pull request !23153 from dinglinhe/dlh_code_ms_I43QY0_nn_ops
 2021-09-14 06:33:39 +00:00
i-robot 2b4cdea48a !23331 batch parallel operator replace input shape from construct 
Merge pull request !23331 from yangzhenzhang/modify-batch-parallel-info
 2021-09-14 06:32:45 +00:00
huangbingjian 6ba47653bf log error level information in python when GLOG_v=4 2021-09-14 14:23:55 +08:00
huanghui ba66c0d491 add security isolate for save_graphs 2021-09-14 10:24:12 +08:00
i-robot 32c2b77595 !19093 [assistant][ops] Add new audio operator Biquad 
Merge pull request !19093 from 杨旭华/Biquad
 2021-09-14 01:52:01 +00:00
dinglinhe 9a8c1b3c73 array_ops error recti and others 2021-09-14 09:12:02 +08:00
i-robot 6dcfe64501 !23264 python serdes bug fix 
Merge pull request !23264 from zetongzhao/deserialize
 2021-09-13 15:53:05 +00:00
i-robot 0aa167cdf4 !23240 maybe max open files in mr or onehot fail in pytransform 
Merge pull request !23240 from guozhijian/fix_max_open_files_and_onehot
 2021-09-13 13:51:09 +00:00
i-robot e149a15ace !23002 Error log optimizer 
Merge pull request !23002 from zhangzhaoju/master_syntax
 2021-09-13 13:43:40 +00:00
i-robot dc45c64a78 !23207 Adding security isolation to debugger 
Merge pull request !23207 from sabrinasun_59ee/macro
 2021-09-13 12:07:29 +00:00
i-robot 5abd4821ce !23357 Add DatasetName method for out developer 
Merge pull request !23357 from xiefangqi/md_white_list_optimization
 2021-09-13 12:06:49 +00:00
i-robot 3e1d1ff4d3 !18671 [assistant][ops]New operator implementation, include SBUDataset 
Merge pull request !18671 from Wangsong95/sbu_dataset
 2021-09-13 11:56:13 +00:00
liannai 631f49f044 [feat][assistant][I3T96A] Add new audio operator Biquad 2021-09-13 19:18:50 +08:00
fangzehua 4ccc635a07 add print security 2021-09-13 17:45:36 +08:00
i-robot bdfd3877f8 !23300 Optimize of exception log of AD 
Merge pull request !23300 from YuJianfeng/dfx
 2021-09-13 09:35:18 +00:00
yangzhenzhang 1b8eb283e4 modify batch parallel info 2021-09-13 16:28:56 +08:00
zhangzhaoju 4296881a16 syntax 2021-09-13 15:20:53 +08:00
xiefangqi 465dd25d74 add virtual DatasetName method 2021-09-13 15:17:32 +08:00
sabrinasun 220245f592 add security isolation to online and offline debugger 2021-09-12 23:01:15 -04:00
i-robot 87381a1cf9 !17806 [assistant][ops] DcShift Op 
Merge pull request !17806 from 杨旭华/DCShift
 2021-09-13 01:29:14 +00:00
i-robot c9ff7242a4 !23298 minddata engine optimize white list error msg 
Merge pull request !23298 from xiefangqi/md_white_list_optimization
 2021-09-13 01:19:15 +00:00
Carry955 0ba84345b0 [feat][assistant][I3J6U3] add new audio operator DCShift 2021-09-11 23:58:18 -07:00
jonyguo da78a17730 fix: may max openfiles in mindrecord and onehot error in py_transform 
and cache_admin rpath
 2021-09-12 00:25:07 +08:00
yujianfeng 752bdde06d Optimize of exception log of AD 2021-09-11 18:07:50 +08:00
xiefangqi ff73e4ccd7 fix white list error msg 2021-09-11 17:36:23 +08:00
Isaac17555 53fc99b914 [feat][assistant][I3T96B]add new data operator LFilter 2021-09-11 02:05:43 -07:00
i-robot 0071667155 !23039 [Fallback] Fix previous block parameters problem and add test cases. 
Merge pull request !23039 from 张清华/opt_fallback
 2021-09-11 07:39:02 +00:00
i-robot a61c2c5cfe !17885 [assistant][ops]Add new operator EqualizerBiquad 
Merge pull request !17885 from YJfuel123/EqualizerBiquad
 2021-09-11 06:40:29 +00:00
i-robot 9b7a966174 !21262 [assistant][ops]New operator implementation, include SparseApplyRMSPropD 
Merge pull request !21262 from 梁秀波/SparseApplyRMSPropD
 2021-09-11 06:01:29 +00:00
i-robot 76fac95591 !23069 Modify error content 
Merge pull request !23069 from huchunmei/master
 2021-09-11 03:50:52 +00:00
YJfuel123 16150d394f [feat][assistant][I3ALd1] add new operator EqualizerBiquad 2021-09-11 10:36:20 +08:00
ckczzj af97ba4a77 [feat][assistant][I3J6VH] add new data operator SBU 2021-09-11 09:58:17 +08:00
zetongzhao 719a207040 deserialize fix 2021-09-10 15:19:59 -04:00
i-robot 7b4f361ca7 !23232 Fix multiprocessing attr error 
Merge pull request !23232 from xiefangqi/md_fix_map_pool_issue
 2021-09-10 14:59:40 +00:00
i-robot 6d709c7254 !19624 [assistant][ops] Add new dataset operator DIV2K. 
Merge pull request !19624 from Rainfor/div2k
 2021-09-10 14:59:21 +00:00
xiefangqi 66c5f937dd fix attr failed problem 2021-09-10 18:01:04 +08:00
wangkc123 3daf3a4d5f [feat] [assistant] [I3CKEK] add new dataset operator DIV2K 2021-09-10 17:55:34 +08:00
Zhang Qinghua bcfb274074 [Fallback] Fix previous block parameters problem, and add test cases. 2021-09-10 16:43:46 +08:00
robert_luo_yibo ce71699734 [feat][assistant][I3CEG5] add new data OP MuLawDecoding 2021-09-10 15:49:46 +08:00
huchunmei c75773cf37 Modify error content 2021-09-10 15:21:33 +08:00
i-robot 32cc5d79b0 !18670 [assistant][ops]New operator implementation, include USPSDataset 
Merge pull request !18670 from Wangsong95/usps_dataset
 2021-09-10 03:06:19 +00:00
i-robot f91e1440c8 !17810 [assistant][ops][DeemphBiquadOp] 
Merge pull request !17810 from Isaac/DeemphBiquad
 2021-09-10 03:05:41 +00:00
i-robot 2cc8c851c5 !23141 mkdir rank_id 0909 
Merge pull request !23141 from mindspore_ding/mkdir_rankid_master_0909
 2021-09-10 02:45:54 +00:00
i-robot 725cf63118 !23187 upgrade Ascend software package 09 Sep 21 
Merge pull request !23187 from yanghaoran/upgrade_ascend_0909
 2021-09-10 01:55:13 +00:00
i-robot 0abff9ad65 !23108 Fix spelling error for transformer 
Merge pull request !23108 from huangxinjing/fix_spell_error
 2021-09-10 01:29:32 +00:00
ckczzj d7c702e9d4 [feat][assistant][I3J6VL] add new data operator USPS 2021-09-09 21:46:57 +08:00
yanghaoran 0ced8775c4 upgrade Ascend software package 09 Sep 21 2021-09-09 20:30:22 +08:00
huangxinjing e02f553010 Fix spell error and add mode check 2021-09-09 18:50:53 +08:00
i-robot 5c72e9d7c6 !23078 Get bprop from python when the bprop mindir dir does not exist 
Merge pull request !23078 from YuJianfeng/bprop_mindir
 2021-09-09 09:51:14 +00:00
i-robot e37b7374ae !22434 [MoE] Adding a MoE implementation 
Merge pull request !22434 from Xiaoda/84-add-moe-layer
 2021-09-09 09:06:56 +00:00
dingpeifei 992d6a6dbc mkdir rank_id 2021-09-09 16:14:54 +08:00
i-robot 936940da8e !22666 [assistant][ComplexNorm] 
Merge pull request !22666 from QingfengLi/ComplexNorm
 2021-09-09 06:41:53 +00:00
Isaac 5dc6c7fe96 [feat][assistant][I3J6U6]add new data operator DeemphBiquad 2021-09-09 14:34:24 +08:00
Xiaoda Zhang 5613c0b974 add a moe implementation: 
1) extend the Liner cell for including BatchMatMul implementation, in
which the first dimension indicates the expert number;
2) implement a Switch (top1) router;
3) implement a MoE cell, which extends the FeedForward cell.
 2021-09-09 11:53:42 +08:00
i-robot 9ad56e86ab !17846 [assistant][ops]Add new operator HighpassBiquad 
Merge pull request !17846 from YJfuel123/HighpassBiquad
 2021-09-09 02:06:41 +00:00
i-robot a918783f1a !22623 Add Random operation with Multi Field 
Merge pull request !22623 from shenwei41/operation_dev
 2021-09-09 01:49:04 +00:00
yujianfeng dfe1b05b28 Get bprop from python when the bprop mindir dir does not exist 2021-09-09 09:05:19 +08:00
i-robot b21da536d3 !22784 serdes python operations by pyfunc 
Merge pull request !22784 from zetongzhao/deserialize
 2021-09-08 17:18:57 +00:00
zetongzhao 0d389f3f0c serdes python operations 2021-09-08 09:05:11 -04:00
shenwei41 a8d02ab782 Add Random operation with MultiField 2021-09-08 19:29:23 +08:00
i-robot 938324b397 !19362 [assistant][ops] Add new dataset operator Cityscapes. 
Merge pull request !19362 from Rainfor/cityscapes
 2021-09-08 09:14:43 +00:00
i-robot 77424eaad5 !23004 Add args Check for Transformer 
Merge pull request !23004 from huangxinjing/args_check
 2021-09-08 08:24:06 +00:00
yaoyuan 85a1b55b47 [feat] [assistant] [I3ALCL] add new operator HighpassBiquad 2021-09-08 15:12:40 +08:00
huangxinjing 6cea07f749 Add args check 2021-09-08 09:12:35 +08:00
i-robot b1be8dfd31 !22851 MD Profiling: Update Connector Init to Remove any existing file 
Merge pull request !22851 from cathwong/ckw_mon_seq_pipelines_fix
 2021-09-07 19:57:58 +00:00
i-robot d37d57d0fd !22941 parallel_sparse_attention_ops_fix_repeated_cal 
Merge pull request !22941 from yao_yf/parallel_sparse_attention_ops_fix_repeated_cal
 2021-09-07 13:26:19 +00:00
i-robot 5cf19e8aa6 !22986 Add supported namespace for fallback. 
Merge pull request !22986 from 张清华/opt_fallback
 2021-09-07 12:50:32 +00:00
Zhang Qinghua 6edea0ed3c Add supported namespace for fallback. 2021-09-07 16:19:25 +08:00
i-robot 5ed105ec01 !22933 Tensor support complex scalar number input 
Merge pull request !22933 from zhouyaqiang0/complex_ops
 2021-09-06 13:29:21 +00:00
i-robot 990d561ed9 !22974 Fix ut/python/dataset generator 14 occationally segment fault 
Merge pull request !22974 from xiefangqi/md_fix_generator_problem
 2021-09-06 12:25:22 +00:00
yao_yf 3ef26288a2 parallel_sparse_attention_ops_fix_repeated_cal 2021-09-06 19:57:22 +08:00
i-robot 05a0898352 !22843 Support fallback feature in Graph mode. 
Merge pull request !22843 from 张清华/opt_fallback
 2021-09-06 11:35:45 +00:00
xiefangqi 57f68d35bd fix generator 14 ut problem 2021-09-06 19:01:51 +08:00
zhouyaqiang 4e07873378 Tensor support complex input 2021-09-06 18:44:26 +08:00
Zhang Qinghua 7203989c26 Support fallback feature in Graph mode (1). 2021-09-06 16:00:03 +08:00
lilei 62e832eaab modify parallel API 2021-09-06 11:45:10 +08:00
i-robot fa12d62d4d !21776 set device_id master 0813 
Merge pull request !21776 from mindspore_ding/set_device_id_master_0813
 2021-09-06 03:02:58 +00:00
Cathy Wong bc85c606b8 MD Profiling: Update Connector Init to Remove any existing file 
to fix sequential pipeline scenario.
 2021-09-03 15:45:38 -04:00
yao_yf 3ca73a6d6b broadcast using seqarates world group 2021-09-03 11:21:36 +08:00
i-robot 60d583190b !22815 Update bprop error information 
Merge pull request !22815 from JoyLvliang/update_bprop_error_information
 2021-09-03 01:31:15 +00:00
i-robot 90c7804d6b !22500 Sort watchpoint hit for offline debugger based on time stamps of dump files 
Merge pull request !22500 from parastooashtari/offline_wp_hit_order
 2021-09-02 14:47:06 +00:00
dingpeifei b4bc6000dc set device id master 0813 2021-09-02 20:51:50 +08:00
7347157+joylvliang@user.noreply.gitee.com 14d24d4793 update_bprop_error_information 2021-09-02 20:40:55 +08:00
i-robot bbbd6e0254 !22579 modify resizebilinear infer type 
Merge pull request !22579 from Simson/opinfer
 2021-09-02 01:02:00 +00:00
i-robot 3368287aab !22620 add util: browse dataset 
Merge pull request !22620 from luoyang/browse_dataset
 2021-09-02 01:00:46 +00:00
Parastoo Ashtari 65d8272352 sort wp hit for offline debugger with time stamp 2021-09-01 14:40:33 -04:00
robert_luo_yibo 3d58da9023 [fix][assistant][I47V0O] fix bug about the wrong output in the operator ComplexNorm 2021-09-01 17:55:38 +08:00
YangLuo 97c1ba380f add util: browse dataset 2021-09-01 16:13:32 +08:00
i-robot d87d0e07c2 !22255 recompute_interface_modify 
Merge pull request !22255 from yao_yf/recompute_interface_modify
 2021-09-01 08:09:36 +00:00
i-robot fc9d4ed659 !17813 [assistant][ops] Add new audio operator Contrast 
Merge pull request !17813 from 杨旭华/Contrast
 2021-09-01 06:38:05 +00:00
yao_yf 39055af6e4 recompute interface modify 2021-09-01 10:59:59 +08:00
i-robot cc8d614b25 !22650 fixed sparse attention modify 
Merge pull request !22650 from yao_yf/fixed_sparse_attention_modify
 2021-09-01 01:29:45 +00:00
simson 7a2fbdda85 modify resizebilinear infer type 2021-09-01 09:03:55 +08:00
wangkc123 70f741bcc1 [feat] [assistant] [I3CKEM] add new dataset operator Cityscapes 2021-08-31 20:03:37 +08:00
Feve1986 82b04d6a1e [feat][assistant][I40FFX] add new Ascend operator SparseApplyRMSPropD 2021-08-31 17:28:38 +08:00
i-robot 389f3a6b6c !21835 make alltoall and neighborexchange to be interface && revert pr 21395 
Merge pull request !21835 from zhoufeng/revert-same-input-to-comm-op
 2021-08-31 08:53:46 +00:00
yao_yf 82889ec56b fixed sparse attention 2021-08-31 16:11:56 +08:00
i-robot 740c62cbaa !22384 amend_assigin 
Merge pull request !22384 from jiangzhenguang/amend_assigin
 2021-08-31 06:55:02 +00:00
tongyue 329526dea8 [feat][assistant][I3J6U0] add new data operator Contrast 2021-08-30 19:34:37 -07:00
i-robot bbf9c6a9ad !22529 fix: for loop dataset iterator will cause memory leak 
Merge pull request !22529 from guozhijian/fix_for_loop_ds_iter_memory_leak
 2021-08-31 01:15:58 +00:00
jiangzhenguang 8812c8fe9b amend assign 2021-08-31 09:10:21 +08:00
yao_yf 68dd138462 add parallel sparse attention ops: dsd_matmul 2021-08-30 18:46:52 +08:00
i-robot 5b8f9ff398 !22096 add parallel sparse attention ops 
Merge pull request !22096 from yao_yf/parallel_sparse_attention_ops
 2021-08-30 10:43:05 +00:00
i-robot 37ecdba742 !20829 [assistant][ops]New operator implementation, include ApplyAdagradDA 
Merge pull request !20829 from 梁秀波/ApplyAdagradDAD
 2021-08-30 09:16:19 +00:00
zhoufeng ecae690a19 Revert "fix same node is used by two comm op" 
This reverts commit b09d411dc4.

add AlltoAll and NeighborExchange as interface
 2021-08-30 16:54:38 +08:00
i-robot a47ab8d643 !18073 [assistant][ops]Add new operator LowpassBiquad 
Merge pull request !18073 from YJfuel123/LowpassBiquad
 2021-08-30 08:33:39 +00:00
i-robot ff2e34b9f9 !22509 Add ut and st for Jvp, Vjp and Grad 
Merge pull request !22509 from LiangZhibo/fix
 2021-08-30 08:21:54 +00:00
jonyguo 4c915fdcbb fix: for loop dataset iterator will cause memory leak 2021-08-30 16:08:26 +08:00
zx 0efbedd23c [feat][assistant][I40FFF] add new Ascend operator ApplyAdagradDA 2021-08-30 11:01:18 +08:00
liyong 5a4ff8cfdb fix ci issue 2021-08-30 10:18:06 +08:00
yao_yf b8a9cbe2a3 add cus_matmul_dds parallel ops 2021-08-30 09:44:48 +08:00
Zhang Qinghua a137fa1d0b Optimize the Executors routines. 
- Fix the key generating.
- Distinguish the executors.
 2021-08-28 17:36:12 +08:00
l00591931 98fad9f08e Add st and ut for jvp vjp and grad 2021-08-28 17:34:23 +08:00
i-robot 535877a47b !22014 Add Fixed Sparse Attention 
Merge pull request !22014 from zhihenghu/add_sparse_attention
 2021-08-28 07:13:01 +00:00
zhihenghu ce12c02343 Add Sparse Attention 
adjut the file structure and name

Deleted extra information

Do some formatting work

Add test case and fix some document

fix imports
 2021-08-28 11:50:58 +08:00
i-robot 1639023909 !22263 Add convertcolor operation 
Merge pull request !22263 from shenwei41/operation_dev
 2021-08-27 12:33:43 +00:00
i-robot dd907a4d91 !22135 rank id master 0820 
Merge pull request !22135 from mindspore_ding/rank_id_master_0816
 2021-08-27 08:51:05 +00:00
i-robot ebe75e403b !22444 Apply comments on tensor stat online and offline PR 
Merge pull request !22444 from parastooashtari/tensor_level_info_online
 2021-08-27 07:42:51 +00:00
d00455729 34262db65e create rank_id dic 2021-08-27 14:24:06 +08:00
liyong c257cf36e2 refactor mindrecord 2021-08-27 09:15:05 +08:00
Parastoo Ashtari bf034bddb5 Apply comments on tensor stat online and offline debugger 2021-08-26 17:40:01 -04:00
i-robot cd4081ac87 !20676 [assistant][ops] Add array operator SplitV 
Merge pull request !20676 from 孟权令/SplitV
 2021-08-26 13:54:40 +00:00
shenwei41 1295744524 Add ConvertColor Operation 2021-08-26 21:14:28 +08:00
i-robot e6e1f37ae4 !22346 [Core] Fix the bug of scope setting when cloning nodes 
Merge pull request !22346 from Xiaoda/86-fix-the-fullname-scope-bug
 2021-08-26 13:04:15 +00:00
i-robot e753a3f70a !22416 Transform device_id to rank_id for hccl 
Merge pull request !22416 from 张毅辉/Device_id_to_rank_id
 2021-08-26 12:09:38 +00:00
haizhouye d96d9e64b0 [feat] [assistant] [I3ALCA] add new LowpassBiquad operator 
[feat] [assistant] [I3ALCA] add new LowpassBiquad operator

bugfix

fix

fix
 2021-08-26 18:49:21 +08:00
i-robot 7083ec9d37 !21925 add pad mode to maxpool3d 
Merge pull request !21925 from jiangzhenguang/amend_maxpool3d
 2021-08-26 09:08:37 +00:00
i-robot 8d00a8d803 !22360 Fix Transformer Mirror Error 
Merge pull request !22360 from huangxinjing/fix_transformer_mirror_error
 2021-08-26 08:16:33 +00:00
zhangyihui 3e5cb3b506 fix bugs for device_id_to_rank_id 2021-08-26 16:15:18 +08:00
i-robot 28e63116f2 !21921 Re-enabling offline debugger ut test 
Merge pull request !21921 from sabrinasun_59ee/uttest
 2021-08-26 07:50:01 +00:00
i-robot 471c57d3d7 !20046 [assistant][ops] Add New MaskedFill 
Merge pull request !20046 from 孟权令/MaskedFill
 2021-08-26 07:43:18 +00:00
i-robot a646eb27ab !21616 modify ms function cache key 
Merge pull request !21616 from chujinjin/modify_ms_function_cache_key
 2021-08-26 07:36:50 +00:00
i-robot 0faf36d5c5 !22187 modify api comment 
Merge pull request !22187 from changzherui/mod_dir_auth
 2021-08-26 03:01:33 +00:00
i-robot 07eaa1969b !22344 fix compile error when weight is used in while condition 
Merge pull request !22344 from xychow/fix-while-loop-with-weight-in-condition
 2021-08-26 03:00:38 +00:00
Xiaoda Zhang b2703879c6 fix the scope setting error when cloning nodes 2021-08-26 10:25:38 +08:00
i-robot edcbb68d71 !22386 fix neighborexchange empty input case 
Merge pull request !22386 from zhoufeng/fix-neighbor-empty-input-bak
 2021-08-26 01:52:10 +00:00
i-robot 5aeec398bb !22369 add test cases for conv2d 
Merge pull request !22369 from yangzhenzhang/add-test-cases
 2021-08-26 01:46:10 +00:00
i-robot 457a01fd09 !20055 [assistant][ops] Add math operator IndexAdd 
Merge pull request !20055 from 孟权令/IndexAdd
 2021-08-26 01:15:39 +00:00
sabrinasun a9c6bf45a3 re-enabling offline debugger ut test 2021-08-25 19:05:19 -04:00
changzherui 46319f3198 modify comment 2021-08-26 00:44:44 +08:00
zhoufeng e5a1582e4b fix neighborexchange empty input case 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-08-25 21:41:22 +08:00
huangxinjing 62496d75f3 less the interface exposed 2021-08-25 21:22:40 +08:00
i-robot 956ae2bbfd !22223 [assistant][TimeMask and FreqMask] 
Merge pull request !22223 from QingfengLi/TimeFreqMask
 2021-08-25 10:43:24 +00:00
i-robot acee9b24bc !22284 Change Op name in hccl to Op name in step trace 
Merge pull request !22284 from 张毅辉/op_name_of_hccl_to_op_name_of_step_trace
 2021-08-25 09:32:55 +00:00
yangzhenzhang 0b9b2a9458 add test cases 2021-08-25 17:22:20 +08:00
jiangzhenguang 8a78b2b7f6 add pad mode to maxpool3d 2021-08-25 16:24:02 +08:00
i-robot 60634c5d11 !21745 Unified format of single machine and multi machine performance data directory 
Merge pull request !21745 from 张毅辉/Device_id_to_rank_id
 2021-08-25 07:49:29 +00:00
doit a5193df648 [feat] [assistant] [I3T92B] add new array operator MaskedFill 2021-08-25 15:29:37 +08:00
i-robot 36238032a2 !22245 Add pynative switch layer ut test case 
Merge pull request !22245 from zjun/switch_layer_ut_test
 2021-08-25 07:24:28 +00:00
chujinjin 551fa9ab8b modify ms function cache key 2021-08-25 14:40:45 +08:00
hulx c70731d601 [feat][assistant][I3T924] add new math operator IndexAdd 2021-08-25 14:19:17 +08:00
zhangyihui dab750d1a5 Mapping op_name of hccl to op_name of step trace 2021-08-25 10:51:52 +08:00
chenx2ovo 2f1d974eeb [fix] [assistant] [I465ZG] revise error message and change input param datatype 2021-08-25 10:47:27 +08:00
i-robot 698eb406e2 !20129 [assistant][ops] Add math operator Erfinv 
Merge pull request !20129 from 孟权令/Erfinv
 2021-08-25 02:44:18 +00:00
i-robot 2edaba38bf !21389 Add Tensor Base and Stat info to offline debugger 
Merge pull request !21389 from parastooashtari/tensor_info_levels
 2021-08-25 02:08:34 +00:00
i-robot 0adacd1b68 !22226 [AutoParallel]Refacor pipeline code 
Merge pull request !22226 from lichen/Refactor_part_of_pipeline
 2021-08-25 01:54:18 +00:00
zhangyihui 3d19949eb4 device_id to rank_id 2021-08-25 09:52:23 +08:00
zhousiyi 44bdcb101c fix while loop compile error when weight is used in while condition 2021-08-25 01:33:34 +00:00
i-robot 4e81ea7bb0 !22300 Add ut and st case for non tensor input in pynative 
Merge pull request !22300 from JoyLvliang/add_st_ut_case_for_pynative_non_tensor_input
 2021-08-25 01:23:34 +00:00
Parastoo Ashtari ff83dee704 Add tensor base and stat info to offline debugger 2021-08-24 18:19:59 -04:00
lichenever 5812076512 Refactor_part_of_pipeline 2021-08-24 21:37:41 +08:00
hulx ca6f3ef155 [feat][assistant][I3T925] add new math operator Erfinv 2021-08-24 21:25:04 +08:00
i-robot 661c83e17f !22274 MD Profiling UT: Use pytest setup and teardown 
Merge pull request !22274 from cathwong/ckw_mon_py_analyze_ut5
 2021-08-24 13:24:49 +00:00
i-robot 1e47ff7bc3 !22108 modify check strategy for conv2d 
Merge pull request !22108 from yangzhenzhang/modify-check-strategy-for-conv2d
 2021-08-24 12:01:23 +00:00
hedongdong 09bc1bddf1 [feat][assistant][I3T92H] add new array operator SplitV 2021-08-24 19:54:26 +08:00
i-robot ab758a981c !20044 [assistant][ops] Add New Lerp 
Merge pull request !20044 from 孟权令/Lerp
 2021-08-24 11:25:44 +00:00
7347157+joylvliang@user.noreply.gitee.com a30800ecc3 add_st_ut_case_for_pynative_non_tensor_input 2021-08-24 16:44:05 +08:00
i-robot 822cedec0a !22153 Convert some ops bprops to mindir 
Merge pull request !22153 from YuJianfeng/bprop_mindir
 2021-08-24 08:07:46 +00:00
yangzhenzhang f1afaeac5a modify check strategy for conv2d 2021-08-24 16:06:16 +08:00
zjun 779b655cfe Add switch_layter pynative ut test 
Signed-off-by: zjun <zhangjun0@huawei.com>
 2021-08-24 11:21:13 +08:00
i-robot 6082835501 !22146 dataset: support return bytes in GeneratorDataset 
Merge pull request !22146 from ms_yan/decode_bytes
 2021-08-24 02:41:18 +00:00
Cathy Wong 3581e7962e MD Profiling UT: Use pytest setup and teardown 2021-08-23 21:09:48 -04:00
yujianfeng 712b9bd013 convert some ops bprops to mindir 2021-08-24 09:09:09 +08:00
i-robot db44b88e1e !22094 MD Profiling: For mismatch op info btwn files, skip bottleneck analysis 
Merge pull request !22094 from cathwong/ckw_mon_py_analyze_fixes3
 2021-08-23 18:28:51 +00:00
ms_yan 6ecfc34524 add np.frombuffer to support return bytes 2021-08-23 17:31:38 +08:00
ms_yan 36a8886ca2 Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset" 
This reverts commit b077aa1cab.

Revert "[feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset"

This reverts commit 4e6f7dc97d.

delete pass_registry_test.cc

comment  hiai_nlu_model_multi.pb related  line
 2021-08-23 01:46:38 +08:00
djc b077aa1cab [feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset 2021-08-22 16:26:45 +08:00
djc 4e6f7dc97d [feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset 2021-08-22 13:39:37 +08:00
i-robot 0e7844daa9 !22093 revert merge request 21685 
Merge pull request !22093 from guozhijian/revert-merge-21685-master
 2021-08-21 09:25:32 +00:00
i-robot 4ba337e0f5 !16667 [assistant][ComplexNorm] 
Merge pull request !16667 from QingfengLi/ComplexNorm
 2021-08-21 02:44:18 +00:00
doit bf23333b27 [feat] [assistant] [I3T927] add new math operator Lerp 2021-08-20 20:19:41 +08:00
i-robot f34426095c !22084 Move Transformer Code from Mindspore.nn.parallel to mindspore.parallel.nn 
Merge pull request !22084 from huangxinjing/transformer_doc_check
 2021-08-20 10:40:01 +00:00
huangxinjing d777742904 1. Move the class to mindspore.parallel, support activation sharding 2021-08-20 14:34:10 +08:00
i-robot 954864bfba !22037 incoroporate getitem if indexed node is zeros_like 
Merge pull request !22037 from xychow/always-incorporate-getitem-if-zeros-like
 2021-08-20 02:14:35 +00:00
i-robot 5d1bb097e2 !22052 Fix probability core dump in MindData coverage test 
Merge pull request !22052 from luoyang/issues2
 2021-08-20 01:18:06 +00:00
robert_luo_yibo d837cbee0f [feat][assistant][I3CEG8] add new data operator ComplexNorm 2021-08-20 09:07:21 +08:00
Cathy Wong 85931175bc MD Profiling: For mismatch op info btwn files, skip bottleneck analysis. 
Add to summary output: per_pipeline_time and per_push_queue_time.
Enhance UT
 2021-08-19 12:19:59 -04:00
guozhijian e1df9a2152 revert 'Pull Request !21685 : add function to invert_op' 2021-08-19 22:49:51 +08:00
i-robot 4113aee7d6 !18668 [assistant][ops]New operator implementation, include Flowers102Dataset 
Merge pull request !18668 from Wangsong95/flowers102_dataset
 2021-08-19 08:41:44 +00:00
YangLuo 9352935ff6 Fix probability core dump in MindData coverage test 2021-08-19 14:34:57 +08:00
i-robot c93bb9936e !20011 [assistant][ops] Add nn operator Roll 
Merge pull request !20011 from 孟权令/Roll
 2021-08-19 06:28:28 +00:00
i-robot 3ad641cb65 !21685 add function to invert_op 
Merge pull request !21685 from Killer/fake_killer
 2021-08-19 05:13:39 +00:00
zhousiyi dcd374961e incoroporate getitem if indexed node is zeros_like so AddN(MakeTuple(x, zeros_like)) can be optimized 2021-08-19 03:28:24 +00:00
fake_killer b0bc4bf5da [feat] [assistant] [I44TRS] extend invert_op's function 2021-08-18 21:46:15 +08:00
i-robot dde05c36b8 !21551 auto_parallel_context interface dataset_strategy union 
Merge pull request !21551 from yao_yf/auto_parallel_context_dataset_strategy_union
 2021-08-18 09:03:18 +00:00
i-robot 415275ae17 !21805 support adafactor model parallel 
Merge pull request !21805 from yangzhenzhang/auto-parallel-support-adafactor-opt
 2021-08-18 07:20:39 +00:00
hedongdong d76ed25e96 [feat][assistant][I3T92I] add new nn operator Roll 2021-08-18 10:15:17 +08:00
i-robot 264cb4d2e8 !21920 MD Profiling Analyze: Search for device trace file, independent of device_target 
Merge pull request !21920 from cathwong/ckw_mon_py_analyze_device_file
 2021-08-18 00:57:50 +00:00
i-robot 0d839fa7c6 !21809 Improved Transformer Struture and Add Args Check 
Merge pull request !21809 from huangxinjing/transformer_improved
 2021-08-17 12:05:25 +00:00
i-robot a77a0b968d !21761 comm_recompute_interface. 
Merge pull request !21761 from yao_yf/comm_recompute_interface
 2021-08-17 09:14:29 +00:00
yangzhenzhang 7ca64d2235 auto parallel support adafactor opt 2021-08-17 10:36:42 +08:00
yao_yf 5277b229be add cell comm recompute interface 2021-08-17 09:23:21 +08:00
Cathy Wong a2cbd4b5fa MD Profiling Analyze: Search for device trace file 
MinddataProfilingAnalyzer() - remove device_target input parm
 2021-08-16 15:41:11 -04:00
huangxinjing 18044aff0f 1. Add docstring, elimitate attention mask, tuple append the deocoder return layer past 
split attention inputs from two into three

Add input check and modify test case

Fix check error and add check to transformer inputs

add input check to the transformers
 2021-08-16 21:08:48 +08:00
Xiao Tianci aae886bcd7 fix crowd contributing code 2021-08-16 19:33:10 +08:00
yao_yf a83bf73298 union auto_parallel_context interface dataset_strategy 2021-08-16 10:54:46 +08:00
i-robot 530da3e37e !21527 fix_reshape_reshape_in_auto_parallel 
Merge pull request !21527 from yao_yf/fix_reshape_reshape_in_auto_parallel
 2021-08-13 08:29:15 +00:00
i-robot f99effd430 !21755 Fix batch usability problem 
Merge pull request !21755 from xiefangqi/md_fix_batch_usability
 2021-08-13 07:21:49 +00:00
i-robot d1112f8e9c !17631 [assistant][FrequencyMasking] 
Merge pull request !17631 from QingfengLi/FreqMask
 2021-08-13 06:48:06 +00:00
xiefangqi e4894a1bf1 fix batch usability problem 2021-08-12 20:12:43 +08:00
i-robot 2650aae9ba !21351 complex support 
Merge pull request !21351 from zhouyaqiang0/complex_support
 2021-08-12 09:39:15 +00:00
chenx2ovo 53615010a3 [feat][assistant][I3CEGG] add new data OP FrequencyMasking 2021-08-12 15:28:30 +08:00
yao_yf e233880e41 fix reshape depend reshape in auto parallel 2021-08-12 11:45:28 +08:00
i-robot bff5cbda9c !21670 fix: null numpy field in mindrecord will cause read error 
Merge pull request !21670 from guozhijian/fix_null_numpy_field_in_mr
 2021-08-12 03:39:34 +00:00
zhouyaqiang b81ba100b7 add complex number support 2021-08-12 10:36:43 +08:00
i-robot 63445ff6fd !21627 alltoall exception handle 
Merge pull request !21627 from zhoufeng/alltoall_exception
 2021-08-12 01:40:22 +00:00
i-robot 6320bf6b7b !21676 check strategy for conv2d 
Merge pull request !21676 from yangzhenzhang/check-strategy-for-conv2d
 2021-08-12 01:29:37 +00:00
i-robot 73b55cff72 !20794 add adafactor 
Merge pull request !20794 from jiangzhenguang/add_adafactor_optimizer
 2021-08-12 01:27:03 +00:00
yangzhenzhang d18c813ee4 check strategy for conv2d 2021-08-11 19:12:48 +08:00
zhoufeng 03a56f2bb0 alltoall exception handle 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-08-11 17:30:49 +08:00
jonyguo 42b3512a1b fix: when field is none in mr 2021-08-11 17:11:38 +08:00
jiangzhenguang a3bb780ce4 optimize run memory 2021-08-10 20:45:25 +08:00
chenx2ovo e72acf362c [feat][assistant][I3CEGH] add op timemasking 2021-08-10 12:06:07 +08:00
i-robot f154db1bb0 !20680 [assistant][ops] Add New SoftMarginLoss and SoftMarginLossGrad 
Merge pull request !20680 from 孟权令/SoftMarginLoss
 2021-08-10 02:39:28 +00:00
i-robot 4aaa8126a0 !21528 Add Parallel Print Support 
Merge pull request !21528 from huangxinjing/add_print
 2021-08-09 10:55:04 +00:00
i-robot dc626617fc !19526 [assistant][TimeStretch] 
Merge pull request !19526 from QingfengLi/TimeStretch
 2021-08-09 09:40:38 +00:00
i-robot 75429acbe3 !21519 fix waring 
Merge pull request !21519 from shenwei41/fix_sqlite
 2021-08-09 09:09:18 +00:00
shenwei41 59efbb88ec fix waring 2021-08-09 11:40:52 +08:00
i-robot 8306abeb67 !21168 Only replace the primal user with tuple_getitem once 
Merge pull request !21168 from YuJianfeng/ad
 2021-08-09 03:19:07 +00:00
huangxinjing 92bad162bd Add print 2021-08-09 11:14:25 +08:00
chenx2ovo 04705e5b0d [feat][assistant][I3CEGC] add op timestretch 2021-08-07 22:53:41 +08:00
i-robot c84e09cf45 !21072 Deserialize - python binding 
Merge pull request !21072 from zetongzhao/deserialize_1
 2021-08-06 21:47:09 +00:00
zetongzhao 4f199b548c deserialize and tests 2021-08-06 13:35:27 -04:00
yujianfeng cf4121126a Only replace the primal user with tuple_getitem once 2021-08-06 19:23:14 +08:00
i-robot d2ae09d891 !21437 Support ListComp and GeneratorExp in Graph Mode. 
Merge pull request !21437 from 张清华/opt
 2021-08-06 09:09:47 +00:00
i-robot 51a1ca61f2 !21357 [MD] fix SlicePatches when dealing with some special tensor. 
Merge pull request !21357 from liyong126/fix_bug
 2021-08-06 08:58:27 +00:00
i-robot 8a8851dc52 !18667 Remove redundant depend 
Merge pull request !18667 from huangbingjian/remove_redundant_depend
 2021-08-06 07:43:53 +00:00
SichongHao 3d2892b454 [feat][assistant][I3T91Y][I3T91Z]add new operator SoftMarginLoss and SoftMarginLossGrad 2021-08-06 15:13:13 +08:00
liyong 5fea72473c fix HW1 issue 2021-08-06 14:07:26 +08:00
Zhang Qinghua aef396f9f2 Support ListComp and GeneratorExp in Graph Mode. 2021-08-06 11:44:57 +08:00
ckczzj 9d9f33be88 [feat][assistant][I3J6VN] add new data operator flowers102 2021-08-06 10:55:12 +08:00
chenx2ovo aa45e2ebbc [feat] [assistant] [I3CEER] add op AmplitudeToDB 2021-08-06 10:07:29 +08:00
huangbingjian 53b31abf12 remove useless depend 2021-08-05 20:21:24 +08:00
Carry955 98be266585 [feat][assistant][I3J6TQ] add a new operator Angle 2021-08-04 19:41:00 -07:00
i-robot 680e40a43a !16453 [assistant][BassBiquadOp] 
Merge pull request !16453 from StyleHang/BassBiquadOp
 2021-08-04 10:02:34 +00:00
i-robot f4e07c0dce !17486 [assistant][ops] Add new dataset operator Flickr. 
Merge pull request !17486 from Rainfor/wangkc
 2021-08-04 08:52:21 +00:00
i-robot a83f8f6f5d !20284 Unify exception info with using the unsupported numpy method 
Merge pull request !20284 from huanghui/numpy-in-graph-mode
 2021-08-04 08:06:01 +00:00
i-robot d260f38936 !15722 [assistant][AdjustGamma] 
Merge pull request !15722 from QingfengLi/adjust_gamma
 2021-08-04 03:58:09 +00:00
li-qiyao ba326d76a8 [feat][assistant][I3J6TW] add new data operator BassBiquad 2021-08-03 19:40:12 -07:00
wangkc123 48f5fed1f8 [feat] [assistant] [I3CKEN] add new dataset operator Flickr 2021-08-04 10:20:43 +08:00
chenx2ovo 4191dde45f [feat][assistant][I3CEGM] add op adjust gamma 2021-08-04 02:32:13 +08:00
tongyue 08469e113a [feat][assistant][I3J6TV]add new audio operator BandrejectBiquad 2021-08-03 05:41:53 -07:00
i-robot 2c7b8e73df !16452 [assistant][BandpassBiquadOp] 
Merge pull request !16452 from StyleHang/BandpassBiquadOp
 2021-08-03 11:08:48 +00:00
i-robot a70b0f3bf4 !18260 [assistant][ops]New operator implementation, include HShrink and HShrinkGrad 
Merge pull request !18260 from 张璇/hshrink
 2021-08-03 11:00:11 +00:00
i-robot 93af13f332 !19979 dataset: modify some error msg 
Merge pull request !19979 from ms_yan/err_msg
 2021-08-03 08:53:30 +00:00
i-robot 0a3b4ff84b !21207 modify replace graph for conv2d 
Merge pull request !21207 from yangzhenzhang/fix-bugs-for-conv2d
 2021-08-03 08:48:37 +00:00
huanghui 3e17650172 Raise NotImplementedError when parsing the numpy methods, but not the numpy constant. 2021-08-03 14:33:22 +08:00
i-robot ef77050348 !18892 [assistant][ops] Add new dataset operator SBD. 
Merge pull request !18892 from Rainfor/sbd
 2021-08-03 03:33:00 +00:00
yangzhenzhang ef0361a449 fix bugs for conv2d 2021-08-03 10:48:05 +08:00
ms_yan 65870045bc modify some error msg 2021-08-03 09:16:28 +08:00
administrator 29d57a89fb [feat][assistant][I3TDRD]add new audio operator BandpassBiquad 2021-08-02 07:08:47 -07:00
i-robot a81fee280c !16458 [assistant][AllpassBiquadOp] 
Merge pull request !16458 from StyleHang/AllpassBiquadOp
 2021-08-02 08:40:06 +00:00
Xiaoda Zhang 4b4b3cdaf4 add reduceany operator and extend onehot to multi-dimensions 2021-08-02 08:53:43 +08:00
zhangjie b04036e13c [feat][assistant][I3PYD4] add new data operator HShrink and HShrinkGrad 2021-08-01 20:55:58 +08:00
danansheng accb87606a [feat][assistant][I3PYD4] add new data operator HShrink 2021-08-01 20:52:55 +08:00
Isaac b49e1acc3e [feat] [assistant] [I3J6TM] add new audio operator AllpassBiquad 2021-07-31 16:15:17 +08:00
i-robot 9301de1b54 !21098 fix bug 
Merge pull request !21098 from shenwei41/fix_waring
 2021-07-31 01:12:21 +00:00
shenwei41 e3385e2564 fix waring to master 2021-07-30 16:37:27 +08:00
i-robot 6e84bf0f0f !16449 [assistant][ops] Add new audio operator BandBiquad 
Merge pull request !16449 from StyleHang/BandBiquadOp
 2021-07-30 03:35:07 +00:00
liannai 5a341e7e27 [feat] [assistant] [I3J6TS] add new audio operator BandBiquad 2021-07-29 17:57:27 +08:00
huangxinjing 615d1a179d Add transformer layer 2021-07-29 11:10:43 +08:00
i-robot 9f296c58d6 !20960 [AutoParallel]Add replace graph for conv2d 
Merge pull request !20960 from lichen/add_replace_graph_for_conv2d
 2021-07-28 07:06:41 +00:00
lichenever a7f8024c29 add_replace_graph_for_conv2d 2021-07-28 11:02:21 +08:00
yao_yf dc7dc7d3fa dataset strategy set 2021-07-27 18:44:10 +08:00
i-robot b8901526b9 !20882 Fix GradOperation recursive call issues. 
Merge pull request !20882 from 张清华/opt
 2021-07-27 01:00:39 +00:00
Zhang Qinghua 8be269c1cc Fix GradOperation issues: 
- Allow the J CNode used multiple as non-call input.
- Check recursive J FG including FV J CNode.
- Add grad functional api.
 2021-07-26 20:47:49 +08:00
yangzhenzhang 80e5cc0e52 add parallel op for gatherd 2021-07-26 11:14:25 +08:00
i-robot c80098b261 !20712 [Auto parallel] Enable All2All when inferring redistribution ops 
Merge pull request !20712 from Xiaoda/76-change-alltoall-redistribution
 2021-07-24 07:07:16 +00:00
i-robot 26bfbf9124 !18282 [assistant][ops]New operator implementation, include HSigmoid and HSigmoidGrad 
Merge pull request !18282 from 张璇/hsigmoid_grad
 2021-07-24 06:22:46 +00:00
Xiaoda Zhang bb5d4212f7 enable All2All in infering redistribution ops 2021-07-24 09:09:01 +08:00
i-robot 1e1d7d5739 !20443 Add numpy-native ut/st 
Merge pull request !20443 from 杨林枫/add_numpy_ut
 2021-07-23 11:24:39 +00:00
wanglixin 33e93e296c [fix][assistant][I3PYD0] fix bug in the Ascend operator HSigmoid and HSigmoidGrad 2021-07-23 16:33:16 +08:00
wild-fox b6c575689d [feat][assistant][I3PYD0] add new Ascend operator HSigmoid 2021-07-23 16:20:51 +08:00
wanglixin a377ade89f [feat][assistant][I3PYD3] add new Ascend operator HSigmoidGrad 2021-07-23 16:20:51 +08:00
i-robot 0f8a21693b !18266 [assistant][ops]New operator implementation, include SoftShrink and SoftShrinkGrad 
Merge pull request !18266 from 张璇/softshrink
 2021-07-23 06:40:47 +00:00
i-robot 69a7ef8632 !20707 [AutoParallel]AutoParallel support control flow 
Merge pull request !20707 from lichen/auto_parallel_support_control_flow
 2021-07-23 06:22:12 +00:00
i-robot bcb49f10b4 !20702 Fix NumpySlicesDataset not accept NumPy as data 
Merge pull request !20702 from xiaotianci/fix_numpy_slices
 2021-07-23 03:31:29 +00:00
i-robot 7666b6e388 !20708 fix exception type to TypeError 
Merge pull request !20708 from xychow/fix-exception-type
 2021-07-23 02:48:49 +00:00
i-robot e8448f972b !20725 Support the tensor of string dtype. 
Merge pull request !20725 from 张清华/opt
 2021-07-23 02:12:48 +00:00
Zhang Qinghua f91c697efc Support the tensor of string dtype. 2021-07-22 19:05:37 +08:00
lichenever 3c7cfb7c08 auto_parallel_support_control_flow 2021-07-22 17:31:31 +08:00
Xiao Tianci 53c01c437d fix NumpySlicesDataset not accept numpy 2021-07-22 15:46:37 +08:00
wangrao124 463ca2434c add numpy-native ut/st test files 2021-07-22 14:47:00 +08:00
zhousiyi 9319eff958 change the error type from RuntimeError to TypeError 2021-07-22 06:38:12 +00:00
Lizxxy 5d00d482e4 [feat][assistant][I3PYDC] add new Ascend operator SoftShrinkGrad 2021-07-20 17:55:02 +08:00
zx be26e62080 [feat][assistant][I3PYDB] add new Ascend operator SoftShrink 2021-07-20 17:52:46 +08:00
i-robot a7d40fc220 !20520 [AutoParallel]Add op AllToAllv 
Merge pull request !20520 from lichen/add_op_AllToAllv
 2021-07-20 07:57:03 +00:00
i-robot ed4c9682b5 !20505 limit the scope of lift free variable 
Merge pull request !20505 from xychow/limit-lift-scope
 2021-07-20 06:10:17 +00:00
lichenever 8c1998fd6b add_op_AllToAllv 2021-07-20 10:49:28 +08:00
i-robot c9d3c1d346 !20411 enable optimizer parallel for inference 
Merge pull request !20411 from gziyan/enable_opt_shard_predict
 2021-07-20 01:37:06 +00:00
i-robot 6061194083 !20490 update check strategy for conv2d 
Merge pull request !20490 from yangzhenzhang/update-check-strategy-for-conv2d
 2021-07-20 01:23:08 +00:00
zhousiyi 597f29ea7d limit the lambda lift scope to the func_graph passed 2021-07-20 00:37:21 +00:00
zhousiyi b590f6d929 don't replace u with fprop_u in primal_graph and bprop_fg 2021-07-19 08:14:40 +00:00
yangzhenzhang b31cd27a08 update check strategy for conv2d 2021-07-19 15:03:26 +08:00
wangkc123 b381e0be9d [feat] [assistant] [I3CKER] add new dataset operator SBD 2021-07-17 21:02:30 +08:00
Ziyan 1c9166e0a6 remove restriction for opt shard in inference 2021-07-16 17:16:12 +08:00
Xiaoda Zhang 04381273b3 Add the sharding propagation function: 
1) users configure sharding strategies for operators;
2) framework will propagate the strategies from configured-ops to
non-configured ops using BFS;
3) the propagation goal is to minimize redistribution communication
cost;
 2021-07-14 10:54:18 +08:00
i-robot ea440db85e !18488 Remove Parameter Check in PyNative mode 
Merge pull request !18488 from caifubi/master-pynative-no-parameter
 2021-07-05 12:05:46 +00:00
i-robot 8508c9eb45 !18179 [MD] add slice patches op in c++ and python 
Merge pull request !18179 from liyong126/slice_patches_op
 2021-07-05 07:04:45 +00:00
i-robot 4a8225eaf4 !19160 Fix parameter check of Rotate and GaussianBlur API 
Merge pull request !19160 from xiaotianci/fix_rotate_and_gaussian_blur
 2021-07-05 06:30:46 +00:00
i-robot b93907fdca !19246 Change Loss to LossBase 
Merge pull request !19246 from chenhaozhe/change-loss-base
 2021-07-05 01:24:23 +00:00
liyong 9a1de0af65 add slice patches in python and c++ 2021-07-05 09:16:47 +08:00
zhousiyi a5b4e7bbf8 lift fv before grad except weight, then convert 
switch(cond, partial(g1, xs), partial(g2, ys))(Zs)
 to
 switch(cond, g1, g2)(Xs, Ys, Zs)

 switch_layer(index, make_tuple(partial(g1, xs), partial(g2, ys)))(Zs)
 to
 switch_layer(index, make_tuple(g1, g2))(Xs, Ys, Zs)

put Zs at last when unifyparameter as it may have u-monad or io-monad

use joined args other than broadened one as some extra parameter which is not a parameter of while_header can be add to while_body

inline fprop_switch forcely

reorder the parameter if one of the parameter is Monad when incorporate call

incorporate switch tuple_getitem if item 0 of tuple is EnvInstance or
item 1 of tuple is bprop function

addn with shape() and shape(1)

remove context_ from FuncGraphEvaluator to make it re-entry able to resolve evaluator stuck issue because of re-entry of the same FuncGraphEvaluator
 2021-07-03 00:03:37 +08:00
chenhaozhe 086a871975 Change Loss to LossBase 2021-07-02 16:41:02 +08:00
Xiao Tianci 8cdd0d8d90 fix param check for Rotate and GaussianBlur 2021-07-01 20:31:33 +08:00
i-robot 8102d68b8b !18420 Give concreted error when mappable dataset lack __len__ method 
Merge pull request !18420 from luoyang/API-check-pybind-name
 2021-06-29 07:48:03 +00:00
YangLuo 17c121b087 Give concreted error when mappable dataset lack __len__ method 2021-06-29 11:13:12 +08:00
lichenever db8850a4a3 pipeline_support_predict_master 2021-06-26 09:25:59 +08:00
i-robot 905cba5ae0 !18788 Fix cache_admin stderr message and TFRecord get_dataset_size() when cached 
Merge pull request !18788 from lixiachen/fix_stderr_msg
 2021-06-24 17:52:10 +00:00
i-robot 708e56f659 !17899 Fix compile cache bug for resent50 
Merge pull request !17899 from LiangZhibo/cache
 2021-06-24 13:29:58 +00:00
Ziyan be1f5a43d7 opt shard fit micro batch 2021-06-24 14:52:19 +08:00
l00591931 8ae5d7cc84 Fix compile cache for resnet50 2021-06-24 14:36:24 +08:00
yangzhenzhang 69acf757d0 add parallel op for conv2d backprop input 2021-06-24 10:01:49 +08:00
Lixia Chen 1f03b16e0e Fix cache_admin server start stderr output 
Fix TFRecord get_dataset_size() when cached
 2021-06-23 18:32:54 -04:00
Harshvardhan Gupta 6845a16b44 fix coredump with large max_rowsize and add arg validations 2021-06-23 09:31:11 -04:00
YangLuo 4e9f6d54f7 update cpp api & doc 2021-06-23 11:14:52 +08:00
i-robot dca5504fd4 !15672 [assistant][RGB2BGR] 
Merge pull request !15672 from QingfengLi/rgb2bgr
 2021-06-22 12:48:04 +00:00
chenx2ovo 4b98099dcb [feat][assistant][I3CEGQ] add op rgb2bgr 2021-06-21 16:16:50 +08:00
yangzhenzhang 24370b5613 add parallel op for maxpool 2021-06-21 09:00:56 +08:00
i-robot f6cda391a9 !18487 remove the redundant code, add docstring of operator init and add default valuefor args. 
Merge pull request !18487 from wangshuide/wsd_master_warn
 2021-06-18 09:38:26 +00:00
i-robot ec999d3fa5 !18477 Modify the error message of abstract join 
Merge pull request !18477 from huangbingjian/abstract_join
 2021-06-18 09:10:29 +00:00
huangbingjian d695554ae5 modify the error message of abstract join 2021-06-18 14:12:10 +08:00
i-robot ff3ad7428a !18413 add parallel op for batch norm 
Merge pull request !18413 from yangzhenzhang/add-parallel-op-for-batchnorm
 2021-06-18 03:08:07 +00:00
caifubi 95695711d7 Remove PyNative Parameter Check 2021-06-18 09:46:27 +08:00
i-robot ab3259c43a !18292 MD Profiling UT: Check CPU util file. Add sequential pipeline UTs 
Merge pull request !18292 from cathwong/ckw_mon_py_analyze_ut4
 2021-06-17 21:47:10 +08:00
wangshuide2020 185ddbbe66 remove the redundant code, add docstring of operator init and add default value for args. 2021-06-17 20:29:52 +08:00
yangzhenzhang af0d28de48 add parallel op for batchnorm 2021-06-17 15:43:24 +08:00
liyong 2989a5a23b fix some bugs 2021-06-17 11:56:10 +08:00
Cathy Wong c37eb350f6 MD Profiling UT: Check CPU util file. Add sequential pipeline UTs 2021-06-16 15:30:59 -04:00
i-robot 7ff63a8e70 !17894 Add support for mindir encryption 
Merge pull request !17894 from liuluobin/master
 2021-06-15 15:15:40 +08:00
i-robot 85d860e6a2 !16457 [AutoParallel]pipeline_split_adapt_master 
Merge pull request !16457 from lichen/pipeline_split_adapt_master
 2021-06-11 11:37:40 +08:00
liuluobin 5b9b46224b Add encryption support for mindir 2021-06-11 09:33:45 +08:00
i-robot 21513404c4 !17082 set default context mode to GRAPH_MODE 
Merge pull request !17082 from huangbingjian/change_context_mode
 2021-06-10 21:21:46 +08:00
lichenever db5d508356 pipeline_split_adapt_master 2021-06-10 20:17:33 +08:00
i-robot dc9720cbb2 !17999 add parallel operator for conv2d 
Merge pull request !17999 from yangzhenzhang/add-parallel-operator-for-conv2d
 2021-06-10 20:05:45 +08:00
i-robot 62a165a3a2 !16917 Add Crop Python API for CV data processing 
Merge pull request !16917 from xiaotianci/crop
 2021-06-10 17:16:04 +08:00
i-robot c293f06b27 !17373 add docs, user-example and assertion for rearrange_inputs 
Merge pull request !17373 from zhiqwang/rearrange-inputs-docs
 2021-06-10 16:17:23 +08:00
yangzhenzhang 7a40741048 add parallel operator for conv2d 2021-06-10 14:58:51 +08:00
i-robot 3a13dde14d !17761 add save ckpt info 
Merge pull request !17761 from changzherui/add_ckpt_info
 2021-06-10 11:01:18 +08:00
i-robot b79400296a !17959 fix optimizer weight shard config 
Merge pull request !17959 from gziyan/add_optimizer_weight_shard_config
 2021-06-10 10:49:17 +08:00
Xiao Tianci a54e65a7ad add Crop Python API 2021-06-10 09:46:57 +08:00
i-robot e60f5f12f5 !17836 Add Rotate API for CV data processing 
Merge pull request !17836 from xiaotianci/rotate
 2021-06-10 09:29:18 +08:00
changzherui 7a05132ed4 add ckpt save info 2021-06-09 22:42:27 +08:00
Cathy Wong a8de1327d9 MD Profiling Analyze: Add class BottleneckAnalyzer 2021-06-09 09:24:32 -04:00
zhiqiang f43d720eb0 Add docs and user-example for rearrange_inputs 2021-06-09 04:19:32 -04:00
huangbingjian ad8f73f32b set default context mode to GRAPH_MODE 2021-06-09 14:40:49 +08:00
i-robot 50f11d5439 !17503 dataset: enhance the expression of error msg 
Merge pull request !17503 from ms_yan/log_modify
 2021-06-08 22:25:04 +08:00
Xiao Tianci 9c4c1c6a77 add Rotate Python API 2021-06-08 22:19:15 +08:00
i-robot 3a63a66d64 !17807 MD Profiling UT: Add MD Analyze UT for MinddataProfilingAnalyzer 
Merge pull request !17807 from cathwong/ckw_mon_py_analyze_ut3
 2021-06-08 21:52:55 +08:00
ms_yan be65ebcb28 complete dataset log 2021-06-08 16:45:47 +08:00
mindspore-ci-bot 8934e4a513 !17879 dynamic min max shape phase 2 
From: @luoyang42
Reviewed-by: @liucunwei,@jonyguo
Signed-off-by: @liucunwei
 2021-06-08 14:49:13 +08:00
Ziyan 95ac0f6d58 fix optimizer weight shard config 2021-06-08 10:44:17 +08:00
Cathy Wong b7342efe12 MD Profiling UT: Add MD Analyze UT. Add more pipeline profiling UTs. 2021-06-07 11:00:34 -04:00
luoyang dad289c679 dynamic min max shape phase 2 2021-06-07 20:06:26 +08:00
Zhenglong Li 2c7d1bf603 Implement new gnn feature 2021-06-07 10:20:06 +08:00
mindspore-ci-bot e5a189a4f0 !17520 Optimize exception info when compile net failed 
From: @irmo
Reviewed-by: @ginfung,@zh_qh
Signed-off-by: @zh_qh
 2021-06-05 12:04:28 +08:00
mindspore-ci-bot e19e14295a !17773 adapt offline debugger to new dump, sync support for iteration ranges, GPU default dump mode correction 
From: @john_tzanakakis
Reviewed-by: @nsyca,@mikef
Signed-off-by: @mikef
 2021-06-05 02:46:50 +08:00
John Tzanakakis 7d460de8b4 adapt offline debuger to new dump, sync support for iteration ranges, GPU default dump mode correction 2021-06-04 08:38:50 -04:00
mindspore-ci-bot 7d9bf65654 !16755 support list add list in net in GraphMode. 
From: @fenglovebei
Reviewed-by: @zh_qh
Signed-off-by: @zh_qh
 2021-06-04 16:37:40 +08:00
huanghui 29f632613f optimize log 2021-06-04 12:32:44 +08:00
mindspore-ci-bot 97989c3bbc !17669 Substitute _Loss for Loss 
From: @c_34
Reviewed-by: @guoqi1024,@liangchenghui
Signed-off-by: @guoqi1024,@liangchenghui
 2021-06-04 10:20:00 +08:00
mindspore-ci-bot a3f2b92839 !17638 modify vgg16 network for clould 
From: @zhanghuiyao
Reviewed-by: @c_34,@wuxuejian
Signed-off-by: @c_34
 2021-06-04 09:21:30 +08:00
fenglovebei 76b884dea9 list add list 2021-06-03 21:16:30 +08:00
chenhaozhe 9da8534396 change _Loss to Loss 2021-06-03 15:26:59 +08:00
zhanghuiyao 36ec89656a modify vgg16 network for clould 2021-06-03 11:39:27 +08:00
mindspore-ci-bot b52f9ddb08 !17060 Add HorizontalFlip and VerticalFlip for CV data processing 
From: @tiancixiao
Reviewed-by: @liucunwei
Signed-off-by: @liucunwei
 2021-06-02 17:48:28 +08:00
mindspore-ci-bot c4757f0692 !17461 MD Profiling Analyze: Handle cpu util with missing ops. Enhance UTs. 
From: @cathwong
Reviewed-by: @robingrosman
Signed-off-by: @robingrosman
 2021-06-02 11:12:59 +08:00
mindspore-ci-bot c77e7de1dc !17313 fix static check 
From: @jiang-shuqiang
Reviewed-by: @yelihua,@ouwenchang
Signed-off-by: @ouwenchang
 2021-06-02 08:50:37 +08:00
mindspore-ci-bot ae2e7c1288 !17541 Fix MD Cache code check warnings [master] 
From: @lixiachen
Reviewed-by: @pandoublefeng,@robingrosman
Signed-off-by: @robingrosman
 2021-06-02 04:53:54 +08:00
Lixia Chen 8c1b561149 Fix cache code check warnings 2021-06-01 10:02:38 -04:00
mindspore-ci-bot a92a450881 !17383 Optimize exception info print 
From: @irmo
Reviewed-by: @zh_qh,@ginfung,@ginfung
Signed-off-by: @zh_qh
 2021-06-01 17:43:24 +08:00
Cathy Wong f8beb933ad MD Profiling Analyze: Handle cpu util with missing ops. Enhance UTs. 2021-05-31 20:33:19 -04:00
mindspore-ci-bot 4338e4abac !17374 files_need_cleanup report fixes to master 
From: @hfarahat
Reviewed-by: @pandoublefeng,@robingrosman
Signed-off-by: @robingrosman
 2021-06-01 05:21:18 +08:00
jiangshuqiang 6154f957fb fix static check 2021-05-31 16:47:21 +08:00
Xiao Tianci 9c74d55a49 add HorizontalFlip and VerticalFlip APIs 2021-05-31 15:55:21 +08:00
huanghui 5acf3c8ade [dfx]optimize exception info print 2021-05-31 14:57:29 +08:00
mindspore-ci-bot 8c1e7ce231 !16345 [DFX]Optimize exception log 
From: @irmo
Reviewed-by: 
Signed-off-by:
 2021-05-31 09:22:48 +08:00
mindspore-ci-bot 04341b1dbc !17076 fix log error for pynative mode 
From: @chujinjin
Reviewed-by: @zhoufeng54,@kisnwang
Signed-off-by: @kisnwang
 2021-05-31 09:22:29 +08:00
hesham 3a9695313b files_need_cleanup fixes 2021-05-30 15:44:08 -04:00
huanghui 0610a8d99c 9fdc0035a0 2021-05-29 10:31:23 +08:00
mindspore-ci-bot 1c8fda25ef !16478 handle load op in step parallel 
From: @gong_zi_yan
Reviewed-by: @yangzhenzhang,@stsuteng
Signed-off-by: @stsuteng
 2021-05-29 09:32:35 +08:00
mindspore-ci-bot b45b63fc58 !17239 add parallel gathernd test case 
From: @hanyang001
Reviewed-by: @stsuteng,@yangzhenzhang
Signed-off-by: @stsuteng
 2021-05-29 09:11:25 +08:00
mindspore-ci-bot 5e87097d15 !17240 add parallel layernorm test case 
From: @hanyang001
Reviewed-by: @stsuteng,@yangzhenzhang
Signed-off-by: @stsuteng
 2021-05-29 09:11:08 +08:00
Wan Hanyang c51dff2634 add parallel gathernd test case 2021-05-28 17:21:11 +08:00
Wan Hanyang 3ce521d78f add parallel layernorm test case 2021-05-28 17:20:04 +08:00
YangLuo ac319b3a79 Fix mindrecord UTs: files existed causes write exception 2021-05-28 15:13:48 +08:00
Ziyan 4b17493e52 handle load in step parallel 2021-05-28 09:16:40 +08:00
chujinjin 7fb3b5ea97 fix log error 2021-05-27 17:19:10 +08:00
mindspore-ci-bot 1e8868cecc !16727 handle duplicate code 
From: @yangzhenzhang
Reviewed-by: @stsuteng,@jjfeing
Signed-off-by: @stsuteng
 2021-05-26 10:58:54 +08:00
mindspore-ci-bot 2433778dac !15963 Support getting dynamic_min_max_shape of data 
From: @luoyang42
Reviewed-by: 
Signed-off-by:
 2021-05-26 09:41:02 +08:00
mindspore-ci-bot 730e211e52 !16702 Add GaussianBlur API for CV data processing 
From: @tiancixiao
Reviewed-by: @liucunwei,@jonyguo
Signed-off-by: @liucunwei
 2021-05-26 09:09:41 +08:00
mindspore-ci-bot d0978f709a !16167 CocoDataset add a new column according a new arg extra_metadata 
From: @xiefangqi
Reviewed-by: 
Signed-off-by:
 2021-05-25 19:55:41 +08:00
yangzhenzhang d711d98f07 clean duplicate code 2021-05-25 17:25:34 +08:00
mindspore-ci-bot e513786709 !16565 Bug in Normalize when num_channels > 128 
From: @hfarahat
Reviewed-by: @robingrosman,@pandoublefeng
Signed-off-by: @robingrosman
 2021-05-25 10:24:25 +08:00
xiefangqi 53891dbdf7 coco add img_id column 2021-05-24 17:19:58 +08:00
luoyang 13ef5b61f3 support getting dynamic_min_max_shape of data 2021-05-24 17:04:50 +08:00
Xiao Tianci 3f495bbae1 add GaussianBlur API 2021-05-24 16:27:05 +08:00
liuxiao93 1160088c8f support avgpool3d 2021-05-22 14:44:11 +08:00
yao_yf 732d13ccff parallel dropout support repeated compute 2021-05-20 19:42:13 +08:00
mindspore-ci-bot 05bbd1d8fa !16426 Change the permission of cache shared memory to 600 for security 
From: @lixiachen
Reviewed-by: @robingrosman,@pandoublefeng
Signed-off-by: @robingrosman
 2021-05-20 02:36:26 +08:00
mindspore-ci-bot c47356d77b !16502 check Optimizer parameters must be list 
From: @wangnan39
Reviewed-by: @zh_qh,@kingxian
Signed-off-by: @zh_qh,@kingxian
 2021-05-19 09:23:56 +08:00
mindspore-ci-bot 1cb2d31642 !16509 GNN dataset new feature for invalid edge or node id case 
From: @lizhenglong1992
Reviewed-by: @liucunwei,@heleiwang
Signed-off-by: @liucunwei
 2021-05-19 09:20:24 +08:00
hesham bc92011b5f Bug in Normalize when num_channels > 128 2021-05-18 12:23:11 -04:00
mindspore-ci-bot ed72a0d9c3 !16497 Add more accurate abstract join error information 
From: @huangbingjian
Reviewed-by: @zh_qh,@ginfung
Signed-off-by: @zh_qh
 2021-05-18 19:36:11 +08:00
Zhenglong Li 9284b6d6af Add special case returned value for get feature function 2021-05-18 15:53:01 +08:00
mindspore-ci-bot ec9fc5fb3b !16384 Fix python multiprocessing with shared memory for edge case 
From: @robingrosman
Reviewed-by: @mikef
Signed-off-by: @mikef
 2021-05-18 10:30:19 +08:00
Lixia Chen 8812111f94 change shared mem perm to 600 & minor other fixes 2021-05-17 17:19:55 -04:00
wangnan39@huawei.com 2761776699 add check for optimizer parameters 2021-05-17 22:23:03 +08:00
huangbingjian 81624dd501 add more error report to abstract join 2021-05-17 21:14:17 +08:00
mindspore-ci-bot 9d423638b3 !16466 Fix code check of python pass 
From: @irmo
Reviewed-by: @ginfung,@zh_qh
Signed-off-by: @zh_qh
 2021-05-17 21:00:16 +08:00
mindspore-ci-bot 601322356b !15638 VOCDataset need to add img_id for evaluation 
From: @xiefangqi
Reviewed-by: @liucunwei
Signed-off-by: @liucunwei
 2021-05-17 19:33:24 +08:00
xiefangqi 9b846c7873 voc add image_id column 2021-05-17 16:09:04 +08:00
huanghui 53e32077c1 fix code check 2021-05-17 11:20:35 +08:00
mindspore-ci-bot 8cfb5b8aea !16332 Add environment variable to enable recursive evaluate. 
From: @zh_qh
Reviewed-by: @ginfung,@kingxian
Signed-off-by: @ginfung
 2021-05-17 11:00:40 +08:00
RobinGrosman ca88d7d76a fix edge case and docstring in minddata multiprocessing shared memory code 2021-05-16 06:46:44 -07:00
Zhang Qinghua bea16101c3 Add environment variable to enable recursive evaluate. 2021-05-14 20:01:19 +08:00
jonyguo 9452142b50 enhance: enable shuffle infile / files when mindrecord 2021-05-14 17:41:18 +08:00
mindspore-ci-bot b5cddcb8cc !16036 Improve performance of multi-processing option for dataset 
From: @robingrosman
Reviewed-by: 
Signed-off-by:
 2021-05-13 01:41:16 +08:00
RobinGrosman 9a7d1fc034 Optimize multi-process in minddata by passing data via shared memory instead of multiprocessing.queue 2021-05-11 15:16:29 -07:00
mindspore-ci-bot 8c5680360d !16200 [Debugger] Fix empty result when reading non-existent tensor 
From: @tina_mengting_zhang
Reviewed-by: @john_tzanakakis,@robingrosman
Signed-off-by: @john_tzanakakis
 2021-05-12 03:08:00 +08:00
mindspore-ci-bot ebed057e72 !16196 If Imagefolder input directory is not right, will occur out of memory error 
From: @xiefangqi
Reviewed-by: @ms_yan,@heleiwang,@jonyguo
Signed-off-by: @jonyguo
 2021-05-11 17:36:28 +08:00
mindspore-ci-bot 4c71d9d1df !15675 add more tensor methods 
From: @yanglf1121
Reviewed-by: @liangchenghui
Signed-off-by:
 2021-05-11 14:32:29 +08:00
mindspore-ci-bot 9b4ff99305 !16158 modify check strategy for scatter update 
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
 2021-05-11 09:41:07 +08:00
mindspore-ci-bot d3a175e30f !16078 Modify Normalize to accept images with more than 3 channels 
From: @hfarahat
Reviewed-by: @mikef,@robingrosman
Signed-off-by: @robingrosman
 2021-05-11 02:03:34 +08:00
TinaMengtingZhang a44376f42a Fix empty tensor issue when reading an non-existing node in sync dump mode 2021-05-10 13:59:05 -04:00
xiefangqi e0148f7181 fix minddata directory path problem 2021-05-10 22:16:37 +08:00
yepei6 acbd7eb023 add more tensor methods 2021-05-10 14:40:53 +08:00
yangzhenzhang 6aa3859131 modify check strategy for scatter update 2021-05-10 11:22:00 +08:00
mindspore-ci-bot ee885b4e58 !15180 enable not fully use opt shard 
From: @gong_zi_yan
Reviewed-by: @stsuteng
Signed-off-by: @stsuteng
 2021-05-08 14:57:58 +08:00
mindspore-ci-bot b86747b9a6 !15813 Convert some pipeline Ops to be inlined 
From: @hfarahat
Reviewed-by: 
Signed-off-by:
 2021-05-08 05:30:39 +08:00
hesham fd943bbdc0 Modify normalize to support multiple of channels 2021-05-07 17:06:26 -04:00
Ziyan 2a752f24bf enable not fully use opt shard 2021-05-07 15:32:48 +08:00
mindspore-ci-bot d76574bbbf !15973 parallel env variables check 
From: @yao_yf
Reviewed-by: @yangzhenzhang,@stsuteng
Signed-off-by: @stsuteng
 2021-05-07 12:13:41 +08:00
mindspore-ci-bot e0422e972e !16019 If dataset_dir is not a dir or something else validation is not right somehow 
From: @xiefangqi
Reviewed-by: @ms_yan,@liucunwei,@jonyguo
Signed-off-by: @liucunwei
 2021-05-07 11:57:31 +08:00
mindspore-ci-bot b85bf60eb8 !15727 VOCDataset read xml will filter invalid bbox automationally 
From: @xiefangqi
Reviewed-by: @heleiwang,@jonyguo
Signed-off-by: @jonyguo
 2021-05-07 09:50:53 +08:00
yao_yf e967f1939b parallel envs variable check 2021-05-07 09:12:53 +08:00
mindspore-ci-bot eb08d2e952 !16024 dataset: modify some error msg in dataset module 
From: @ms_yan
Reviewed-by: @jonyguo,@heleiwang
Signed-off-by: @jonyguo
 2021-05-07 09:12:46 +08:00
ms_yan 34dcd2b463 modify log of dataset part 2021-05-06 23:33:17 +08:00
xiefangqi b6e1fceedc minddata modify dir validation 2021-05-06 21:35:31 +08:00
Lixia Chen 5967cb2cd7 Unblock mindrecord under cache 2021-05-05 13:28:13 -04:00
hesham e4c0bd51a5 Modify concat to be an inlined Op 
Modify zip to be an inlined Op
Modify take to be an inlined Op
Modify skip to be an inlined Op
Modify rename to be an inlined Op
Modify filter to consume child's rows using one thread
 2021-05-04 12:45:18 -04:00
mindspore-ci-bot c13ed20dad !15907 add type convert during load checkpoint 
From: @changzherui
Reviewed-by: @kingxian,@zh_qh
Signed-off-by: @kingxian
 2021-04-30 15:52:41 +08:00
mindspore-ci-bot ee3012fd3f !15303 add lsq quantization method 
From: @erpim
Reviewed-by: 
Signed-off-by:
 2021-04-30 11:26:42 +08:00
mindspore-ci-bot ac912672bf !15871 Support pass args or|and kwargs for OP CreateInstance. 
From: @zh_qh
Reviewed-by: @ginfung,@hwhewei
Signed-off-by: @hwhewei
 2021-04-30 10:39:04 +08:00
mindspore-ci-bot cefcf6c2ae !15931 Add eager tests for transform ops, and add a shape comparison in the EXPECT_MSTENSOR_EQ Macro 
From: @alexyuyue
Reviewed-by: @nsyca,@robingrosman
Signed-off-by: @robingrosman
 2021-04-30 06:15:12 +08:00
alex-yuyue 9ef4331f56 Add eager tests for transform ops 
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
 2021-04-29 13:19:24 -04:00
changzherui 85025804ef add type convert during load checkpoint 2021-04-29 17:38:16 +08:00
Zhang Qinghua cd7f7d40fb Support pass args or|and kwargs for OP CreateInstance. 2021-04-29 14:14:58 +08:00
mindspore-ci-bot 33966f0cd5 !15744 Add encryption for ckpt file 
From: @liu_luobin
Reviewed-by: @baochong,@chongbao
Signed-off-by:
 2021-04-29 11:18:50 +08:00
mindspore-ci-bot 577cf7cd1d !15758 [Offline Debug] Add UT tests to the offline debugger. 
From: @islam_amin
Reviewed-by: @john_tzanakakis,@tom__chen,@robingrosman
Signed-off-by: @john_tzanakakis
 2021-04-29 04:33:02 +08:00
Islam Amin 6bb740f137 added GPU UT tests 2021-04-28 13:03:51 -04:00
liuluobin a40229d171 Add encryption for ckpt file 2021-04-28 16:24:29 +08:00
mindspore-ci-bot 78fcdbc7c9 !15790 modify scatter update op 
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
 2021-04-28 10:48:19 +08:00
mindspore-ci-bot b663bbd9ca !15597 [MD] save op support variable dimension 0 
From: @liyong126
Reviewed-by: @liucunwei,@jonyguo
Signed-off-by: @liucunwei
 2021-04-28 09:38:58 +08:00
mindspore-ci-bot cbca36d723 !15766 modify tile op 
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
 2021-04-28 09:17:17 +08:00
Erpim 90d5d5dab3 add lsq quantization method 2021-04-27 20:48:04 +08:00
yangzhenzhang 075f680a42 modify scatter update op 2021-04-27 20:23:14 +08:00
liyong 587247e793 add support save dynamic shape tensor 2021-04-27 19:15:10 +08:00
mindspore-ci-bot 9e650da6d7 !15578 numpy-native tensor setitem bug fix & restructure 
From: @jachua
Reviewed-by: @guoqi1024,@kisnwang
Signed-off-by: @kisnwang
 2021-04-27 15:20:25 +08:00
xiefangqi 458ff5fed9 md fix voc and manifest error scenario 2021-04-27 14:24:57 +08:00
Xiaoda Zhang aa52399200 Making the Tile operator to have more parallel strategies 2021-04-27 11:36:40 +08:00
huangmengxi d6be043cb9 fix & restructure setitem 2021-04-27 10:03:10 +08:00
mindspore-ci-bot e3d54b7e3b !15695 dont insert VirtualOutput for scalar 
From: @yao_yf
Reviewed-by: @yangzhenzhang,@stsuteng
Signed-off-by: @stsuteng
 2021-04-27 09:25:30 +08:00
mindspore-ci-bot 83cdb8bb38 !15560 Optimize cache_admin tool to allow multiple session destroy 
From: @lixiachen
Reviewed-by: @robingrosman,@nsyca
Signed-off-by: @robingrosman
 2021-04-27 07:55:29 +08:00
yao_yf 093ef784de dont insert virtualoutput for scalar 2021-04-26 19:55:16 +08:00
mindspore-ci-bot d328fdcf61 !15200 profiler: fixed AICPU timeline 
From: @zhangyunshu
Reviewed-by: @yelihua,@ouwenchang
Signed-off-by: @ouwenchang
 2021-04-26 11:06:50 +08:00
mindspore-ci-bot 3cfd58e8e0 !15643 insert virtual div only for first input of dropout do mask 
From: @yangzhenzhang
Reviewed-by: @stsuteng,@kisnwang
Signed-off-by: @stsuteng
 2021-04-26 09:21:00 +08:00
mindspore-ci-bot 49d6c029a6 !15542 split axis and batch for gather 
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng,@stsuteng
Signed-off-by: @stsuteng,@stsuteng
 2021-04-25 19:33:09 +08:00
mindspore-ci-bot 7dc9eb3e0b !15396 add parallel virtual output in eval/predict 
From: @yao_yf
Reviewed-by: @yangzhenzhang,@stsuteng
Signed-off-by: @stsuteng
 2021-04-25 17:43:13 +08:00
yangzhenzhang 5828973978 fix bug for dropout do mask 2021-04-25 16:47:44 +08:00
yao_yf 21276408b8 parallel virtual_out_ops 2021-04-25 11:18:54 +08:00
Lixia Chen 44fb7ac4bb Add support for multi-session destroy 2021-04-23 11:17:06 -04:00
yangzhenzhang 213922574e split axis and batch for gatherv2 2021-04-23 16:59:35 +08:00
zhiqiang 2a0b443cc4 Add indexes attribute and make metrics indexes recognizable 2021-04-23 04:32:02 -04:00
mindspore-ci-bot b77c3f093d !15436 augassign 
From: @yepei6
Reviewed-by: @yanglf1121,@kingxian
Signed-off-by: @kingxian
 2021-04-23 14:58:35 +08:00
yepei6 81789ffb5d augassign 2021-04-23 11:58:07 +08:00
changzherui f63a13b2e9 modify check file name bug 2021-04-23 08:57:43 +08:00
mindspore-ci-bot e43a57fd37 !15525 clean code not used 
From: @zhangzhaoju
Reviewed-by: @zh_qh,@ginfung
Signed-off-by: @zh_qh
 2021-04-22 20:04:57 +08:00
mindspore-ci-bot 1ecc638fad !15442 modify code method metrics 
From: @changzherui
Reviewed-by: @kingxian,@zhoufeng54
Signed-off-by: @kingxian
 2021-04-22 16:58:36 +08:00
zhangzhaoju 6a2aee492c Clean code that not used 2021-04-22 16:24:05 +08:00
mindspore-ci-bot b760d1235f !15416 Update normalization description at nn/layer/normalization.py 
From: @dinglinhe123
Reviewed-by: @liangchenghui,@wuxuejian
Signed-off-by: @liangchenghui
 2021-04-21 15:05:33 +08:00
changzherui 1f4c17edca modify clean code 2021-04-21 10:56:16 +08:00
dinglinhe 54fb72e2b3 Update normalization description at nn/layer/normalization.py 2021-04-20 12:30:37 +08:00
yangzhenzhang c2ca2232c5 add select op 2021-04-20 09:23:22 +08:00
mindspore-ci-bot 1c9d3c0aa0 !15353 add parallel operator for scatter update 
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
 2021-04-20 09:03:08 +08:00
Cathy Wong 636809c255 dataset: C++ API ToNumber & Lookup: change data_type parm from string to DataType 2021-04-19 12:35:37 -04:00
mindspore-ci-bot 0fd1726e79 !15172 Clean GraphKernel's codes from frontend 
From: @dayschan
Reviewed-by: @gaoxiong1,@dylangeng,@gaoxiong1
Signed-off-by: @dylangeng,@dylangeng
 2021-04-19 09:34:35 +08:00
yangzhenzhang 9cdd70433f add scatterupdate op 2021-04-17 17:32:48 +08:00
yangzhenzhang d070af122f add topk op 2021-04-17 14:12:49 +08:00
dayschan 771e3f61f3 Clean GraphKernel's codes from frontend 
1. set class GraphKernel as deprecated, and treat it as Cell
2. set class InplaceAssign as deprecated, suggested using Assign instead.
3. set op_selector as deprecated, removed the _selected_ops and _selected_grad_ops, replaced with real operations
4. removed the two passes of GraphKernel from frontend
5. removed the GraphKernel's codes from other modules
 2021-04-17 11:03:34 +08:00
mindspore-ci-bot f9c5060cf2 !14930 Handle ignored returned Status 
From: @hfarahat
Reviewed-by: @robingrosman,@pandoublefeng
Signed-off-by: @robingrosman
 2021-04-17 03:52:41 +08:00
mindspore-ci-bot 9c81c5d2a0 !15189 Add more ut for transform ops and subset sampler 
From: @alexyuyue
Reviewed-by: 
Signed-off-by:
 2021-04-17 01:46:13 +08:00
hesham 6e6eaebb77 Fix unused return value in main code 2021-04-16 11:33:35 -04:00
yangzhenzhang f9f5df368e add gathernd op 2021-04-16 14:29:03 +08:00
alex-yuyue 97e3232b6d Add more ut for transform ops and subset sampler 
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
 2021-04-15 16:51:41 -04:00
mindspore-ci-bot f09df9ac2f !15248 Fix shellcheck warnings for cache shell scripts 
From: @lixiachen
Reviewed-by: @pandoublefeng,@robingrosman
Signed-off-by: @robingrosman
 2021-04-15 22:47:06 +08:00
Lixia Chen 91f9059263 Fix shellcheck warnings 2021-04-15 09:33:07 -04:00
zhangyunshu d969be9107 profiler: fixed aicpu timeline 2021-04-15 19:35:24 +08:00
yangzhenzhang bcd2ecc403 check layouts for shared parameter 2021-04-15 10:39:05 +08:00
mindspore-ci-bot 727203a498 !14911 dataset: Fill op: C++ API support, UTs and Pybind decoupling 
From: @cathwong
Reviewed-by: 
Signed-off-by:
 2021-04-14 05:32:11 +08:00
Cathy Wong 7e6a03487e dataset: Fill op: C++ API support, UTs and Pybind decoupling 2021-04-13 10:02:39 -04:00
mindspore-ci-bot e07a69d8f8 !14874 GNN dataset new feature 
From: @lizhenglong1992
Reviewed-by: 
Signed-off-by:
 2021-04-13 10:44:27 +08:00
Zhenglong Li f3895f2b09 Add get edges from nodes function for gnn network 2021-04-10 18:31:13 +08:00
mindspore-ci-bot f0f7bf1ed1 !14885 fix: wrong input order 
From: @jonyguo
Reviewed-by: @liucunwei,@heleiwang
Signed-off-by: @liucunwei
 2021-04-10 16:52:41 +08:00
jonyguo a5cc81dc97 fix: wrong input order in test_paddeddataset.py 2021-04-09 17:22:31 +08:00
Lixia Chen 1f2b178a16 Reset CacheClient's status for a new run 
Turn off lock only after all data is cached
 2021-04-08 15:30:48 -04:00
mindspore-ci-bot a9ba9b90f6 !14680 MindData Codespell correction 
From: @luoyang42
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
 2021-04-07 18:28:55 +08:00
luoyang 624511337c MindData Codespell correction 2021-04-07 10:20:29 +08:00
hesham 8535e89e6c Remove DataBuffer 2021-04-05 17:55:59 -04:00
hesham 0d86cb1423 Remove rows_per_buffer 2021-04-04 00:22:16 -04:00
mindspore-ci-bot c99fe1e412 !12841 DataBuffer removal from DE 
From: @hfarahat
Reviewed-by: 
Signed-off-by:
 2021-04-04 03:28:13 +08:00
mindspore-ci-bot 28f4759537 !14606 parallel ut test 
From: @yao_yf
Reviewed-by: 
Signed-off-by:
 2021-04-02 21:24:43 +08:00
yao_yf a83fb3316b fix parallel timeout 2021-04-02 20:19:26 +08:00
mindspore-ci-bot 5b8a200fa9 !14572 show accurate error line when use user defined class 
From: @zhangbuxue
Reviewed-by: @zh_qh,@ginfung
Signed-off-by: @zh_qh
 2021-04-02 15:14:31 +08:00
mindspore-ci-bot e034f0294b !14556 Fix validation of RGB2HSV/HSV2RGB/RandomResizedCrop in py_transform & Fix error msg of pythontokenizer 
From: @luoyang42
Reviewed-by: @liucunwei,@heleiwang
Signed-off-by: @liucunwei
 2021-04-02 14:23:56 +08:00
buxue 6f1105ea79 show accurate error line when use user defined class 2021-04-01 21:52:00 +08:00
luoyang ec21d3f748 Fix validation of RGB2HSV/HSV2RGB/RandomResizedCrop in py_transform 
Fix error msg of pythontokenizer
 2021-04-01 19:09:07 +08:00
changzherui ffee537387 modify python ut 2021-04-01 16:19:55 +08:00
hesham a9a80693be Replace Databuffers with TensorRows 2021-03-31 17:00:36 -04:00
buxue 8c47ce1803 show accurate error info and error lines when use unsupported builtin function 2021-03-31 12:33:38 +08:00
changzherui fde2856d5d modify python ut 2021-03-30 20:08:26 +08:00
mindspore-ci-bot 7d911cdeeb !14365 set parallel communication init in parallel ut 
From: @yao_yf
Reviewed-by: @stsuteng,@kisnwang
Signed-off-by: @stsuteng
 2021-03-30 16:30:07 +08:00
yao_yf 4d0635eabe set parallel communication init flag in parallel ut 2021-03-30 11:21:57 +08:00
buxue d830a2b55a optimize exception mode when use undefined name in if for and while 2021-03-27 17:28:52 +08:00
mindspore-ci-bot 5d0490909d !14097 map a fv cnode if it is not mapped and belong to primal_graph_ 
From: @xychow
Reviewed-by: @ginfung,@zh_qh
Signed-off-by: @zh_qh
 2021-03-26 09:20:42 +08:00
zhousiyi 74d500a756 If a fv cnode is not mapped but belong to primal_graph_, then don't propagate this fv to caller, it should mapped instead 2021-03-25 11:49:37 +00:00
mindspore-ci-bot 5926f7c386 !13906 【MD】【BUG】Conventional judgment on the parameter h w not less than zero 
From: @xulei2020
Reviewed-by: 
Signed-off-by:
 2021-03-25 14:10:42 +08:00