Commit Graph

3732 Commits

Author SHA1 Message Date
i-robot b073af4b5d
!28559 [MD][Offload] Added dimension check to required Offload ops.
Merge pull request !28559 from alashkari/offload-fix
2022-01-05 07:38:31 +00:00
i-robot a1720c210d
!22348 [assistant][ops] Add new loader EnWik9Dataset
Merge pull request !22348 from 杨旭华/EnWik9Dataset
2022-01-05 07:36:48 +00:00
i-robot ec485cb436
!28307 convert EnvSetItem/EnvGetItem to primitive EnvironSet/EnvironGet
Merge pull request !28307 from xychow/EnvGetItem-conversion
2022-01-05 07:10:30 +00:00
Rescue fac68dbb46 Added dimension check to required Offload ops. 2022-01-05 04:26:31 +00:00
i-robot de030c8d41
!28204 Improved HwcToChw support multi-channel input.
Merge pull request !28204 from unseenme/mindcon_coding_hwc2chw
2022-01-04 11:50:04 +00:00
unseenme 755cb0adfa Improved HwcToChw support multi-channel input. 2022-01-04 15:47:04 +09:00
Eden 63ab65e3a4 [feat] [assistant] [#I40GYF] add new loader EnWik9Dataset 2022-01-03 21:45:43 -08:00
zhousiyi 19e9571149 rename env_getitem/setitem to EnvironGet/EnvironGet 2022-01-04 02:17:30 +00:00
i-robot dba67422f9 !28384 [Fallback] Support the use of self
Merge pull request !28384 from huangbingjian/fallback_self
2021-12-31 09:26:03 +00:00
i-robot e8b4e34f02 !28352 Optimize the exception message while the return number of brop is wrong
Merge pull request !28352 from zhangzhaoju/master_I4NX1K
2021-12-31 08:17:18 +00:00
i-robot 03b4829b86 !28431 [Auto parallel] MoE Changes
Merge pull request !28431 from Xiaoda/122-moe-changes
2021-12-31 08:06:45 +00:00
zhangzhaoju 1950b6a823 Optimize the exception message while the return number of brop is wrong
Fix:I4OQM9 Bprop out check message optimize
2021-12-31 15:01:57 +08:00
vddong 7449b8364b [feat][assistant][I40GYQ] add new dataset operator WIDERFace 2021-12-31 13:49:47 +08:00
huangbingjian 58bafb539a [Fallback] Support self attr/method. 2021-12-31 10:57:41 +08:00
Xiaoda Zhang 6d8320fa66 1) fix the exact division in moe;
2) changing CumSum from composition to a single Operator;
3) add InferMirrorOps for CumSumInfo.
2021-12-30 19:20:05 +08:00
jingyangxiang a7f8b3af1c [feat][assistant][ops]New operator implementation, include IMDBDataset
Signed-off-by: zjuter0126 <977180923@qq.com>
2021-12-30 11:16:23 +08:00
zjuter0126 3c2ca41886 [feat][assistant][ops] add new data operator WikiTextDataset 2021-12-29 18:54:54 +08:00
i-robot 17b3e3cd13 !28267 Resuse ConvertData of GenerateArgumentsKey
Merge pull request !28267 from zhangzhaoju/master_res_base
2021-12-29 08:20:10 +00:00
i-robot ae1278fa42 !28074 convert execute mode to graph mode when loading mindir
Merge pull request !28074 from lianliguang/master
2021-12-29 06:23:57 +00:00
i-robot ac9e545dc8 !22546 add new dataset loading operator CaltechDataset
Merge pull request !22546 from 杨旭华/CaltechDataset
2021-12-29 03:40:06 +00:00
zhangzhaoju c5b2996b3f Resuse ConvertData of GenerateArgumentsKey 2021-12-29 10:30:17 +08:00
lianliguang d5efef0ae6 convert pynative mode to graph mode when loading mindir 2021-12-29 09:46:08 +08:00
donrichnx 9a0fc0ffc1 [feat] [assistant] [I40GYH] add new dataset loading operator CaltechDataset 2021-12-28 19:04:18 +08:00
Xiaoda Zhang 1bdb610b34 changing default value of single-loop flag 2021-12-28 17:56:30 +08:00
i-robot 67e843ec7f !27487 [assistant] [ops][SpectralCentroid]
Merge pull request !27487 from 杨旭华/SpectralCentroidOp
2021-12-28 09:10:32 +00:00
i-robot 7faf774063 !22310 [assistant][ops] Add new loader SemeionDataset
Merge pull request !22310 from 杨旭华/SemeionDataset
2021-12-28 03:13:02 +00:00
i-robot bff8d6ae01 !28247 Fix Python Vocab validation
Merge pull request !28247 from luoyang/vocab
2021-12-28 02:58:25 +00:00
luqilin 896f10d6d5 [feat][assistant][I40GYK] add new dataset loading operator SemeionDataset 2021-12-27 19:49:06 +08:00
tongyue 9a1dcd60fc [fix] [assistant] [I40GXI] fix bug in the infer function of the operator SpectralCentroid 2021-12-27 01:41:31 -08:00
i-robot 69a6c7db98 !23380 [assistant][ops] Add new loader AmazonReview
Merge pull request !23380 from 杨旭华/AmazonReview
2021-12-27 09:36:32 +00:00
luoyang ca3de66559 Fix Python Vocab validation 2021-12-27 17:12:07 +08:00
i-robot c13f31861c !26398 [feat] [assistant] [I48OBC] add new LogicalNot
Merge pull request !26398 from 桂胜楠/logicalnot
2021-12-27 02:54:53 +00:00
i-robot eb7a78a998 !28134 Python Vocab refactoring and add ids_to_tokens & tokens_to_ids
Merge pull request !28134 from luoyang/vocab
2021-12-25 06:39:41 +00:00
i-robot dd90a56d68 !28073 fix code warning && remove save_graphs use in st/ut
Merge pull request !28073 from huanghui/fix-warning
2021-12-24 09:29:25 +00:00
i-robot 170e6ad857 !28052 modify profiler ai_cpu ut and st
Merge pull request !28052 from zangqx/zangqx_04
2021-12-24 08:14:25 +00:00
i-robot 22c25ec10e !27862 [Auto parallel] [Sharding propagation] dealing with cast
Merge pull request !27862 from Xiaoda/119-adapting-sharding-propagation
2021-12-24 07:33:47 +00:00
luoyang 0288480722 Python Vocab refactoring and add ids_to_tokens & tokens_to_ids 2021-12-24 15:26:15 +08:00
huanghui 74ca50e652 fix code warning && remove save_graphs use in st/ut 2021-12-24 14:45:37 +08:00
zheng_pengfei 09b5e545dd [feat] [assistant] [I48OBC] add new LogicalNot 2021-12-23 20:39:17 +08:00
臧庆香 fcd3fface0 modify profiler ai_cpu ut and st 2021-12-23 20:10:28 +08:00
Xiaoda Zhang 66c7474e5a remove CastInfo from CNODE 2021-12-23 19:05:02 +08:00
i-robot f9270b8e09 !28069 change API:cell.shard
Merge pull request !28069 from zhuyuxiao/I4LE9J
2021-12-23 10:58:43 +00:00
chengchuanxing 07aa66ee43 [feat][assistant][I40GY2] add new loader AmazonReview 2021-12-23 16:32:31 +08:00
i-robot 1ea8693c83 !27356 dataset: check whether operator in nn or ops is mixed into operations
Merge pull request !27356 from ms_yan/operator_mixed
2021-12-23 07:04:52 +00:00
i-robot 3b6c40ff1e !28028 [ME] Optimize the error message of the operator module.
Merge pull request !28028 from Margaret_wangrui/operator
2021-12-23 06:48:00 +00:00
zhuyuxiao dd7bbf92dd change API 2021-12-23 14:26:06 +08:00
i-robot 91434597c3 !25861 [assistant][ops]New operator implementation, include BesselI0 and BesselI1
Merge pull request !25861 from 张璇/BesselI0
2021-12-23 02:41:41 +00:00
ms_yan 192983b5da check operator mixed or not 2021-12-23 10:22:03 +08:00
Margaret_wangrui 38ddd04c83 [ME] Optimize the error message of the operator module. 2021-12-23 10:10:48 +08:00
lilei 017aa359a6 insert VirtualDataset node for master 2021-12-23 09:25:05 +08:00
zx e0a7a87a9c [feat][assistant][I4CRK5] add new Ascend operator BesselI0 and BesselI1 2021-12-22 16:19:28 +08:00
gaocongli b9187f96da parsing the profiling data on ai cpu in binary 2021-12-22 11:59:47 +08:00
i-robot 14df5d3984 !23670 [assistant][ops] add new dataset loading operator CoNLL2000ChunkingDataset
Merge pull request !23670 from 杨旭华/CoNLL2000ChunkingDataset
2021-12-22 01:50:12 +00:00
i-robot b1de53fac2 !27728 [Fallback] Support numpy augassign method, subscript method and binary operations
Merge pull request !27728 from huangbingjian/fallback_parse
2021-12-22 01:01:46 +00:00
i-robot 372065c821 !26325 [assistant][ops] add Addcdiv and Addcmul
Merge pull request !26325 from 孟权令/Addcdiv
2021-12-21 12:46:21 +00:00
i-robot 2fbec9a554 !27856 use neighbor-exchange-v2 for conv2d
Merge pull request !27856 from yangzhenzhang/use-neighborexchangev2-for-conv2d
2021-12-21 10:59:54 +00:00
i-robot bc235730ca !27957 parallel_ut_refactoring
Merge pull request !27957 from 王志伟/parallel_ut_refactoring2
2021-12-21 08:02:16 +00:00
huangbingjian fea6974c80 Support numpy augassign method, subscript method and binary operations. 2021-12-21 15:58:20 +08:00
fattycat 289a7997df [feat] [assistant] [#I40GYB] add new loader CoNLL2000ChunkingDataset 2021-12-21 15:31:25 +08:00
Sawyer 564d83c959 [feat][assistant][I3T921][I3T923] add Addcdiv and Addcmul 2021-12-21 14:56:04 +08:00
i-robot cfdae8e0fc !27925 [ME] Optimize the error message of the operator module.
Merge pull request !27925 from Margaret_wangrui/operator
2021-12-21 06:54:30 +00:00
yangzhenzhang 8a68577756 use neighbor-exchange-v2 for conv2d 2021-12-21 14:27:41 +08:00
wzw a9b78682d5 parallel ut refactor 3 2021-12-21 14:26:58 +08:00
i-robot f007b8a99f !27745 [MD][Offload] Move offload checks and split to the C pipeline
Merge pull request !27745 from markuskunej/offload_column_pipeline
2021-12-21 04:26:51 +00:00
Margaret_wangrui f9a88a01bc [ME] Optimize the error message of the operator module 2021-12-21 10:19:25 +08:00
i-robot 7331629ceb !22686 [assistant][ops][Dither]
Merge pull request !22686 from Isaac/Dither
2021-12-20 11:16:20 +00:00
i-robot 76aaf62088 !27860 The profiler framework data is changed to binary data
Merge pull request !27860 from helloiSCSI/data_reduce
2021-12-20 07:47:49 +00:00
i-robot 953920112c !22553 [assistant][ops] Add new loader UDPOSDataset
Merge pull request !22553 from 杨旭华/UDPOSDataset
2021-12-20 06:54:54 +00:00
i-robot cc3c980a07 !27874 Real、conj、imag 接口支持实数输入
Merge pull request !27874 from zhouyaqiang0/master
2021-12-20 03:53:16 +00:00
helloiSCSI 115ec28ea0 Profiler save framework data as binary data
1. Reconstructing the profiler data reporting module
2. Rewrite the write framework data module, Detail: add a new profiler_reporter file to report binnary data, and delele all the old
profiler reporter diretcory.
3. Rewrite the parse framework data module
4. Fix the framework module ut and st
2021-12-20 11:06:53 +08:00
i-robot f1b26ea205 !21339 [assistant][ops]New operator implementation, include SparseApplyAdadeltaD
Merge pull request !21339 from 梁秀波/SparseApplyAdadeltaD
2021-12-20 01:34:10 +00:00
zhouyaqiang a6b48e003d Adapt Real input of ops real imag conj 2021-12-19 17:26:09 +08:00
haohaonannan97 f480be7c48 [feat][assistant][I40GXF] add new data operator Dither 2021-12-18 08:24:48 -08:00
王天浩 11cb3e4ef7 [fear][assistant][I40GYA] add new loader UDPOSDataset 2021-12-18 23:28:05 +08:00
wild-fox 452dbd4551 [feat][assistant][I40FFU] add new Ascend operator SparseApplyAdadelta 2021-12-18 17:56:51 +08:00
zorax 031c792cf6 [assistant][ops]New operator implementation, include ApplyAdamWithAmsgradD 2021-12-18 16:52:47 +08:00
i-robot 87c7fc13bb !23042 [assistant][ops]New operator implementation, include NonMaxSuppressionV3
Merge pull request !23042 from 梁秀波/NonMaxSuppressionV3
2021-12-18 06:51:51 +00:00
i-robot 57bbfe6453 !27741 Add test util function to write object into json
Merge pull request !27741 from sabrinasun_59ee/test
2021-12-18 03:00:53 +00:00
sabrinasun 2fa9399231 add test function to write object to json 2021-12-17 16:11:05 -05:00
markuskunej 0c10f52eb4 Moved the offload operation check and map operation split from python (datasets.py) to c++ (NodeOffloadPass.cc).
Updated check for offload in python (dataset_helper.py and
iterators.py).

Updated auto_offload test in test_map_offload.py.

Changed MapNode.offload type from bool->int in bindings.cc.

Changed manual offload flag from int->enum.

Update offload end of pipeline detection to be column-specific.
2021-12-17 14:35:17 +00:00
i-robot 457d953565 !22471 [assistant][ops]New operator implementation, include IsClose
Merge pull request !22471 from 梁秀波/IsClose
2021-12-17 11:55:37 +00:00
韩峥嵘 efe0fce473 [feat][assistant][I40FG0] add new Ascend operator NonMaxSuppression 2021-12-17 17:08:39 +08:00
i-robot 9b27295d1e !27544 fixed st and landscape bugs
Merge pull request !27544 from Songyuanwei/test
2021-12-17 08:14:23 +00:00
i-robot 96b2dce300 !22248 [assistant][ops] Add new loader operator YahooAnswers
Merge pull request !22248 from 杨旭华/YahooAnswers
2021-12-17 06:40:13 +00:00
i-robot 3121a317ec !27775 Fix Slice node's location incorrect
Merge pull request !27775 from huanghui/fix-Slice-no-location
2021-12-17 06:35:26 +00:00
韩峥嵘 43a495f3fd [feat][assistant][I40FG5] add new Ascend operator IsClose 2021-12-17 12:03:38 +08:00
Carry955 2320bb7c70 [feat][assistant][I40GXW] add new loader YahooAnswers 2021-12-16 18:33:47 -08:00
i-robot a618bb8ab5 !26949 save dataset into mindir - phase 2
Merge pull request !26949 from luoyang/mindir-stage2-2
2021-12-17 01:14:39 +00:00
i-robot d1dbdeffcb !27684 Update Python UT removal of generated files
Merge pull request !27684 from zetongzhao/update_python_remove
2021-12-17 01:09:17 +00:00
zetongzhao 7cb6989efd replace python removal with pytest tmp_path 2021-12-16 14:38:49 -05:00
i-robot 2bf244cd66 !27757 Support variable index of getitem during handling cell list getattr.
Merge pull request !27757 from 张清华/opt_cell_list_getattr2
2021-12-16 18:13:36 +00:00
i-robot 0158db12e6 !27800 add testcase for ops
Merge pull request !27800 from zhanlijun/addtest1
2021-12-16 13:12:26 +00:00
songyuanwei 11d84058c3 fixed st and landscape bugs 2021-12-16 21:03:37 +08:00
Zhang Qinghua ea8c47e981 Support variable index of getitem during handling cell list getattr. 2021-12-16 20:35:45 +08:00
zhanlijun 82de6c7ebc add testcase 2021-12-16 20:25:38 +08:00
huanghui d549ec5af5 fix Slice cannot get location 2021-12-16 17:19:20 +08:00
YangLuo fa7ed720c8 Saving dataset into Mindir and load for inference phase 2 2021-12-16 16:46:51 +08:00
i-robot c8096bc416 !27701 add output parallel strategy for gather op
Merge pull request !27701 from yangzhenzhang/add-output-strategy-for-gather-op
2021-12-16 06:54:40 +00:00
i-robot 67fc03f623 !27694 [API] python frame rebuild
Merge pull request !27694 from kingxian/master
2021-12-16 06:49:56 +00:00
jinxiaoxian 01fc6efc7d rebuild python frame 2021-12-16 10:50:59 +08:00
yangzhenzhang 5f6477b022 add output strategy for gather op 2021-12-16 09:24:50 +08:00
i-robot 05336b03c5 !22332 [assistant][ops][SogouNews]
Merge pull request !22332 from 杨旭华/SogouNews
2021-12-16 01:07:21 +00:00
i-robot 8d648e0f1e !19673 Seperate constant from pb file
Merge pull request !19673 from sabrinasun_59ee/constant
2021-12-15 23:52:33 +00:00
i-robot f6fe56c20d !27447 [MD][Offload] Fix Offload Normalize op bug, Added extra tests to Offload UT.
Merge pull request !27447 from alashkari/offload-fix
2021-12-15 16:00:26 +00:00
li-qiyao f4bfcb8c25 [feat][assistant][I40GXN] add new loader SogouNews 2021-12-14 22:53:38 -08:00
i-robot 005d4bb742 !27590 Change the AllSwap to the Internal Usage
Merge pull request !27590 from huangxinjing/mv_all_swap
2021-12-15 03:50:46 +00:00
i-robot 83e9fe5c48 !27542 dataset: change dataset_file into dataset_files for MindDataset
Merge pull request !27542 from ms_yan/datasetfiles_name
2021-12-15 03:09:33 +00:00
i-robot dac636decd !22297 [assistant][ops] Add new loader IWSLTDataset
Merge pull request !22297 from 杨旭华/IWSLTDataset
2021-12-15 02:55:08 +00:00
i-robot a5ce9e9b9b !27570 [Fallback] Process the attributes/methods of Tensor, different from NumPy
Merge pull request !27570 from huangbingjian/parse_tensor
2021-12-15 02:13:21 +00:00
i-robot d49f5e6caf !27525 support optimizer parallel for adafactor
Merge pull request !27525 from yangzhenzhang/support-opt-parallel-for-adafactor
2021-12-15 01:25:12 +00:00
sabrinasun 542d715217 seperate constant from pb 2021-12-14 13:19:14 -05:00
Rescue dc5c388505 Fixed offload Normalize op, added offload Normalize and Rescale tests to offload UT. 2021-12-14 17:03:11 +00:00
i-robot d57bdfb4f6 !23261 [assistant][ops][GainOp]
Merge pull request !23261 from 杨旭华/Gain
2021-12-14 11:05:27 +00:00
huangbingjian db4567989a fallback parse Tensor, different from NumPy. 2021-12-14 12:59:47 +08:00
i-robot 21176d6c51 !27602 Support getattr by the item of cell list: Handle the DoSignaturePrimitive('getitem') between getattr and resolve.
Merge pull request !27602 from 张清华/opt_cell_list_getattr
2021-12-14 03:52:42 +00:00
ms_yan a85113c093 change dataset_file into dataset_files for MIndDataset 2021-12-14 10:52:41 +08:00
i-robot 19b7b8b2de !27577 fix reshape bool in auto parallel
Merge pull request !27577 from yao_yf/reshape_bool_redistribution_fix
2021-12-14 01:25:05 +00:00
Zhang Qinghua 3e7b73e6c7 Support getattr by the item of cell list: Handle the DoSignaturePrimitive('getitem') between getattr and resolve. 2021-12-14 09:06:34 +08:00
liannai a99b5461bd [feat][assistant][I40GXH]add new data operator Gain 2021-12-13 22:03:09 +08:00
lufei9026 30bc609ce6 [feat][assistant][I40GY8]add new loader IWSLTDataset 2021-12-13 21:47:55 +08:00
i-robot efa63b78c0 !27600 [ME][Fallback] Add tensor testcase.
Merge pull request !27600 from Margaret_wangrui/fallback_tensor
2021-12-13 13:33:41 +00:00
i-robot 0d3ddbdde4 !27580 [ME][Fallback] Add array property test cases
Merge pull request !27580 from Margaret_wangrui/fallback
2021-12-13 13:14:52 +00:00
yao_yf 30576c6a75 fix reshape bool type in auto parallel 2021-12-13 20:24:33 +08:00
i-robot 2a2cd5e4ca !22222 [assistant][ops] Add new loader PennTreebankDataset
Merge pull request !22222 from 杨旭华/PennTreebankDataset
2021-12-13 11:43:00 +00:00
Margaret_wangrui dafe31e2cd [ME][Fallback] Add tensor testcase. 2021-12-13 17:13:24 +08:00
i-robot 7d7ec3c0c6 !27449 [ME]Add `MS` header of env var
Merge pull request !27449 from chenfei_mindspore/environment_variable_fix
2021-12-13 08:03:45 +00:00
huangxinjing f5889750f4 Move the AllSwap to the _AllSwap 2021-12-13 14:19:29 +08:00
yangzhenzhang 2a0b528084 support opt parallel for adafactor 2021-12-13 11:21:44 +08:00
Margaret_wangrui 751763dcef [ME][Fallback] Add array property test cases 2021-12-13 10:17:35 +08:00
huangbingjian 038cbe43de add tesecases of Tensor 2021-12-11 10:14:41 +08:00
i-robot 22078f77ea !27522 [ME][Fallback] Add tensor testcase.
Merge pull request !27522 from Margaret_wangrui/fallback
2021-12-10 09:40:42 +00:00
i-robot 938dc8abd0 !27439 [Auto parallel] Add new operatorInfo for Parallel: CumSum
Merge pull request !27439 from Xiaoda/117-add-cumsum-op
2021-12-10 07:00:06 +00:00
Margaret_wangrui 2779760409 [ME][Fallback] Add tensor testcase 2021-12-10 14:53:27 +08:00
chenfei 0ae5eb4618 add ms header of env var 2021-12-10 09:35:22 +08:00
i-robot 093f6f7bf2 !27453 Handle the interpreted node for binary ops, and refactoring other modules.
Merge pull request !27453 from 张清华/opt_jit_fallback2
2021-12-09 10:59:34 +00:00
i-robot d46e047fe1 !27372 fix permission bug when remove read_only_file on windows
Merge pull request !27372 from zhangbuxue/fix_permission_bug_when_remove_read_only_file_on_windows
2021-12-09 06:11:13 +00:00
Zhang Qinghua 135db97692 Handle the interpreted node for binary ops.
Refactoring specialize.
Adjust ir/dat/dot order.
Optimize DumpIR FV routine.
2021-12-09 11:33:45 +08:00
i-robot 0e358f4cb3 !27428 revert insert VirtualDataset node for master
Merge pull request !27428 from lilei/modify_virtualdataset_for_master
2021-12-09 02:47:13 +00:00
buxue ae256a362b fix permission bug when remove read_only_file on windows 2021-12-09 09:32:24 +08:00
Xiaoda Zhang 8042c88223 add the new operatorInfo for parallel: CumSum 2021-12-09 09:21:52 +08:00
i-robot 66a0e7efa5 !27424 [MD][revert] revert offload modification code to fix pangu model problem
Merge pull request !27424 from xiefangqi/md_revert_offload_pr
2021-12-08 13:30:50 +00:00
lilei 2edf6ab33b revert insert VirtualDataset node for master 2021-12-08 17:39:42 +08:00
i-robot faaec746f7 !27401 add more ut tests for allreduce fusion
Merge pull request !27401 from jiahongQian/master
2021-12-08 09:38:37 +00:00
Megalomania 259854e040 [feat] [assistant] [I40GY5] add new loader PennTreebankDataset 2021-12-08 01:22:40 -08:00
xiefangqi bae1dd3bb0 Revert "Moved the offload operation check and map operation split from python (datasets.py) to c++ (NodeOffloadPass.cc)."
This reverts commit 84d38e547a.
2021-12-08 16:39:10 +08:00
i-robot 895256f69a !20043 [assistant][ops] Add new YelpReview
Merge pull request !20043 from 杨旭华/YelpReview
2021-12-08 08:13:34 +00:00
jiahongQian b03c8d18d3 add more ut tests 2021-12-08 14:17:02 +08:00
i-robot 75e35bded2 !27081 [MD][Offload] Move offload checks and split to the C pipeline
Merge pull request !27081 from markuskunej/move_offload_check_to_c
2021-12-07 15:55:16 +00:00
i-robot b80ed801d5 !27335 change log level for read not exist tensors
Merge pull request !27335 from yelihua/dev
2021-12-07 13:08:20 +00:00
lufei9026 2947f418b1 [feat][assistant][I3T96N]add new loader YelpReview 2021-12-07 17:09:41 +08:00
i-robot ffca7b08a5 !27237 auto insert VirtualDataset node for master
Merge pull request !27237 from lilei/modify_virtualdataset_for_master
2021-12-07 09:02:50 +00:00
i-robot 25ae2d620b !27271 modify c++ msg & conv2d
Merge pull request !27271 from huchunmei/master
2021-12-07 07:56:21 +00:00
yelihua 01823faed0 change error level to info as dir not exist is normal case 2021-12-07 15:27:37 +08:00
i-robot 7a8e35b4f1 !26456 [assistant][ops]Add new operator Spectrogram
Merge pull request !26456 from YJfuel123/Spectrogram
2021-12-07 06:39:01 +00:00
i-robot 3d0f8fcc99 !22552 [assistant][ops]New operator implementation, include STL10Dataset
Merge pull request !22552 from 王睿/stl10_dataset
2021-12-07 06:37:04 +00:00
i-robot 59184541c3 !27140 fix sync GraphCell params data from device bug
Merge pull request !27140 from zhangbuxue/fix_sync_GraphCell_params_data_from_device_bug
2021-12-07 04:33:21 +00:00
huchunmei 1023c7a5e2 modify c++ msg 2021-12-07 11:20:12 +08:00
i-robot f40668ef73 !27251 test_micro_batch_Interleaved
Merge pull request !27251 from lilei/add_parallel_ut
2021-12-07 02:18:09 +00:00
i-robot 9b2f4141c9 !27302 add summart ops params valid check ut
Merge pull request !27302 from helloiSCSI/add_st
2021-12-07 01:56:52 +00:00
RainWang6188 c4063f0f11 [feat][assistant][I3J6VI] add new data operator STL10 2021-12-07 01:21:11 +00:00
buxue d7dc539b6e fix sync GraphCell params data from device bug 2021-12-07 09:20:46 +08:00
i-robot d723cc417d !27151 [ME][Fallback] [ME][Fallback] Support built-in type: complex and reversed.
Merge pull request !27151 from Margaret_wangrui/fallback
2021-12-07 01:04:14 +00:00
i-robot 8bcd6e3a86 !27287 [ME][Fallback] Handle interpret nodes in list.
Merge pull request !27287 from Margaret_wangrui/list_interpret
2021-12-07 01:02:12 +00:00
i-robot d1aa8d6cb5 !26995 fix:unexpected eiminate of tile
Merge pull request !26995 from zhangzhaoju/master_bug_fix
2021-12-07 00:58:44 +00:00
lilei 05189459ab auto insert VirtualDataset node for master 2021-12-06 21:39:37 +08:00
Margaret_wangrui 6e5d625153 [ME][Fallback] Support built-in type: complex and reversed. 2021-12-06 21:15:30 +08:00
i-robot b1eae16a05 !22304 [assistant][ops]New operator implementation, include SVHNDataset
Merge pull request !22304 from 王睿/svhn_dataset
2021-12-06 12:30:13 +00:00
helloiSCSI 7cb5ed7676 add summart ops params valid check ut 2021-12-06 20:11:27 +08:00
郑昊 4ae41350a6 [feat][assistant][I3ALD1] add new method Spectrogram 2021-12-06 19:24:37 +08:00
lilei e933aa268b test_micro_batch_Interleaved 2021-12-06 18:37:21 +08:00
Margaret_wangrui fa8506c0a7 [ME][Fallback] Handle interpret nodes in list. 2021-12-06 16:58:21 +08:00
zhangzhaoju 722086435d 1. fix:unexpected eiminate of tile
2. fix:delay memory allocat in NewTensorFilledWithData
2021-12-06 14:49:48 +08:00
i-robot 2d23b698a6 !27024 add allreduce fusion by size
Merge pull request !27024 from jiahongQian/master
2021-12-06 05:32:12 +00:00
q00596439 de36fdc169 add allreduce fusion size and unify the interface 2021-12-05 21:35:11 +08:00
zhangyuqwer e934381b08 [feat][assistant][I3ZSQV] add new data operator CharNGram 2021-12-04 22:09:34 +08:00
RainWang6188 340b3b4d5d [feat][assistant][I3J6VJ] add new data operator SVHN 2021-12-04 08:19:47 +00:00
mohammad af6e587c28 MD Profiler: support multiple start/stop calls 2021-12-03 23:25:38 -05:00
danishfarid faaa5d5f0a autotune step
fix testing script default

updates and changed sampling function

comments addressed

comments addressed

comments addressed

moving isSinkCheckAbove

update - move CheckSinkFunction

fix
2021-12-03 20:29:35 +00:00
markuskunej 84d38e547a Moved the offload operation check and map operation split from python (datasets.py) to c++ (NodeOffloadPass.cc).
Updated check for offload in python (dataset_helper.py and
iterators.py).

Updated auto_offload test in test_map_offload.py.

Changed MapNode.offload type from bool->int in bindings.cc.

Changed manual offload flag from int->enum.
2021-12-03 14:40:01 +00:00
luoyang f3e1794a74 update log 2021-12-03 15:09:36 +08:00
i-robot 93db7f741f !20788 [assistant][ops] Add new dataset loading operator TedliumDataset
Merge pull request !20788 from 杨旭华/TedliumDataset
2021-12-03 06:29:29 +00:00
i-robot 8e4f3472d8 !27154 Enable the test for Parallel Optimizer
Merge pull request !27154 from huangxinjing/enable_gradient_accumulation
2021-12-03 06:23:53 +00:00
i-robot c0048bb117 !26953 Add some bprop mindir files
Merge pull request !26953 from YuJianfeng/bprop_mindir
2021-12-03 03:28:37 +00:00
i-robot 9cec03e3a8 !27033 close autotune in non-sink mode
Merge pull request !27033 from luoyang/close_autotune_nonsink
2021-12-03 01:26:06 +00:00
huangxinjing 8c9b2b93a8 Add transformer 2021-12-03 09:08:57 +08:00
luoyang 9cbb45bcc4 close autotune in non-sink mode 2021-12-03 08:46:14 +08:00
i-robot 9ddd3fb66f !27085 [MD][UT]: Use pytest.mark.forked for profiling tests
Merge pull request !27085 from cathwong/ckw_ut_prof_forked
2021-12-02 17:00:28 +00:00
Cathy Wong 367e5ed1dd MD UT: Use pytest.mark.forked for profiling tests 2021-12-02 10:55:05 -05:00
i-robot eb25c473d0 !27117 [ME][Fallback] Handle interpret nodes in tuple.
Merge pull request !27117 from Margaret_wangrui/tuple_interpret
2021-12-02 14:11:12 +00:00
i-robot fa457b2bfa !17832 [assistant][ops]New operator implementation, include KMnistDataset
Merge pull request !17832 from 张璇/kmnist_dataset
2021-12-02 14:00:36 +00:00
i-robot 3e73e124ac !23225 [assistant][ops] Add Glove
Merge pull request !23225 from 张渝/Glove
2021-12-02 12:22:17 +00:00
i-robot eab0699c6d !26986 change MD error log
Merge pull request !26986 from shenwei41/master
2021-12-02 11:35:07 +00:00
i-robot 7c9dc30e78 !27101 check args for shard
Merge pull request !27101 from yangzhenzhang/fix-bug-for-out-strategy
2021-12-02 08:24:47 +00:00
Margaret_wangrui f7fc7f4238 [ME][Fallback] Handle interpret nodes in tuple 2021-12-02 15:36:54 +08:00
i-robot 53f50c0d6b !26880 [MD] fix mindrecord log message part02
Merge pull request !26880 from liyong126/fix_mindrecord_log_msg_2
2021-12-02 06:48:15 +00:00
yangzhenzhang 7454b8f8f2 check args for shard 2021-12-02 11:51:29 +08:00
i-robot 3bff079969 !26896 Enhance error message of audio ops
Merge pull request !26896 from xiaotianci/enhance_audio_err_message
2021-12-02 03:42:35 +00:00
liyong d35e003def fix mindrecord log part02 2021-12-02 11:28:58 +08:00
i-robot ae94c51a97 !26930 fix bug of export mindir when using encrypt
Merge pull request !26930 from lianliguang/mindir_load_2G
2021-12-02 02:21:19 +00:00
luqilin 34bffbf768 [feat][assistant][I3T96H] add new dataset loading operator TedliumDataset 2021-12-02 09:53:39 +08:00
i-robot b00b1cc276 !26982 [ME][Fallback] Review the local dict and try to eval out the interpret node.
Merge pull request !26982 from Margaret_wangrui/recheck_local_dict
2021-12-02 01:09:12 +00:00
yujianfeng 7c808ee792 Add some bprop mindir files 2021-12-01 19:44:06 +08:00
zy 8f9a09f79c [fix] [assistant] [I3ZSQR] add new data operator GloVe 2021-12-01 17:12:20 +08:00
shenwei41 5d48409395 change err info 2021-12-01 16:48:14 +08:00
i-robot 6924866a87 !26746 [MD] minddata error msg optimize
Merge pull request !26746 from xiefangqi/md_datasetops_error_msg_opt
2021-12-01 07:18:18 +00:00
zy 5ca98a494a [fix] [assistant] [I3ZSQS] add new data operator FastText 2021-12-01 11:12:08 +08:00
“uccInf” 92d6d31750 [feat][assistant][I3J6V7] add new data operator KMnist 2021-12-01 03:05:05 +00:00
Margaret_wangrui ee1b4d4e6d [ME][Fallback] Review the local dict and try to eval out the interpret node 2021-12-01 10:02:26 +08:00
i-robot b6a6dbbe8f !27003 [Auto parallel] [Sharding propagation] Dealing with a parameter being used by mutiple ops
Merge pull request !27003 from Xiaoda/114-adapting-sharding-propagation-for-common-parameter
2021-12-01 02:01:34 +00:00
i-robot fcac7351aa !26801 add loss landscape ut and st
Merge pull request !26801 from Songyuanwei/landscape_ci
2021-12-01 01:49:43 +00:00
i-robot eb9537af11 !21690 [assistant][ops] Add data operator Vectors
Merge pull request !21690 from 张渝/Vectors
2021-12-01 01:29:45 +00:00
Xiao Tianci b883498c93 enhance error message of audio ops 2021-12-01 09:27:04 +08:00
i-robot 1905b228b4 !26609 Update minddata log message
Merge pull request !26609 from luoyang/log
2021-12-01 01:25:11 +00:00
lianliguang c7acd4b0ca fix bug of export mindir when using encrypt mode 2021-12-01 09:22:53 +08:00
i-robot bf59d75604 !26611 [MD] fix mindrecord log message part01
Merge pull request !26611 from liyong126/fix_mindrecord_log_msg
2021-12-01 01:12:48 +00:00
xiefangqi f74b5cea0c optimize datasetops error msg 2021-12-01 09:11:22 +08:00
Xiaoda Zhang 364858cbc9 In sharding propagation, to keep strategy consistent of parameter being used by multiple operators, we check the edge with one node of TmpIdentityInfo 2021-11-30 18:58:33 +08:00
i-robot 2fd00935ed !20964 [assistant][ops] Add new data operator SpeechCommandsDataset
Merge pull request !20964 from 杨旭华/SpeechCommandsDataset
2021-11-30 09:33:03 +00:00
i-robot 95c0cafef4 !26824 white list for syntax exception
Merge pull request !26824 from zhangzhaoju/master_syntax
2021-11-30 08:01:59 +00:00
i-robot 7554053c00 !26786 Add initializer and optimizer ut
Merge pull request !26786 from wanyiming/add_init_opt_ut
2021-11-30 07:23:27 +00:00
luoyang 1a6a42c083 Update minddata log message 2021-11-30 15:22:40 +08:00
zhangyuqwer 6a6e73ef82 [fix] [assistant] [I3ZSQM] add new data operator Vectors 2021-11-30 14:39:42 +08:00
songyuanwei a67ac908d8 add landscape ut and st 2021-11-30 11:28:47 +08:00
liyong 2869352cc8 fix mindrecord log part01 2021-11-30 10:57:58 +08:00
Xiaoda Zhang 04db51a528 In a previous PR (https://gitee.com/mindspore/mindspore/pulls/26807/), we replaced 'auto_parallel_search_mode' by 'search_mode' directly.
However, to be forward compatitable, it is suitable to keep 'auto_parallel_search_mode' available. This PR recovers the 'auto_parallel_search_mode' interface and adds a warning when using this old interface.

This PR also deals with other codestyle things.
2021-11-29 15:40:23 +08:00
zhangzhaoju d34f14e324 white list for syntax exception 2021-11-29 12:40:38 +08:00
vddong 91d3a7543f [feat][assistant][I3T96F] add new data operator SpeechCommands 2021-11-27 11:25:18 +08:00
i-robot d1e4e674ab !26690 Add supoort resolving outer lambda function for ops.Partial.
Merge pull request !26690 from hezhenhao1/add_lambda
2021-11-26 09:21:34 +00:00
hezhenhao1 4af312d17e Add supoort resolving outer lambda function for ops.Partial. 2021-11-26 15:05:50 +08:00
i-robot 9f8ec2c5ab !26807 [Auto parallel] [Sharding propagation] Interface change of sharding propagation
Merge pull request !26807 from Xiaoda/113-auto-parallel-search-mode-changes-to-search-mode
2021-11-26 01:48:58 +00:00
i-robot 6ecbc97fd6 !26804 virtual_dataset_avoid_auto_parallel
Merge pull request !26804 from yao_yf/virtual_dataset_avoid_auto_parallel
2021-11-26 01:48:53 +00:00
wanyiming ab65f4ac98 addut 2021-11-26 09:48:34 +08:00
i-robot b282414de7 !26619 arallel_ut_refactoring
Merge pull request !26619 from 王志伟/parallel_ut_refactoring1
2021-11-26 01:34:49 +00:00
i-robot bbe9606f1c !26805 Revert "Add the check of function return None."
Merge pull request !26805 from Margaret_wangrui/return_none
2021-11-26 01:28:46 +00:00
i-robot d8fbc26419 !26700 [MD][Profiler][Autotune] Add test, logs, clean state
Merge pull request !26700 from harshvardhangupta/add_test_at_prof
2021-11-25 19:38:33 +00:00
Margaret_wangrui 922678edef Revert "Add the check of function return None."
This reverts commit f9a384456a.
2021-11-25 21:18:24 +08:00
i-robot 4407210ae3 !26689 Modify error
Merge pull request !26689 from liuyang/error_ms
2021-11-25 12:18:11 +00:00
Xiaoda Zhang ad5ac77ae8 1) 'auto_parallel_search_mode' changes to 'search_mode';
2) 'sharding_propagation' moves to 'search_mode';
2021-11-25 19:38:21 +08:00
yao_yf f29ce1fb60 virtual dataset avoid auto parallel 2021-11-25 18:47:35 +08:00
harshvardhangupta 02f4a8068b add tests, clean states, print proper warn logs 2021-11-25 00:03:38 -05:00
liuyang_655 12092c882f modify error 2021-11-24 22:40:23 -05:00
jonyguo 58c9112c2e fix: generator dataset with source zip 2021-11-25 11:32:28 +08:00
i-robot eef5f3f8d4 !22925 [assistant][ops] add operator Cummin
Merge pull request !22925 from yangwm/cummin
2021-11-24 11:46:23 +00:00
i-robot d251800c62 !26705 Add the check of function return None.
Merge pull request !26705 from Margaret_wangrui/return_none
2021-11-24 11:09:27 +00:00
Margaret_wangrui f9a384456a Add the check of function return None. 2021-11-24 15:30:35 +08:00
i-robot 2cc51099b1 !26718 [ME][Fallback] Add some fallback numpy test cases
Merge pull request !26718 from Margaret_wangrui/fallback
2021-11-24 06:43:13 +00:00
i-robot 519f14a909 !26006 slice recompute activation
Merge pull request !26006 from yao_yf/add_transformer_slice_activation_config
2021-11-24 06:14:28 +00:00
i-robot de8b6db07c !26585 add warnings for set_dump API, see I4AUIR for details
Merge pull request !26585 from wenkai/wk1120setdumpwarning1
2021-11-24 03:42:25 +00:00
Margaret_wangrui 16ac3638d3 [ME][Fallback] Add some fallback numpy test cases 2021-11-24 11:20:06 +08:00
i-robot 9a5fd32bd2 !26280 fix mindir export's error when using _encrypt
Merge pull request !26280 from lianliguang/master
2021-11-24 01:48:32 +00:00
wzw 86c5ad20c8 parallel_ut_refactoring1 2021-11-24 09:41:52 +08:00
luon 5485ff0cb6 [feat] [assistant] [I40GGH] add new ascend operator Cummin 2021-11-23 21:57:23 +08:00
wenkai c493f19b6b add warnings for set_dump API, see I4AUIR for details 2021-11-23 21:55:36 +08:00
yujianfeng f2bd7de442 Add automatic detection for the changes of python scripts when enable compile cache 2021-11-22 21:27:02 +00:00
i-robot 4f55a3f52f !26275 [API] Tensor python float trans to ms float32
Merge pull request !26275 from kingxian/master
2021-11-22 11:13:15 +00:00
lianliguang a6e5dcfb22 if parameter total larger than 1T split to another file 2021-11-22 11:17:33 +08:00
kingxian 545dc83fcb fix: `cell` does not support deep copy, tensor default dtype -> float32 2021-11-22 09:08:32 +08:00
i-robot 1b8c2ff0e9 !26414 fault_recover_by_mirror_group_fix_opt_shard
Merge pull request !26414 from yao_yf/fault_recover_by_mirror_group_fix_opt_shard
2021-11-20 03:06:45 +00:00
i-robot 4f34c32c6d !26235 AutoTune v1
Merge pull request !26235 from danishfarid/autotune
2021-11-19 23:40:40 +00:00
Rescue da986710f0 Updated concat-zip check and UT. 2021-11-19 17:38:16 +00:00
hesham 40797c40da AutoTune 2021-11-19 09:27:12 -05:00
i-robot 70363899e7 !24080 [assistant][ops] Add new audio operator ComputeDeltas
Merge pull request !24080 from Rainfor/compute_detlas
2021-11-19 12:29:49 +00:00
i-robot c6821bde0a !21648 [assistant][ops] Add new data loading operator YesNoDataset
Merge pull request !21648 from 杨旭华/YesNoDataset
2021-11-19 09:05:07 +00:00
vddong f465cd0242 [feat][assistant][I3T96L]add new dataset operator YesNo 2021-11-19 13:36:24 +08:00
i-robot f38df5c888 !26234 New dataset config option, auto_offload
Merge pull request !26234 from markuskunej/offload_config
2021-11-19 03:44:56 +00:00
yao_yf 188d39da83 slice_activation_in_recompute
slice recompute activation
2021-11-19 10:51:54 +08:00
i-robot 7559d5b798 !26494 [Auto parallel] Adjusting sharding propagation
Merge pull request !26494 from Xiaoda/102-adjusting-sharding-propagation
2021-11-19 02:00:46 +00:00
yao_yf 01dc4bbdf9 fix fault recover in optimizer shard 2021-11-19 09:46:27 +08:00
i-robot 3c39afad11 !24547 [MS][crowdfunding]New operator implementation, AutoAugment
Merge pull request !24547 from yangwm/autoaugment
2021-11-19 01:00:51 +00:00
markuskunej 29cf442521 Added dataset.config.set_auto_offload(), which will automatically attempt to offload dataset map operations if set to True. 2021-11-18 21:13:20 +00:00
i-robot 117df75afc !26126 MD Profiling - Add Start Stop Python UT
Merge pull request !26126 from cathwong/ckw_ut_prof_startstop
2021-11-18 14:05:00 +00:00
zhuchuang 4c3931f5c9 [feat] [assistant] [I3CKEE] add new audio operator ComputeDeltas 2021-11-18 17:18:43 +08:00
Xiaoda Zhang df67e74eaf making sharding_propagation smooth, add a reshape justification:
1) when propagate sharding strategy from one op to another, try to find the strategy with zero communication cost;
2) if there is no such strategy, find the strategy with minimum communication cost, and raise a warning;
2021-11-18 15:55:50 +08:00
i-robot 9f52343a6a !26350 add check for resizenearestneighbor parallel op
Merge pull request !26350 from yangzhenzhang/add-check-for-resize-op
2021-11-18 05:45:57 +00:00
despicablemme 09897ce7ec [feat] [assistant] [I40GZP] add new data op AutoAugment 2021-11-18 11:38:18 +08:00
i-robot 707e7fbbf9 !26453 [Fallback] Add some fallback numpy test cases
Merge pull request !26453 from Margaret_wangrui/fallback_tests
2021-11-18 03:01:47 +00:00
Margaret_wangrui c6582b9390 [Fallback] Add some fallback numpy test cases 2021-11-18 10:18:13 +08:00
Cathy Wong b1094b9d81 MD Profiling - Add Start Stop Python UT 2021-11-17 13:49:43 -05:00
i-robot 4e88f2e5e8 !26345 add examples of function grad, jvp and vjp
Merge pull request !26345 from chenzhuo/jvp
2021-11-17 08:35:38 +00:00
i-robot 36517de69c !24519 [assistant][ops] Add new audio operator SlidingWindowCmn.
Merge pull request !24519 from Rainfor/SlidingWindowCmn
2021-11-17 06:40:43 +00:00
i-robot 9f2e1edc00 !26279 neighborexchangev2 fix bug
Merge pull request !26279 from TuDouNi/neighborexchangev2_bug
2021-11-17 02:29:21 +00:00
wangkc123 706f9e2cbb [feat] [assistant] [I3CKEH] add new audio operator SlidingWindowCmn 2021-11-16 22:00:09 +08:00
yangzhenzhang ba99e4c505 add check for resize op 2021-11-16 15:39:52 +08:00
i-robot 58b69a05ee !20576 [assistant][ops] add new dataset loading operator LJSpeechDataset
Merge pull request !20576 from 杨旭华/LJSpeechDataset
2021-11-16 07:00:20 +00:00
chenzhuo d07f24462c add examples of grad, jvp and vjp 2021-11-16 14:15:26 +08:00
ttudu 33ac1de062 fix bug 2021-11-16 11:14:58 +08:00
liyong 9663884db3 fix occasional failed in random sampler 2021-11-16 09:53:38 +08:00
i-robot 5af8572cd7 !25488 add the set_dump API
Merge pull request !25488 from wenkai/wk1027setdump1
2021-11-16 01:47:32 +00:00
i-robot 0113b3eee1 !26236 Add MD Profiler save()
Merge pull request !26236 from Mohammad Motallebi/add_profiler_save
2021-11-16 01:04:53 +00:00
mohammad 5c8ab5f60c add MD Profiler Save() 2021-11-15 13:18:36 -05:00
wenkai d2eca80d40 add the set_dump API, see I4AUIR for details 2021-11-15 21:28:40 +08:00
i-robot 9dfe08b805 !25909 [Fallback] Add global Py param when processing global namespace info
Merge pull request !25909 from huangbingjian/update_global_params
2021-11-15 11:43:35 +00:00
i-robot 9522ee9686 !25703 [assistant][ops] Add math operator LpNorm
Merge pull request !25703 from 孟权令/LpNorm
2021-11-15 02:36:54 +00:00
vddong 6fe2d35ae2 [feat][assistant][I3T96D] add new dataset loading operator LJSpeechDataset 2021-11-14 14:52:15 +08:00
i-robot e154dca4b1 !22193 [assistant][ops] Add new loader operator DBpedia
Merge pull request !22193 from 杨旭华/DBpedia
2021-11-12 09:02:28 +00:00
i-robot e773f0621e !25918 add Function jvp and vjp
Merge pull request !25918 from chenzhuo/jvp
2021-11-12 06:37:46 +00:00
i-robot 5869e02fa1 !26135 Enable tuple input of optimizer as variable
Merge pull request !26135 from LiangZhibo/broaden3
2021-11-12 06:29:35 +00:00
Carry955 0d26c38693 [feat][assistant][I40GXT] add new loader DBpedia 2021-11-11 19:02:22 -08:00
i-robot 7a73bae5c3 !26036 add output strategy for matmul operator
Merge pull request !26036 from yangzhenzhang/add-output-strategy-for-op-init
2021-11-12 01:22:22 +00:00
i-robot e03544685b !26049 [Auto parallel] Support reshape in sharding propagation
Merge pull request !26049 from Xiaoda/99-ad-reshape-adjusting-in-sharding-propagation
2021-11-12 01:14:18 +00:00
chenzhuo f36edec3ff add function jvp 2021-11-12 08:44:41 +08:00
i-robot 1792d5f8a4 !26131 Offload Hardware Acceleration Computing
Merge pull request !26131 from alashkari/hw_accel_move_copy
2021-11-11 13:18:07 +00:00
i-robot b910870ecc !19986 [assistant][ops] Add new dataset loading operator AGNEWS
Merge pull request !19986 from 杨旭华/AGNEWS
2021-11-11 06:22:25 +00:00
Xiaoda Zhang a772767265 support reshape in sharding propagation:
1) using 'swc index of strategy_cost_' as reshape's selected strategy;
2) when encountering reshape in BFS, select the 'swc index' with zero communication cost;
3) when encountering a reshape that is already visited, check whether there exists communication between reshape and current operator. It is OK if communication happens between two configured operators;
4) currently, two consecutive reshapes are not supported;
5) adjusting BFS structure in graph_costmodel.cc;
6) adjusting some code in step_auto_parallel.cc to avoid cyclomatic complexity.
2021-11-11 11:35:43 +08:00
l00591931 9353bd10a4 Enable tuple as variable in optimizer 2021-11-11 11:31:05 +08:00
Megalomania c34bbabed9 [feat] [assistant] [I3T96M] add new loader AGNEWS 2021-11-09 23:51:19 -08:00
yangzhenzhang 8431ba616c add output strategy for op init 2021-11-10 15:35:45 +08:00
rescue 22e03ab12e Adding offload hardware accelerator. 2021-11-10 07:03:43 +00:00
i-robot f1f7731fb2 !25964 Fix serdes multithreading bug
Merge pull request !25964 from zetongzhao/serdes_multithreading
2021-11-09 15:48:06 +00:00
i-robot 14c3517b9a !25452 Add Gradient Sharding
Merge pull request !25452 from huangxinjing/pipeline_shard_mini_step
2021-11-09 08:15:23 +00:00
huangbingjian d0ca18b921 Add global Py param when processing global namespace info. 2021-11-09 09:34:30 +08:00
huangxinjing f354ab22a3 add pipeline shard interface
Add support for no pipeline accugradient

Add delay tag for fusion op

Optimizer the visite order

add mirror for mini step control

Move the group to attributes

Add gradient_shard control for the mini step

Fix code stype

Fix ut description

Add interface
2021-11-09 09:11:13 +08:00
i-robot d89a39c661 !25851 MD Profiling Start and Stop Support
Merge pull request !25851 from cathwong/ckw_prof_startstop4
2021-11-08 16:16:42 +00:00
i-robot 527abb8ede !26003 [MD] Added restrictions on shuffle and num_samples
Merge pull request !26003 from liyong126/fix_shuffle_and_num_samples
2021-11-08 11:58:08 +00:00
kman066 4ebec36ab2 add lpnorm 2021-11-08 19:36:13 +08:00
i-robot efc33a8225 !25745 F.grad support get gradient by position
Merge pull request !25745 from zhang_sss/grad
2021-11-08 08:59:23 +00:00
liyong 79891feadb fix shuffle and num_samples issue 2021-11-08 15:33:01 +08:00
zhang__sss 8bae4d9d50 grad 2021-11-08 14:12:58 +08:00
Cathy Wong cdf3126459 MD Profiler Start Stop Support 2021-11-05 19:46:39 -04:00
zetongzhao 5e8377ea5c fix multithreading bug 2021-11-05 16:49:18 -04:00
i-robot ded1c77bbf !25765 neighborExchangeV2 & grad
Merge pull request !25765 from TuDouNi/neighborExchangeV2
2021-11-05 09:31:03 +00:00
ttudu e953c15cd2 NeighborExchangeV2 & Grad 2021-11-05 11:00:46 +08:00
i-robot 7c14f984ed !25793 add output strategy for shard
Merge pull request !25793 from yangzhenzhang/add-output-strategy
2021-11-05 01:19:01 +00:00
i-robot 76f4f77cc2 !24520 Add graph run history to dump structure
Merge pull request !24520 from parastooashtari/multi_root_graph_dump
2021-11-04 12:55:01 +00:00
i-robot 92b81d3221 !23257 [assistant][ops][DBToAmplitudeOp]
Merge pull request !23257 from 杨旭华/DBToAmplitude
2021-11-04 10:32:32 +00:00
yangzhenzhang 6ad6304b77 add output strategy 2021-11-04 16:28:54 +08:00
i-robot 2828f317f7 !25718 optimize implicit convert error message
Merge pull request !25718 from chujinjin/optimize_implicit_convert_error_msg
2021-11-03 12:31:56 +00:00
yujianfeng fc769a79fe Fix the unloadable bprop mindir files 2021-11-03 14:29:56 +08:00
Isaac 69f57bc5b1 [feat][assistant][I40GXD]add new data operator DBToAmplitude 2021-11-02 23:45:27 +08:00
parastooashtari 1a59dc37bf add graph execution order history to dump 2021-11-02 11:00:38 -04:00
chujinjin 26410ccf75 optimize implicit convert error message 2021-11-01 17:34:11 +08:00
liyong 41e8280f55 add mindrecord overwrite 2021-11-01 10:44:20 +08:00
i-robot 45882752ba !25644 [Fallback] Support builtin type
Merge pull request !25644 from huangbingjian/fallback_set
2021-10-30 10:01:52 +00:00
i-robot f16ed11237 !25651 Add some fallback testcases
Merge pull request !25651 from Margaret_wangrui/fallback_tests
2021-10-30 09:21:46 +00:00
huangbingjian 5063ee55bc [Fallback] Support builtin type: set, dict, slice, bool, int, float, str 2021-10-30 14:54:59 +08:00
yujianfeng 195563c67f Fix the random failure of ut tests in ci 2021-10-30 14:09:12 +08:00
i-robot b27520b6ae !25640 fix minddata ut core
Merge pull request !25640 from luoyang/serving
2021-10-30 01:35:32 +00:00
i-robot 7d50c3d5d7 !25551 [Fallback] Added test cases for python built-in functions
Merge pull request !25551 from huangbingjian/add_fallback_testcases
2021-10-29 09:15:19 +00:00
luoyang beba798e00 fix minddata ut core 2021-10-29 16:28:22 +08:00
i-robot 958c2a8e00 !25560 Support bytes input for decode op
Merge pull request !25560 from luoyang/serving
2021-10-29 06:47:02 +00:00
Margaret_wangrui 6275cdcf7a add fallback testcases 2021-10-29 12:02:16 +08:00
i-robot e43d0ee554 !25613 [MD] fix dataset ut part06
Merge pull request !25613 from liyong126/fix_md_ut_part06
2021-10-29 03:32:27 +00:00
i-robot 48699c939c !25544 add parallel op for resizenearestneighbor
Merge pull request !25544 from yangzhenzhang/add-parallel-op-for-resizenearestneighbor
2021-10-29 02:47:49 +00:00
liyong b9bad0bdbb fix md ut part06 2021-10-29 10:26:34 +08:00
huangbingjian 02f72ab3ae [Fallback] Added test cases for python built-in functions 2021-10-29 09:33:16 +08:00
i-robot 357ad46cb1 !25585 Enable JIT Fallback in default.
Merge pull request !25585 from 张清华/opt_jit_fallback
2021-10-28 17:30:50 +00:00
Zhang Qinghua e8b421fe6e Enable JIT Fallback in default. 2021-10-28 20:18:06 +08:00
i-robot 8758830723 !25479 delete mindquantum c++ simulator
Merge pull request !25479 from donghufeng/master
2021-10-28 08:14:18 +00:00
luoyang b47ac46e92 Support bytes input for decode op 2021-10-28 15:22:50 +08:00
yangzhenzhang c42081619e add parallel op for resizenearestneighbor 2021-10-28 11:31:00 +08:00
i-robot a7834c382f !25511 Add some fallback testcases
Merge pull request !25511 from Margaret_wangrui/fallback_tests
2021-10-28 02:28:20 +00:00
Margaret_wangrui 7738f55f44 Add some fallback testcases 2021-10-28 09:15:24 +08:00
i-robot 418e1b425b !23490 [assistant][ops] Add New Math Operator IsNan
Merge pull request !23490 from 孟权令/IsNan
2021-10-27 12:15:41 +00:00
xuxusheng 7a9a4d0515 delete mindquantum simulator 2021-10-27 18:35:35 +08:00
i-robot 360e228f45 !25358 Fix fallback and cell kwargs issues.
Merge pull request !25358 from 张清华/opt_fallback
2021-10-27 09:07:55 +00:00
Sawyer c032d1f83c [feat][assistant][I3T92O]add new operator IsNan 2021-10-27 16:14:03 +08:00
i-robot 180b071122 !22149 [assistant][ops] Add New IsInf
Merge pull request !22149 from 孟权令/IsInf
2021-10-27 07:41:15 +00:00
Zhang Qinghua b43693be23 Fix fallback and cell kwargs issues. 2021-10-27 14:06:02 +08:00
i-robot 74977e548d !24624 [Autotune] Modify MD callback and AddWorker logic to ParallelOps
Merge pull request !24624 from h.farahat/add_worker
2021-10-27 00:41:20 +00:00
i-robot c0f6286fcb !25092 [MD] API for autotune
Merge pull request !25092 from harshvardhangupta/auto_tune_api
2021-10-26 18:14:43 +00:00
i-robot 704c490e80 !25449 MD UT - Add missing set and restore seed for parallel test execution
Merge pull request !25449 from cathwong/ckw_ut_py_parallel
2021-10-26 17:53:39 +00:00
Cathy Wong e66aba9ef5 MD UT - Add missing set and restore seed.
test_places365_content_check - delete visualize_dataset
2021-10-26 13:19:47 -04:00
harshvardhangupta 1bb45142c9 Implement autotune api 2021-10-26 11:26:13 -04:00
doit cd9242eaa9 [feat] [assistant] [I3T92M] add new math operator IsInf 2021-10-25 14:40:40 +08:00
huangbingjian d7e97dd74a change EXCEPTION level to CRITICAL level 2021-10-25 14:25:50 +08:00
i-robot 6f413ee29d !25155 Support ops, nn and numpy namespaces, and add test case.
Merge pull request !25155 from 张清华/opt_fallback
2021-10-23 03:50:53 +00:00
Zhang Qinghua 6a79e262ae Support ops, nn and numpy namespaces, and add test case. 2021-10-22 16:31:30 +08:00
i-robot c544af28b6 !25286 dataset: modify profiling ut for parallel running
Merge pull request !25286 from ms_yan/ut_parallel
2021-10-22 08:09:03 +00:00
ms_yan bb314ad07f make ut parallel 2021-10-22 13:17:43 +08:00
i-robot cf0029b33a !25277 [MD] fix mindrecord ut part05
Merge pull request !25277 from liyong126/fix_md_ut_05
2021-10-22 01:43:03 +00:00
i-robot 782874bf18 !21215 [MS][crowdfunding]New operator implementation, include phaser
Merge pull request !21215 from Wangsong95/phaser
2021-10-22 01:08:50 +00:00
hesham 85e077b60b Callback changes
AddWorker logic to parallel ops
2021-10-21 17:35:11 -04:00
liyong 7c9f6899a3 fix md ut part05 2021-10-21 20:40:09 +08:00
i-robot b7d8bcfe8d !25177 [MD] fix mindrecord ut part04
Merge pull request !25177 from liyong126/fix_md_ut_part04
2021-10-21 01:39:26 +00:00
i-robot 5d8be044c9 !18018 [assistant][ops]New operator implementation, include FashionMnistDataset
Merge pull request !18018 from 张璇/fashionmnist_dataset
2021-10-20 06:42:54 +00:00
i-robot f9bd640b09 !16269 [assistant][RandomLighting]
Merge pull request !16269 from QingfengLi/randomlighting
2021-10-20 06:42:12 +00:00
liyong fc5ea9cc1c fix dataset ut for running independently 2021-10-20 14:27:36 +08:00
i-robot ae87f31dea !25088 Optimize the comment and log descriptions for the python source code
Merge pull request !25088 from zhunaipan/master
2021-10-20 06:26:56 +00:00
zhunaipan 8ce4e62725 optimize the comment and log description
修改:     ops/operations/_inner_ops.py
	修改:     ops/operations/_quant_ops.py
	修改:     ops/operations/array_ops.py
	修改:     ops/operations/comm_ops.py
	修改:     ops/operations/math_ops.py
	修改:     ops/operations/quantum_ops.py
	修改:     ops/operations/rl_ops.py
	修改:     ops/operations/sponge_ops.py
	修改:     ops/operations/sponge_update_ops.py
	修改:     train/__init__.py
	修改:     common/tensor.py
	修改:     train/serialization.py
	修改:     ccsrc/pipeline/jit/parse/parse.h
	修改:     explainer/benchmark/_attribution/metric.py
	修改:     ops/composite/multitype_ops/_constexpr_utils.py
	修改:     ops/operations/comm_ops.py

	修改:     RELEASE.md
	修改:     mindspore/_extends/parse/standard_method.py
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/concat_offset_cpu_kernel.cc
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/dynamic_shape_cpu_kernel.cc
	修改:     mindspore/ccsrc/frontend/parallel/ops_info/reshape_info.cc
	修改:     mindspore/ccsrc/frontend/parallel/ops_info/tile_info.cc
	修改:     mindspore/ccsrc/frontend/parallel/ops_info/transpose_info.cc
	修改:     mindspore/ccsrc/frontend/parallel/strategy.h
	修改:     mindspore/common/tensor.py
	修改:     mindspore/core/abstract/prim_arrays.cc
	修改:     mindspore/core/abstract/prim_nn.cc
	修改:     mindspore/core/ops/conv2d.cc
	修改:     mindspore/core/ops/logical_and.h
	修改:     mindspore/core/ops/logical_not.h
	修改:     mindspore/core/ops/logical_or.h
	修改:     mindspore/core/ops/reduce_all.h
	修改:     mindspore/core/ops/reduce_any.h
	修改:     mindspore/lite/src/runtime/kernel/arm/fp32_grad/sgd.cc
	修改:     mindspore/nn/layer/quant.py
	修改:     mindspore/nn/optim/sgd.py
	修改:     mindspore/nn/sparse/sparse.py
	修改:     mindspore/numpy/array_creations.py
	修改:     mindspore/numpy/array_ops.py
	修改:     mindspore/numpy/logic_ops.py
	修改:     mindspore/numpy/math_ops.py
	修改:     mindspore/ops/operations/_inner_ops.py
	修改:     mindspore/ops/operations/array_ops.py
	修改:     mindspore/ops/operations/rl_ops.py
	修改:     mindspore/train/_utils.py
	修改:     tests/ut/python/model/test_lenet_core_after_exception.py

	修改:     mindspore/_extends/parse/standard_method.py
	修改:     mindspore/ops/operations/rl_ops.py

	修改:     mindspore/core/abstract/prim_nn.cc
	修改:     mindspore/core/ops/conv2d.cc

	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/ctcloss_cpu_kernel.cc
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/fl/fused_pull_weight_kernel.h
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/fl/fused_push_weight_kernel.h
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/mkldnn/conv2d_grad_filter_cpu_kernel.cc
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/mkldnn/conv2d_grad_input_cpu_kernel.cc
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/ps/sparse_apply_ftrl_ps_kernel.cc
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/ps/sparse_apply_lazy_adam_ps_kernel.cc
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/rolling_cpu_kernel.cc
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/scatter_arithmetic_cpu_kernel.cc
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/split_cpu_kernel.cc
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/update_cache_cpu_kernel.cc
	修改:     mindspore/ccsrc/backend/kernel_compiler/gpu/arrays/split_gpu_kernel.h
	修改:     mindspore/ccsrc/backend/kernel_compiler/gpu/math/broadcast_gpu_kernel.h
	修改:     mindspore/ccsrc/backend/kernel_compiler/gpu/nn/conv2d_grad_input_gpu_kernel.h
	修改:     mindspore/ccsrc/fl/server/server.cc
	修改:     mindspore/ccsrc/frontend/optimizer/ad/kpynative.cc
	修改:     mindspore/ccsrc/frontend/optimizer/irpass/incorporate_getitem.h
	修改:     mindspore/ccsrc/frontend/optimizer/irpass/inline.h
	修改:     mindspore/ccsrc/minddata/dataset/core/device_tensor.cc
	修改:     mindspore/ccsrc/minddata/dataset/core/tensor.cc
	修改:     mindspore/ccsrc/minddata/dataset/engine/datasetops/source/emnist_op.cc
	修改:     mindspore/ccsrc/minddata/dataset/engine/datasetops/source/mnist_op.cc
	修改:     mindspore/ccsrc/minddata/dataset/engine/datasetops/source/qmnist_op.cc
	修改:     mindspore/ccsrc/minddata/dataset/engine/ir/datasetops/dataset_node.cc
	修改:     mindspore/ccsrc/minddata/dataset/engine/opt/pre/epoch_ctrl_pass.cc
	修改:     mindspore/ccsrc/minddata/dataset/kernels/image/lite_image_utils.cc
	修改:     mindspore/ccsrc/pipeline/jit/action.cc
	修改:     mindspore/ccsrc/pipeline/jit/static_analysis/evaluator.cc
	修改:     mindspore/ccsrc/runtime/device/ascend/executor/tiling/op_tiling_adapter.cc
	修改:     mindspore/compression/quant/quant_utils.py
	修改:     mindspore/core/abstract/prim_nn.cc
	修改:     mindspore/dataset/engine/validators.py
	修改:     mindspore/lite/micro/coder/opcoders/nnacl/fp32/affine_fp32_coder.cc
	修改:     mindspore/lite/micro/coder/opcoders/nnacl/int8/affine_int8_coder.cc
	修改:     mindspore/lite/src/runtime/kernel/ascend310/src/custom_kernel.cc
	修改:     mindspore/lite/src/runtime/kernel/opencl/kernel/matmul.cc
	修改:     mindspore/lite/src/runtime/kernel/opencl/kernel/strassen.cc
	修改:     mindspore/lite/tools/common/graph_util.h
	修改:     mindspore/lite/tools/optimizer/fisson/fisson_util.cc
	修改:     mindspore/ops/composite/math_ops.py
	修改:     mindspore/ops/operations/_inner_ops.py
	修改:     mindspore/ops/operations/array_ops.py
	修改:     mindspore/ops/operations/math_ops.py
	修改:     mindspore/ops/operations/other_ops.py

	修改:     mindspore/boost/boost_cell_wrapper.py
	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/update_cache_cpu_kernel.cc
	修改:     mindspore/ccsrc/common/trans.cc
	修改:     mindspore/ccsrc/frontend/parallel/cache_embedding/cache_embedding.cc
	修改:     mindspore/ccsrc/frontend/parallel/ops_info/gather_info.cc
	修改:     mindspore/lite/src/common/log_util.h
	修改:     mindspore/nn/wrap/loss_scale.py
	修改:     mindspore/parallel/nn/moe.py
	修改:     tests/mindspore_test_framework/mindspore_test.py

	修改:     mindspore/ccsrc/backend/kernel_compiler/cpu/split_cpu_kernel.cc
	修改:     mindspore/lite/tools/common/graph_util.h

	修改:     mindspore/ccsrc/frontend/parallel/ops_info/gather_info.cc

	修改:     mindspore/core/ops/conv2d.cc

	修改:     tests/ut/python/model/test_lenet_core_after_exception.py
2021-10-20 12:02:40 +08:00
i-robot ef7bc4ddda !25079 Change dir hash to file hash in bprop mindir
Merge pull request !25079 from YuJianfeng/bprop_mindir
2021-10-20 02:54:05 +00:00
“uccInf” fe3123cfe8 [feat][assistant][I3J6V4] add new data operator FashionMnist 2021-10-20 02:37:56 +00:00
i-robot 440036d331 !24362 [assistant][ops]New operator implementation, include PhotoTourDataset
Merge pull request !24362 from Wangsong95/phototour_dataset
2021-10-20 01:46:05 +00:00
yangyueren 6594b90a58 [feat][assistant][I3J6VE] add new data operator PhotoTour 2021-10-19 15:31:32 +00:00
chenx2ovo 77caf907c4 [feat][assistant][I3CEGR] add op random lighting 2021-10-19 20:38:01 +08:00
yujianfeng 42079ac087 Change dir hash to file hash in bprop mindir 2021-10-19 19:22:25 +08:00
liyong a89741c32e fix md ut part03 2021-10-19 16:52:57 +08:00
i-robot 690642d672 !18664 [assistant][ops]New operator implementation, include Places365Dataset
Merge pull request !18664 from Wangsong95/places365_dataset
2021-10-19 07:06:35 +00:00
i-robot c97d3eeef7 !25100 [MD] fix mindrecord ut part02
Merge pull request !25100 from liyong126/fix_md_ut_part02
2021-10-19 06:30:57 +00:00
i-robot 1606f19dfb !18265 [assistant][ops] Add new audio operator CreateDct
Merge pull request !18265 from 杨旭华/CreateDct
2021-10-19 06:30:18 +00:00
liyong d23961b98f fix mindrecord ut 2021-10-19 11:43:52 +08:00
i-robot e7ea546194 !25006 [MD] fix mindrecord ut
Merge pull request !25006 from liyong126/fix_md_ut
2021-10-19 02:02:13 +00:00
i-robot d9cfda44c4 !25060 ut_fix
Merge pull request !25060 from wanyiming/ut_fix
2021-10-19 00:59:01 +00:00
i-robot e3d8edc530 !24475 Implement the dict.items() interface and the multiplication operation of numbers and lists or tuples
Merge pull request !24475 from 翟之博/master
2021-10-18 11:39:27 +00:00
i-robot 8df1bd14a1 !24986 Change printed log's level in dump_proto.cc
Merge pull request !24986 from huanghui/change-log-level
2021-10-18 11:36:44 +00:00
tophand 4f4777f0da [feat][assistant][I3J6U2] Add new audio operator CreateDct 2021-10-18 03:23:18 -07:00
wanyiming 4fbc59a98a utfixs 2021-10-18 18:06:37 +08:00
liyong d9aa18dfca refactor md ut 2021-10-18 17:55:28 +08:00
i-robot 9d0d094437 !24554 support nested call of ms_function
Merge pull request !24554 from zhangzhaoju/ms_master_ms_function
2021-10-18 09:36:30 +00:00
zzb 95425b770d iml dict.items() and multiplication op 2021-10-18 12:47:22 +08:00
zx d13d2413f5 [feat][assistant][I3J6UV] add new audio operator Phaser 2021-10-16 08:45:12 +08:00
yangyueren 951193c308 [feat][assistant][I3J6VF] add new data operator Places365 2021-10-15 14:56:09 +00:00
Xiao Tianci 930a5b89c0 fix api docs of audio 2021-10-15 17:17:18 +08:00
i-robot be691284e2 !18407 [assistant][MulLawEncoding]
Merge pull request !18407 from QingfengLi/mulawencoding
2021-10-15 09:03:41 +00:00
i-robot 44fe11c656 !24805 fix_fronted_ut
Merge pull request !24805 from wanyiming/fix_uts
2021-10-15 09:01:35 +00:00
zhangzhaoju b4453709a2 Support parser decoratored functions
like nested calling of ms_function
2021-10-15 16:41:08 +08:00
wanyiming 8b40e77201 ut_fixed 2021-10-15 15:54:26 +08:00
huanghui 3785b6d1b4 change printed log's level 2021-10-15 15:49:08 +08:00
chujinjin 3c3d8c3962 remove useless python ut 2021-10-15 15:26:45 +08:00
i-robot b27623ae37 !24899 modify ut of probability
Merge pull request !24899 from byweng/master
2021-10-15 02:02:52 +00:00
robert_luo_yibo 75e2c3041c [feat][assistant][I3CEG3] add new data OP MuLawEncoding 2021-10-14 20:24:18 +08:00
Bingya Weng be20f00299 modify ut of probability 2021-10-14 19:33:34 +08:00
i-robot f83070728d !24790 support user define strategy gen method under auto parallel context
Merge pull request !24790 from zhuyuxiao/master
2021-10-14 09:03:36 +00:00
chujinjin 90836f70a0 fix context python ut error 2021-10-14 14:27:50 +08:00
i-robot 957f9a7b4e !24839 UT case runs failed in PyNative mode
Merge pull request !24839 from JoyLvliang/ut_run_failed_in_pynative_mode
2021-10-14 06:15:28 +00:00
i-robot 65f08a6c4c !24804 parallel ut modify
Merge pull request !24804 from yao_yf/parallel_ut_modify
2021-10-14 01:24:12 +00:00
i-robot 470de9bcaa !21258 [assistant][ops]New operator implementation, include ApplyKerasMomentumD
Merge pull request !21258 from 梁秀波/ApplyKerasMomentumD
2021-10-14 01:05:23 +00:00
7347157+joylvliang@user.noreply.gitee.com aecbdf3c3b ut_run_failed_in_pynative_mode 2021-10-13 18:46:27 +08:00
i-robot 1b9b85bbb2 !17851 [assistant][ops]New operator implementation, include FakeImageDataset
Merge pull request !17851 from 张璇/fakeimage_dataset
2021-10-13 09:22:55 +00:00
yao_yf 636f82a466 parallel ut modify 2021-10-13 14:28:13 +08:00
zhuyuxiao 1907246931 change api 2021-10-13 10:28:30 +08:00
i-robot 3fd94000c5 !24568 Apply batch parallel in auto_parallel mode when strategies are not specified
Merge pull request !24568 from zhuyuxiao/master
2021-10-13 01:20:15 +00:00
i-robot 18e632c7a1 !21216 [MS][crowdfunding]New operator implementation, include Overdirve
Merge pull request !21216 from Wangsong95/overdrive
2021-10-13 01:08:36 +00:00
G-Dragon-Liu d2f22a8726 [feat][assistant][I3J6V3] add new data operator FakeImage 2021-10-12 14:00:43 +00:00
zx 9b7d7be65c [feat][assistant][I3J6UU] add new audio operator Overdrive 2021-10-12 18:10:31 +08:00
zhuyuxiao cf76c76745 apply batch parallel in auto_parallel mode when strategies are not specified 2021-10-12 15:44:10 +08:00
yao_yf b303d6001c parallel ut refactor 2021-10-12 15:18:51 +08:00
huanghui 1af32f74f9 support None argument for the outermost net 2021-10-11 16:00:57 +08:00
i-robot b9c2a84d3b !17812 [assistant][ops] Add a new audio operator Flanger
Merge pull request !17812 from 杨旭华/Flanger
2021-10-09 08:15:33 +00:00
li-qiyao 2283442855 [feat][assistant][I3J6U9] add new data operator Flanger 2021-10-08 05:03:31 -07:00
i-robot ea53466848 !24490 Extend the completeness of the mindspore static graph mode, so that the filter function is supported in the construct function
Merge pull request !24490 from 卢逸飞/MindSpore/master
2021-10-08 10:35:29 +00:00
i-robot 8598d08351 !17820 [assistant][ops]New operator implementation, include EMnistDataset
Merge pull request !17820 from 张璇/emnist_dataset
2021-10-08 07:18:31 +00:00
i-robot 02f9e3e077 !17805 [assistant][ops] Add new audio operator DetectPitchFrequency
Merge pull request !17805 from 杨旭华/DetectPitchFrequency
2021-10-08 03:34:46 +00:00
G-Dragon-Liu 32baa520bf [feat][assistant][I3J6V2] add new data operator EMnist 2021-10-08 02:53:00 +00:00
John Tzanakakis 7e7b444c63 remove verbose option from DbgServices 2021-10-06 11:38:05 -04:00
Lu 9f68d43c32 Construct supports the filter function. 2021-09-30 15:18:05 +08:00
i-robot dddea1803d !24361 context api 0928
Merge pull request !24361 from mindspore_ding/context_master_0928
2021-09-30 06:45:28 +00:00
dingpeifei 89f9d0f263 api context 0927 2021-09-29 23:15:36 +08:00
Zhang Lian b7e6520e62 [feat] [assistant] [I3J6U8] Add a new audio operator DetectPitchFrequency 2021-09-29 15:12:58 +08:00
despicablemme 75ade61acf [feat] [assistant] [I40GGE] add new Ascend operator CeLU 2021-09-28 14:58:25 +08:00
i-robot 2cacf9cdc2 !24231 fix security wrap and code check
Merge pull request !24231 from jiangshuqiang/fix_code_check_master
2021-09-28 06:45:19 +00:00
i-robot 2085ab1774 !22831 [assistant][ops]add math ops Ger
Merge pull request !22831 from yangwm/ger
2021-09-28 06:27:35 +00:00
jiangshuqiang 13fc005562 fix security wrap 2021-09-28 11:59:45 +08:00
i-robot dd544a9693 !21406 [MS][crowdfunding]New operator implementation, include TrebleBiquad
Merge pull request !21406 from 张璇/treble_biquad
2021-09-27 14:18:00 +00:00
i-robot f16c003dfa !22610 [MS][crowdfunding]New operator implementation, RandomAdjustSharpness
Merge pull request !22610 from yangwm/sharpness
2021-09-27 09:20:05 +00:00
zorax 6098c1da5e [feat][assistant][I40FFO] add new Ascend operator ApplyKerasMomentum 2021-09-27 16:49:18 +08:00
zx 3da0f0f487 [feat][assistant][I3J6V0] add new audio operator TrebleBiquad 2021-09-27 13:01:26 +08:00
despicablemme d072a4e4bf [feat] [assistant] [I40GZE] add new data operator RandomAdjustSharpness 2021-09-27 11:19:33 +08:00
i-robot ab567574c4 !21451 [MS][crowdfunding]New operator implementation, include RiaaBiquad
Merge pull request !21451 from 张璇/riaa_biquad
2021-09-27 03:14:16 +00:00
i-robot 2969688382 !20047 [assistant][ops]New operator implementation, include QmnistDataset
Merge pull request !20047 from Wangsong95/qmnist_dataset
2021-09-27 01:36:08 +00:00
despicablemme 84337078b1 [feat] [assistant] [I40GGM] add new ascend operator Ger 2021-09-27 09:28:05 +08:00