Commit Graph

3391 Commits

Author SHA1 Message Date
zhangzhaoju a54d1f33e7 Add input type check for instance Create in Cell.construct
Adjust the order of resource release sequence

Save executor_info to cache after compile avoiding inconsistent between
python cache and c++ cache

Clean entire_costgraph at ClearResAtExit to avoid coredump.
2022-01-11 10:17:39 +08:00
simson 0191832a1d fix greater op infervalue 2022-01-11 09:21:48 +08:00
yangzhenzhang e5df74e9e4 compute top bottom overlap for conv2d 2022-01-10 16:15:04 +08:00
jiangzhenguang d895eadd7b fix softmaxcrossentropywithlogits infer 2022-01-06 20:44:11 +08:00
Margaret_wangrui 7d1f3d71ba Optimize error message 2022-01-06 20:32:08 +08:00
i-robot 0823ec3e9a
!28535 Modify Error Info
Merge pull request !28535 from liuyang/ms_error
2022-01-06 08:45:12 +00:00
i-robot d7c41f3f5f
!28553 [Fallback] Deal with constants such as np.pi
Merge pull request !28553 from huangbingjian/attr_const
2022-01-06 07:13:24 +00:00
liuyang_655 15a153a40d Modify error info 2022-01-06 01:28:53 -05:00
huangbingjian 45e8b52f6e [Fallback] Do not interpret constant from third-partiy library. 2022-01-06 09:42:54 +08:00
i-robot b073af4b5d
!28559 [MD][Offload] Added dimension check to required Offload ops.
Merge pull request !28559 from alashkari/offload-fix
2022-01-05 07:38:31 +00:00
i-robot a1720c210d
!22348 [assistant][ops] Add new loader EnWik9Dataset
Merge pull request !22348 from 杨旭华/EnWik9Dataset
2022-01-05 07:36:48 +00:00
i-robot ec485cb436
!28307 convert EnvSetItem/EnvGetItem to primitive EnvironSet/EnvironGet
Merge pull request !28307 from xychow/EnvGetItem-conversion
2022-01-05 07:10:30 +00:00
Rescue fac68dbb46 Added dimension check to required Offload ops. 2022-01-05 04:26:31 +00:00
i-robot de030c8d41
!28204 Improved HwcToChw support multi-channel input.
Merge pull request !28204 from unseenme/mindcon_coding_hwc2chw
2022-01-04 11:50:04 +00:00
unseenme 755cb0adfa Improved HwcToChw support multi-channel input. 2022-01-04 15:47:04 +09:00
Eden 63ab65e3a4 [feat] [assistant] [#I40GYF] add new loader EnWik9Dataset 2022-01-03 21:45:43 -08:00
zhousiyi 19e9571149 rename env_getitem/setitem to EnvironGet/EnvironGet 2022-01-04 02:17:30 +00:00
i-robot dba67422f9 !28384 [Fallback] Support the use of self
Merge pull request !28384 from huangbingjian/fallback_self
2021-12-31 09:26:03 +00:00
i-robot e8b4e34f02 !28352 Optimize the exception message while the return number of brop is wrong
Merge pull request !28352 from zhangzhaoju/master_I4NX1K
2021-12-31 08:17:18 +00:00
i-robot 03b4829b86 !28431 [Auto parallel] MoE Changes
Merge pull request !28431 from Xiaoda/122-moe-changes
2021-12-31 08:06:45 +00:00
zhangzhaoju 1950b6a823 Optimize the exception message while the return number of brop is wrong
Fix:I4OQM9 Bprop out check message optimize
2021-12-31 15:01:57 +08:00
vddong 7449b8364b [feat][assistant][I40GYQ] add new dataset operator WIDERFace 2021-12-31 13:49:47 +08:00
huangbingjian 58bafb539a [Fallback] Support self attr/method. 2021-12-31 10:57:41 +08:00
Xiaoda Zhang 6d8320fa66 1) fix the exact division in moe;
2) changing CumSum from composition to a single Operator;
3) add InferMirrorOps for CumSumInfo.
2021-12-30 19:20:05 +08:00
jingyangxiang a7f8b3af1c [feat][assistant][ops]New operator implementation, include IMDBDataset
Signed-off-by: zjuter0126 <977180923@qq.com>
2021-12-30 11:16:23 +08:00
zjuter0126 3c2ca41886 [feat][assistant][ops] add new data operator WikiTextDataset 2021-12-29 18:54:54 +08:00
i-robot 17b3e3cd13 !28267 Resuse ConvertData of GenerateArgumentsKey
Merge pull request !28267 from zhangzhaoju/master_res_base
2021-12-29 08:20:10 +00:00
i-robot ae1278fa42 !28074 convert execute mode to graph mode when loading mindir
Merge pull request !28074 from lianliguang/master
2021-12-29 06:23:57 +00:00
i-robot ac9e545dc8 !22546 add new dataset loading operator CaltechDataset
Merge pull request !22546 from 杨旭华/CaltechDataset
2021-12-29 03:40:06 +00:00
zhangzhaoju c5b2996b3f Resuse ConvertData of GenerateArgumentsKey 2021-12-29 10:30:17 +08:00
lianliguang d5efef0ae6 convert pynative mode to graph mode when loading mindir 2021-12-29 09:46:08 +08:00
donrichnx 9a0fc0ffc1 [feat] [assistant] [I40GYH] add new dataset loading operator CaltechDataset 2021-12-28 19:04:18 +08:00
Xiaoda Zhang 1bdb610b34 changing default value of single-loop flag 2021-12-28 17:56:30 +08:00
i-robot 67e843ec7f !27487 [assistant] [ops][SpectralCentroid]
Merge pull request !27487 from 杨旭华/SpectralCentroidOp
2021-12-28 09:10:32 +00:00
i-robot 7faf774063 !22310 [assistant][ops] Add new loader SemeionDataset
Merge pull request !22310 from 杨旭华/SemeionDataset
2021-12-28 03:13:02 +00:00
i-robot bff8d6ae01 !28247 Fix Python Vocab validation
Merge pull request !28247 from luoyang/vocab
2021-12-28 02:58:25 +00:00
luqilin 896f10d6d5 [feat][assistant][I40GYK] add new dataset loading operator SemeionDataset 2021-12-27 19:49:06 +08:00
tongyue 9a1dcd60fc [fix] [assistant] [I40GXI] fix bug in the infer function of the operator SpectralCentroid 2021-12-27 01:41:31 -08:00
i-robot 69a6c7db98 !23380 [assistant][ops] Add new loader AmazonReview
Merge pull request !23380 from 杨旭华/AmazonReview
2021-12-27 09:36:32 +00:00
luoyang ca3de66559 Fix Python Vocab validation 2021-12-27 17:12:07 +08:00
i-robot c13f31861c !26398 [feat] [assistant] [I48OBC] add new LogicalNot
Merge pull request !26398 from 桂胜楠/logicalnot
2021-12-27 02:54:53 +00:00
i-robot eb7a78a998 !28134 Python Vocab refactoring and add ids_to_tokens & tokens_to_ids
Merge pull request !28134 from luoyang/vocab
2021-12-25 06:39:41 +00:00
i-robot dd90a56d68 !28073 fix code warning && remove save_graphs use in st/ut
Merge pull request !28073 from huanghui/fix-warning
2021-12-24 09:29:25 +00:00
i-robot 170e6ad857 !28052 modify profiler ai_cpu ut and st
Merge pull request !28052 from zangqx/zangqx_04
2021-12-24 08:14:25 +00:00
i-robot 22c25ec10e !27862 [Auto parallel] [Sharding propagation] dealing with cast
Merge pull request !27862 from Xiaoda/119-adapting-sharding-propagation
2021-12-24 07:33:47 +00:00
luoyang 0288480722 Python Vocab refactoring and add ids_to_tokens & tokens_to_ids 2021-12-24 15:26:15 +08:00
huanghui 74ca50e652 fix code warning && remove save_graphs use in st/ut 2021-12-24 14:45:37 +08:00
zheng_pengfei 09b5e545dd [feat] [assistant] [I48OBC] add new LogicalNot 2021-12-23 20:39:17 +08:00
臧庆香 fcd3fface0 modify profiler ai_cpu ut and st 2021-12-23 20:10:28 +08:00
Xiaoda Zhang 66c7474e5a remove CastInfo from CNODE 2021-12-23 19:05:02 +08:00
i-robot f9270b8e09 !28069 change API:cell.shard
Merge pull request !28069 from zhuyuxiao/I4LE9J
2021-12-23 10:58:43 +00:00
chengchuanxing 07aa66ee43 [feat][assistant][I40GY2] add new loader AmazonReview 2021-12-23 16:32:31 +08:00
i-robot 1ea8693c83 !27356 dataset: check whether operator in nn or ops is mixed into operations
Merge pull request !27356 from ms_yan/operator_mixed
2021-12-23 07:04:52 +00:00
i-robot 3b6c40ff1e !28028 [ME] Optimize the error message of the operator module.
Merge pull request !28028 from Margaret_wangrui/operator
2021-12-23 06:48:00 +00:00
zhuyuxiao dd7bbf92dd change API 2021-12-23 14:26:06 +08:00
i-robot 91434597c3 !25861 [assistant][ops]New operator implementation, include BesselI0 and BesselI1
Merge pull request !25861 from 张璇/BesselI0
2021-12-23 02:41:41 +00:00
ms_yan 192983b5da check operator mixed or not 2021-12-23 10:22:03 +08:00
Margaret_wangrui 38ddd04c83 [ME] Optimize the error message of the operator module. 2021-12-23 10:10:48 +08:00
lilei 017aa359a6 insert VirtualDataset node for master 2021-12-23 09:25:05 +08:00
zx e0a7a87a9c [feat][assistant][I4CRK5] add new Ascend operator BesselI0 and BesselI1 2021-12-22 16:19:28 +08:00
gaocongli b9187f96da parsing the profiling data on ai cpu in binary 2021-12-22 11:59:47 +08:00
i-robot 14df5d3984 !23670 [assistant][ops] add new dataset loading operator CoNLL2000ChunkingDataset
Merge pull request !23670 from 杨旭华/CoNLL2000ChunkingDataset
2021-12-22 01:50:12 +00:00
i-robot b1de53fac2 !27728 [Fallback] Support numpy augassign method, subscript method and binary operations
Merge pull request !27728 from huangbingjian/fallback_parse
2021-12-22 01:01:46 +00:00
i-robot 372065c821 !26325 [assistant][ops] add Addcdiv and Addcmul
Merge pull request !26325 from 孟权令/Addcdiv
2021-12-21 12:46:21 +00:00
i-robot 2fbec9a554 !27856 use neighbor-exchange-v2 for conv2d
Merge pull request !27856 from yangzhenzhang/use-neighborexchangev2-for-conv2d
2021-12-21 10:59:54 +00:00
i-robot bc235730ca !27957 parallel_ut_refactoring
Merge pull request !27957 from 王志伟/parallel_ut_refactoring2
2021-12-21 08:02:16 +00:00
huangbingjian fea6974c80 Support numpy augassign method, subscript method and binary operations. 2021-12-21 15:58:20 +08:00
fattycat 289a7997df [feat] [assistant] [#I40GYB] add new loader CoNLL2000ChunkingDataset 2021-12-21 15:31:25 +08:00
Sawyer 564d83c959 [feat][assistant][I3T921][I3T923] add Addcdiv and Addcmul 2021-12-21 14:56:04 +08:00
i-robot cfdae8e0fc !27925 [ME] Optimize the error message of the operator module.
Merge pull request !27925 from Margaret_wangrui/operator
2021-12-21 06:54:30 +00:00
yangzhenzhang 8a68577756 use neighbor-exchange-v2 for conv2d 2021-12-21 14:27:41 +08:00
wzw a9b78682d5 parallel ut refactor 3 2021-12-21 14:26:58 +08:00
i-robot f007b8a99f !27745 [MD][Offload] Move offload checks and split to the C pipeline
Merge pull request !27745 from markuskunej/offload_column_pipeline
2021-12-21 04:26:51 +00:00
Margaret_wangrui f9a88a01bc [ME] Optimize the error message of the operator module 2021-12-21 10:19:25 +08:00
i-robot 7331629ceb !22686 [assistant][ops][Dither]
Merge pull request !22686 from Isaac/Dither
2021-12-20 11:16:20 +00:00
i-robot 76aaf62088 !27860 The profiler framework data is changed to binary data
Merge pull request !27860 from helloiSCSI/data_reduce
2021-12-20 07:47:49 +00:00
i-robot 953920112c !22553 [assistant][ops] Add new loader UDPOSDataset
Merge pull request !22553 from 杨旭华/UDPOSDataset
2021-12-20 06:54:54 +00:00
i-robot cc3c980a07 !27874 Real、conj、imag 接口支持实数输入
Merge pull request !27874 from zhouyaqiang0/master
2021-12-20 03:53:16 +00:00
helloiSCSI 115ec28ea0 Profiler save framework data as binary data
1. Reconstructing the profiler data reporting module
2. Rewrite the write framework data module, Detail: add a new profiler_reporter file to report binnary data, and delele all the old
profiler reporter diretcory.
3. Rewrite the parse framework data module
4. Fix the framework module ut and st
2021-12-20 11:06:53 +08:00
i-robot f1b26ea205 !21339 [assistant][ops]New operator implementation, include SparseApplyAdadeltaD
Merge pull request !21339 from 梁秀波/SparseApplyAdadeltaD
2021-12-20 01:34:10 +00:00
zhouyaqiang a6b48e003d Adapt Real input of ops real imag conj 2021-12-19 17:26:09 +08:00
haohaonannan97 f480be7c48 [feat][assistant][I40GXF] add new data operator Dither 2021-12-18 08:24:48 -08:00
王天浩 11cb3e4ef7 [fear][assistant][I40GYA] add new loader UDPOSDataset 2021-12-18 23:28:05 +08:00
wild-fox 452dbd4551 [feat][assistant][I40FFU] add new Ascend operator SparseApplyAdadelta 2021-12-18 17:56:51 +08:00
zorax 031c792cf6 [assistant][ops]New operator implementation, include ApplyAdamWithAmsgradD 2021-12-18 16:52:47 +08:00
i-robot 87c7fc13bb !23042 [assistant][ops]New operator implementation, include NonMaxSuppressionV3
Merge pull request !23042 from 梁秀波/NonMaxSuppressionV3
2021-12-18 06:51:51 +00:00
i-robot 57bbfe6453 !27741 Add test util function to write object into json
Merge pull request !27741 from sabrinasun_59ee/test
2021-12-18 03:00:53 +00:00
sabrinasun 2fa9399231 add test function to write object to json 2021-12-17 16:11:05 -05:00
markuskunej 0c10f52eb4 Moved the offload operation check and map operation split from python (datasets.py) to c++ (NodeOffloadPass.cc).
Updated check for offload in python (dataset_helper.py and
iterators.py).

Updated auto_offload test in test_map_offload.py.

Changed MapNode.offload type from bool->int in bindings.cc.

Changed manual offload flag from int->enum.

Update offload end of pipeline detection to be column-specific.
2021-12-17 14:35:17 +00:00
i-robot 457d953565 !22471 [assistant][ops]New operator implementation, include IsClose
Merge pull request !22471 from 梁秀波/IsClose
2021-12-17 11:55:37 +00:00
韩峥嵘 efe0fce473 [feat][assistant][I40FG0] add new Ascend operator NonMaxSuppression 2021-12-17 17:08:39 +08:00
i-robot 9b27295d1e !27544 fixed st and landscape bugs
Merge pull request !27544 from Songyuanwei/test
2021-12-17 08:14:23 +00:00
i-robot 96b2dce300 !22248 [assistant][ops] Add new loader operator YahooAnswers
Merge pull request !22248 from 杨旭华/YahooAnswers
2021-12-17 06:40:13 +00:00
i-robot 3121a317ec !27775 Fix Slice node's location incorrect
Merge pull request !27775 from huanghui/fix-Slice-no-location
2021-12-17 06:35:26 +00:00
韩峥嵘 43a495f3fd [feat][assistant][I40FG5] add new Ascend operator IsClose 2021-12-17 12:03:38 +08:00
Carry955 2320bb7c70 [feat][assistant][I40GXW] add new loader YahooAnswers 2021-12-16 18:33:47 -08:00
i-robot a618bb8ab5 !26949 save dataset into mindir - phase 2
Merge pull request !26949 from luoyang/mindir-stage2-2
2021-12-17 01:14:39 +00:00
i-robot d1dbdeffcb !27684 Update Python UT removal of generated files
Merge pull request !27684 from zetongzhao/update_python_remove
2021-12-17 01:09:17 +00:00
zetongzhao 7cb6989efd replace python removal with pytest tmp_path 2021-12-16 14:38:49 -05:00
i-robot 2bf244cd66 !27757 Support variable index of getitem during handling cell list getattr.
Merge pull request !27757 from 张清华/opt_cell_list_getattr2
2021-12-16 18:13:36 +00:00