Commit Graph

3187 Commits

Author SHA1 Message Date
xiefangqi bae1dd3bb0 Revert "Moved the offload operation check and map operation split from python (datasets.py) to c++ (NodeOffloadPass.cc)."
This reverts commit 84d38e547a.
2021-12-08 16:39:10 +08:00
i-robot 895256f69a !20043 [assistant][ops] Add new YelpReview
Merge pull request !20043 from 杨旭华/YelpReview
2021-12-08 08:13:34 +00:00
i-robot 75e35bded2 !27081 [MD][Offload] Move offload checks and split to the C pipeline
Merge pull request !27081 from markuskunej/move_offload_check_to_c
2021-12-07 15:55:16 +00:00
i-robot b80ed801d5 !27335 change log level for read not exist tensors
Merge pull request !27335 from yelihua/dev
2021-12-07 13:08:20 +00:00
lufei9026 2947f418b1 [feat][assistant][I3T96N]add new loader YelpReview 2021-12-07 17:09:41 +08:00
i-robot ffca7b08a5 !27237 auto insert VirtualDataset node for master
Merge pull request !27237 from lilei/modify_virtualdataset_for_master
2021-12-07 09:02:50 +00:00
i-robot 25ae2d620b !27271 modify c++ msg & conv2d
Merge pull request !27271 from huchunmei/master
2021-12-07 07:56:21 +00:00
yelihua 01823faed0 change error level to info as dir not exist is normal case 2021-12-07 15:27:37 +08:00
i-robot 7a8e35b4f1 !26456 [assistant][ops]Add new operator Spectrogram
Merge pull request !26456 from YJfuel123/Spectrogram
2021-12-07 06:39:01 +00:00
i-robot 3d0f8fcc99 !22552 [assistant][ops]New operator implementation, include STL10Dataset
Merge pull request !22552 from 王睿/stl10_dataset
2021-12-07 06:37:04 +00:00
i-robot 59184541c3 !27140 fix sync GraphCell params data from device bug
Merge pull request !27140 from zhangbuxue/fix_sync_GraphCell_params_data_from_device_bug
2021-12-07 04:33:21 +00:00
huchunmei 1023c7a5e2 modify c++ msg 2021-12-07 11:20:12 +08:00
i-robot f40668ef73 !27251 test_micro_batch_Interleaved
Merge pull request !27251 from lilei/add_parallel_ut
2021-12-07 02:18:09 +00:00
i-robot 9b2f4141c9 !27302 add summart ops params valid check ut
Merge pull request !27302 from helloiSCSI/add_st
2021-12-07 01:56:52 +00:00
RainWang6188 c4063f0f11 [feat][assistant][I3J6VI] add new data operator STL10 2021-12-07 01:21:11 +00:00
buxue d7dc539b6e fix sync GraphCell params data from device bug 2021-12-07 09:20:46 +08:00
i-robot d723cc417d !27151 [ME][Fallback] [ME][Fallback] Support built-in type: complex and reversed.
Merge pull request !27151 from Margaret_wangrui/fallback
2021-12-07 01:04:14 +00:00
i-robot 8bcd6e3a86 !27287 [ME][Fallback] Handle interpret nodes in list.
Merge pull request !27287 from Margaret_wangrui/list_interpret
2021-12-07 01:02:12 +00:00
i-robot d1aa8d6cb5 !26995 fix:unexpected eiminate of tile
Merge pull request !26995 from zhangzhaoju/master_bug_fix
2021-12-07 00:58:44 +00:00
lilei 05189459ab auto insert VirtualDataset node for master 2021-12-06 21:39:37 +08:00
Margaret_wangrui 6e5d625153 [ME][Fallback] Support built-in type: complex and reversed. 2021-12-06 21:15:30 +08:00
i-robot b1eae16a05 !22304 [assistant][ops]New operator implementation, include SVHNDataset
Merge pull request !22304 from 王睿/svhn_dataset
2021-12-06 12:30:13 +00:00
helloiSCSI 7cb5ed7676 add summart ops params valid check ut 2021-12-06 20:11:27 +08:00
郑昊 4ae41350a6 [feat][assistant][I3ALD1] add new method Spectrogram 2021-12-06 19:24:37 +08:00
lilei e933aa268b test_micro_batch_Interleaved 2021-12-06 18:37:21 +08:00
Margaret_wangrui fa8506c0a7 [ME][Fallback] Handle interpret nodes in list. 2021-12-06 16:58:21 +08:00
zhangzhaoju 722086435d 1. fix:unexpected eiminate of tile
2. fix:delay memory allocat in NewTensorFilledWithData
2021-12-06 14:49:48 +08:00
i-robot 2d23b698a6 !27024 add allreduce fusion by size
Merge pull request !27024 from jiahongQian/master
2021-12-06 05:32:12 +00:00
q00596439 de36fdc169 add allreduce fusion size and unify the interface 2021-12-05 21:35:11 +08:00
zhangyuqwer e934381b08 [feat][assistant][I3ZSQV] add new data operator CharNGram 2021-12-04 22:09:34 +08:00
RainWang6188 340b3b4d5d [feat][assistant][I3J6VJ] add new data operator SVHN 2021-12-04 08:19:47 +00:00
mohammad af6e587c28 MD Profiler: support multiple start/stop calls 2021-12-03 23:25:38 -05:00
danishfarid faaa5d5f0a autotune step
fix testing script default

updates and changed sampling function

comments addressed

comments addressed

comments addressed

moving isSinkCheckAbove

update - move CheckSinkFunction

fix
2021-12-03 20:29:35 +00:00
markuskunej 84d38e547a Moved the offload operation check and map operation split from python (datasets.py) to c++ (NodeOffloadPass.cc).
Updated check for offload in python (dataset_helper.py and
iterators.py).

Updated auto_offload test in test_map_offload.py.

Changed MapNode.offload type from bool->int in bindings.cc.

Changed manual offload flag from int->enum.
2021-12-03 14:40:01 +00:00
luoyang f3e1794a74 update log 2021-12-03 15:09:36 +08:00
i-robot 93db7f741f !20788 [assistant][ops] Add new dataset loading operator TedliumDataset
Merge pull request !20788 from 杨旭华/TedliumDataset
2021-12-03 06:29:29 +00:00
i-robot 8e4f3472d8 !27154 Enable the test for Parallel Optimizer
Merge pull request !27154 from huangxinjing/enable_gradient_accumulation
2021-12-03 06:23:53 +00:00
i-robot c0048bb117 !26953 Add some bprop mindir files
Merge pull request !26953 from YuJianfeng/bprop_mindir
2021-12-03 03:28:37 +00:00
i-robot 9cec03e3a8 !27033 close autotune in non-sink mode
Merge pull request !27033 from luoyang/close_autotune_nonsink
2021-12-03 01:26:06 +00:00
huangxinjing 8c9b2b93a8 Add transformer 2021-12-03 09:08:57 +08:00
luoyang 9cbb45bcc4 close autotune in non-sink mode 2021-12-03 08:46:14 +08:00
i-robot 9ddd3fb66f !27085 [MD][UT]: Use pytest.mark.forked for profiling tests
Merge pull request !27085 from cathwong/ckw_ut_prof_forked
2021-12-02 17:00:28 +00:00
Cathy Wong 367e5ed1dd MD UT: Use pytest.mark.forked for profiling tests 2021-12-02 10:55:05 -05:00
i-robot eb25c473d0 !27117 [ME][Fallback] Handle interpret nodes in tuple.
Merge pull request !27117 from Margaret_wangrui/tuple_interpret
2021-12-02 14:11:12 +00:00
i-robot fa457b2bfa !17832 [assistant][ops]New operator implementation, include KMnistDataset
Merge pull request !17832 from 张璇/kmnist_dataset
2021-12-02 14:00:36 +00:00
i-robot 3e73e124ac !23225 [assistant][ops] Add Glove
Merge pull request !23225 from 张渝/Glove
2021-12-02 12:22:17 +00:00
i-robot eab0699c6d !26986 change MD error log
Merge pull request !26986 from shenwei41/master
2021-12-02 11:35:07 +00:00
i-robot 7c9dc30e78 !27101 check args for shard
Merge pull request !27101 from yangzhenzhang/fix-bug-for-out-strategy
2021-12-02 08:24:47 +00:00
Margaret_wangrui f7fc7f4238 [ME][Fallback] Handle interpret nodes in tuple 2021-12-02 15:36:54 +08:00
i-robot 53f50c0d6b !26880 [MD] fix mindrecord log message part02
Merge pull request !26880 from liyong126/fix_mindrecord_log_msg_2
2021-12-02 06:48:15 +00:00