Commit Graph

934 Commits

Author SHA1 Message Date
xiefangqi bae1dd3bb0 Revert "Moved the offload operation check and map operation split from python (datasets.py) to c++ (NodeOffloadPass.cc)."
This reverts commit 84d38e547a.
2021-12-08 16:39:10 +08:00
i-robot 895256f69a !20043 [assistant][ops] Add new YelpReview
Merge pull request !20043 from 杨旭华/YelpReview
2021-12-08 08:13:34 +00:00
i-robot 75e35bded2 !27081 [MD][Offload] Move offload checks and split to the C pipeline
Merge pull request !27081 from markuskunej/move_offload_check_to_c
2021-12-07 15:55:16 +00:00
lufei9026 2947f418b1 [feat][assistant][I3T96N]add new loader YelpReview 2021-12-07 17:09:41 +08:00
i-robot 7a8e35b4f1 !26456 [assistant][ops]Add new operator Spectrogram
Merge pull request !26456 from YJfuel123/Spectrogram
2021-12-07 06:39:01 +00:00
RainWang6188 c4063f0f11 [feat][assistant][I3J6VI] add new data operator STL10 2021-12-07 01:21:11 +00:00
i-robot b1eae16a05 !22304 [assistant][ops]New operator implementation, include SVHNDataset
Merge pull request !22304 from 王睿/svhn_dataset
2021-12-06 12:30:13 +00:00
郑昊 4ae41350a6 [feat][assistant][I3ALD1] add new method Spectrogram 2021-12-06 19:24:37 +08:00
zhangyuqwer e934381b08 [feat][assistant][I3ZSQV] add new data operator CharNGram 2021-12-04 22:09:34 +08:00
RainWang6188 340b3b4d5d [feat][assistant][I3J6VJ] add new data operator SVHN 2021-12-04 08:19:47 +00:00
mohammad af6e587c28 MD Profiler: support multiple start/stop calls 2021-12-03 23:25:38 -05:00
danishfarid faaa5d5f0a autotune step
fix testing script default

updates and changed sampling function

comments addressed

comments addressed

comments addressed

moving isSinkCheckAbove

update - move CheckSinkFunction

fix
2021-12-03 20:29:35 +00:00
markuskunej 84d38e547a Moved the offload operation check and map operation split from python (datasets.py) to c++ (NodeOffloadPass.cc).
Updated check for offload in python (dataset_helper.py and
iterators.py).

Updated auto_offload test in test_map_offload.py.

Changed MapNode.offload type from bool->int in bindings.cc.

Changed manual offload flag from int->enum.
2021-12-03 14:40:01 +00:00
luoyang f3e1794a74 update log 2021-12-03 15:09:36 +08:00
i-robot 93db7f741f !20788 [assistant][ops] Add new dataset loading operator TedliumDataset
Merge pull request !20788 from 杨旭华/TedliumDataset
2021-12-03 06:29:29 +00:00
i-robot 9cec03e3a8 !27033 close autotune in non-sink mode
Merge pull request !27033 from luoyang/close_autotune_nonsink
2021-12-03 01:26:06 +00:00
luoyang 9cbb45bcc4 close autotune in non-sink mode 2021-12-03 08:46:14 +08:00
i-robot 9ddd3fb66f !27085 [MD][UT]: Use pytest.mark.forked for profiling tests
Merge pull request !27085 from cathwong/ckw_ut_prof_forked
2021-12-02 17:00:28 +00:00
Cathy Wong 367e5ed1dd MD UT: Use pytest.mark.forked for profiling tests 2021-12-02 10:55:05 -05:00
i-robot fa457b2bfa !17832 [assistant][ops]New operator implementation, include KMnistDataset
Merge pull request !17832 from 张璇/kmnist_dataset
2021-12-02 14:00:36 +00:00
i-robot 3e73e124ac !23225 [assistant][ops] Add Glove
Merge pull request !23225 from 张渝/Glove
2021-12-02 12:22:17 +00:00
i-robot eab0699c6d !26986 change MD error log
Merge pull request !26986 from shenwei41/master
2021-12-02 11:35:07 +00:00
i-robot 53f50c0d6b !26880 [MD] fix mindrecord log message part02
Merge pull request !26880 from liyong126/fix_mindrecord_log_msg_2
2021-12-02 06:48:15 +00:00
i-robot 3bff079969 !26896 Enhance error message of audio ops
Merge pull request !26896 from xiaotianci/enhance_audio_err_message
2021-12-02 03:42:35 +00:00
liyong d35e003def fix mindrecord log part02 2021-12-02 11:28:58 +08:00
luqilin 34bffbf768 [feat][assistant][I3T96H] add new dataset loading operator TedliumDataset 2021-12-02 09:53:39 +08:00
zy 8f9a09f79c [fix] [assistant] [I3ZSQR] add new data operator GloVe 2021-12-01 17:12:20 +08:00
shenwei41 5d48409395 change err info 2021-12-01 16:48:14 +08:00
i-robot 6924866a87 !26746 [MD] minddata error msg optimize
Merge pull request !26746 from xiefangqi/md_datasetops_error_msg_opt
2021-12-01 07:18:18 +00:00
zy 5ca98a494a [fix] [assistant] [I3ZSQS] add new data operator FastText 2021-12-01 11:12:08 +08:00
“uccInf” 92d6d31750 [feat][assistant][I3J6V7] add new data operator KMnist 2021-12-01 03:05:05 +00:00
i-robot eb9537af11 !21690 [assistant][ops] Add data operator Vectors
Merge pull request !21690 from 张渝/Vectors
2021-12-01 01:29:45 +00:00
Xiao Tianci b883498c93 enhance error message of audio ops 2021-12-01 09:27:04 +08:00
i-robot 1905b228b4 !26609 Update minddata log message
Merge pull request !26609 from luoyang/log
2021-12-01 01:25:11 +00:00
i-robot bf59d75604 !26611 [MD] fix mindrecord log message part01
Merge pull request !26611 from liyong126/fix_mindrecord_log_msg
2021-12-01 01:12:48 +00:00
xiefangqi f74b5cea0c optimize datasetops error msg 2021-12-01 09:11:22 +08:00
i-robot 2fd00935ed !20964 [assistant][ops] Add new data operator SpeechCommandsDataset
Merge pull request !20964 from 杨旭华/SpeechCommandsDataset
2021-11-30 09:33:03 +00:00
luoyang 1a6a42c083 Update minddata log message 2021-11-30 15:22:40 +08:00
zhangyuqwer 6a6e73ef82 [fix] [assistant] [I3ZSQM] add new data operator Vectors 2021-11-30 14:39:42 +08:00
liyong 2869352cc8 fix mindrecord log part01 2021-11-30 10:57:58 +08:00
vddong 91d3a7543f [feat][assistant][I3T96F] add new data operator SpeechCommands 2021-11-27 11:25:18 +08:00
i-robot d8fbc26419 !26700 [MD][Profiler][Autotune] Add test, logs, clean state
Merge pull request !26700 from harshvardhangupta/add_test_at_prof
2021-11-25 19:38:33 +00:00
harshvardhangupta 02f4a8068b add tests, clean states, print proper warn logs 2021-11-25 00:03:38 -05:00
jonyguo 58c9112c2e fix: generator dataset with source zip 2021-11-25 11:32:28 +08:00
i-robot 4f34c32c6d !26235 AutoTune v1
Merge pull request !26235 from danishfarid/autotune
2021-11-19 23:40:40 +00:00
Rescue da986710f0 Updated concat-zip check and UT. 2021-11-19 17:38:16 +00:00
hesham 40797c40da AutoTune 2021-11-19 09:27:12 -05:00
i-robot 70363899e7 !24080 [assistant][ops] Add new audio operator ComputeDeltas
Merge pull request !24080 from Rainfor/compute_detlas
2021-11-19 12:29:49 +00:00
i-robot c6821bde0a !21648 [assistant][ops] Add new data loading operator YesNoDataset
Merge pull request !21648 from 杨旭华/YesNoDataset
2021-11-19 09:05:07 +00:00
vddong f465cd0242 [feat][assistant][I3T96L]add new dataset operator YesNo 2021-11-19 13:36:24 +08:00