Commit Graph

823 Commits

Author SHA1 Message Date
luqilin 34bffbf768 [feat][assistant][I3T96H] add new dataset loading operator TedliumDataset 2021-12-02 09:53:39 +08:00
zy 8f9a09f79c [fix] [assistant] [I3ZSQR] add new data operator GloVe 2021-12-01 17:12:20 +08:00
hesham 828120b784 Fix intermittent failure in callback_test.cc 2021-11-30 22:36:55 -05:00
zy 5ca98a494a [fix] [assistant] [I3ZSQS] add new data operator FastText 2021-12-01 11:12:08 +08:00
“uccInf” 92d6d31750 [feat][assistant][I3J6V7] add new data operator KMnist 2021-12-01 03:05:05 +00:00
i-robot eb9537af11 !21690 [assistant][ops] Add data operator Vectors
Merge pull request !21690 from 张渝/Vectors
2021-12-01 01:29:45 +00:00
i-robot 2fd00935ed !20964 [assistant][ops] Add new data operator SpeechCommandsDataset
Merge pull request !20964 from 杨旭华/SpeechCommandsDataset
2021-11-30 09:33:03 +00:00
zhangyuqwer 6a6e73ef82 [fix] [assistant] [I3ZSQM] add new data operator Vectors 2021-11-30 14:39:42 +08:00
vddong 91d3a7543f [feat][assistant][I3T96F] add new data operator SpeechCommands 2021-11-27 11:25:18 +08:00
i-robot 3520f1427d !26701 MD C++ UT: Remove old tests part 3
Merge pull request !26701 from hetshah/hs_remove_old_tests
2021-11-25 19:29:30 +00:00
hetshah 098ca49dd3 remove instances of datasetiterator from old tests and move coverage to new method 2021-11-25 15:22:34 +00:00
hesham cf3ff77cfd AutoTune support non-sink mode
Add time sts to iterator tracing
2021-11-24 17:51:25 -05:00
i-robot 70363899e7 !24080 [assistant][ops] Add new audio operator ComputeDeltas
Merge pull request !24080 from Rainfor/compute_detlas
2021-11-19 12:29:49 +00:00
i-robot c6821bde0a !21648 [assistant][ops] Add new data loading operator YesNoDataset
Merge pull request !21648 from 杨旭华/YesNoDataset
2021-11-19 09:05:07 +00:00
vddong f465cd0242 [feat][assistant][I3T96L]add new dataset operator YesNo 2021-11-19 13:36:24 +08:00
zhuchuang 4c3931f5c9 [feat] [assistant] [I3CKEE] add new audio operator ComputeDeltas 2021-11-18 17:18:43 +08:00
despicablemme 09897ce7ec [feat] [assistant] [I40GZP] add new data op AutoAugment 2021-11-18 11:38:18 +08:00
wangkc123 706f9e2cbb [feat] [assistant] [I3CKEH] add new audio operator SlidingWindowCmn 2021-11-16 22:00:09 +08:00
i-robot 58b69a05ee !20576 [assistant][ops] add new dataset loading operator LJSpeechDataset
Merge pull request !20576 from 杨旭华/LJSpeechDataset
2021-11-16 07:00:20 +00:00
mohammad 5c8ab5f60c add MD Profiler Save() 2021-11-15 13:18:36 -05:00
vddong 6fe2d35ae2 [feat][assistant][I3T96D] add new dataset loading operator LJSpeechDataset 2021-11-14 14:52:15 +08:00
i-robot 04da5c2808 !26140 Add callback support to BatchOp Datasets to enable Add/Remove workers
Merge pull request !26140 from h.farahat/cb_batch
2021-11-12 17:23:19 +00:00
Carry955 0d26c38693 [feat][assistant][I40GXT] add new loader DBpedia 2021-11-11 19:02:22 -08:00
hesham 2662b6d5c3 Add callback to Batch op 2021-11-11 10:58:01 -05:00
i-robot b910870ecc !19986 [assistant][ops] Add new dataset loading operator AGNEWS
Merge pull request !19986 from 杨旭华/AGNEWS
2021-11-11 06:22:25 +00:00
zetongzhao 2de8142c44 profiler test 2021-11-10 11:55:19 -05:00
Megalomania c34bbabed9 [feat] [assistant] [I3T96M] add new loader AGNEWS 2021-11-09 23:51:19 -08:00
i-robot 2e174427c9 !25963 [MD][Autotune] Add WaitFor
Merge pull request !25963 from harshvardhangupta/hesh_tree_mod
2021-11-09 22:43:00 +00:00
i-robot b7244ac987 !25852 MD C++ UT: Remove old tests part 2
Merge pull request !25852 from hetshah/hs_remove_old_tests
2021-11-09 22:07:59 +00:00
hetshah 5c703015e4 remove old tests and move coverage 2021-11-09 21:27:37 +00:00
hesham 17e338e909 Add WaitFor 2021-11-09 10:19:48 -05:00
hesham 040398a660 Add callback to Mappable ops
Update mindspore/ccsrc/minddata/dataset/engine/datasetops/source/mappable_leaf_op.cc
2021-11-08 20:17:34 -05:00
i-robot 92b81d3221 !23257 [assistant][ops][DBToAmplitudeOp]
Merge pull request !23257 from 杨旭华/DBToAmplitude
2021-11-04 10:32:32 +00:00
liucunwei a86ac516fc add some of ut about dataset IteratorOneColumn 2021-11-03 12:02:00 +08:00
Isaac 69f57bc5b1 [feat][assistant][I40GXD]add new data operator DBToAmplitude 2021-11-02 23:45:27 +08:00
i-robot 1edd91c974 !25329 MD C++ UT: Remove old tests part 1
Merge pull request !25329 from hetshah/hs_remove_old_tests
2021-11-01 19:35:58 +00:00
hesham 62d9004d1e TreeModifier and Remove worker 2021-10-29 17:11:19 -04:00
liucunwei f2813b909e add some of ut cases about createIterator columns 2021-10-28 18:57:02 +08:00
hesham 843357a6d8 Make ProfilingManager a singleton 2021-10-27 11:37:02 -04:00
i-robot 74977e548d !24624 [Autotune] Modify MD callback and AddWorker logic to ParallelOps
Merge pull request !24624 from h.farahat/add_worker
2021-10-27 00:41:20 +00:00
hetshah 1be909c28e removed old tests and moved additonal coverage to new test files 2021-10-26 20:43:49 +00:00
i-robot 5a49db7a36 !25212 Reduce size of queue and test
Merge pull request !25212 from zetongzhao/resize_smaller
2021-10-26 19:36:00 +00:00
zetongzhao 9dad5f1f46 resize to a smaller size 2021-10-25 16:03:57 -04:00
i-robot 782874bf18 !21215 [MS][crowdfunding]New operator implementation, include phaser
Merge pull request !21215 from Wangsong95/phaser
2021-10-22 01:08:50 +00:00
hesham 85e077b60b Callback changes
AddWorker logic to parallel ops
2021-10-21 17:35:11 -04:00
i-robot 5d8be044c9 !18018 [assistant][ops]New operator implementation, include FashionMnistDataset
Merge pull request !18018 from 张璇/fashionmnist_dataset
2021-10-20 06:42:54 +00:00
i-robot f9bd640b09 !16269 [assistant][RandomLighting]
Merge pull request !16269 from QingfengLi/randomlighting
2021-10-20 06:42:12 +00:00
“uccInf” fe3123cfe8 [feat][assistant][I3J6V4] add new data operator FashionMnist 2021-10-20 02:37:56 +00:00
i-robot 440036d331 !24362 [assistant][ops]New operator implementation, include PhotoTourDataset
Merge pull request !24362 from Wangsong95/phototour_dataset
2021-10-20 01:46:05 +00:00
i-robot 4ea7849908 !24575 Resize operator connector queue
Merge pull request !24575 from zetongzhao/master
2021-10-19 20:36:43 +00:00
zetongzhao 10fdbd6c03 resize queue and test 2021-10-19 11:43:53 -04:00
yangyueren 6594b90a58 [feat][assistant][I3J6VE] add new data operator PhotoTour 2021-10-19 15:31:32 +00:00
chenx2ovo 77caf907c4 [feat][assistant][I3CEGR] add op random lighting 2021-10-19 20:38:01 +08:00
i-robot 690642d672 !18664 [assistant][ops]New operator implementation, include Places365Dataset
Merge pull request !18664 from Wangsong95/places365_dataset
2021-10-19 07:06:35 +00:00
i-robot 1606f19dfb !18265 [assistant][ops] Add new audio operator CreateDct
Merge pull request !18265 from 杨旭华/CreateDct
2021-10-19 06:30:18 +00:00
tophand 4f4777f0da [feat][assistant][I3J6U2] Add new audio operator CreateDct 2021-10-18 03:23:18 -07:00
zx d13d2413f5 [feat][assistant][I3J6UV] add new audio operator Phaser 2021-10-16 08:45:12 +08:00
yangyueren 951193c308 [feat][assistant][I3J6VF] add new data operator Places365 2021-10-15 14:56:09 +00:00
robert_luo_yibo 75e2c3041c [feat][assistant][I3CEG3] add new data OP MuLawEncoding 2021-10-14 20:24:18 +08:00
i-robot 1b9b85bbb2 !17851 [assistant][ops]New operator implementation, include FakeImageDataset
Merge pull request !17851 from 张璇/fakeimage_dataset
2021-10-13 09:22:55 +00:00
G-Dragon-Liu d2f22a8726 [feat][assistant][I3J6V3] add new data operator FakeImage 2021-10-12 14:00:43 +00:00
zx 9b7d7be65c [feat][assistant][I3J6UU] add new audio operator Overdrive 2021-10-12 18:10:31 +08:00
li-qiyao 2283442855 [feat][assistant][I3J6U9] add new data operator Flanger 2021-10-08 05:03:31 -07:00
i-robot 8598d08351 !17820 [assistant][ops]New operator implementation, include EMnistDataset
Merge pull request !17820 from 张璇/emnist_dataset
2021-10-08 07:18:31 +00:00
i-robot 02f9e3e077 !17805 [assistant][ops] Add new audio operator DetectPitchFrequency
Merge pull request !17805 from 杨旭华/DetectPitchFrequency
2021-10-08 03:34:46 +00:00
G-Dragon-Liu 32baa520bf [feat][assistant][I3J6V2] add new data operator EMnist 2021-10-08 02:53:00 +00:00
i-robot 55e165c50e !24517 MD Profiling: Move ProfilingManager from ExecutionTree to TreeConsumer
Merge pull request !24517 from cathwong/ckw_prof_mv_to_consumer6
2021-10-06 14:34:24 +00:00
hesham c3718327f2 Stage 1 2021-10-04 23:34:15 -04:00
Cathy Wong 0665a191dc MD Profiling: Move ProfilingManager from ExecutionTree to TreeConsumer 2021-10-04 11:12:02 -04:00
Zhang Lian b7e6520e62 [feat] [assistant] [I3J6U8] Add a new audio operator DetectPitchFrequency 2021-09-29 15:12:58 +08:00
i-robot dd544a9693 !21406 [MS][crowdfunding]New operator implementation, include TrebleBiquad
Merge pull request !21406 from 张璇/treble_biquad
2021-09-27 14:18:00 +00:00
i-robot d1d4797079 !24204 [MD] sync code for code review
Merge pull request !24204 from liyong126/sync_code
2021-09-27 11:16:03 +00:00
i-robot f16c003dfa !22610 [MS][crowdfunding]New operator implementation, RandomAdjustSharpness
Merge pull request !22610 from yangwm/sharpness
2021-09-27 09:20:05 +00:00
liyong 567f137a39 sync code 2021-09-27 14:31:49 +08:00
zx 3da0f0f487 [feat][assistant][I3J6V0] add new audio operator TrebleBiquad 2021-09-27 13:01:26 +08:00
despicablemme d072a4e4bf [feat] [assistant] [I40GZE] add new data operator RandomAdjustSharpness 2021-09-27 11:19:33 +08:00
i-robot ab567574c4 !21451 [MS][crowdfunding]New operator implementation, include RiaaBiquad
Merge pull request !21451 from 张璇/riaa_biquad
2021-09-27 03:14:16 +00:00
i-robot 2969688382 !20047 [assistant][ops]New operator implementation, include QmnistDataset
Merge pull request !20047 from Wangsong95/qmnist_dataset
2021-09-27 01:36:08 +00:00
despicablemme 7063907bdc [feat] [assidtant] [I40GZN] add new data ops RandomEqualize 2021-09-25 18:00:25 +08:00
zx 1d95e6f480 [feat][assistant][I3J6UY] add new audio operator RiaaBiquad 2021-09-23 21:36:59 +08:00
despicablemme 7a6b75c2e8 [feat] [assistant] [I40GZJ] add new data op RandomAutoContrast 2021-09-23 20:17:39 +08:00
despicablemme b977d8723b [feat] [assistant] [I40GZC] add new data ops RandomInvert 2021-09-22 16:55:14 +08:00
ckczzj 001b68c286 [feat][assistant][I3J6VG] add new data operator QMnist 2021-09-22 12:13:27 +08:00
zetongzhao a0c203df23 fix deser python operation error 2021-09-20 14:11:02 -04:00
葛崇林 a05a5de073 [feat][assistant][I3ALC5] add new method Magphase 2021-09-17 16:02:46 +08:00
chenx2ovo 9e62623b4a [feat][assistant][I3CEGI] add op vol 2021-09-17 09:34:20 +08:00
i-robot 4a553c8d57 !16607 [assistant][Fade]
Merge pull request !16607 from QingfengLi/Fade
2021-09-15 14:54:16 +00:00
zetongzhao 860810b9c4 check python interpreter 2021-09-14 16:25:04 -04:00
chenx2ovo 1a3196b052 [feat][assistant][I3CEGF] add op fade 2021-09-14 19:08:37 +08:00
i-robot 32c2b77595 !19093 [assistant][ops] Add new audio operator Biquad
Merge pull request !19093 from 杨旭华/Biquad
2021-09-14 01:52:01 +00:00
i-robot 3e1d1ff4d3 !18671 [assistant][ops]New operator implementation, include SBUDataset
Merge pull request !18671 from Wangsong95/sbu_dataset
2021-09-13 11:56:13 +00:00
liannai 631f49f044 [feat][assistant][I3T96A] Add new audio operator Biquad 2021-09-13 19:18:50 +08:00
Carry955 0ba84345b0 [feat][assistant][I3J6U3] add new audio operator DCShift 2021-09-11 23:58:18 -07:00
Isaac17555 53fc99b914 [feat][assistant][I3T96B]add new data operator LFilter 2021-09-11 02:05:43 -07:00
YJfuel123 16150d394f [feat][assistant][I3ALd1] add new operator EqualizerBiquad 2021-09-11 10:36:20 +08:00
ckczzj af97ba4a77 [feat][assistant][I3J6VH] add new data operator SBU 2021-09-11 09:58:17 +08:00
i-robot cdde54a146 !23202 codedex and pclint warning fix
Merge pull request !23202 from zetongzhao/warn_fix
2021-09-10 20:01:22 +00:00
i-robot 6d709c7254 !19624 [assistant][ops] Add new dataset operator DIV2K.
Merge pull request !19624 from Rainfor/div2k
2021-09-10 14:59:21 +00:00
wangkc123 3daf3a4d5f [feat] [assistant] [I3CKEK] add new dataset operator DIV2K 2021-09-10 17:55:34 +08:00
robert_luo_yibo ce71699734 [feat][assistant][I3CEG5] add new data OP MuLawDecoding 2021-09-10 15:49:46 +08:00
i-robot 32cc5d79b0 !18670 [assistant][ops]New operator implementation, include USPSDataset
Merge pull request !18670 from Wangsong95/usps_dataset
2021-09-10 03:06:19 +00:00
i-robot f91e1440c8 !17810 [assistant][ops][DeemphBiquadOp]
Merge pull request !17810 from Isaac/DeemphBiquad
2021-09-10 03:05:41 +00:00
zetongzhao e2a5dafaf3 warning fix 2021-09-09 15:18:51 -04:00
ckczzj d7c702e9d4 [feat][assistant][I3J6VL] add new data operator USPS 2021-09-09 21:46:57 +08:00
liyong 0959c54ae9 fix bug in random posterize 2021-09-09 19:50:57 +08:00
i-robot 936940da8e !22666 [assistant][ComplexNorm]
Merge pull request !22666 from QingfengLi/ComplexNorm
2021-09-09 06:41:53 +00:00
Isaac 5dc6c7fe96 [feat][assistant][I3J6U6]add new data operator DeemphBiquad 2021-09-09 14:34:24 +08:00
i-robot 9ad56e86ab !17846 [assistant][ops]Add new operator HighpassBiquad
Merge pull request !17846 from YJfuel123/HighpassBiquad
2021-09-09 02:06:41 +00:00
i-robot a918783f1a !22623 Add Random operation with Multi Field
Merge pull request !22623 from shenwei41/operation_dev
2021-09-09 01:49:04 +00:00
shenwei41 a8d02ab782 Add Random operation with MultiField 2021-09-08 19:29:23 +08:00
i-robot 938324b397 !19362 [assistant][ops] Add new dataset operator Cityscapes.
Merge pull request !19362 from Rainfor/cityscapes
2021-09-08 09:14:43 +00:00
yaoyuan 85a1b55b47 [feat] [assistant] [I3ALCL] add new operator HighpassBiquad 2021-09-08 15:12:40 +08:00
Guo Zhijian 4b413922ac fix: code review new 2021-09-08 09:10:54 +08:00
robert_luo_yibo 3d58da9023 [fix][assistant][I47V0O] fix bug about the wrong output in the operator ComplexNorm 2021-09-01 17:55:38 +08:00
wangkc123 70f741bcc1 [feat] [assistant] [I3CKEM] add new dataset operator Cityscapes 2021-08-31 20:03:37 +08:00
tongyue 329526dea8 [feat][assistant][I3J6U0] add new data operator Contrast 2021-08-30 19:34:37 -07:00
i-robot a47ab8d643 !18073 [assistant][ops]Add new operator LowpassBiquad
Merge pull request !18073 from YJfuel123/LowpassBiquad
2021-08-30 08:33:39 +00:00
shenwei41 1295744524 Add ConvertColor Operation 2021-08-26 21:14:28 +08:00
haizhouye d96d9e64b0 [feat] [assistant] [I3ALCA] add new LowpassBiquad operator
[feat] [assistant] [I3ALCA] add new LowpassBiquad operator

bugfix

fix

fix
2021-08-26 18:49:21 +08:00
i-robot ef195c9de6 !21631 Deserialize part4
Merge pull request !21631 from zetongzhao/deserialize_3
2021-08-23 20:09:23 +00:00
zetongzhao b17464e30c deserialize and tests 2021-08-23 14:11:05 -04:00
ms_yan 36a8886ca2 Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset"
This reverts commit b077aa1cab.

Revert "[feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset"

This reverts commit 4e6f7dc97d.

delete pass_registry_test.cc

comment  hiai_nlu_model_multi.pb related  line
2021-08-23 01:46:38 +08:00
djc b077aa1cab [feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset 2021-08-22 16:26:45 +08:00
djc 4e6f7dc97d [feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset 2021-08-22 13:39:37 +08:00
i-robot 0f3de77e93 !21149 Sync MD code clean to master
Merge pull request !21149 from xiefangqi/md_sync_codeclean_master
2021-08-21 06:43:20 +00:00
robert_luo_yibo d837cbee0f [feat][assistant][I3CEG8] add new data operator ComplexNorm 2021-08-20 09:07:21 +08:00
xiefangqi 0e2efc2501 fix minddata code clean 2021-08-19 09:11:30 +08:00
i-robot 1e4dace193 !20683 deserializer 2nd part
Merge pull request !20683 from zetongzhao/deserialize_2
2021-08-17 19:50:43 +00:00
zetongzhao ea1f2d0d7c deserialize and tests 2021-08-16 10:23:36 -04:00
Xiao Tianci aae886bcd7 fix crowd contributing code 2021-08-16 19:33:10 +08:00
liyong c5fefa7523 fix ut bug 2021-08-16 09:15:48 +08:00
chenx2ovo 53615010a3 [feat][assistant][I3CEGG] add new data OP FrequencyMasking 2021-08-12 15:28:30 +08:00
chenx2ovo e72acf362c [feat][assistant][I3CEGH] add op timemasking 2021-08-10 12:06:07 +08:00
i-robot dc626617fc !19526 [assistant][TimeStretch]
Merge pull request !19526 from QingfengLi/TimeStretch
2021-08-09 09:40:38 +00:00
chenx2ovo 04705e5b0d [feat][assistant][I3CEGC] add op timestretch 2021-08-07 22:53:41 +08:00
i-robot c84e09cf45 !21072 Deserialize - python binding
Merge pull request !21072 from zetongzhao/deserialize_1
2021-08-06 21:47:09 +00:00
zetongzhao 4f199b548c deserialize and tests 2021-08-06 13:35:27 -04:00
i-robot 51a1ca61f2 !21357 [MD] fix SlicePatches when dealing with some special tensor.
Merge pull request !21357 from liyong126/fix_bug
2021-08-06 08:58:27 +00:00
liyong 5fea72473c fix HW1 issue 2021-08-06 14:07:26 +08:00
chenx2ovo aa45e2ebbc [feat] [assistant] [I3CEER] add op AmplitudeToDB 2021-08-06 10:07:29 +08:00
Carry955 98be266585 [feat][assistant][I3J6TQ] add a new operator Angle 2021-08-04 19:41:00 -07:00
i-robot 680e40a43a !16453 [assistant][BassBiquadOp]
Merge pull request !16453 from StyleHang/BassBiquadOp
2021-08-04 10:02:34 +00:00
i-robot f4e07c0dce !17486 [assistant][ops] Add new dataset operator Flickr.
Merge pull request !17486 from Rainfor/wangkc
2021-08-04 08:52:21 +00:00
i-robot d260f38936 !15722 [assistant][AdjustGamma]
Merge pull request !15722 from QingfengLi/adjust_gamma
2021-08-04 03:58:09 +00:00
li-qiyao ba326d76a8 [feat][assistant][I3J6TW] add new data operator BassBiquad 2021-08-03 19:40:12 -07:00
wangkc123 48f5fed1f8 [feat] [assistant] [I3CKEN] add new dataset operator Flickr 2021-08-04 10:20:43 +08:00
chenx2ovo 4191dde45f [feat][assistant][I3CEGM] add op adjust gamma 2021-08-04 02:32:13 +08:00
tongyue 08469e113a [feat][assistant][I3J6TV]add new audio operator BandrejectBiquad 2021-08-03 05:41:53 -07:00
administrator 29d57a89fb [feat][assistant][I3TDRD]add new audio operator BandpassBiquad 2021-08-02 07:08:47 -07:00
Isaac b49e1acc3e [feat] [assistant] [I3J6TM] add new audio operator AllpassBiquad 2021-07-31 16:15:17 +08:00