Nigel
/
mindspore
forked from mindspore-Ecosystem/mindspore
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
42,838 Commits 24 Branches 0 Tags 3.9 GiB
Commit Graph

3732 Commits

Author SHA1 Message Date
i-robot ffca7b08a5 !27237 auto insert VirtualDataset node for master 
Merge pull request !27237 from lilei/modify_virtualdataset_for_master
 2021-12-07 09:02:50 +00:00
i-robot 25ae2d620b !27271 modify c++ msg & conv2d 
Merge pull request !27271 from huchunmei/master
 2021-12-07 07:56:21 +00:00
yelihua 01823faed0 change error level to info as dir not exist is normal case 2021-12-07 15:27:37 +08:00
i-robot 7a8e35b4f1 !26456 [assistant][ops]Add new operator Spectrogram 
Merge pull request !26456 from YJfuel123/Spectrogram
 2021-12-07 06:39:01 +00:00
i-robot 3d0f8fcc99 !22552 [assistant][ops]New operator implementation, include STL10Dataset 
Merge pull request !22552 from 王睿/stl10_dataset
 2021-12-07 06:37:04 +00:00
i-robot 59184541c3 !27140 fix sync GraphCell params data from device bug 
Merge pull request !27140 from zhangbuxue/fix_sync_GraphCell_params_data_from_device_bug
 2021-12-07 04:33:21 +00:00
huchunmei 1023c7a5e2 modify c++ msg 2021-12-07 11:20:12 +08:00
i-robot f40668ef73 !27251 test_micro_batch_Interleaved 
Merge pull request !27251 from lilei/add_parallel_ut
 2021-12-07 02:18:09 +00:00
i-robot 9b2f4141c9 !27302 add summart ops params valid check ut 
Merge pull request !27302 from helloiSCSI/add_st
 2021-12-07 01:56:52 +00:00
RainWang6188 c4063f0f11 [feat][assistant][I3J6VI] add new data operator STL10 2021-12-07 01:21:11 +00:00
buxue d7dc539b6e fix sync GraphCell params data from device bug 2021-12-07 09:20:46 +08:00
i-robot d723cc417d !27151 [ME][Fallback] [ME][Fallback] Support built-in type: complex and reversed. 
Merge pull request !27151 from Margaret_wangrui/fallback
 2021-12-07 01:04:14 +00:00
i-robot 8bcd6e3a86 !27287 [ME][Fallback] Handle interpret nodes in list. 
Merge pull request !27287 from Margaret_wangrui/list_interpret
 2021-12-07 01:02:12 +00:00
i-robot d1aa8d6cb5 !26995 fix:unexpected eiminate of tile 
Merge pull request !26995 from zhangzhaoju/master_bug_fix
 2021-12-07 00:58:44 +00:00
lilei 05189459ab auto insert VirtualDataset node for master 2021-12-06 21:39:37 +08:00
Margaret_wangrui 6e5d625153 [ME][Fallback] Support built-in type: complex and reversed. 2021-12-06 21:15:30 +08:00
i-robot b1eae16a05 !22304 [assistant][ops]New operator implementation, include SVHNDataset 
Merge pull request !22304 from 王睿/svhn_dataset
 2021-12-06 12:30:13 +00:00
helloiSCSI 7cb5ed7676 add summart ops params valid check ut 2021-12-06 20:11:27 +08:00
郑昊 4ae41350a6 [feat][assistant][I3ALD1] add new method Spectrogram 2021-12-06 19:24:37 +08:00
lilei e933aa268b test_micro_batch_Interleaved 2021-12-06 18:37:21 +08:00
Margaret_wangrui fa8506c0a7 [ME][Fallback] Handle interpret nodes in list. 2021-12-06 16:58:21 +08:00
zhangzhaoju 722086435d 1. fix:unexpected eiminate of tile 
2. fix:delay memory allocat in NewTensorFilledWithData
 2021-12-06 14:49:48 +08:00
i-robot 2d23b698a6 !27024 add allreduce fusion by size 
Merge pull request !27024 from jiahongQian/master
 2021-12-06 05:32:12 +00:00
q00596439 de36fdc169 add allreduce fusion size and unify the interface 2021-12-05 21:35:11 +08:00
zhangyuqwer e934381b08 [feat][assistant][I3ZSQV] add new data operator CharNGram 2021-12-04 22:09:34 +08:00
RainWang6188 340b3b4d5d [feat][assistant][I3J6VJ] add new data operator SVHN 2021-12-04 08:19:47 +00:00
mohammad af6e587c28 MD Profiler: support multiple start/stop calls 2021-12-03 23:25:38 -05:00
danishfarid faaa5d5f0a autotune step 
fix testing script default

updates and changed sampling function

comments addressed

comments addressed

comments addressed

moving isSinkCheckAbove

update - move CheckSinkFunction

fix
 2021-12-03 20:29:35 +00:00
markuskunej 84d38e547a Moved the offload operation check and map operation split from python (datasets.py) to c++ (NodeOffloadPass.cc). 
Updated check for offload in python (dataset_helper.py and
iterators.py).

Updated auto_offload test in test_map_offload.py.

Changed MapNode.offload type from bool->int in bindings.cc.

Changed manual offload flag from int->enum.
 2021-12-03 14:40:01 +00:00
luoyang f3e1794a74 update log 2021-12-03 15:09:36 +08:00
i-robot 93db7f741f !20788 [assistant][ops] Add new dataset loading operator TedliumDataset 
Merge pull request !20788 from 杨旭华/TedliumDataset
 2021-12-03 06:29:29 +00:00
i-robot 8e4f3472d8 !27154 Enable the test for Parallel Optimizer 
Merge pull request !27154 from huangxinjing/enable_gradient_accumulation
 2021-12-03 06:23:53 +00:00
i-robot c0048bb117 !26953 Add some bprop mindir files 
Merge pull request !26953 from YuJianfeng/bprop_mindir
 2021-12-03 03:28:37 +00:00
i-robot 9cec03e3a8 !27033 close autotune in non-sink mode 
Merge pull request !27033 from luoyang/close_autotune_nonsink
 2021-12-03 01:26:06 +00:00
huangxinjing 8c9b2b93a8 Add transformer 2021-12-03 09:08:57 +08:00
luoyang 9cbb45bcc4 close autotune in non-sink mode 2021-12-03 08:46:14 +08:00
i-robot 9ddd3fb66f !27085 [MD][UT]: Use pytest.mark.forked for profiling tests 
Merge pull request !27085 from cathwong/ckw_ut_prof_forked
 2021-12-02 17:00:28 +00:00
Cathy Wong 367e5ed1dd MD UT: Use pytest.mark.forked for profiling tests 2021-12-02 10:55:05 -05:00
i-robot eb25c473d0 !27117 [ME][Fallback] Handle interpret nodes in tuple. 
Merge pull request !27117 from Margaret_wangrui/tuple_interpret
 2021-12-02 14:11:12 +00:00
i-robot fa457b2bfa !17832 [assistant][ops]New operator implementation, include KMnistDataset 
Merge pull request !17832 from 张璇/kmnist_dataset
 2021-12-02 14:00:36 +00:00
i-robot 3e73e124ac !23225 [assistant][ops] Add Glove 
Merge pull request !23225 from 张渝/Glove
 2021-12-02 12:22:17 +00:00
i-robot eab0699c6d !26986 change MD error log 
Merge pull request !26986 from shenwei41/master
 2021-12-02 11:35:07 +00:00
i-robot 7c9dc30e78 !27101 check args for shard 
Merge pull request !27101 from yangzhenzhang/fix-bug-for-out-strategy
 2021-12-02 08:24:47 +00:00
Margaret_wangrui f7fc7f4238 [ME][Fallback] Handle interpret nodes in tuple 2021-12-02 15:36:54 +08:00
i-robot 53f50c0d6b !26880 [MD] fix mindrecord log message part02 
Merge pull request !26880 from liyong126/fix_mindrecord_log_msg_2
 2021-12-02 06:48:15 +00:00
yangzhenzhang 7454b8f8f2 check args for shard 2021-12-02 11:51:29 +08:00
i-robot 3bff079969 !26896 Enhance error message of audio ops 
Merge pull request !26896 from xiaotianci/enhance_audio_err_message
 2021-12-02 03:42:35 +00:00
liyong d35e003def fix mindrecord log part02 2021-12-02 11:28:58 +08:00
i-robot ae94c51a97 !26930 fix bug of export mindir when using encrypt 
Merge pull request !26930 from lianliguang/mindir_load_2G
 2021-12-02 02:21:19 +00:00
luqilin 34bffbf768 [feat][assistant][I3T96H] add new dataset loading operator TedliumDataset 2021-12-02 09:53:39 +08:00
i-robot b00b1cc276 !26982 [ME][Fallback] Review the local dict and try to eval out the interpret node. 
Merge pull request !26982 from Margaret_wangrui/recheck_local_dict
 2021-12-02 01:09:12 +00:00
yujianfeng 7c808ee792 Add some bprop mindir files 2021-12-01 19:44:06 +08:00
zy 8f9a09f79c [fix] [assistant] [I3ZSQR] add new data operator GloVe 2021-12-01 17:12:20 +08:00
shenwei41 5d48409395 change err info 2021-12-01 16:48:14 +08:00
i-robot 6924866a87 !26746 [MD] minddata error msg optimize 
Merge pull request !26746 from xiefangqi/md_datasetops_error_msg_opt
 2021-12-01 07:18:18 +00:00
zy 5ca98a494a [fix] [assistant] [I3ZSQS] add new data operator FastText 2021-12-01 11:12:08 +08:00
“uccInf” 92d6d31750 [feat][assistant][I3J6V7] add new data operator KMnist 2021-12-01 03:05:05 +00:00
Margaret_wangrui ee1b4d4e6d [ME][Fallback] Review the local dict and try to eval out the interpret node 2021-12-01 10:02:26 +08:00
i-robot b6a6dbbe8f !27003 [Auto parallel] [Sharding propagation] Dealing with a parameter being used by mutiple ops 
Merge pull request !27003 from Xiaoda/114-adapting-sharding-propagation-for-common-parameter
 2021-12-01 02:01:34 +00:00
i-robot fcac7351aa !26801 add loss landscape ut and st 
Merge pull request !26801 from Songyuanwei/landscape_ci
 2021-12-01 01:49:43 +00:00
i-robot eb9537af11 !21690 [assistant][ops] Add data operator Vectors 
Merge pull request !21690 from 张渝/Vectors
 2021-12-01 01:29:45 +00:00
Xiao Tianci b883498c93 enhance error message of audio ops 2021-12-01 09:27:04 +08:00
i-robot 1905b228b4 !26609 Update minddata log message 
Merge pull request !26609 from luoyang/log
 2021-12-01 01:25:11 +00:00
lianliguang c7acd4b0ca fix bug of export mindir when using encrypt mode 2021-12-01 09:22:53 +08:00
i-robot bf59d75604 !26611 [MD] fix mindrecord log message part01 
Merge pull request !26611 from liyong126/fix_mindrecord_log_msg
 2021-12-01 01:12:48 +00:00
xiefangqi f74b5cea0c optimize datasetops error msg 2021-12-01 09:11:22 +08:00
Xiaoda Zhang 364858cbc9 In sharding propagation, to keep strategy consistent of parameter being used by multiple operators, we check the edge with one node of TmpIdentityInfo 2021-11-30 18:58:33 +08:00
i-robot 2fd00935ed !20964 [assistant][ops] Add new data operator SpeechCommandsDataset 
Merge pull request !20964 from 杨旭华/SpeechCommandsDataset
 2021-11-30 09:33:03 +00:00
i-robot 95c0cafef4 !26824 white list for syntax exception 
Merge pull request !26824 from zhangzhaoju/master_syntax
 2021-11-30 08:01:59 +00:00
i-robot 7554053c00 !26786 Add initializer and optimizer ut 
Merge pull request !26786 from wanyiming/add_init_opt_ut
 2021-11-30 07:23:27 +00:00
luoyang 1a6a42c083 Update minddata log message 2021-11-30 15:22:40 +08:00
zhangyuqwer 6a6e73ef82 [fix] [assistant] [I3ZSQM] add new data operator Vectors 2021-11-30 14:39:42 +08:00
songyuanwei a67ac908d8 add landscape ut and st 2021-11-30 11:28:47 +08:00
liyong 2869352cc8 fix mindrecord log part01 2021-11-30 10:57:58 +08:00
Xiaoda Zhang 04db51a528 In a previous PR (https://gitee.com/mindspore/mindspore/pulls/26807/), we replaced 'auto_parallel_search_mode' by 'search_mode' directly. 
However, to be forward compatitable, it is suitable to keep 'auto_parallel_search_mode' available. This PR recovers the 'auto_parallel_search_mode' interface and adds a warning when using this old interface.

This PR also deals with other codestyle things.
 2021-11-29 15:40:23 +08:00
zhangzhaoju d34f14e324 white list for syntax exception 2021-11-29 12:40:38 +08:00
vddong 91d3a7543f [feat][assistant][I3T96F] add new data operator SpeechCommands 2021-11-27 11:25:18 +08:00
i-robot d1e4e674ab !26690 Add supoort resolving outer lambda function for ops.Partial. 
Merge pull request !26690 from hezhenhao1/add_lambda
 2021-11-26 09:21:34 +00:00
hezhenhao1 4af312d17e Add supoort resolving outer lambda function for ops.Partial. 2021-11-26 15:05:50 +08:00
i-robot 9f8ec2c5ab !26807 [Auto parallel] [Sharding propagation] Interface change of sharding propagation 
Merge pull request !26807 from Xiaoda/113-auto-parallel-search-mode-changes-to-search-mode
 2021-11-26 01:48:58 +00:00
i-robot 6ecbc97fd6 !26804 virtual_dataset_avoid_auto_parallel 
Merge pull request !26804 from yao_yf/virtual_dataset_avoid_auto_parallel
 2021-11-26 01:48:53 +00:00
wanyiming ab65f4ac98 addut 2021-11-26 09:48:34 +08:00
i-robot b282414de7 !26619 arallel_ut_refactoring 
Merge pull request !26619 from 王志伟/parallel_ut_refactoring1
 2021-11-26 01:34:49 +00:00
i-robot bbe9606f1c !26805 Revert "Add the check of function return None." 
Merge pull request !26805 from Margaret_wangrui/return_none
 2021-11-26 01:28:46 +00:00
i-robot d8fbc26419 !26700 [MD][Profiler][Autotune] Add test, logs, clean state 
Merge pull request !26700 from harshvardhangupta/add_test_at_prof
 2021-11-25 19:38:33 +00:00
Margaret_wangrui 922678edef Revert "Add the check of function return None." 
This reverts commit f9a384456a.
 2021-11-25 21:18:24 +08:00
i-robot 4407210ae3 !26689 Modify error 
Merge pull request !26689 from liuyang/error_ms
 2021-11-25 12:18:11 +00:00
Xiaoda Zhang ad5ac77ae8 1) 'auto_parallel_search_mode' changes to 'search_mode'; 
2) 'sharding_propagation' moves to 'search_mode';
 2021-11-25 19:38:21 +08:00
yao_yf f29ce1fb60 virtual dataset avoid auto parallel 2021-11-25 18:47:35 +08:00
harshvardhangupta 02f4a8068b add tests, clean states, print proper warn logs 2021-11-25 00:03:38 -05:00
liuyang_655 12092c882f modify error 2021-11-24 22:40:23 -05:00
jonyguo 58c9112c2e fix: generator dataset with source zip 2021-11-25 11:32:28 +08:00
i-robot eef5f3f8d4 !22925 [assistant][ops] add operator Cummin 
Merge pull request !22925 from yangwm/cummin
 2021-11-24 11:46:23 +00:00
i-robot d251800c62 !26705 Add the check of function return None. 
Merge pull request !26705 from Margaret_wangrui/return_none
 2021-11-24 11:09:27 +00:00
Margaret_wangrui f9a384456a Add the check of function return None. 2021-11-24 15:30:35 +08:00
i-robot 2cc51099b1 !26718 [ME][Fallback] Add some fallback numpy test cases 
Merge pull request !26718 from Margaret_wangrui/fallback
 2021-11-24 06:43:13 +00:00
i-robot 519f14a909 !26006 slice recompute activation 
Merge pull request !26006 from yao_yf/add_transformer_slice_activation_config
 2021-11-24 06:14:28 +00:00
i-robot de8b6db07c !26585 add warnings for set_dump API, see I4AUIR for details 
Merge pull request !26585 from wenkai/wk1120setdumpwarning1
 2021-11-24 03:42:25 +00:00
Margaret_wangrui 16ac3638d3 [ME][Fallback] Add some fallback numpy test cases 2021-11-24 11:20:06 +08:00
i-robot 9a5fd32bd2 !26280 fix mindir export's error when using _encrypt 
Merge pull request !26280 from lianliguang/master
 2021-11-24 01:48:32 +00:00
wzw 86c5ad20c8 parallel_ut_refactoring1 2021-11-24 09:41:52 +08:00
luon 5485ff0cb6 [feat] [assistant] [I40GGH] add new ascend operator Cummin 2021-11-23 21:57:23 +08:00
wenkai c493f19b6b add warnings for set_dump API, see I4AUIR for details 2021-11-23 21:55:36 +08:00
yujianfeng f2bd7de442 Add automatic detection for the changes of python scripts when enable compile cache 2021-11-22 21:27:02 +00:00
i-robot 4f55a3f52f !26275 [API] Tensor python float trans to ms float32 
Merge pull request !26275 from kingxian/master
 2021-11-22 11:13:15 +00:00
lianliguang a6e5dcfb22 if parameter total larger than 1T split to another file 2021-11-22 11:17:33 +08:00
kingxian 545dc83fcb fix: `cell` does not support deep copy, tensor default dtype -> float32 2021-11-22 09:08:32 +08:00
i-robot 1b8c2ff0e9 !26414 fault_recover_by_mirror_group_fix_opt_shard 
Merge pull request !26414 from yao_yf/fault_recover_by_mirror_group_fix_opt_shard
 2021-11-20 03:06:45 +00:00
i-robot 4f34c32c6d !26235 AutoTune v1 
Merge pull request !26235 from danishfarid/autotune
 2021-11-19 23:40:40 +00:00
Rescue da986710f0 Updated concat-zip check and UT. 2021-11-19 17:38:16 +00:00
hesham 40797c40da AutoTune 2021-11-19 09:27:12 -05:00
i-robot 70363899e7 !24080 [assistant][ops] Add new audio operator ComputeDeltas 
Merge pull request !24080 from Rainfor/compute_detlas
 2021-11-19 12:29:49 +00:00
i-robot c6821bde0a !21648 [assistant][ops] Add new data loading operator YesNoDataset 
Merge pull request !21648 from 杨旭华/YesNoDataset
 2021-11-19 09:05:07 +00:00
vddong f465cd0242 [feat][assistant][I3T96L]add new dataset operator YesNo 2021-11-19 13:36:24 +08:00
i-robot f38df5c888 !26234 New dataset config option, auto_offload 
Merge pull request !26234 from markuskunej/offload_config
 2021-11-19 03:44:56 +00:00
yao_yf 188d39da83 slice_activation_in_recompute 
slice recompute activation
 2021-11-19 10:51:54 +08:00
i-robot 7559d5b798 !26494 [Auto parallel] Adjusting sharding propagation 
Merge pull request !26494 from Xiaoda/102-adjusting-sharding-propagation
 2021-11-19 02:00:46 +00:00
yao_yf 01dc4bbdf9 fix fault recover in optimizer shard 2021-11-19 09:46:27 +08:00
i-robot 3c39afad11 !24547 [MS][crowdfunding]New operator implementation, AutoAugment 
Merge pull request !24547 from yangwm/autoaugment
 2021-11-19 01:00:51 +00:00
markuskunej 29cf442521 Added dataset.config.set_auto_offload(), which will automatically attempt to offload dataset map operations if set to True. 2021-11-18 21:13:20 +00:00
i-robot 117df75afc !26126 MD Profiling - Add Start Stop Python UT 
Merge pull request !26126 from cathwong/ckw_ut_prof_startstop
 2021-11-18 14:05:00 +00:00
zhuchuang 4c3931f5c9 [feat] [assistant] [I3CKEE] add new audio operator ComputeDeltas 2021-11-18 17:18:43 +08:00
Xiaoda Zhang df67e74eaf making sharding_propagation smooth, add a reshape justification: 
1) when propagate sharding strategy from one op to another, try to find the strategy with zero communication cost;
2) if there is no such strategy, find the strategy with minimum communication cost, and raise a warning;
 2021-11-18 15:55:50 +08:00
i-robot 9f52343a6a !26350 add check for resizenearestneighbor parallel op 
Merge pull request !26350 from yangzhenzhang/add-check-for-resize-op
 2021-11-18 05:45:57 +00:00
despicablemme 09897ce7ec [feat] [assistant] [I40GZP] add new data op AutoAugment 2021-11-18 11:38:18 +08:00
i-robot 707e7fbbf9 !26453 [Fallback] Add some fallback numpy test cases 
Merge pull request !26453 from Margaret_wangrui/fallback_tests
 2021-11-18 03:01:47 +00:00
Margaret_wangrui c6582b9390 [Fallback] Add some fallback numpy test cases 2021-11-18 10:18:13 +08:00
Cathy Wong b1094b9d81 MD Profiling - Add Start Stop Python UT 2021-11-17 13:49:43 -05:00
i-robot 4e88f2e5e8 !26345 add examples of function grad, jvp and vjp 
Merge pull request !26345 from chenzhuo/jvp
 2021-11-17 08:35:38 +00:00
i-robot 36517de69c !24519 [assistant][ops] Add new audio operator SlidingWindowCmn. 
Merge pull request !24519 from Rainfor/SlidingWindowCmn
 2021-11-17 06:40:43 +00:00
i-robot 9f2e1edc00 !26279 neighborexchangev2 fix bug 
Merge pull request !26279 from TuDouNi/neighborexchangev2_bug
 2021-11-17 02:29:21 +00:00
wangkc123 706f9e2cbb [feat] [assistant] [I3CKEH] add new audio operator SlidingWindowCmn 2021-11-16 22:00:09 +08:00
yangzhenzhang ba99e4c505 add check for resize op 2021-11-16 15:39:52 +08:00
i-robot 58b69a05ee !20576 [assistant][ops] add new dataset loading operator LJSpeechDataset 
Merge pull request !20576 from 杨旭华/LJSpeechDataset
 2021-11-16 07:00:20 +00:00
chenzhuo d07f24462c add examples of grad, jvp and vjp 2021-11-16 14:15:26 +08:00
ttudu 33ac1de062 fix bug 2021-11-16 11:14:58 +08:00
liyong 9663884db3 fix occasional failed in random sampler 2021-11-16 09:53:38 +08:00
i-robot 5af8572cd7 !25488 add the set_dump API 
Merge pull request !25488 from wenkai/wk1027setdump1
 2021-11-16 01:47:32 +00:00
i-robot 0113b3eee1 !26236 Add MD Profiler save() 
Merge pull request !26236 from Mohammad Motallebi/add_profiler_save
 2021-11-16 01:04:53 +00:00
mohammad 5c8ab5f60c add MD Profiler Save() 2021-11-15 13:18:36 -05:00
wenkai d2eca80d40 add the set_dump API, see I4AUIR for details 2021-11-15 21:28:40 +08:00
i-robot 9dfe08b805 !25909 [Fallback] Add global Py param when processing global namespace info 
Merge pull request !25909 from huangbingjian/update_global_params
 2021-11-15 11:43:35 +00:00
i-robot 9522ee9686 !25703 [assistant][ops] Add math operator LpNorm 
Merge pull request !25703 from 孟权令/LpNorm
 2021-11-15 02:36:54 +00:00
vddong 6fe2d35ae2 [feat][assistant][I3T96D] add new dataset loading operator LJSpeechDataset 2021-11-14 14:52:15 +08:00
i-robot e154dca4b1 !22193 [assistant][ops] Add new loader operator DBpedia 
Merge pull request !22193 from 杨旭华/DBpedia
 2021-11-12 09:02:28 +00:00
i-robot e773f0621e !25918 add Function jvp and vjp 
Merge pull request !25918 from chenzhuo/jvp
 2021-11-12 06:37:46 +00:00
i-robot 5869e02fa1 !26135 Enable tuple input of optimizer as variable 
Merge pull request !26135 from LiangZhibo/broaden3
 2021-11-12 06:29:35 +00:00
Carry955 0d26c38693 [feat][assistant][I40GXT] add new loader DBpedia 2021-11-11 19:02:22 -08:00
i-robot 7a73bae5c3 !26036 add output strategy for matmul operator 
Merge pull request !26036 from yangzhenzhang/add-output-strategy-for-op-init
 2021-11-12 01:22:22 +00:00
i-robot e03544685b !26049 [Auto parallel] Support reshape in sharding propagation 
Merge pull request !26049 from Xiaoda/99-ad-reshape-adjusting-in-sharding-propagation
 2021-11-12 01:14:18 +00:00
chenzhuo f36edec3ff add function jvp 2021-11-12 08:44:41 +08:00
i-robot 1792d5f8a4 !26131 Offload Hardware Acceleration Computing 
Merge pull request !26131 from alashkari/hw_accel_move_copy
 2021-11-11 13:18:07 +00:00
i-robot b910870ecc !19986 [assistant][ops] Add new dataset loading operator AGNEWS 
Merge pull request !19986 from 杨旭华/AGNEWS
 2021-11-11 06:22:25 +00:00
Xiaoda Zhang a772767265 support reshape in sharding propagation: 
1) using 'swc index of strategy_cost_' as reshape's selected strategy;
2) when encountering reshape in BFS, select the 'swc index' with zero communication cost;
3) when encountering a reshape that is already visited, check whether there exists communication between reshape and current operator. It is OK if communication happens between two configured operators;
4) currently, two consecutive reshapes are not supported;
5) adjusting BFS structure in graph_costmodel.cc;
6) adjusting some code in step_auto_parallel.cc to avoid cyclomatic complexity.
 2021-11-11 11:35:43 +08:00
l00591931 9353bd10a4 Enable tuple as variable in optimizer 2021-11-11 11:31:05 +08:00
Megalomania c34bbabed9 [feat] [assistant] [I3T96M] add new loader AGNEWS 2021-11-09 23:51:19 -08:00
yangzhenzhang 8431ba616c add output strategy for op init 2021-11-10 15:35:45 +08:00
rescue 22e03ab12e Adding offload hardware accelerator. 2021-11-10 07:03:43 +00:00
i-robot f1f7731fb2 !25964 Fix serdes multithreading bug 
Merge pull request !25964 from zetongzhao/serdes_multithreading
 2021-11-09 15:48:06 +00:00
i-robot 14c3517b9a !25452 Add Gradient Sharding 
Merge pull request !25452 from huangxinjing/pipeline_shard_mini_step
 2021-11-09 08:15:23 +00:00
huangbingjian d0ca18b921 Add global Py param when processing global namespace info. 2021-11-09 09:34:30 +08:00
huangxinjing f354ab22a3 add pipeline shard interface 
Add support for no pipeline accugradient

Add delay tag for fusion op

Optimizer the visite order

add mirror for mini step control

Move the group to attributes

Add gradient_shard control for the mini step

Fix code stype

Fix ut description

Add interface
 2021-11-09 09:11:13 +08:00
i-robot d89a39c661 !25851 MD Profiling Start and Stop Support 
Merge pull request !25851 from cathwong/ckw_prof_startstop4
 2021-11-08 16:16:42 +00:00
i-robot 527abb8ede !26003 [MD] Added restrictions on shuffle and num_samples 
Merge pull request !26003 from liyong126/fix_shuffle_and_num_samples
 2021-11-08 11:58:08 +00:00
kman066 4ebec36ab2 add lpnorm 2021-11-08 19:36:13 +08:00
i-robot efc33a8225 !25745 F.grad support get gradient by position 
Merge pull request !25745 from zhang_sss/grad
 2021-11-08 08:59:23 +00:00
liyong 79891feadb fix shuffle and num_samples issue 2021-11-08 15:33:01 +08:00
zhang__sss 8bae4d9d50 grad 2021-11-08 14:12:58 +08:00
Cathy Wong cdf3126459 MD Profiler Start Stop Support 2021-11-05 19:46:39 -04:00
zetongzhao 5e8377ea5c fix multithreading bug 2021-11-05 16:49:18 -04:00
i-robot ded1c77bbf !25765 neighborExchangeV2 & grad 
Merge pull request !25765 from TuDouNi/neighborExchangeV2
 2021-11-05 09:31:03 +00:00
ttudu e953c15cd2 NeighborExchangeV2 & Grad 2021-11-05 11:00:46 +08:00
i-robot 7c14f984ed !25793 add output strategy for shard 
Merge pull request !25793 from yangzhenzhang/add-output-strategy
 2021-11-05 01:19:01 +00:00
i-robot 76f4f77cc2 !24520 Add graph run history to dump structure 
Merge pull request !24520 from parastooashtari/multi_root_graph_dump
 2021-11-04 12:55:01 +00:00
i-robot 92b81d3221 !23257 [assistant][ops][DBToAmplitudeOp] 
Merge pull request !23257 from 杨旭华/DBToAmplitude
 2021-11-04 10:32:32 +00:00
yangzhenzhang 6ad6304b77 add output strategy 2021-11-04 16:28:54 +08:00
i-robot 2828f317f7 !25718 optimize implicit convert error message 
Merge pull request !25718 from chujinjin/optimize_implicit_convert_error_msg
 2021-11-03 12:31:56 +00:00
yujianfeng fc769a79fe Fix the unloadable bprop mindir files 2021-11-03 14:29:56 +08:00
Isaac 69f57bc5b1 [feat][assistant][I40GXD]add new data operator DBToAmplitude 2021-11-02 23:45:27 +08:00
parastooashtari 1a59dc37bf add graph execution order history to dump 2021-11-02 11:00:38 -04:00
chujinjin 26410ccf75 optimize implicit convert error message 2021-11-01 17:34:11 +08:00
liyong 41e8280f55 add mindrecord overwrite 2021-11-01 10:44:20 +08:00
i-robot 45882752ba !25644 [Fallback] Support builtin type 
Merge pull request !25644 from huangbingjian/fallback_set
 2021-10-30 10:01:52 +00:00
i-robot f16ed11237 !25651 Add some fallback testcases 
Merge pull request !25651 from Margaret_wangrui/fallback_tests
 2021-10-30 09:21:46 +00:00
huangbingjian 5063ee55bc [Fallback] Support builtin type: set, dict, slice, bool, int, float, str 2021-10-30 14:54:59 +08:00
yujianfeng 195563c67f Fix the random failure of ut tests in ci 2021-10-30 14:09:12 +08:00
i-robot b27520b6ae !25640 fix minddata ut core 
Merge pull request !25640 from luoyang/serving
 2021-10-30 01:35:32 +00:00
i-robot 7d50c3d5d7 !25551 [Fallback] Added test cases for python built-in functions 
Merge pull request !25551 from huangbingjian/add_fallback_testcases
 2021-10-29 09:15:19 +00:00
luoyang beba798e00 fix minddata ut core 2021-10-29 16:28:22 +08:00
i-robot 958c2a8e00 !25560 Support bytes input for decode op 
Merge pull request !25560 from luoyang/serving
 2021-10-29 06:47:02 +00:00
Margaret_wangrui 6275cdcf7a add fallback testcases 2021-10-29 12:02:16 +08:00
i-robot e43d0ee554 !25613 [MD] fix dataset ut part06 
Merge pull request !25613 from liyong126/fix_md_ut_part06
 2021-10-29 03:32:27 +00:00
i-robot 48699c939c !25544 add parallel op for resizenearestneighbor 
Merge pull request !25544 from yangzhenzhang/add-parallel-op-for-resizenearestneighbor
 2021-10-29 02:47:49 +00:00
liyong b9bad0bdbb fix md ut part06 2021-10-29 10:26:34 +08:00
huangbingjian 02f72ab3ae [Fallback] Added test cases for python built-in functions 2021-10-29 09:33:16 +08:00
i-robot 357ad46cb1 !25585 Enable JIT Fallback in default. 
Merge pull request !25585 from 张清华/opt_jit_fallback
 2021-10-28 17:30:50 +00:00
Zhang Qinghua e8b421fe6e Enable JIT Fallback in default. 2021-10-28 20:18:06 +08:00
i-robot 8758830723 !25479 delete mindquantum c++ simulator 
Merge pull request !25479 from donghufeng/master
 2021-10-28 08:14:18 +00:00
luoyang b47ac46e92 Support bytes input for decode op 2021-10-28 15:22:50 +08:00
yangzhenzhang c42081619e add parallel op for resizenearestneighbor 2021-10-28 11:31:00 +08:00
i-robot a7834c382f !25511 Add some fallback testcases 
Merge pull request !25511 from Margaret_wangrui/fallback_tests
 2021-10-28 02:28:20 +00:00
Margaret_wangrui 7738f55f44 Add some fallback testcases 2021-10-28 09:15:24 +08:00
i-robot 418e1b425b !23490 [assistant][ops] Add New Math Operator IsNan 
Merge pull request !23490 from 孟权令/IsNan
 2021-10-27 12:15:41 +00:00
xuxusheng 7a9a4d0515 delete mindquantum simulator 2021-10-27 18:35:35 +08:00
i-robot 360e228f45 !25358 Fix fallback and cell kwargs issues. 
Merge pull request !25358 from 张清华/opt_fallback
 2021-10-27 09:07:55 +00:00
Sawyer c032d1f83c [feat][assistant][I3T92O]add new operator IsNan 2021-10-27 16:14:03 +08:00
i-robot 180b071122 !22149 [assistant][ops] Add New IsInf 
Merge pull request !22149 from 孟权令/IsInf
 2021-10-27 07:41:15 +00:00
Zhang Qinghua b43693be23 Fix fallback and cell kwargs issues. 2021-10-27 14:06:02 +08:00
i-robot 74977e548d !24624 [Autotune] Modify MD callback and AddWorker logic to ParallelOps 
Merge pull request !24624 from h.farahat/add_worker
 2021-10-27 00:41:20 +00:00
i-robot c0f6286fcb !25092 [MD] API for autotune 
Merge pull request !25092 from harshvardhangupta/auto_tune_api
 2021-10-26 18:14:43 +00:00
i-robot 704c490e80 !25449 MD UT - Add missing set and restore seed for parallel test execution 
Merge pull request !25449 from cathwong/ckw_ut_py_parallel
 2021-10-26 17:53:39 +00:00
Cathy Wong e66aba9ef5 MD UT - Add missing set and restore seed. 
test_places365_content_check - delete visualize_dataset
 2021-10-26 13:19:47 -04:00
harshvardhangupta 1bb45142c9 Implement autotune api 2021-10-26 11:26:13 -04:00
doit cd9242eaa9 [feat] [assistant] [I3T92M] add new math operator IsInf 2021-10-25 14:40:40 +08:00
huangbingjian d7e97dd74a change EXCEPTION level to CRITICAL level 2021-10-25 14:25:50 +08:00
i-robot 6f413ee29d !25155 Support ops, nn and numpy namespaces, and add test case. 
Merge pull request !25155 from 张清华/opt_fallback
 2021-10-23 03:50:53 +00:00
Zhang Qinghua 6a79e262ae Support ops, nn and numpy namespaces, and add test case. 2021-10-22 16:31:30 +08:00
i-robot c544af28b6 !25286 dataset: modify profiling ut for parallel running 
Merge pull request !25286 from ms_yan/ut_parallel
 2021-10-22 08:09:03 +00:00
ms_yan bb314ad07f make ut parallel 2021-10-22 13:17:43 +08:00
i-robot cf0029b33a !25277 [MD] fix mindrecord ut part05 
Merge pull request !25277 from liyong126/fix_md_ut_05
 2021-10-22 01:43:03 +00:00
i-robot 782874bf18 !21215 [MS][crowdfunding]New operator implementation, include phaser 
Merge pull request !21215 from Wangsong95/phaser
 2021-10-22 01:08:50 +00:00
hesham 85e077b60b Callback changes 
AddWorker logic to parallel ops
 2021-10-21 17:35:11 -04:00
liyong 7c9f6899a3 fix md ut part05 2021-10-21 20:40:09 +08:00
i-robot b7d8bcfe8d !25177 [MD] fix mindrecord ut part04 
Merge pull request !25177 from liyong126/fix_md_ut_part04
 2021-10-21 01:39:26 +00:00
i-robot 5d8be044c9 !18018 [assistant][ops]New operator implementation, include FashionMnistDataset 
Merge pull request !18018 from 张璇/fashionmnist_dataset
 2021-10-20 06:42:54 +00:00
i-robot f9bd640b09 !16269 [assistant][RandomLighting] 
Merge pull request !16269 from QingfengLi/randomlighting
 2021-10-20 06:42:12 +00:00
liyong fc5ea9cc1c fix dataset ut for running independently 2021-10-20 14:27:36 +08:00
i-robot ae87f31dea !25088 Optimize the comment and log descriptions for the python source code 
Merge pull request !25088 from zhunaipan/master
 2021-10-20 06:26:56 +00:00
zhunaipan 8ce4e62725 optimize the comment and log description 
修改：     ops/operations/_inner_ops.py
	修改：     ops/operations/_quant_ops.py
	修改：     ops/operations/array_ops.py
	修改：     ops/operations/comm_ops.py
	修改：     ops/operations/math_ops.py
	修改：     ops/operations/quantum_ops.py
	修改：     ops/operations/rl_ops.py
	修改：     ops/operations/sponge_ops.py
	修改：     ops/operations/sponge_update_ops.py
	修改：     train/__init__.py
	修改：     common/tensor.py
	修改：     train/serialization.py
	修改：     ccsrc/pipeline/jit/parse/parse.h
	修改：     explainer/benchmark/_attribution/metric.py
	修改：     ops/composite/multitype_ops/_constexpr_utils.py
	修改：     ops/operations/comm_ops.py

	修改：     RELEASE.md
	修改：     mindspore/_extends/parse/standard_method.py
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/concat_offset_cpu_kernel.cc
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/dynamic_shape_cpu_kernel.cc
	修改：     mindspore/ccsrc/frontend/parallel/ops_info/reshape_info.cc
	修改：     mindspore/ccsrc/frontend/parallel/ops_info/tile_info.cc
	修改：     mindspore/ccsrc/frontend/parallel/ops_info/transpose_info.cc
	修改：     mindspore/ccsrc/frontend/parallel/strategy.h
	修改：     mindspore/common/tensor.py
	修改：     mindspore/core/abstract/prim_arrays.cc
	修改：     mindspore/core/abstract/prim_nn.cc
	修改：     mindspore/core/ops/conv2d.cc
	修改：     mindspore/core/ops/logical_and.h
	修改：     mindspore/core/ops/logical_not.h
	修改：     mindspore/core/ops/logical_or.h
	修改：     mindspore/core/ops/reduce_all.h
	修改：     mindspore/core/ops/reduce_any.h
	修改：     mindspore/lite/src/runtime/kernel/arm/fp32_grad/sgd.cc
	修改：     mindspore/nn/layer/quant.py
	修改：     mindspore/nn/optim/sgd.py
	修改：     mindspore/nn/sparse/sparse.py
	修改：     mindspore/numpy/array_creations.py
	修改：     mindspore/numpy/array_ops.py
	修改：     mindspore/numpy/logic_ops.py
	修改：     mindspore/numpy/math_ops.py
	修改：     mindspore/ops/operations/_inner_ops.py
	修改：     mindspore/ops/operations/array_ops.py
	修改：     mindspore/ops/operations/rl_ops.py
	修改：     mindspore/train/_utils.py
	修改：     tests/ut/python/model/test_lenet_core_after_exception.py

	修改：     mindspore/_extends/parse/standard_method.py
	修改：     mindspore/ops/operations/rl_ops.py

	修改：     mindspore/core/abstract/prim_nn.cc
	修改：     mindspore/core/ops/conv2d.cc

	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/ctcloss_cpu_kernel.cc
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/fl/fused_pull_weight_kernel.h
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/fl/fused_push_weight_kernel.h
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/mkldnn/conv2d_grad_filter_cpu_kernel.cc
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/mkldnn/conv2d_grad_input_cpu_kernel.cc
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/ps/sparse_apply_ftrl_ps_kernel.cc
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/ps/sparse_apply_lazy_adam_ps_kernel.cc
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/rolling_cpu_kernel.cc
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/scatter_arithmetic_cpu_kernel.cc
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/split_cpu_kernel.cc
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/update_cache_cpu_kernel.cc
	修改：     mindspore/ccsrc/backend/kernel_compiler/gpu/arrays/split_gpu_kernel.h
	修改：     mindspore/ccsrc/backend/kernel_compiler/gpu/math/broadcast_gpu_kernel.h
	修改：     mindspore/ccsrc/backend/kernel_compiler/gpu/nn/conv2d_grad_input_gpu_kernel.h
	修改：     mindspore/ccsrc/fl/server/server.cc
	修改：     mindspore/ccsrc/frontend/optimizer/ad/kpynative.cc
	修改：     mindspore/ccsrc/frontend/optimizer/irpass/incorporate_getitem.h
	修改：     mindspore/ccsrc/frontend/optimizer/irpass/inline.h
	修改：     mindspore/ccsrc/minddata/dataset/core/device_tensor.cc
	修改：     mindspore/ccsrc/minddata/dataset/core/tensor.cc
	修改：     mindspore/ccsrc/minddata/dataset/engine/datasetops/source/emnist_op.cc
	修改：     mindspore/ccsrc/minddata/dataset/engine/datasetops/source/mnist_op.cc
	修改：     mindspore/ccsrc/minddata/dataset/engine/datasetops/source/qmnist_op.cc
	修改：     mindspore/ccsrc/minddata/dataset/engine/ir/datasetops/dataset_node.cc
	修改：     mindspore/ccsrc/minddata/dataset/engine/opt/pre/epoch_ctrl_pass.cc
	修改：     mindspore/ccsrc/minddata/dataset/kernels/image/lite_image_utils.cc
	修改：     mindspore/ccsrc/pipeline/jit/action.cc
	修改：     mindspore/ccsrc/pipeline/jit/static_analysis/evaluator.cc
	修改：     mindspore/ccsrc/runtime/device/ascend/executor/tiling/op_tiling_adapter.cc
	修改：     mindspore/compression/quant/quant_utils.py
	修改：     mindspore/core/abstract/prim_nn.cc
	修改：     mindspore/dataset/engine/validators.py
	修改：     mindspore/lite/micro/coder/opcoders/nnacl/fp32/affine_fp32_coder.cc
	修改：     mindspore/lite/micro/coder/opcoders/nnacl/int8/affine_int8_coder.cc
	修改：     mindspore/lite/src/runtime/kernel/ascend310/src/custom_kernel.cc
	修改：     mindspore/lite/src/runtime/kernel/opencl/kernel/matmul.cc
	修改：     mindspore/lite/src/runtime/kernel/opencl/kernel/strassen.cc
	修改：     mindspore/lite/tools/common/graph_util.h
	修改：     mindspore/lite/tools/optimizer/fisson/fisson_util.cc
	修改：     mindspore/ops/composite/math_ops.py
	修改：     mindspore/ops/operations/_inner_ops.py
	修改：     mindspore/ops/operations/array_ops.py
	修改：     mindspore/ops/operations/math_ops.py
	修改：     mindspore/ops/operations/other_ops.py

	修改：     mindspore/boost/boost_cell_wrapper.py
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/update_cache_cpu_kernel.cc
	修改：     mindspore/ccsrc/common/trans.cc
	修改：     mindspore/ccsrc/frontend/parallel/cache_embedding/cache_embedding.cc
	修改：     mindspore/ccsrc/frontend/parallel/ops_info/gather_info.cc
	修改：     mindspore/lite/src/common/log_util.h
	修改：     mindspore/nn/wrap/loss_scale.py
	修改：     mindspore/parallel/nn/moe.py
	修改：     tests/mindspore_test_framework/mindspore_test.py

	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/split_cpu_kernel.cc
	修改：     mindspore/lite/tools/common/graph_util.h

	修改：     mindspore/ccsrc/frontend/parallel/ops_info/gather_info.cc

	修改：     mindspore/core/ops/conv2d.cc

	修改：     tests/ut/python/model/test_lenet_core_after_exception.py
 2021-10-20 12:02:40 +08:00
i-robot ef7bc4ddda !25079 Change dir hash to file hash in bprop mindir 
Merge pull request !25079 from YuJianfeng/bprop_mindir
 2021-10-20 02:54:05 +00:00
“uccInf” fe3123cfe8 [feat][assistant][I3J6V4] add new data operator FashionMnist 2021-10-20 02:37:56 +00:00
i-robot 440036d331 !24362 [assistant][ops]New operator implementation, include PhotoTourDataset 
Merge pull request !24362 from Wangsong95/phototour_dataset
 2021-10-20 01:46:05 +00:00
yangyueren 6594b90a58 [feat][assistant][I3J6VE] add new data operator PhotoTour 2021-10-19 15:31:32 +00:00
chenx2ovo 77caf907c4 [feat][assistant][I3CEGR] add op random lighting 2021-10-19 20:38:01 +08:00
yujianfeng 42079ac087 Change dir hash to file hash in bprop mindir 2021-10-19 19:22:25 +08:00
liyong a89741c32e fix md ut part03 2021-10-19 16:52:57 +08:00
i-robot 690642d672 !18664 [assistant][ops]New operator implementation, include Places365Dataset 
Merge pull request !18664 from Wangsong95/places365_dataset
 2021-10-19 07:06:35 +00:00
i-robot c97d3eeef7 !25100 [MD] fix mindrecord ut part02 
Merge pull request !25100 from liyong126/fix_md_ut_part02
 2021-10-19 06:30:57 +00:00
i-robot 1606f19dfb !18265 [assistant][ops] Add new audio operator CreateDct 
Merge pull request !18265 from 杨旭华/CreateDct
 2021-10-19 06:30:18 +00:00
liyong d23961b98f fix mindrecord ut 2021-10-19 11:43:52 +08:00
i-robot e7ea546194 !25006 [MD] fix mindrecord ut 
Merge pull request !25006 from liyong126/fix_md_ut
 2021-10-19 02:02:13 +00:00
i-robot d9cfda44c4 !25060 ut_fix 
Merge pull request !25060 from wanyiming/ut_fix
 2021-10-19 00:59:01 +00:00
i-robot e3d8edc530 !24475 Implement the dict.items() interface and the multiplication operation of numbers and lists or tuples 
Merge pull request !24475 from 翟之博/master
 2021-10-18 11:39:27 +00:00
i-robot 8df1bd14a1 !24986 Change printed log's level in dump_proto.cc 
Merge pull request !24986 from huanghui/change-log-level
 2021-10-18 11:36:44 +00:00
tophand 4f4777f0da [feat][assistant][I3J6U2] Add new audio operator CreateDct 2021-10-18 03:23:18 -07:00
wanyiming 4fbc59a98a utfixs 2021-10-18 18:06:37 +08:00
liyong d9aa18dfca refactor md ut 2021-10-18 17:55:28 +08:00
i-robot 9d0d094437 !24554 support nested call of ms_function 
Merge pull request !24554 from zhangzhaoju/ms_master_ms_function
 2021-10-18 09:36:30 +00:00
zzb 95425b770d iml dict.items() and multiplication op 2021-10-18 12:47:22 +08:00
zx d13d2413f5 [feat][assistant][I3J6UV] add new audio operator Phaser 2021-10-16 08:45:12 +08:00
yangyueren 951193c308 [feat][assistant][I3J6VF] add new data operator Places365 2021-10-15 14:56:09 +00:00
Xiao Tianci 930a5b89c0 fix api docs of audio 2021-10-15 17:17:18 +08:00
i-robot be691284e2 !18407 [assistant][MulLawEncoding] 
Merge pull request !18407 from QingfengLi/mulawencoding
 2021-10-15 09:03:41 +00:00
i-robot 44fe11c656 !24805 fix_fronted_ut 
Merge pull request !24805 from wanyiming/fix_uts
 2021-10-15 09:01:35 +00:00
zhangzhaoju b4453709a2 Support parser decoratored functions 
like nested calling of ms_function
 2021-10-15 16:41:08 +08:00
wanyiming 8b40e77201 ut_fixed 2021-10-15 15:54:26 +08:00
huanghui 3785b6d1b4 change printed log's level 2021-10-15 15:49:08 +08:00
chujinjin 3c3d8c3962 remove useless python ut 2021-10-15 15:26:45 +08:00
i-robot b27623ae37 !24899 modify ut of probability 
Merge pull request !24899 from byweng/master
 2021-10-15 02:02:52 +00:00
robert_luo_yibo 75e2c3041c [feat][assistant][I3CEG3] add new data OP MuLawEncoding 2021-10-14 20:24:18 +08:00
Bingya Weng be20f00299 modify ut of probability 2021-10-14 19:33:34 +08:00
i-robot f83070728d !24790 support user define strategy gen method under auto parallel context 
Merge pull request !24790 from zhuyuxiao/master
 2021-10-14 09:03:36 +00:00
chujinjin 90836f70a0 fix context python ut error 2021-10-14 14:27:50 +08:00
i-robot 957f9a7b4e !24839 UT case runs failed in PyNative mode 
Merge pull request !24839 from JoyLvliang/ut_run_failed_in_pynative_mode
 2021-10-14 06:15:28 +00:00
i-robot 65f08a6c4c !24804 parallel ut modify 
Merge pull request !24804 from yao_yf/parallel_ut_modify
 2021-10-14 01:24:12 +00:00
i-robot 470de9bcaa !21258 [assistant][ops]New operator implementation, include ApplyKerasMomentumD 
Merge pull request !21258 from 梁秀波/ApplyKerasMomentumD
 2021-10-14 01:05:23 +00:00
7347157+joylvliang@user.noreply.gitee.com aecbdf3c3b ut_run_failed_in_pynative_mode 2021-10-13 18:46:27 +08:00
i-robot 1b9b85bbb2 !17851 [assistant][ops]New operator implementation, include FakeImageDataset 
Merge pull request !17851 from 张璇/fakeimage_dataset
 2021-10-13 09:22:55 +00:00
yao_yf 636f82a466 parallel ut modify 2021-10-13 14:28:13 +08:00
zhuyuxiao 1907246931 change api 2021-10-13 10:28:30 +08:00
i-robot 3fd94000c5 !24568 Apply batch parallel in auto_parallel mode when strategies are not specified 
Merge pull request !24568 from zhuyuxiao/master
 2021-10-13 01:20:15 +00:00
i-robot 18e632c7a1 !21216 [MS][crowdfunding]New operator implementation, include Overdirve 
Merge pull request !21216 from Wangsong95/overdrive
 2021-10-13 01:08:36 +00:00
G-Dragon-Liu d2f22a8726 [feat][assistant][I3J6V3] add new data operator FakeImage 2021-10-12 14:00:43 +00:00
zx 9b7d7be65c [feat][assistant][I3J6UU] add new audio operator Overdrive 2021-10-12 18:10:31 +08:00
zhuyuxiao cf76c76745 apply batch parallel in auto_parallel mode when strategies are not specified 2021-10-12 15:44:10 +08:00
yao_yf b303d6001c parallel ut refactor 2021-10-12 15:18:51 +08:00
huanghui 1af32f74f9 support None argument for the outermost net 2021-10-11 16:00:57 +08:00
i-robot b9c2a84d3b !17812 [assistant][ops] Add a new audio operator Flanger 
Merge pull request !17812 from 杨旭华/Flanger
 2021-10-09 08:15:33 +00:00
li-qiyao 2283442855 [feat][assistant][I3J6U9] add new data operator Flanger 2021-10-08 05:03:31 -07:00
i-robot ea53466848 !24490 Extend the completeness of the mindspore static graph mode, so that the filter function is supported in the construct function 
Merge pull request !24490 from 卢逸飞/MindSpore/master
 2021-10-08 10:35:29 +00:00
i-robot 8598d08351 !17820 [assistant][ops]New operator implementation, include EMnistDataset 
Merge pull request !17820 from 张璇/emnist_dataset
 2021-10-08 07:18:31 +00:00
i-robot 02f9e3e077 !17805 [assistant][ops] Add new audio operator DetectPitchFrequency 
Merge pull request !17805 from 杨旭华/DetectPitchFrequency
 2021-10-08 03:34:46 +00:00
G-Dragon-Liu 32baa520bf [feat][assistant][I3J6V2] add new data operator EMnist 2021-10-08 02:53:00 +00:00
John Tzanakakis 7e7b444c63 remove verbose option from DbgServices 2021-10-06 11:38:05 -04:00
Lu 9f68d43c32 Construct supports the filter function. 2021-09-30 15:18:05 +08:00
i-robot dddea1803d !24361 context api 0928 
Merge pull request !24361 from mindspore_ding/context_master_0928
 2021-09-30 06:45:28 +00:00
dingpeifei 89f9d0f263 api context 0927 2021-09-29 23:15:36 +08:00
Zhang Lian b7e6520e62 [feat] [assistant] [I3J6U8] Add a new audio operator DetectPitchFrequency 2021-09-29 15:12:58 +08:00
despicablemme 75ade61acf [feat] [assistant] [I40GGE] add new Ascend operator CeLU 2021-09-28 14:58:25 +08:00
i-robot 2cacf9cdc2 !24231 fix security wrap and code check 
Merge pull request !24231 from jiangshuqiang/fix_code_check_master
 2021-09-28 06:45:19 +00:00
i-robot 2085ab1774 !22831 [assistant][ops]add math ops Ger 
Merge pull request !22831 from yangwm/ger
 2021-09-28 06:27:35 +00:00
jiangshuqiang 13fc005562 fix security wrap 2021-09-28 11:59:45 +08:00
i-robot dd544a9693 !21406 [MS][crowdfunding]New operator implementation, include TrebleBiquad 
Merge pull request !21406 from 张璇/treble_biquad
 2021-09-27 14:18:00 +00:00
i-robot f16c003dfa !22610 [MS][crowdfunding]New operator implementation, RandomAdjustSharpness 
Merge pull request !22610 from yangwm/sharpness
 2021-09-27 09:20:05 +00:00
zorax 6098c1da5e [feat][assistant][I40FFO] add new Ascend operator ApplyKerasMomentum 2021-09-27 16:49:18 +08:00
zx 3da0f0f487 [feat][assistant][I3J6V0] add new audio operator TrebleBiquad 2021-09-27 13:01:26 +08:00
despicablemme d072a4e4bf [feat] [assistant] [I40GZE] add new data operator RandomAdjustSharpness 2021-09-27 11:19:33 +08:00
i-robot ab567574c4 !21451 [MS][crowdfunding]New operator implementation, include RiaaBiquad 
Merge pull request !21451 from 张璇/riaa_biquad
 2021-09-27 03:14:16 +00:00
i-robot 2969688382 !20047 [assistant][ops]New operator implementation, include QmnistDataset 
Merge pull request !20047 from Wangsong95/qmnist_dataset
 2021-09-27 01:36:08 +00:00
despicablemme 84337078b1 [feat] [assistant] [I40GGM] add new ascend operator Ger 2021-09-27 09:28:05 +08:00
i-robot e3bc280f22 !22532 [MS][crowdfunding]New operator implementation, RandomEqualize 
Merge pull request !22532 from yangwm/equalize
 2021-09-27 01:07:04 +00:00
i-robot b10df2da0c !21401 [assistant][ops]New operator implementation, include ExtractVolumePatches 
Merge pull request !21401 from 梁秀波/ExtractVolumePatches
 2021-09-26 09:52:43 +00:00
i-robot bb038292d4 !23905 fix error log 
Merge pull request !23905 from lianliguang/more-info-for-infer-error
 2021-09-26 06:23:34 +00:00
despicablemme 7063907bdc [feat] [assidtant] [I40GZN] add new data ops RandomEqualize 2021-09-25 18:00:25 +08:00
i-robot d0023355a3 !23205 Fix bus error with multiprocessing enabled, large image, shared_memory, single device 
Merge pull request !23205 from RobinGrosman/mem_bus_failure
 2021-09-24 19:16:12 +00:00
RobinGrosman c90efc0403 add check for shm available when num_devices=1 to avoid bus errors 
-Required modifying tests to reduce memory usage to check doesn't fail during CI
-Also required fixing max_rowsize to be externalized from map+batch() function
 2021-09-24 10:24:31 -07:00
hzw 2f5758a4a8 [feat][assistant][#I40FFZ] add new Ascend operator ExtractVolumePatches 2021-09-24 18:36:03 +08:00
i-robot ee38ffbd3d !22560 [MS][crowdfunding]New operator implementation, RandomAutoContrast 
Merge pull request !22560 from yangwm/autocontrast
 2021-09-24 09:34:37 +00:00
i-robot 7cde7731b0 !23537 Update pangu reshape and softmax. 
Merge pull request !23537 from linqingke/pangu
 2021-09-24 08:12:13 +00:00
i-robot 86392fdd3d !23982 fix the debug info about the cell function decorated by @ms_functon 
Merge pull request !23982 from huanghui/fix-filename-error-with-ms_function
 2021-09-24 06:43:35 +00:00
i-robot e7cb505e68 !23569 Produce parallel operators for ResizeBilinear and ResizeNearestNeighbor 
Merge pull request !23569 from Bert0108/resizebilinear_parallel_ops
 2021-09-24 03:05:23 +00:00
i-robot d37fccc56f !23544 remove deprecated gather op 
Merge pull request !23544 from zhuyuxiao/master
 2021-09-24 01:20:53 +00:00
Bert0108 2d3d0b673e parallel operators for ResizeBilinear and ResizeNearestNeighbor 2021-09-24 09:07:49 +08:00
linqingke acde7febef update pangu reshape and softmax performance. 
Add layer norm judge

Fix layer norm name error

Fix input tyoe check

Fix ut test

Add 3d supports
 2021-09-24 09:06:16 +08:00
zx 1d95e6f480 [feat][assistant][I3J6UY] add new audio operator RiaaBiquad 2021-09-23 21:36:59 +08:00
i-robot 79d1f3cfd3 !23854 Fix testcase about modelzoo 
Merge pull request !23854 from chenhaozhe/fix-testcase-about-models
 2021-09-23 12:27:42 +00:00
despicablemme 7a6b75c2e8 [feat] [assistant] [I40GZJ] add new data op RandomAutoContrast 2021-09-23 20:17:39 +08:00
i-robot ab9a7163cb !22175 [assistant][ops]New operator implementation, include Trunc 
Merge pull request !22175 from 梁秀波/Trunc
 2021-09-23 10:04:55 +00:00
i-robot 0c26736da1 !22276 [MS][crowdfunding]New operator implementation, RandomInvert 
Merge pull request !22276 from yangwm/rinvert
 2021-09-23 08:12:57 +00:00
lianliguang 7227b61979 modify info when infer error 2021-09-23 15:54:43 +08:00
i-robot 632e3b8dcd !23663 add exception level to python error report 
Merge pull request !23663 from huangbingjian/py_log
 2021-09-23 07:46:45 +00:00
huanghui 97250978c4 fix the debug info about the function decorated by @ms_functon 2021-09-23 14:43:02 +08:00
echo-yike 785558cdd2 [feat][assistant][I40FGD] add new Ascend operator Trunc 2021-09-23 14:27:35 +08:00
chenhaozhe 12fab451e8 fix test cases about models 2021-09-23 09:19:37 +08:00
i-robot 44b1dbf77f !23827 MD Python UT: Update num_epochs to appropriate value for iterators instead of using default value 
Merge pull request !23827 from hetshah/hs_python_ut
 2021-09-22 21:14:35 +00:00
hetshah 2c1666fd06 set num epochs for iterators that use the default value 
add explicit paramter for infinite iterators

set appropriate value for num_epoch param for iteratos

fix long lines

remove trailing whitespace

fixed typo

remove comment

fixed comments

fixed test
 2021-09-22 17:32:50 +00:00
despicablemme b977d8723b [feat] [assistant] [I40GZC] add new data ops RandomInvert 2021-09-22 16:55:14 +08:00
huangbingjian 3ee5d98a8d add exception level to python error report 2021-09-22 14:34:21 +08:00
ckczzj 001b68c286 [feat][assistant][I3J6VG] add new data operator QMnist 2021-09-22 12:13:27 +08:00
Zhang Qinghua 9fbd118319 Handle interpreted node as input, set function Parameters and update local params if need. 2021-09-18 17:34:50 +08:00
i-robot ebe094ac0f !21829 [assistant][ops] Add New Cdist and CdistGrad 
Merge pull request !21829 from 孟权令/Cdist
 2021-09-18 09:23:27 +00:00
i-robot e87f0be14f !23707 fix summary isolation 
Merge pull request !23707 from jiangshuqiang/temp
 2021-09-18 09:23:25 +00:00
i-robot 6489dacdab !18114 [assistant][ops]Add new operator Magphase 
Merge pull request !18114 from YJfuel123/Magphase
 2021-09-18 07:26:34 +00:00
i-robot 92287b86d8 !23471 Fix white list error msg synax error 
Merge pull request !23471 from xiefangqi/md_white_list_optimization
 2021-09-18 05:03:40 +00:00
jiangshuqiang c2bd061889 fix summary isolation 2021-09-18 10:59:14 +08:00
i-robot 95e56d0912 !23212 enable profiling warning 
Merge pull request !23212 from mindspore_ding/enable_profiling_master_0910
 2021-09-18 02:04:37 +00:00
zhoufeng 1f934bd782 check neighbor attr type 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-09-17 21:15:37 +08:00
dingpeifei 7523b320d7 enable profiling warning 2021-09-17 17:09:56 +08:00
葛崇林 a05a5de073 [feat][assistant][I3ALC5] add new method Magphase 2021-09-17 16:02:46 +08:00
i-robot f5af432e04 !16922 [assistant][Vol] 
Merge pull request !16922 from QingfengLi/Vol
 2021-09-17 06:51:49 +00:00
SichongHao 5412382e16 [feat][assistant][I3T91W][I3T91X]add new operator Cdist and CdistGrad 2021-09-17 13:58:53 +08:00
chenx2ovo 9e62623b4a [feat][assistant][I3CEGI] add op vol 2021-09-17 09:34:20 +08:00
ms_yan 0a365e91bf modify log in kernel part 2021-09-16 22:09:21 +08:00
i-robot a5b793463a !23099 Correct wrong info when using ms_function to decorate bprop 
Merge pull request !23099 from JoyLvliang/correct_wrong_info_when_using_ms_function_with_bprop
 2021-09-16 08:46:41 +00:00
i-robot 89119ae470 !23553 fix: pyfunc cause hung when it is a generator which can't be serialize 
Merge pull request !23553 from guozhijian/fix_pyfunc_hung_when_yield
 2021-09-16 08:44:50 +00:00
zhuyuxiao 79d99323a2 rename gather 2021-09-16 16:07:05 +08:00
7347157+joylvliang@user.noreply.gitee.com 6e59598f99 correct_wrong_info_when_using_ms_function_with_bprop 2021-09-16 14:12:55 +08:00
huangxinjing 0b89d5c9c4 fix batch size error 2021-09-16 10:56:40 +08:00
Guo Zhijian f49bacde09 fix: pyfunc hung when it's a yield func 2021-09-16 09:20:44 +08:00
i-robot 57b8c8e2d9 !23310 [MD] fix error message of mindrecord 
Merge pull request !23310 from liyong126/fix_log_msg
 2021-09-16 00:45:11 +00:00
i-robot e5af07d519 !23538 minddata error message optimize 
Merge pull request !23538 from luoyang/log_update
 2021-09-16 00:42:42 +00:00
i-robot 4a553c8d57 !16607 [assistant][Fade] 
Merge pull request !16607 from QingfengLi/Fade
 2021-09-15 14:54:16 +00:00
i-robot 87fac9a520 !23476 fix hung when user return Tensor in generator 
Merge pull request !23476 from guozhijian/fix_generator_hung_when_return_mindspore_tensor
 2021-09-15 10:17:24 +00:00
YangLuo 9d89de5765 minddata error message optimize 2021-09-15 18:05:02 +08:00
liyong 65f3365a2a fix mindrecord log 2021-09-15 16:18:40 +08:00
i-robot 0d914dd427 !22638 Add ut test for offline debugger 
Merge pull request !22638 from sabrinasun_59ee/ut
 2021-09-15 06:28:47 +00:00
jonyguo c408867085 fix: hung when user return Tensor in generator 2021-09-15 14:13:33 +08:00
i-robot 0a33f88d48 !23419 log error level information in python when GLOG_v=4 
Merge pull request !23419 from huangbingjian/exception_log
 2021-09-15 01:29:12 +00:00
i-robot bbdacd41f4 !20585 add security isolate for save_graphs 
Merge pull request !20585 from huanghui/add-security-isolate-for-DumpIR
 2021-09-15 01:25:46 +00:00
sabrinasun 3a349a9219 add ut test for offline debugger 2021-09-14 18:46:22 -04:00
xiefangqi a91c87c581 fix some syntax error 2021-09-14 21:29:02 +08:00
chenx2ovo 1a3196b052 [feat][assistant][I3CEGF] add op fade 2021-09-14 19:08:37 +08:00
i-robot db19a40280 !23365 add print op security 
Merge pull request !23365 from fangzehua/print_sec
 2021-09-14 09:01:31 +00:00
i-robot c6a99428cd !23153 Update the operator in order to let users better understand the reason for the error of the operator part: nn_ops and array_ops 
Merge pull request !23153 from dinglinhe/dlh_code_ms_I43QY0_nn_ops
 2021-09-14 06:33:39 +00:00
i-robot 2b4cdea48a !23331 batch parallel operator replace input shape from construct 
Merge pull request !23331 from yangzhenzhang/modify-batch-parallel-info
 2021-09-14 06:32:45 +00:00
huangbingjian 6ba47653bf log error level information in python when GLOG_v=4 2021-09-14 14:23:55 +08:00
huanghui ba66c0d491 add security isolate for save_graphs 2021-09-14 10:24:12 +08:00
i-robot 32c2b77595 !19093 [assistant][ops] Add new audio operator Biquad 
Merge pull request !19093 from 杨旭华/Biquad
 2021-09-14 01:52:01 +00:00
dinglinhe 9a8c1b3c73 array_ops error recti and others 2021-09-14 09:12:02 +08:00
i-robot 6dcfe64501 !23264 python serdes bug fix 
Merge pull request !23264 from zetongzhao/deserialize
 2021-09-13 15:53:05 +00:00
i-robot 0aa167cdf4 !23240 maybe max open files in mr or onehot fail in pytransform 
Merge pull request !23240 from guozhijian/fix_max_open_files_and_onehot
 2021-09-13 13:51:09 +00:00
i-robot e149a15ace !23002 Error log optimizer 
Merge pull request !23002 from zhangzhaoju/master_syntax
 2021-09-13 13:43:40 +00:00
i-robot dc45c64a78 !23207 Adding security isolation to debugger 
Merge pull request !23207 from sabrinasun_59ee/macro
 2021-09-13 12:07:29 +00:00
i-robot 5abd4821ce !23357 Add DatasetName method for out developer 
Merge pull request !23357 from xiefangqi/md_white_list_optimization
 2021-09-13 12:06:49 +00:00
i-robot 3e1d1ff4d3 !18671 [assistant][ops]New operator implementation, include SBUDataset 
Merge pull request !18671 from Wangsong95/sbu_dataset
 2021-09-13 11:56:13 +00:00
liannai 631f49f044 [feat][assistant][I3T96A] Add new audio operator Biquad 2021-09-13 19:18:50 +08:00
fangzehua 4ccc635a07 add print security 2021-09-13 17:45:36 +08:00
i-robot bdfd3877f8 !23300 Optimize of exception log of AD 
Merge pull request !23300 from YuJianfeng/dfx
 2021-09-13 09:35:18 +00:00
yangzhenzhang 1b8eb283e4 modify batch parallel info 2021-09-13 16:28:56 +08:00
zhangzhaoju 4296881a16 syntax 2021-09-13 15:20:53 +08:00
xiefangqi 465dd25d74 add virtual DatasetName method 2021-09-13 15:17:32 +08:00
sabrinasun 220245f592 add security isolation to online and offline debugger 2021-09-12 23:01:15 -04:00
i-robot 87381a1cf9 !17806 [assistant][ops] DcShift Op 
Merge pull request !17806 from 杨旭华/DCShift
 2021-09-13 01:29:14 +00:00
i-robot c9ff7242a4 !23298 minddata engine optimize white list error msg 
Merge pull request !23298 from xiefangqi/md_white_list_optimization
 2021-09-13 01:19:15 +00:00
Carry955 0ba84345b0 [feat][assistant][I3J6U3] add new audio operator DCShift 2021-09-11 23:58:18 -07:00
jonyguo da78a17730 fix: may max openfiles in mindrecord and onehot error in py_transform 
and cache_admin rpath
 2021-09-12 00:25:07 +08:00
yujianfeng 752bdde06d Optimize of exception log of AD 2021-09-11 18:07:50 +08:00
xiefangqi ff73e4ccd7 fix white list error msg 2021-09-11 17:36:23 +08:00
Isaac17555 53fc99b914 [feat][assistant][I3T96B]add new data operator LFilter 2021-09-11 02:05:43 -07:00
i-robot 0071667155 !23039 [Fallback] Fix previous block parameters problem and add test cases. 
Merge pull request !23039 from 张清华/opt_fallback
 2021-09-11 07:39:02 +00:00
i-robot a61c2c5cfe !17885 [assistant][ops]Add new operator EqualizerBiquad 
Merge pull request !17885 from YJfuel123/EqualizerBiquad
 2021-09-11 06:40:29 +00:00
i-robot 9b7a966174 !21262 [assistant][ops]New operator implementation, include SparseApplyRMSPropD 
Merge pull request !21262 from 梁秀波/SparseApplyRMSPropD
 2021-09-11 06:01:29 +00:00
i-robot 76fac95591 !23069 Modify error content 
Merge pull request !23069 from huchunmei/master
 2021-09-11 03:50:52 +00:00
YJfuel123 16150d394f [feat][assistant][I3ALd1] add new operator EqualizerBiquad 2021-09-11 10:36:20 +08:00
ckczzj af97ba4a77 [feat][assistant][I3J6VH] add new data operator SBU 2021-09-11 09:58:17 +08:00
zetongzhao 719a207040 deserialize fix 2021-09-10 15:19:59 -04:00
i-robot 7b4f361ca7 !23232 Fix multiprocessing attr error 
Merge pull request !23232 from xiefangqi/md_fix_map_pool_issue
 2021-09-10 14:59:40 +00:00
i-robot 6d709c7254 !19624 [assistant][ops] Add new dataset operator DIV2K. 
Merge pull request !19624 from Rainfor/div2k
 2021-09-10 14:59:21 +00:00
xiefangqi 66c5f937dd fix attr failed problem 2021-09-10 18:01:04 +08:00
wangkc123 3daf3a4d5f [feat] [assistant] [I3CKEK] add new dataset operator DIV2K 2021-09-10 17:55:34 +08:00
Zhang Qinghua bcfb274074 [Fallback] Fix previous block parameters problem, and add test cases. 2021-09-10 16:43:46 +08:00
robert_luo_yibo ce71699734 [feat][assistant][I3CEG5] add new data OP MuLawDecoding 2021-09-10 15:49:46 +08:00
huchunmei c75773cf37 Modify error content 2021-09-10 15:21:33 +08:00
i-robot 32cc5d79b0 !18670 [assistant][ops]New operator implementation, include USPSDataset 
Merge pull request !18670 from Wangsong95/usps_dataset
 2021-09-10 03:06:19 +00:00
i-robot f91e1440c8 !17810 [assistant][ops][DeemphBiquadOp] 
Merge pull request !17810 from Isaac/DeemphBiquad
 2021-09-10 03:05:41 +00:00
i-robot 2cc8c851c5 !23141 mkdir rank_id 0909 
Merge pull request !23141 from mindspore_ding/mkdir_rankid_master_0909
 2021-09-10 02:45:54 +00:00
i-robot 725cf63118 !23187 upgrade Ascend software package 09 Sep 21 
Merge pull request !23187 from yanghaoran/upgrade_ascend_0909
 2021-09-10 01:55:13 +00:00
i-robot 0abff9ad65 !23108 Fix spelling error for transformer 
Merge pull request !23108 from huangxinjing/fix_spell_error
 2021-09-10 01:29:32 +00:00
ckczzj d7c702e9d4 [feat][assistant][I3J6VL] add new data operator USPS 2021-09-09 21:46:57 +08:00
yanghaoran 0ced8775c4 upgrade Ascend software package 09 Sep 21 2021-09-09 20:30:22 +08:00
huangxinjing e02f553010 Fix spell error and add mode check 2021-09-09 18:50:53 +08:00
i-robot 5c72e9d7c6 !23078 Get bprop from python when the bprop mindir dir does not exist 
Merge pull request !23078 from YuJianfeng/bprop_mindir
 2021-09-09 09:51:14 +00:00
i-robot e37b7374ae !22434 [MoE] Adding a MoE implementation 
Merge pull request !22434 from Xiaoda/84-add-moe-layer
 2021-09-09 09:06:56 +00:00
dingpeifei 992d6a6dbc mkdir rank_id 2021-09-09 16:14:54 +08:00
i-robot 936940da8e !22666 [assistant][ComplexNorm] 
Merge pull request !22666 from QingfengLi/ComplexNorm
 2021-09-09 06:41:53 +00:00
Isaac 5dc6c7fe96 [feat][assistant][I3J6U6]add new data operator DeemphBiquad 2021-09-09 14:34:24 +08:00
Xiaoda Zhang 5613c0b974 add a moe implementation: 
1) extend the Liner cell for including BatchMatMul implementation, in
which the first dimension indicates the expert number;
2) implement a Switch (top1) router;
3) implement a MoE cell, which extends the FeedForward cell.
 2021-09-09 11:53:42 +08:00
i-robot 9ad56e86ab !17846 [assistant][ops]Add new operator HighpassBiquad 
Merge pull request !17846 from YJfuel123/HighpassBiquad
 2021-09-09 02:06:41 +00:00
i-robot a918783f1a !22623 Add Random operation with Multi Field 
Merge pull request !22623 from shenwei41/operation_dev
 2021-09-09 01:49:04 +00:00
yujianfeng dfe1b05b28 Get bprop from python when the bprop mindir dir does not exist 2021-09-09 09:05:19 +08:00
i-robot b21da536d3 !22784 serdes python operations by pyfunc 
Merge pull request !22784 from zetongzhao/deserialize
 2021-09-08 17:18:57 +00:00
zetongzhao 0d389f3f0c serdes python operations 2021-09-08 09:05:11 -04:00
shenwei41 a8d02ab782 Add Random operation with MultiField 2021-09-08 19:29:23 +08:00
i-robot 938324b397 !19362 [assistant][ops] Add new dataset operator Cityscapes. 
Merge pull request !19362 from Rainfor/cityscapes
 2021-09-08 09:14:43 +00:00
i-robot 77424eaad5 !23004 Add args Check for Transformer 
Merge pull request !23004 from huangxinjing/args_check
 2021-09-08 08:24:06 +00:00
yaoyuan 85a1b55b47 [feat] [assistant] [I3ALCL] add new operator HighpassBiquad 2021-09-08 15:12:40 +08:00
huangxinjing 6cea07f749 Add args check 2021-09-08 09:12:35 +08:00
i-robot b1be8dfd31 !22851 MD Profiling: Update Connector Init to Remove any existing file 
Merge pull request !22851 from cathwong/ckw_mon_seq_pipelines_fix
 2021-09-07 19:57:58 +00:00
i-robot d37d57d0fd !22941 parallel_sparse_attention_ops_fix_repeated_cal 
Merge pull request !22941 from yao_yf/parallel_sparse_attention_ops_fix_repeated_cal
 2021-09-07 13:26:19 +00:00
i-robot 5cf19e8aa6 !22986 Add supported namespace for fallback. 
Merge pull request !22986 from 张清华/opt_fallback
 2021-09-07 12:50:32 +00:00
Zhang Qinghua 6edea0ed3c Add supported namespace for fallback. 2021-09-07 16:19:25 +08:00
i-robot 5ed105ec01 !22933 Tensor support complex scalar number input 
Merge pull request !22933 from zhouyaqiang0/complex_ops
 2021-09-06 13:29:21 +00:00
i-robot 990d561ed9 !22974 Fix ut/python/dataset generator 14 occationally segment fault 
Merge pull request !22974 from xiefangqi/md_fix_generator_problem
 2021-09-06 12:25:22 +00:00
yao_yf 3ef26288a2 parallel_sparse_attention_ops_fix_repeated_cal 2021-09-06 19:57:22 +08:00
i-robot 05a0898352 !22843 Support fallback feature in Graph mode. 
Merge pull request !22843 from 张清华/opt_fallback
 2021-09-06 11:35:45 +00:00
xiefangqi 57f68d35bd fix generator 14 ut problem 2021-09-06 19:01:51 +08:00
zhouyaqiang 4e07873378 Tensor support complex input 2021-09-06 18:44:26 +08:00
Zhang Qinghua 7203989c26 Support fallback feature in Graph mode (1). 2021-09-06 16:00:03 +08:00
lilei 62e832eaab modify parallel API 2021-09-06 11:45:10 +08:00
i-robot fa12d62d4d !21776 set device_id master 0813 
Merge pull request !21776 from mindspore_ding/set_device_id_master_0813
 2021-09-06 03:02:58 +00:00
Cathy Wong bc85c606b8 MD Profiling: Update Connector Init to Remove any existing file 
to fix sequential pipeline scenario.
 2021-09-03 15:45:38 -04:00
yao_yf 3ca73a6d6b broadcast using seqarates world group 2021-09-03 11:21:36 +08:00
i-robot 60d583190b !22815 Update bprop error information 
Merge pull request !22815 from JoyLvliang/update_bprop_error_information
 2021-09-03 01:31:15 +00:00
i-robot 90c7804d6b !22500 Sort watchpoint hit for offline debugger based on time stamps of dump files 
Merge pull request !22500 from parastooashtari/offline_wp_hit_order
 2021-09-02 14:47:06 +00:00
dingpeifei b4bc6000dc set device id master 0813 2021-09-02 20:51:50 +08:00
7347157+joylvliang@user.noreply.gitee.com 14d24d4793 update_bprop_error_information 2021-09-02 20:40:55 +08:00
i-robot bbbd6e0254 !22579 modify resizebilinear infer type 
Merge pull request !22579 from Simson/opinfer
 2021-09-02 01:02:00 +00:00
i-robot 3368287aab !22620 add util: browse dataset 
Merge pull request !22620 from luoyang/browse_dataset
 2021-09-02 01:00:46 +00:00
Parastoo Ashtari 65d8272352 sort wp hit for offline debugger with time stamp 2021-09-01 14:40:33 -04:00
robert_luo_yibo 3d58da9023 [fix][assistant][I47V0O] fix bug about the wrong output in the operator ComplexNorm 2021-09-01 17:55:38 +08:00
YangLuo 97c1ba380f add util: browse dataset 2021-09-01 16:13:32 +08:00
i-robot d87d0e07c2 !22255 recompute_interface_modify 
Merge pull request !22255 from yao_yf/recompute_interface_modify
 2021-09-01 08:09:36 +00:00
i-robot fc9d4ed659 !17813 [assistant][ops] Add new audio operator Contrast 
Merge pull request !17813 from 杨旭华/Contrast
 2021-09-01 06:38:05 +00:00
yao_yf 39055af6e4 recompute interface modify 2021-09-01 10:59:59 +08:00
i-robot cc8d614b25 !22650 fixed sparse attention modify 
Merge pull request !22650 from yao_yf/fixed_sparse_attention_modify
 2021-09-01 01:29:45 +00:00
simson 7a2fbdda85 modify resizebilinear infer type 2021-09-01 09:03:55 +08:00
wangkc123 70f741bcc1 [feat] [assistant] [I3CKEM] add new dataset operator Cityscapes 2021-08-31 20:03:37 +08:00
Feve1986 82b04d6a1e [feat][assistant][I40FFX] add new Ascend operator SparseApplyRMSPropD 2021-08-31 17:28:38 +08:00
i-robot 389f3a6b6c !21835 make alltoall and neighborexchange to be interface && revert pr 21395 
Merge pull request !21835 from zhoufeng/revert-same-input-to-comm-op
 2021-08-31 08:53:46 +00:00
yao_yf 82889ec56b fixed sparse attention 2021-08-31 16:11:56 +08:00
i-robot 740c62cbaa !22384 amend_assigin 
Merge pull request !22384 from jiangzhenguang/amend_assigin
 2021-08-31 06:55:02 +00:00
tongyue 329526dea8 [feat][assistant][I3J6U0] add new data operator Contrast 2021-08-30 19:34:37 -07:00
i-robot bbf9c6a9ad !22529 fix: for loop dataset iterator will cause memory leak 
Merge pull request !22529 from guozhijian/fix_for_loop_ds_iter_memory_leak
 2021-08-31 01:15:58 +00:00
jiangzhenguang 8812c8fe9b amend assign 2021-08-31 09:10:21 +08:00
yao_yf 68dd138462 add parallel sparse attention ops: dsd_matmul 2021-08-30 18:46:52 +08:00
i-robot 5b8f9ff398 !22096 add parallel sparse attention ops 
Merge pull request !22096 from yao_yf/parallel_sparse_attention_ops
 2021-08-30 10:43:05 +00:00
i-robot 37ecdba742 !20829 [assistant][ops]New operator implementation, include ApplyAdagradDA 
Merge pull request !20829 from 梁秀波/ApplyAdagradDAD
 2021-08-30 09:16:19 +00:00
zhoufeng ecae690a19 Revert "fix same node is used by two comm op" 
This reverts commit b09d411dc4.

add AlltoAll and NeighborExchange as interface
 2021-08-30 16:54:38 +08:00
i-robot a47ab8d643 !18073 [assistant][ops]Add new operator LowpassBiquad 
Merge pull request !18073 from YJfuel123/LowpassBiquad
 2021-08-30 08:33:39 +00:00
i-robot ff2e34b9f9 !22509 Add ut and st for Jvp, Vjp and Grad 
Merge pull request !22509 from LiangZhibo/fix
 2021-08-30 08:21:54 +00:00
jonyguo 4c915fdcbb fix: for loop dataset iterator will cause memory leak 2021-08-30 16:08:26 +08:00
zx 0efbedd23c [feat][assistant][I40FFF] add new Ascend operator ApplyAdagradDA 2021-08-30 11:01:18 +08:00
liyong 5a4ff8cfdb fix ci issue 2021-08-30 10:18:06 +08:00
yao_yf b8a9cbe2a3 add cus_matmul_dds parallel ops 2021-08-30 09:44:48 +08:00
Zhang Qinghua a137fa1d0b Optimize the Executors routines. 
- Fix the key generating.
- Distinguish the executors.
 2021-08-28 17:36:12 +08:00
l00591931 98fad9f08e Add st and ut for jvp vjp and grad 2021-08-28 17:34:23 +08:00
i-robot 535877a47b !22014 Add Fixed Sparse Attention 
Merge pull request !22014 from zhihenghu/add_sparse_attention
 2021-08-28 07:13:01 +00:00
zhihenghu ce12c02343 Add Sparse Attention 
adjut the file structure and name

Deleted extra information

Do some formatting work

Add test case and fix some document

fix imports
 2021-08-28 11:50:58 +08:00
i-robot 1639023909 !22263 Add convertcolor operation 
Merge pull request !22263 from shenwei41/operation_dev
 2021-08-27 12:33:43 +00:00
i-robot dd907a4d91 !22135 rank id master 0820 
Merge pull request !22135 from mindspore_ding/rank_id_master_0816
 2021-08-27 08:51:05 +00:00
i-robot ebe75e403b !22444 Apply comments on tensor stat online and offline PR 
Merge pull request !22444 from parastooashtari/tensor_level_info_online
 2021-08-27 07:42:51 +00:00
d00455729 34262db65e create rank_id dic 2021-08-27 14:24:06 +08:00
liyong c257cf36e2 refactor mindrecord 2021-08-27 09:15:05 +08:00
Parastoo Ashtari bf034bddb5 Apply comments on tensor stat online and offline debugger 2021-08-26 17:40:01 -04:00
i-robot cd4081ac87 !20676 [assistant][ops] Add array operator SplitV 
Merge pull request !20676 from 孟权令/SplitV
 2021-08-26 13:54:40 +00:00
shenwei41 1295744524 Add ConvertColor Operation 2021-08-26 21:14:28 +08:00
i-robot e6e1f37ae4 !22346 [Core] Fix the bug of scope setting when cloning nodes 
Merge pull request !22346 from Xiaoda/86-fix-the-fullname-scope-bug
 2021-08-26 13:04:15 +00:00
i-robot e753a3f70a !22416 Transform device_id to rank_id for hccl 
Merge pull request !22416 from 张毅辉/Device_id_to_rank_id
 2021-08-26 12:09:38 +00:00
haizhouye d96d9e64b0 [feat] [assistant] [I3ALCA] add new LowpassBiquad operator 
[feat] [assistant] [I3ALCA] add new LowpassBiquad operator

bugfix

fix

fix
 2021-08-26 18:49:21 +08:00
i-robot 7083ec9d37 !21925 add pad mode to maxpool3d 
Merge pull request !21925 from jiangzhenguang/amend_maxpool3d
 2021-08-26 09:08:37 +00:00
i-robot 8d00a8d803 !22360 Fix Transformer Mirror Error 
Merge pull request !22360 from huangxinjing/fix_transformer_mirror_error
 2021-08-26 08:16:33 +00:00
zhangyihui 3e5cb3b506 fix bugs for device_id_to_rank_id 2021-08-26 16:15:18 +08:00
i-robot 28e63116f2 !21921 Re-enabling offline debugger ut test 
Merge pull request !21921 from sabrinasun_59ee/uttest
 2021-08-26 07:50:01 +00:00
i-robot 471c57d3d7 !20046 [assistant][ops] Add New MaskedFill 
Merge pull request !20046 from 孟权令/MaskedFill
 2021-08-26 07:43:18 +00:00
i-robot a646eb27ab !21616 modify ms function cache key 
Merge pull request !21616 from chujinjin/modify_ms_function_cache_key
 2021-08-26 07:36:50 +00:00
i-robot 0faf36d5c5 !22187 modify api comment 
Merge pull request !22187 from changzherui/mod_dir_auth
 2021-08-26 03:01:33 +00:00
i-robot 07eaa1969b !22344 fix compile error when weight is used in while condition 
Merge pull request !22344 from xychow/fix-while-loop-with-weight-in-condition
 2021-08-26 03:00:38 +00:00
Xiaoda Zhang b2703879c6 fix the scope setting error when cloning nodes 2021-08-26 10:25:38 +08:00
i-robot edcbb68d71 !22386 fix neighborexchange empty input case 
Merge pull request !22386 from zhoufeng/fix-neighbor-empty-input-bak
 2021-08-26 01:52:10 +00:00
i-robot 5aeec398bb !22369 add test cases for conv2d 
Merge pull request !22369 from yangzhenzhang/add-test-cases
 2021-08-26 01:46:10 +00:00
i-robot 457a01fd09 !20055 [assistant][ops] Add math operator IndexAdd 
Merge pull request !20055 from 孟权令/IndexAdd
 2021-08-26 01:15:39 +00:00
sabrinasun a9c6bf45a3 re-enabling offline debugger ut test 2021-08-25 19:05:19 -04:00
changzherui 46319f3198 modify comment 2021-08-26 00:44:44 +08:00
zhoufeng e5a1582e4b fix neighborexchange empty input case 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-08-25 21:41:22 +08:00
huangxinjing 62496d75f3 less the interface exposed 2021-08-25 21:22:40 +08:00
i-robot 956ae2bbfd !22223 [assistant][TimeMask and FreqMask] 
Merge pull request !22223 from QingfengLi/TimeFreqMask
 2021-08-25 10:43:24 +00:00
i-robot acee9b24bc !22284 Change Op name in hccl to Op name in step trace 
Merge pull request !22284 from 张毅辉/op_name_of_hccl_to_op_name_of_step_trace
 2021-08-25 09:32:55 +00:00
yangzhenzhang 0b9b2a9458 add test cases 2021-08-25 17:22:20 +08:00
jiangzhenguang 8a78b2b7f6 add pad mode to maxpool3d 2021-08-25 16:24:02 +08:00
i-robot 60634c5d11 !21745 Unified format of single machine and multi machine performance data directory 
Merge pull request !21745 from 张毅辉/Device_id_to_rank_id
 2021-08-25 07:49:29 +00:00
doit a5193df648 [feat] [assistant] [I3T92B] add new array operator MaskedFill 2021-08-25 15:29:37 +08:00
i-robot 36238032a2 !22245 Add pynative switch layer ut test case 
Merge pull request !22245 from zjun/switch_layer_ut_test
 2021-08-25 07:24:28 +00:00
chujinjin 551fa9ab8b modify ms function cache key 2021-08-25 14:40:45 +08:00
hulx c70731d601 [feat][assistant][I3T924] add new math operator IndexAdd 2021-08-25 14:19:17 +08:00
zhangyihui dab750d1a5 Mapping op_name of hccl to op_name of step trace 2021-08-25 10:51:52 +08:00
chenx2ovo 2f1d974eeb [fix] [assistant] [I465ZG] revise error message and change input param datatype 2021-08-25 10:47:27 +08:00
i-robot 698eb406e2 !20129 [assistant][ops] Add math operator Erfinv 
Merge pull request !20129 from 孟权令/Erfinv
 2021-08-25 02:44:18 +00:00
i-robot 2edaba38bf !21389 Add Tensor Base and Stat info to offline debugger 
Merge pull request !21389 from parastooashtari/tensor_info_levels
 2021-08-25 02:08:34 +00:00
i-robot 0adacd1b68 !22226 [AutoParallel]Refacor pipeline code 
Merge pull request !22226 from lichen/Refactor_part_of_pipeline
 2021-08-25 01:54:18 +00:00
zhangyihui 3d19949eb4 device_id to rank_id 2021-08-25 09:52:23 +08:00
zhousiyi 44bdcb101c fix while loop compile error when weight is used in while condition 2021-08-25 01:33:34 +00:00
i-robot 4e81ea7bb0 !22300 Add ut and st case for non tensor input in pynative 
Merge pull request !22300 from JoyLvliang/add_st_ut_case_for_pynative_non_tensor_input
 2021-08-25 01:23:34 +00:00
Parastoo Ashtari ff83dee704 Add tensor base and stat info to offline debugger 2021-08-24 18:19:59 -04:00
lichenever 5812076512 Refactor_part_of_pipeline 2021-08-24 21:37:41 +08:00
hulx ca6f3ef155 [feat][assistant][I3T925] add new math operator Erfinv 2021-08-24 21:25:04 +08:00
i-robot 661c83e17f !22274 MD Profiling UT: Use pytest setup and teardown 
Merge pull request !22274 from cathwong/ckw_mon_py_analyze_ut5
 2021-08-24 13:24:49 +00:00
i-robot 1e47ff7bc3 !22108 modify check strategy for conv2d 
Merge pull request !22108 from yangzhenzhang/modify-check-strategy-for-conv2d
 2021-08-24 12:01:23 +00:00
hedongdong 09bc1bddf1 [feat][assistant][I3T92H] add new array operator SplitV 2021-08-24 19:54:26 +08:00
i-robot ab758a981c !20044 [assistant][ops] Add New Lerp 
Merge pull request !20044 from 孟权令/Lerp
 2021-08-24 11:25:44 +00:00
7347157+joylvliang@user.noreply.gitee.com a30800ecc3 add_st_ut_case_for_pynative_non_tensor_input 2021-08-24 16:44:05 +08:00
i-robot 822cedec0a !22153 Convert some ops bprops to mindir 
Merge pull request !22153 from YuJianfeng/bprop_mindir
 2021-08-24 08:07:46 +00:00
yangzhenzhang f1afaeac5a modify check strategy for conv2d 2021-08-24 16:06:16 +08:00
zjun 779b655cfe Add switch_layter pynative ut test 
Signed-off-by: zjun <zhangjun0@huawei.com>
 2021-08-24 11:21:13 +08:00
i-robot 6082835501 !22146 dataset: support return bytes in GeneratorDataset 
Merge pull request !22146 from ms_yan/decode_bytes
 2021-08-24 02:41:18 +00:00
Cathy Wong 3581e7962e MD Profiling UT: Use pytest setup and teardown 2021-08-23 21:09:48 -04:00
yujianfeng 712b9bd013 convert some ops bprops to mindir 2021-08-24 09:09:09 +08:00
i-robot db44b88e1e !22094 MD Profiling: For mismatch op info btwn files, skip bottleneck analysis 
Merge pull request !22094 from cathwong/ckw_mon_py_analyze_fixes3
 2021-08-23 18:28:51 +00:00
ms_yan 6ecfc34524 add np.frombuffer to support return bytes 2021-08-23 17:31:38 +08:00
ms_yan 36a8886ca2 Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset" 
This reverts commit b077aa1cab.

Revert "[feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset"

This reverts commit 4e6f7dc97d.

delete pass_registry_test.cc

comment  hiai_nlu_model_multi.pb related  line
 2021-08-23 01:46:38 +08:00
djc b077aa1cab [feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset 2021-08-22 16:26:45 +08:00
djc 4e6f7dc97d [feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset 2021-08-22 13:39:37 +08:00
i-robot 0e7844daa9 !22093 revert merge request 21685 
Merge pull request !22093 from guozhijian/revert-merge-21685-master
 2021-08-21 09:25:32 +00:00
i-robot 4ba337e0f5 !16667 [assistant][ComplexNorm] 
Merge pull request !16667 from QingfengLi/ComplexNorm
 2021-08-21 02:44:18 +00:00
doit bf23333b27 [feat] [assistant] [I3T927] add new math operator Lerp 2021-08-20 20:19:41 +08:00
i-robot f34426095c !22084 Move Transformer Code from Mindspore.nn.parallel to mindspore.parallel.nn 
Merge pull request !22084 from huangxinjing/transformer_doc_check
 2021-08-20 10:40:01 +00:00
huangxinjing d777742904 1. Move the class to mindspore.parallel, support activation sharding 2021-08-20 14:34:10 +08:00
i-robot 954864bfba !22037 incoroporate getitem if indexed node is zeros_like 
Merge pull request !22037 from xychow/always-incorporate-getitem-if-zeros-like
 2021-08-20 02:14:35 +00:00
i-robot 5d1bb097e2 !22052 Fix probability core dump in MindData coverage test 
Merge pull request !22052 from luoyang/issues2
 2021-08-20 01:18:06 +00:00
robert_luo_yibo d837cbee0f [feat][assistant][I3CEG8] add new data operator ComplexNorm 2021-08-20 09:07:21 +08:00
Cathy Wong 85931175bc MD Profiling: For mismatch op info btwn files, skip bottleneck analysis. 
Add to summary output: per_pipeline_time and per_push_queue_time.
Enhance UT
 2021-08-19 12:19:59 -04:00
guozhijian e1df9a2152 revert 'Pull Request !21685 : add function to invert_op' 2021-08-19 22:49:51 +08:00
i-robot 4113aee7d6 !18668 [assistant][ops]New operator implementation, include Flowers102Dataset 
Merge pull request !18668 from Wangsong95/flowers102_dataset
 2021-08-19 08:41:44 +00:00
YangLuo 9352935ff6 Fix probability core dump in MindData coverage test 2021-08-19 14:34:57 +08:00
i-robot c93bb9936e !20011 [assistant][ops] Add nn operator Roll 
Merge pull request !20011 from 孟权令/Roll
 2021-08-19 06:28:28 +00:00
i-robot 3ad641cb65 !21685 add function to invert_op 
Merge pull request !21685 from Killer/fake_killer
 2021-08-19 05:13:39 +00:00
zhousiyi dcd374961e incoroporate getitem if indexed node is zeros_like so AddN(MakeTuple(x, zeros_like)) can be optimized 2021-08-19 03:28:24 +00:00
fake_killer b0bc4bf5da [feat] [assistant] [I44TRS] extend invert_op's function 2021-08-18 21:46:15 +08:00
i-robot dde05c36b8 !21551 auto_parallel_context interface dataset_strategy union 
Merge pull request !21551 from yao_yf/auto_parallel_context_dataset_strategy_union
 2021-08-18 09:03:18 +00:00
i-robot 415275ae17 !21805 support adafactor model parallel 
Merge pull request !21805 from yangzhenzhang/auto-parallel-support-adafactor-opt
 2021-08-18 07:20:39 +00:00
hedongdong d76ed25e96 [feat][assistant][I3T92I] add new nn operator Roll 2021-08-18 10:15:17 +08:00
i-robot 264cb4d2e8 !21920 MD Profiling Analyze: Search for device trace file, independent of device_target 
Merge pull request !21920 from cathwong/ckw_mon_py_analyze_device_file
 2021-08-18 00:57:50 +00:00
i-robot 0d839fa7c6 !21809 Improved Transformer Struture and Add Args Check 
Merge pull request !21809 from huangxinjing/transformer_improved
 2021-08-17 12:05:25 +00:00
i-robot a77a0b968d !21761 comm_recompute_interface. 
Merge pull request !21761 from yao_yf/comm_recompute_interface
 2021-08-17 09:14:29 +00:00
yangzhenzhang 7ca64d2235 auto parallel support adafactor opt 2021-08-17 10:36:42 +08:00
yao_yf 5277b229be add cell comm recompute interface 2021-08-17 09:23:21 +08:00
Cathy Wong a2cbd4b5fa MD Profiling Analyze: Search for device trace file 
MinddataProfilingAnalyzer() - remove device_target input parm
 2021-08-16 15:41:11 -04:00
huangxinjing 18044aff0f 1. Add docstring, elimitate attention mask, tuple append the deocoder return layer past 
split attention inputs from two into three

Add input check and modify test case

Fix check error and add check to transformer inputs

add input check to the transformers
 2021-08-16 21:08:48 +08:00
Xiao Tianci aae886bcd7 fix crowd contributing code 2021-08-16 19:33:10 +08:00
yao_yf a83bf73298 union auto_parallel_context interface dataset_strategy 2021-08-16 10:54:46 +08:00
i-robot 530da3e37e !21527 fix_reshape_reshape_in_auto_parallel 
Merge pull request !21527 from yao_yf/fix_reshape_reshape_in_auto_parallel
 2021-08-13 08:29:15 +00:00
i-robot f99effd430 !21755 Fix batch usability problem 
Merge pull request !21755 from xiefangqi/md_fix_batch_usability
 2021-08-13 07:21:49 +00:00
i-robot d1112f8e9c !17631 [assistant][FrequencyMasking] 
Merge pull request !17631 from QingfengLi/FreqMask
 2021-08-13 06:48:06 +00:00
xiefangqi e4894a1bf1 fix batch usability problem 2021-08-12 20:12:43 +08:00
i-robot 2650aae9ba !21351 complex support 
Merge pull request !21351 from zhouyaqiang0/complex_support
 2021-08-12 09:39:15 +00:00
chenx2ovo 53615010a3 [feat][assistant][I3CEGG] add new data OP FrequencyMasking 2021-08-12 15:28:30 +08:00
yao_yf e233880e41 fix reshape depend reshape in auto parallel 2021-08-12 11:45:28 +08:00
i-robot bff5cbda9c !21670 fix: null numpy field in mindrecord will cause read error 
Merge pull request !21670 from guozhijian/fix_null_numpy_field_in_mr
 2021-08-12 03:39:34 +00:00
zhouyaqiang b81ba100b7 add complex number support 2021-08-12 10:36:43 +08:00
i-robot 63445ff6fd !21627 alltoall exception handle 
Merge pull request !21627 from zhoufeng/alltoall_exception
 2021-08-12 01:40:22 +00:00
i-robot 6320bf6b7b !21676 check strategy for conv2d 
Merge pull request !21676 from yangzhenzhang/check-strategy-for-conv2d
 2021-08-12 01:29:37 +00:00
i-robot 73b55cff72 !20794 add adafactor 
Merge pull request !20794 from jiangzhenguang/add_adafactor_optimizer
 2021-08-12 01:27:03 +00:00
yangzhenzhang d18c813ee4 check strategy for conv2d 2021-08-11 19:12:48 +08:00
zhoufeng 03a56f2bb0 alltoall exception handle 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-08-11 17:30:49 +08:00
jonyguo 42b3512a1b fix: when field is none in mr 2021-08-11 17:11:38 +08:00
jiangzhenguang a3bb780ce4 optimize run memory 2021-08-10 20:45:25 +08:00
chenx2ovo e72acf362c [feat][assistant][I3CEGH] add op timemasking 2021-08-10 12:06:07 +08:00
i-robot f154db1bb0 !20680 [assistant][ops] Add New SoftMarginLoss and SoftMarginLossGrad 
Merge pull request !20680 from 孟权令/SoftMarginLoss
 2021-08-10 02:39:28 +00:00
i-robot 4aaa8126a0 !21528 Add Parallel Print Support 
Merge pull request !21528 from huangxinjing/add_print
 2021-08-09 10:55:04 +00:00
i-robot dc626617fc !19526 [assistant][TimeStretch] 
Merge pull request !19526 from QingfengLi/TimeStretch
 2021-08-09 09:40:38 +00:00
i-robot 75429acbe3 !21519 fix waring 
Merge pull request !21519 from shenwei41/fix_sqlite
 2021-08-09 09:09:18 +00:00
shenwei41 59efbb88ec fix waring 2021-08-09 11:40:52 +08:00
i-robot 8306abeb67 !21168 Only replace the primal user with tuple_getitem once 
Merge pull request !21168 from YuJianfeng/ad
 2021-08-09 03:19:07 +00:00
huangxinjing 92bad162bd Add print 2021-08-09 11:14:25 +08:00
chenx2ovo 04705e5b0d [feat][assistant][I3CEGC] add op timestretch 2021-08-07 22:53:41 +08:00
i-robot c84e09cf45 !21072 Deserialize - python binding 
Merge pull request !21072 from zetongzhao/deserialize_1
 2021-08-06 21:47:09 +00:00
zetongzhao 4f199b548c deserialize and tests 2021-08-06 13:35:27 -04:00
yujianfeng cf4121126a Only replace the primal user with tuple_getitem once 2021-08-06 19:23:14 +08:00
i-robot d2ae09d891 !21437 Support ListComp and GeneratorExp in Graph Mode. 
Merge pull request !21437 from 张清华/opt
 2021-08-06 09:09:47 +00:00
i-robot 51a1ca61f2 !21357 [MD] fix SlicePatches when dealing with some special tensor. 
Merge pull request !21357 from liyong126/fix_bug
 2021-08-06 08:58:27 +00:00
i-robot 8a8851dc52 !18667 Remove redundant depend 
Merge pull request !18667 from huangbingjian/remove_redundant_depend
 2021-08-06 07:43:53 +00:00