p47068915
/
mindspore
forked from mindspore-Ecosystem/mindspore
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
36,276 Commits 23 Branches 0 Tags 3.9 GiB
Commit Graph

7458 Commits

Author SHA1 Message Date
i-robot 6b92d9bd4d !27224 [ME] Optimize the error message of the operator module 
Merge pull request !27224 from Margaret_wangrui/operator
 2021-12-07 01:21:38 +00:00
RainWang6188 c4063f0f11 [feat][assistant][I3J6VI] add new data operator STL10 2021-12-07 01:21:11 +00:00
buxue d7dc539b6e fix sync GraphCell params data from device bug 2021-12-07 09:20:46 +08:00
tanghuikang b5528574d6 Delete error code assert in error manager test case 2021-12-07 09:13:01 +08:00
i-robot d723cc417d !27151 [ME][Fallback] [ME][Fallback] Support built-in type: complex and reversed. 
Merge pull request !27151 from Margaret_wangrui/fallback
 2021-12-07 01:04:14 +00:00
i-robot 8bcd6e3a86 !27287 [ME][Fallback] Handle interpret nodes in list. 
Merge pull request !27287 from Margaret_wangrui/list_interpret
 2021-12-07 01:02:12 +00:00
i-robot d1aa8d6cb5 !26995 fix:unexpected eiminate of tile 
Merge pull request !26995 from zhangzhaoju/master_bug_fix
 2021-12-07 00:58:44 +00:00
i-robot 18163f07aa !26851 Add compile cache st test cases 
Merge pull request !26851 from LiangZhibo/master
 2021-12-07 00:50:32 +00:00
Jimmy Qi b9d1a4920c Add statistic dump for ascend 2021-12-06 20:11:44 +00:00
lilei 05189459ab auto insert VirtualDataset node for master 2021-12-06 21:39:37 +08:00
Margaret_wangrui 6e5d625153 [ME][Fallback] Support built-in type: complex and reversed. 2021-12-06 21:15:30 +08:00
i-robot b1eae16a05 !22304 [assistant][ops]New operator implementation, include SVHNDataset 
Merge pull request !22304 from 王睿/svhn_dataset
 2021-12-06 12:30:13 +00:00
helloiSCSI 7cb5ed7676 add summart ops params valid check ut 2021-12-06 20:11:27 +08:00
郑昊 4ae41350a6 [feat][assistant][I3ALD1] add new method Spectrogram 2021-12-06 19:24:37 +08:00
i-robot b4716271bc !26892 ME compiler environment variables normalization 
Merge pull request !26892 from chenfei_mindspore/environment_variable_fix
 2021-12-06 11:16:57 +00:00
i-robot aeb2cccbe6 !27152 [bug]fix functional grad with grad_position twice bug 
Merge pull request !27152 from chenzhuo/grad
 2021-12-06 10:56:46 +00:00
lilei e933aa268b test_micro_batch_Interleaved 2021-12-06 18:37:21 +08:00
z00512249 a1b8c2f065 while inplace op for cpu backend 2021-12-06 17:41:40 +08:00
Margaret_wangrui 0f4a276b7e Optimize the error message of the operator module 2021-12-06 17:25:42 +08:00
Margaret_wangrui fa8506c0a7 [ME][Fallback] Handle interpret nodes in list. 2021-12-06 16:58:21 +08:00
l00591931 79f86d3fe2 Add test case for compile cache 2021-12-06 15:37:03 +08:00
zhangzhaoju 722086435d 1. fix:unexpected eiminate of tile 
2. fix:delay memory allocat in NewTensorFilledWithData
 2021-12-06 14:49:48 +08:00
i-robot 2d23b698a6 !27024 add allreduce fusion by size 
Merge pull request !27024 from jiahongQian/master
 2021-12-06 05:32:12 +00:00
i-robot db9b66242b !21823 [assistant][ops] Add data operator CharNGram 
Merge pull request !21823 from 张渝/CharNGram
 2021-12-06 03:46:31 +00:00
i-robot 7458863fd4 !27259 Fix MindAPI unit-test random failure 
Merge pull request !27259 from hewei/core_api
 2021-12-06 03:31:42 +00:00
looop5 ae5532fb9e pass lambda function to out_shape and out_dtype 2021-12-06 10:21:16 +08:00
He Wei 5e092985e4 Fix MindAPI unit-test random failure 
Remove improper assert line: `ASSERT_TRUE(p < q);`
 2021-12-06 09:50:24 +08:00
chenzhuo 287bcdd783 fix grad twice position bug 2021-12-06 09:39:42 +08:00
i-robot bf0142ae4b !27242 Add unit test for persistent storage 
Merge pull request !27242 from zyli2020/ps_cache_feature
 2021-12-06 01:22:11 +00:00
q00596439 de36fdc169 add allreduce fusion size and unify the interface 2021-12-05 21:35:11 +08:00
lizhenyu b1a42e3525 add unit test for persistent storage 2021-12-05 13:51:17 +08:00
zhangyuqwer e934381b08 [feat][assistant][I3ZSQV] add new data operator CharNGram 2021-12-04 22:09:34 +08:00
i-robot de7df755bb !27020 Support multiple start/stop calls for MD Profiler 
Merge pull request !27020 from Mohammad Motallebi/fix_multiple_start_stop
 2021-12-04 13:23:53 +00:00
i-robot d224c7dd18 !27192 fix error log 
Merge pull request !27192 from lianliguang/xbg
 2021-12-04 10:10:00 +00:00
RainWang6188 340b3b4d5d [feat][assistant][I3J6VJ] add new data operator SVHN 2021-12-04 08:19:47 +00:00
i-robot f5215745f4 !27121 Apply Autodiff in Custom Op 
Merge pull request !27121 from jiaoy1224/arithmetic
 2021-12-04 04:54:02 +00:00
mohammad af6e587c28 MD Profiler: support multiple start/stop calls 2021-12-03 23:25:38 -05:00
i-robot d3a047f63b !27202 move cpu csrtensor test case to lv1 
Merge pull request !27202 from 杨林枫/fix_csr_while_test_case
 2021-12-04 02:58:39 +00:00
i-robot d01a0f041b !26759 Enable Cann api callback feature and add corresponded testcases 
Merge pull request !26759 from TinaMengtingZhang/cann_api_adapt_test
 2021-12-04 02:53:57 +00:00
TinaMengtingZhang 16a19be56f Enable cann api allback register function 
Add testcases for cann api feature
 2021-12-03 17:36:15 -05:00
danishfarid faaa5d5f0a autotune step 
fix testing script default

updates and changed sampling function

comments addressed

comments addressed

comments addressed

moving isSinkCheckAbove

update - move CheckSinkFunction

fix
 2021-12-03 20:29:35 +00:00
lianliguang 40c3995b98 fix error log 2021-12-03 23:13:03 +08:00
markuskunej 84d38e547a Moved the offload operation check and map operation split from python (datasets.py) to c++ (NodeOffloadPass.cc). 
Updated check for offload in python (dataset_helper.py and
iterators.py).

Updated auto_offload test in test_map_offload.py.

Changed MapNode.offload type from bool->int in bindings.cc.

Changed manual offload flag from int->enum.
 2021-12-03 14:40:01 +00:00
i-robot fb85709604 !27181 Upgrade Ascend software package Desc 2 
Merge pull request !27181 from TronZhang/upgrade_ascend_1202
 2021-12-03 14:11:58 +00:00
i-robot 3866cfaf6e !27163 support op overflow consumption for A dump and A plus M dump 
Merge pull request !27163 from john_tzanakakis/jt_bug_fixes
 2021-12-03 12:45:06 +00:00
tronzhang 9d3c0499a5 upgrade ascend 1201 2021-12-03 19:43:51 +08:00
yanglf1121 bfabc2b89d temp fix csrtensor testcase 2021-12-03 17:19:02 +08:00
i-robot c4ba2c2ba1 !27187 update log 
Merge pull request !27187 from luoyang/code_docs_doc
 2021-12-03 08:57:18 +00:00
i-robot 1da503448f !27168 [AutoParallel]Add_Parallel_CN_API 
Merge pull request !27168 from lichen/add_CN_API
 2021-12-03 08:37:04 +00:00
chenfei c5c2b2f186 environment variables fix 
debug log
 2021-12-03 15:55:43 +08:00
i-robot 95af195d0c !26926 Provide new mindspore core API classes 
Merge pull request !26926 from hewei/core_api
 2021-12-03 07:52:59 +00:00
kswang 391a06aad1 set offload node 2021-12-03 15:29:01 +08:00
luoyang f3e1794a74 update log 2021-12-03 15:09:36 +08:00
i-robot 93db7f741f !20788 [assistant][ops] Add new dataset loading operator TedliumDataset 
Merge pull request !20788 from 杨旭华/TedliumDataset
 2021-12-03 06:29:29 +00:00
i-robot 8e4f3472d8 !27154 Enable the test for Parallel Optimizer 
Merge pull request !27154 from huangxinjing/enable_gradient_accumulation
 2021-12-03 06:23:53 +00:00
lichenever ae40fea111 add_CN_API 2021-12-03 14:12:43 +08:00
John Tzanakakis 9145dd9bba support op overflow consumption for A dump and A plus M dump 2021-12-02 22:57:35 -05:00
i-robot c0048bb117 !26953 Add some bprop mindir files 
Merge pull request !26953 from YuJianfeng/bprop_mindir
 2021-12-03 03:28:37 +00:00
i-robot de585722da !27150 code sync in mindspore fl 
Merge pull request !27150 from tan-wei-cheng-3260/develop-twc-sync2
 2021-12-03 03:16:41 +00:00
Yang Jiao 5acce31c72 apply autodiff in custom 2021-12-03 11:16:19 +08:00
He Wei d2bb6303b7 Provide new mindspore core API classes 
1. namespace is mindspore::api;
2. API header files located in mindspore/core/mindapi;
3. We use pimpl pattern to provide a wrapper layer for api;
4. Check mindapi_test.cc for usage examples.
 2021-12-03 11:03:22 +08:00
i-robot 8a2ce38ce1 !27114 Add LayoutProto to support pipeline for compile cache and solve import package problem. 
Merge pull request !27114 from LiangZhibo/mindir
 2021-12-03 02:53:12 +00:00
i-robot cc5cdca5ca !27148 thor测试用例修改 
Merge pull request !27148 from melody/master
 2021-12-03 02:33:14 +00:00
i-robot f9459a871a !27061 dataset: enhance kernel part log 
Merge pull request !27061 from ms_yan/kernel_enhance
 2021-12-03 01:26:07 +00:00
i-robot 9cec03e3a8 !27033 close autotune in non-sink mode 
Merge pull request !27033 from luoyang/close_autotune_nonsink
 2021-12-03 01:26:06 +00:00
huangxinjing 8c9b2b93a8 Add transformer 2021-12-03 09:08:57 +08:00
luoyang 9cbb45bcc4 close autotune in non-sink mode 2021-12-03 08:46:14 +08:00
i-robot 9ddd3fb66f !27085 [MD][UT]: Use pytest.mark.forked for profiling tests 
Merge pull request !27085 from cathwong/ckw_ut_prof_forked
 2021-12-02 17:00:28 +00:00
i-robot 881548452c !27031 Fix intermittent failure in callback_test.cc 
Merge pull request !27031 from h.farahat/callback_test_fix
 2021-12-02 16:44:54 +00:00
Cathy Wong 367e5ed1dd MD UT: Use pytest.mark.forked for profiling tests 2021-12-02 10:55:05 -05:00
ms_yan d2e0061656 enhance error msg 2021-12-02 22:35:30 +08:00
wmzheng2020 96979f05cc !27145 fix relative import path for RDR st 
Merge pull request !27145 from liangyongxiong/fix
 2021-12-02 14:19:46 +00:00
i-robot eb25c473d0 !27117 [ME][Fallback] Handle interpret nodes in tuple. 
Merge pull request !27117 from Margaret_wangrui/tuple_interpret
 2021-12-02 14:11:12 +00:00
i-robot fa457b2bfa !17832 [assistant][ops]New operator implementation, include KMnistDataset 
Merge pull request !17832 from 张璇/kmnist_dataset
 2021-12-02 14:00:36 +00:00
htchu 01cb5b3007 modify thor st 
modify test
 2021-12-02 20:43:12 +08:00
i-robot e4fb249c87 !27147 add some of dataset ut cases about createIterator columns 
Merge pull request !27147 from liucunwei/dataset-lcw-1029
 2021-12-02 12:29:29 +00:00
twc 63dac501e0 code sync in mindspore fl 2021-12-02 20:23:19 +08:00
i-robot 3e73e124ac !23225 [assistant][ops] Add Glove 
Merge pull request !23225 from 张渝/Glove
 2021-12-02 12:22:17 +00:00
i-robot 82542f1d4a !27108 code sync in federated learning 
Merge pull request !27108 from tan-wei-cheng-3260/develop-twc-sync2
 2021-12-02 11:57:55 +00:00
liangyongxiong 94298e9b90 fix relative import path for RDR st 2021-12-02 19:39:47 +08:00
i-robot eab0699c6d !26986 change MD error log 
Merge pull request !26986 from shenwei41/master
 2021-12-02 11:35:07 +00:00
liucunwei ac27fa2cff add some of dataset ut cases about createIterator columns 2021-12-02 19:20:55 +08:00
l00591931 62e474aaf1 Enable mindir for layout 2021-12-02 17:50:43 +08:00
i-robot 7c9dc30e78 !27101 check args for shard 
Merge pull request !27101 from yangzhenzhang/fix-bug-for-out-strategy
 2021-12-02 08:24:47 +00:00
Margaret_wangrui f7fc7f4238 [ME][Fallback] Handle interpret nodes in tuple 2021-12-02 15:36:54 +08:00
i-robot 53f50c0d6b !26880 [MD] fix mindrecord log message part02 
Merge pull request !26880 from liyong126/fix_mindrecord_log_msg_2
 2021-12-02 06:48:15 +00:00
i-robot 9a5814b6a4 !26937 fix pytest mark decorator for platform_x86_cpu 
Merge pull request !26937 from liangyongxiong/tests
 2021-12-02 06:44:27 +00:00
twc a5fcb08c00 code sync in federated learning 2021-12-02 14:41:56 +08:00
yangzhenzhang 7454b8f8f2 check args for shard 2021-12-02 11:51:29 +08:00
i-robot 3bff079969 !26896 Enhance error message of audio ops 
Merge pull request !26896 from xiaotianci/enhance_audio_err_message
 2021-12-02 03:42:35 +00:00
liyong d35e003def fix mindrecord log part02 2021-12-02 11:28:58 +08:00
i-robot ae94c51a97 !26930 fix bug of export mindir when using encrypt 
Merge pull request !26930 from lianliguang/mindir_load_2G
 2021-12-02 02:21:19 +00:00
luqilin 34bffbf768 [feat][assistant][I3T96H] add new dataset loading operator TedliumDataset 2021-12-02 09:53:39 +08:00
i-robot c621547d26 !26962 [Fallback] Process the interpret node in the return node 
Merge pull request !26962 from huangbingjian/fallback_return_tuple
 2021-12-02 01:53:04 +00:00
i-robot b00b1cc276 !26982 [ME][Fallback] Review the local dict and try to eval out the interpret node. 
Merge pull request !26982 from Margaret_wangrui/recheck_local_dict
 2021-12-02 01:09:12 +00:00
i-robot 9376195766 !26980 Fix cell dump is enabled issue when enabled=False 
Merge pull request !26980 from sabrinasun_59ee/cell
 2021-12-01 15:44:52 +00:00
yujianfeng 7c808ee792 Add some bprop mindir files 2021-12-01 19:44:06 +08:00
songyuanwei bf6a5d1408 modify 2021-12-01 17:17:05 +08:00
zy 8f9a09f79c [fix] [assistant] [I3ZSQR] add new data operator GloVe 2021-12-01 17:12:20 +08:00
shenwei41 5d48409395 change err info 2021-12-01 16:48:14 +08:00
i-robot 8e496e44f0 !22320 support heterogeneous for pynative mode 
Merge pull request !22320 from chujinjin/support_heterogeneous_for_pynative
 2021-12-01 08:34:44 +00:00
i-robot 6924866a87 !26746 [MD] minddata error msg optimize 
Merge pull request !26746 from xiefangqi/md_datasetops_error_msg_opt
 2021-12-01 07:18:18 +00:00
i-robot 0c6505db26 !22712 [assistant][ops] Add FastText 
Merge pull request !22712 from 无言/FastText
 2021-12-01 06:50:59 +00:00
i-robot c5fac5aba4 !26811 Support CSRTensor in while loop and subgraph 
Merge pull request !26811 from 杨林枫/csr_in_while
 2021-12-01 06:38:36 +00:00
liangyongxiong 05174c2115 fix pytest mark decorator for platform_x86_cpu 2021-12-01 14:15:36 +08:00
hesham 828120b784 Fix intermittent failure in callback_test.cc 2021-11-30 22:36:55 -05:00
i-robot 84d2e54871 !26959 TensorArray CPU 
Merge pull request !26959 from VectorSL/tensor-array-cpu
 2021-12-01 03:31:26 +00:00
zy 5ca98a494a [fix] [assistant] [I3ZSQS] add new data operator FastText 2021-12-01 11:12:08 +08:00
sabrinasun c095908772 fix enable=false still dump issue for cell dump 2021-11-30 22:10:20 -05:00
“uccInf” 92d6d31750 [feat][assistant][I3J6V7] add new data operator KMnist 2021-12-01 03:05:05 +00:00
chujinjin d20c9d93d8 support pynative heterogeneous 2021-12-01 10:18:59 +08:00
Margaret_wangrui ee1b4d4e6d [ME][Fallback] Review the local dict and try to eval out the interpret node 2021-12-01 10:02:26 +08:00
i-robot b6a6dbbe8f !27003 [Auto parallel] [Sharding propagation] Dealing with a parameter being used by mutiple ops 
Merge pull request !27003 from Xiaoda/114-adapting-sharding-propagation-for-common-parameter
 2021-12-01 02:01:34 +00:00
i-robot fcac7351aa !26801 add loss landscape ut and st 
Merge pull request !26801 from Songyuanwei/landscape_ci
 2021-12-01 01:49:43 +00:00
i-robot 5503deea2e !26998 add float32 to Batch Gmres 
Merge pull request !26998 from zhujingxuan/master
 2021-12-01 01:32:31 +00:00
i-robot eb9537af11 !21690 [assistant][ops] Add data operator Vectors 
Merge pull request !21690 from 张渝/Vectors
 2021-12-01 01:29:45 +00:00
Xiao Tianci b883498c93 enhance error message of audio ops 2021-12-01 09:27:04 +08:00
i-robot 1905b228b4 !26609 Update minddata log message 
Merge pull request !26609 from luoyang/log
 2021-12-01 01:25:11 +00:00
i-robot 9cb5120594 !26936 move testcases to scipy_st 
Merge pull request !26936 from zhujingxuan/move_tesecases
 2021-12-01 01:23:57 +00:00
lianliguang c7acd4b0ca fix bug of export mindir when using encrypt mode 2021-12-01 09:22:53 +08:00
i-robot bf59d75604 !26611 [MD] fix mindrecord log message part01 
Merge pull request !26611 from liyong126/fix_mindrecord_log_msg
 2021-12-01 01:12:48 +00:00
xiefangqi f74b5cea0c optimize datasetops error msg 2021-12-01 09:11:22 +08:00
VectorSL cb3d25c8f0 add cpu tensor array 2021-11-30 22:35:24 +08:00
i-robot 58fc9a6d81 !26985 fix the negative axis problem of reduce_eliminate 
Merge pull request !26985 from huangbingjian/reduce_eliminate
 2021-11-30 11:52:45 +00:00
i-robot aa93cb9afb !26845 high level api for federated learning 
Merge pull request !26845 from wtcheng/master
 2021-11-30 11:31:23 +00:00
Xiaoda Zhang 364858cbc9 In sharding propagation, to keep strategy consistent of parameter being used by multiple operators, we check the edge with one node of TmpIdentityInfo 2021-11-30 18:58:33 +08:00
i-robot 2fd00935ed !20964 [assistant][ops] Add new data operator SpeechCommandsDataset 
Merge pull request !20964 from 杨旭华/SpeechCommandsDataset
 2021-11-30 09:33:03 +00:00
zhujingxuan 7e16e6d8cb add float32 to Batch Gmres 2021-11-30 17:25:40 +08:00
i-robot 95c0cafef4 !26824 white list for syntax exception 
Merge pull request !26824 from zhangzhaoju/master_syntax
 2021-11-30 08:01:59 +00:00
yanglf1121 343b17c61f support csr in while loop 2021-11-30 15:28:40 +08:00
i-robot 7554053c00 !26786 Add initializer and optimizer ut 
Merge pull request !26786 from wanyiming/add_init_opt_ut
 2021-11-30 07:23:27 +00:00
luoyang 1a6a42c083 Update minddata log message 2021-11-30 15:22:40 +08:00
zhangyuqwer 6a6e73ef82 [fix] [assistant] [I3ZSQM] add new data operator Vectors 2021-11-30 14:39:42 +08:00
huangbingjian 66309632c1 fix the negative axis problem of reduce_eliminate 2021-11-30 13:11:01 +08:00
i-robot 46161cda30 !26931 add float32 cases 
Merge pull request !26931 from zhujingxuan/master
 2021-11-30 03:50:13 +00:00
i-robot f513e0bfdd !26743 [GraphKernel] lite adapt for akg build. 
Merge pull request !26743 from chenlei_autodiff/lite_callback
 2021-11-30 03:38:38 +00:00
songyuanwei a67ac908d8 add landscape ut and st 2021-11-30 11:28:47 +08:00
w00517672 ea3e651b36 high level api for federated learning 2021-11-30 11:16:22 +08:00
liyong 2869352cc8 fix mindrecord log part01 2021-11-30 10:57:58 +08:00
zhujingxuan a18b9e703e move testcases 2021-11-30 10:52:02 +08:00
i-robot 51dbbda8f2 !26935 [Auto parallel] Recover 'auto_parallel_search_mode' in parallel_context 
Merge pull request !26935 from Xiaoda/115-adapting-interface-of-search-mode
 2021-11-30 01:58:52 +00:00
huangbingjian e970c96d68 Process the interpret node in the return node 2021-11-29 22:56:18 +08:00
i-robot b9d56b9cce !26914 fix some error report and remove some useless code 
Merge pull request !26914 from lianliguang/master
 2021-11-29 12:34:41 +00:00
Xiaoda Zhang 04db51a528 In a previous PR (https://gitee.com/mindspore/mindspore/pulls/26807/), we replaced 'auto_parallel_search_mode' by 'search_mode' directly. 
However, to be forward compatitable, it is suitable to keep 'auto_parallel_search_mode' available. This PR recovers the 'auto_parallel_search_mode' interface and adds a warning when using this old interface.

This PR also deals with other codestyle things.
 2021-11-29 15:40:23 +08:00
zhangzhaoju d34f14e324 white list for syntax exception 2021-11-29 12:40:38 +08:00
i-robot 16fa10fd38 !26875 add ut for debug info 
Merge pull request !26875 from huanghui/add-ut
 2021-11-29 03:55:52 +00:00
zhujingxuan 2aa8dc28cf add float32 testing 2021-11-29 10:53:31 +08:00
lianliguang 0dc5d7f4f9 modify some eroor log and remove some useless code 2021-11-29 10:23:03 +08:00
chenlei_autodiff 54227cae81 [GraphKernel] lite adapt for akg build. 2021-11-27 17:51:54 +08:00
huanghui 67a6beb1b1 add ut for debug info 2021-11-27 17:29:45 +08:00
i-robot f85dea2959 !26662 fix lu kernel 
Merge pull request !26662 from zhuzhongrui/gmres
 2021-11-27 07:18:46 +00:00
i-robot 2bd6deaeeb !26682 GraphKernel For CPU 
Merge pull request !26682 from ZengZitao/gk_cpu
 2021-11-27 06:23:01 +00:00
vddong 91d3a7543f [feat][assistant][I3T96F] add new data operator SpeechCommands 2021-11-27 11:25:18 +08:00
i-robot 6f95837c0e !26825 [Fallback] supports the use of attr/method on the interpreted nodes 
Merge pull request !26825 from huangbingjian/support_numpy_method
 2021-11-27 03:07:24 +00:00
i-robot 4252b24335 !26792 malloc ts memory for label 
Merge pull request !26792 from zhoufeng/change-label-memory-type
 2021-11-27 01:09:03 +00:00
zengzitao 62458b5636 adapt graph kernel for cpu 2021-11-26 18:42:34 +08:00
i-robot d1e4e674ab !26690 Add supoort resolving outer lambda function for ops.Partial. 
Merge pull request !26690 from hezhenhao1/add_lambda
 2021-11-26 09:21:34 +00:00
huangbingjian cf4a4ba900 Partially support numpy attr/method 2021-11-26 16:46:55 +08:00
z00512249 872d8b37da fix lu factor and solve for cpu backend 2021-11-26 16:24:01 +08:00
i-robot b3780ddfd7 !26789 fix cpu graph mode 
Merge pull request !26789 from zhujingxuan/master
 2021-11-26 07:11:21 +00:00
hezhenhao1 4af312d17e Add supoort resolving outer lambda function for ops.Partial. 2021-11-26 15:05:50 +08:00
i-robot 04132e0c50 !26766 fix error log and move some function to inner 
Merge pull request !26766 from lianliguang/master
 2021-11-26 06:09:42 +00:00
zhujingxuan 142480b08e fix cpu graph mode 2021-11-26 09:51:07 +08:00
i-robot 9f8ec2c5ab !26807 [Auto parallel] [Sharding propagation] Interface change of sharding propagation 
Merge pull request !26807 from Xiaoda/113-auto-parallel-search-mode-changes-to-search-mode
 2021-11-26 01:48:58 +00:00
i-robot 6ecbc97fd6 !26804 virtual_dataset_avoid_auto_parallel 
Merge pull request !26804 from yao_yf/virtual_dataset_avoid_auto_parallel
 2021-11-26 01:48:53 +00:00
wanyiming ab65f4ac98 addut 2021-11-26 09:48:34 +08:00
i-robot b282414de7 !26619 arallel_ut_refactoring 
Merge pull request !26619 from 王志伟/parallel_ut_refactoring1
 2021-11-26 01:34:49 +00:00
i-robot bbe9606f1c !26805 Revert "Add the check of function return None." 
Merge pull request !26805 from Margaret_wangrui/return_none
 2021-11-26 01:28:46 +00:00
lianliguang 5864d6a006 modify some eroor log 2021-11-26 09:24:19 +08:00
zhoufeng 881179fa10 malloc ts memory for label 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-11-26 09:17:02 +08:00
i-robot d8fbc26419 !26700 [MD][Profiler][Autotune] Add test, logs, clean state 
Merge pull request !26700 from harshvardhangupta/add_test_at_prof
 2021-11-25 19:38:33 +00:00
i-robot 3520f1427d !26701 MD C++ UT: Remove old tests part 3 
Merge pull request !26701 from hetshah/hs_remove_old_tests
 2021-11-25 19:29:30 +00:00
hetshah 098ca49dd3 remove instances of datasetiterator from old tests and move coverage to new method 2021-11-25 15:22:34 +00:00
Margaret_wangrui 922678edef Revert "Add the check of function return None." 
This reverts commit f9a384456a.
 2021-11-25 21:18:24 +08:00
i-robot 4407210ae3 !26689 Modify error 
Merge pull request !26689 from liuyang/error_ms
 2021-11-25 12:18:11 +00:00
Xiaoda Zhang ad5ac77ae8 1) 'auto_parallel_search_mode' changes to 'search_mode'; 
2) 'sharding_propagation' moves to 'search_mode';
 2021-11-25 19:38:21 +08:00
i-robot 5c263c0eed !26741 fix: generator can re-iteratable when source is zip 
Merge pull request !26741 from guozhijian/fix_generator_zip_cannot_be_reiterator
 2021-11-25 11:19:28 +00:00
yao_yf f29ce1fb60 virtual dataset avoid auto parallel 2021-11-25 18:47:35 +08:00
i-robot 7dcdc7d0fb !26400 [Fallback] add fallback testcases 
Merge pull request !26400 from huangbingjian/eval_numpy
 2021-11-25 08:19:20 +00:00
harshvardhangupta 02f4a8068b add tests, clean states, print proper warn logs 2021-11-25 00:03:38 -05:00
i-robot e96f33e887 !25943 TensorArray 
Merge pull request !25943 from VectorSL/tensor-array-v2
 2021-11-25 03:57:45 +00:00
liuyang_655 12092c882f modify error 2021-11-24 22:40:23 -05:00
jonyguo 58c9112c2e fix: generator dataset with source zip 2021-11-25 11:32:28 +08:00
i-robot 3d0f9d8aae !26683 Enable compile cache feature to load hyper parameter data from python 
Merge pull request !26683 from LiangZhibo/mindir
 2021-11-25 03:25:27 +00:00
i-robot 5048d3823b !26754 Support non-sink pipeline in Autotune 
Merge pull request !26754 from h.farahat/autotune_nonsink
 2021-11-25 02:34:05 +00:00
i-robot a92d97adb2 !25850 Add CANN tensor data callback support for ascend async dump - part2 
Merge pull request !25850 from TinaMengtingZhang/cann_api_adapt
 2021-11-25 02:11:28 +00:00
hesham cf3ff77cfd AutoTune support non-sink mode 
Add time sts to iterator tracing
 2021-11-24 17:51:25 -05:00
TinaMengtingZhang 07b653103e Support Cann callback api for ascend async dump 2021-11-24 10:35:29 -05:00
i-robot eef5f3f8d4 !22925 [assistant][ops] add operator Cummin 
Merge pull request !22925 from yangwm/cummin
 2021-11-24 11:46:23 +00:00
i-robot d251800c62 !26705 Add the check of function return None. 
Merge pull request !26705 from Margaret_wangrui/return_none
 2021-11-24 11:09:27 +00:00
huangbingjian 00f3fa99e2 add fallback testcases 2021-11-24 17:39:55 +08:00
VectorSL 710289a72d add tensor array 2021-11-24 16:12:04 +08:00
i-robot cfc6ea32ff !24714 replace rtmemcpyxx to acl memcpy 
Merge pull request !24714 from jjfeing/br_replace_rtmemcpyxx_with_acl_api
 2021-11-24 07:47:43 +00:00
Margaret_wangrui f9a384456a Add the check of function return None. 2021-11-24 15:30:35 +08:00
i-robot 2cc51099b1 !26718 [ME][Fallback] Add some fallback numpy test cases 
Merge pull request !26718 from Margaret_wangrui/fallback
 2021-11-24 06:43:13 +00:00
i-robot b472850a75 !26594 Replace std::unordered_map/set with robin-hood-hashing 
Merge pull request !26594 from hewei/use_robin_hood
 2021-11-24 06:30:36 +00:00
i-robot 30d182ac18 !26626 fix reduce ops axis multiple bug in GPU 
Merge pull request !26626 from zhangbuxue/fix_reduce_ops_axis_multiple_bug_in_GPU
 2021-11-24 06:15:10 +00:00
i-robot 519f14a909 !26006 slice recompute activation 
Merge pull request !26006 from yao_yf/add_transformer_slice_activation_config
 2021-11-24 06:14:28 +00:00
i-robot de8b6db07c !26585 add warnings for set_dump API, see I4AUIR for details 
Merge pull request !26585 from wenkai/wk1120setdumpwarning1
 2021-11-24 03:42:25 +00:00
l00591931 21df240f23 Enable mindir to load initialize weight from python 2021-11-24 11:33:43 +08:00
i-robot 9f29ab20ba !25764 [Dataset] Fix lite cv resize bilinear core dump problem 
Merge pull request !25764 from xiefangqi/md_fix_resize_bilinear_fuzz_issue
 2021-11-24 03:20:09 +00:00
Margaret_wangrui 16ac3638d3 [ME][Fallback] Add some fallback numpy test cases 2021-11-24 11:20:06 +08:00
He Wei 41dcac9c49 Replace std::unordered_map/set with robin-hood-hashing 
Robin-hood-hashing (https://github.com/martinus/robin-hood-hashing)
is considered faster then std::unordered_map/set,
so we use it to improve mindspore performance.

1. robin_hood head file in `third_party/robin_hood/include`;
2. In `utils/hash_map.h` and `utils/hash_set.h`, we define:
 - mindspore::HashMap as an alias of robin_hood::unordered_map;
 - mindspore::HashSet as an alias of robin_hood::unordered_set;
3. Replace:
 - `#include <unordered_map>` --> `#include "utils/hash_map.h"`;
 - `#include <unordered_set>` --> `#include "utils/hash_set.h"`;
 - `std::unordered_map` --> `mindspore::HashMap`;
 - `std::unordered_set` --> `mindspore::HashSet`;
 - `map.insert(std::pair(key, value))` --> `map.emplace(key, value)`;
 - `[] (const std::pair<K, V> &p) {..} ` --> `[] (const auto &p) {..} `;
4. Fix issues found by switch to robin_hood:
 - AnfNodeConfig hash and equal;
 - Fix a bug in `Slice::operator==()`;
 - Fix a bug in `CNode::HasPrimalAttr()`;
 - Fix map.erase() usage bugs: `map.erase(iter++)` --> `iter = map.erase(iter)`;
 - Fix some iterator invalidated problem;
5. Some std::unordered_map/set can not replace by robin_hood:
 - As parameter of functions that exposed to python by pybind11;
 - Use bad hash that cause robin_hood::map over_flow, such as AbstractBasePtrListHasher;
6. Update cpp unit tests;
7. Add build option '-F' to enable robin_hood, default on.
 2021-11-24 10:47:40 +08:00
i-robot 9a5fd32bd2 !26280 fix mindir export's error when using _encrypt 
Merge pull request !26280 from lianliguang/master
 2021-11-24 01:48:32 +00:00
wzw 86c5ad20c8 parallel_ut_refactoring1 2021-11-24 09:41:52 +08:00
i-robot 3fc995a6ae !26664 Add support float64 as input type for ReduceProd GPU op. 
Merge pull request !26664 from hezhenhao1/add_prod
 2021-11-23 15:06:05 +00:00
luon 5485ff0cb6 [feat] [assistant] [I40GGH] add new ascend operator Cummin 2021-11-23 21:57:23 +08:00
wenkai c493f19b6b add warnings for set_dump API, see I4AUIR for details 2021-11-23 21:55:36 +08:00
i-robot 875f35d6d8 !26541 Fix file name and field type changes generated by HCCL in profiler. 
Merge pull request !26541 from casgj/master_hccl
 2021-11-23 13:16:28 +00:00
buxue 89a688f3be fix reduce ops axis multiple bug in GPU 2021-11-23 16:39:41 +08:00
i-robot 15cc4673a0 !25557 Add ASGD and Rprop optimizer to Mindspore 
Merge pull request !25557 from wanyiming/optimizer
 2021-11-23 07:17:11 +00:00
i-robot e40f3ec063 !25791 Add new initializer 
Merge pull request !25791 from wanyiming/initilizer
 2021-11-23 07:14:03 +00:00
casgj b15c09db6d Fix file name and field type changes generated by HCCL. 2021-11-23 12:48:59 +08:00
hezhenhao1 accc6368aa Add support float64 as input type for ReduceProd GPU op. 2021-11-23 11:44:40 +08:00
i-robot 76206a8894 !26162 Add automatic detection for the changes of python scripts when enable compilation cache 
Merge pull request !26162 from YuJianfeng/compile_cache
 2021-11-23 02:54:38 +00:00
i-robot 310bbcebe1 !26539 [GraphKernel] support lite_adapter for graph kernel. 
Merge pull request !26539 from chenlei_autodiff/lite_callback
 2021-11-23 02:44:13 +00:00
jjfeing 05485d991c replace api with acl api 2021-11-23 09:06:28 +08:00
yujianfeng f2bd7de442 Add automatic detection for the changes of python scripts when enable compile cache 2021-11-22 21:27:02 +00:00
i-robot 4f55a3f52f !26275 [API] Tensor python float trans to ms float32 
Merge pull request !26275 from kingxian/master
 2021-11-22 11:13:15 +00:00
i-robot 6f559516ea !26560 move all itertive Gmres code into Cell 
Merge pull request !26560 from zhujingxuan/master
 2021-11-22 09:19:14 +00:00
chenlei_autodiff 4c0d5dcfe7 [GraphKernel] support lite_adapter for graph kernel. 2021-11-22 15:10:30 +08:00
i-robot 24b3e346a4 !26558 Add debug message for BFGS method. 
Merge pull request !26558 from hezhenhao1/fix_bfgs_bug
 2021-11-22 06:08:33 +00:00
wanyiming 3b4621e673 add initializer 2021-11-22 12:38:11 +08:00
i-robot 69c4f470e4 !26546 Unify GPU/CPU ops input/output(col/rolmajor), modify related testcases, add linalg function and testcases 
Merge pull request !26546 from wuwenbing/master
 2021-11-22 04:34:33 +00:00
wanyiming 40755b904c add_optimizer 2021-11-22 12:31:18 +08:00
lianliguang a6e5dcfb22 if parameter total larger than 1T split to another file 2021-11-22 11:17:33 +08:00
zhujingxuan 3f2479aca0 move test cases 2021-11-22 10:23:28 +08:00
kingxian 545dc83fcb fix: `cell` does not support deep copy, tensor default dtype -> float32 2021-11-22 09:08:32 +08:00
i-robot 1b8c2ff0e9 !26414 fault_recover_by_mirror_group_fix_opt_shard 
Merge pull request !26414 from yao_yf/fault_recover_by_mirror_group_fix_opt_shard
 2021-11-20 03:06:45 +00:00
i-robot 4f34c32c6d !26235 AutoTune v1 
Merge pull request !26235 from danishfarid/autotune
 2021-11-19 23:40:40 +00:00
Rescue da986710f0 Updated concat-zip check and UT. 2021-11-19 17:38:16 +00:00
hesham 40797c40da AutoTune 2021-11-19 09:27:12 -05:00
i-robot 70363899e7 !24080 [assistant][ops] Add new audio operator ComputeDeltas 
Merge pull request !24080 from Rainfor/compute_detlas
 2021-11-19 12:29:49 +00:00
i-robot 1b7a38ccd8 !26329 Add exchangeKeys ops and getKeys ops for cross-silo STABLE_PW_ENCRYPT 
Merge pull request !26329 from jxlang910/master
 2021-11-19 10:59:27 +00:00
i-robot c6821bde0a !21648 [assistant][ops] Add new data loading operator YesNoDataset 
Merge pull request !21648 from 杨旭华/YesNoDataset
 2021-11-19 09:05:07 +00:00
hezhenhao1 a527f43699 Add debug message for BFGS method. 2021-11-19 15:36:45 +08:00
xiefangqi 8a28ad1aa5 fix lite cv resize bilinear fuzz bug 2021-11-19 14:56:25 +08:00
i-robot 9e8efe9169 !26503 [ST] Add mindspore resnet50 thor st smoke 
Merge pull request !26503 from xiefangqi/ms_add_resnet_thor_8p
 2021-11-19 06:43:37 +00:00
wenbean 13409f519f Unify GPU/CPU ops input/output(col/rolmajor), modify related testcases, add linalg function and testcases 2021-11-19 14:40:27 +08:00
i-robot b1d942cea0 !26413 [Numpy-Native] remove histogram density test 
Merge pull request !26413 from huangmengxi/del_test
 2021-11-19 06:28:39 +00:00
vddong f465cd0242 [feat][assistant][I3T96L]add new dataset operator YesNo 2021-11-19 13:36:24 +08:00
i-robot f38df5c888 !26234 New dataset config option, auto_offload 
Merge pull request !26234 from markuskunej/offload_config
 2021-11-19 03:44:56 +00:00
i-robot 55463892e4 !26402 add mem offload strategy 
Merge pull request !26402 from kisnwang/add-mem-offload-strategy
 2021-11-19 03:42:52 +00:00
i-robot 87e6cf438c !26469 Remove resnet_thor 4p st and add resnet 8p st. 
Merge pull request !26469 from linqingke/bug_fix
 2021-11-19 03:36:28 +00:00
yao_yf 188d39da83 slice_activation_in_recompute 
slice recompute activation
 2021-11-19 10:51:54 +08:00
i-robot 7559d5b798 !26494 [Auto parallel] Adjusting sharding propagation 
Merge pull request !26494 from Xiaoda/102-adjusting-sharding-propagation
 2021-11-19 02:00:46 +00:00
yao_yf 01dc4bbdf9 fix fault recover in optimizer shard 2021-11-19 09:46:27 +08:00
xiefangqi 6173929894 add resnet thor st 2021-11-19 09:16:49 +08:00
i-robot d837e2c969 !26429 add cpu op fp64 register to fix bugs of gmres for backend cpu 
Merge pull request !26429 from zhuzhongrui/gmres
 2021-11-19 01:14:36 +00:00
i-robot 3c39afad11 !24547 [MS][crowdfunding]New operator implementation, AutoAugment 
Merge pull request !24547 from yangwm/autoaugment
 2021-11-19 01:00:51 +00:00