mindspore-Ecosystem
/
mindspore
21
0
Fork 27
Code Issues Pull Requests 6 Projects Releases Wiki Activity
36,271 Commits 23 Branches 30 Tags 4 GiB
Commit Graph

7455 Commits

Author SHA1 Message Date
i-robot deea2c9b6b !26942 unify GRU and LSTM operaters and change LSTMCell to right version 
Merge pull request !26942 from 吕昱峰（Nate.River）/rnn_op
 2021-12-14 16:12:06 +00:00
i-robot 46e12035bf !27502 Print null for min, max, avg values when tensor only has NaNs and Infs 
Merge pull request !27502 from Jimmy Qi/stat-null
 2021-12-14 14:51:55 +00:00
i-robot d750fce904 !27609 fix bugs in fl data sink mode 
Merge pull request !27609 from wtcheng/master
 2021-12-14 12:21:49 +00:00
liucunwei 238ab38211 add some of dataset ut cases about createIterator columns 2021-12-14 19:11:52 +08:00
i-robot d57bdfb4f6 !23261 [assistant][ops][GainOp] 
Merge pull request !23261 from 杨旭华/Gain
 2021-12-14 11:05:27 +00:00
i-robot dda2fd1fc3 !27473 Support CSRTensor op in pynative 
Merge pull request !27473 from 杨林枫/csr_pynative
 2021-12-14 06:18:38 +00:00
huangbingjian db4567989a fallback parse Tensor, different from NumPy. 2021-12-14 12:59:47 +08:00
i-robot 21176d6c51 !27602 Support getattr by the item of cell list: Handle the DoSignaturePrimitive('getitem') between getattr and resolve. 
Merge pull request !27602 from 张清华/opt_cell_list_getattr
 2021-12-14 03:52:42 +00:00
i-robot a4cf337666 !27331 Add unify ClipGradNorm op on GPU 
Merge pull request !27331 from JoyLvliang/add_unify_clip_grad_norm_op_on_gpu
 2021-12-14 03:32:17 +00:00
ms_yan a85113c093 change dataset_file into dataset_files for MIndDataset 2021-12-14 10:52:41 +08:00
i-robot b97df28d6c !27581 Add bool for tensorarray 
Merge pull request !27581 from VectorSL/add-bool-for-tensorarray
 2021-12-14 02:48:32 +00:00
i-robot 2b616290dc !27591 Update models version 
Merge pull request !27591 from chenhaozhe/update-models-version
 2021-12-14 02:34:36 +00:00
chenlei_autodiff 7a8cfd6048 [GraphKernel] fix probabilistic failure case. 2021-12-14 09:49:54 +08:00
i-robot 19b7b8b2de !27577 fix reshape bool in auto parallel 
Merge pull request !27577 from yao_yf/reshape_bool_redistribution_fix
 2021-12-14 01:25:05 +00:00
Zhang Qinghua 3e7b73e6c7 Support getattr by the item of cell list: Handle the DoSignaturePrimitive('getitem') between getattr and resolve. 2021-12-14 09:06:34 +08:00
liannai a99b5461bd [feat][assistant][I40GXH]add new data operator Gain 2021-12-13 22:03:09 +08:00
lufei9026 30bc609ce6 [feat][assistant][I40GY8]add new loader IWSLTDataset 2021-12-13 21:47:55 +08:00
i-robot efa63b78c0 !27600 [ME][Fallback] Add tensor testcase. 
Merge pull request !27600 from Margaret_wangrui/fallback_tensor
 2021-12-13 13:33:41 +00:00
i-robot 0d3ddbdde4 !27580 [ME][Fallback] Add array property test cases 
Merge pull request !27580 from Margaret_wangrui/fallback
 2021-12-13 13:14:52 +00:00
yao_yf 30576c6a75 fix reshape bool type in auto parallel 2021-12-13 20:24:33 +08:00
i-robot 2a2cd5e4ca !22222 [assistant][ops] Add new loader PennTreebankDataset 
Merge pull request !22222 from 杨旭华/PennTreebankDataset
 2021-12-13 11:43:00 +00:00
Margaret_wangrui dafe31e2cd [ME][Fallback] Add tensor testcase. 2021-12-13 17:13:24 +08:00
i-robot c41c8e8908 !27486 [ME][Fallback] Support list insert. 
Merge pull request !27486 from Margaret_wangrui/list_insert
 2021-12-13 09:05:09 +00:00
i-robot 90e2acc536 !27583 fix no parallel strategy file if start profiler in the process of training 
Merge pull request !27583 from yuximiao/bug_fix
 2021-12-13 08:37:20 +00:00
w00517672 fa4a77760f fix bugs in fl data sink mode 2021-12-13 16:24:30 +08:00
i-robot 7d7ec3c0c6 !27449 [ME]Add `MS` header of env var 
Merge pull request !27449 from chenfei_mindspore/environment_variable_fix
 2021-12-13 08:03:45 +00:00
VectorSL 91766dbcd8 add bool for tesorarray 2021-12-13 15:07:51 +08:00
huangxinjing f5889750f4 Move the AllSwap to the _AllSwap 2021-12-13 14:19:29 +08:00
7347157+joylvliang@user.noreply.gitee.com 7a9fd2d7df add_unify_clip_grad_norm_op_on_gpu 2021-12-13 11:40:57 +08:00
chenhaozhe 389e22e9d6 update models version 2021-12-13 11:35:44 +08:00
yangzhenzhang 2a0b528084 support opt parallel for adafactor 2021-12-13 11:21:44 +08:00
yuximiao 393d3621a3 fix no paralle stratege if start profiler in the process of trainging 2021-12-13 10:44:07 +08:00
Margaret_wangrui 751763dcef [ME][Fallback] Add array property test cases 2021-12-13 10:17:35 +08:00
i-robot c01985ae9b !27495 C++ inference interface AscendDeviceInfo 
Merge pull request !27495 from 徐永飞/master
 2021-12-13 01:34:25 +00:00
i-robot 34198dd525 !27538 check bprop shape change 
Merge pull request !27538 from caifubi/master-pynative-mindrt-fix-case
 2021-12-13 01:31:18 +00:00
Jimmy Qi 6f2b70c21f Print null for min, max, avg values for NaN tensor 2021-12-12 19:31:21 +00:00
huangbingjian 038cbe43de add tesecases of Tensor 2021-12-11 10:14:41 +08:00
i-robot 22078f77ea !27522 [ME][Fallback] Add tensor testcase. 
Merge pull request !27522 from Margaret_wangrui/fallback
 2021-12-10 09:40:42 +00:00
caifubi e722090e46 check bprop 2021-12-10 17:14:46 +08:00
i-robot aef419ff0a !27201 Adapt Graphkernel For CPU CI 
Merge pull request !27201 from ZengZitao/adapt_cpu_ci
 2021-12-10 08:41:50 +00:00
xuyongfei 0a0419498f C++ inference interface Ascend310DeviceInfo+Ascend910DeviceInfo->AscendDeviceInfo 2021-12-10 16:41:10 +08:00
i-robot 938dc8abd0 !27439 [Auto parallel] Add new operatorInfo for Parallel: CumSum 
Merge pull request !27439 from Xiaoda/117-add-cumsum-op
 2021-12-10 07:00:06 +00:00
yanglf1121 feefdae8e3 support pynative csr op 2021-12-10 14:55:16 +08:00
Margaret_wangrui 2779760409 [ME][Fallback] Add tensor testcase 2021-12-10 14:53:27 +08:00
i-robot 3b3a6da5da !27377 Fix cross-silo's st 
Merge pull request !27377 from jxlang910/master
 2021-12-10 06:45:19 +00:00
i-robot ed63220a9f !27357 Fix Type Error of Aot Test File on Mac and Add Comments 
Merge pull request !27357 from jiaoy1224/arithmetic
 2021-12-10 06:21:16 +00:00
Margaret_wangrui 5d97a268a9 [ME][Fallback] Support list insert 2021-12-10 12:03:15 +08:00
i-robot 32e2dfb178 !27435 fix bugs triggered by fl 
Merge pull request !27435 from wtcheng/master
 2021-12-10 03:40:26 +00:00
chenfei 0ae5eb4618 add ms header of env var 2021-12-10 09:35:22 +08:00
i-robot 9501257866 !27459 Modifies test case for RandomChoiceWIthMask on mac 
Merge pull request !27459 from huangbo/master_1209
 2021-12-09 12:33:32 +00:00
zengzitao 6f4aebbe11 adapt ms_cpu ci for graphkernel 2021-12-09 19:44:09 +08:00
VectorSL b17d0a08c9 add dynamic kernels 2021-12-09 19:42:29 +08:00
i-robot 093f6f7bf2 !27453 Handle the interpreted node for binary ops, and refactoring other modules. 
Merge pull request !27453 from 张清华/opt_jit_fallback2
 2021-12-09 10:59:34 +00:00
jin-xiulang 34dced6995 Fix cross-silo's st 2021-12-09 17:23:28 +08:00
w00517672 0064fc7ebc fix bugs triggered by fl 2021-12-09 16:21:17 +08:00
i-robot b76d848b4a !27410 takedown ascend resnet50 thor testcase due to probablistic failures 
Merge pull request !27410 from yanghaoran/takedown_thor_resnet
 2021-12-09 07:37:36 +00:00
i-robot 55b099dc27 !27395 Add more to MindAPI 
Merge pull request !27395 from hewei/core_api
 2021-12-09 06:45:41 +00:00
i-robot d46e047fe1 !27372 fix permission bug when remove read_only_file on windows 
Merge pull request !27372 from zhangbuxue/fix_permission_bug_when_remove_read_only_file_on_windows
 2021-12-09 06:11:13 +00:00
Zhang Qinghua 135db97692 Handle the interpreted node for binary ops. 
Refactoring specialize.
Adjust ir/dat/dot order.
Optimize DumpIR FV routine.
 2021-12-09 11:33:45 +08:00
huangbo77 4300938799 Modifies test case for RandomChoiceWIthMask on mac 2021-12-09 11:27:24 +08:00
i-robot 0e358f4cb3 !27428 revert insert VirtualDataset node for master 
Merge pull request !27428 from lilei/modify_virtualdataset_for_master
 2021-12-09 02:47:13 +00:00
buxue ae256a362b fix permission bug when remove read_only_file on windows 2021-12-09 09:32:24 +08:00
Xiaoda Zhang 8042c88223 add the new operatorInfo for parallel: CumSum 2021-12-09 09:21:52 +08:00
He Wei f35554d0c6 Add more to MindAPI 
1. `TensorType` and `TensorTypePtr`;
2. `utils::isa<TensorTypePtr>()`;
3. `utils::isa<int64_t>()`, `utils::cast<int64_t>()`;
4. `GetValue<ValuePtrList>(value)`.
 2021-12-09 08:59:25 +08:00
i-robot 0edcd5ce74 !27164 Add statistic dump for ascend 
Merge pull request !27164 from Jimmy Qi/new-async-stat-dump
 2021-12-08 23:05:31 +00:00
i-robot 66a0e7efa5 !27424 [MD][revert] revert offload modification code to fix pangu model problem 
Merge pull request !27424 from xiefangqi/md_revert_offload_pr
 2021-12-08 13:30:50 +00:00
i-robot 4cc59dee17 !26731 【CSR SUPPORT】Add CSR OPs (CSReduceSum, CSRMV, CSRMul) 
Merge pull request !26731 from wangrao124/add_csr_op
 2021-12-08 12:16:11 +00:00
lilei 2edf6ab33b revert insert VirtualDataset node for master 2021-12-08 17:39:42 +08:00
i-robot faaec746f7 !27401 add more ut tests for allreduce fusion 
Merge pull request !27401 from jiahongQian/master
 2021-12-08 09:38:37 +00:00
Megalomania 259854e040 [feat] [assistant] [I40GY5] add new loader PennTreebankDataset 2021-12-08 01:22:40 -08:00
Yang Jiao d9531a4f73 add head for aot test 2021-12-08 17:05:13 +08:00
lvyufeng 7de53ec3fe unify GRU and LSTM operaters and change LSTMCell to right version 2021-12-08 16:51:51 +08:00
xiefangqi bae1dd3bb0 Revert "Moved the offload operation check and map operation split from python (datasets.py) to c++ (NodeOffloadPass.cc)." 
This reverts commit 84d38e547a.
 2021-12-08 16:39:10 +08:00
i-robot 895256f69a !20043 [assistant][ops] Add new YelpReview 
Merge pull request !20043 from 杨旭华/YelpReview
 2021-12-08 08:13:34 +00:00
yanghaoran 01e5b92b90 takedown ascend resnet50 thor testcase due to probablistic failures 2021-12-08 14:59:17 +08:00
jiahongQian b03c8d18d3 add more ut tests 2021-12-08 14:17:02 +08:00
i-robot 75e35bded2 !27081 [MD][Offload] Move offload checks and split to the C pipeline 
Merge pull request !27081 from markuskunej/move_offload_check_to_c
 2021-12-07 15:55:16 +00:00
i-robot b80ed801d5 !27335 change log level for read not exist tensors 
Merge pull request !27335 from yelihua/dev
 2021-12-07 13:08:20 +00:00
i-robot fc2e4c7a55 !27317 update tests owners 
Merge pull request !27317 from kisnwang/add-owners
 2021-12-07 12:58:45 +00:00
wangrao124 385f153dd1 add CSReduceSum, CSRMV, CSRMul 2021-12-07 18:42:06 +08:00
lufei9026 2947f418b1 [feat][assistant][I3T96N]add new loader YelpReview 2021-12-07 17:09:41 +08:00
i-robot ffca7b08a5 !27237 auto insert VirtualDataset node for master 
Merge pull request !27237 from lilei/modify_virtualdataset_for_master
 2021-12-07 09:02:50 +00:00
i-robot 25ae2d620b !27271 modify c++ msg & conv2d 
Merge pull request !27271 from huchunmei/master
 2021-12-07 07:56:21 +00:00
i-robot 1c84ab092c !27320 takedown resnet50_cifar10_gpu 
Merge pull request !27320 from yanghaoran/takedown_gpu_resnet
 2021-12-07 07:38:09 +00:00
i-robot 68ff04ac82 !27186 pass lambda function to out_shape and out_dtype 
Merge pull request !27186 from looop5/out_shape
 2021-12-07 07:31:59 +00:00
yelihua 01823faed0 change error level to info as dir not exist is normal case 2021-12-07 15:27:37 +08:00
i-robot 96f56b827e !27203 while inplace op for cpu backend 
Merge pull request !27203 from zhuzhongrui/gmres
 2021-12-07 06:59:34 +00:00
i-robot 7a8e35b4f1 !26456 [assistant][ops]Add new operator Spectrogram 
Merge pull request !26456 from YJfuel123/Spectrogram
 2021-12-07 06:39:01 +00:00
i-robot 3d0f8fcc99 !22552 [assistant][ops]New operator implementation, include STL10Dataset 
Merge pull request !22552 from 王睿/stl10_dataset
 2021-12-07 06:37:04 +00:00
i-robot 59184541c3 !27140 fix sync GraphCell params data from device bug 
Merge pull request !27140 from zhangbuxue/fix_sync_GraphCell_params_data_from_device_bug
 2021-12-07 04:33:21 +00:00
i-robot cbff4bf117 !27314 Delete error code assert in error manager test case 
Merge pull request !27314 from tanghuikang/adjust_hcom_errormanager_st
 2021-12-07 03:47:30 +00:00
huchunmei 1023c7a5e2 modify c++ msg 2021-12-07 11:20:12 +08:00
i-robot 4eb816008e !27066 set offload node 
Merge pull request !27066 from kisnwang/enable-set-swap-node
 2021-12-07 03:06:00 +00:00
i-robot f40668ef73 !27251 test_micro_batch_Interleaved 
Merge pull request !27251 from lilei/add_parallel_ut
 2021-12-07 02:18:09 +00:00
i-robot 9b2f4141c9 !27302 add summart ops params valid check ut 
Merge pull request !27302 from helloiSCSI/add_st
 2021-12-07 01:56:52 +00:00
yanghaoran f60b072710 takedown resnet50_cifar10_gpu 2021-12-07 09:51:09 +08:00
kswang fcdf236cdc add tests owners for kisnwang/laiyongqiang/HulkTang 2021-12-07 09:45:45 +08:00
i-robot 6b92d9bd4d !27224 [ME] Optimize the error message of the operator module 
Merge pull request !27224 from Margaret_wangrui/operator
 2021-12-07 01:21:38 +00:00
RainWang6188 c4063f0f11 [feat][assistant][I3J6VI] add new data operator STL10 2021-12-07 01:21:11 +00:00
buxue d7dc539b6e fix sync GraphCell params data from device bug 2021-12-07 09:20:46 +08:00
tanghuikang b5528574d6 Delete error code assert in error manager test case 2021-12-07 09:13:01 +08:00
i-robot d723cc417d !27151 [ME][Fallback] [ME][Fallback] Support built-in type: complex and reversed. 
Merge pull request !27151 from Margaret_wangrui/fallback
 2021-12-07 01:04:14 +00:00
i-robot 8bcd6e3a86 !27287 [ME][Fallback] Handle interpret nodes in list. 
Merge pull request !27287 from Margaret_wangrui/list_interpret
 2021-12-07 01:02:12 +00:00
i-robot d1aa8d6cb5 !26995 fix:unexpected eiminate of tile 
Merge pull request !26995 from zhangzhaoju/master_bug_fix
 2021-12-07 00:58:44 +00:00
i-robot 18163f07aa !26851 Add compile cache st test cases 
Merge pull request !26851 from LiangZhibo/master
 2021-12-07 00:50:32 +00:00
Jimmy Qi b9d1a4920c Add statistic dump for ascend 2021-12-06 20:11:44 +00:00
lilei 05189459ab auto insert VirtualDataset node for master 2021-12-06 21:39:37 +08:00
Margaret_wangrui 6e5d625153 [ME][Fallback] Support built-in type: complex and reversed. 2021-12-06 21:15:30 +08:00
i-robot b1eae16a05 !22304 [assistant][ops]New operator implementation, include SVHNDataset 
Merge pull request !22304 from 王睿/svhn_dataset
 2021-12-06 12:30:13 +00:00
helloiSCSI 7cb5ed7676 add summart ops params valid check ut 2021-12-06 20:11:27 +08:00
郑昊 4ae41350a6 [feat][assistant][I3ALD1] add new method Spectrogram 2021-12-06 19:24:37 +08:00
i-robot b4716271bc !26892 ME compiler environment variables normalization 
Merge pull request !26892 from chenfei_mindspore/environment_variable_fix
 2021-12-06 11:16:57 +00:00
i-robot aeb2cccbe6 !27152 [bug]fix functional grad with grad_position twice bug 
Merge pull request !27152 from chenzhuo/grad
 2021-12-06 10:56:46 +00:00
lilei e933aa268b test_micro_batch_Interleaved 2021-12-06 18:37:21 +08:00
z00512249 a1b8c2f065 while inplace op for cpu backend 2021-12-06 17:41:40 +08:00
Margaret_wangrui 0f4a276b7e Optimize the error message of the operator module 2021-12-06 17:25:42 +08:00
Margaret_wangrui fa8506c0a7 [ME][Fallback] Handle interpret nodes in list. 2021-12-06 16:58:21 +08:00
l00591931 79f86d3fe2 Add test case for compile cache 2021-12-06 15:37:03 +08:00
zhangzhaoju 722086435d 1. fix:unexpected eiminate of tile 
2. fix:delay memory allocat in NewTensorFilledWithData
 2021-12-06 14:49:48 +08:00
i-robot 2d23b698a6 !27024 add allreduce fusion by size 
Merge pull request !27024 from jiahongQian/master
 2021-12-06 05:32:12 +00:00
i-robot db9b66242b !21823 [assistant][ops] Add data operator CharNGram 
Merge pull request !21823 from 张渝/CharNGram
 2021-12-06 03:46:31 +00:00
i-robot 7458863fd4 !27259 Fix MindAPI unit-test random failure 
Merge pull request !27259 from hewei/core_api
 2021-12-06 03:31:42 +00:00
looop5 ae5532fb9e pass lambda function to out_shape and out_dtype 2021-12-06 10:21:16 +08:00
He Wei 5e092985e4 Fix MindAPI unit-test random failure 
Remove improper assert line: `ASSERT_TRUE(p < q);`
 2021-12-06 09:50:24 +08:00
chenzhuo 287bcdd783 fix grad twice position bug 2021-12-06 09:39:42 +08:00
i-robot bf0142ae4b !27242 Add unit test for persistent storage 
Merge pull request !27242 from zyli2020/ps_cache_feature
 2021-12-06 01:22:11 +00:00
q00596439 de36fdc169 add allreduce fusion size and unify the interface 2021-12-05 21:35:11 +08:00
lizhenyu b1a42e3525 add unit test for persistent storage 2021-12-05 13:51:17 +08:00
zhangyuqwer e934381b08 [feat][assistant][I3ZSQV] add new data operator CharNGram 2021-12-04 22:09:34 +08:00
i-robot de7df755bb !27020 Support multiple start/stop calls for MD Profiler 
Merge pull request !27020 from Mohammad Motallebi/fix_multiple_start_stop
 2021-12-04 13:23:53 +00:00
i-robot d224c7dd18 !27192 fix error log 
Merge pull request !27192 from lianliguang/xbg
 2021-12-04 10:10:00 +00:00
RainWang6188 340b3b4d5d [feat][assistant][I3J6VJ] add new data operator SVHN 2021-12-04 08:19:47 +00:00
i-robot f5215745f4 !27121 Apply Autodiff in Custom Op 
Merge pull request !27121 from jiaoy1224/arithmetic
 2021-12-04 04:54:02 +00:00
mohammad af6e587c28 MD Profiler: support multiple start/stop calls 2021-12-03 23:25:38 -05:00
i-robot d3a047f63b !27202 move cpu csrtensor test case to lv1 
Merge pull request !27202 from 杨林枫/fix_csr_while_test_case
 2021-12-04 02:58:39 +00:00
i-robot d01a0f041b !26759 Enable Cann api callback feature and add corresponded testcases 
Merge pull request !26759 from TinaMengtingZhang/cann_api_adapt_test
 2021-12-04 02:53:57 +00:00
TinaMengtingZhang 16a19be56f Enable cann api allback register function 
Add testcases for cann api feature
 2021-12-03 17:36:15 -05:00
danishfarid faaa5d5f0a autotune step 
fix testing script default

updates and changed sampling function

comments addressed

comments addressed

comments addressed

moving isSinkCheckAbove

update - move CheckSinkFunction

fix
 2021-12-03 20:29:35 +00:00
lianliguang 40c3995b98 fix error log 2021-12-03 23:13:03 +08:00
markuskunej 84d38e547a Moved the offload operation check and map operation split from python (datasets.py) to c++ (NodeOffloadPass.cc). 
Updated check for offload in python (dataset_helper.py and
iterators.py).

Updated auto_offload test in test_map_offload.py.

Changed MapNode.offload type from bool->int in bindings.cc.

Changed manual offload flag from int->enum.
 2021-12-03 14:40:01 +00:00
i-robot fb85709604 !27181 Upgrade Ascend software package Desc 2 
Merge pull request !27181 from TronZhang/upgrade_ascend_1202
 2021-12-03 14:11:58 +00:00
i-robot 3866cfaf6e !27163 support op overflow consumption for A dump and A plus M dump 
Merge pull request !27163 from john_tzanakakis/jt_bug_fixes
 2021-12-03 12:45:06 +00:00
tronzhang 9d3c0499a5 upgrade ascend 1201 2021-12-03 19:43:51 +08:00
yanglf1121 bfabc2b89d temp fix csrtensor testcase 2021-12-03 17:19:02 +08:00
i-robot c4ba2c2ba1 !27187 update log 
Merge pull request !27187 from luoyang/code_docs_doc
 2021-12-03 08:57:18 +00:00
i-robot 1da503448f !27168 [AutoParallel]Add_Parallel_CN_API 
Merge pull request !27168 from lichen/add_CN_API
 2021-12-03 08:37:04 +00:00
chenfei c5c2b2f186 environment variables fix 
debug log
 2021-12-03 15:55:43 +08:00
i-robot 95af195d0c !26926 Provide new mindspore core API classes 
Merge pull request !26926 from hewei/core_api
 2021-12-03 07:52:59 +00:00
kswang 391a06aad1 set offload node 2021-12-03 15:29:01 +08:00
luoyang f3e1794a74 update log 2021-12-03 15:09:36 +08:00