Commit Graph

4714 Commits

Author SHA1 Message Date
i-robot c8096bc416 !27701 add output parallel strategy for gather op
Merge pull request !27701 from yangzhenzhang/add-output-strategy-for-gather-op
2021-12-16 06:54:40 +00:00
i-robot 67fc03f623 !27694 [API] python frame rebuild
Merge pull request !27694 from kingxian/master
2021-12-16 06:49:56 +00:00
jinxiaoxian 01fc6efc7d rebuild python frame 2021-12-16 10:50:59 +08:00
i-robot d1d516e668 !27461 Add shard operation
Merge pull request !27461 from YuJianfeng/shard
2021-12-16 02:36:13 +00:00
yangzhenzhang 5f6477b022 add output strategy for gather op 2021-12-16 09:24:50 +08:00
i-robot 05336b03c5 !22332 [assistant][ops][SogouNews]
Merge pull request !22332 from 杨旭华/SogouNews
2021-12-16 01:07:21 +00:00
i-robot 8d648e0f1e !19673 Seperate constant from pb file
Merge pull request !19673 from sabrinasun_59ee/constant
2021-12-15 23:52:33 +00:00
i-robot f6fe56c20d !27447 [MD][Offload] Fix Offload Normalize op bug, Added extra tests to Offload UT.
Merge pull request !27447 from alashkari/offload-fix
2021-12-15 16:00:26 +00:00
i-robot daae93cff3 !27633 Parallelize calculating tensor statistics in tensor_summary
Merge pull request !27633 from Jimmy Qi/timing
2021-12-15 07:53:58 +00:00
li-qiyao f4bfcb8c25 [feat][assistant][I40GXN] add new loader SogouNews 2021-12-14 22:53:38 -08:00
i-robot 005d4bb742 !27590 Change the AllSwap to the Internal Usage
Merge pull request !27590 from huangxinjing/mv_all_swap
2021-12-15 03:50:46 +00:00
i-robot 83e9fe5c48 !27542 dataset: change dataset_file into dataset_files for MindDataset
Merge pull request !27542 from ms_yan/datasetfiles_name
2021-12-15 03:09:33 +00:00
yujianfeng cd2a021992 Add shard api 2021-12-15 11:05:11 +08:00
i-robot dac636decd !22297 [assistant][ops] Add new loader IWSLTDataset
Merge pull request !22297 from 杨旭华/IWSLTDataset
2021-12-15 02:55:08 +00:00
i-robot a5ce9e9b9b !27570 [Fallback] Process the attributes/methods of Tensor, different from NumPy
Merge pull request !27570 from huangbingjian/parse_tensor
2021-12-15 02:13:21 +00:00
i-robot d49f5e6caf !27525 support optimizer parallel for adafactor
Merge pull request !27525 from yangzhenzhang/support-opt-parallel-for-adafactor
2021-12-15 01:25:12 +00:00
Jimmy Qi c3ab951fa9 Parallelize calculating tensor statistics 2021-12-14 20:40:11 +00:00
sabrinasun 542d715217 seperate constant from pb 2021-12-14 13:19:14 -05:00
Rescue dc5c388505 Fixed offload Normalize op, added offload Normalize and Rescale tests to offload UT. 2021-12-14 17:03:11 +00:00
liucunwei 238ab38211 add some of dataset ut cases about createIterator columns 2021-12-14 19:11:52 +08:00
i-robot d57bdfb4f6 !23261 [assistant][ops][GainOp]
Merge pull request !23261 from 杨旭华/Gain
2021-12-14 11:05:27 +00:00
huangbingjian db4567989a fallback parse Tensor, different from NumPy. 2021-12-14 12:59:47 +08:00
i-robot 21176d6c51 !27602 Support getattr by the item of cell list: Handle the DoSignaturePrimitive('getitem') between getattr and resolve.
Merge pull request !27602 from 张清华/opt_cell_list_getattr
2021-12-14 03:52:42 +00:00
ms_yan a85113c093 change dataset_file into dataset_files for MIndDataset 2021-12-14 10:52:41 +08:00
i-robot 19b7b8b2de !27577 fix reshape bool in auto parallel
Merge pull request !27577 from yao_yf/reshape_bool_redistribution_fix
2021-12-14 01:25:05 +00:00
Zhang Qinghua 3e7b73e6c7 Support getattr by the item of cell list: Handle the DoSignaturePrimitive('getitem') between getattr and resolve. 2021-12-14 09:06:34 +08:00
liannai a99b5461bd [feat][assistant][I40GXH]add new data operator Gain 2021-12-13 22:03:09 +08:00
lufei9026 30bc609ce6 [feat][assistant][I40GY8]add new loader IWSLTDataset 2021-12-13 21:47:55 +08:00
i-robot efa63b78c0 !27600 [ME][Fallback] Add tensor testcase.
Merge pull request !27600 from Margaret_wangrui/fallback_tensor
2021-12-13 13:33:41 +00:00
i-robot 0d3ddbdde4 !27580 [ME][Fallback] Add array property test cases
Merge pull request !27580 from Margaret_wangrui/fallback
2021-12-13 13:14:52 +00:00
yao_yf 30576c6a75 fix reshape bool type in auto parallel 2021-12-13 20:24:33 +08:00
i-robot 2a2cd5e4ca !22222 [assistant][ops] Add new loader PennTreebankDataset
Merge pull request !22222 from 杨旭华/PennTreebankDataset
2021-12-13 11:43:00 +00:00
Margaret_wangrui dafe31e2cd [ME][Fallback] Add tensor testcase. 2021-12-13 17:13:24 +08:00
i-robot 90e2acc536 !27583 fix no parallel strategy file if start profiler in the process of training
Merge pull request !27583 from yuximiao/bug_fix
2021-12-13 08:37:20 +00:00
i-robot 7d7ec3c0c6 !27449 [ME]Add `MS` header of env var
Merge pull request !27449 from chenfei_mindspore/environment_variable_fix
2021-12-13 08:03:45 +00:00
huangxinjing f5889750f4 Move the AllSwap to the _AllSwap 2021-12-13 14:19:29 +08:00
yangzhenzhang 2a0b528084 support opt parallel for adafactor 2021-12-13 11:21:44 +08:00
yuximiao 393d3621a3 fix no paralle stratege if start profiler in the process of trainging 2021-12-13 10:44:07 +08:00
Margaret_wangrui 751763dcef [ME][Fallback] Add array property test cases 2021-12-13 10:17:35 +08:00
i-robot c01985ae9b !27495 C++ inference interface AscendDeviceInfo
Merge pull request !27495 from 徐永飞/master
2021-12-13 01:34:25 +00:00
huangbingjian 038cbe43de add tesecases of Tensor 2021-12-11 10:14:41 +08:00
i-robot 22078f77ea !27522 [ME][Fallback] Add tensor testcase.
Merge pull request !27522 from Margaret_wangrui/fallback
2021-12-10 09:40:42 +00:00
xuyongfei 0a0419498f C++ inference interface Ascend310DeviceInfo+Ascend910DeviceInfo->AscendDeviceInfo 2021-12-10 16:41:10 +08:00
i-robot 938dc8abd0 !27439 [Auto parallel] Add new operatorInfo for Parallel: CumSum
Merge pull request !27439 from Xiaoda/117-add-cumsum-op
2021-12-10 07:00:06 +00:00
Margaret_wangrui 2779760409 [ME][Fallback] Add tensor testcase 2021-12-10 14:53:27 +08:00
i-robot 32e2dfb178 !27435 fix bugs triggered by fl
Merge pull request !27435 from wtcheng/master
2021-12-10 03:40:26 +00:00
chenfei 0ae5eb4618 add ms header of env var 2021-12-10 09:35:22 +08:00
i-robot 093f6f7bf2 !27453 Handle the interpreted node for binary ops, and refactoring other modules.
Merge pull request !27453 from 张清华/opt_jit_fallback2
2021-12-09 10:59:34 +00:00
w00517672 0064fc7ebc fix bugs triggered by fl 2021-12-09 16:21:17 +08:00
i-robot 55b099dc27 !27395 Add more to MindAPI
Merge pull request !27395 from hewei/core_api
2021-12-09 06:45:41 +00:00