Nigel
/
mindspore
forked from mindspore-Ecosystem/mindspore
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
56,551 Commits 24 Branches 0 Tags 3.9 GiB
Commit Graph

22 Commits

Author SHA1 Message Date
jonyguo 911cbd7f6a del: column_order in map 2022-10-18 21:07:38 +08:00
mhmotallebi 96e21f6ed4 [MD] decode numpy strings in cpp for eager mode 2022-06-16 18:02:43 -04:00
David 34d3755e20 Added docs to ut part 3 2022-05-30 16:16:46 -04:00
i-robot 8f57454372
!35028 [MD] Fix hanging problem in offload 
Merge pull request !35028 from h.farahat/offload_hang
 2022-05-27 17:25:06 +00:00
hesham 23e85ff083 avoid hangs when offload is true with pyfuncs and dict iterator 2022-05-26 23:16:16 -04:00
Cathy Wong b9396a32b7 [MD] Update import transforms statements in dataset UT 2022-05-25 19:51:26 -04:00
Cathy Wong b8e7c2acaf [MD] Transform Unification: Phase 1C - Minor Code Fixes and UT Updates 2022-05-24 22:24:38 -04:00
Cathy Wong eb4fd20bac [MD] Transform Unification Feature - Phase 2A - test_[a-q]*.py Python UT updates 2022-05-04 15:24:18 -04:00
Rescue 60d895fcd8 Decrease test_map_offload.py computation time. 2022-03-30 16:40:19 +00:00
Rescue face5e51a0 Added sharpness without randomness support and sharpnes op ut. 
fix pad issue
 2022-03-11 17:30:49 +00:00
markuskunej 6de37045ff Added TypeCast op in dataset offload. 2022-03-01 21:55:27 +00:00
markuskunej 87a45b239b Add offload support for multi-column datasets and map offload operations 
to specific columns.
 2022-02-18 20:09:49 +00:00
markuskunej 54e584c300 Added input column validation for offloaded map operations. 
Moved check_add_offload from dataset_helper.py to offload.py.
 2022-01-12 16:16:49 +00:00
Rescue fac68dbb46 Added dimension check to required Offload ops. 2022-01-05 04:26:31 +00:00
markuskunej 0c10f52eb4 Moved the offload operation check and map operation split from python (datasets.py) to c++ (NodeOffloadPass.cc). 
Updated check for offload in python (dataset_helper.py and
iterators.py).

Updated auto_offload test in test_map_offload.py.

Changed MapNode.offload type from bool->int in bindings.cc.

Changed manual offload flag from int->enum.

Update offload end of pipeline detection to be column-specific.
 2021-12-17 14:35:17 +00:00
Rescue dc5c388505 Fixed offload Normalize op, added offload Normalize and Rescale tests to offload UT. 2021-12-14 17:03:11 +00:00
xiefangqi bae1dd3bb0 Revert "Moved the offload operation check and map operation split from python (datasets.py) to c++ (NodeOffloadPass.cc)." 
This reverts commit 84d38e547a.
 2021-12-08 16:39:10 +08:00
markuskunej 84d38e547a Moved the offload operation check and map operation split from python (datasets.py) to c++ (NodeOffloadPass.cc). 
Updated check for offload in python (dataset_helper.py and
iterators.py).

Updated auto_offload test in test_map_offload.py.

Changed MapNode.offload type from bool->int in bindings.cc.

Changed manual offload flag from int->enum.
 2021-12-03 14:40:01 +00:00
xiefangqi f74b5cea0c optimize datasetops error msg 2021-12-01 09:11:22 +08:00
Rescue da986710f0 Updated concat-zip check and UT. 2021-11-19 17:38:16 +00:00
markuskunej 29cf442521 Added dataset.config.set_auto_offload(), which will automatically attempt to offload dataset map operations if set to True. 2021-11-18 21:13:20 +00:00
rescue 22e03ab12e Adding offload hardware accelerator. 2021-11-10 07:03:43 +00:00