Nigel
/
mindspore
forked from mindspore-Ecosystem/mindspore
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

!31112 [dataset][offload][easyuse] 修复Lenet训练时minddata会有一条告警日志的问题 

Merge pull request !31112 from xiefangqi/md_fix_offload_warning
This commit is contained in:
i-robot 2022-03-11 01:35:04 +00:00 committed by Gitee
parent 95d57c67f6 92b503dffa
commit 97b1b40d20
No known key found for this signature in database
GPG Key ID: 173E9B9CA92EEF8F
1 changed files with 4 additions and 5 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

9
mindspore/python/mindspore/dataset/engine/offload.py
View File

@ -32,11 +32,10 @@ def check_add_offload_sink_mode(dataset, dataset_helper, network):
if hasattr(dataset, '__no_send__'):
# Dataset was not sent to device. Skip adding offload.
return network
offload_model = dataset.__transfer_dataset__.get_offload_model()
# See if the offload pass identified any operations to be offloaded
if offload_model.transform_list != []:
check_concat_zip_dataset(dataset.__transfer_dataset__)
network = ApplyPreTransform(offload_model, network)
# We don't use dataset.__transfer_dataset__ because there will be a device_queue rdr warning log
iterator = dataset.create_tuple_iterator(num_epochs=1)
if iterator.offload_model is not None:
network = ApplyPreTransform(iterator.offload_model, network)
return network