p47068915
/
mindspore
forked from mindspore-Ecosystem/mindspore
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

!3241 fix some log error of dataset 

Merge pull request !3241 from panfengfeng/fix_some_log_error
This commit is contained in:
mindspore-ci-bot 2020-07-21 09:10:30 +08:00 committed by Gitee
parent 74f2c89d01 cbb159de08
commit 3f7488f3e5
2 changed files with 3 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
mindspore/ccsrc/minddata/dataset/engine/datasetops/source/text_file_op.cc
View File

@ -58,7 +58,7 @@ Status TextFileOp::Builder::Build(std::shared_ptr<TextFileOp> *op) {
// Throttle the number of workers if we have more workers than files!
if (static_cast<size_t>(builder_num_workers_) > builder_text_files_list_.size()) {
builder_num_workers_ = builder_text_files_list_.size();
MS_LOG(WARNING) << "TextFileOp operator parallelism reduced to " << builder_num_workers_ << " workers.";
MS_LOG(DEBUG) << "TextFileOp operator parallelism reduced to " << builder_num_workers_ << " workers.";
}
builder_schema_ = std::make_unique<DataSchema>();

4
mindspore/dataset/engine/datasets.py
View File

@ -253,8 +253,8 @@ class Dataset:
If a per_batch_map callable is provided, it will be applied to the batches of tensors.
Note:
The order of using repeat and batch reflects the number of batches. Recommend that
repeat operation should be used after batch operation.
The order of using repeat and batch reflects the number of batches and per_batch_map.
Recommend that repeat operation should be used after batch operation.
Args:
batch_size (int or function): The number of rows each batch is created with. An