p47068915
/
mindspore
forked from mindspore-Ecosystem/mindspore
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

!3241 fix some log error of dataset 

Merge pull request !3241 from panfengfeng/fix_some_log_error
This commit is contained in:
mindspore-ci-bot 2020-07-21 09:10:30 +08:00 committed by Gitee
parent 74f2c89d01 cbb159de08
commit 3f7488f3e5
2 changed files with 3 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
mindspore/ccsrc/minddata/dataset/engine/datasetops/source/text_file_op.cc
View File

@ -58,7 +58,7 @@ Status TextFileOp::Builder::Build(std::shared_ptr<TextFileOp> *op) {
// Throttle the number of workers if we have more workers than files! // Throttle the number of workers if we have more workers than files!
if (static_cast<size_t>(builder_num_workers_) > builder_text_files_list_.size()) { if (static_cast<size_t>(builder_num_workers_) > builder_text_files_list_.size()) {
builder_num_workers_ = builder_text_files_list_.size(); builder_num_workers_ = builder_text_files_list_.size();
MS_LOG(WARNING) << "TextFileOp operator parallelism reduced to " << builder_num_workers_ << " workers."; MS_LOG(DEBUG) << "TextFileOp operator parallelism reduced to " << builder_num_workers_ << " workers.";
} }
builder_schema_ = std::make_unique<DataSchema>(); builder_schema_ = std::make_unique<DataSchema>();

4
mindspore/dataset/engine/datasets.py
View File

@ -253,8 +253,8 @@ class Dataset:
If a per_batch_map callable is provided, it will be applied to the batches of tensors. If a per_batch_map callable is provided, it will be applied to the batches of tensors.
Note: Note:
The order of using repeat and batch reflects the number of batches. Recommend that The order of using repeat and batch reflects the number of batches and per_batch_map.
repeat operation should be used after batch operation. Recommend that repeat operation should be used after batch operation.
Args: Args:
batch_size (int or function): The number of rows each batch is created with. An batch_size (int or function): The number of rows each batch is created with. An