Commit Graph

2648 Commits

Author SHA1 Message Date
yao_yf eeede168fa wide_and_deep merge ckpt in eval 2020-08-26 10:47:26 +08:00
mindspore-ci-bot 20b3134785 !5184 fix: padded dataset when no div and with repeat op
Merge pull request !5184 from guozhijian/fix_padded_with_no_div_repeat
2020-08-26 10:47:22 +08:00
peixu_ren 10f381d662 Modify the name of parameters in uniform 2020-08-25 22:44:21 -04:00
mindspore-ci-bot f3fd7a5578 !5073 Add checks and exception handling DS callback
Merge pull request !5073 from h.farahat/map_callback_end
2020-08-26 10:40:40 +08:00
hexia e1c240f86a serving st time optimization 2020-08-26 09:51:48 +08:00
mindspore-ci-bot 9e8c4f373f !5070 Fix wrong index error msg
Merge pull request !5070 from fanglei/new_case
2020-08-26 09:26:55 +08:00
jonyguo 6df1a43ec2 fix: padded dataset with non div & repeat 2020-08-26 08:56:37 +08:00
Peilin Wang d92a357e4a add scatternd ut 2020-08-25 17:03:57 -04:00
Cathy Wong 46e9d79a50 C++ API: Lexicographical order support for CLUE, CSV & TextFile Datasets 2020-08-25 14:11:19 -04:00
mindspore-ci-bot 971716f4b9 !5136 fix large for loop runtime error due to lacking of backend operators
Merge pull request !5136 from fary86/fix_large_for_runtime_error
2020-08-25 22:26:25 +08:00
mindspore-ci-bot 346b97acb8 !5156 fix softdvpp coredump
Merge pull request !5156 from qianlong21st/master_fix_softdvpp_core
2020-08-25 22:20:00 +08:00
mindspore-ci-bot 2e3f5cd41b !5114 fix bug in c-api: rename, concat, take
Merge pull request !5114 from luoyang/c-api-pyfunc
2020-08-25 20:57:41 +08:00
qianlong 12dfca71f1 fix softdvpp coredump 2020-08-25 18:56:40 +08:00
YangLuo 67f5c89cd6 Check input image type for random posterize 2020-08-25 16:26:17 +08:00
fary86 8d245497a4 Fix large for loop Runtime Error due to backend missing operators 2020-08-25 16:25:41 +08:00
luoyang b26f6b3d5e fix bug in c-api: rename, concat, take 2020-08-25 16:25:00 +08:00
leilei_snow df9df609f8 fix index error 2020-08-25 08:05:07 +00:00
huangdongrun 113641decd fix test cases 2020-08-25 14:38:08 +08:00
mindspore-ci-bot 7d4f481884 !5017 remove internal interface in wide&deep
Merge pull request !5017 from yao_yf/wide_and_deep_no_internal_interface
2020-08-25 14:11:51 +08:00
mindspore-ci-bot 957126375b !5095 Adding Float tensor support for CutMixBatch
Merge pull request !5095 from MahdiRahmaniHanzaki/cutmix-fix
2020-08-25 10:53:58 +08:00
mindspore-ci-bot afd16fbf0a !4963 fix bug of switch layer join
Merge pull request !4963 from fary86/fix_switch_layer_join_bug
2020-08-25 10:47:32 +08:00
mindspore-ci-bot abe6b82138 !5011 remove global grad ops
Merge pull request !5011 from riemann_penn/remove_global_grad_ops
2020-08-25 09:47:55 +08:00
fary86 947e19b839 Fix bug of switch layer join 2020-08-25 09:08:53 +08:00
islam_amin 641e751d5e adding bbox class 2020-08-24 18:22:58 -04:00
Mahdi a2c38d89f9 Added float32 support for CutMixBatch 2020-08-24 17:15:25 -04:00
hesham 8eeceb267b - release the wait if training is ended 2020-08-24 13:11:07 -04:00
yao_yf a9a8e323b2 remove internal interface in wide&deep 2020-08-24 19:18:47 +08:00
mindspore-ci-bot 4f6e63fcf8 !4576 Support if by if not inline
Merge pull request !4576 from amongo/SupportIfByIfNotInline
2020-08-24 19:15:39 +08:00
mindspore-ci-bot fc6eee3bda !5019 raise RuntimeError when set different mode after Initializer created
Merge pull request !5019 from yihuaijie/dev
2020-08-24 18:49:32 +08:00
mindspore-ci-bot be5c455906 !4818 Fix ScatterNdUpdate cpu kernel
Merge pull request !4818 from huanghui/scatter-nd-update-cpu-kernel
2020-08-24 17:32:39 +08:00
huangdongrun 1bd9fefd84 support if by if not inline
add testcase of net of if by if
2020-08-24 17:11:26 +08:00
panyifeng 637e812347 remove global grad ops 2020-08-24 16:50:09 +08:00
mindspore-ci-bot 226f019e45 !4888 add parallel attention test
Merge pull request !4888 from hanyang/master
2020-08-24 15:50:56 +08:00
huanghui b367da88eb fix ScatterNdUpdate cpu kernel 2020-08-24 15:24:51 +08:00
Yi Huaijie 394be43492 raise RuntimeError when set different mode after Initializer created 2020-08-24 14:08:09 +08:00
zhangxinfeng3 6d821235c0 update some comments of api 2020-08-24 11:52:58 +08:00
mindspore-ci-bot 8d693306f4 !4126 Add new parameter
Merge pull request !4126 from BowenK/new_parameter
2020-08-24 10:01:46 +08:00
mindspore-ci-bot 56835aaf88 !5005 Fix the bug in the formula in Bernoulli log_probs
Merge pull request !5005 from zichun_ye/fix_bernoulli_probs
2020-08-24 09:09:43 +08:00
mindspore-ci-bot 0bbce9367e !4772 Adding AlbumDataset for device training
Merge pull request !4772 from EricZ/ms-album
2020-08-24 08:27:14 +08:00
Zichun Ye 9e7d6e2397 fix bernoulli prob formula; fix some other minor bugs
update threshold of softplus computation

support fp for bernoulli and geometric distribution
2020-08-23 17:49:09 -04:00
Eric c79db93c48 Initial commit for album
Added linter fix for album dataset

Added testDataset

Adding signature

Added JsonDataset example API

Example dataset

Resolving format

More fixing

Refactor

Small fix

Added compiling album dataset

Running tests

Added linter fix #1

Passing UT

Added dataset API

Addressing clang

Clang part 2

Fixing pass

Fixed tree check

lint fix

Added lint fix part 2
2020-08-22 11:07:10 -04:00
mindspore-ci-bot 75fce54208 !4790 Fix a Pynative bug.
Merge pull request !4790 from jxlang910/push-to-opensource
2020-08-22 16:45:00 +08:00
mindspore-ci-bot 94a109f476 !4898 Fix coredump caused by function call depth too large
Merge pull request !4898 from fary86/fix_call_depth_too_large
2020-08-22 16:08:27 +08:00
jin-xiulang c246b177a6 Debug for Pynative mode.
Debug test.

pynative debug
2020-08-22 15:47:36 +08:00
fary86 04524b6bd3 Fix coredump caused by function call depth too large 2020-08-22 15:00:04 +08:00
mindspore-ci-bot e2203bed01 !3957 Gpu StridedSlice dims exceeds
Merge pull request !3957 from chenweifeng/strided_slice_dims_exceeds
2020-08-22 14:28:39 +08:00
mindspore-ci-bot ac81886328 !4916 fix generator_dataset hangs and test_graphdata_distributed.py failing randomly
Merge pull request !4916 from heleiwang/gnn_fix_bug
2020-08-22 10:51:01 +08:00
mindspore-ci-bot b366608a3f !4952 Fix errors in log calculation logics
Merge pull request !4952 from peixu_ren/custom_pp_ops
2020-08-22 10:40:40 +08:00
mindspore-ci-bot 9b503e4f38 !4955 Fixes for Dynamic Augmentation Ops
Merge pull request !4955 from MahdiRahmaniHanzaki/dynamic-ops-fix
2020-08-22 10:27:50 +08:00
mindspore-ci-bot ab45bec828 !4924 Modify API comments and fix error of st
Merge pull request !4924 from byweng/fix_param_check
2020-08-22 09:37:36 +08:00
peixu_ren 1c8eb9b15d Fix errors in log calculation logics 2020-08-21 21:28:10 -04:00
Mahdi a5f9b8f92e Added fix for MixUpBatch and CutMixBatch and for RandomAffine
updated c color op descriptions
2020-08-21 17:40:08 -04:00
mindspore-ci-bot 9d7250c483 !4776 Introduce 2 extra ctrl flags to DataBuffer in dataset, address remaining cmts to PR4632
Merge pull request !4776 from ZiruiWu/map_callback_follow_up
2020-08-22 03:31:31 +08:00
Zirui Wu 74c1e6da60 introducing pause and quit flags to DataBuffer
fix review cmts

fix ci

fix Ci

fixci

address ci

ci

- add timeout
- add more test cases

fix CI

address review cmts
2020-08-21 14:33:26 -04:00
mindspore-ci-bot 82c888f065 !4930 Fix CI cifar hang issue
Merge pull request !4930 from xiefangqi/fix_cifar_nofile_issue
2020-08-21 20:49:40 +08:00
xiefangqi e3e7820413 fix cifar stuck problem 2020-08-21 19:35:07 +08:00
bingyaweng 3422f60d50 modify comments of API 2020-08-21 17:26:11 +08:00
mindspore-ci-bot 0d1a7ac654 !4909 [bug]support implicit type conversion for parameter
Merge pull request !4909 from vlne-v1/I1QM7L-implicit-type-conversion-parameter
2020-08-21 17:08:23 +08:00
BowenK e7c6b7e66a Add NewParameter and Imm patterns 2020-08-21 16:53:04 +08:00
mindspore-ci-bot c92f7c9170 !4911 add func type check for switch layer
Merge pull request !4911 from riemann_penn/add_func_type_check_for_switch_layer
2020-08-21 16:42:12 +08:00
wilfChen 837aecf9af gpu stridedslice 2020-08-21 16:21:27 +08:00
panyifeng abab21ed57 add func type check for switch layer 2020-08-21 16:11:40 +08:00
mindspore-ci-bot 6e8d3a3b82 !4859 Add CTCGrerdyDecoder ops for old backend.
Merge pull request !4859 from liuxiao93/Add-ReversSqueuce-EditDistance-CTCGrerdyDecoder
2020-08-21 16:05:19 +08:00
heleiwang 4870abc848 1. fix generator_dataset hangs
2. fix test_graphdata_distributed.py failing randomly
2020-08-21 16:03:06 +08:00
mindspore-ci-bot 46429a98bf !4869 Add ci for quant
Merge pull request !4869 from chenfei_mindspore/master
2020-08-21 15:57:43 +08:00
Wei Luning 77dcdd89ec support parameter updata with implicit type conversion 2020-08-21 15:24:57 +08:00
panyifeng f9f3cd7ce0 fix switch_layer_issues 2020-08-21 14:17:51 +08:00
chenfei a71868f1e5 add ci for quant
add ci for quant
2020-08-21 14:05:45 +08:00
mindspore-ci-bot 8440f2bcdb !4809 add AddN,AssignAdd,Conv2d,BN,Relu6,TensorAdd CPU operator
Merge pull request !4809 from zhaoting/master
2020-08-21 12:39:45 +08:00
mindspore-ci-bot b2a5440548 !4883 Fix compilation warnings
Merge pull request !4883 from zhoufeng/xiu-ba-ge
2020-08-21 12:33:20 +08:00
mindspore-ci-bot bccb92adf7 !4868 fix: concat with none sample dataset
Merge pull request !4868 from guozhijian/fix_concat_with_zero_dataset
2020-08-21 12:02:30 +08:00
mindspore-ci-bot 1166a091f5 !4893 fix error of conv_variational
Merge pull request !4893 from byweng/fix_param_check
2020-08-21 11:41:51 +08:00
bingyaweng b126272b39 fix error of conv_variational 2020-08-21 11:06:12 +08:00
liuxiao93 9bc18ea2e5 Add CTCGrerdyDecoder ops for GE. 2020-08-21 10:12:01 +08:00
Su Teng e3ae23c939 add parallel attention test 2020-08-21 10:10:53 +08:00
mindspore-ci-bot 2ac410e90d !4789 Add EditDistance op for GE.
Merge pull request !4789 from liuxiao93/Add-EditDistance-op-for-GE
2020-08-21 09:49:38 +08:00
mindspore-ci-bot 3d06cbf987 !4801 Must set or change parallel mode before any Initializer created
Merge pull request !4801 from yihuaijie/dev
2020-08-21 09:47:32 +08:00
zhoufeng 22ec976ef7 fix compilation warnings
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2020-08-21 09:44:04 +08:00
jonyguo 5b4b539751 fix: concat with none sample dataset 2020-08-21 09:19:50 +08:00
mindspore-ci-bot 29e21479a4 !4845 Fix bugs about uncertainty toolbox and vae
Merge pull request !4845 from zhangxinfeng3/master
2020-08-21 09:06:41 +08:00
Xun Deng c9f8f9fe85 added CheckTenosr and CheckTuple 2020-08-20 16:41:34 -04:00
Peilin Wang b7a4313755 added type support for reshape gpu kernel
fix ci
2020-08-20 13:52:23 -04:00
mindspore-ci-bot 13d1738ff3 !4706 fix SmoothL1Loss gpu kernel
Merge pull request !4706 from Peilin/smoothL1Loss-fix
2020-08-20 22:33:16 +08:00
mindspore-ci-bot 9a3baf4f6c !4314 [MD] remove defaults used in binding code, and remove bilinear resize op
Merge pull request !4314 from nhussain/clean_up_bindings
2020-08-20 22:16:56 +08:00
mindspore-ci-bot ff6cf58bfd !4683 split ci cases
Merge pull request !4683 from yoonlee666/cisplit
2020-08-20 22:11:21 +08:00
mindspore-ci-bot bfa3cd900e !4843 remove ccsrc/common.h by explicit dependent header file
Merge pull request !4843 from xychow/remove-ccsrc-common-h
2020-08-20 22:02:13 +08:00
mindspore-ci-bot 98052f9d06 !4847 [MD] Add some data validation
Merge pull request !4847 from xiefangqi/xfq_add_numworker_validate
2020-08-20 20:22:51 +08:00
mindspore-ci-bot 2cb22a0f78 !4688 Fix bool operation parsing to be consistent with pynative
Merge pull request !4688 from amongo/FixBoolParse
2020-08-20 20:06:41 +08:00
zhaoting cbca6be8bf add AddN,AssignAdd,Conv2d,BN,Relu6,TensorAdd CPU operator 2020-08-20 20:05:04 +08:00
yoonlee666 eb46d5cc19 split ci cases 2020-08-20 19:48:19 +08:00
liuxiao93 4c99f4f649 Add EditDistance op for GE. 2020-08-20 19:39:57 +08:00
zhangxinfeng3 27ff97a555 update uncertainty toolbox 2020-08-20 19:32:18 +08:00
Yi Huaijie 89a4ebf8a1 parallel mode must be set before create an initializer 2020-08-20 19:20:46 +08:00
mindspore-ci-bot a3dae6344b !4758 GPU kernel support NHWC
Merge pull request !4758 from VectorSL/nhwc-support
2020-08-20 19:17:33 +08:00
zhousiyi d0e58dd765 remove ccsrc/common.h
replace frontend/operator/ops.h in backend with base/core_ops.h as
backend should not use any frontend-only primitive
2020-08-20 09:34:07 +00:00
mindspore-ci-bot cde4a81b8b !4831 Add test of bnn_layers and transforms
Merge pull request !4831 from byweng/add_test
2020-08-20 17:27:54 +08:00
xiefangqi 7dc7990d75 add NumWorkers validate 2020-08-20 17:25:30 +08:00
VectorSL e939d61a2c conv pooling pad support NHWC 2020-08-20 17:21:53 +08:00
huangdongrun f30418991c refactor bool op parsing to be consistent with pynative mode
add testcase of st
2020-08-20 16:45:30 +08:00
mindspore-ci-bot 5dad6ea5cb !4754 add http visit example to seving st
Merge pull request !4754 from hexia/add_http_to_st_serving
2020-08-20 16:32:55 +08:00
bingyaweng 2037336195 add st 2020-08-20 16:08:25 +08:00
hexia a7de095d51 iii 2020-08-20 15:21:17 +08:00
mindspore-ci-bot 9ee144ea40 !4744 [AutoParallel]Support bert
Merge pull request !4744 from lichen/support_bert
2020-08-20 14:13:19 +08:00
mindspore-ci-bot 7b0a4e5929 !4796 Fix randomdata ut core dump problem
Merge pull request !4796 from xiefangqi/fix_randomdata_ut
2020-08-20 14:11:55 +08:00
xiefangqi c0d18d2517 fix randomdata ut problem 2020-08-20 11:13:02 +08:00
mindspore-ci-bot ed954dc407 !4782 Python UT fails on RandomPosterize
Merge pull request !4782 from islam_amin/bbox_class
2020-08-20 10:18:59 +08:00
mindspore-ci-bot 24700afa2d !4689 add check for user define bprop in Pynative mode
Merge pull request !4689 from zhangbuxue/add_check_for_user_define_bprop_in_Pynative_mode
2020-08-20 09:43:46 +08:00
islam_amin 85357238fe Fixing posterize python ut 2020-08-19 21:35:07 -04:00
Peilin Wang 0d5220d33c modified documentation and gpu kernel for smoothL1Loss
fix pylint

changed doc and code for SmoothL1Loss to be same a dchip. fixed grad kernel

fix ci
2020-08-19 17:06:22 -04:00
Jesse Lee 8a08d0c37b Phase 2 of CacheOp 2020-08-19 13:45:55 -04:00
Zirui Wu 78c1aa1d96 Implemented Callback for Dataset
implment pause in MapOp, added more to callback

add ds_callback

- Initial drop of Python DSCallback

- Pybind DSCallback

- Pybind DSCallback

added callback to mapOp

- de_pipeline DSCallback

- de_pipeline DSCallback

add test case, segfault for now

fix seg fault

- de_pipeline DSCallback

remove 1 line

update callback test case, now works

use builder class for mapOp callback

- de_pipeline DSCallback

- de_pipeline DSCallback

- de_pipeline DSCallback

better test case

minor fix

add comments and minor clean ups

get rid of nullptr in MapOp, use other flag instead

fix a bug ParseMapOp only takes 1 callback

- Added WaitedDSCalabck

refactor callback param

fix text case incorrect number

- added testing

fix cpp test case

- added testing

- revert back lenet changes

- cleanup test_callbacks.py

- cleanup test_callbacks.py

fix CI stage I

fix CI stage II

fix CI and update epoch counter

- add validation
- add more testing  test_callbacks.py

use random data op to do tests

adjust when to call EpochBegin/End

- add repeat with callback

- addressing reviewers' comments

- docstring and CI fixes

- docstring and CI fixes

- docstring and CI fixes

- rebase with upstream/master

fix cpp test case

fix review comments

addr review cmts, add test case
2020-08-19 12:31:04 -04:00
YangLuo b50ae27c72 !4597 [Dataset] C++ API Support for build_vocab 2020-08-19 22:47:47 +08:00
nhussain eb9a611041 remove old defaults 2020-08-19 10:11:19 -04:00
mindspore-ci-bot 748d7f1f1a !4685 Export server embedding table ckpts.
Merge pull request !4685 from ZPaC/master-supports-export-server-ckpt
2020-08-19 20:08:00 +08:00
buxue 855d6b8fed add check for user define bprop in Pynative mode. 2020-08-19 19:14:02 +08:00
lichenever 221a801395 auto parallel support bert 2020-08-19 17:47:59 +08:00
ZPaC 5084557f67 Export server embedding table ckpt. 2020-08-19 17:09:57 +08:00
mindspore-ci-bot d541e261a0 !4696 C++ API Support for CSV Dataset
Merge pull request !4696 from jiangzhiwen/jzw/c_api_csv
2020-08-19 17:08:33 +08:00
mindspore-ci-bot 70a218123b !4722 modiy error type
Merge pull request !4722 from lijiaqi/modify_error_type
2020-08-19 16:18:50 +08:00
mindspore-ci-bot 2db4bda219 !4622 serving restful init
Merge pull request !4622 from hexia/http_init
2020-08-19 16:15:58 +08:00
mindspore-ci-bot 256dccc651 !4498 Gnn data processing supports distributed scenarios
Merge pull request !4498 from heleiwang/gnn_distributed
2020-08-19 16:09:05 +08:00
jiangzhiwen 39df25f803 c++ api for CSV Dataset 2020-08-19 16:02:11 +08:00
mindspore-ci-bot 2112cb91d5 !4690 add categorical distribution
Merge pull request !4690 from baihuawei/categorical
2020-08-19 14:31:14 +08:00
李嘉琪 c65ea1687b modify error type 2020-08-19 14:21:56 +08:00
mindspore-ci-bot 2d683234fb !4723 Support to concat more than 3 tensors in auto parallel mode
Merge pull request !4723 from yangzhenzhang/concat-more-than-3-tensors
2020-08-19 14:16:02 +08:00
yangzhenzhang cda08f6a52 concat 3 tensors in auto parallel mode 2020-08-19 11:27:35 +08:00
baihuawei 772e14d00d add categorical 2020-08-19 11:21:15 +08:00
heleiwang 8ee4d8e92d Gnn data processing supports distributed scenarios 2020-08-19 11:09:01 +08:00
mindspore-ci-bot 6868b9b6fa !4422 Minddata new dataset api ==> RandomData
Merge pull request !4422 from xiefangqi/xfq_c++api_randomdata
2020-08-19 10:48:53 +08:00
mindspore-ci-bot 50b5c8035b !4701 fix concat get_dataset_size error
Merge pull request !4701 from guozhijian/fix_concat_get_dataset_size_err
2020-08-19 09:14:30 +08:00
xiefangqi b91e56375e add randomdataset and schema 2020-08-19 09:13:43 +08:00
mindspore-ci-bot 2aab14242c !4669 add toolbox and dpn
Merge pull request !4669 from zhangxinfeng3/master
2020-08-19 09:13:29 +08:00
mindspore-ci-bot 505b6b5a9b !4699 NMS_GPU_Sorting_Mem Fix
Merge pull request !4699 from danishnxt/GPU_two
2020-08-19 09:08:20 +08:00
nhussain 738ae2c78d change api to use std_vector
try to display image
2020-08-18 15:41:21 -04:00
islam_amin 979111d0ef Added Posterize Op 2020-08-18 13:55:47 -04:00
jonyguo b0b370336f fix: concat get_dataset_size error 2020-08-18 23:40:17 +08:00
danish 97f08e74ec nms_sorting fix
lint py fix 2

nms_py_file test value fix

lint fix
2020-08-18 11:15:33 -04:00
jonyguo 5f294fb90d fix: random affine parameter check 2020-08-18 21:58:53 +08:00
panyifeng 22a9d02e9f switch_layer incorporate env_get and tuple_get 2020-08-18 20:23:23 +08:00
hexia 75d116b5db serving http init 2020-08-18 20:15:47 +08:00
zhangxinfeng3 d643c228d7 update variational and toolbox 2020-08-18 19:02:27 +08:00
mindspore-ci-bot 4f46c4277a !4614 Code compile performance optimization
Merge pull request !4614 from zhoufeng/code-compile-performance
2020-08-18 16:45:15 +08:00
mindspore-ci-bot cc077de9e3 !4425 fix if statement with no return coredump
Merge pull request !4425 from fary86/fix_if_no_return_coredump
2020-08-18 16:09:31 +08:00
mindspore-ci-bot 2ae6365d77 !4650 EmbeddingLookup support auto parallel
Merge pull request !4650 from yangzhenzhang/embedding-lookup-auto-parallel
2020-08-18 15:51:04 +08:00
zhoufeng 663278112f optimize code compile performance
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2020-08-18 14:33:24 +08:00
mindspore-ci-bot 025e6f23f7 !4643 add test cases for parameter slice init using all kind of initializers
Merge pull request !4643 from yihuaijie/dev
2020-08-18 14:21:41 +08:00
mindspore-ci-bot 26de4540ef !4639 rename param_value to param_info
Merge pull request !4639 from vlne-v1/rename_param_value
2020-08-18 14:16:23 +08:00
fary86 38083e055a Fix coredump missing return statement after while loop 2020-08-18 14:16:21 +08:00
yangzhenzhang 6f6a8ae9f0 embedding lookup auto parallel 2020-08-18 11:40:09 +08:00
Wei Luning c1c30a44f1 rename param_value -> param_info 2020-08-18 11:16:28 +08:00