Commit Graph

2375 Commits

Author SHA1 Message Date
yujianfeng e688e1df32 Fix remove internal output for unique device target 2020-08-26 17:31:35 +08:00
mindspore-ci-bot 314c5ad055 !5172 remove name arg from gradoperation
Merge pull request !5172 from riemann_penn/remove_name_args_from_gradoperation
2020-08-26 16:55:57 +08:00
mindspore-ci-bot 95212b55a0 !3271 make reftype a subtype of MetaTensor and try to mark ref in node input
Merge pull request !3271 from vlne-v1/ref_demo
2020-08-26 15:45:48 +08:00
yangzhenzhang 6ae5893681 add test cases 2020-08-26 15:11:44 +08:00
Wei Luning 24a10225cf change base class of ref to tensor in cpp 2020-08-26 12:41:25 +08:00
mindspore-ci-bot e4d2f2fd3b !5030 Adding a BBox class and fixing Posterize C Op testing.
Merge pull request !5030 from islam_amin/bbox_class
2020-08-26 11:40:57 +08:00
panyifeng 1a54785fe2 remove name arg from gradoperation 2020-08-26 11:16:57 +08:00
mindspore-ci-bot cd1240180b !5187 C++ API: Lexicographical order support for CLUE, CSV & TextFile Datasets
Merge pull request !5187 from cathwong/ckw_c_api_fixes2
2020-08-26 10:48:05 +08:00
mindspore-ci-bot 20b3134785 !5184 fix: padded dataset when no div and with repeat op
Merge pull request !5184 from guozhijian/fix_padded_with_no_div_repeat
2020-08-26 10:47:22 +08:00
mindspore-ci-bot f3fd7a5578 !5073 Add checks and exception handling DS callback
Merge pull request !5073 from h.farahat/map_callback_end
2020-08-26 10:40:40 +08:00
jonyguo 6df1a43ec2 fix: padded dataset with non div & repeat 2020-08-26 08:56:37 +08:00
Cathy Wong 46e9d79a50 C++ API: Lexicographical order support for CLUE, CSV & TextFile Datasets 2020-08-25 14:11:19 -04:00
mindspore-ci-bot 971716f4b9 !5136 fix large for loop runtime error due to lacking of backend operators
Merge pull request !5136 from fary86/fix_large_for_runtime_error
2020-08-25 22:26:25 +08:00
mindspore-ci-bot 346b97acb8 !5156 fix softdvpp coredump
Merge pull request !5156 from qianlong21st/master_fix_softdvpp_core
2020-08-25 22:20:00 +08:00
mindspore-ci-bot 2e3f5cd41b !5114 fix bug in c-api: rename, concat, take
Merge pull request !5114 from luoyang/c-api-pyfunc
2020-08-25 20:57:41 +08:00
qianlong 12dfca71f1 fix softdvpp coredump 2020-08-25 18:56:40 +08:00
YangLuo 67f5c89cd6 Check input image type for random posterize 2020-08-25 16:26:17 +08:00
fary86 8d245497a4 Fix large for loop Runtime Error due to backend missing operators 2020-08-25 16:25:41 +08:00
luoyang b26f6b3d5e fix bug in c-api: rename, concat, take 2020-08-25 16:25:00 +08:00
huangdongrun 113641decd fix test cases 2020-08-25 14:38:08 +08:00
mindspore-ci-bot 7d4f481884 !5017 remove internal interface in wide&deep
Merge pull request !5017 from yao_yf/wide_and_deep_no_internal_interface
2020-08-25 14:11:51 +08:00
mindspore-ci-bot 957126375b !5095 Adding Float tensor support for CutMixBatch
Merge pull request !5095 from MahdiRahmaniHanzaki/cutmix-fix
2020-08-25 10:53:58 +08:00
mindspore-ci-bot afd16fbf0a !4963 fix bug of switch layer join
Merge pull request !4963 from fary86/fix_switch_layer_join_bug
2020-08-25 10:47:32 +08:00
mindspore-ci-bot abe6b82138 !5011 remove global grad ops
Merge pull request !5011 from riemann_penn/remove_global_grad_ops
2020-08-25 09:47:55 +08:00
fary86 947e19b839 Fix bug of switch layer join 2020-08-25 09:08:53 +08:00
islam_amin 641e751d5e adding bbox class 2020-08-24 18:22:58 -04:00
Mahdi a2c38d89f9 Added float32 support for CutMixBatch 2020-08-24 17:15:25 -04:00
hesham 8eeceb267b - release the wait if training is ended 2020-08-24 13:11:07 -04:00
yao_yf a9a8e323b2 remove internal interface in wide&deep 2020-08-24 19:18:47 +08:00
mindspore-ci-bot 4f6e63fcf8 !4576 Support if by if not inline
Merge pull request !4576 from amongo/SupportIfByIfNotInline
2020-08-24 19:15:39 +08:00
mindspore-ci-bot fc6eee3bda !5019 raise RuntimeError when set different mode after Initializer created
Merge pull request !5019 from yihuaijie/dev
2020-08-24 18:49:32 +08:00
huangdongrun 1bd9fefd84 support if by if not inline
add testcase of net of if by if
2020-08-24 17:11:26 +08:00
panyifeng 637e812347 remove global grad ops 2020-08-24 16:50:09 +08:00
mindspore-ci-bot 226f019e45 !4888 add parallel attention test
Merge pull request !4888 from hanyang/master
2020-08-24 15:50:56 +08:00
Yi Huaijie 394be43492 raise RuntimeError when set different mode after Initializer created 2020-08-24 14:08:09 +08:00
mindspore-ci-bot 8d693306f4 !4126 Add new parameter
Merge pull request !4126 from BowenK/new_parameter
2020-08-24 10:01:46 +08:00
mindspore-ci-bot 56835aaf88 !5005 Fix the bug in the formula in Bernoulli log_probs
Merge pull request !5005 from zichun_ye/fix_bernoulli_probs
2020-08-24 09:09:43 +08:00
mindspore-ci-bot 0bbce9367e !4772 Adding AlbumDataset for device training
Merge pull request !4772 from EricZ/ms-album
2020-08-24 08:27:14 +08:00
Zichun Ye 9e7d6e2397 fix bernoulli prob formula; fix some other minor bugs
update threshold of softplus computation

support fp for bernoulli and geometric distribution
2020-08-23 17:49:09 -04:00
Eric c79db93c48 Initial commit for album
Added linter fix for album dataset

Added testDataset

Adding signature

Added JsonDataset example API

Example dataset

Resolving format

More fixing

Refactor

Small fix

Added compiling album dataset

Running tests

Added linter fix #1

Passing UT

Added dataset API

Addressing clang

Clang part 2

Fixing pass

Fixed tree check

lint fix

Added lint fix part 2
2020-08-22 11:07:10 -04:00
mindspore-ci-bot 94a109f476 !4898 Fix coredump caused by function call depth too large
Merge pull request !4898 from fary86/fix_call_depth_too_large
2020-08-22 16:08:27 +08:00
fary86 04524b6bd3 Fix coredump caused by function call depth too large 2020-08-22 15:00:04 +08:00
mindspore-ci-bot ac81886328 !4916 fix generator_dataset hangs and test_graphdata_distributed.py failing randomly
Merge pull request !4916 from heleiwang/gnn_fix_bug
2020-08-22 10:51:01 +08:00
mindspore-ci-bot b366608a3f !4952 Fix errors in log calculation logics
Merge pull request !4952 from peixu_ren/custom_pp_ops
2020-08-22 10:40:40 +08:00
mindspore-ci-bot 9b503e4f38 !4955 Fixes for Dynamic Augmentation Ops
Merge pull request !4955 from MahdiRahmaniHanzaki/dynamic-ops-fix
2020-08-22 10:27:50 +08:00
peixu_ren 1c8eb9b15d Fix errors in log calculation logics 2020-08-21 21:28:10 -04:00
Mahdi a5f9b8f92e Added fix for MixUpBatch and CutMixBatch and for RandomAffine
updated c color op descriptions
2020-08-21 17:40:08 -04:00
mindspore-ci-bot 9d7250c483 !4776 Introduce 2 extra ctrl flags to DataBuffer in dataset, address remaining cmts to PR4632
Merge pull request !4776 from ZiruiWu/map_callback_follow_up
2020-08-22 03:31:31 +08:00
Zirui Wu 74c1e6da60 introducing pause and quit flags to DataBuffer
fix review cmts

fix ci

fix Ci

fixci

address ci

ci

- add timeout
- add more test cases

fix CI

address review cmts
2020-08-21 14:33:26 -04:00
mindspore-ci-bot 82c888f065 !4930 Fix CI cifar hang issue
Merge pull request !4930 from xiefangqi/fix_cifar_nofile_issue
2020-08-21 20:49:40 +08:00
xiefangqi e3e7820413 fix cifar stuck problem 2020-08-21 19:35:07 +08:00
mindspore-ci-bot 0d1a7ac654 !4909 [bug]support implicit type conversion for parameter
Merge pull request !4909 from vlne-v1/I1QM7L-implicit-type-conversion-parameter
2020-08-21 17:08:23 +08:00
BowenK e7c6b7e66a Add NewParameter and Imm patterns 2020-08-21 16:53:04 +08:00
mindspore-ci-bot c92f7c9170 !4911 add func type check for switch layer
Merge pull request !4911 from riemann_penn/add_func_type_check_for_switch_layer
2020-08-21 16:42:12 +08:00
panyifeng abab21ed57 add func type check for switch layer 2020-08-21 16:11:40 +08:00
mindspore-ci-bot 6e8d3a3b82 !4859 Add CTCGrerdyDecoder ops for old backend.
Merge pull request !4859 from liuxiao93/Add-ReversSqueuce-EditDistance-CTCGrerdyDecoder
2020-08-21 16:05:19 +08:00
heleiwang 4870abc848 1. fix generator_dataset hangs
2. fix test_graphdata_distributed.py failing randomly
2020-08-21 16:03:06 +08:00
Wei Luning 77dcdd89ec support parameter updata with implicit type conversion 2020-08-21 15:24:57 +08:00
panyifeng f9f3cd7ce0 fix switch_layer_issues 2020-08-21 14:17:51 +08:00
mindspore-ci-bot b2a5440548 !4883 Fix compilation warnings
Merge pull request !4883 from zhoufeng/xiu-ba-ge
2020-08-21 12:33:20 +08:00
mindspore-ci-bot bccb92adf7 !4868 fix: concat with none sample dataset
Merge pull request !4868 from guozhijian/fix_concat_with_zero_dataset
2020-08-21 12:02:30 +08:00
liuxiao93 9bc18ea2e5 Add CTCGrerdyDecoder ops for GE. 2020-08-21 10:12:01 +08:00
Su Teng e3ae23c939 add parallel attention test 2020-08-21 10:10:53 +08:00
mindspore-ci-bot 2ac410e90d !4789 Add EditDistance op for GE.
Merge pull request !4789 from liuxiao93/Add-EditDistance-op-for-GE
2020-08-21 09:49:38 +08:00
mindspore-ci-bot 3d06cbf987 !4801 Must set or change parallel mode before any Initializer created
Merge pull request !4801 from yihuaijie/dev
2020-08-21 09:47:32 +08:00
zhoufeng 22ec976ef7 fix compilation warnings
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2020-08-21 09:44:04 +08:00
jonyguo 5b4b539751 fix: concat with none sample dataset 2020-08-21 09:19:50 +08:00
mindspore-ci-bot 9a3baf4f6c !4314 [MD] remove defaults used in binding code, and remove bilinear resize op
Merge pull request !4314 from nhussain/clean_up_bindings
2020-08-20 22:16:56 +08:00
mindspore-ci-bot bfa3cd900e !4843 remove ccsrc/common.h by explicit dependent header file
Merge pull request !4843 from xychow/remove-ccsrc-common-h
2020-08-20 22:02:13 +08:00
mindspore-ci-bot 98052f9d06 !4847 [MD] Add some data validation
Merge pull request !4847 from xiefangqi/xfq_add_numworker_validate
2020-08-20 20:22:51 +08:00
mindspore-ci-bot 2cb22a0f78 !4688 Fix bool operation parsing to be consistent with pynative
Merge pull request !4688 from amongo/FixBoolParse
2020-08-20 20:06:41 +08:00
liuxiao93 4c99f4f649 Add EditDistance op for GE. 2020-08-20 19:39:57 +08:00
Yi Huaijie 89a4ebf8a1 parallel mode must be set before create an initializer 2020-08-20 19:20:46 +08:00
zhousiyi d0e58dd765 remove ccsrc/common.h
replace frontend/operator/ops.h in backend with base/core_ops.h as
backend should not use any frontend-only primitive
2020-08-20 09:34:07 +00:00
xiefangqi 7dc7990d75 add NumWorkers validate 2020-08-20 17:25:30 +08:00
huangdongrun f30418991c refactor bool op parsing to be consistent with pynative mode
add testcase of st
2020-08-20 16:45:30 +08:00
mindspore-ci-bot 9ee144ea40 !4744 [AutoParallel]Support bert
Merge pull request !4744 from lichen/support_bert
2020-08-20 14:13:19 +08:00
mindspore-ci-bot 7b0a4e5929 !4796 Fix randomdata ut core dump problem
Merge pull request !4796 from xiefangqi/fix_randomdata_ut
2020-08-20 14:11:55 +08:00
xiefangqi c0d18d2517 fix randomdata ut problem 2020-08-20 11:13:02 +08:00
mindspore-ci-bot ed954dc407 !4782 Python UT fails on RandomPosterize
Merge pull request !4782 from islam_amin/bbox_class
2020-08-20 10:18:59 +08:00
mindspore-ci-bot 24700afa2d !4689 add check for user define bprop in Pynative mode
Merge pull request !4689 from zhangbuxue/add_check_for_user_define_bprop_in_Pynative_mode
2020-08-20 09:43:46 +08:00
islam_amin 85357238fe Fixing posterize python ut 2020-08-19 21:35:07 -04:00
Jesse Lee 8a08d0c37b Phase 2 of CacheOp 2020-08-19 13:45:55 -04:00
Zirui Wu 78c1aa1d96 Implemented Callback for Dataset
implment pause in MapOp, added more to callback

add ds_callback

- Initial drop of Python DSCallback

- Pybind DSCallback

- Pybind DSCallback

added callback to mapOp

- de_pipeline DSCallback

- de_pipeline DSCallback

add test case, segfault for now

fix seg fault

- de_pipeline DSCallback

remove 1 line

update callback test case, now works

use builder class for mapOp callback

- de_pipeline DSCallback

- de_pipeline DSCallback

- de_pipeline DSCallback

better test case

minor fix

add comments and minor clean ups

get rid of nullptr in MapOp, use other flag instead

fix a bug ParseMapOp only takes 1 callback

- Added WaitedDSCalabck

refactor callback param

fix text case incorrect number

- added testing

fix cpp test case

- added testing

- revert back lenet changes

- cleanup test_callbacks.py

- cleanup test_callbacks.py

fix CI stage I

fix CI stage II

fix CI and update epoch counter

- add validation
- add more testing  test_callbacks.py

use random data op to do tests

adjust when to call EpochBegin/End

- add repeat with callback

- addressing reviewers' comments

- docstring and CI fixes

- docstring and CI fixes

- docstring and CI fixes

- rebase with upstream/master

fix cpp test case

fix review comments

addr review cmts, add test case
2020-08-19 12:31:04 -04:00
YangLuo b50ae27c72 !4597 [Dataset] C++ API Support for build_vocab 2020-08-19 22:47:47 +08:00
nhussain eb9a611041 remove old defaults 2020-08-19 10:11:19 -04:00
buxue 855d6b8fed add check for user define bprop in Pynative mode. 2020-08-19 19:14:02 +08:00
lichenever 221a801395 auto parallel support bert 2020-08-19 17:47:59 +08:00
mindspore-ci-bot d541e261a0 !4696 C++ API Support for CSV Dataset
Merge pull request !4696 from jiangzhiwen/jzw/c_api_csv
2020-08-19 17:08:33 +08:00
mindspore-ci-bot 70a218123b !4722 modiy error type
Merge pull request !4722 from lijiaqi/modify_error_type
2020-08-19 16:18:50 +08:00
mindspore-ci-bot 2db4bda219 !4622 serving restful init
Merge pull request !4622 from hexia/http_init
2020-08-19 16:15:58 +08:00
mindspore-ci-bot 256dccc651 !4498 Gnn data processing supports distributed scenarios
Merge pull request !4498 from heleiwang/gnn_distributed
2020-08-19 16:09:05 +08:00
jiangzhiwen 39df25f803 c++ api for CSV Dataset 2020-08-19 16:02:11 +08:00
李嘉琪 c65ea1687b modify error type 2020-08-19 14:21:56 +08:00
mindspore-ci-bot 2d683234fb !4723 Support to concat more than 3 tensors in auto parallel mode
Merge pull request !4723 from yangzhenzhang/concat-more-than-3-tensors
2020-08-19 14:16:02 +08:00
yangzhenzhang cda08f6a52 concat 3 tensors in auto parallel mode 2020-08-19 11:27:35 +08:00
heleiwang 8ee4d8e92d Gnn data processing supports distributed scenarios 2020-08-19 11:09:01 +08:00
mindspore-ci-bot 6868b9b6fa !4422 Minddata new dataset api ==> RandomData
Merge pull request !4422 from xiefangqi/xfq_c++api_randomdata
2020-08-19 10:48:53 +08:00
mindspore-ci-bot 50b5c8035b !4701 fix concat get_dataset_size error
Merge pull request !4701 from guozhijian/fix_concat_get_dataset_size_err
2020-08-19 09:14:30 +08:00
xiefangqi b91e56375e add randomdataset and schema 2020-08-19 09:13:43 +08:00
nhussain 738ae2c78d change api to use std_vector
try to display image
2020-08-18 15:41:21 -04:00
islam_amin 979111d0ef Added Posterize Op 2020-08-18 13:55:47 -04:00
jonyguo b0b370336f fix: concat get_dataset_size error 2020-08-18 23:40:17 +08:00
jonyguo 5f294fb90d fix: random affine parameter check 2020-08-18 21:58:53 +08:00
panyifeng 22a9d02e9f switch_layer incorporate env_get and tuple_get 2020-08-18 20:23:23 +08:00
hexia 75d116b5db serving http init 2020-08-18 20:15:47 +08:00
mindspore-ci-bot 4f46c4277a !4614 Code compile performance optimization
Merge pull request !4614 from zhoufeng/code-compile-performance
2020-08-18 16:45:15 +08:00
mindspore-ci-bot cc077de9e3 !4425 fix if statement with no return coredump
Merge pull request !4425 from fary86/fix_if_no_return_coredump
2020-08-18 16:09:31 +08:00
mindspore-ci-bot 2ae6365d77 !4650 EmbeddingLookup support auto parallel
Merge pull request !4650 from yangzhenzhang/embedding-lookup-auto-parallel
2020-08-18 15:51:04 +08:00
zhoufeng 663278112f optimize code compile performance
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2020-08-18 14:33:24 +08:00
mindspore-ci-bot 025e6f23f7 !4643 add test cases for parameter slice init using all kind of initializers
Merge pull request !4643 from yihuaijie/dev
2020-08-18 14:21:41 +08:00
mindspore-ci-bot 26de4540ef !4639 rename param_value to param_info
Merge pull request !4639 from vlne-v1/rename_param_value
2020-08-18 14:16:23 +08:00
fary86 38083e055a Fix coredump missing return statement after while loop 2020-08-18 14:16:21 +08:00
yangzhenzhang 6f6a8ae9f0 embedding lookup auto parallel 2020-08-18 11:40:09 +08:00
Wei Luning c1c30a44f1 rename param_value -> param_info 2020-08-18 11:16:28 +08:00
Yi Huaijie 0f7ead5f14 parameter slice init test all initializers 2020-08-18 10:34:15 +08:00
jiangzhiwen a88273bd3f c++ api support for Manifest Dataset 2020-08-18 09:48:55 +08:00
mindspore-ci-bot 113ff6ca24 !4367 CutMixBatch Augmentation Op
Merge pull request !4367 from MahdiRahmaniHanzaki/cutmix
2020-08-18 03:27:33 +08:00
mahdi 3ecc53fb4e Added CutMix 2020-08-17 13:01:47 -04:00
mindspore-ci-bot d1ad33676b !4598 support axis is None for all and any interface in graph mode
Merge pull request !4598 from zhangbuxue/support_axis_is_None_for_all_and_any_in_graph_mode
2020-08-17 19:52:40 +08:00
buxue 09f1a4bbaf support axis is None for all and any interface in graph mode. 2020-08-17 17:53:02 +08:00
jonyguo 8bb4449fa8 add testcase for padded dataset with decode op 2020-08-17 16:43:23 +08:00
mindspore-ci-bot f41ca6b5c6 !4558 soft_dvpp_decode_resize_jpeg_op issue resolved, input size can be an int, break the constraints of input size being sequence (height, width)
Merge pull request !4558 from magemomou/my/work
2020-08-17 16:40:43 +08:00
mayang c410c6a6e2 soft_dvpp_decode_resize_jpeg_op issue resolved, input size can be an int, break the constraints of input size being sequence (height, width) 2020-08-17 14:57:04 +08:00
mindspore-ci-bot dda4c26e7c !4423 add reshape type of tensor
Merge pull request !4423 from lianliguang/add-reshape-type-to-tensor
2020-08-17 11:34:11 +08:00
WilliamLian 6760d9976d add reshape type to tensor 2020-08-17 09:34:38 +08:00
mindspore-ci-bot f875bf21bc !2948 fix control flow
Merge pull request !2948 from amongo/FixControlFlow
2020-08-17 08:56:22 +08:00
huangdongrun 2a6d346d2f support if by if grad parameter
add join for ref

adjust env eliminate to eliminate all env ops

add partial app cache

resolve while endless

fix env eliminate

support for "for while" cases

fix join shape error
2020-08-15 09:47:10 +08:00
Cathy Wong 9c8af0d1cf C++ API: Provide validate param functions 2020-08-14 17:54:38 -04:00
mindspore-ci-bot 7d70fb4dc4 !3769 add RandomColorOp
Merge pull request !3769 from Alexey_Shevlyakov/ColorOp
2020-08-14 23:43:08 +08:00
mindspore-ci-bot 0e4d2c2535 !4188 fix switch layer sigle prim cell
Merge pull request !4188 from riemann_penn/fix_switch_layer_sigle_prim_cell
2020-08-14 19:54:37 +08:00
mindspore-ci-bot f41c21c5fa !4284 remove to_full_tensor and load_inputs in exexute stage
Merge pull request !4284 from yao_yf/remove_to_full_tensor_and_load_inputs_in_exexute_stage
2020-08-14 18:05:44 +08:00
mindspore-ci-bot 659ed37812 !4443 [bug]fix bugs in parameters and add ut cases
Merge pull request !4443 from vlne-v1/I1RDCY-slice_shape_update_initializer
2020-08-14 18:03:20 +08:00
mindspore-ci-bot ebdea65f70 !4402 [Dataset] Fix c_api bugs
Merge pull request !4402 from luoyang/c-api-pyfunc
2020-08-14 17:40:32 +08:00
panyifeng 1c296b96c9 fix switch layer sigle prim cell 2020-08-14 17:04:01 +08:00
Wei Luning d18ce95714 * add support to update by scalar* fix update error for by Initializer when slice_shape is* add ut for compute and update 2020-08-14 16:35:28 +08:00
yao_yf cbb4363fa7 remove to_full_tensor and load_inputs in exexute stage 2020-08-14 11:40:27 +08:00
mindspore-ci-bot 0f637fdc58 !4404 update field split
Merge pull request !4404 from yangzhenzhang/update-field-split-in-forward-communication
2020-08-14 10:16:24 +08:00
mindspore-ci-bot e9629f95e1 !4418 Add UniqueWithPad cpu kernel
Merge pull request !4418 from huanghui/unique-with-pad-cpu-kernel
2020-08-14 09:46:22 +08:00
mindspore-ci-bot 93f60269c3 !4369 Added distribution_specific_args checking to some functions and fixed minor issues in docs
Merge pull request !4369 from XunDeng/pp_poc_v3
2020-08-14 09:33:23 +08:00
yangzhenzhang 14c77c9f03 update field split 2020-08-14 09:00:56 +08:00
Alexey Shevlyakov 8526d5414d RandomColor 2020-08-13 16:10:21 -04:00
mindspore-ci-bot 2953720169 !4322 Adding RGBA color conversion
Merge pull request !4322 from EricZ/bitmap_support
2020-08-14 01:58:33 +08:00
mindspore-ci-bot 7a10e07fc6 !4383 Add distributedSampler to concatOP
Merge pull request !4383 from genglishuai/genglshOK
2020-08-14 00:06:06 +08:00
eric 6a41b44724 Added wrapper around color change function 2020-08-13 11:39:56 -04:00
genglishuai 4d4df68d1e add DistributedSampler for Concat op 2020-08-13 22:52:02 +08:00
luoyang 373adaa553 !4402 [Dataset] Fix c_api bugs 2020-08-13 22:38:55 +08:00
mindspore-ci-bot b4b6e5c8ed !4370 support kw and kwargs for cell in Pynative
Merge pull request !4370 from zhangbuxue/support_kw_and_kwargs_for_cell_in_pynative
2020-08-13 22:19:41 +08:00
mindspore-ci-bot ed1244558c !4366 Fixing param type in c++ api and fixing python validator for Repeat Op
Merge pull request !4366 from TinaMengtingZhang/cpp-api-repeat-count
2020-08-13 22:03:39 +08:00
huanghui 8f70af7300 add unique_with_pad cpu kernel 2020-08-13 21:55:00 +08:00
buxue 0be4114240 support kw and kwargs for cell in Pynative 2020-08-13 20:29:47 +08:00
mindspore-ci-bot 1b63c76c61 !4194 Add infer and dpn to nn/probability
Merge pull request !4194 from zhangxinfeng3/master
2020-08-13 17:32:50 +08:00
mindspore-ci-bot 2db0290c49 !4356 Add validation for field split
Merge pull request !4356 from yangzhenzhang/update-field-split
2020-08-13 16:43:44 +08:00
mindspore-ci-bot 58be11907c !4346 all dataset support get_dataset_size
Merge pull request !4346 from anzhengqi/I1PXKS-Dataset-support-getsize
2020-08-13 14:49:22 +08:00
mindspore-ci-bot 579e0ab925 !4354 modify python ut runtest.sh
Merge pull request !4354 from changzherui/mod_python_ut
2020-08-13 14:17:44 +08:00
zhangxinfeng3 b16b71b9e8 add infer and dpn 2020-08-13 11:46:07 +08:00
mindspore-ci-bot 1716beb037 !3942 embeddinglookup_wrap
Merge pull request !3942 from yao_yf/embeddinglookup_wrap
2020-08-13 11:21:22 +08:00
yangzhenzhang 4a0e6ff7fc update field split 2020-08-13 10:35:04 +08:00
Xun Deng c0a3b51bb8 fixed minor issues in docs, updated parameter checking in some functions in distributions 2020-08-12 22:05:58 -04:00
mindspore-ci-bot 03210ef166 !2557 Add UnsortedSegmentSum fission pass
Merge pull request !2557 from huanghui/unsorted-segment-sum-fission-pass
2020-08-13 08:57:01 +08:00
mindspore-ci-bot 265064733b !4340 move cc file that end with py to pybind
Merge pull request !4340 from liubuyu/master
2020-08-13 08:56:01 +08:00
tinazhang 0868720eb7 fix parameter type for repeat op in c++ api and added c++/python ut. 2020-08-12 17:23:42 -04:00
tony_liu2 deb1146474 reorganize headers and tests
remove headers

fix iterator file

fix pr comments

fix new file
2020-08-12 14:36:01 -04:00
huanghui b8d7f6d77f add UnsortedSegmentSum fission pass 2020-08-12 19:17:19 +08:00
changzherui d3f709be55 modify python ut runtest.sh 2020-08-12 19:06:06 +08:00
anzhengqi 3e31ac6d62 all Dataset support get_dataset_size 2020-08-12 15:35:47 +08:00
liubuyu 45b6600001 mv cc file that end with py to pybind 2020-08-12 14:50:18 +08:00
yao_yf e4de26d5bc embeddinglookup wrap 2020-08-12 14:24:13 +08:00
mindspore-ci-bot 5adba834d0 !3819 C++ API Support for CLUE Dataset
Merge pull request !3819 from jiangzhiwen/jzw/c_api_clue
2020-08-12 14:21:19 +08:00
mindspore-ci-bot 735fc98c78 !4265 support two mstypes do equal.
Merge pull request !4265 from zhangbuxue/support_two_mstypes_do_equal
2020-08-12 11:43:04 +08:00
mindspore-ci-bot 5b3f209e43 !4269 change export from geir to air
Merge pull request !4269 from fary86/change_export_interface
2020-08-12 10:25:00 +08:00
jiangzhiwen 5842a0212f c++ api support for CLUE Dataset 2020-08-12 09:55:43 +08:00
mindspore-ci-bot e509f87f7f !4219 Add Unique CPU kernel
Merge pull request !4219 from huanghui/add-op-unique
2020-08-12 09:39:14 +08:00
buxue 35677ac098 support two mstypes do equal. 2020-08-12 09:12:46 +08:00
mindspore-ci-bot 9276a9d2fb !3771 C++ API Support for TextFile Dataset
Merge pull request !3771 from cathwong/ckw_c_api_textfile_nosampler
2020-08-12 04:32:05 +08:00
avakh 477528de7f random sharpness cpp op support 2020-08-11 15:30:40 -04:00
mindspore-ci-bot 8ee68ae667 !4245 [MD] Add SolarizeOp
Merge pull request !4245 from nhussain/solarize
2020-08-12 02:27:42 +08:00
fary86 73325e0f01 Change export interface 2020-08-12 00:01:31 +08:00
nhussain 7766efd58e add files 2020-08-11 11:54:14 -04:00
Cathy Wong 7f39b5cfd7 C++ API Support for TextFile Dataset and Unit Tests 2020-08-11 11:53:53 -04:00
mindspore-ci-bot 4f75adb11a !4297 sync code incubator to master
Merge pull request !4297 from guozhijian/code_sync_incubator_f3c32baf_to_master_fcfc75a3_0811
2020-08-11 22:13:46 +08:00
huanghui fa081092c8 add Unique cpu kernel 2020-08-11 21:36:55 +08:00
mindspore-ci-bot c2997845c2 !4289 Fix pad op validate issue
Merge pull request !4289 from xiefangqi/fix_pad_validate
2020-08-11 20:20:35 +08:00
mindspore-ci-bot 67f5b0e916 !4258 change binary to mindir
Merge pull request !4258 from leopz/fix_doc
2020-08-11 20:17:41 +08:00
mindspore-ci-bot c6acafcbc6 !4268 fix glog level dont work
Merge pull request !4268 from liubuyu/master
2020-08-11 20:05:03 +08:00
jonyguo 4964f7703a Merge branch 'master' into code_sync_incubator_f3c32baf_to_master_fcfc75a3_0811 2020-08-11 19:40:04 +08:00
mindspore-ci-bot a2827eb657 !3874 add SoftDvppDecodeResizeJpegOp and SoftDvppDecodeRandomCropResizeJpeg op
Merge pull request !3874 from qianlong21st/soft_dvpp
2020-08-11 19:00:36 +08:00
mindspore-ci-bot 468e797e97 !4255 unify primitive
Merge pull request !4255 from lianliguang/unify-primitive
2020-08-11 18:41:21 +08:00
xiefangqi 7ee1e46455 fix pad op validate issue 2020-08-11 17:28:08 +08:00
liubuyu 25a67602b7 bug fix for glog level don't work 2020-08-11 16:44:50 +08:00
qianlong e9c4378ed8 add support of soft dvpp op 2020-08-11 15:46:07 +08:00
leopz eea597c92a change binary to mindir 2020-08-11 15:18:40 +08:00
WilliamLian 1f5441d73a remove inferfunction to core 2020-08-11 14:22:29 +08:00
mindspore-ci-bot b120cbcfb4 !4249 Add parameter checking in distributions
Merge pull request !4249 from XunDeng/pp_poc_v3
2020-08-11 14:16:29 +08:00
mindspore-ci-bot 6772bbde8d !4021 Add ScalarAffine and Softplus bijector
Merge pull request !4021 from XunDeng/scalar_affine_softplus
2020-08-11 14:14:35 +08:00
mindspore-ci-bot 0115876363 !4197 Add AdamApplyOneAssign fusion pass
Merge pull request !4197 from YuJianfeng/adam_assign
2020-08-11 11:26:00 +08:00
mindspore-ci-bot 266df56570 !4220 [MD] add num_samples support in minddataset pk sampler
Merge pull request !4220 from liyong126/minddataset_pk_num_samples
2020-08-11 11:22:28 +08:00
mindspore-ci-bot f21ee64fd0 !4247 Add ChannelSwap operation
Merge pull request !4247 from 章一智/channel_swap_op
2020-08-11 09:59:55 +08:00
mindspore-ci-bot 2cab58fdbc !3850 Implementing RandomAffine C Op and a CPP UT for AutoContrast & Equalize
Merge pull request !3850 from islam_amin/randomaffine_op
2020-08-11 09:29:09 +08:00
mindspore-ci-bot 0bb39830ae !4250 fix cpp api iterator build function
Merge pull request !4250 from anthonyaje/fix_cpp_api_iterator
2020-08-11 07:21:27 +08:00
anthonyaje 9774505ecd Fixed dataset cpp api iterator build function 2020-08-10 18:35:59 -04:00
islam_amin e52d85ba9d Added RandomAffine Op 2020-08-10 17:52:50 -04:00
mindspore-ci-bot 612f533d15 !3917 Add c++ ops CreateTupleIterator & Code changes in VOC DatasetOp
Merge pull request !3917 from luoyang/c-api
2020-08-11 05:50:21 +08:00
ervinzhang 3a1d8b5f39 added channel swap operation in transforms.h 2020-08-10 17:32:50 -04:00
Xun Deng be6db4a6fe add scalar affine and softplus bijector 2020-08-10 16:07:54 -04:00
Xun Deng 415dad3adb added some parameter checking 2020-08-10 15:46:24 -04:00
mindspore-ci-bot 9ad82f79fd !3979 Adding MixUp operation
Merge pull request !3979 from MahdiRahmaniHanzaki/mixup
2020-08-10 23:01:26 +08:00
liyong 7341421d3b fix num samples in pk sampler 2020-08-10 19:05:47 +08:00
mindspore-ci-bot e195fa6f9e !4192 Fix md five_crop ci problem
Merge pull request !4192 from xiefangqi/xfq_validate_ci
2020-08-10 18:59:23 +08:00
xiefangqi 3d7826b6df test five crop problem 2020-08-10 16:59:24 +08:00
yujianfeng 8a77751988 Add AdamApplyOneAssign and AdamApplyOneWithDecayAssign fusion pass 2020-08-10 14:46:37 +08:00
YangLuo e6a12946c8 Updata voc build() & add C++ Op CreateTupleIterator 2020-08-10 11:53:58 +08:00
mindspore-ci-bot fe0b8d6272 !4068 Add parallel operator for Concat
Merge pull request !4068 from yangzhenzhang/add-concat-op
2020-08-10 10:15:29 +08:00
mindspore-ci-bot e7df54166c !3982 Add LGamma op
Merge pull request !3982 from peixu_ren/custom_pp_ops
2020-08-10 09:39:33 +08:00
peixu_ren 3820533ad1 Refactor Gamma and Poisson ops 2020-08-09 19:47:26 -04:00
liubuyu 195f04e50e compile the core directory into a separate static library 2020-08-08 21:31:41 +08:00
changzherui 22336c0843 sync 0807 code to ms-incubator 2020-08-08 10:43:09 +08:00
Mahdi 1896950ae5 Added Mixup 2020-08-07 17:47:16 -04:00
tony_liu2 3a020fe877 split c_api_test
split into datasets

review fix

fix merge issues

fixed minddata lite build issues
2020-08-07 11:57:49 -04:00
peixu_ren 517fed55a5 Added LGamma op 2020-08-07 11:40:59 -04:00
mindspore-ci-bot e19d382473 !3346 Maintain epoch/repeat count for ops
Merge pull request !3346 from lixiachen/repeat_rework
2020-08-07 20:39:19 +08:00
yangzhenzhang f4bb43bbaf add concat op 2020-08-07 15:47:17 +08:00
mindspore-ci-bot a395907182 !3944 Minddata new dataset api ==> CelebA
Merge pull request !3944 from xiefangqi/md_new_api_CelebA
2020-08-07 14:26:54 +08:00
panyifeng 34e50e5d6e fix cell bprop 2020-08-07 10:57:01 +08:00
mindspore-ci-bot 3b7df4e512 !4072 Fix a bug in Tensor::equals()
Merge pull request !4072 from hewei/fixbug_tensor_equal
2020-08-07 09:55:55 +08:00
xiefangqi 6276c0f22f new c++ api ==> CelebA 2020-08-07 09:23:20 +08:00
Lixia Chen ac85b77b76 Maintain epoch/repeat count for ops 2020-08-06 09:47:31 -04:00
mindspore-ci-bot 470328eeaf !4060 fix do concat in while loop specialize error
Merge pull request !4060 from fary86/fix_while_concat_specialize_error
2020-08-06 21:12:13 +08:00
He Wei d310891eca Fix a bug in Tensor::equals()
1. Check if data_ is null before compare it;
2. Always allocate an array for data_ even if size is zero.
2020-08-06 21:06:27 +08:00
Wei Luning d4d6457ea7 init parameter data by defaultOnly keep no data as MetaTensor in auto parallel mode 2020-08-06 19:52:31 +08:00
fary86 7602054acd Fix do concat in while loop specialize error 2020-08-06 19:41:11 +08:00
mindspore-ci-bot fe7141e9e0 !4019 add tensor layout in strategy checkpoint
Merge pull request !4019 from yao_yf/add_layout_in_stra_ckpt
2020-08-06 19:00:11 +08:00
yao_yf 60a9fb0001 add_tensor_layout_in_stra_ckpt 2020-08-06 15:57:38 +08:00
kingfo 28dabf0332 fix grad flag update issue in pynative 2020-08-06 15:12:31 +08:00
mindspore-ci-bot 0b407dfe78 !4005 unsortedsegsum grad
Merge pull request !4005 from fangzehua/unsortedsegsum
2020-08-06 14:19:20 +08:00
mindspore-ci-bot c493859978 !4004 add squreasumall grad
Merge pull request !4004 from fangzehua/squaresumall
2020-08-06 14:18:23 +08:00
mindspore-ci-bot 235378d5d7 !3789 eager mode sparse
Merge pull request !3789 from riemann_penn/eager_mode_sparse
2020-08-06 09:33:50 +08:00
mindspore-ci-bot 7ec0b5857a !3977 [MD] Refactor Concatenate Op
Merge pull request !3977 from nhussain/multi_dim_concat_2
2020-08-06 02:53:06 +08:00
ervinzhang c65670b1a7 changed sampler parameter to support std::move 2020-08-05 13:56:52 -04:00
mindspore-ci-bot 6aa65da5d2 !3860 Minddata new dataset api ==> Coco
Merge pull request !3860 from xiefangqi/md_new_api_cocodataset
2020-08-06 00:34:28 +08:00
nhussain 61769b2dd9 fix concat 2020-08-05 11:28:56 -04:00
fangzehua 99f2be7064 unsortedsegsum grad 2020-08-05 20:34:06 +08:00
fangzehua 7011508379 add squreasumall grad 2020-08-05 20:28:02 +08:00
mindspore-ci-bot b045f47428 !3983 Add ReduceMin fission pass
Merge pull request !3983 from huanghui/reduce-min-fission-pass
2020-08-05 19:46:00 +08:00
panyifeng 9927e6eb5c eager mode sparse 2020-08-05 18:21:30 +08:00
mindspore-ci-bot 8dec74908a !4000 improve interface '__bool__' for tensor
Merge pull request !4000 from zhangbuxue/improve_bool_for_tensor
2020-08-05 17:21:41 +08:00
mindspore-ci-bot 617b98f104 !3966 [AutoParallel]Add dropout distributed op
Merge pull request !3966 from lichen/add_dropout_distributed_op
2020-08-05 16:38:32 +08:00
buxue ace34525cd improve interface '__bool__' for tensor 2020-08-05 16:14:14 +08:00
mindspore-ci-bot 52689a7dcf !3938 decoupling core and context
Merge pull request !3938 from liubuyu/master
2020-08-05 14:16:37 +08:00
lichenever bfc96de1b9 add dropout distributed op 2020-08-05 14:07:24 +08:00
peixu_ren b9c8c0b439 Added Bijector TransformDistribution base classes and two instances: power and exp bijectors 2020-08-05 00:03:50 -04:00
mindspore-ci-bot 98c415a1d5 !3807 serving support acl dvpp process
Merge pull request !3807 from 徐永飞/master
2020-08-05 11:00:21 +08:00
xiefangqi bb7bda1d6b new dataset api -- Coco 2020-08-05 10:54:37 +08:00
huanghui 30000fdb52 add ReduceMin fission pass 2020-08-05 10:46:01 +08:00
mindspore-ci-bot a301fc1757 !3916 remove loss_scale range check which is a temp fix.
Merge pull request !3916 from xychow/remove-loss-scale-range-check
2020-08-05 10:16:15 +08:00
liubuyu d81862a916 decoupling core and context 2020-08-05 08:15:14 +08:00
xuyongfei c0b8df4f7c serving add acl dvpp support, ut tests, return input status string message 2020-08-04 21:40:21 +08:00
mindspore-ci-bot 5827ba9a8a !3940 View code support interface 'all' and 'any' of tensor
Merge pull request !3940 from zhangbuxue/support_interface_all_and_any_of_tensor
2020-08-04 20:08:44 +08:00
buxue 2c4cb49a11 support interface 'all' and 'any' of tensor 2020-08-04 18:24:56 +08:00
zhousiyi 7d31deb6fa remove loss_scale range check to make FP32Imm(inf) comparison equal 2020-08-04 08:08:29 +00:00
mindspore-ci-bot 8b396cea98 !3915 Revert modification of opt
Merge pull request !3915 from Simson/push-to-opensource
2020-08-04 15:59:20 +08:00
mindspore-ci-bot 7da26cc0f6 !3928 change type of Shape from int32 to int64
Merge pull request !3928 from yihuaijie/dev
2020-08-04 15:50:33 +08:00
mindspore-ci-bot 8b3e6496ac !3127 [pynative]pynative steps infer once
Merge pull request !3127 from flywind/infer_2
2020-08-04 14:34:25 +08:00
mindspore-ci-bot bac1781539 !3648 Add some testing cases for mindspore.profiler
Merge pull request !3648 from 张毅辉/zyh_profiler_test
2020-08-04 14:23:15 +08:00
mindspore-ci-bot c3edfe12bc !3715 Update python pattern expression
Merge pull request !3715 from BowenK/new_pattern
2020-08-04 12:58:32 +08:00
Yi Huaijie 80bdcab982 temporarily cast between int64 and int32 to wait ME support int64 2020-08-04 12:21:06 +08:00
mindspore-ci-bot af9398b39a !3756 Change distribution api
Merge pull request !3756 from XunDeng/pp_poc_v3
2020-08-04 11:34:46 +08:00
Yi Huaijie 518cb80133 change type of Shape from int32 to int64 2020-08-04 11:30:23 +08:00
kpy a09565389c optimize infer in pynative mode 2020-08-04 11:22:39 +08:00
mindspore-ci-bot 2da29bce66 !3370 same graph used in different context should be treat differently.
Merge pull request !3370 from xychow/fix-context-dup
2020-08-04 10:56:04 +08:00
simson 3617121ccf revert modification of opt 2020-08-04 10:09:21 +08:00
suteng 19e45ccdb1 回退 'Pull Request !3103 : change type of Shape from int32 to int64' 2020-08-03 22:06:37 +08:00
mindspore-ci-bot aa65cbf733 !3846 Add TBE op SquaredDifference\Xdivy\Xlogy for VM.
Merge pull request !3846 from liuxiao93/Add-ops-SeluSquaredDifference
2020-08-03 21:20:24 +08:00
mindspore-ci-bot 6f7f376b1c !3821 Decouple ME and TBE by the IPC way.
Merge pull request !3821 from ZhangQinghua/master1
2020-08-03 20:34:01 +08:00
mindspore-ci-bot 657b547116 !3103 change type of Shape from int32 to int64
Merge pull request !3103 from yihuaijie/dev
2020-08-03 19:40:19 +08:00
mindspore-ci-bot 27a0a2e333 !3880 fix auto mix precision issue in pynative
Merge pull request !3880 from wangqiuliang/fix-gradients-issue-in-pynative
2020-08-03 19:23:03 +08:00
mindspore-ci-bot a182a87a6d !3820 support tensor attr shape and dtype in graph mode
Merge pull request !3820 from zhangbuxue/support_dtype_and_shape_as_attr_in_graph_mode
2020-08-03 18:57:46 +08:00
liuxiao93 374b7b8583 Add TBE op SquaredDifference for VM. 2020-08-03 18:52:18 +08:00
kingfo 577535b387 fix gradients issue in pynative 2020-08-03 17:35:21 +08:00
buxue b075674cf2 support tensor attr shape and dtype in graph mode 2020-08-03 17:09:31 +08:00
Yi Huaijie 15d5cc396d change type of Shape from int32 to int64 2020-08-03 16:47:19 +08:00
mindspore-ci-bot be507b96e0 !3473 [refine]change base class of parameter
Merge pull request !3473 from vlne-v1/change_base_class_of_parameter
2020-08-03 16:05:46 +08:00
zhousiyi f926650c64 if AbstractFunction comparison succeed in NewContext, then the evaluator should use the same one, otherwise one of the evaluator will not be evaluated.
if funcgraph or metafuncgraph call it recursively, then anf_node should be used as tracking_id to discriminate the first occurcance and the
recursive occurance.
add anf_node to PrimitiveAbstractClosure hash() to reduce cost of GetEvaluatorFor().

ignore the tracking_id to make cse work.
2020-08-03 07:57:07 +00:00
BowenK 6d4c07c886 Update python pattern expression 2020-08-03 15:29:22 +08:00
mindspore-ci-bot 25fdb67e3d !3744 [Auto parallel] Add a new graph operation in the DP algorithm
Merge pull request !3744 from Xiaoda/14-add-new-graph-operations-in-auto-parallel
2020-08-03 11:18:14 +08:00
Wei Luning a05c38bb63 make python Parameter inherit from Tensor 2020-08-03 09:12:24 +08:00
Zhang Qinghua 960da5cbed Decouple the backend TBE from binding Python API. 2020-08-01 17:09:08 +08:00
mindspore-ci-bot d1b3096418 !3837 add_test_for_mindrecord 3
Merge pull request !3837 from liucunwei/add_test_for_mindrecord3
2020-08-01 16:09:50 +08:00
mindspore-ci-bot 5a3b557354 !3814 enhance: map file label start begin 0 in imagenet_to_mr tool
Merge pull request !3814 from liucunwei/enhance_map_file_for_imagenet
2020-08-01 15:01:45 +08:00
z00505269 87668d6ea2 remove predict 2020-08-01 11:45:19 +08:00
liucunwei 8b99114f6d add mindrecord test case 2020-08-01 11:41:58 +08:00
tinazhang e57d849618 add concat op and extend zip support to cpp api 2020-07-31 12:57:50 -04:00
Xun Deng e87e1fc6bc changed distribution api 2020-07-31 12:41:06 -04:00
Eric 8c018da468 Fixing issues in distributed sampler
Added Distributed sampler option

Fix style
2020-07-31 11:12:26 -04:00
mindspore-ci-bot 634d797ca3 !3549 MapOp refactor for device augmentation (part 1)
Merge pull request !3549 from anthonyaje/device_augment_mapop_refactor1
2020-07-31 21:56:16 +08:00
mindspore-ci-bot 27e51c5a63 !3553 Unify np array comparisons
Merge pull request !3553 from tony_liu2/staging
2020-07-31 21:39:31 +08:00
mindspore-ci-bot 953f91cef8 !3739 not eliminate memcpy when nexe node is graph output
Merge pull request !3739 from laiyongqiang/eliminate_memcpy_bug
2020-07-31 17:35:11 +08:00
LiuCunwei c133059c59 enhance: imagenet to mindrecord mapfile 2020-07-31 15:59:45 +08:00
mindspore-ci-bot 4e2b1eec5d !3119 Delete parameter block_reader for MindDataset
Merge pull request !3119 from dengyutao/remove_blockreader
2020-07-31 15:46:15 +08:00
dengyutao 388e43f7cb delete parameter block_reader for MindDataset 2020-07-31 11:30:05 +08:00
Xiaoda Zhang d24a902afe add a new graph operation in autoparallel 2020-07-31 10:57:19 +08:00
liubuyu a499d4e47c decoupling core and debug 2020-07-31 10:39:31 +08:00
mindspore-ci-bot f1e717554c !3537 add sparse operators
Merge pull request !3537 from riemann_penn/add_sparse_operator
2020-07-31 10:25:55 +08:00
peixu_ren 374772035a Refactor random uniform ops and complete gamma and poisson 2020-07-30 09:46:52 -04:00
mindspore-ci-bot 8943d5de34 !3727 Fix fuzz issue and split problem
Merge pull request !3727 from xiefangqi/fuzz_issue_pad_01
2020-07-30 21:24:47 +08:00
laiyongqiang 2458431750 not eliminate memcpy when nexe node is graph output 2020-07-30 19:51:57 +08:00
panyifeng 598bfa0205 add sparse operators 2020-07-30 17:18:23 +08:00
mindspore-ci-bot 61867c7386 !3645 add mindspore hub for download ckpt file
Merge pull request !3645 from chenzhongming/master
2020-07-30 16:25:10 +08:00
mindspore-ci-bot ce08065c23 !3671 vgg: optimize the script and Readme
Merge pull request !3671 from ms_yan/vgg_optimize
2020-07-30 16:00:50 +08:00
xiefangqi 6017b050ac add generatordataset support split 2020-07-30 15:51:28 +08:00
chenzomi 8918c90b66 add mindspore hub for download ckpt file
add mindspore.hub and change model_zoo
2020-07-30 15:02:55 +08:00
mindspore-ci-bot ab4c43007f !3657 Add parallel operator for StridedSlice
Merge pull request !3657 from yangzhenzhang/add-stridedslice-op
2020-07-30 15:02:35 +08:00
mindspore-ci-bot 80dd2cfe00 !3405 fix optimizer parallel problems
Merge pull request !3405 from gziyan/fix_optimizer_parallel
2020-07-30 14:09:16 +08:00
zhangyihui 54f2cf4ef0 add some test case for profiler 2020-07-30 10:43:13 +08:00
ms_yan abbd7b50db optimize the vgg script 2020-07-30 07:48:35 +08:00
Xun Deng e94d91ba95 remove import probability from nn/__init__.py 2020-07-29 15:08:58 -04:00
tony_liu2 269b477684 use np.testing.assert instead of asserting
fix line lengths

fix spacing

reverse a few changes
2020-07-29 14:53:01 -04:00
Ziyan 98e2ee90de fix optimizer parallel problems 2020-07-29 20:55:31 +08:00
yangzhenzhang 9aa84b3d14 add strided slice op 2020-07-29 17:18:50 +08:00
mindspore-ci-bot 4834a6b347 !3574 Rename AnfNode::user_data related functions to follow naming rule
Merge pull request !3574 from hewei/rename_user_data_func
2020-07-29 14:26:21 +08:00
mindspore-ci-bot d06da1d270 !3603 Check that the number columns of names and default matches
Merge pull request !3603 from jiangzhiwen/fix_column_names_exceeded
2020-07-29 11:40:06 +08:00
mindspore-ci-bot b75943f220 !3620 add mindspore lite
Merge pull request !3620 from 张学同/to_merge
2020-07-29 10:54:41 +08:00
mindspore-ci-bot 2f956d7cc2 !3612 modify case
Merge pull request !3612 from changzherui/mod_case
2020-07-29 10:12:17 +08:00
jiangzhiwen 2cc6b5cb52 fix number of columns not match 2020-07-29 09:19:33 +08:00
anthonyaje a7eaf2736a First drop of MapOp refactor to support device augment.
Refactored MapOp to in preparation to support device augment

Minor fix
2020-07-28 15:53:43 -04:00
hangq 174d308cfa add mindspore lite 2020-07-29 03:06:17 +08:00
changzherui 758853ff52 modify case 2020-07-29 00:15:48 +08:00
YangLuo ae99a3a3e4 C++ API support for TakeDatasetOp and VOCDatasetOp 2020-07-28 23:09:57 +08:00
mindspore-ci-bot 46ae7879d4 !3394 Three distribution class instances: Exponential, Geometric Uniform distribution
Merge pull request !3394 from XunDeng/pp_poc_v3
2020-07-28 22:21:29 +08:00
mindspore-ci-bot b6c7273bb6 !3551 [MD] Fix Broken C++ Only Build
Merge pull request !3551 from nhussain/fix_cpp_only_build
2020-07-28 20:12:13 +08:00
mindspore-ci-bot 7cb567ebbe !3543 Split unsupport transdata
Merge pull request !3543 from lianliguang/unify-primitive
2020-07-28 17:23:44 +08:00
He Wei 4eb81d7934 Rename AnfNode::user_data related functions to follow naming rule 2020-07-28 15:35:48 +08:00
WilliamLian 0179724dcd spilit unspported transdata to two transdata from special format -> defualt -> default -> special 2020-07-28 14:23:31 +08:00
guansongsong 1906ed1be8 fix cache description again 2020-07-28 13:26:29 +08:00
guansongsong b6529b9096 fix cache description 2020-07-28 13:03:06 +08:00
guansongsong 620d951e5e Merge branch 'ql/fix_cache_core' of https://gitee.com/qianlong21st/mindspore into ql/fix_cache_core 2020-07-28 11:37:06 +08:00
mindspore-ci-bot 16079e6356 !3472 [Auto parallel] Cost model for GPU
Merge pull request !3472 from Xiaoda/13-add-gpu-costmodel
2020-07-28 09:27:26 +08:00
mindspore-ci-bot 72e45841a2 !3528 Fix the difference of Error type between graph&pynative mode
Merge pull request !3528 from Simson/push-to-opensource
2020-07-28 09:26:49 +08:00
mindspore-ci-bot d4165671d9 !3435 Add parallel operator for Tile
Merge pull request !3435 from yangzhenzhang/add-tile-op
2020-07-28 09:16:30 +08:00
peixu_ren 292f2de0cf Add sampling functions in exponential, geometric and uniform distributions 2020-07-27 17:07:14 -04:00
Xun Deng 7bb83067d0 added exponential uniform geometric distribution
added cdf, logcdf, survival, logsurvival, entropy, mode, cross_entropy wrapper
2020-07-27 17:03:37 -04:00
nhussain b65125b0a1 add more ifdef and include statments for pybind 2020-07-27 13:51:11 -04:00
mindspore-ci-bot ee67f70b73 !3449 Cifar100 for C API
Merge pull request !3449 from MahdiRahmaniHanzaki/cifar100-c-api
2020-07-28 00:09:41 +08:00
Mahdi 92568248c9 Added Cifar100 for C API 2020-07-27 10:35:24 -04:00
ms_yan cf3fff8996 init add vgg16 gpu version
merge the script

optimize the script
2020-07-27 22:26:17 +08:00
mindspore-ci-bot 6e7c673c90 !3519 remove diary file
Merge pull request !3519 from anzhengqi/remove-log
2020-07-27 20:53:41 +08:00
mindspore-ci-bot e9316b1389 !3500 fix sparse feature bug for auto parallel
Merge pull request !3500 from lirongzhen1/master
2020-07-27 19:27:39 +08:00
simson b2cdd5d848 Fix the difference of Error type between graph&pynative mode 2020-07-27 17:28:13 +08:00
mindspore-ci-bot 5f7d2ba396 !3525 Fix a bug for Parameter
Merge pull request !3525 from hewei/fix_parameter_bug
2020-07-27 17:17:16 +08:00
He Wei a6db29b11b Fix a bug for Parameter
1. Parameter's init_data() should have no effect if default_input already set;
2. This bug is introduced by 'decouple ParamValue from python';
3. An unit test case is added to ensure the right init_data() behavior.
2020-07-27 15:32:08 +08:00
Xiaoda Zhang 9097b36950 add resnet50 testcases for gpu 2020-07-27 15:22:30 +08:00
mindspore-ci-bot 568da0d510 !3425 fix avgpoolgrad
Merge pull request !3425 from fangzehua/avgpool
2020-07-27 14:15:29 +08:00
mindspore-ci-bot 8e3d788942 !3349 move the dependency of utils to core
Merge pull request !3349 from liubuyu/master
2020-07-27 11:20:21 +08:00
anzhengqi 081d876438 remove-log 2020-07-27 11:14:38 +08:00
fangzehua 86dd0c583a fix avgpool grad 2020-07-27 11:06:32 +08:00
lirongzhen1 51796aa624 fix sparse feature bug for auto parallel 2020-07-27 10:44:49 +08:00
mindspore-ci-bot 295038d346 !3324 add reduce_any op for vm
Merge pull request !3324 from fangzehua/reduce_any
2020-07-27 10:38:57 +08:00
liubuyu f4bc0bc9fe move the dependency of utils to core 2020-07-27 10:28:46 +08:00
chenfei 1f1a07e645 don't insert assign from condition to true branch of while 2020-07-26 14:38:42 +08:00
mindspore-ci-bot 84c8b85ddc !3452 [MD] Gets rid of uncessary print calls
Merge pull request !3452 from nhussain/refactor_name_function
2020-07-25 20:59:27 +08:00
mindspore-ci-bot 9c06a564d1 !2983 Dataset Tensor class cleanup
Merge pull request !2983 from h.farahat/tensor_class
2020-07-25 20:59:13 +08:00
mindspore-ci-bot 7478c26b75 !3447 Add Crop and SwapRedBlue to C++ API
Merge pull request !3447 from EricZ/crop_rbswap
2020-07-25 18:47:05 +08:00
qianlong bf87b1d1fb fix cache op core dump 2020-07-25 18:37:02 +08:00
yangzhenzhang 6a6e2bd271 add tile op 2020-07-25 11:42:06 +08:00
kingfo 73ea9b7855 fix mix precesion operator issue 2020-07-25 09:40:50 +08:00
mindspore-ci-bot 0a2980ca74 !3440 [MD]Fix Segementation Falut when SentencepieceTokenizer Op before zipOp and ConcatOp
Merge pull request !3440 from xulei/sentence_piece0715
2020-07-25 09:19:34 +08:00
Eric 465a69a70a Added crop signature, wip
Added input check

Added SwapRedBlue
2020-07-24 20:40:45 -04:00
hesham adfbc891d3 - Add checks and testing for empty tensors
- cleanup work on createTensor and Tensor's constructors
2020-07-24 17:23:18 -04:00
nhussain a306264030 remove print calls 2020-07-24 17:10:49 -04:00
mindspore-ci-bot 06ed9ffd6a !3183 Remove files on test fail for test_minddataset*.py
Merge pull request !3183 from tony_liu2/master
2020-07-24 23:47:29 +08:00
mindspore-ci-bot 60feafd75e !3399 Fixing Bug with AutoContrast/Equalize supporting uint8 dtype/mnist
Merge pull request !3399 from islam_amin/autocontrast_bug
2020-07-24 23:46:55 +08:00
mindspore-ci-bot e07f74367d !3299 Rename for C API
Merge pull request !3299 from MahdiRahmaniHanzaki/rename-c-api
2020-07-24 22:14:53 +08:00
xulei2020 0af6d75761 add code 2020-07-24 19:51:27 +08:00
mindspore-ci-bot b1fae868ba !3404 add sparse api docs
Merge pull request !3404 from riemann_penn/add_sparse_api_docs
2020-07-24 17:54:23 +08:00
panyifeng 963bd67a60 add sparse api docs 2020-07-24 15:40:46 +08:00
qianlong d28c63b6c0 fix diff workers disallow cache 2020-07-24 15:30:00 +08:00
buxue e9ca893431 remove ut test_expand_dims_grad 2020-07-24 15:15:41 +08:00
islam_amin 48ec178e77 Fixing AutoContrast/Equalize Bug 2020-07-23 14:32:37 -04:00
Mahdi 2b71cbf1bd Added RenameOp 2020-07-23 12:22:55 -04:00
mindspore-ci-bot de0dcbc0bd !3290 Split parameter and value node with tuple to multiple nodes with make-tuple
Merge pull request !3290 from chenfei_mindspore/split-tuple-parameter-to-parameters
2020-07-23 21:39:27 +08:00
mindspore-ci-bot 2d973c9597 !3161 Set output value for dynamic graph.
Merge pull request !3161 from flywind/output
2020-07-23 21:14:08 +08:00
mindspore-ci-bot 366dd44ca8 !3371 support call super when class define in test_case
Merge pull request !3371 from zhangbuxue/support_call_super_when_class_define_in_test_case
2020-07-23 20:11:25 +08:00
panyifeng 8a89f003eb fix sparse related issues 2020-07-23 19:05:53 +08:00
buxue b812c1a17a support call super when class define in test_case. 2020-07-23 18:30:30 +08:00
kpy 570da089a8 set output value for dynamic graph 2020-07-23 17:05:47 +08:00
mindspore-ci-bot 684ff4f46b !3160 Rewrite tensor's __bool__ for pynative mode
Merge pull request !3160 from Simson/push-to-opensource
2020-07-23 16:55:49 +08:00
simson 5f77fbdd75 Rewrite tensor's __bool__ for pynative mode 2020-07-23 16:51:46 +08:00
root 1b6f85dec8 split tuple parameter to parameters
add function trans tuple to maketuple
2020-07-23 16:46:55 +08:00
mindspore-ci-bot 0a84b63fc3 !3305 modify the vgg16/lstm path to offical/{cv/npl}
Merge pull request !3305 from caojian05/ms_master_dev
2020-07-23 16:01:42 +08:00
fangzehua 228a959cc7 add reduce any op for vm 2020-07-23 14:43:53 +08:00
mindspore-ci-bot 48711414fc !3356 [common]Refine code & Add ToAbstruct for `FuncGraph`, `MetaFuncGraph` `Primitive`
Merge pull request !3356 from vlne-v1/add_to_abstract_for_function
2020-07-23 14:33:58 +08:00
mindspore-ci-bot 9fb6576d8c !3338 Op debug feature
Merge pull request !3338 from zhoufeng/debug-op-overflow
2020-07-23 14:11:38 +08:00
Wei Luning 484d7f10c8 refine code* refine code in bert model* add ToAbstruct for `FuncGraph`, `MetaFuncGraph` `Primitive`* remove partial hard code in spec for poly* remove any in data convert cache 2020-07-23 12:43:37 +08:00
mindspore-ci-bot 24dd2fc2a6 !3333 Fix internal multiple outputs check
Merge pull request !3333 from YuJianfeng/master
2020-07-23 11:38:11 +08:00
mindspore-ci-bot 7f1ccc5f3b !3311 add sparse feature test cases for auto parallel
Merge pull request !3311 from lirongzhen1/master
2020-07-23 11:35:49 +08:00
zhoufeng 000a6c73a5 op debug
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2020-07-23 11:12:02 +08:00
mindspore-ci-bot 21a5f06e93 !3328 Add testcases
Merge pull request !3328 from shenwei41/sw_master
2020-07-23 09:57:22 +08:00
mindspore-ci-bot a4f447af6c !3289 Move abstract function to core abstract folder.
Merge pull request !3289 from ZhangQinghua/master
2020-07-23 09:39:37 +08:00
yujianfeng 4d18e9ec35 Fix internal multiple outputs check 2020-07-23 08:56:42 +08:00
tony_liu2 1f4251a440 add try to minddataset python tests to remove files on fail
delete unrelated file

change finally to except else

fix spacing alignment

fix indentation

fix indentation

fix indentation

add fix to new test case

add if main for pytest

fix spacing
2020-07-22 16:34:10 -04:00