Commit Graph

2212 Commits

Author SHA1 Message Date
mindspore-ci-bot 800b9dc596 !3270 New optimization pass to remove redundant Select ops
Merge pull request !3270 from thlinh/dev_Jul17_removeSelect
2020-07-29 10:19:14 +08:00
mindspore-ci-bot 2f956d7cc2 !3612 modify case
Merge pull request !3612 from changzherui/mod_case
2020-07-29 10:12:17 +08:00
jiangzhiwen 2cc6b5cb52 fix number of columns not match 2020-07-29 09:19:33 +08:00
anthonyaje a7eaf2736a First drop of MapOp refactor to support device augment.
Refactored MapOp to in preparation to support device augment

Minor fix
2020-07-28 15:53:43 -04:00
hangq 174d308cfa add mindspore lite 2020-07-29 03:06:17 +08:00
changzherui 758853ff52 modify case 2020-07-29 00:15:48 +08:00
YangLuo ae99a3a3e4 C++ API support for TakeDatasetOp and VOCDatasetOp 2020-07-28 23:09:57 +08:00
mindspore-ci-bot 46ae7879d4 !3394 Three distribution class instances: Exponential, Geometric Uniform distribution
Merge pull request !3394 from XunDeng/pp_poc_v3
2020-07-28 22:21:29 +08:00
mindspore-ci-bot 3cac1bb9f8 !3352 Add ROIAlignGrad GPU operator
Merge pull request !3352 from JonathanY/ROIAlignGrad
2020-07-28 22:13:38 +08:00
mindspore-ci-bot efb12d5e1e !3560 Add random uniform real op at GPU end
Merge pull request !3560 from peixu_ren/custom_gpu
2020-07-28 21:23:05 +08:00
mindspore-ci-bot b6c7273bb6 !3551 [MD] Fix Broken C++ Only Build
Merge pull request !3551 from nhussain/fix_cpp_only_build
2020-07-28 20:12:13 +08:00
mindspore-ci-bot 7cb567ebbe !3543 Split unsupport transdata
Merge pull request !3543 from lianliguang/unify-primitive
2020-07-28 17:23:44 +08:00
He Wei 4eb81d7934 Rename AnfNode::user_data related functions to follow naming rule 2020-07-28 15:35:48 +08:00
mindspore-ci-bot 6a55d7ca8f !3571 fix the description of cache
Merge pull request !3571 from guansongsong/gss/fix_cache_core
2020-07-28 14:33:07 +08:00
mindspore-ci-bot bca16792be !3453 Support resolving an attribute of a Cell class instance
Merge pull request !3453 from zichun_ye/resolve_attr_pr
2020-07-28 14:32:31 +08:00
WilliamLian 0179724dcd spilit unspported transdata to two transdata from special format -> defualt -> default -> special 2020-07-28 14:23:31 +08:00
guansongsong 1906ed1be8 fix cache description again 2020-07-28 13:26:29 +08:00
Hoai Linh Tran 2861e5462d Add optimization pass to remove redundant Select, fix uninitiated parameter in test_bert_train.py script
Create a new pass named ValueBasedEliminate to reduce the load of Arithmetic Simplify

Code review
2020-07-28 01:04:29 -04:00
guansongsong b6529b9096 fix cache description 2020-07-28 13:03:06 +08:00
Zichun Ye 5b9899eb4f add support to resolve attr for a class
update logic for cache

clean up code

add test cases for new api

update include of code

specify the resolve attr to ClassMember

avoid resolve attr of self
2020-07-27 23:37:35 -04:00
guansongsong 620d951e5e Merge branch 'ql/fix_cache_core' of https://gitee.com/qianlong21st/mindspore into ql/fix_cache_core 2020-07-28 11:37:06 +08:00
peixu_ren e7a99397a5 Add random uniform real op at GPU end 2020-07-27 23:18:11 -04:00
mindspore-ci-bot 16079e6356 !3472 [Auto parallel] Cost model for GPU
Merge pull request !3472 from Xiaoda/13-add-gpu-costmodel
2020-07-28 09:27:26 +08:00
mindspore-ci-bot 72e45841a2 !3528 Fix the difference of Error type between graph&pynative mode
Merge pull request !3528 from Simson/push-to-opensource
2020-07-28 09:26:49 +08:00
mindspore-ci-bot d4165671d9 !3435 Add parallel operator for Tile
Merge pull request !3435 from yangzhenzhang/add-tile-op
2020-07-28 09:16:30 +08:00
peixu_ren 292f2de0cf Add sampling functions in exponential, geometric and uniform distributions 2020-07-27 17:07:14 -04:00
Xun Deng 7bb83067d0 added exponential uniform geometric distribution
added cdf, logcdf, survival, logsurvival, entropy, mode, cross_entropy wrapper
2020-07-27 17:03:37 -04:00
nhussain b65125b0a1 add more ifdef and include statments for pybind 2020-07-27 13:51:11 -04:00
mindspore-ci-bot ee67f70b73 !3449 Cifar100 for C API
Merge pull request !3449 from MahdiRahmaniHanzaki/cifar100-c-api
2020-07-28 00:09:41 +08:00
Mahdi 92568248c9 Added Cifar100 for C API 2020-07-27 10:35:24 -04:00
ms_yan cf3fff8996 init add vgg16 gpu version
merge the script

optimize the script
2020-07-27 22:26:17 +08:00
mindspore-ci-bot 6e7c673c90 !3519 remove diary file
Merge pull request !3519 from anzhengqi/remove-log
2020-07-27 20:53:41 +08:00
mindspore-ci-bot e9316b1389 !3500 fix sparse feature bug for auto parallel
Merge pull request !3500 from lirongzhen1/master
2020-07-27 19:27:39 +08:00
simson b2cdd5d848 Fix the difference of Error type between graph&pynative mode 2020-07-27 17:28:13 +08:00
mindspore-ci-bot 5f7d2ba396 !3525 Fix a bug for Parameter
Merge pull request !3525 from hewei/fix_parameter_bug
2020-07-27 17:17:16 +08:00
mindspore-ci-bot e730224a2c !3511 Add IOU, CheckValid, GatherNd, ScatterNd ops.
Merge pull request !3511 from linqingke/new_ops
2020-07-27 15:50:30 +08:00
He Wei a6db29b11b Fix a bug for Parameter
1. Parameter's init_data() should have no effect if default_input already set;
2. This bug is introduced by 'decouple ParamValue from python';
3. An unit test case is added to ensure the right init_data() behavior.
2020-07-27 15:32:08 +08:00
Xiaoda Zhang 9097b36950 add resnet50 testcases for gpu 2020-07-27 15:22:30 +08:00
mindspore-ci-bot 9c461f5565 !3513 Add parameter server mode_zoo case and CI test cases.
Merge pull request !3513 from ZPaC/master-add-ps-test-cases
2020-07-27 14:31:46 +08:00
mindspore-ci-bot 568da0d510 !3425 fix avgpoolgrad
Merge pull request !3425 from fangzehua/avgpool
2020-07-27 14:15:29 +08:00
ZPaC 07a52688c1 Add parameter server model_zoo case and CI test cases. 2020-07-27 11:45:02 +08:00
mindspore-ci-bot ca42c21206 !3497 restore transformer st
Merge pull request !3497 from yuchaojie/transformer_st
2020-07-27 11:41:56 +08:00
mindspore-ci-bot 8e3d788942 !3349 move the dependency of utils to core
Merge pull request !3349 from liubuyu/master
2020-07-27 11:20:21 +08:00
anzhengqi 081d876438 remove-log 2020-07-27 11:14:38 +08:00
linqingke 7829bab811 add iou ops. 2020-07-27 11:12:26 +08:00
fangzehua 86dd0c583a fix avgpool grad 2020-07-27 11:06:32 +08:00
mindspore-ci-bot c22792aab1 !3495 Gpu StridedSlice performance optimize
Merge pull request !3495 from chenweifeng/strided_slice
2020-07-27 11:04:50 +08:00
lirongzhen1 51796aa624 fix sparse feature bug for auto parallel 2020-07-27 10:44:49 +08:00
mindspore-ci-bot 295038d346 !3324 add reduce_any op for vm
Merge pull request !3324 from fangzehua/reduce_any
2020-07-27 10:38:57 +08:00
liubuyu f4bc0bc9fe move the dependency of utils to core 2020-07-27 10:28:46 +08:00
chenfei 1f1a07e645 don't insert assign from condition to true branch of while 2020-07-26 14:38:42 +08:00
mindspore-ci-bot 84c8b85ddc !3452 [MD] Gets rid of uncessary print calls
Merge pull request !3452 from nhussain/refactor_name_function
2020-07-25 20:59:27 +08:00
mindspore-ci-bot 9c06a564d1 !2983 Dataset Tensor class cleanup
Merge pull request !2983 from h.farahat/tensor_class
2020-07-25 20:59:13 +08:00
wilfChen d3167da8af gpu support stridedslice 2020-07-25 19:55:19 +08:00
mindspore-ci-bot 7478c26b75 !3447 Add Crop and SwapRedBlue to C++ API
Merge pull request !3447 from EricZ/crop_rbswap
2020-07-25 18:47:05 +08:00
qianlong bf87b1d1fb fix cache op core dump 2020-07-25 18:37:02 +08:00
yuchaojie a2b1c38cf2 restore transformer st 2020-07-25 17:07:31 +08:00
chenhaozhe ef7ea3b92d fix bert performance test case 2020-07-25 15:52:04 +08:00
yangzhenzhang 6a6e2bd271 add tile op 2020-07-25 11:42:06 +08:00
mindspore-ci-bot e09c61d6a6 !3381 fix mix precision operator issue
Merge pull request !3381 from wangqiuliang/fix-mix-precsion-operator-issue
2020-07-25 10:50:21 +08:00
mindspore-ci-bot d21871a4fe !3375 add bert ci script
Merge pull request !3375 from yoonlee666/bertci
2020-07-25 09:43:04 +08:00
kingfo 73ea9b7855 fix mix precesion operator issue 2020-07-25 09:40:50 +08:00
mindspore-ci-bot 0a2980ca74 !3440 [MD]Fix Segementation Falut when SentencepieceTokenizer Op before zipOp and ConcatOp
Merge pull request !3440 from xulei/sentence_piece0715
2020-07-25 09:19:34 +08:00
Eric 465a69a70a Added crop signature, wip
Added input check

Added SwapRedBlue
2020-07-24 20:40:45 -04:00
hesham adfbc891d3 - Add checks and testing for empty tensors
- cleanup work on createTensor and Tensor's constructors
2020-07-24 17:23:18 -04:00
nhussain a306264030 remove print calls 2020-07-24 17:10:49 -04:00
mindspore-ci-bot 06ed9ffd6a !3183 Remove files on test fail for test_minddataset*.py
Merge pull request !3183 from tony_liu2/master
2020-07-24 23:47:29 +08:00
mindspore-ci-bot 60feafd75e !3399 Fixing Bug with AutoContrast/Equalize supporting uint8 dtype/mnist
Merge pull request !3399 from islam_amin/autocontrast_bug
2020-07-24 23:46:55 +08:00
mindspore-ci-bot dc64a3878a !3396 fix get dataset size error
Merge pull request !3396 from panfengfeng/fix_getdataset_size_error
2020-07-24 23:09:45 +08:00
tom__chen 5c3be0114f add maxpool_with_argmax/grad cuda kernel 2020-07-24 06:17:14 -08:00
mindspore-ci-bot e07f74367d !3299 Rename for C API
Merge pull request !3299 from MahdiRahmaniHanzaki/rename-c-api
2020-07-24 22:14:53 +08:00
yoonlee666 4c167e3085 add bert ci script 2020-07-24 22:04:40 +08:00
panfengfeng 939e612906 fix get daataset size error 2020-07-24 21:45:42 +08:00
xulei2020 0af6d75761 add code 2020-07-24 19:51:27 +08:00
mindspore-ci-bot b1fae868ba !3404 add sparse api docs
Merge pull request !3404 from riemann_penn/add_sparse_api_docs
2020-07-24 17:54:23 +08:00
mindspore-ci-bot c44939afc8 !3412 Fix a DatasetCache sharing scenario
Merge pull request !3412 from qianlong21st/fix_cache
2020-07-24 17:30:03 +08:00
mindspore-ci-bot 2f1a5b979d !3345 Fix minor bugs in denoting and test cases
Merge pull request !3345 from peixu_ren/custom_gpu
2020-07-24 16:36:32 +08:00
panyifeng 963bd67a60 add sparse api docs 2020-07-24 15:40:46 +08:00
qianlong d28c63b6c0 fix diff workers disallow cache 2020-07-24 15:30:00 +08:00
buxue e9ca893431 remove ut test_expand_dims_grad 2020-07-24 15:15:41 +08:00
Jonathan Yan ad40e00228 roi align grad v1 2020-07-24 00:36:32 -04:00
peixu_ren 19d80b87a9 Fix minor errors in probabilistic programming 2020-07-23 15:38:08 -04:00
islam_amin 48ec178e77 Fixing AutoContrast/Equalize Bug 2020-07-23 14:32:37 -04:00
Mahdi 2b71cbf1bd Added RenameOp 2020-07-23 12:22:55 -04:00
mindspore-ci-bot de0dcbc0bd !3290 Split parameter and value node with tuple to multiple nodes with make-tuple
Merge pull request !3290 from chenfei_mindspore/split-tuple-parameter-to-parameters
2020-07-23 21:39:27 +08:00
mindspore-ci-bot 2d973c9597 !3161 Set output value for dynamic graph.
Merge pull request !3161 from flywind/output
2020-07-23 21:14:08 +08:00
mindspore-ci-bot 1e88d64b20 !3259 add gpu cumsum op and reducemin
Merge pull request !3259 from baihuawei/automl
2020-07-23 20:38:33 +08:00
mindspore-ci-bot 366dd44ca8 !3371 support call super when class define in test_case
Merge pull request !3371 from zhangbuxue/support_call_super_when_class_define_in_test_case
2020-07-23 20:11:25 +08:00
panyifeng 8a89f003eb fix sparse related issues 2020-07-23 19:05:53 +08:00
buxue b812c1a17a support call super when class define in test_case. 2020-07-23 18:30:30 +08:00
kpy 570da089a8 set output value for dynamic graph 2020-07-23 17:05:47 +08:00
mindspore-ci-bot 684ff4f46b !3160 Rewrite tensor's __bool__ for pynative mode
Merge pull request !3160 from Simson/push-to-opensource
2020-07-23 16:55:49 +08:00
simson 5f77fbdd75 Rewrite tensor's __bool__ for pynative mode 2020-07-23 16:51:46 +08:00
root 1b6f85dec8 split tuple parameter to parameters
add function trans tuple to maketuple
2020-07-23 16:46:55 +08:00
mindspore-ci-bot 0a84b63fc3 !3305 modify the vgg16/lstm path to offical/{cv/npl}
Merge pull request !3305 from caojian05/ms_master_dev
2020-07-23 16:01:42 +08:00
baihuawei 4a8724e0ac add gpu cumsum 2020-07-23 15:43:04 +08:00
fangzehua 228a959cc7 add reduce any op for vm 2020-07-23 14:43:53 +08:00
mindspore-ci-bot 48711414fc !3356 [common]Refine code & Add ToAbstruct for `FuncGraph`, `MetaFuncGraph` `Primitive`
Merge pull request !3356 from vlne-v1/add_to_abstract_for_function
2020-07-23 14:33:58 +08:00
mindspore-ci-bot 9fb6576d8c !3338 Op debug feature
Merge pull request !3338 from zhoufeng/debug-op-overflow
2020-07-23 14:11:38 +08:00
Wei Luning 484d7f10c8 refine code* refine code in bert model* add ToAbstruct for `FuncGraph`, `MetaFuncGraph` `Primitive`* remove partial hard code in spec for poly* remove any in data convert cache 2020-07-23 12:43:37 +08:00
mindspore-ci-bot 24dd2fc2a6 !3333 Fix internal multiple outputs check
Merge pull request !3333 from YuJianfeng/master
2020-07-23 11:38:11 +08:00
mindspore-ci-bot 7f1ccc5f3b !3311 add sparse feature test cases for auto parallel
Merge pull request !3311 from lirongzhen1/master
2020-07-23 11:35:49 +08:00
zhoufeng 000a6c73a5 op debug
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2020-07-23 11:12:02 +08:00
mindspore-ci-bot 183cf5cf5d !3285 Add Encode,Decode,SGD,floordiv,ScatterNd,GatherNd ops.
Merge pull request !3285 from linqingke/gpu_ops
2020-07-23 10:53:54 +08:00
mindspore-ci-bot 21a5f06e93 !3328 Add testcases
Merge pull request !3328 from shenwei41/sw_master
2020-07-23 09:57:22 +08:00
mindspore-ci-bot a4f447af6c !3289 Move abstract function to core abstract folder.
Merge pull request !3289 from ZhangQinghua/master
2020-07-23 09:39:37 +08:00
yujianfeng 4d18e9ec35 Fix internal multiple outputs check 2020-07-23 08:56:42 +08:00
tony_liu2 1f4251a440 add try to minddataset python tests to remove files on fail
delete unrelated file

change finally to except else

fix spacing alignment

fix indentation

fix indentation

fix indentation

add fix to new test case

add if main for pytest

fix spacing
2020-07-22 16:34:10 -04:00
mindspore-ci-bot 859fe6bc41 !3342 C++ API Support for Skip Dataset Op plus UTs
Merge pull request !3342 from cathwong/ckw_c_api_skip
2020-07-23 04:28:38 +08:00
mindspore-ci-bot df1300d9cb !3294 Refactor opt/pre passes
Merge pull request !3294 from nsyca/removal_pass
2020-07-23 02:51:31 +08:00
Cathy Wong 8921a6099c C++ API Support for Skip Dataset Op and UTs 2020-07-22 13:21:35 -04:00
mindspore-ci-bot c24122bb55 !3303 fix validator that checks the vocab_size is positive in vocab.from_file
Merge pull request !3303 from ZiruiWu/fix_vocab_validator
2020-07-23 00:49:29 +08:00
Nat Sutyanyong 9fb1904ed8 Refactoring opt/pre 2020-07-22 11:13:42 -04:00
buxue f84b055244 add check for implicit conversion when scalar is not number and bool. 2020-07-22 20:55:19 +08:00
shenwei41 4eaa396ca7 Add testcases 2020-07-22 20:21:19 +08:00
linqingke f679568d86 gpu ops code and test case. 2020-07-22 20:15:52 +08:00
CaoJian f9fdb52373 modify the vgg16/lstm path to offical/{cv/npl} 2020-07-22 19:25:27 +08:00
kingfo 09b437285b support mix precision in pynative 2020-07-22 17:12:36 +08:00
mindspore-ci-bot 8f4bab4e75 !2410 Support insert memcpy between two hccl op if the part outputs of prior hccl op linking to next hccl op
Merge pull request !2410 from huanghui/insert-memcpy-async-pass
2020-07-22 16:40:10 +08:00
mindspore-ci-bot bc20de741a !3315 restore reshape ut
Merge pull request !3315 from yao_yf/restore_auto_parallel_reshape_ut
2020-07-22 16:23:29 +08:00
mindspore-ci-bot c84d4bbd36 !3180 Update for python AutoContrast API, cpp UnifromAugment API and UT
Merge pull request !3180 from alashkari/update-aug-ops-2
2020-07-22 16:09:12 +08:00
mindspore-ci-bot 174acbec13 !3265 Decouple ir from optimizer
Merge pull request !3265 from hewei/decouple_ir_optimizer
2020-07-22 16:08:39 +08:00
mindspore-ci-bot 2eefb94fee !3312 Relax the threshold of pynative resnet50 performance st
Merge pull request !3312 from JoyLvliang/Relax-the-threshold-of-pynative-resnet50-performance-st
2020-07-22 14:51:51 +08:00
mindspore-ci-bot ac993460bf !3288 delete useless code for all reduce
Merge pull request !3288 from yangzhenzhang/delete-useless-code
2020-07-22 14:49:51 +08:00
yao_yf 1d3a06a3b0 recover reshape ut 2020-07-22 14:30:12 +08:00
lirongzhen1 5d63c60135 add sparse feature test cases for auto parallel 2020-07-22 14:27:12 +08:00
Amir Lashkari 6f186aafa0 Update Python UA op, AutoContrast Op and UT
Updated Validators.py

Fixed UA UT

Fixed UA UT

Fixed PyLint Errors

Added aditional changes

remove old golden AutoContrast UT file

updated Autocontrast python UT

Added golden files

Fixed issue

fixed UT
2020-07-22 14:16:16 +08:00
mindspore-ci-bot d15b4c5d61 !3201 RoI Align GPU kernel
Merge pull request !3201 from JonathanY/main
2020-07-22 13:38:34 +08:00
mindspore-ci-bot 38a52a5b67 !3176 Add gpu support for ResizeNearestNeighbor
Merge pull request !3176 from 34bunny/GPU-ResizeNearestNeighbor
2020-07-22 13:38:11 +08:00
mindspore-ci-bot 21783ce221 !3300 Optimize server code
Merge pull request !3300 from ZPaC/new-feature-of-ps
2020-07-22 12:35:28 +08:00
lvliang 6f1d2768f8 Relax-the-threshold-of-pynative-resnet50-performance-st 2020-07-22 12:01:43 +08:00
Zirui Wu 40ea84ae81 fix from_file validator minor error, 1 line change
add test case
2020-07-21 23:17:26 -04:00
cristoval c6262111ef add sparse lazy adam in ps 2020-07-22 10:44:27 +08:00
huanghui f1563d2d37 insert memcpy async if hccl op cascade 2020-07-22 10:43:38 +08:00
yangzhenzhang e6cef98e95 delete useless code for allreduce 2020-07-22 10:13:19 +08:00
mindspore-ci-bot b13c7a3d48 !3268 refine GPU memory swap performance
Merge pull request !3268 from zyli2020/refine_gpu_mem_swap
2020-07-22 10:08:51 +08:00
mindspore-ci-bot 5f10417b9f !3276 make gpu equal op support int32
Merge pull request !3276 from qujianwei/master
2020-07-22 09:19:11 +08:00
Jonathan Yan 661b993475 roi align v1 2020-07-21 20:15:49 -04:00
mindspore-ci-bot 568e75fdd3 !3256 Zip C API
Merge pull request !3256 from MahdiRahmaniHanzaki/zip-c-api
2020-07-22 04:01:51 +08:00
Mahdi 91b4d90716 Added ZipOp 2020-07-21 10:24:38 -04:00
TFbunny de28cdc71c add GPU support to ResizeNearestNeighbor 2020-07-21 10:20:07 -04:00
mindspore-ci-bot 8da91ca3cf !3237 support call the parent class function
Merge pull request !3237 from zhangbuxue/support_call_the_parent_class_construct_function
2020-07-21 22:13:04 +08:00
mindspore-ci-bot c451146b14 !3255 Added cpp Equalize op to vision api
Merge pull request !3255 from alashkari/cpp_ops
2020-07-21 21:56:41 +08:00
mindspore-ci-bot 925172664b !3230 add bprop for sparse_tensor
Merge pull request !3230 from riemann_penn/add_bprop_for_sparse_tensor
2020-07-21 21:47:53 +08:00
lizhenyu c67e562373 refine GPU memory swap performance 2020-07-21 21:37:54 +08:00
Zhang Qinghua 7b69565d91 Move abstract function to core abstract folder. 2020-07-21 21:25:32 +08:00
mindspore-ci-bot cf4353f728 !3220 Add random normal op at MindSpore front-end
Merge pull request !3220 from peixu_ren/custom_gpu
2020-07-21 20:33:52 +08:00
mindspore-ci-bot 37cc6e2628 !3175 add ScatterNdAdd ScatterNdSub ScatterNonAliasingAdd ops
Merge pull request !3175 from fangzehua/scatter_add_vm
2020-07-21 20:26:07 +08:00
panyifeng 4d4e23fd9e Add bprop for sparse_tensor 2020-07-21 19:40:35 +08:00
chentingting 8e8a197364 change gnn dir 2020-07-21 18:28:19 +08:00