Commit Graph

2255 Commits

Author SHA1 Message Date
mindspore-ci-bot e1f93ec28c !3619 NMSWithMask - CUDA Impl
Merge pull request !3619 from danishnxt/GPU_One
2020-07-31 23:18:43 +08:00
Eric 8c018da468 Fixing issues in distributed sampler
Added Distributed sampler option

Fix style
2020-07-31 11:12:26 -04:00
mindspore-ci-bot 634d797ca3 !3549 MapOp refactor for device augmentation (part 1)
Merge pull request !3549 from anthonyaje/device_augment_mapop_refactor1
2020-07-31 21:56:16 +08:00
mindspore-ci-bot 27e51c5a63 !3553 Unify np array comparisons
Merge pull request !3553 from tony_liu2/staging
2020-07-31 21:39:31 +08:00
mindspore-ci-bot 82b103a740 !3780 add gpu BinaryCrossEntropy
Merge pull request !3780 from baihuawei/losscuda
2020-07-31 18:34:01 +08:00
mindspore-ci-bot 953f91cef8 !3739 not eliminate memcpy when nexe node is graph output
Merge pull request !3739 from laiyongqiang/eliminate_memcpy_bug
2020-07-31 17:35:11 +08:00
LiuCunwei c133059c59 enhance: imagenet to mindrecord mapfile 2020-07-31 15:59:45 +08:00
mindspore-ci-bot 4e2b1eec5d !3119 Delete parameter block_reader for MindDataset
Merge pull request !3119 from dengyutao/remove_blockreader
2020-07-31 15:46:15 +08:00
baihuawei 9eca56635d add KLDiv loss 2020-07-31 15:03:18 +08:00
dengyutao 388e43f7cb delete parameter block_reader for MindDataset 2020-07-31 11:30:05 +08:00
Xiaoda Zhang d24a902afe add a new graph operation in autoparallel 2020-07-31 10:57:19 +08:00
baihuawei aa9ea1707c add binary cross entropy 2020-07-31 10:45:08 +08:00
panbingao e6335739d2 stridedslice/stridedslicegrad 4D to 7D 2020-07-31 10:41:29 +08:00
liubuyu a499d4e47c decoupling core and debug 2020-07-31 10:39:31 +08:00
mindspore-ci-bot f1e717554c !3537 add sparse operators
Merge pull request !3537 from riemann_penn/add_sparse_operator
2020-07-31 10:25:55 +08:00
mindspore-ci-bot 31e889881b !3737 Enlarge the threshold of resnet50 performance st in pynative
Merge pull request !3737 from JoyLvliang/enlarge-the-threshold-of-resnet50-performance-st-in-pynative
2020-07-31 09:00:22 +08:00
TFbunny 075acf80b1 fix ResizeNearestNeighbor & add util.cuh to support atomicadd for half 2020-07-30 12:31:03 -04:00
mindspore-ci-bot 8943d5de34 !3727 Fix fuzz issue and split problem
Merge pull request !3727 from xiefangqi/fuzz_issue_pad_01
2020-07-30 21:24:47 +08:00
wilfChen 4d600e70f1 gpu layernorm 2020-07-30 20:11:04 +08:00
laiyongqiang 2458431750 not eliminate memcpy when nexe node is graph output 2020-07-30 19:51:57 +08:00
panyifeng 598bfa0205 add sparse operators 2020-07-30 17:18:23 +08:00
lvliang afe42e8d19 enlarge-the-threshold-of-resnet50-performance-st-in-pynative 2020-07-30 17:10:51 +08:00
mindspore-ci-bot 61867c7386 !3645 add mindspore hub for download ckpt file
Merge pull request !3645 from chenzhongming/master
2020-07-30 16:25:10 +08:00
mindspore-ci-bot ce08065c23 !3671 vgg: optimize the script and Readme
Merge pull request !3671 from ms_yan/vgg_optimize
2020-07-30 16:00:50 +08:00
xiefangqi 6017b050ac add generatordataset support split 2020-07-30 15:51:28 +08:00
chenzomi 8918c90b66 add mindspore hub for download ckpt file
add mindspore.hub and change model_zoo
2020-07-30 15:02:55 +08:00
mindspore-ci-bot ab4c43007f !3657 Add parallel operator for StridedSlice
Merge pull request !3657 from yangzhenzhang/add-stridedslice-op
2020-07-30 15:02:35 +08:00
mindspore-ci-bot f1a39a0f72 !3655 gpu support BroadcastTo kernel
Merge pull request !3655 from chenweifeng/broadcast_to
2020-07-30 14:23:18 +08:00
mindspore-ci-bot 773f8e5352 !3707 Gpu support LayerNorm kernel
Merge pull request !3707 from chenweifeng/LayerNorm
2020-07-30 14:22:25 +08:00
mindspore-ci-bot 80dd2cfe00 !3405 fix optimizer parallel problems
Merge pull request !3405 from gziyan/fix_optimizer_parallel
2020-07-30 14:09:16 +08:00
wilfChen 1eee3d6937 gpu layernorm 2020-07-30 11:06:55 +08:00
zhangyihui 54f2cf4ef0 add some test case for profiler 2020-07-30 10:43:13 +08:00
ms_yan abbd7b50db optimize the vgg script 2020-07-30 07:48:35 +08:00
danish a2ffc9530e stuff added
box copying fix

common function for IOU

new sort func

final update + unit test

remove one comment

fix lintig -1

lint fix 2

lint fix 3

last lint fix

value fix in ST nms with mask

addressing comments

 pylint fix

 pylint fix 1

test file fix
2020-07-29 15:11:24 -04:00
Xun Deng e94d91ba95 remove import probability from nn/__init__.py 2020-07-29 15:08:58 -04:00
tony_liu2 269b477684 use np.testing.assert instead of asserting
fix line lengths

fix spacing

reverse a few changes
2020-07-29 14:53:01 -04:00
mindspore-ci-bot afce1c3a40 !3341 GPU maxpool with argmax op
Merge pull request !3341 from tom_chen/maxpool_with_argmax
2020-07-29 21:24:38 +08:00
Ziyan 98e2ee90de fix optimizer parallel problems 2020-07-29 20:55:31 +08:00
yangzhenzhang 9aa84b3d14 add strided slice op 2020-07-29 17:18:50 +08:00
wilfChen 9cad0fec1d gpu broadcast to 2020-07-29 16:24:01 +08:00
mindspore-ci-bot 4834a6b347 !3574 Rename AnfNode::user_data related functions to follow naming rule
Merge pull request !3574 from hewei/rename_user_data_func
2020-07-29 14:26:21 +08:00
mindspore-ci-bot d06da1d270 !3603 Check that the number columns of names and default matches
Merge pull request !3603 from jiangzhiwen/fix_column_names_exceeded
2020-07-29 11:40:06 +08:00
mindspore-ci-bot b75943f220 !3620 add mindspore lite
Merge pull request !3620 from 张学同/to_merge
2020-07-29 10:54:41 +08:00
mindspore-ci-bot 800b9dc596 !3270 New optimization pass to remove redundant Select ops
Merge pull request !3270 from thlinh/dev_Jul17_removeSelect
2020-07-29 10:19:14 +08:00
mindspore-ci-bot 2f956d7cc2 !3612 modify case
Merge pull request !3612 from changzherui/mod_case
2020-07-29 10:12:17 +08:00
jiangzhiwen 2cc6b5cb52 fix number of columns not match 2020-07-29 09:19:33 +08:00
anthonyaje a7eaf2736a First drop of MapOp refactor to support device augment.
Refactored MapOp to in preparation to support device augment

Minor fix
2020-07-28 15:53:43 -04:00
hangq 174d308cfa add mindspore lite 2020-07-29 03:06:17 +08:00
changzherui 758853ff52 modify case 2020-07-29 00:15:48 +08:00
YangLuo ae99a3a3e4 C++ API support for TakeDatasetOp and VOCDatasetOp 2020-07-28 23:09:57 +08:00
mindspore-ci-bot 46ae7879d4 !3394 Three distribution class instances: Exponential, Geometric Uniform distribution
Merge pull request !3394 from XunDeng/pp_poc_v3
2020-07-28 22:21:29 +08:00
mindspore-ci-bot 3cac1bb9f8 !3352 Add ROIAlignGrad GPU operator
Merge pull request !3352 from JonathanY/ROIAlignGrad
2020-07-28 22:13:38 +08:00
mindspore-ci-bot efb12d5e1e !3560 Add random uniform real op at GPU end
Merge pull request !3560 from peixu_ren/custom_gpu
2020-07-28 21:23:05 +08:00
mindspore-ci-bot b6c7273bb6 !3551 [MD] Fix Broken C++ Only Build
Merge pull request !3551 from nhussain/fix_cpp_only_build
2020-07-28 20:12:13 +08:00
mindspore-ci-bot 7cb567ebbe !3543 Split unsupport transdata
Merge pull request !3543 from lianliguang/unify-primitive
2020-07-28 17:23:44 +08:00
He Wei 4eb81d7934 Rename AnfNode::user_data related functions to follow naming rule 2020-07-28 15:35:48 +08:00
mindspore-ci-bot 6a55d7ca8f !3571 fix the description of cache
Merge pull request !3571 from guansongsong/gss/fix_cache_core
2020-07-28 14:33:07 +08:00
mindspore-ci-bot bca16792be !3453 Support resolving an attribute of a Cell class instance
Merge pull request !3453 from zichun_ye/resolve_attr_pr
2020-07-28 14:32:31 +08:00
WilliamLian 0179724dcd spilit unspported transdata to two transdata from special format -> defualt -> default -> special 2020-07-28 14:23:31 +08:00
guansongsong 1906ed1be8 fix cache description again 2020-07-28 13:26:29 +08:00
Hoai Linh Tran 2861e5462d Add optimization pass to remove redundant Select, fix uninitiated parameter in test_bert_train.py script
Create a new pass named ValueBasedEliminate to reduce the load of Arithmetic Simplify

Code review
2020-07-28 01:04:29 -04:00
guansongsong b6529b9096 fix cache description 2020-07-28 13:03:06 +08:00
Zichun Ye 5b9899eb4f add support to resolve attr for a class
update logic for cache

clean up code

add test cases for new api

update include of code

specify the resolve attr to ClassMember

avoid resolve attr of self
2020-07-27 23:37:35 -04:00
guansongsong 620d951e5e Merge branch 'ql/fix_cache_core' of https://gitee.com/qianlong21st/mindspore into ql/fix_cache_core 2020-07-28 11:37:06 +08:00
peixu_ren e7a99397a5 Add random uniform real op at GPU end 2020-07-27 23:18:11 -04:00
mindspore-ci-bot 16079e6356 !3472 [Auto parallel] Cost model for GPU
Merge pull request !3472 from Xiaoda/13-add-gpu-costmodel
2020-07-28 09:27:26 +08:00
mindspore-ci-bot 72e45841a2 !3528 Fix the difference of Error type between graph&pynative mode
Merge pull request !3528 from Simson/push-to-opensource
2020-07-28 09:26:49 +08:00
mindspore-ci-bot d4165671d9 !3435 Add parallel operator for Tile
Merge pull request !3435 from yangzhenzhang/add-tile-op
2020-07-28 09:16:30 +08:00
peixu_ren 292f2de0cf Add sampling functions in exponential, geometric and uniform distributions 2020-07-27 17:07:14 -04:00
Xun Deng 7bb83067d0 added exponential uniform geometric distribution
added cdf, logcdf, survival, logsurvival, entropy, mode, cross_entropy wrapper
2020-07-27 17:03:37 -04:00
nhussain b65125b0a1 add more ifdef and include statments for pybind 2020-07-27 13:51:11 -04:00
mindspore-ci-bot ee67f70b73 !3449 Cifar100 for C API
Merge pull request !3449 from MahdiRahmaniHanzaki/cifar100-c-api
2020-07-28 00:09:41 +08:00
Mahdi 92568248c9 Added Cifar100 for C API 2020-07-27 10:35:24 -04:00
ms_yan cf3fff8996 init add vgg16 gpu version
merge the script

optimize the script
2020-07-27 22:26:17 +08:00
mindspore-ci-bot 6e7c673c90 !3519 remove diary file
Merge pull request !3519 from anzhengqi/remove-log
2020-07-27 20:53:41 +08:00
mindspore-ci-bot e9316b1389 !3500 fix sparse feature bug for auto parallel
Merge pull request !3500 from lirongzhen1/master
2020-07-27 19:27:39 +08:00
simson b2cdd5d848 Fix the difference of Error type between graph&pynative mode 2020-07-27 17:28:13 +08:00
mindspore-ci-bot 5f7d2ba396 !3525 Fix a bug for Parameter
Merge pull request !3525 from hewei/fix_parameter_bug
2020-07-27 17:17:16 +08:00
mindspore-ci-bot e730224a2c !3511 Add IOU, CheckValid, GatherNd, ScatterNd ops.
Merge pull request !3511 from linqingke/new_ops
2020-07-27 15:50:30 +08:00
He Wei a6db29b11b Fix a bug for Parameter
1. Parameter's init_data() should have no effect if default_input already set;
2. This bug is introduced by 'decouple ParamValue from python';
3. An unit test case is added to ensure the right init_data() behavior.
2020-07-27 15:32:08 +08:00
Xiaoda Zhang 9097b36950 add resnet50 testcases for gpu 2020-07-27 15:22:30 +08:00
mindspore-ci-bot 9c461f5565 !3513 Add parameter server mode_zoo case and CI test cases.
Merge pull request !3513 from ZPaC/master-add-ps-test-cases
2020-07-27 14:31:46 +08:00
mindspore-ci-bot 568da0d510 !3425 fix avgpoolgrad
Merge pull request !3425 from fangzehua/avgpool
2020-07-27 14:15:29 +08:00
ZPaC 07a52688c1 Add parameter server model_zoo case and CI test cases. 2020-07-27 11:45:02 +08:00
mindspore-ci-bot ca42c21206 !3497 restore transformer st
Merge pull request !3497 from yuchaojie/transformer_st
2020-07-27 11:41:56 +08:00
mindspore-ci-bot 8e3d788942 !3349 move the dependency of utils to core
Merge pull request !3349 from liubuyu/master
2020-07-27 11:20:21 +08:00
anzhengqi 081d876438 remove-log 2020-07-27 11:14:38 +08:00
linqingke 7829bab811 add iou ops. 2020-07-27 11:12:26 +08:00
fangzehua 86dd0c583a fix avgpool grad 2020-07-27 11:06:32 +08:00
mindspore-ci-bot c22792aab1 !3495 Gpu StridedSlice performance optimize
Merge pull request !3495 from chenweifeng/strided_slice
2020-07-27 11:04:50 +08:00
lirongzhen1 51796aa624 fix sparse feature bug for auto parallel 2020-07-27 10:44:49 +08:00
mindspore-ci-bot 295038d346 !3324 add reduce_any op for vm
Merge pull request !3324 from fangzehua/reduce_any
2020-07-27 10:38:57 +08:00
liubuyu f4bc0bc9fe move the dependency of utils to core 2020-07-27 10:28:46 +08:00
chenfei 1f1a07e645 don't insert assign from condition to true branch of while 2020-07-26 14:38:42 +08:00
mindspore-ci-bot 84c8b85ddc !3452 [MD] Gets rid of uncessary print calls
Merge pull request !3452 from nhussain/refactor_name_function
2020-07-25 20:59:27 +08:00
mindspore-ci-bot 9c06a564d1 !2983 Dataset Tensor class cleanup
Merge pull request !2983 from h.farahat/tensor_class
2020-07-25 20:59:13 +08:00
wilfChen d3167da8af gpu support stridedslice 2020-07-25 19:55:19 +08:00
mindspore-ci-bot 7478c26b75 !3447 Add Crop and SwapRedBlue to C++ API
Merge pull request !3447 from EricZ/crop_rbswap
2020-07-25 18:47:05 +08:00
qianlong bf87b1d1fb fix cache op core dump 2020-07-25 18:37:02 +08:00
yuchaojie a2b1c38cf2 restore transformer st 2020-07-25 17:07:31 +08:00
chenhaozhe ef7ea3b92d fix bert performance test case 2020-07-25 15:52:04 +08:00
yangzhenzhang 6a6e2bd271 add tile op 2020-07-25 11:42:06 +08:00
mindspore-ci-bot e09c61d6a6 !3381 fix mix precision operator issue
Merge pull request !3381 from wangqiuliang/fix-mix-precsion-operator-issue
2020-07-25 10:50:21 +08:00
mindspore-ci-bot d21871a4fe !3375 add bert ci script
Merge pull request !3375 from yoonlee666/bertci
2020-07-25 09:43:04 +08:00
kingfo 73ea9b7855 fix mix precesion operator issue 2020-07-25 09:40:50 +08:00
mindspore-ci-bot 0a2980ca74 !3440 [MD]Fix Segementation Falut when SentencepieceTokenizer Op before zipOp and ConcatOp
Merge pull request !3440 from xulei/sentence_piece0715
2020-07-25 09:19:34 +08:00
Eric 465a69a70a Added crop signature, wip
Added input check

Added SwapRedBlue
2020-07-24 20:40:45 -04:00
hesham adfbc891d3 - Add checks and testing for empty tensors
- cleanup work on createTensor and Tensor's constructors
2020-07-24 17:23:18 -04:00
nhussain a306264030 remove print calls 2020-07-24 17:10:49 -04:00
mindspore-ci-bot 06ed9ffd6a !3183 Remove files on test fail for test_minddataset*.py
Merge pull request !3183 from tony_liu2/master
2020-07-24 23:47:29 +08:00
mindspore-ci-bot 60feafd75e !3399 Fixing Bug with AutoContrast/Equalize supporting uint8 dtype/mnist
Merge pull request !3399 from islam_amin/autocontrast_bug
2020-07-24 23:46:55 +08:00
mindspore-ci-bot dc64a3878a !3396 fix get dataset size error
Merge pull request !3396 from panfengfeng/fix_getdataset_size_error
2020-07-24 23:09:45 +08:00
tom__chen 5c3be0114f add maxpool_with_argmax/grad cuda kernel 2020-07-24 06:17:14 -08:00
mindspore-ci-bot e07f74367d !3299 Rename for C API
Merge pull request !3299 from MahdiRahmaniHanzaki/rename-c-api
2020-07-24 22:14:53 +08:00
yoonlee666 4c167e3085 add bert ci script 2020-07-24 22:04:40 +08:00
panfengfeng 939e612906 fix get daataset size error 2020-07-24 21:45:42 +08:00
xulei2020 0af6d75761 add code 2020-07-24 19:51:27 +08:00
mindspore-ci-bot b1fae868ba !3404 add sparse api docs
Merge pull request !3404 from riemann_penn/add_sparse_api_docs
2020-07-24 17:54:23 +08:00
mindspore-ci-bot c44939afc8 !3412 Fix a DatasetCache sharing scenario
Merge pull request !3412 from qianlong21st/fix_cache
2020-07-24 17:30:03 +08:00
mindspore-ci-bot 2f1a5b979d !3345 Fix minor bugs in denoting and test cases
Merge pull request !3345 from peixu_ren/custom_gpu
2020-07-24 16:36:32 +08:00
panyifeng 963bd67a60 add sparse api docs 2020-07-24 15:40:46 +08:00
qianlong d28c63b6c0 fix diff workers disallow cache 2020-07-24 15:30:00 +08:00
buxue e9ca893431 remove ut test_expand_dims_grad 2020-07-24 15:15:41 +08:00
Jonathan Yan ad40e00228 roi align grad v1 2020-07-24 00:36:32 -04:00
peixu_ren 19d80b87a9 Fix minor errors in probabilistic programming 2020-07-23 15:38:08 -04:00
islam_amin 48ec178e77 Fixing AutoContrast/Equalize Bug 2020-07-23 14:32:37 -04:00
Mahdi 2b71cbf1bd Added RenameOp 2020-07-23 12:22:55 -04:00
mindspore-ci-bot de0dcbc0bd !3290 Split parameter and value node with tuple to multiple nodes with make-tuple
Merge pull request !3290 from chenfei_mindspore/split-tuple-parameter-to-parameters
2020-07-23 21:39:27 +08:00
mindspore-ci-bot 2d973c9597 !3161 Set output value for dynamic graph.
Merge pull request !3161 from flywind/output
2020-07-23 21:14:08 +08:00
mindspore-ci-bot 1e88d64b20 !3259 add gpu cumsum op and reducemin
Merge pull request !3259 from baihuawei/automl
2020-07-23 20:38:33 +08:00
mindspore-ci-bot 366dd44ca8 !3371 support call super when class define in test_case
Merge pull request !3371 from zhangbuxue/support_call_super_when_class_define_in_test_case
2020-07-23 20:11:25 +08:00
panyifeng 8a89f003eb fix sparse related issues 2020-07-23 19:05:53 +08:00
buxue b812c1a17a support call super when class define in test_case. 2020-07-23 18:30:30 +08:00
kpy 570da089a8 set output value for dynamic graph 2020-07-23 17:05:47 +08:00
mindspore-ci-bot 684ff4f46b !3160 Rewrite tensor's __bool__ for pynative mode
Merge pull request !3160 from Simson/push-to-opensource
2020-07-23 16:55:49 +08:00
simson 5f77fbdd75 Rewrite tensor's __bool__ for pynative mode 2020-07-23 16:51:46 +08:00
root 1b6f85dec8 split tuple parameter to parameters
add function trans tuple to maketuple
2020-07-23 16:46:55 +08:00
mindspore-ci-bot 0a84b63fc3 !3305 modify the vgg16/lstm path to offical/{cv/npl}
Merge pull request !3305 from caojian05/ms_master_dev
2020-07-23 16:01:42 +08:00
baihuawei 4a8724e0ac add gpu cumsum 2020-07-23 15:43:04 +08:00
fangzehua 228a959cc7 add reduce any op for vm 2020-07-23 14:43:53 +08:00
mindspore-ci-bot 48711414fc !3356 [common]Refine code & Add ToAbstruct for `FuncGraph`, `MetaFuncGraph` `Primitive`
Merge pull request !3356 from vlne-v1/add_to_abstract_for_function
2020-07-23 14:33:58 +08:00
mindspore-ci-bot 9fb6576d8c !3338 Op debug feature
Merge pull request !3338 from zhoufeng/debug-op-overflow
2020-07-23 14:11:38 +08:00
Wei Luning 484d7f10c8 refine code* refine code in bert model* add ToAbstruct for `FuncGraph`, `MetaFuncGraph` `Primitive`* remove partial hard code in spec for poly* remove any in data convert cache 2020-07-23 12:43:37 +08:00
mindspore-ci-bot 24dd2fc2a6 !3333 Fix internal multiple outputs check
Merge pull request !3333 from YuJianfeng/master
2020-07-23 11:38:11 +08:00
mindspore-ci-bot 7f1ccc5f3b !3311 add sparse feature test cases for auto parallel
Merge pull request !3311 from lirongzhen1/master
2020-07-23 11:35:49 +08:00
zhoufeng 000a6c73a5 op debug
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2020-07-23 11:12:02 +08:00
mindspore-ci-bot 183cf5cf5d !3285 Add Encode,Decode,SGD,floordiv,ScatterNd,GatherNd ops.
Merge pull request !3285 from linqingke/gpu_ops
2020-07-23 10:53:54 +08:00
mindspore-ci-bot 21a5f06e93 !3328 Add testcases
Merge pull request !3328 from shenwei41/sw_master
2020-07-23 09:57:22 +08:00
mindspore-ci-bot a4f447af6c !3289 Move abstract function to core abstract folder.
Merge pull request !3289 from ZhangQinghua/master
2020-07-23 09:39:37 +08:00
yujianfeng 4d18e9ec35 Fix internal multiple outputs check 2020-07-23 08:56:42 +08:00