Commit Graph

1593 Commits

Author SHA1 Message Date
mindspore-ci-bot 92d2011b8b !2924 [Dataset Python UT] Disable md5 random perspective test
Merge pull request !2924 from TinaMengtingZhang/redo-skip-md5-random-perspective-test
2020-07-08 03:52:21 +08:00
mindspore-ci-bot 6d946b6a19 !2890 Fix for Alexey's testcase
Merge pull request !2890 from JesseKLee/queue_perf
2020-07-08 03:21:50 +08:00
Danish Farid 78c370f72a First Commit - New Infrastructure - Python UT tests + Common Aug Files
fix accidental change overwrite

fix 2

updated inits from 0 to 0.0 for float

improvd python ut comments

updated macro
2020-07-07 14:50:34 -04:00
tinazhang 8455f957ac disable md5 random perspective test case 2020-07-07 14:21:06 -04:00
wuyongkang 02dd305bb0 Optimization for ApplyTransform function 2020-07-07 21:15:59 +08:00
jinyaohui c7f6527e92 fix print file bug 2020-07-07 21:05:17 +08:00
mindspore-ci-bot faa1084bd8 !2865 asymmetric param row split support for GatherV2
Merge pull request !2865 from yihuaijie/dev
2020-07-07 20:04:32 +08:00
mindspore-ci-bot b82926138d !2905 two level reduce sparse gradient
Merge pull request !2905 from kisnwang/parallel-reduce-sparse-gradient
2020-07-07 17:41:52 +08:00
mindspore-ci-bot 5baae2ebd0 !2884 Add TBE op UnsortedSegmentProd for VM.
Merge pull request !2884 from liuxiao93/UnsortedSegmentProd
2020-07-07 17:12:43 +08:00
mindspore-ci-bot bd60db5c11 !2811 support vm for ParallelConcat
Merge pull request !2811 from jiangjinsheng/vm_parallel_concat
2020-07-07 16:23:46 +08:00
kswang a719a9fe3a add two level reduce sparse gradient 2020-07-07 15:40:45 +08:00
liuxiao93 2b0ecfd2b1 Add TBE op UnsortedSegmentProd for VM. 2020-07-07 15:35:00 +08:00
Yi Huaijie cae254f4df asymmetric row split support for GatherV2 2020-07-07 14:36:07 +08:00
islam_amin dfc3409f67 Update RandomHorizontalFlipWithBBox and BoundingBouxAugment C++ Ops to use floats 2020-07-06 23:49:21 -04:00
mindspore-ci-bot 751b5e6fac !2897 Modify VOCDataset output float dtype bbox
Merge pull request !2897 from xiefangqi/md_voc_support_float
2020-07-07 11:11:19 +08:00
xiefangqi 62d55fdbce vocdataset support float bbox 2020-07-07 10:07:42 +08:00
Jesse Lee e0ef91a676 Fix Queue::Reset 2020-07-06 11:36:14 -04:00
jiangjinsheng a3565a75d1 vm for ParallelConcat 2020-07-06 18:35:12 +08:00
changzherui 17da929b82 syn code 0706 2020-07-06 17:51:17 +08:00
mindspore-ci-bot 3d377c51b9 !2839 support vm for PopulationCount
Merge pull request !2839 from jiangjinsheng/vm_population_count
2020-07-06 17:32:08 +08:00
mindspore-ci-bot aef002ad6c !2809 support Python built-in function 'enumerate'
Merge pull request !2809 from zhangbuxue/support_Python_built-in_functions_enumerate
2020-07-06 09:38:47 +08:00
leilei_snow 5cccfbc61b Add TransShape Operator. 2020-07-05 03:34:35 +00:00
mindspore-ci-bot f42e36b629 !2845 Fix empty graph dump ir failed
Merge pull request !2845 from zhoufeng/empty-graph-dump-ir
2020-07-04 15:49:57 +08:00
zhoufeng 1f8b00dff2 Fix empty graph dump ir
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2020-07-04 14:26:52 +08:00
mindspore-ci-bot b5066e81ee !2308 Unskip md5 python UT case for RandomPerspective
Merge pull request !2308 from TinaMengtingZhang/unskip-case-random-perspective
2020-07-04 03:37:58 +08:00
mindspore-ci-bot 34fadfad31 !2774 fix perf_data test
Merge pull request !2774 from Alexey_Shevlyakov/fix_perf_data_test
2020-07-04 03:20:26 +08:00
tinazhang dc03019200 unskip md5 testcase for RandomPerspective 2020-07-03 13:10:13 -04:00
Danish Farid 5a9673ee6f fix_annotate bug fix 2020-07-03 11:17:13 -04:00
jiangjinsheng ee7aef98df vm for PopulationCount 2020-07-03 17:47:11 +08:00
mindspore-ci-bot 860a32632e !2671 vm for MaxPoolGradGrad, MaxPoolGradGradWithArgmax
Merge pull request !2671 from jiangjinsheng/vm_max_pool_ext2
2020-07-03 17:40:54 +08:00
buxue cfa41733d6 support Python built-in function 'enumerate' 2020-07-03 14:42:10 +08:00
zhousiyi b29d260be3 reuse AddN primitive in opt as AddN will replicated by program_specialize 2020-07-03 03:18:25 +00:00
fary86 e17469bf42 Fix bug of large for loop 2020-07-03 11:15:41 +08:00
mindspore-ci-bot 2cd9649b9e !2810 Add operator adapting in ME for Softsign
Merge pull request !2810 from zhangzheng/softsign
2020-07-03 09:31:59 +08:00
mindspore-ci-bot 391f5e44e4 !2832 check types for optional boolean parameters
Merge pull request !2832 from Peilin/invalid-type-bucket-check
2020-07-03 09:20:28 +08:00
mindspore-ci-bot 9b915b5c28 !2831 Rework/Fix arithmetic_simplify passes
Merge pull request !2831 from thlinh/dev_Jul02_rework_arithmetic_simplify
2020-07-03 09:14:44 +08:00
Hoai Linh Tran 6bd66e7953 Fix memcpy calls. Add ut tests for arithmetic_simplify. Split long arithmetic_simplify.h to arithmetic_simplify.cc
Code checking
2020-07-02 17:51:08 -04:00
peilin-wang 29aa589972 added check for invalid type for boolean args 2020-07-02 16:49:09 -04:00
ale 383564c417 fix perf_data test 2020-07-02 13:24:45 -04:00
mindspore-ci-bot 709dfd7e81 !2738 [Dataset C++ UT] Implement C++ UT common class for object detection tests.
Merge pull request !2738 from islam_amin/object_ops_ut_cc
2020-07-03 01:23:50 +08:00
mindspore-ci-bot c1a53d3f68 !2822 Fix bool tensor problem
Merge pull request !2822 from hewei/fix_bool_tensor
2020-07-02 20:41:27 +08:00
He Wei a0623e1528 Fix bool type tensor problem
Problem: Create 'uint8' type tensor from float data raise RuntimeError;
Fix:  Use same internal data type for 'uint8' and 'bool' tensor and allows
convert float data to bool tensor.
2020-07-02 19:22:35 +08:00
panbingao 1e51414f1b Adapting operator Softsign in ME 2020-07-02 03:31:25 -04:00
liuxiao ddedc41613 Add TBE operators SparseApplyFtrlV2\SparseApplyAdagradV2 for VM. 2020-07-02 12:00:58 +08:00
mindspore-ci-bot f1a9a7ceb1 !2718 fix quantization aware training auto create graph bug
Merge pull request !2718 from chenzhongming/master
2020-07-02 09:57:30 +08:00
mindspore-ci-bot 622b97f3b6 !2787 Add op ScatterMul ScatterDiv vm
Merge pull request !2787 from zhaozhenlong/op/scatter-div-mul-vm
2020-07-01 20:41:03 +08:00
jiangjinsheng ce4e15b0b3 vm for MaxPoolExt2,MaxPoolGradGrad,MaxPoolGradGradWithArgmax 2020-07-01 17:05:11 +08:00
yangzhenzhang 2351845ede delete shape validation in initializer 2020-07-01 16:01:31 +08:00
zhaozhenlong 8d9939eaa4 ScatterMull and ScatterDiv vm 2020-07-01 15:49:24 +08:00
mindspore-ci-bot 4eafb21ea8 !2638 support vm for mod
Merge pull request !2638 from jiangjinsheng/vm_mod
2020-07-01 14:26:07 +08:00
mindspore-ci-bot 30fc1bd0c3 !2747 refactor StridedSlice op
Merge pull request !2747 from zhangbuxue/refactor_the_StridedSlice_op
2020-07-01 12:04:11 +08:00
buxue be771aa9e4 refactor StridedSlice op 2020-07-01 11:08:36 +08:00
jiangjinsheng ffd0352162 vm for mod 2020-07-01 10:16:47 +08:00
mindspore-ci-bot d1fa90a3d9 !2769 fix get loss error and NoneType error cause by _proceesor_specified_data
Merge pull request !2769 from ougongchang/fix_nonetype
2020-07-01 10:01:05 +08:00
mindspore-ci-bot ea475637a1 !2720 fix assign used in while loop
Merge pull request !2720 from xychow/fix-assign-in-while
2020-07-01 09:16:13 +08:00
islam_amin 593ee1eb34 C++ UT common files for object detection tests 2020-06-30 17:54:35 -04:00
mindspore-ci-bot 9377e432d2 !2766 get default value if num_parallel_workers is None
Merge pull request !2766 from yanghaitao/yht_serialize_num_parallel_worker
2020-06-30 23:11:44 +08:00
ougongchang cd868aea52 fix get loss error and NoneType error cause by _proceesor_specified_data
fix get loss error when it not a scalar and fix process specified data
failed when the action is False, and collect_specified_data parameter is
not None
2020-06-30 21:11:06 +08:00
yanghaitao 365c901ee0 get default value if num_parallel_worker is None 2020-06-30 21:10:37 +08:00
mindspore-ci-bot 3a89f93cc5 !2699 add ScatterMax ScatterMin ScatterSub vm
Merge pull request !2699 from zhaozhenlong/op/scatter-max-vm
2020-06-30 20:10:17 +08:00
mindspore-ci-bot fe82d82155 !1904 Add IndexedSlices
Merge pull request !1904 from riemann_penn/add_indexed_slices
2020-06-30 19:03:12 +08:00
mindspore-ci-bot 2fadbb1d04 !2743 add more ut and st for SummaryCollector
Merge pull request !2743 from ougongchang/summary_collector_ut
2020-06-30 18:58:03 +08:00
panyifeng d6635bbbe2 Add IndexedSlices 2020-06-30 17:38:24 +08:00
chenzomi 1089c908a9 cherry-pick r0.5 to master for quantizaiton aware training 2020-06-30 17:23:08 +08:00
ougongchang 3dc6f6f2d9 add more ut and st for SummaryCollector
Has fixed collecting optimizer error when mode is eval
2020-06-30 17:02:03 +08:00
zhousiyi d5255fe311 fix assign used in while 2020-06-30 08:22:27 +00:00
guohongzilong 652093642e change order param same as group params 2020-06-30 14:56:55 +08:00
mindspore-ci-bot d08a89ab87 !2737 makes 0 an invaild bucket size
Merge pull request !2737 from Peilin/zero-input-bucket-check
2020-06-30 05:33:41 +08:00
mindspore-ci-bot 3197f9fb35 !2733 Schema clean up
Merge pull request !2733 from EricZ/schema_fix
2020-06-30 05:31:27 +08:00
mindspore-ci-bot 1227719cdd !2603 [Dataset Python UT] Cleanup mse and md5 validation
Merge pull request !2603 from TinaMengtingZhang/I1LTCA-mse-check-cleanup
2020-06-30 04:46:49 +08:00
peilin-wang 9468b49e28 bucket_batch_sizes must be strictly positive, 0 is not a valid batch size 2020-06-29 16:34:39 -04:00
Eric 88bb65768e Clean up part 1
Removed extra fields in schema

Fixed test cases

Fixing CI
2020-06-29 15:57:53 -04:00
mindspore-ci-bot a5c1e09469 !2736 Remove de_error.h
Merge pull request !2736 from Alexey_Shevlyakov/remove_de_error
2020-06-30 03:45:55 +08:00
Alexey Shevlyakov 71cede8173 remove de_error.h 2020-06-29 14:01:50 -04:00
mindspore-ci-bot c70e6987ba !2624 Fix config test
Merge pull request !2624 from EricZ/fix_config_test
2020-06-30 01:11:12 +08:00
mindspore-ci-bot 9b4399480a !2321 Connector throughput performance metric
Merge pull request !2321 from Alexey_Shevlyakov/connector_throughput_dev
2020-06-29 23:54:42 +08:00
tinazhang66 5cd3136355 remove local defined mse and add missing mse/md5 validation 2020-06-29 11:51:07 -04:00
mindspore-ci-bot 51c4f4a499 !2683 Add TBE operaters ApplyAddSign\ApplyPowerSign\ApplyGradientDescent\ApplyProximalGradientDescent for VM.
Merge pull request !2683 from liuxiao/ops-for-VM
2020-06-29 21:30:17 +08:00
mindspore-ci-bot e2b17999a8 !2708 update api comment and del dead code
Merge pull request !2708 from guozhijian/enhance_api_comment_del_dead_code
2020-06-29 20:07:37 +08:00
mindspore-ci-bot 5b8957a884 !2717 dataset: some parameter check for NumpySlices and num_sharads
Merge pull request !2717 from ms_yan/check_param
2020-06-29 20:02:36 +08:00
ms_yan 7fa0d9e7e4 add paramter check for numpyslices and num_shards 2020-06-29 19:12:52 +08:00
jinyaohui dd5fba1db9 add notice 2020-06-29 17:39:25 +08:00
zhaozhenlong a8654ac3b5 add ScatterMax ScatterMin ScatterSub for vm 2020-06-29 17:21:08 +08:00
jonyguo 41d16a3c77 enhance: 1. fix api comment, 2. del dead code 2020-06-29 17:15:44 +08:00
jin-xiulang 8dff818a18 Add Laplace random operator. 2020-06-29 15:51:59 +08:00
mindspore-ci-bot 6fb5538117 !2661 add support dtype for scatter_add vm
Merge pull request !2661 from zhaozhenlong/op/scatter-add
2020-06-29 11:46:49 +08:00
mindspore-ci-bot 1a78794947 !2680 Add ut for cpu kernel implement of sparse optimizer
Merge pull request !2680 from YuJianfeng/ut
2020-06-29 11:36:00 +08:00
liuxiao 2097a0e90a Add optimizer operators for VM. 2020-06-29 11:35:45 +08:00
mindspore-ci-bot ef8cdbd82e !2639 [ad] improve the performance of ad
Merge pull request !2639 from Kang/master
2020-06-29 10:04:51 +08:00
mindspore-ci-bot 99d4289251 !248 Add 5 random ops
Merge pull request !248 from peixu_ren/custom_aicpu
2020-06-29 09:15:22 +08:00
peixu_ren c5f72582dc Added 5 random ops 2020-06-28 12:34:02 -03:00
mindspore-ci-bot 9be17e2a59 !2668 support weight decay for sparse optimizer
Merge pull request !2668 from wangnan39/support_weight_decay_for_sparse_optimizer
2020-06-28 22:24:45 +08:00
mindspore-ci-bot 0ab7fd98ea !2654 fix: tfrecord to mindrecord para check
Merge pull request !2654 from guozhijian/fix_tfrecord_to_mr_para_check
2020-06-28 22:06:50 +08:00
yujianfeng 91306cbd34 Add ut for cpu kernel of sparse optimizer 2020-06-28 21:12:08 +08:00
mindspore-ci-bot 32a2d5d21c !2629 get monitor sampling interval from json file
Merge pull request !2629 from yanghaitao/yht_sampling_interval
2020-06-28 20:05:05 +08:00
mindspore-ci-bot 363489d00f !2580 BasicTokenizer do not case fold on preserved words
Merge pull request !2580 from qianlong21st/fix_basic_tokenizer
2020-06-28 19:36:28 +08:00
mindspore-ci-bot db6c4bf784 !2640 [MD] fix minddata error message
Merge pull request !2640 from liyong126/minddataset_fix_errmsg
2020-06-28 19:36:23 +08:00
wangnan39@huawei.com 172728a6a6 support weight decay for sparse optimizer 2020-06-28 17:49:03 +08:00
jonyguo 3450c35d9b fix: tfrecord to mindrecord parameter check 2020-06-28 17:48:52 +08:00
mindspore-ci-bot bc30576ac9 !2631 Add ExpandDims to whitelist
Merge pull request !2631 from amongo/FixExpandDimsOps
2020-06-28 17:40:20 +08:00
zhaozhenlong d55c0f6679 complement scatter add support dtype 2020-06-28 16:51:53 +08:00
qianlong cae77c0c22 BasicTokenizer not case fold on preserverd words 2020-06-28 16:28:00 +08:00
liyong 68e2097897 fix split erroer message 2020-06-28 15:47:10 +08:00
zhaozhenlong 15580f8f6e limit ssim input img type to fp32 and fp16 2020-06-28 15:36:30 +08:00
zhaozhenlong 71d33b087e limit ssim input img type to fp32 and fp16 2020-06-28 15:35:07 +08:00
yanghaitao fd701b8504 set monitor sampling interval through json file 2020-06-28 15:18:21 +08:00
wuyongkang e606068585 cache bprop instead of fprop 2020-06-28 14:57:54 +08:00
huangdongrun 96b38f72b2 add ExpandDims whitelist
add comment for control_depend
2020-06-28 11:29:16 +08:00
mindspore-ci-bot 262e4fc041 !2585 Replace TransformFuncType with OptimizerCaller
Merge pull request !2585 from Giancarlo/remove_transformfunc
2020-06-28 10:12:18 +08:00
Eric a4f5802924 Added Fix for test config 2020-06-27 15:20:48 -04:00
mindspore-ci-bot 87213648bc !2612 delete pynative lenet test
Merge pull request !2612 from changzherui/del_test
2020-06-27 18:38:36 +08:00
changzherui 9e83337e2f delete pynative lenet_model test 2020-06-27 15:33:27 +08:00
Ziyan 0925e35252 enable optimizer parallel with broadcast 2020-06-27 14:36:17 +08:00
mindspore-ci-bot df795daf75 !2562 [bug]when multi times print same thing, do not merge in cse
Merge pull request !2562 from vlne-v1/I1LHCF-print-multi-times-and-same-str
2020-06-27 07:26:52 +08:00
Alexey Shevlyakov 698abf75fc Connector throughput + PerfData + CyclicArray 2020-06-26 14:45:01 -04:00
mindspore-ci-bot a1b17bd2e2 !2593 python unit tests for randomResizeWithBBox and ResizeWithBBox
Merge pull request !2593 from ava/python_ut_tests
2020-06-27 02:31:31 +08:00
mindspore-ci-bot bfc2f142dd !2601 AutoIndexObj should use 0 as the first generated key
Merge pull request !2601 from JesseKLee/auto_index
2020-06-27 01:42:01 +08:00
avakh 1e869146e9 applying comments removing VOC 2020-06-26 12:39:48 -04:00
Cathy Wong 277aba5326 dataset: Fixup docs; remove pylint disabled messages in UT 2020-06-26 12:26:41 -04:00
Jesse Lee 81bf4bde1d AutoIndexObj primary should start with 0 2020-06-26 12:22:44 -04:00
mindspore-ci-bot e11c953225 !2587 Implementing Python UTs for BoundingBoxAugment and RandomHorizontalFlipWithBBox
Merge pull request !2587 from imaaamin/object_ops_ut
2020-06-26 00:43:31 +08:00
mindspore-ci-bot 067592ccf9 !2590 Updated Python UTs for RandomVerticalFlipWithBBox, RandomCropWithBBox and RandomResizedCropWithBBox
Merge pull request !2590 from danishnxt/AugOps2
2020-06-25 23:40:34 +08:00
islam_amin 0f58f0338e updating ut for RandomHorizontalFlipWithBBox and BBoxAugment 2020-06-25 11:35:22 -04:00
mindspore-ci-bot b0a10c26a4 !2532 adding random-resize-with-bbox-op and resize-with-bbox-op
Merge pull request !2532 from ava/NNNewMaster
2020-06-25 20:42:00 +08:00
Danish Farid 3d1ecaaeb5 updated UT test for Python (3) AugOps with BBox - MD5 checks + imrpv comments 2020-06-25 03:19:14 -04:00
avakh 587e260236 addressing comments 2020-06-24 18:54:47 -04:00
Jamie Nisbet c22eac743d subtree creation in python apis
updates

fix

fix cpplint

fix
2020-06-24 17:17:05 -04:00
Giancarlo Colmenares aabec55c79 Removing TransformFuncType 2020-06-24 13:48:57 -04:00
mindspore-ci-bot a12f9614d4 !2533 Fixing testVOC2012 dataset by merging with testVOC2012_2 + moving BBoxOp testing functions to util + new check in Bounding_Box_check
Merge pull request !2533 from danishnxt/AugOpsD2
2020-06-25 01:39:08 +08:00
Wei Luning ef13a4b6fb adjust cse code when op has side effect. 2020-06-25 00:46:01 +08:00
Danish Farid a8f392ca42 updated test util file + new BoundingBoxCheck + fixed VOCDataset annotations
Style Error fix

fixed PyLint problem

reverting testVOC2012 due to CI break for existing test

reverting testVOC2012 due to CI break for existing test-2

updated old error messages to confirm with global standard

addressing PR 2355 Comments - 1

addressing PR 2355 Comments - 2

addressing PR 2355 Comments - 3
2020-06-24 12:41:41 -04:00
mindspore-ci-bot d9b1825552 !2374 C++ UT for CutOut and Pad
Merge pull request !2374 from MahdiRahmaniHanzaki/I1L892-pad-cutout-ut
2020-06-24 22:56:17 +08:00
mindspore-ci-bot 67d664d7dd !2511 add mod and floordiv opration for tensor
Merge pull request !2511 from wangqiuliang/add-tensor-mod-operation
2020-06-24 18:09:59 +08:00
mindspore-ci-bot a613b8b67a !2548 Fix map mapping
Merge pull request !2548 from amongo/fixmapmapping
2020-06-24 18:04:07 +08:00
mindspore-ci-bot 044b214636 !2490 assign hcom op to one stream
Merge pull request !2490 from gukecai/new-stream-for-commit
2020-06-24 17:44:34 +08:00
kingfo 078738adc5 add tensor mod & floordiv operation 2020-06-24 16:47:23 +08:00
huangdongrun 9d3c9c69fe modify map to C.Map() 2020-06-24 15:07:33 +08:00
ms_yan e829535a86 change GetTensor into GetRow to avoid NullPtr 2020-06-24 15:07:32 +08:00
mindspore-ci-bot a9dac909d9 !2535 Fix pynative indexing
Merge pull request !2535 from amongo/FixPynativeTensorIndexing
2020-06-24 14:41:11 +08:00
mindspore-ci-bot a4fbdc3f69 !2245 Decouple ir::Tensor from python.
Merge pull request !2245 from hewei/decouple_tensor
2020-06-24 14:34:48 +08:00
mindspore-ci-bot 087779b7d4 !2517 checkpoint add model_type
Merge pull request !2517 from chenzhongming/quant
2020-06-24 14:32:33 +08:00
mindspore-ci-bot 0a368494db !2499 HostAllGather and HostReduceScatter change to internal interface
Merge pull request !2499 from yihuaijie/master
2020-06-24 14:32:31 +08:00
chenzomi d3f9b80066 checkpoint add model_type 2020-06-24 12:31:08 +08:00
huangdongrun bc0455eaff * fix bool index
* change slice setitem to mixed procedure
* add testcase for slice assignment
2020-06-24 11:18:20 +08:00
He Wei 43e0967024 Decouple ir::Tensor class from python 2020-06-24 10:28:59 +08:00
mindspore-ci-bot 363a232cbc !2512 [quant]The top level add op prefix_name check error
Merge pull request !2512 from vlne-v1/I1LJMR-quant-the-top-level-add-op-prefix_name-check-error
2020-06-24 09:42:29 +08:00
mindspore-ci-bot c22c865c4a !1950 [front]add `has_effect` direct to target construct method not cell object
Merge pull request !1950 from vlne-v1/move-flags-to-construct
2020-06-24 09:35:24 +08:00
mindspore-ci-bot ea4800050b !2503 fix misspell and check parameters on graphdata
Merge pull request !2503 from heleiwang/fix_misspell
2020-06-24 09:15:33 +08:00
gukecai c703c4d7c8 hcom one stream 2020-06-24 08:59:36 +08:00
heleiwang 0d52888fc5 fix misspell and check parameters 2020-06-23 22:01:36 +08:00
Mahdi bca037e1be added cpp test cases for pad and cut out 2020-06-23 09:55:01 -04:00
mindspore-ci-bot d831474d33 !2426 add one opt pass which optimize tuple_getitem with constant input to const value
Merge pull request !2426 from xychow/add-tuple-getitem-const-pass
2020-06-23 21:30:16 +08:00
yanghaoran 21c381b366 sync from mindspore to incubator 2020-06-23 21:05:50 +08:00
Wei Luning dcd5773f64 fix bug in quant deploy export 2020-06-23 20:34:44 +08:00
Wei Luning 8f56528f8c add flags on function 2020-06-23 20:22:07 +08:00
mindspore-ci-bot 0478b7d191 !2303 optimize LARS interface
Merge pull request !2303 from gziyan/modify_lars_interface
2020-06-23 20:05:47 +08:00
Yi Huaijie 2eb739de6e change HostAllGather and HostReduceScatter to internal interface 2020-06-23 16:56:04 +08:00
jiangjinsheng a1e148cb4d vm for LRN and LRNGrad 2020-06-23 15:47:15 +08:00
zhousiyi b2ec296f99 add opt pass for tuple_getitem with constant input 2020-06-23 07:41:21 +00:00
mindspore-ci-bot 5b14292f69 !2140 Implementation of mindspore debugger
Merge pull request !2140 from ShidaHe/debugger_dev
2020-06-23 15:33:02 +08:00
mindspore-ci-bot 367e5765f4 !237 fix issue ssim ksize check
Merge pull request !237 from zhaozhenlong/fix-issue-ssim-ksize-check-incu
2020-06-23 14:18:54 +08:00
Ziyan 41ddc153a6 modify lars interface 2020-06-23 11:23:28 +08:00
mindspore-ci-bot ac78ac9700 !2297 add vm support for operators include MatrixDiag, MatrixDiagPart etc
Merge pull request !2297 from jiangjinsheng/vm_matrixdiag
2020-06-23 11:03:02 +08:00
mindspore-ci-bot 8e5d8a1cf7 !2305 Enhance callback module and strongly check if callbacks is list or not
Merge pull request !2305 from 李鸿章/callback
2020-06-23 10:49:45 +08:00
Shida He 4c056855e0 Implementation for mindspore debugger 2020-06-22 17:15:30 -04:00
mindspore-ci-bot 73f440a54d !2418 add pretrain for lstm & vgg16 and remove lstm/vgg16/googlenet from directory 'mindspore/model_zoo'
Merge pull request !2418 from caojian05/ms_master_dev
2020-06-22 22:51:19 +08:00
wuxuejian 92880788f3 add aicpu embeddinglookup
move embeddinglookup to the internal
2020-06-22 21:33:16 +08:00
jiangjinsheng 017ff492af vm for MatrixDiag,MatrixDiagPart.MatrixSetDiag 2020-06-22 20:24:51 +08:00
Li Hongzhang 4c0d12fd63 enhance callback module and strongly check callbacks is list or not 2020-06-22 18:54:40 +08:00
mindspore-ci-bot 932b7649e7 !2241 Adapting operator named AccumulateNV2
Merge pull request !2241 from zhangzheng/accumulate
2020-06-22 17:17:47 +08:00
caojian05 deb9694f63 add pretrain for lstm & vgg16 and remove lstm/vgg16/googlenet from directory 'mindspore/model_zoo' 2020-06-22 17:17:10 +08:00
mindspore-ci-bot 55d5ded228 !2306 [Dataset] Code review & improve quality
Merge pull request !2306 from luoyang/pylint
2020-06-22 16:01:02 +08:00
mindspore-ci-bot e9e4442dcb !2413 [Auto parallel] Check 'CAST' from optimizers
Merge pull request !2413 from Xiaoda/7-auto-parallel-check-optimizer-ops
2020-06-22 14:20:32 +08:00
YangLuo 4e3bfcf4c9 !2306 [Dataset] Code review & improve quality 2020-06-22 14:01:22 +08:00
zhaozhenlong 5888d745bf fix ssim filter size check 2020-06-22 11:02:29 +08:00
zhangz0911gm 4ac1876237 Adapting AccumulateNV2 2020-06-21 22:49:09 -04:00
jiangjinsheng e71599b5ca vm for lin_space 2020-06-22 10:32:03 +08:00
xutianchun 2bfc86f5b7 Add aicpu op: ReverseSequence, CropAndResize, CTCLoss 2020-06-22 09:31:30 +08:00
mindspore-ci-bot beb436f457 !2398 Bug in Slice when multiple rows are used
Merge pull request !2398 from h.farahat/slice_bug
2020-06-22 09:23:44 +08:00
mindspore-ci-bot a9c309da4c !2404 [Dataset]rename input variable name to children and output variable to parent
Merge pull request !2404 from xulei/input_output
2020-06-22 09:22:33 +08:00
mindspore-ci-bot 1ea38eb60c !2375 Add Python Tokenizer
Merge pull request !2375 from h.farahat/python_tokenizer
2020-06-22 09:20:33 +08:00
Xiaoda Zhang 3ff6e336c6 check cast from optimizer in auto-parallel 2020-06-22 09:10:22 +08:00
liyong 2412ee09ce fix distributedSampler reshuffle and fix random_device failed 2020-06-21 18:23:47 +08:00
gong chen a6dfa281ea Init GraphKernel.
- It provides a unified style to express graph and kernel for user.
- It provides a unified IR to represent graph and kernel for developer.
- It breaks the boundary between graph and kernel.
- It provides more opportunities to do compile optimization.
2020-06-20 22:31:54 +08:00
mindspore-ci-bot 78a8bc302d !2380 Fix CocoDataset issue
Merge pull request !2380 from xiefangqi/xfq_fix_coco_issue_01
2020-06-20 18:41:07 +08:00
mindspore-ci-bot a3e7b30457 !2384 Add split fission pass
Merge pull request !2384 from YuJianfeng/split
2020-06-20 18:11:02 +08:00
mindspore-ci-bot 616cc80d78 !2378 fix tensor id bug and some yolov3 bug
Merge pull request !2378 from flywind/fix_yolov3_bug
2020-06-20 17:46:47 +08:00
mindspore-ci-bot 53654f94f2 !2056 Enable new control sink
Merge pull request !2056 from zhoufeng/enable-new-control-sink
2020-06-20 17:41:30 +08:00
kpy b79523a994 fix yolov3 multi getitem bug and tensor ptr not unique bug 2020-06-20 17:35:15 +08:00
xulei2020 3b71bd0d5d rename input to children, output to parent 2020-06-20 16:40:10 +08:00
mindspore-ci-bot 8a913d7586 !2157 mindspore server inference
Merge pull request !2157 from hangq/master
2020-06-20 16:22:15 +08:00
mindspore-ci-bot 3401e1c80b !2143 dataset: remove storage_op c++ part
Merge pull request !2143 from ms_yan/del_storage_c++
2020-06-20 15:24:33 +08:00
zhoufeng bbbfaa2441 enable new control sink
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2020-06-20 14:48:21 +08:00
yujianfeng 7ad877a948 Add Split fission pass 2020-06-20 14:28:25 +08:00
hangangqiang dfbb232468 mindspore server inference 2020-06-20 14:12:56 +08:00
ms_yan cf82aa9035 init remove storage op in c++
init remove storage op test case c++

remove source c++ files
2020-06-20 13:52:07 +08:00
hesham 68030e6a4b Slice Bug 2020-06-20 00:47:13 -04:00
qianlong 980ddd32a2 change output of WordpieceTokenizer and BertTokenizer to 1-D string tensors 2020-06-20 12:08:43 +08:00
mindspore-ci-bot e8639ad91e !2347 support multi param for tuple grad
Merge pull request !2347 from riemann_penn/support_multi_param_for_tuple_grad
2020-06-20 10:30:37 +08:00
xiefangqi 5703a10b8b fix CocoDataset issue 2020-06-20 09:51:10 +08:00
mindspore-ci-bot bbf69912be !2363 fix TextFildDataset and CLUEDataset does not support to_device
Merge pull request !2363 from yanghaitao/yht_fix_textfiledataset
2020-06-20 09:47:01 +08:00
mindspore-ci-bot 634bfd3508 !2259 add Normal op
Merge pull request !2259 from pkuliuliu/master
2020-06-20 09:33:38 +08:00
mindspore-ci-bot d137cefa79 !2372 Cleanup work for BERT special ops
Merge pull request !2372 from h.farahat/cleanup_0619
2020-06-20 09:25:56 +08:00
mindspore-ci-bot 2f9c6ec8bc !2337 aware quantization training auto create graph
Merge pull request !2337 from chenzhongming/master
2020-06-20 09:23:14 +08:00
pkuliuliu acf46bafbb add Normal op 2020-06-20 09:23:13 +08:00
mindspore-ci-bot 9514b52a23 !2147 Add a callback named SummaryCollector and delete SummaryStep callback
Merge pull request !2147 from ougongchang/master
2020-06-20 09:19:10 +08:00
panyifeng 3c2057297e support multi param for tuple grad 2020-06-20 08:39:42 +08:00
hesham e981c67acd Python Tokenizer
!38 Synchronize with latest Ascend software suite 17 Jun 2020
Merge pull request !38 from yanghaoran/master
2020-06-19 19:57:11 -04:00
hesham 674415f7be Cleanup work for Concate, Mask, Slice, PadEnd and TruncatePair 2020-06-19 19:11:50 -04:00
mindspore-ci-bot bc4b1c2460 !2373 Comments + improved casting/parameters + UT tests for 3 AugOps (Augmentation Ops RandomCropWithBBox, Random Vertical FlipWithWithBBox and Random CropAndResizeWithWithBBox)
Merge pull request !2373 from danishnxt/AugOpsD1
2020-06-20 05:19:03 +08:00
mindspore-ci-bot 7bdcc319b2 !2325 Addressing comments from PR2314
Merge pull request !2325 from imaaamin/object_ops_pr2
2020-06-20 04:50:56 +08:00
Danish Farid 6442a85b75 comments added, ptrs to consts, UT tests for BBOps
updated comments for 3 BB AugOps

addressing comments, void -> status, macros added, fixed test cmt

changed types -> value, fixed ut test funcs, grammar

bug type fix

fixed condition in tests for viz
2020-06-19 16:09:16 -04:00
islam_amin edc42c5b85 addressed comments from reviews 2020-06-19 14:53:46 -04:00
nhussain d89101b95f add missing test 2020-06-19 11:44:41 -04:00
chenzomi c268c88220 aware quantization training auto create graph 2020-06-19 22:01:16 +08:00
ougongchang 939cd29d7e Add a callback named SummaryCollector and delete SummaryStep callback
I added a SummaryCollector to help users automatically collect information
such as the network, loss, learning rate and so on, making it easier to collect this information.

It also can collect train lineage and eval lineage information which is
collected by TrainLineage Callback and EvalLineage Callback in
MindInsight.

I also add some UT for SummaryCollect to keep the code correct.
2020-06-19 21:07:55 +08:00
mindspore-ci-bot 21c67eddd5 !1897 save print data to file
Merge pull request !1897 from jinyaohui/print
2020-06-19 17:50:34 +08:00
yanghaitao 9f336bb735 fix TextFileDataset and CLUEDataset failed with to_device 2020-06-19 17:28:05 +08:00
jinyaohui ac23a179bf save print data to file 2020-06-19 17:25:22 +08:00
mindspore-ci-bot 182215e060 !2284 Add Pass to Eliminate Redundant Depend
Merge pull request !2284 from BowenK/fix_depend
2020-06-19 16:39:55 +08:00
mindspore-ci-bot b6ff27245f !1990 fix profiling stream id
Merge pull request !1990 from caifubi/fix-profiling-stream-id
2020-06-19 16:36:34 +08:00
mindspore-ci-bot 2d6d3cc86b !2339 support catch IndexError in C++
Merge pull request !2339 from zhangbuxue/support_catch_index_error_in_c++
2020-06-19 15:28:18 +08:00
mindspore-ci-bot 8867c67d61 !1935 Summary callback as collector for summary and lineage
Merge pull request !1935 from 李鸿章/policy_writer
2020-06-19 14:53:14 +08:00
BowenK 8f29e7242f add pass to eliminate depend value 2020-06-19 14:52:52 +08:00
mindspore-ci-bot 230963d08e !2332 Fix ConfusionSoftmaxGrad fusion pass work if the ReduceSum's attr of keep_dims set with False
Merge pull request !2332 from huanghui/fix-ConfusionSoftmaxGrad-fusion-pass
2020-06-19 14:44:23 +08:00
caifubi a49c6f0b13 Fix profiling stream id bug 2020-06-19 14:34:20 +08:00
mindspore-ci-bot 9958bc479a !2161 [qat]Export network from quantization aware network to deploy
Merge pull request !2161 from vlne-v1/I1IZV3-quant-infer
2020-06-19 14:16:00 +08:00
mindspore-ci-bot 06b511ca94 !2301 add sparse proximal ada grad optimizer
Merge pull request !2301 from lilei/sparse_proximal_ada_grad
2020-06-19 14:07:50 +08:00
Li Hongzhang 0921c1e538 enhance the SummaryRecord with set_mode and add_value 2020-06-19 13:03:00 +08:00
buxue 2c9ca199ad support catch IndexError in C++ 2020-06-19 12:13:18 +08:00
huanghui c7bda5363d fix ConfusionSoftmaxGrad fusion pass work if the ReduceSum's attr of keep_dims set False 2020-06-19 10:37:15 +08:00
Wei Luning 1d77bf86a9 Exports MindSpore quant predict model to deploy with GEIR 2020-06-19 10:21:35 +08:00
lilei 497067d7b2 add sparse proximal ada grad optimizer 2020-06-19 09:56:28 +08:00
peilinwang 1e36b0649f remove graphengine changes
remove graphengine changes

concat op

Truncate Pair

concat_op

remove graph engine changes

ToNumberOp implementation almost done

ToNumberOp complete

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

merge conflicts
2020-06-18 20:07:35 -04:00
hesham 11826fb256 DuplicateOp 2020-06-18 19:47:27 -04:00
mindspore-ci-bot 90bb9320aa !2314 Implemented RandomHorizontalFlipWithBBox and BoundingBoxAugment C++ Ops
Merge pull request !2314 from imaaamin/object_ops_pr
2020-06-19 07:08:42 +08:00
mindspore-ci-bot a83baafbf6 !2253 Add ConcatOp to Dataset
Merge pull request !2253 from nhussain/concat_op
2020-06-19 06:32:15 +08:00
mindspore-ci-bot 3784220056 !2317 rework on dataset.text.vocab to support any user special_tokens
Merge pull request !2317 from ZiruiWu/vocab_rework
2020-06-19 05:25:31 +08:00
nhussain 5515016dba remove graphengine changes
remove graphengine changes

concat op

Truncate Pair

concat_op

remove graph engine changes
2020-06-18 17:17:50 -04:00
mindspore-ci-bot ffc8a3c362 !2274 add PadEndOp
Merge pull request !2274 from xunxue/padend
2020-06-19 05:05:14 +08:00
mindspore-ci-bot e4322baece !2316 [Dataset] Move python tree transformation into cpp pass
Merge pull request !2316 from JunhanHu/alter_node_cpp
2020-06-19 05:02:03 +08:00
islam_amin 0af156d169 added two ops for object detection, random horizontal flip with bbox and bouding box augment. along with their unit tests 2020-06-18 16:55:31 -04:00
xunxue 87aa9c8f7a PadEndOp 2020-06-18 16:07:34 -04:00
Junhan Hu 57f3732ac3 Move python tree transformation into cpp pass. 2020-06-18 15:52:38 -04:00
Zirui Wu b6e9504b31 phase I of Vocab rework
phase II vocab rework

added more test cases

fix api doc string

address review cmts and fix CI

address ci complains

fix review cmts

ci
2020-06-18 15:36:28 -04:00
Zirui Wu 8f2674850b address API doc style and content
addr review cmts

revert

ci

private class

ci

fix ci

address ci

address review cmts

fix style err
2020-06-18 12:23:42 -04:00
mindspore-ci-bot c0fe8c0322 !2273 [AutoParallel]update EmbeddingLookUp op
Merge pull request !2273 from lichen/fix_embeding_look_up
2020-06-18 21:07:52 +08:00
mindspore-ci-bot 5850b99161 !2211 Add TruncatePair Op to dataset
Merge pull request !2211 from h.farahat/pair_truncate
2020-06-18 20:58:40 +08:00
mindspore-ci-bot 0958a695a4 !205 add ReverseSequenceGrad
Merge pull request !205 from xutianchun/reverse_sequence_grad
2020-06-18 20:53:48 +08:00
lichenever 563622874a update 2020-06-18 19:45:40 +08:00