Commit Graph

975 Commits

Author SHA1 Message Date
mindspore-ci-bot 32a2d5d21c !2629 get monitor sampling interval from json file
Merge pull request !2629 from yanghaitao/yht_sampling_interval
2020-06-28 20:05:05 +08:00
mindspore-ci-bot 363489d00f !2580 BasicTokenizer do not case fold on preserved words
Merge pull request !2580 from qianlong21st/fix_basic_tokenizer
2020-06-28 19:36:28 +08:00
mindspore-ci-bot db6c4bf784 !2640 [MD] fix minddata error message
Merge pull request !2640 from liyong126/minddataset_fix_errmsg
2020-06-28 19:36:23 +08:00
wangnan39@huawei.com 172728a6a6 support weight decay for sparse optimizer 2020-06-28 17:49:03 +08:00
jonyguo 3450c35d9b fix: tfrecord to mindrecord parameter check 2020-06-28 17:48:52 +08:00
mindspore-ci-bot bc30576ac9 !2631 Add ExpandDims to whitelist
Merge pull request !2631 from amongo/FixExpandDimsOps
2020-06-28 17:40:20 +08:00
zhaozhenlong d55c0f6679 complement scatter add support dtype 2020-06-28 16:51:53 +08:00
qianlong cae77c0c22 BasicTokenizer not case fold on preserverd words 2020-06-28 16:28:00 +08:00
liyong 68e2097897 fix split erroer message 2020-06-28 15:47:10 +08:00
zhaozhenlong 71d33b087e limit ssim input img type to fp32 and fp16 2020-06-28 15:35:07 +08:00
yanghaitao fd701b8504 set monitor sampling interval through json file 2020-06-28 15:18:21 +08:00
huangdongrun 96b38f72b2 add ExpandDims whitelist
add comment for control_depend
2020-06-28 11:29:16 +08:00
Eric a4f5802924 Added Fix for test config 2020-06-27 15:20:48 -04:00
mindspore-ci-bot 87213648bc !2612 delete pynative lenet test
Merge pull request !2612 from changzherui/del_test
2020-06-27 18:38:36 +08:00
changzherui 9e83337e2f delete pynative lenet_model test 2020-06-27 15:33:27 +08:00
Ziyan 0925e35252 enable optimizer parallel with broadcast 2020-06-27 14:36:17 +08:00
mindspore-ci-bot df795daf75 !2562 [bug]when multi times print same thing, do not merge in cse
Merge pull request !2562 from vlne-v1/I1LHCF-print-multi-times-and-same-str
2020-06-27 07:26:52 +08:00
Alexey Shevlyakov 698abf75fc Connector throughput + PerfData + CyclicArray 2020-06-26 14:45:01 -04:00
mindspore-ci-bot a1b17bd2e2 !2593 python unit tests for randomResizeWithBBox and ResizeWithBBox
Merge pull request !2593 from ava/python_ut_tests
2020-06-27 02:31:31 +08:00
avakh 1e869146e9 applying comments removing VOC 2020-06-26 12:39:48 -04:00
Cathy Wong 277aba5326 dataset: Fixup docs; remove pylint disabled messages in UT 2020-06-26 12:26:41 -04:00
mindspore-ci-bot e11c953225 !2587 Implementing Python UTs for BoundingBoxAugment and RandomHorizontalFlipWithBBox
Merge pull request !2587 from imaaamin/object_ops_ut
2020-06-26 00:43:31 +08:00
mindspore-ci-bot 067592ccf9 !2590 Updated Python UTs for RandomVerticalFlipWithBBox, RandomCropWithBBox and RandomResizedCropWithBBox
Merge pull request !2590 from danishnxt/AugOps2
2020-06-25 23:40:34 +08:00
islam_amin 0f58f0338e updating ut for RandomHorizontalFlipWithBBox and BBoxAugment 2020-06-25 11:35:22 -04:00
mindspore-ci-bot b0a10c26a4 !2532 adding random-resize-with-bbox-op and resize-with-bbox-op
Merge pull request !2532 from ava/NNNewMaster
2020-06-25 20:42:00 +08:00
Danish Farid 3d1ecaaeb5 updated UT test for Python (3) AugOps with BBox - MD5 checks + imrpv comments 2020-06-25 03:19:14 -04:00
avakh 587e260236 addressing comments 2020-06-24 18:54:47 -04:00
Jamie Nisbet c22eac743d subtree creation in python apis
updates

fix

fix cpplint

fix
2020-06-24 17:17:05 -04:00
mindspore-ci-bot a12f9614d4 !2533 Fixing testVOC2012 dataset by merging with testVOC2012_2 + moving BBoxOp testing functions to util + new check in Bounding_Box_check
Merge pull request !2533 from danishnxt/AugOpsD2
2020-06-25 01:39:08 +08:00
Wei Luning ef13a4b6fb adjust cse code when op has side effect. 2020-06-25 00:46:01 +08:00
Danish Farid a8f392ca42 updated test util file + new BoundingBoxCheck + fixed VOCDataset annotations
Style Error fix

fixed PyLint problem

reverting testVOC2012 due to CI break for existing test

reverting testVOC2012 due to CI break for existing test-2

updated old error messages to confirm with global standard

addressing PR 2355 Comments - 1

addressing PR 2355 Comments - 2

addressing PR 2355 Comments - 3
2020-06-24 12:41:41 -04:00
mindspore-ci-bot 67d664d7dd !2511 add mod and floordiv opration for tensor
Merge pull request !2511 from wangqiuliang/add-tensor-mod-operation
2020-06-24 18:09:59 +08:00
kingfo 078738adc5 add tensor mod & floordiv operation 2020-06-24 16:47:23 +08:00
huangdongrun 9d3c9c69fe modify map to C.Map() 2020-06-24 15:07:33 +08:00
mindspore-ci-bot a9dac909d9 !2535 Fix pynative indexing
Merge pull request !2535 from amongo/FixPynativeTensorIndexing
2020-06-24 14:41:11 +08:00
mindspore-ci-bot 087779b7d4 !2517 checkpoint add model_type
Merge pull request !2517 from chenzhongming/quant
2020-06-24 14:32:33 +08:00
mindspore-ci-bot 0a368494db !2499 HostAllGather and HostReduceScatter change to internal interface
Merge pull request !2499 from yihuaijie/master
2020-06-24 14:32:31 +08:00
chenzomi d3f9b80066 checkpoint add model_type 2020-06-24 12:31:08 +08:00
huangdongrun bc0455eaff * fix bool index
* change slice setitem to mixed procedure
* add testcase for slice assignment
2020-06-24 11:18:20 +08:00
mindspore-ci-bot 363a232cbc !2512 [quant]The top level add op prefix_name check error
Merge pull request !2512 from vlne-v1/I1LJMR-quant-the-top-level-add-op-prefix_name-check-error
2020-06-24 09:42:29 +08:00
mindspore-ci-bot c22c865c4a !1950 [front]add `has_effect` direct to target construct method not cell object
Merge pull request !1950 from vlne-v1/move-flags-to-construct
2020-06-24 09:35:24 +08:00
Wei Luning dcd5773f64 fix bug in quant deploy export 2020-06-23 20:34:44 +08:00
Wei Luning 8f56528f8c add flags on function 2020-06-23 20:22:07 +08:00
mindspore-ci-bot 0478b7d191 !2303 optimize LARS interface
Merge pull request !2303 from gziyan/modify_lars_interface
2020-06-23 20:05:47 +08:00
Yi Huaijie 2eb739de6e change HostAllGather and HostReduceScatter to internal interface 2020-06-23 16:56:04 +08:00
jiangjinsheng a1e148cb4d vm for LRN and LRNGrad 2020-06-23 15:47:15 +08:00
Ziyan 41ddc153a6 modify lars interface 2020-06-23 11:23:28 +08:00
mindspore-ci-bot ac78ac9700 !2297 add vm support for operators include MatrixDiag, MatrixDiagPart etc
Merge pull request !2297 from jiangjinsheng/vm_matrixdiag
2020-06-23 11:03:02 +08:00
mindspore-ci-bot 8e5d8a1cf7 !2305 Enhance callback module and strongly check if callbacks is list or not
Merge pull request !2305 from 李鸿章/callback
2020-06-23 10:49:45 +08:00
mindspore-ci-bot 73f440a54d !2418 add pretrain for lstm & vgg16 and remove lstm/vgg16/googlenet from directory 'mindspore/model_zoo'
Merge pull request !2418 from caojian05/ms_master_dev
2020-06-22 22:51:19 +08:00
jiangjinsheng 017ff492af vm for MatrixDiag,MatrixDiagPart.MatrixSetDiag 2020-06-22 20:24:51 +08:00
Li Hongzhang 4c0d12fd63 enhance callback module and strongly check callbacks is list or not 2020-06-22 18:54:40 +08:00
mindspore-ci-bot 932b7649e7 !2241 Adapting operator named AccumulateNV2
Merge pull request !2241 from zhangzheng/accumulate
2020-06-22 17:17:47 +08:00
caojian05 deb9694f63 add pretrain for lstm & vgg16 and remove lstm/vgg16/googlenet from directory 'mindspore/model_zoo' 2020-06-22 17:17:10 +08:00
mindspore-ci-bot 55d5ded228 !2306 [Dataset] Code review & improve quality
Merge pull request !2306 from luoyang/pylint
2020-06-22 16:01:02 +08:00
mindspore-ci-bot e9e4442dcb !2413 [Auto parallel] Check 'CAST' from optimizers
Merge pull request !2413 from Xiaoda/7-auto-parallel-check-optimizer-ops
2020-06-22 14:20:32 +08:00
YangLuo 4e3bfcf4c9 !2306 [Dataset] Code review & improve quality 2020-06-22 14:01:22 +08:00
zhangz0911gm 4ac1876237 Adapting AccumulateNV2 2020-06-21 22:49:09 -04:00
jiangjinsheng e71599b5ca vm for lin_space 2020-06-22 10:32:03 +08:00
xutianchun 2bfc86f5b7 Add aicpu op: ReverseSequence, CropAndResize, CTCLoss 2020-06-22 09:31:30 +08:00
mindspore-ci-bot beb436f457 !2398 Bug in Slice when multiple rows are used
Merge pull request !2398 from h.farahat/slice_bug
2020-06-22 09:23:44 +08:00
mindspore-ci-bot a9c309da4c !2404 [Dataset]rename input variable name to children and output variable to parent
Merge pull request !2404 from xulei/input_output
2020-06-22 09:22:33 +08:00
mindspore-ci-bot 1ea38eb60c !2375 Add Python Tokenizer
Merge pull request !2375 from h.farahat/python_tokenizer
2020-06-22 09:20:33 +08:00
Xiaoda Zhang 3ff6e336c6 check cast from optimizer in auto-parallel 2020-06-22 09:10:22 +08:00
liyong 2412ee09ce fix distributedSampler reshuffle and fix random_device failed 2020-06-21 18:23:47 +08:00
mindspore-ci-bot 78a8bc302d !2380 Fix CocoDataset issue
Merge pull request !2380 from xiefangqi/xfq_fix_coco_issue_01
2020-06-20 18:41:07 +08:00
xulei2020 3b71bd0d5d rename input to children, output to parent 2020-06-20 16:40:10 +08:00
hesham 68030e6a4b Slice Bug 2020-06-20 00:47:13 -04:00
qianlong 980ddd32a2 change output of WordpieceTokenizer and BertTokenizer to 1-D string tensors 2020-06-20 12:08:43 +08:00
mindspore-ci-bot e8639ad91e !2347 support multi param for tuple grad
Merge pull request !2347 from riemann_penn/support_multi_param_for_tuple_grad
2020-06-20 10:30:37 +08:00
xiefangqi 5703a10b8b fix CocoDataset issue 2020-06-20 09:51:10 +08:00
mindspore-ci-bot bbf69912be !2363 fix TextFildDataset and CLUEDataset does not support to_device
Merge pull request !2363 from yanghaitao/yht_fix_textfiledataset
2020-06-20 09:47:01 +08:00
mindspore-ci-bot 634bfd3508 !2259 add Normal op
Merge pull request !2259 from pkuliuliu/master
2020-06-20 09:33:38 +08:00
mindspore-ci-bot d137cefa79 !2372 Cleanup work for BERT special ops
Merge pull request !2372 from h.farahat/cleanup_0619
2020-06-20 09:25:56 +08:00
mindspore-ci-bot 2f9c6ec8bc !2337 aware quantization training auto create graph
Merge pull request !2337 from chenzhongming/master
2020-06-20 09:23:14 +08:00
pkuliuliu acf46bafbb add Normal op 2020-06-20 09:23:13 +08:00
mindspore-ci-bot 9514b52a23 !2147 Add a callback named SummaryCollector and delete SummaryStep callback
Merge pull request !2147 from ougongchang/master
2020-06-20 09:19:10 +08:00
panyifeng 3c2057297e support multi param for tuple grad 2020-06-20 08:39:42 +08:00
hesham e981c67acd Python Tokenizer
!38 Synchronize with latest Ascend software suite 17 Jun 2020
Merge pull request !38 from yanghaoran/master
2020-06-19 19:57:11 -04:00
hesham 674415f7be Cleanup work for Concate, Mask, Slice, PadEnd and TruncatePair 2020-06-19 19:11:50 -04:00
mindspore-ci-bot bc4b1c2460 !2373 Comments + improved casting/parameters + UT tests for 3 AugOps (Augmentation Ops RandomCropWithBBox, Random Vertical FlipWithWithBBox and Random CropAndResizeWithWithBBox)
Merge pull request !2373 from danishnxt/AugOpsD1
2020-06-20 05:19:03 +08:00
mindspore-ci-bot 7bdcc319b2 !2325 Addressing comments from PR2314
Merge pull request !2325 from imaaamin/object_ops_pr2
2020-06-20 04:50:56 +08:00
Danish Farid 6442a85b75 comments added, ptrs to consts, UT tests for BBOps
updated comments for 3 BB AugOps

addressing comments, void -> status, macros added, fixed test cmt

changed types -> value, fixed ut test funcs, grammar

bug type fix

fixed condition in tests for viz
2020-06-19 16:09:16 -04:00
islam_amin edc42c5b85 addressed comments from reviews 2020-06-19 14:53:46 -04:00
nhussain d89101b95f add missing test 2020-06-19 11:44:41 -04:00
chenzomi c268c88220 aware quantization training auto create graph 2020-06-19 22:01:16 +08:00
ougongchang 939cd29d7e Add a callback named SummaryCollector and delete SummaryStep callback
I added a SummaryCollector to help users automatically collect information
such as the network, loss, learning rate and so on, making it easier to collect this information.

It also can collect train lineage and eval lineage information which is
collected by TrainLineage Callback and EvalLineage Callback in
MindInsight.

I also add some UT for SummaryCollect to keep the code correct.
2020-06-19 21:07:55 +08:00
mindspore-ci-bot 21c67eddd5 !1897 save print data to file
Merge pull request !1897 from jinyaohui/print
2020-06-19 17:50:34 +08:00
yanghaitao 9f336bb735 fix TextFileDataset and CLUEDataset failed with to_device 2020-06-19 17:28:05 +08:00
jinyaohui ac23a179bf save print data to file 2020-06-19 17:25:22 +08:00
mindspore-ci-bot 2d6d3cc86b !2339 support catch IndexError in C++
Merge pull request !2339 from zhangbuxue/support_catch_index_error_in_c++
2020-06-19 15:28:18 +08:00
mindspore-ci-bot 8867c67d61 !1935 Summary callback as collector for summary and lineage
Merge pull request !1935 from 李鸿章/policy_writer
2020-06-19 14:53:14 +08:00
mindspore-ci-bot 9958bc479a !2161 [qat]Export network from quantization aware network to deploy
Merge pull request !2161 from vlne-v1/I1IZV3-quant-infer
2020-06-19 14:16:00 +08:00
mindspore-ci-bot 06b511ca94 !2301 add sparse proximal ada grad optimizer
Merge pull request !2301 from lilei/sparse_proximal_ada_grad
2020-06-19 14:07:50 +08:00
Li Hongzhang 0921c1e538 enhance the SummaryRecord with set_mode and add_value 2020-06-19 13:03:00 +08:00
buxue 2c9ca199ad support catch IndexError in C++ 2020-06-19 12:13:18 +08:00
Wei Luning 1d77bf86a9 Exports MindSpore quant predict model to deploy with GEIR 2020-06-19 10:21:35 +08:00
lilei 497067d7b2 add sparse proximal ada grad optimizer 2020-06-19 09:56:28 +08:00
peilinwang 1e36b0649f remove graphengine changes
remove graphengine changes

concat op

Truncate Pair

concat_op

remove graph engine changes

ToNumberOp implementation almost done

ToNumberOp complete

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

merge conflicts
2020-06-18 20:07:35 -04:00
hesham 11826fb256 DuplicateOp 2020-06-18 19:47:27 -04:00