Commit Graph

956 Commits

Author SHA1 Message Date
avakh 1e869146e9 applying comments removing VOC 2020-06-26 12:39:48 -04:00
Cathy Wong 277aba5326 dataset: Fixup docs; remove pylint disabled messages in UT 2020-06-26 12:26:41 -04:00
mindspore-ci-bot e11c953225 !2587 Implementing Python UTs for BoundingBoxAugment and RandomHorizontalFlipWithBBox
Merge pull request !2587 from imaaamin/object_ops_ut
2020-06-26 00:43:31 +08:00
mindspore-ci-bot 067592ccf9 !2590 Updated Python UTs for RandomVerticalFlipWithBBox, RandomCropWithBBox and RandomResizedCropWithBBox
Merge pull request !2590 from danishnxt/AugOps2
2020-06-25 23:40:34 +08:00
islam_amin 0f58f0338e updating ut for RandomHorizontalFlipWithBBox and BBoxAugment 2020-06-25 11:35:22 -04:00
mindspore-ci-bot b0a10c26a4 !2532 adding random-resize-with-bbox-op and resize-with-bbox-op
Merge pull request !2532 from ava/NNNewMaster
2020-06-25 20:42:00 +08:00
Danish Farid 3d1ecaaeb5 updated UT test for Python (3) AugOps with BBox - MD5 checks + imrpv comments 2020-06-25 03:19:14 -04:00
avakh 587e260236 addressing comments 2020-06-24 18:54:47 -04:00
Jamie Nisbet c22eac743d subtree creation in python apis
updates

fix

fix cpplint

fix
2020-06-24 17:17:05 -04:00
mindspore-ci-bot a12f9614d4 !2533 Fixing testVOC2012 dataset by merging with testVOC2012_2 + moving BBoxOp testing functions to util + new check in Bounding_Box_check
Merge pull request !2533 from danishnxt/AugOpsD2
2020-06-25 01:39:08 +08:00
Wei Luning ef13a4b6fb adjust cse code when op has side effect. 2020-06-25 00:46:01 +08:00
Danish Farid a8f392ca42 updated test util file + new BoundingBoxCheck + fixed VOCDataset annotations
Style Error fix

fixed PyLint problem

reverting testVOC2012 due to CI break for existing test

reverting testVOC2012 due to CI break for existing test-2

updated old error messages to confirm with global standard

addressing PR 2355 Comments - 1

addressing PR 2355 Comments - 2

addressing PR 2355 Comments - 3
2020-06-24 12:41:41 -04:00
mindspore-ci-bot 67d664d7dd !2511 add mod and floordiv opration for tensor
Merge pull request !2511 from wangqiuliang/add-tensor-mod-operation
2020-06-24 18:09:59 +08:00
kingfo 078738adc5 add tensor mod & floordiv operation 2020-06-24 16:47:23 +08:00
huangdongrun 9d3c9c69fe modify map to C.Map() 2020-06-24 15:07:33 +08:00
mindspore-ci-bot a9dac909d9 !2535 Fix pynative indexing
Merge pull request !2535 from amongo/FixPynativeTensorIndexing
2020-06-24 14:41:11 +08:00
mindspore-ci-bot 087779b7d4 !2517 checkpoint add model_type
Merge pull request !2517 from chenzhongming/quant
2020-06-24 14:32:33 +08:00
mindspore-ci-bot 0a368494db !2499 HostAllGather and HostReduceScatter change to internal interface
Merge pull request !2499 from yihuaijie/master
2020-06-24 14:32:31 +08:00
chenzomi d3f9b80066 checkpoint add model_type 2020-06-24 12:31:08 +08:00
huangdongrun bc0455eaff * fix bool index
* change slice setitem to mixed procedure
* add testcase for slice assignment
2020-06-24 11:18:20 +08:00
mindspore-ci-bot 363a232cbc !2512 [quant]The top level add op prefix_name check error
Merge pull request !2512 from vlne-v1/I1LJMR-quant-the-top-level-add-op-prefix_name-check-error
2020-06-24 09:42:29 +08:00
mindspore-ci-bot c22c865c4a !1950 [front]add `has_effect` direct to target construct method not cell object
Merge pull request !1950 from vlne-v1/move-flags-to-construct
2020-06-24 09:35:24 +08:00
Wei Luning dcd5773f64 fix bug in quant deploy export 2020-06-23 20:34:44 +08:00
Wei Luning 8f56528f8c add flags on function 2020-06-23 20:22:07 +08:00
mindspore-ci-bot 0478b7d191 !2303 optimize LARS interface
Merge pull request !2303 from gziyan/modify_lars_interface
2020-06-23 20:05:47 +08:00
Yi Huaijie 2eb739de6e change HostAllGather and HostReduceScatter to internal interface 2020-06-23 16:56:04 +08:00
jiangjinsheng a1e148cb4d vm for LRN and LRNGrad 2020-06-23 15:47:15 +08:00
Ziyan 41ddc153a6 modify lars interface 2020-06-23 11:23:28 +08:00
mindspore-ci-bot ac78ac9700 !2297 add vm support for operators include MatrixDiag, MatrixDiagPart etc
Merge pull request !2297 from jiangjinsheng/vm_matrixdiag
2020-06-23 11:03:02 +08:00
mindspore-ci-bot 8e5d8a1cf7 !2305 Enhance callback module and strongly check if callbacks is list or not
Merge pull request !2305 from 李鸿章/callback
2020-06-23 10:49:45 +08:00
mindspore-ci-bot 73f440a54d !2418 add pretrain for lstm & vgg16 and remove lstm/vgg16/googlenet from directory 'mindspore/model_zoo'
Merge pull request !2418 from caojian05/ms_master_dev
2020-06-22 22:51:19 +08:00
jiangjinsheng 017ff492af vm for MatrixDiag,MatrixDiagPart.MatrixSetDiag 2020-06-22 20:24:51 +08:00
Li Hongzhang 4c0d12fd63 enhance callback module and strongly check callbacks is list or not 2020-06-22 18:54:40 +08:00
mindspore-ci-bot 932b7649e7 !2241 Adapting operator named AccumulateNV2
Merge pull request !2241 from zhangzheng/accumulate
2020-06-22 17:17:47 +08:00
caojian05 deb9694f63 add pretrain for lstm & vgg16 and remove lstm/vgg16/googlenet from directory 'mindspore/model_zoo' 2020-06-22 17:17:10 +08:00
mindspore-ci-bot 55d5ded228 !2306 [Dataset] Code review & improve quality
Merge pull request !2306 from luoyang/pylint
2020-06-22 16:01:02 +08:00
mindspore-ci-bot e9e4442dcb !2413 [Auto parallel] Check 'CAST' from optimizers
Merge pull request !2413 from Xiaoda/7-auto-parallel-check-optimizer-ops
2020-06-22 14:20:32 +08:00
YangLuo 4e3bfcf4c9 !2306 [Dataset] Code review & improve quality 2020-06-22 14:01:22 +08:00
zhangz0911gm 4ac1876237 Adapting AccumulateNV2 2020-06-21 22:49:09 -04:00
jiangjinsheng e71599b5ca vm for lin_space 2020-06-22 10:32:03 +08:00
xutianchun 2bfc86f5b7 Add aicpu op: ReverseSequence, CropAndResize, CTCLoss 2020-06-22 09:31:30 +08:00
mindspore-ci-bot beb436f457 !2398 Bug in Slice when multiple rows are used
Merge pull request !2398 from h.farahat/slice_bug
2020-06-22 09:23:44 +08:00
mindspore-ci-bot a9c309da4c !2404 [Dataset]rename input variable name to children and output variable to parent
Merge pull request !2404 from xulei/input_output
2020-06-22 09:22:33 +08:00
mindspore-ci-bot 1ea38eb60c !2375 Add Python Tokenizer
Merge pull request !2375 from h.farahat/python_tokenizer
2020-06-22 09:20:33 +08:00
Xiaoda Zhang 3ff6e336c6 check cast from optimizer in auto-parallel 2020-06-22 09:10:22 +08:00
liyong 2412ee09ce fix distributedSampler reshuffle and fix random_device failed 2020-06-21 18:23:47 +08:00
mindspore-ci-bot 78a8bc302d !2380 Fix CocoDataset issue
Merge pull request !2380 from xiefangqi/xfq_fix_coco_issue_01
2020-06-20 18:41:07 +08:00
xulei2020 3b71bd0d5d rename input to children, output to parent 2020-06-20 16:40:10 +08:00
hesham 68030e6a4b Slice Bug 2020-06-20 00:47:13 -04:00
qianlong 980ddd32a2 change output of WordpieceTokenizer and BertTokenizer to 1-D string tensors 2020-06-20 12:08:43 +08:00
mindspore-ci-bot e8639ad91e !2347 support multi param for tuple grad
Merge pull request !2347 from riemann_penn/support_multi_param_for_tuple_grad
2020-06-20 10:30:37 +08:00
xiefangqi 5703a10b8b fix CocoDataset issue 2020-06-20 09:51:10 +08:00
mindspore-ci-bot bbf69912be !2363 fix TextFildDataset and CLUEDataset does not support to_device
Merge pull request !2363 from yanghaitao/yht_fix_textfiledataset
2020-06-20 09:47:01 +08:00
mindspore-ci-bot 634bfd3508 !2259 add Normal op
Merge pull request !2259 from pkuliuliu/master
2020-06-20 09:33:38 +08:00
mindspore-ci-bot d137cefa79 !2372 Cleanup work for BERT special ops
Merge pull request !2372 from h.farahat/cleanup_0619
2020-06-20 09:25:56 +08:00
mindspore-ci-bot 2f9c6ec8bc !2337 aware quantization training auto create graph
Merge pull request !2337 from chenzhongming/master
2020-06-20 09:23:14 +08:00
pkuliuliu acf46bafbb add Normal op 2020-06-20 09:23:13 +08:00
mindspore-ci-bot 9514b52a23 !2147 Add a callback named SummaryCollector and delete SummaryStep callback
Merge pull request !2147 from ougongchang/master
2020-06-20 09:19:10 +08:00
panyifeng 3c2057297e support multi param for tuple grad 2020-06-20 08:39:42 +08:00
hesham e981c67acd Python Tokenizer
!38 Synchronize with latest Ascend software suite 17 Jun 2020
Merge pull request !38 from yanghaoran/master
2020-06-19 19:57:11 -04:00
hesham 674415f7be Cleanup work for Concate, Mask, Slice, PadEnd and TruncatePair 2020-06-19 19:11:50 -04:00
mindspore-ci-bot bc4b1c2460 !2373 Comments + improved casting/parameters + UT tests for 3 AugOps (Augmentation Ops RandomCropWithBBox, Random Vertical FlipWithWithBBox and Random CropAndResizeWithWithBBox)
Merge pull request !2373 from danishnxt/AugOpsD1
2020-06-20 05:19:03 +08:00
mindspore-ci-bot 7bdcc319b2 !2325 Addressing comments from PR2314
Merge pull request !2325 from imaaamin/object_ops_pr2
2020-06-20 04:50:56 +08:00
Danish Farid 6442a85b75 comments added, ptrs to consts, UT tests for BBOps
updated comments for 3 BB AugOps

addressing comments, void -> status, macros added, fixed test cmt

changed types -> value, fixed ut test funcs, grammar

bug type fix

fixed condition in tests for viz
2020-06-19 16:09:16 -04:00
islam_amin edc42c5b85 addressed comments from reviews 2020-06-19 14:53:46 -04:00
nhussain d89101b95f add missing test 2020-06-19 11:44:41 -04:00
chenzomi c268c88220 aware quantization training auto create graph 2020-06-19 22:01:16 +08:00
ougongchang 939cd29d7e Add a callback named SummaryCollector and delete SummaryStep callback
I added a SummaryCollector to help users automatically collect information
such as the network, loss, learning rate and so on, making it easier to collect this information.

It also can collect train lineage and eval lineage information which is
collected by TrainLineage Callback and EvalLineage Callback in
MindInsight.

I also add some UT for SummaryCollect to keep the code correct.
2020-06-19 21:07:55 +08:00
mindspore-ci-bot 21c67eddd5 !1897 save print data to file
Merge pull request !1897 from jinyaohui/print
2020-06-19 17:50:34 +08:00
yanghaitao 9f336bb735 fix TextFileDataset and CLUEDataset failed with to_device 2020-06-19 17:28:05 +08:00
jinyaohui ac23a179bf save print data to file 2020-06-19 17:25:22 +08:00
mindspore-ci-bot 2d6d3cc86b !2339 support catch IndexError in C++
Merge pull request !2339 from zhangbuxue/support_catch_index_error_in_c++
2020-06-19 15:28:18 +08:00
mindspore-ci-bot 8867c67d61 !1935 Summary callback as collector for summary and lineage
Merge pull request !1935 from 李鸿章/policy_writer
2020-06-19 14:53:14 +08:00
mindspore-ci-bot 9958bc479a !2161 [qat]Export network from quantization aware network to deploy
Merge pull request !2161 from vlne-v1/I1IZV3-quant-infer
2020-06-19 14:16:00 +08:00
mindspore-ci-bot 06b511ca94 !2301 add sparse proximal ada grad optimizer
Merge pull request !2301 from lilei/sparse_proximal_ada_grad
2020-06-19 14:07:50 +08:00
Li Hongzhang 0921c1e538 enhance the SummaryRecord with set_mode and add_value 2020-06-19 13:03:00 +08:00
buxue 2c9ca199ad support catch IndexError in C++ 2020-06-19 12:13:18 +08:00
Wei Luning 1d77bf86a9 Exports MindSpore quant predict model to deploy with GEIR 2020-06-19 10:21:35 +08:00
lilei 497067d7b2 add sparse proximal ada grad optimizer 2020-06-19 09:56:28 +08:00
peilinwang 1e36b0649f remove graphengine changes
remove graphengine changes

concat op

Truncate Pair

concat_op

remove graph engine changes

ToNumberOp implementation almost done

ToNumberOp complete

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

merge conflicts
2020-06-18 20:07:35 -04:00
hesham 11826fb256 DuplicateOp 2020-06-18 19:47:27 -04:00
mindspore-ci-bot 90bb9320aa !2314 Implemented RandomHorizontalFlipWithBBox and BoundingBoxAugment C++ Ops
Merge pull request !2314 from imaaamin/object_ops_pr
2020-06-19 07:08:42 +08:00
mindspore-ci-bot a83baafbf6 !2253 Add ConcatOp to Dataset
Merge pull request !2253 from nhussain/concat_op
2020-06-19 06:32:15 +08:00
mindspore-ci-bot 3784220056 !2317 rework on dataset.text.vocab to support any user special_tokens
Merge pull request !2317 from ZiruiWu/vocab_rework
2020-06-19 05:25:31 +08:00
nhussain 5515016dba remove graphengine changes
remove graphengine changes

concat op

Truncate Pair

concat_op

remove graph engine changes
2020-06-18 17:17:50 -04:00
mindspore-ci-bot ffc8a3c362 !2274 add PadEndOp
Merge pull request !2274 from xunxue/padend
2020-06-19 05:05:14 +08:00
mindspore-ci-bot e4322baece !2316 [Dataset] Move python tree transformation into cpp pass
Merge pull request !2316 from JunhanHu/alter_node_cpp
2020-06-19 05:02:03 +08:00
islam_amin 0af156d169 added two ops for object detection, random horizontal flip with bbox and bouding box augment. along with their unit tests 2020-06-18 16:55:31 -04:00
xunxue 87aa9c8f7a PadEndOp 2020-06-18 16:07:34 -04:00
Junhan Hu 57f3732ac3 Move python tree transformation into cpp pass. 2020-06-18 15:52:38 -04:00
Zirui Wu b6e9504b31 phase I of Vocab rework
phase II vocab rework

added more test cases

fix api doc string

address review cmts and fix CI

address ci complains

fix review cmts

ci
2020-06-18 15:36:28 -04:00
Zirui Wu 8f2674850b address API doc style and content
addr review cmts

revert

ci

private class

ci

fix ci

address ci

address review cmts

fix style err
2020-06-18 12:23:42 -04:00
mindspore-ci-bot c0fe8c0322 !2273 [AutoParallel]update EmbeddingLookUp op
Merge pull request !2273 from lichen/fix_embeding_look_up
2020-06-18 21:07:52 +08:00
mindspore-ci-bot 5850b99161 !2211 Add TruncatePair Op to dataset
Merge pull request !2211 from h.farahat/pair_truncate
2020-06-18 20:58:40 +08:00
lichenever 563622874a update 2020-06-18 19:45:40 +08:00
mindspore-ci-bot d0c5071cab !1993 [Dataset] Fix codedex.
Merge pull request !1993 from luoyang/pylint
2020-06-18 18:59:31 +08:00
mindspore-ci-bot 2ecd5bdf25 !2239 [MD] convert csv to mindrecord
Merge pull request !2239 from liyong126/csv_to_mindrecord
2020-06-18 18:56:33 +08:00
mindspore-ci-bot d9b8da14e2 !2275 [Auto parallel] Changing bprob of EmbeddingLookup
Merge pull request !2275 from Xiaoda/4-fix-the-embeddinglookup-errors
2020-06-18 18:08:19 +08:00
mindspore-ci-bot 9b90d89f6b !2276 fix eliminate get ref parameter
Merge pull request !2276 from fary86/fix_eliminate_get_ref
2020-06-18 17:14:26 +08:00
fary86 15b3fba0ef Fix eliminate get ref parameter 2020-06-18 16:10:53 +08:00