Commit Graph

275 Commits

Author SHA1 Message Date
zhaoting d421f49e60 delete redundant codes 2020-09-17 17:44:36 +08:00
Ziyan 8ea177e614 fix_api_problems 2020-09-17 11:32:13 +08:00
wangmin d9e84e468b remove rm -rf in testcase of bert_thor 2020-09-16 19:58:48 +08:00
mindspore-ci-bot 3671244ff8 !6233 move batch_size from bert_cfg_cfg to cfg
Merge pull request !6233 from yoonlee666/master
2020-09-16 14:51:06 +08:00
wangmin d96ecd2740 add st for bert_thor 2020-09-16 10:04:29 +08:00
yoonlee666 528072f45f move batch_size from bert_cfg_cfg to cfg 2020-09-16 09:46:38 +08:00
anzhengqi 8e1a2ef5ae stop send data to device after end of sequence 2020-09-15 15:02:37 +08:00
nhussain 92e99ff224 change map calls 2020-09-10 10:25:05 -04:00
mindspore-ci-bot eedbbb3649 !5958 Modify interface for function and remove duplicated def
Merge pull request !5958 from lilei/modify_bug
2020-09-10 21:22:32 +08:00
mindspore-ci-bot 55372b41fd !5908 delete DataWrapper in Model to unify the expression of dataset sinking
Merge pull request !5908 from wangnan39/optim_datawrapper_in_model
2020-09-10 19:33:26 +08:00
wangnan39@huawei.com fdac02feed delete DataWrapper and optim Model 2020-09-10 18:47:37 +08:00
Yi Huaijie a836d25c64 change API set_strategy() to shard() 2020-09-10 15:30:19 +08:00
lilei 71adabd944 modify_bug 2020-09-09 18:20:32 +08:00
xiefangqi d0410d6191 md delete set_dataset_size interface 2020-09-09 09:56:03 +08:00
nhussain 3bac9d3713 switch input columns and operation
change ImagefolderDV2 name

change ds.transforms.vision to ds.vision

change batch api to match map api more closely

compose op changes

test_pylint

remove compose op from vision, move to transform module, refactor map and batch to use column_order
2020-09-08 10:26:20 -04:00
mindspore-ci-bot ad186e79d8 !5599 Collect input data when `dataset_sink_mode` set on GPU
Merge pull request !5599 from LiHongzhang/dataset_sink_mode
2020-09-08 10:21:33 +08:00
Li Hongzhang 066950f69e GPU dataset_sink_mode collect inputs 2020-09-07 17:12:36 +08:00
lichenever f2d3fd34ce rectification_allreduce_fusion_api 2020-09-07 16:38:58 +08:00
wangmin b035890128 allreduce fusion 2020-09-04 17:28:07 +08:00
yao_yf d4cfe55c04 rename mirror_mean to gradients_mean 2020-09-04 14:47:36 +08:00
mindspore-ci-bot a50bc2182e !5665 delete enable_fused_layernorm
Merge pull request !5665 from yoonlee666/bugfix
2020-09-03 21:21:46 +08:00
mindspore-ci-bot fc79997de5 !5502 Mod SoftmaxCrossEntropyWithlogits
Merge pull request !5502 from wanyiming/mod_SoftmaxCrossEntropyWithlogits
2020-09-03 20:24:43 +08:00
wanyiming 0ec70068ae mod_SoftmaxCrossEntropyWithLogits 2020-09-03 17:33:20 +08:00
yoonlee666 dfd85caa1b delete enable_fused_layernorm 2020-09-03 11:40:38 +08:00
jinyaohui a9972a7def optim pylint 2020-08-31 14:49:57 +08:00
yao_yf 07117e4dd4 mv ParallelMode to context 2020-08-28 19:13:55 +08:00
panyifeng 1a54785fe2 remove name arg from gradoperation 2020-08-26 11:16:57 +08:00
panyifeng 637e812347 remove global grad ops 2020-08-24 16:50:09 +08:00
yoonlee666 eb46d5cc19 split ci cases 2020-08-20 19:48:19 +08:00
chenzomi bb125cb309 change unsupport to unsupported 2020-08-17 20:37:09 +08:00
yao_yf cbb4363fa7 remove to_full_tensor and load_inputs in exexute stage 2020-08-14 11:40:27 +08:00
panyifeng 34e50e5d6e fix cell bprop 2020-08-07 10:57:01 +08:00
Wei Luning d4d6457ea7 init parameter data by defaultOnly keep no data as MetaTensor in auto parallel mode 2020-08-06 19:52:31 +08:00
mindspore-ci-bot 1c6ddf70b6 !4043 add serving st
Merge pull request !4043 from hexia/serving_st
2020-08-06 16:15:11 +08:00
hexia 7f514a07e8 serving st 2020-08-06 15:09:25 +08:00
Wei Luning a05c38bb63 make python Parameter inherit from Tensor 2020-08-03 09:12:24 +08:00
chenhaozhe ef7ea3b92d fix bert performance test case 2020-07-25 15:52:04 +08:00
mindspore-ci-bot d21871a4fe !3375 add bert ci script
Merge pull request !3375 from yoonlee666/bertci
2020-07-25 09:43:04 +08:00
yoonlee666 4c167e3085 add bert ci script 2020-07-24 22:04:40 +08:00
panfengfeng 939e612906 fix get daataset size error 2020-07-24 21:45:42 +08:00
Wei Luning 484d7f10c8 refine code* refine code in bert model* add ToAbstruct for `FuncGraph`, `MetaFuncGraph` `Primitive`* remove partial hard code in spec for poly* remove any in data convert cache 2020-07-23 12:43:37 +08:00
lizhenyu c67e562373 refine GPU memory swap performance 2020-07-21 21:37:54 +08:00
wangnan39@huawei.com 082433183d uniform learning_rate behavior of optimizers 2020-07-20 21:09:20 +08:00
anzhengqi 008b91b2a1 inject epoch ctrl op in the execution tree and send eos at the end of epoch 2020-07-20 13:02:47 +08:00
mindspore-ci-bot 6f8863b65d !3198 synchronize latest Ascend software suite 18 Jul 2020, and merging branches
Merge pull request !3198 from yanghaoran/code_sync_0718
2020-07-19 14:14:45 +08:00
Wei Luning 88e864a4a3 remove loop can unroll flag, clean some python usage 2020-07-18 17:41:34 +08:00
changzherui f4cb445ea8 syn code for 0715 2020-07-16 17:18:21 +08:00
yanghaoran 00749914a4 remove testcase 2020-07-15 15:41:18 +08:00
mindspore-ci-bot 48654be14d !3040 BoundingBoxAugment op fix ratio
Merge pull request !3040 from islam_amin/bounding_box_augment_bugs
2020-07-14 09:36:34 +08:00
panbingao 45dbc8bf04 Move model_zoo.resnet.py 2020-07-10 17:36:34 +08:00
duxiutao 1e43c609e0 Add test case and fix two bugs
1. add case to guard precision
2. fix a shape bug
3. fix a funcGraph bug
2020-07-02 12:52:15 +08:00
zhaoting 0dc8a42bd1 fix resnet st group params bug 2020-06-30 11:00:53 +08:00
mindspore-ci-bot c22c865c4a !1950 [front]add `has_effect` direct to target construct method not cell object
Merge pull request !1950 from vlne-v1/move-flags-to-construct
2020-06-24 09:35:24 +08:00
Wei Luning 8f56528f8c add flags on function 2020-06-23 20:22:07 +08:00
Ziyan 41ddc153a6 modify lars interface 2020-06-23 11:23:28 +08:00
mindspore-ci-bot f469c6cf2e !2397 change acc threshold of test_resnet_imagenet
Merge pull request !2397 from zhaoting/ResNet50_st
2020-06-20 18:55:13 +08:00
mindspore-ci-bot 748b0b1b64 !2388 GPU update bert scripts
Merge pull request !2388 from VectorSL/bert-eval
2020-06-20 15:26:21 +08:00
zhaoting 9d9c35d1ee change acc threshold of test_resnet_imagenet 2020-06-20 12:18:20 +08:00
VectorSL b2412ea571 gpu update bert scripts 2020-06-20 12:00:40 +08:00
chenzomi c268c88220 aware quantization training auto create graph 2020-06-19 22:01:16 +08:00
mindspore-ci-bot 1424178601 !1663 change lenet and alexnet dir
Merge pull request !1663 from wukesong/change_network_path
2020-06-19 09:45:19 +08:00
mindspore-ci-bot b7b4333d13 !2272 remove dataset send from data exec
Merge pull request !2272 from wangnan39/remove_dataset_send_from_model_init
2020-06-19 09:33:12 +08:00
wangnan39@huawei.com 887838d452 do not send the data during the model init 2020-06-18 22:18:41 +08:00
wukesong 7dfd369998 modify lenet&alexnet dir 2020-06-18 20:45:46 +08:00
mindspore-ci-bot 90e05579c8 !2197 Change acc threshold of test_resnet_imagenet
Merge pull request !2197 from zhaoting/ResNet50_st
2020-06-18 14:53:00 +08:00
zhaoting c083089e7e change acc threshold of test_resnet_imagenet 2020-06-18 14:13:22 +08:00
mindspore-ci-bot 0c3d96a98b !2236 Refactor the callback module in an encapsulated way
Merge pull request !2236 from 李鸿章/callback
2020-06-18 12:09:19 +08:00
Li Hongzhang ecc459158e callback module in encapsulated 2020-06-17 17:01:44 +08:00
mindspore-ci-bot cef901fe0d !2069 Fix input value check for Momentum, SparseApplyFtrl and SparseApplyAdagrad.
Merge pull request !2069 from liuxiao/fix-input-value-check-for-SparseApplyFtrl-and-SparseApplyAdaGrad
2020-06-17 16:37:18 +08:00
李鸿章 ee438aaf4a callback as context manager 2020-06-17 14:07:52 +08:00
liuxiao df63a3195d fix input value check for SparseApplyFtrl and SparseApplyAdagrad 2020-06-17 13:05:09 +08:00
ougongchang 1ffa37ffbc Add a callback module to avoid the size of the callback.py file to large 2020-06-17 09:54:58 +08:00
mindspore-ci-bot 792d1a444c !1899 add resnet50_imagenet 8p st
Merge pull request !1899 from zhaoting/ResNet50_st
2020-06-16 22:09:42 +08:00
zhaoting 429c88a462 add resnet50 imagenet st 2020-06-16 22:04:24 +08:00
mindspore-ci-bot 34790387e3 !2088 fix pylint
Merge pull request !2088 from z00378171/master
2020-06-15 20:42:16 +08:00
mindspore-ci-bot 971f10d222 !1790 remove transdata only connected with control depend
Merge pull request !1790 from lianliguang/remove-the-useless-transdata-connected-with-the-control-depend
2020-06-15 16:59:33 +08:00
WilliamLian b86016a26f remove the useless transdata and cast of control depend node 2020-06-15 14:54:47 +08:00
unknown f39a934a77 fix pylint 2020-06-13 21:58:52 +08:00
mindspore-ci-bot e33ecf310a !2052 Update CI test for deeplabv3
Merge pull request !2052 from z00378171/master
2020-06-13 16:55:11 +08:00
unknown ac2e2f9a7a updata deeplabv3 CI 2020-06-13 16:11:03 +08:00
buxue 66bbdb4a31 change tensor dtype and shape from function to attr 2020-06-12 19:03:23 +08:00
mindspore-ci-bot d9c7a8400e !1933 edit bert example scripts
Merge pull request !1933 from yoonlee666/edit-example
2020-06-10 11:04:00 +08:00
yanghaoran 8da4c1a763 synchronize latest ascend software 04 Jun 2020 2020-06-09 23:34:13 +08:00
yoonlee666 ab36f3d3cd edit example script 2020-06-09 20:59:32 +08:00
chenhaozhe 1be7ad52bb fix bert scripts 2020-06-08 19:23:36 +08:00
jinyaohui 5e43edc474 clean pylint 2020-06-04 21:03:30 +08:00
wanghua 3f536ea1b7 add bert performance test case 2020-06-02 19:53:38 +08:00
mindspore-ci-bot 692f38ded2 !1532 clean pylint warning in test dir
Merge pull request !1532 from jinyaohui/pylint1
2020-05-30 10:13:45 +08:00
jinyaohui 86d197dfeb clean pylint 2020-05-29 23:00:00 +08:00
lizhenyu 9df3a8613c fix get nullptr when use graph manager 2020-05-29 21:20:50 +08:00
chenhaozhe b6aceddeab update bert scripts according to rules of modelzoo 2020-05-27 14:27:09 +08:00
mindspore-ci-bot 2e684e89e7 !1446 pylint clean
Merge pull request !1446 from liuxiao78/master
2020-05-27 14:15:14 +08:00
“liuxiao” 18f0af0529 pylint clean 2020-05-25 19:49:06 +08:00
liubuyu 107794fac9 pylint warning clean 2020-05-25 11:52:36 +08:00
zhaojichen 7c9fb3424f add epsilon parameter for layernorm 2020-05-22 05:36:39 -04:00
yoonlee666 12d9c71c83 delete dropout when prob equals 0 and adjust bert ci script 2020-05-21 22:08:36 +08:00
mindspore-ci-bot 19c200e9cc !1280 pylint clean
Merge pull request !1280 from liubuyu/master
2020-05-21 11:27:07 +08:00
liubuyu 37be555a81 pylint clean 2020-05-20 11:12:14 +08:00
wanghua 2703ac5ba4 fix bert percision problem 2020-05-19 21:01:42 +08:00
jinyaohui 5a914994ba clean pylint 2020-05-18 16:42:35 +08:00
jinyaohui bcfaff97f9 clean pylint 2020-05-18 10:31:46 +08:00
seatea 981b013f81 Fix CSE bug for some operations like `DropoutGenMask` which should not
be optimized as it will generate different values each time.
2020-05-16 18:58:43 +08:00
jinyaohui 2907cf4488 remove some context param 2020-05-16 15:07:13 +08:00
candanzg 2cc85bdc93 Support weight compile according to shape
Signed-off-by: candanzg <zhangshucheng@huawei.com>
2020-05-13 17:49:07 +08:00
jinyaohui 391a060f21 remove two context param 2020-05-12 22:11:50 +08:00
mindspore-ci-bot af7c54b12a !920 [MS][Bert]Modify example script of bert model.
Merge pull request !920 from wsc/lossscale_script
2020-05-10 13:56:08 +08:00
wsc 46c175a574 Modify example scripts of bert model 2020-05-09 18:52:40 +08:00
limingqi107 05e8d95e7f optimize the gpu context switch 2020-05-09 15:31:32 +08:00
mindspore-ci-bot 8a484dbd0b !812 [CR] add lenet train and eval st case
Merge pull request !812 from jinyaohui/train_eval
2020-05-07 18:01:21 +08:00
jinyaohui 8b49a4cf0e add lenet train eval gpu st case 2020-05-07 16:59:09 +08:00
mindspore-ci-bot 7eaed2463f !786 GPU update testcase for amp
Merge pull request !786 from VectorSL/gpu-add-test-amp
2020-04-30 14:56:59 +08:00
VectorSL 1d7fe758a0 gpu add test for amp 2020-04-30 11:44:16 +08:00
wsc d428fc1166 Modify the ST test script and example script of bert model 2020-04-28 20:51:25 +08:00
mindspore-ci-bot d7242002aa !474 [MS][bert][example]Add ST test script of bert model
Merge pull request !474 from wsc/lossscale_script
2020-04-27 09:16:16 +08:00
wsc e071f04d4b Add ST test script of bert with loss scale 2020-04-26 16:37:49 +08:00
leonwanghui ba43dbc148 Fix pylint warnings in mindspore st test module 2020-04-22 16:44:19 +08:00
kswang 83eeac9310 optimize execute order sort 2020-04-17 15:09:48 +08:00
mindspore-ci-bot 3e36982314 !99 Develop op MaxPoolWithArgMax
Merge pull request !99 from zhangbuxue/Dock_MaxPoolWithArgMax
2020-04-08 22:40:00 +08:00
buxue 7541d3b067 Develop op MaxPoolWithArgMax 2020-04-08 20:47:49 +08:00
yoonlee666 c5bfbc3556 use TFRecordDataset in bert ci script and add absolute position embedding code in bert model 2020-04-08 14:31:18 +08:00
wanghua 5b176f258b modify bert test file 2020-04-03 18:20:50 +08:00
wanghua da123c5b3e fix bert precison bug 2020-04-03 14:55:25 +08:00
xiefangqi bc4602b58e fix and remove useless import of example, st, ut 2020-04-02 22:13:36 +08:00
kswang 2dc9f632c1 add cpu st lenet 2020-03-31 21:25:48 +08:00
zhunaipan 930a1fb0a8 initial version
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
2020-03-27 22:54:54 +08:00