sfqcyy
/
mindspore
forked from OSSInnovation/mindspore
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
10,946 Commits 7 Branches 0 Tags 311 MiB
Commit Graph

183 Commits

Author SHA1 Message Date
chenhaozhe e1f4c066b3 fix loss print in bert and corresponding downstream task 2020-09-14 17:14:39 +08:00
mindspore-ci-bot aa16811ba5 !6139 fix hccl environ in get_distribute_pretrain_cmd.py 
Merge pull request !6139 from chenhaozhe/fix-hccl-env
 2020-09-14 14:45:55 +08:00
mindspore-ci-bot 144998894f !6057 transformer bucket batch modification 
Merge pull request !6057 from yuchaojie/transformer2
 2020-09-14 14:21:15 +08:00
root ec947ebf3d modify the ckpt path 2020-09-14 11:27:54 +08:00
chenhaozhe 4e587420c0 fix hccl environ in get_distribute_pretrain_cmd.py 2020-09-14 10:48:12 +08:00
yuchaojie fa1247a85e transformer bucket batch modification 2020-09-14 09:52:34 +08:00
chenhaozhe 91c65a734a fix some doc error 2020-09-12 18:19:00 +08:00
mindspore-ci-bot 326feab42f !6067 Generate cmd file for distributed_pretrain in bert scripts 
Merge pull request !6067 from chenhaozhe/fix-bert-codex
 2020-09-12 14:53:26 +08:00
mindspore-ci-bot 1bcffd29dd !6066 transformer loss fix. 
Merge pull request !6066 from linqingke/fasterrcnn
 2020-09-12 14:24:36 +08:00
mindspore-ci-bot d8c09067ce !5801 [MD][Feature] minddata iterator output ms_tensor 
Merge pull request !5801 from xiefangqi/md_modify_output_tensor
 2020-09-11 20:19:06 +08:00
chenhaozhe 28cb0da168 remove os.system in launch scripts 2020-09-11 17:16:08 +08:00
linqingke bab4757904 transformer loss fix. 2020-09-11 17:00:25 +08:00
xiefangqi 9b3c33e157 minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
mindspore-ci-bot be62fd7fa6 !5768 Save the GPU backend multi card output in different folders. 
Merge pull request !5768 from linqingke/fasterrcnn
 2020-09-11 11:05:04 +08:00
nhussain 92e99ff224 change map calls 2020-09-10 10:25:05 -04:00
mindspore-ci-bot eedbbb3649 !5958 Modify interface for function and remove duplicated def 
Merge pull request !5958 from lilei/modify_bug
 2020-09-10 21:22:32 +08:00
wangnan39@huawei.com fdac02feed delete DataWrapper and optim Model 2020-09-10 18:47:37 +08:00
linqingke 845ff342ed Save the GPU backend multi card output in different folders. 2020-09-10 16:04:28 +08:00
mindspore-ci-bot 994cfcb8a0 !5914 edit bert hub config file and tinybert script bugfix 
Merge pull request !5914 from yoonlee666/master
 2020-09-10 09:20:00 +08:00
lilei 71adabd944 modify_bug 2020-09-09 18:20:32 +08:00
mindspore-ci-bot cd07acc8a4 !5903 add set_grad() for pynative mode in model_zoo networks 
Merge pull request !5903 from lvchangquan/master
 2020-09-09 14:48:47 +08:00
yoonlee666 16c2c17436 edit bert hub config 2020-09-09 09:12:59 +08:00
nhussain 3bac9d3713 switch input columns and operation 
change ImagefolderDV2 name

change ds.transforms.vision to ds.vision

change batch api to match map api more closely

compose op changes

test_pylint

remove compose op from vision, move to transform module, refactor map and batch to use column_order
 2020-09-08 10:26:20 -04:00
lvchangquan 7abe692fb5 add set_grad() for pynative mode in model_zoo network 2020-09-08 19:30:31 +08:00
mindspore-ci-bot 947247bbc5 !5888 add bert hub config 
Merge pull request !5888 from yoonlee666/master
 2020-09-08 17:41:16 +08:00
yoonlee666 0a2f472578 add hub config for bert base and nezha 2020-09-08 15:08:48 +08:00
ZPaC 87bf2a7dcd Add PS context. 2020-09-08 14:06:58 +08:00
mindspore-ci-bot ad186e79d8 !5599 Collect input data when `dataset_sink_mode` set on GPU 
Merge pull request !5599 from LiHongzhang/dataset_sink_mode
 2020-09-08 10:21:33 +08:00
Li Hongzhang 066950f69e GPU dataset_sink_mode collect inputs 2020-09-07 17:12:36 +08:00
lichenever f2d3fd34ce rectification_allreduce_fusion_api 2020-09-07 16:38:58 +08:00
yao_yf d4cfe55c04 rename mirror_mean to gradients_mean 2020-09-04 14:47:36 +08:00
linqingke 4d9d8c3e74 Modelzoo interface change. 2020-09-04 11:37:24 +08:00
mindspore-ci-bot 1cd4ac2ad4 !5708 support startup script of bert_thor with relative path 
Merge pull request !5708 from wangmin0104/master
 2020-09-04 09:38:36 +08:00
mindspore-ci-bot a50bc2182e !5665 delete enable_fused_layernorm 
Merge pull request !5665 from yoonlee666/bugfix
 2020-09-03 21:21:46 +08:00
mindspore-ci-bot fc79997de5 !5502 Mod SoftmaxCrossEntropyWithlogits 
Merge pull request !5502 from wanyiming/mod_SoftmaxCrossEntropyWithlogits
 2020-09-03 20:24:43 +08:00
wanyiming 0ec70068ae mod_SoftmaxCrossEntropyWithLogits 2020-09-03 17:33:20 +08:00
wangmin d63b1f16bd support startup bert_thor script with relative path 2020-09-03 16:47:06 +08:00
yoonlee666 dfd85caa1b delete enable_fused_layernorm 2020-09-03 11:40:38 +08:00
mindspore-ci-bot 4ec343961e !5482 modify save_checkpoint 
Merge pull request !5482 from liuyang/md_save_checkpoint
 2020-09-02 14:20:48 +08:00
mindspore-ci-bot 76694059a2 !5639 fix bug of bert_thor and update readme.md 
Merge pull request !5639 from wangmin0104/master
 2020-09-01 22:14:39 +08:00
mindspore-ci-bot 44a9c25251 !5632 Add clip_by_global_nrom in bert 
Merge pull request !5632 from chenhaozhe/add-global-norm-to-bert
 2020-09-01 21:32:23 +08:00
wangmin d24ce34c36 fix bug of bert_thor 2020-09-01 20:59:15 +08:00
chenhaozhe ac95836257 add global norm in bert 2020-09-01 19:01:13 +08:00
jonyguo f08a05975e fix: data_tpye var error 2020-09-01 17:28:09 +08:00
jonyguo 314fef8ecc fix: arg_opt is not defined 2020-09-01 10:08:32 +08:00
mindspore-ci-bot d5e02cf474 !5584 delete the redundant argument while initializing the class of GradOperation 
Merge pull request !5584 from shibeiji/master
 2020-09-01 09:32:49 +08:00
shibeiji d57960ed4c delete the redundant argument while initializing class of GradOperation 2020-08-31 18:50:29 +08:00
liuyang_655 4683de3443 modify save_checkpoint 2020-08-31 16:24:57 +08:00
yoonlee666 ff4e02a09d bert script bugfix 2020-08-31 15:16:40 +08:00
mindspore-ci-bot 3f1e05881d !5474 bert script bugfix 
Merge pull request !5474 from yoonlee666/bugfix
 2020-08-29 17:34:08 +08:00
yoonlee666 954f53da9e enhancement 2020-08-29 15:09:24 +08:00
mindspore-ci-bot e6a4d932b4 !5350 [AutoParallel]Rectification distributed init 
Merge pull request !5350 from lichen/rectification_init
 2020-08-29 14:55:18 +08:00
lichenever d3e55b543e rectification init 2020-08-29 09:34:58 +08:00
mindspore-ci-bot c247f5cdbf !5325 add schema file introduce for BERT and TinyBERT 
Merge pull request !5325 from wanghua/master
 2020-08-29 09:12:15 +08:00
mindspore-ci-bot be13688e29 !5431 update lstm readme 
Merge pull request !5431 from caojian05/ms_lstm_readme_update
 2020-08-28 19:46:51 +08:00
wanghua f347d1c9e7 add schema for BERT and TinyBERT 2020-08-28 17:54:12 +08:00
CaoJian c465f2bf5c update lstm readme 2020-08-28 16:44:15 +08:00
mindspore-ci-bot 820f2cb4eb !5351 move ParalleMode to Context 
Merge pull request !5351 from yao_yf/parallel_context_collation
 2020-08-28 16:13:01 +08:00
yao_yf 07117e4dd4 mv ParallelMode to context 2020-08-28 19:13:55 +08:00
mindspore-ci-bot a8c5dfae3b !4957 lstm readme 
Merge pull request !4957 from chenweifeng/lstm-readme
 2020-08-28 15:26:52 +08:00
wilfChen 734993e21a lstm readme 2020-08-28 14:54:03 +08:00
mindspore-ci-bot f3fc24c82a !5368 fix sink_size bug for transformer 
Merge pull request !5368 from yuchaojie/transformer_st
 2020-08-28 11:12:43 +08:00
yuchaojie 9fb6f0c34b fix sink_size bug for transformer 2020-08-28 09:08:45 +08:00
jonyguo fe016d321c update tiny bert script and readme 2020-08-27 21:57:34 +08:00
mindspore-ci-bot 7127304c67 !4814 support minddateset for tinybert 
Merge pull request !4814 from dengyutao/tinybert
 2020-08-27 20:12:47 +08:00
mindspore-ci-bot 586d6673b3 !5307 change enable_data_sink value to true for transformer 
Merge pull request !5307 from yuchaojie/transformer2
 2020-08-27 19:48:11 +08:00
mindspore-ci-bot e4909f9050 !5277 add option choices for transformer 
Merge pull request !5277 from yuchaojie/transformer_st
 2020-08-27 19:47:38 +08:00
yuchaojie 15b366307e change enable_data_sink value to true for transformer 2020-08-27 16:29:40 +08:00
mindspore-ci-bot df9d67c0dc !5235 add tinybert gpu readme 
Merge pull request !5235 from hanhuifeng/tinybert_readme
 2020-08-27 14:52:01 +08:00
yuchaojie 48efc182e0 change option choices for transformer 2020-08-27 10:00:41 +08:00
mindspore-ci-bot 92e2d21ea4 !5088 Fix MASS and FasterRcnn CI Problem. 
Merge pull request !5088 from linqingke/mass
 2020-08-27 09:30:58 +08:00
hanhuifeng2020 fbafedf135 add tinybert gpu readme 2020-08-26 15:41:07 +08:00
dengyutao 4e0447b05e support minddataset for tinybert 2020-08-26 11:30:42 +08:00
panyifeng 1a54785fe2 remove name arg from gradoperation 2020-08-26 11:16:57 +08:00
shibeiji 40fc11e9a4 Mimic higher batch size by accumulating gradients N times before weight update 2020-08-25 11:04:26 +08:00
linqingke ad8b98b476 fix fasterrcnn and mass bug. 2020-08-25 09:52:45 +08:00
wanghua a40cc12fae modify BERT and TinyBERT README.md 2020-08-24 18:54:24 +08:00
mindspore-ci-bot 6511491a7c !4691 Fix MASS and FasterRcnn README. 
Merge pull request !4691 from linqingke/new_ops
 2020-08-21 09:53:29 +08:00
wangmin e6be30a094 modify ReadMe 2020-08-20 16:43:23 +08:00
zongha 91accd1ed4 for readme modify 2020-08-19 18:04:08 +08:00
linqingke 642d48e9dd fix floordiv and iou ops. 2020-08-19 09:04:22 +08:00
mindspore-ci-bot 4815dcbb1d !4517 The teacher use fp16 calculations to imporve the performance of tinybert on gpu 
Merge pull request !4517 from hanhuifeng/tinybert_gpu_perf
 2020-08-18 15:11:18 +08:00
mindspore-ci-bot 7cec00b491 !4577 Optimize the print of bert 
Merge pull request !4577 from chenhaozhe/optimize-print-of-bert
 2020-08-18 11:03:03 +08:00
mindspore-ci-bot cc9bd8a3e5 !4182 add_tf_and_ms_checkpoint_transfer_tools 
Merge pull request !4182 from Guomenghao319/add_tf_and_ms_checkpoint_transfer_tools
 2020-08-18 10:44:26 +08:00
chenzomi bb125cb309 change unsupport to unsupported 2020-08-17 20:37:09 +08:00
chenhaozhe fa10a4e483 optimize print of bert scripts' 2020-08-17 20:03:31 +08:00
hanhuifeng2020 9e2b38c961 The teacher use fp16 calculations to optimize the performance of tinybert on the gpu 2020-08-17 15:01:01 +08:00
mindspore-ci-bot 510ae7c88c !4500 [net] update transformer README 
Merge pull request !4500 from yuchaojie/transformer_st
 2020-08-15 18:10:49 +08:00
mindspore-ci-bot df8fcef457 !4412 MASS support running on GPU. 
Merge pull request !4412 from linqingke/mass
 2020-08-15 18:10:26 +08:00
yuchaojie 3c1e7011e0 update transformer readme 2020-08-15 15:38:28 +08:00
mindspore-ci-bot eb4749642d !4460 update the codes of bert_thor 
Merge pull request !4460 from zongha/master
 2020-08-14 19:06:49 +08:00
zongha da142ccfd3 modify the codes for bert_thor 
2nd for update thor bert
 2020-08-14 17:36:34 +08:00
linqingke a1347264f7 mass add gpu support. 2020-08-14 11:54:21 +08:00
yao_yf cbb4363fa7 remove to_full_tensor and load_inputs in exexute stage 2020-08-14 11:40:27 +08:00
mindspore-ci-bot 881fc135bf !4187 tinybert script suit for gpu 
Merge pull request !4187 from hanhuifeng/tinybert_suit_gpu
 2020-08-12 10:26:19 +08:00
yoonlee666 32846d791b bugfix bert script 2020-08-11 14:40:06 +08:00
mindspore-ci-bot 1f7d72dd2a !4227 fix pylint warning in model_zoo 
Merge pull request !4227 from panbingao/pylintfix
 2020-08-11 14:17:45 +08:00
hanhuifeng2020 1756d084ab tinybert script suit for gpu 2020-08-10 20:00:07 +08:00
panbingao 3f60bf6dfe fix pylint warnings in model_zoo 2020-08-10 19:44:41 +08:00
yoonlee666 a5ac2427a7 bugfix bert script 2020-08-10 16:40:40 +08:00