Commit Graph

18 Commits

Author SHA1 Message Date
yanghaoran 2d141e071d takedown testcases to ensure gate stability 2022-11-04 09:20:09 +08:00
huangxinjing 35cdc8f495 [AutoParallel]Fix batch infer error 2022-10-11 11:59:53 +08:00
huangxinjing 0e575f178d Fix activation shard error
Fix hidden activation error
2022-10-08 20:39:55 +08:00
i-robot 5dff519437
!40643 Improve the Transformer APIs
Merge pull request !40643 from huangxinjing/improve_transformer_apis
2022-09-24 03:10:37 +00:00
huangxinjing 908975d458 Impove the transforer apis
Support attention mask is None
Fix attention check
WIP in custom activation
Support attention
2022-09-23 21:57:58 +08:00
changzherui 264dccfd0d clean code for python 0918 2022-09-22 19:58:36 +08:00
huangxinjing 7bd91c0351 Fix warnning clear 2022-08-05 22:34:13 +08:00
huangxinjing 1918f058c4 Fix linear dtype 2022-06-17 10:29:46 +08:00
huangxinjing 6cea07f749 Add args check 2021-09-08 09:12:35 +08:00
yao_yf 82889ec56b fixed sparse attention 2021-08-31 16:11:56 +08:00
Zhang Qinghua a137fa1d0b Optimize the Executors routines.
- Fix the key generating.
- Distinguish the executors.
2021-08-28 17:36:12 +08:00
zhihenghu ce12c02343 Add Sparse Attention
adjut the file structure and name

Deleted extra information

Do some formatting work

Add test case and fix some document

fix imports
2021-08-28 11:50:58 +08:00
huangxinjing 62496d75f3 less the interface exposed 2021-08-25 21:22:40 +08:00
ms_yan 36a8886ca2 Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset"
This reverts commit b077aa1cab.

Revert "[feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset"

This reverts commit 4e6f7dc97d.

delete pass_registry_test.cc

comment  hiai_nlu_model_multi.pb related  line
2021-08-23 01:46:38 +08:00
djc 4e6f7dc97d [feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset 2021-08-22 13:39:37 +08:00
huangxinjing d777742904 1. Move the class to mindspore.parallel, support activation sharding 2021-08-20 14:34:10 +08:00
huangxinjing 18044aff0f 1. Add docstring, elimitate attention mask, tuple append the deocoder return layer past
split attention inputs from two into three

Add input check and modify test case

Fix check error and add check to transformer inputs

add input check to the transformers
2021-08-16 21:08:48 +08:00
huangxinjing 615d1a179d Add transformer layer 2021-07-29 11:10:43 +08:00