3 Commits

Author	SHA1	Message	Date
linqingke	acde7febef	update pangu reshape and softmax performance. ... Add layer norm judge Fix layer norm name error Fix input tyoe check Fix ut test Add 3d supports	2021-09-24 09:06:16 +08:00
huanghui	ba66c0d491	add security isolate for save_graphs	2021-09-14 10:24:12 +08:00
Xiaoda Zhang	5613c0b974	add a moe implementation: ... 1) extend the Liner cell for including BatchMatMul implementation, in which the first dimension indicates the expert number; 2) implement a Switch (top1) router; 3) implement a MoE cell, which extends the FeedForward cell.	2021-09-09 11:53:42 +08:00