Commit Graph

2 Commits

Author SHA1 Message Date
huanghui ba66c0d491 add security isolate for save_graphs 2021-09-14 10:24:12 +08:00
Xiaoda Zhang 5613c0b974 add a moe implementation:
1) extend the Liner cell for including BatchMatMul implementation, in
which the first dimension indicates the expert number;
2) implement a Switch (top1) router;
3) implement a MoE cell, which extends the FeedForward cell.
2021-09-09 11:53:42 +08:00