d01207dbf3
* Add a RotatingKVCache. * Add some KvCache tests. * Test the reset too. * More kv-cache testing. * More tests for the rotating kv-cache. * Improve the api for the rotating cache so that the whole src tensor gets returned when it's overlarge. * Handle contiguity + bugfix + use in mimi. * Add a way to test the mimi streaming mode. * Mimi streaming fixes. * More rotating kv-cache. * Fix the attn mask generation. * Handle the abs case. * Add some tests for the generated mask. |
||
|---|---|---|
| .. | ||
| batch_norm.rs | ||
| group_norm.rs | ||
| kv_cache.rs | ||
| layer_norm.rs | ||
| loss.rs | ||
| one_hot.rs | ||
| ops.rs | ||
| optim.rs | ||
| rnn.rs | ||