History

Laurent Mazare d01207dbf3 Add a RotatingKVCache. (#2493 ) * Add a RotatingKVCache. * Add some KvCache tests. * Test the reset too. * More kv-cache testing. * More tests for the rotating kv-cache. * Improve the api for the rotating cache so that the whole src tensor gets returned when it's overlarge. * Handle contiguity + bugfix + use in mimi. * Add a way to test the mimi streaming mode. * Mimi streaming fixes. * More rotating kv-cache. * Fix the attn mask generation. * Handle the abs case. * Add some tests for the generated mask.		2024-09-23 13:14:32 +02:00
..
examples	Add a RotatingKVCache. (#2493 )	2024-09-23 13:14:32 +02:00
src	MobileCLIP models S1 and S2 (#2454 )	2024-08-29 15:38:58 +02:00
Cargo.toml	Add the mimi audio-tokenizer. (#2488 )	2024-09-20 14:31:20 -06:00
README.md	Add some missing readme files. (#304 )	2023-08-02 10:57:12 +01:00
build.rs	Pin the revision used for phi-v2 + make it the default. (#1572 )	2024-01-12 09:19:30 +01:00

README.md

candle-examples