Cade Daniel 8437bae6ef [Speculative decoding 3/9] Worker which speculates, scores, and applies rejection sampling (#3103)		2024-03-08 23:32:46 -08:00
..
__init__.py	[Speculative decoding 2/9] Multi-step worker for draft model (#2424)	2024-01-21 16:31:47 -08:00
test_model_runner.py	Remove hardcoded `device="cuda" ` to support more devices (#2503)	2024-02-01 15:46:39 -08:00