louis_lifu
/
vllm
mirror of https://github.com/vllm-project/vllm
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

[FIX] Fix prefix test error on main (#3286)

This commit is contained in:
Zhuohan Li 2024-03-08 17:16:14 -08:00 committed by GitHub
parent c2c5e0909a
commit f48c6791b7
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 0 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
vllm/model_executor/layers/attention/backends/flash_attn.py
View File

@ -103,8 +103,6 @@ class FlashAttentionBackend:
key_cache,
value_cache,
input_metadata,
self.num_heads,
self.num_kv_heads,
self.alibi_slopes,
)
else: