5 Commits

Author	SHA1	Message	Date
CHU Tianxiang	0fbfc4b81b	Add GPTQ support (#916)	2023-12-15 03:04:22 -08:00
Mingcan Xiang	614856da25	Avoid multiple redefinition (#1817)	2023-12-14 09:35:58 -08:00
wbn	dacaf5a400	Replace head_mapping params with num_kv_heads to attention kernel. (#1997) ... Co-authored-by: wangguoya <wangguoya@baidu.com> Co-authored-by: Yang Zhao <zhaoyangstar@foxmail.com>	2023-12-10 10:12:53 -08:00
TJian	6ccc0bfffb	Merge EmbeddedLLM/vllm-rocm into vLLM main (#1836) ... Co-authored-by: Philipp Moritz <pcmoritz@gmail.com> Co-authored-by: Amir Balwel <amoooori04@gmail.com> Co-authored-by: root <kuanfu.liu@akirakan.com> Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com> Co-authored-by: kuanfu <kuanfu.liu@embeddedllm.com> Co-authored-by: miloice <17350011+kliuae@users.noreply.github.com>	2023-12-07 23:16:52 -08:00
Yanming W	e0c6f556e8	[Build] Avoid building too many extensions (#1624)	2023-11-23 16:31:19 -08:00