EngineX/xc-llm-kunlun
3
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

[dev] support AWQ/GPTQ quantization for dense models

Browse Source
This commit is contained in:
Li Wei
2025-12-24 13:45:55 +08:00
parent 75d0bdae2f
commit 6546323c71
5 changed files with 412 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
vllm_kunlun/ops/__init__.py
View File

@@ -16,4 +16,6 @@
#
import vllm_kunlun.ops.rotary_embedding
import vllm_kunlun.ops.layernorm
import vllm_kunlun.ops.layernorm
import vllm_kunlun.ops.quantization.awq
import vllm_kunlun.ops.quantization.gptq