初始化项目,由ModelHub XC社区提供模型

Model: DarkArtsForge/Asmodeus-24B-v2
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-09-10 21:50:23 +08:00
commit 62386b7099
22 changed files with 10990 additions and 0 deletions

12
imatrix_quant_command.txt Normal file
View File

@@ -0,0 +1,12 @@
Generate imatrix:
llama-imatrix -m input.gguf -f training_data.txt -o imatrix.dat
Use imatrix:
llama-quantize --imatrix imatrix.dat input.gguf output_iq4.gguf IQ4_XS
Generate imatrix:
llama-imatrix -m input.gguf -f illuminati_imatrix_v1.txt -o illuminati_imatrix_v1.dat
Use imatrix:
llama-quantize --imatrix illuminati_imatrix_v1.dat input.gguf B:\24B\DarkArtsForge__Asmodeus-24B-v2\output_iq4_xs.gguf IQ4_XS