初始化项目,由ModelHub XC社区提供模型
Model: DarkArtsForge/Asmodeus-24B-v2 Source: Original Platform
This commit is contained in:
12
imatrix_quant_command.txt
Normal file
12
imatrix_quant_command.txt
Normal file
@@ -0,0 +1,12 @@
|
||||
Generate imatrix:
|
||||
llama-imatrix -m input.gguf -f training_data.txt -o imatrix.dat
|
||||
|
||||
Use imatrix:
|
||||
llama-quantize --imatrix imatrix.dat input.gguf output_iq4.gguf IQ4_XS
|
||||
|
||||
|
||||
Generate imatrix:
|
||||
llama-imatrix -m input.gguf -f illuminati_imatrix_v1.txt -o illuminati_imatrix_v1.dat
|
||||
|
||||
Use imatrix:
|
||||
llama-quantize --imatrix illuminati_imatrix_v1.dat input.gguf B:\24B\DarkArtsForge__Asmodeus-24B-v2\output_iq4_xs.gguf IQ4_XS
|
||||
Reference in New Issue
Block a user