mradermacher/Alpaca-CodeLlama-3.1-8B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Alpaca-CodeLlama-3.1-8B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-24 16:57:17 +08:00
commit feaf31fe50
24 changed files with 202 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

57
.gitattributes vendored Normal file
View File

@@ -0,0 +1,57 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Alpaca-CodeLlama-3.1-8B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Alpaca-CodeLlama-3.1-8B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Alpaca-CodeLlama-3.1-8B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Alpaca-CodeLlama-3.1-8B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Alpaca-CodeLlama-3.1-8B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Alpaca-CodeLlama-3.1-8B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Alpaca-CodeLlama-3.1-8B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Alpaca-CodeLlama-3.1-8B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Alpaca-CodeLlama-3.1-8B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Alpaca-CodeLlama-3.1-8B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Alpaca-CodeLlama-3.1-8B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Alpaca-CodeLlama-3.1-8B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Alpaca-CodeLlama-3.1-8B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Alpaca-CodeLlama-3.1-8B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Alpaca-CodeLlama-3.1-8B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Alpaca-CodeLlama-3.1-8B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Alpaca-CodeLlama-3.1-8B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Alpaca-CodeLlama-3.1-8B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Alpaca-CodeLlama-3.1-8B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Alpaca-CodeLlama-3.1-8B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Alpaca-CodeLlama-3.1-8B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Alpaca-CodeLlama-3.1-8B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b9f8f4d6cc2b1232fd22a65cc80f5f6df602ae03d38cf36a6a006ecb6a00b510
size 2161972736

3
Alpaca-CodeLlama-3.1-8B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9f0da6de485a986f967013ebea90b4ea67fdd5244083c529d8922712c87315e9
size 2019628544

3
Alpaca-CodeLlama-3.1-8B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b878c7f981ba694a8d6be2dd12b21ca556a7a7a919a07e1a067e4fc217212a6a
size 2948281856

3
Alpaca-CodeLlama-3.1-8B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d238799839cb817da509d4e89674dd2088353e324a1d7f9477462c2ff51c70ef
size 2758489600

3
Alpaca-CodeLlama-3.1-8B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9e9db047f92e5cc4d52c5fe90f1d019053b60fefb771a55b7c84249d0241dc94
size 2605782528

3
Alpaca-CodeLlama-3.1-8B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4622c087bded8a7943f03d977ec92e37eef3635f207e05037f0332ef32e97bdf
size 2399213056

3
Alpaca-CodeLlama-3.1-8B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:89fc2a7d312bc91ddd58f3cb6b054253942bcf1f85701eb69f168579d6154788
size 3784824320

3
Alpaca-CodeLlama-3.1-8B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3140a3abc35e8fd4b24b1f3c3da58de9feb227a7c71be7f70b0beb0934e3c5c6
size 3682326016

3
Alpaca-CodeLlama-3.1-8B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:432f83961218be301434b940cc2c6e4e4ef3a0a9b22be8e6b35dec8c99df8dcb
size 3518748160

3
Alpaca-CodeLlama-3.1-8B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:93e5f36c9ae8a102c734ab1d5632d3c9682c03db2e8f2a02dcfbb1be9d78e1e0
size 3274913280

3
Alpaca-CodeLlama-3.1-8B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:23c8368e55eba0454d2e7e4cc0e255b5588829a2ab53985a4898f9fe4e8da88f
size 4447663616

3
Alpaca-CodeLlama-3.1-8B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e1fa709a4adc47dec96818c27f22a90f3efaabdf5859ba86cb4ae2b0d2626b63
size 3179132416

3
Alpaca-CodeLlama-3.1-8B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e186757955ab5e75cebbd706d160b5d49c7de2a68d5cccc094f2c7709f61bf4a
size 4321957376

3
Alpaca-CodeLlama-3.1-8B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6368669f9b14a0902656871fe56f24b70370b84d684af05b7ff23c1817e6fc79
size 4018918912

3
Alpaca-CodeLlama-3.1-8B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fa163eea7586d636e2505c4ab0584c36366c16603bfdcd3e8f9d3af9f8086b0f
size 3664500224

3
Alpaca-CodeLlama-3.1-8B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7696b9bba75f182a71fe88207b7f35c5a570ce1e4ae05153c42388a869271e67
size 4675892736

3
Alpaca-CodeLlama-3.1-8B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6a0f0951f14f19f5fdc5242f5f2138f6d7574e48203dbd829ce3b8817eaa93d6
size 4920735232

3
Alpaca-CodeLlama-3.1-8B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:082b37f1eb6d0d5a10ddeea985c75f674d145da473838ffc6519bf9a09ec4ad3
size 4692669952

3
Alpaca-CodeLlama-3.1-8B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:db0a6bc25107b65f26588996b258b519d516ba85d25a2d09cc70a900c5a85dc2
size 5732988416

3
Alpaca-CodeLlama-3.1-8B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b169d08e5357290f1dfe212a0952173ab8da3f7b20b4eae380e4837c6e702265
size 5599294976

3
Alpaca-CodeLlama-3.1-8B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e2ba685256f4280e4c355125d5643f07b02cd4a688c48ed4a5bce1b4d3602e07
size 6596007424

79
README.md Normal file
View File

@@ -0,0 +1,79 @@
---
base_model: EpistemeAI/Alpaca-CodeLlama-3.1-8B
language:
- en
library_name: transformers
license: apache-2.0
quantized_by: mradermacher
tags:
- text-generation-inference
- transformers
- unsloth
- llama
- trl
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/EpistemeAI/Alpaca-CodeLlama-3.1-8B
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/Alpaca-CodeLlama-3.1-8B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Alpaca-CodeLlama-3.1-8B-i1-GGUF/resolve/main/Alpaca-CodeLlama-3.1-8B.i1-IQ1_S.gguf) | i1-IQ1_S | 2.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Alpaca-CodeLlama-3.1-8B-i1-GGUF/resolve/main/Alpaca-CodeLlama-3.1-8B.i1-IQ1_M.gguf) | i1-IQ1_M | 2.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Alpaca-CodeLlama-3.1-8B-i1-GGUF/resolve/main/Alpaca-CodeLlama-3.1-8B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.5 | |
| [GGUF](https://huggingface.co/mradermacher/Alpaca-CodeLlama-3.1-8B-i1-GGUF/resolve/main/Alpaca-CodeLlama-3.1-8B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/Alpaca-CodeLlama-3.1-8B-i1-GGUF/resolve/main/Alpaca-CodeLlama-3.1-8B.i1-IQ2_S.gguf) | i1-IQ2_S | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/Alpaca-CodeLlama-3.1-8B-i1-GGUF/resolve/main/Alpaca-CodeLlama-3.1-8B.i1-IQ2_M.gguf) | i1-IQ2_M | 3.0 | |
| [GGUF](https://huggingface.co/mradermacher/Alpaca-CodeLlama-3.1-8B-i1-GGUF/resolve/main/Alpaca-CodeLlama-3.1-8B.i1-Q2_K.gguf) | i1-Q2_K | 3.3 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Alpaca-CodeLlama-3.1-8B-i1-GGUF/resolve/main/Alpaca-CodeLlama-3.1-8B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Alpaca-CodeLlama-3.1-8B-i1-GGUF/resolve/main/Alpaca-CodeLlama-3.1-8B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.6 | |
| [GGUF](https://huggingface.co/mradermacher/Alpaca-CodeLlama-3.1-8B-i1-GGUF/resolve/main/Alpaca-CodeLlama-3.1-8B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Alpaca-CodeLlama-3.1-8B-i1-GGUF/resolve/main/Alpaca-CodeLlama-3.1-8B.i1-IQ3_S.gguf) | i1-IQ3_S | 3.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Alpaca-CodeLlama-3.1-8B-i1-GGUF/resolve/main/Alpaca-CodeLlama-3.1-8B.i1-IQ3_M.gguf) | i1-IQ3_M | 3.9 | |
| [GGUF](https://huggingface.co/mradermacher/Alpaca-CodeLlama-3.1-8B-i1-GGUF/resolve/main/Alpaca-CodeLlama-3.1-8B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.1 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Alpaca-CodeLlama-3.1-8B-i1-GGUF/resolve/main/Alpaca-CodeLlama-3.1-8B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.4 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Alpaca-CodeLlama-3.1-8B-i1-GGUF/resolve/main/Alpaca-CodeLlama-3.1-8B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.5 | |
| [GGUF](https://huggingface.co/mradermacher/Alpaca-CodeLlama-3.1-8B-i1-GGUF/resolve/main/Alpaca-CodeLlama-3.1-8B.i1-Q4_0.gguf) | i1-Q4_0 | 4.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Alpaca-CodeLlama-3.1-8B-i1-GGUF/resolve/main/Alpaca-CodeLlama-3.1-8B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.8 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Alpaca-CodeLlama-3.1-8B-i1-GGUF/resolve/main/Alpaca-CodeLlama-3.1-8B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Alpaca-CodeLlama-3.1-8B-i1-GGUF/resolve/main/Alpaca-CodeLlama-3.1-8B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.7 | |
| [GGUF](https://huggingface.co/mradermacher/Alpaca-CodeLlama-3.1-8B-i1-GGUF/resolve/main/Alpaca-CodeLlama-3.1-8B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/Alpaca-CodeLlama-3.1-8B-i1-GGUF/resolve/main/Alpaca-CodeLlama-3.1-8B.i1-Q6_K.gguf) | i1-Q6_K | 6.7 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e21c169d0ae620610ea08d1824d14b969eae89519a91932ea95b5855076d6577
size 4988157