mradermacher/Llama-3.2-3B-Agent007-Coder-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Llama-3.2-3B-Agent007-Coder-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-03 01:10:35 +08:00
commit 8aca9b0eb7
27 changed files with 220 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Llama-3.2-3B-Agent007-Coder.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-3B-Agent007-Coder.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-3B-Agent007-Coder.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-3B-Agent007-Coder.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-3B-Agent007-Coder.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-3B-Agent007-Coder.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-3B-Agent007-Coder.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-3B-Agent007-Coder.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-3B-Agent007-Coder.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-3B-Agent007-Coder.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-3B-Agent007-Coder.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-3B-Agent007-Coder.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-3B-Agent007-Coder.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-3B-Agent007-Coder.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-3B-Agent007-Coder.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-3B-Agent007-Coder.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-3B-Agent007-Coder.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-3B-Agent007-Coder.i1-Q4_0_4_4.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-3B-Agent007-Coder.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-3B-Agent007-Coder.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-3B-Agent007-Coder.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-3B-Agent007-Coder.i1-Q4_0_8_8.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-3B-Agent007-Coder.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-3B-Agent007-Coder.i1-Q4_0_4_8.gguf filter=lfs diff=lfs merge=lfs -text

3
Llama-3.2-3B-Agent007-Coder.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d67f8707457b4ffdcac0b5063507591472280b60d91ab91b95efba9573f96c7e
size 924192160

3
Llama-3.2-3B-Agent007-Coder.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c228ce3b7766051d142e5dada9a2334b904839515ee601cc6848fd2f6bb4961e
size 868158880

3
Llama-3.2-3B-Agent007-Coder.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f3d9ae56dc0036eb1bd221fafe918792bc77eeab379e93b1423cba22c4682ca6
size 1229032864

3
Llama-3.2-3B-Agent007-Coder.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5f4132f39da60834ac2066a4887d49ff06ef3111a3ffd20608ef6ac7c05e5f3d
size 1154321824

3
Llama-3.2-3B-Agent007-Coder.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:554eb45ffc9e80d6a675b66fee04e807fa68d95e26bbcb5f8795e0d280dc1a2e
size 1100549536

3
Llama-3.2-3B-Agent007-Coder.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6f2453a555a35c4a2047178d50ea5db52f88286353938bb78f8484e1f65a0b9b
size 1017580960

3
Llama-3.2-3B-Agent007-Coder.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0c3a5940db045b57275816067e0a4901bad8ca7c71f701787c7db603acbd6683
size 1599669664

3
Llama-3.2-3B-Agent007-Coder.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8fd3fa564d6e538937580b930dcb19f3417409e4dacd1d1ef5e3013878bfe9fe
size 1542849952

3
Llama-3.2-3B-Agent007-Coder.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:57bcb76f78abbf107e2f7d357909b8160bb5185bb6317f1f99b9d2d0f924568f
size 1476789664

3
Llama-3.2-3B-Agent007-Coder.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e86952595a85e9e72bc52546a0a4693e28ed8aefe86a357ce8e71b1a7eeb7a17
size 1348767136

3
Llama-3.2-3B-Agent007-Coder.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f24c223d578010773eb8090ce47c0cd38d969dcf5f271f4fe1e317922b8a04c3
size 1829111200

3
Llama-3.2-3B-Agent007-Coder.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:26a432b196132243d607698b0abab84ad580eb795a1987fbfe2fcd204c5b8d17
size 1363936672

3
Llama-3.2-3B-Agent007-Coder.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:12b7249b3a436d358ac5c4bebdfafe3ae2845c82958bfe0c1d358668b6f1b2e3
size 1815348640

3
Llama-3.2-3B-Agent007-Coder.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9c8fa264537761c450922448eb89b105e448b5cb255e9df94c466c9e9bbed391
size 1687160224

3
Llama-3.2-3B-Agent007-Coder.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3941451cb1f2ae95ac2c9d42554823555537e6cfbca6d7b713abfe00e586a63c
size 1542849952

3
Llama-3.2-3B-Agent007-Coder.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:989e2d8c452531d4c5bd555b8005e25350e785901e5ff77b2dd856e755f48e25
size 1921910176

3
Llama-3.2-3B-Agent007-Coder.i1-Q4_0_4_4.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:de4ae87ce67696a85fd63a5fb33e78459967bdb1dac7035155797a8c39a9ce5a
size 1917191584

3
Llama-3.2-3B-Agent007-Coder.i1-Q4_0_4_8.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:58b6a744262c9e1a7c96de9e878c6260dd27057c0ea4c4ae0ddd6ba212742a62
size 1917191584

3
Llama-3.2-3B-Agent007-Coder.i1-Q4_0_8_8.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:618910eeb58ecabd42821e9dc70ddd50f3d177fad79e04dd0e7e5446e657493a
size 1917191584

3
Llama-3.2-3B-Agent007-Coder.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d30ffece024092f230b2c762e8af21b5226391774fa92e24ba4e7cc88f892c46
size 2019378592

3
Llama-3.2-3B-Agent007-Coder.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:86fb04c33911156ddfeaf1a62a99a6506fc5fa6955b59a4ee9be0b664c24213d
size 1928201632

3
Llama-3.2-3B-Agent007-Coder.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4ad9d1a7aee38f23fd500e58af72094e7effd17bf20f20019e790c8b99935603
size 2322154912

3
Llama-3.2-3B-Agent007-Coder.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a0ca7a33727fb0481a6fcc12391d0e95deb6cf875707672ffa4c43f4928926bf
size 2269513120

3
Llama-3.2-3B-Agent007-Coder.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6d7bfa5effea137e36b8465867851156807916da51ef318304ab82376226a68f
size 2643854752

85
README.md Normal file
View File

@@ -0,0 +1,85 @@
---
base_model: EpistemeAI/Llama-3.2-3B-Agent007-Coder
datasets:
- sahil2801/CodeAlpaca-20k
- argilla/magpie-ultra-v0.1
language:
- en
library_name: transformers
license: apache-2.0
quantized_by: mradermacher
tags:
- text-generation-inference
- transformers
- unsloth
- llama
- trl
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/EpistemeAI/Llama-3.2-3B-Agent007-Coder
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/Llama-3.2-3B-Agent007-Coder-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-3B-Agent007-Coder-i1-GGUF/resolve/main/Llama-3.2-3B-Agent007-Coder.i1-IQ1_S.gguf) | i1-IQ1_S | 1.0 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-3B-Agent007-Coder-i1-GGUF/resolve/main/Llama-3.2-3B-Agent007-Coder.i1-IQ1_M.gguf) | i1-IQ1_M | 1.0 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-3B-Agent007-Coder-i1-GGUF/resolve/main/Llama-3.2-3B-Agent007-Coder.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-3B-Agent007-Coder-i1-GGUF/resolve/main/Llama-3.2-3B-Agent007-Coder.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-3B-Agent007-Coder-i1-GGUF/resolve/main/Llama-3.2-3B-Agent007-Coder.i1-IQ2_S.gguf) | i1-IQ2_S | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-3B-Agent007-Coder-i1-GGUF/resolve/main/Llama-3.2-3B-Agent007-Coder.i1-IQ2_M.gguf) | i1-IQ2_M | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-3B-Agent007-Coder-i1-GGUF/resolve/main/Llama-3.2-3B-Agent007-Coder.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-3B-Agent007-Coder-i1-GGUF/resolve/main/Llama-3.2-3B-Agent007-Coder.i1-Q2_K.gguf) | i1-Q2_K | 1.5 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-3B-Agent007-Coder-i1-GGUF/resolve/main/Llama-3.2-3B-Agent007-Coder.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.6 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-3B-Agent007-Coder-i1-GGUF/resolve/main/Llama-3.2-3B-Agent007-Coder.i1-IQ3_S.gguf) | i1-IQ3_S | 1.6 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-3B-Agent007-Coder-i1-GGUF/resolve/main/Llama-3.2-3B-Agent007-Coder.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-3B-Agent007-Coder-i1-GGUF/resolve/main/Llama-3.2-3B-Agent007-Coder.i1-IQ3_M.gguf) | i1-IQ3_M | 1.7 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-3B-Agent007-Coder-i1-GGUF/resolve/main/Llama-3.2-3B-Agent007-Coder.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.8 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-3B-Agent007-Coder-i1-GGUF/resolve/main/Llama-3.2-3B-Agent007-Coder.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.9 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-3B-Agent007-Coder-i1-GGUF/resolve/main/Llama-3.2-3B-Agent007-Coder.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.9 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-3B-Agent007-Coder-i1-GGUF/resolve/main/Llama-3.2-3B-Agent007-Coder.i1-Q4_0_4_4.gguf) | i1-Q4_0_4_4 | 2.0 | fast on arm, low quality |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-3B-Agent007-Coder-i1-GGUF/resolve/main/Llama-3.2-3B-Agent007-Coder.i1-Q4_0_4_8.gguf) | i1-Q4_0_4_8 | 2.0 | fast on arm+i8mm, low quality |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-3B-Agent007-Coder-i1-GGUF/resolve/main/Llama-3.2-3B-Agent007-Coder.i1-Q4_0_8_8.gguf) | i1-Q4_0_8_8 | 2.0 | fast on arm+sve, low quality |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-3B-Agent007-Coder-i1-GGUF/resolve/main/Llama-3.2-3B-Agent007-Coder.i1-Q4_0.gguf) | i1-Q4_0 | 2.0 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-3B-Agent007-Coder-i1-GGUF/resolve/main/Llama-3.2-3B-Agent007-Coder.i1-Q4_K_S.gguf) | i1-Q4_K_S | 2.0 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-3B-Agent007-Coder-i1-GGUF/resolve/main/Llama-3.2-3B-Agent007-Coder.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.1 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-3B-Agent007-Coder-i1-GGUF/resolve/main/Llama-3.2-3B-Agent007-Coder.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.4 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-3B-Agent007-Coder-i1-GGUF/resolve/main/Llama-3.2-3B-Agent007-Coder.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.4 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-3.2-3B-Agent007-Coder-i1-GGUF/resolve/main/Llama-3.2-3B-Agent007-Coder.i1-Q6_K.gguf) | i1-Q6_K | 2.7 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cdf6126b9aa3c07092e087b5eea2148a99612b1eb17a2da992c4971eaa6b6587
size 2988377