mradermacher/bigllama3.2-3b-to-9b-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/bigllama3.2-3b-to-9b-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-09-29 20:02:23 +08:00
commit 6326a1feec
15 changed files with 154 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

48
.gitattributes vendored Normal file
View File

@@ -0,0 +1,48 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
bigllama3.2-3b-to-9b.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
bigllama3.2-3b-to-9b.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
bigllama3.2-3b-to-9b.f16.gguf filter=lfs diff=lfs merge=lfs -text
bigllama3.2-3b-to-9b.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
bigllama3.2-3b-to-9b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
bigllama3.2-3b-to-9b.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
bigllama3.2-3b-to-9b.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
bigllama3.2-3b-to-9b.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
bigllama3.2-3b-to-9b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
bigllama3.2-3b-to-9b.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
bigllama3.2-3b-to-9b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
bigllama3.2-3b-to-9b.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
bigllama3.2-3b-to-9b.Q4_0_4_4.gguf filter=lfs diff=lfs merge=lfs -text

67
README.md Normal file
View File

@@ -0,0 +1,67 @@
---
base_model: deltanym/bigllama3.2-3b-to-9b
language:
- en
library_name: transformers
quantized_by: mradermacher
tags:
- mergekit
- merge
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
static quants of https://huggingface.co/deltanym/bigllama3.2-3b-to-9b
<!-- provided-files -->
weighted/imatrix quants seem not to be available (by me) at this time. If they do not show up a week or so after the static ones, I have probably not planned for them. Feel free to request them by opening a Community Discussion.
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/bigllama3.2-3b-to-9b-GGUF/resolve/main/bigllama3.2-3b-to-9b.Q2_K.gguf) | Q2_K | 3.8 | |
| [GGUF](https://huggingface.co/mradermacher/bigllama3.2-3b-to-9b-GGUF/resolve/main/bigllama3.2-3b-to-9b.Q3_K_S.gguf) | Q3_K_S | 4.3 | |
| [GGUF](https://huggingface.co/mradermacher/bigllama3.2-3b-to-9b-GGUF/resolve/main/bigllama3.2-3b-to-9b.Q3_K_M.gguf) | Q3_K_M | 4.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/bigllama3.2-3b-to-9b-GGUF/resolve/main/bigllama3.2-3b-to-9b.Q3_K_L.gguf) | Q3_K_L | 5.2 | |
| [GGUF](https://huggingface.co/mradermacher/bigllama3.2-3b-to-9b-GGUF/resolve/main/bigllama3.2-3b-to-9b.IQ4_XS.gguf) | IQ4_XS | 5.3 | |
| [GGUF](https://huggingface.co/mradermacher/bigllama3.2-3b-to-9b-GGUF/resolve/main/bigllama3.2-3b-to-9b.Q4_0_4_4.gguf) | Q4_0_4_4 | 5.5 | fast on arm, low quality |
| [GGUF](https://huggingface.co/mradermacher/bigllama3.2-3b-to-9b-GGUF/resolve/main/bigllama3.2-3b-to-9b.Q4_K_S.gguf) | Q4_K_S | 5.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/bigllama3.2-3b-to-9b-GGUF/resolve/main/bigllama3.2-3b-to-9b.Q4_K_M.gguf) | Q4_K_M | 5.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/bigllama3.2-3b-to-9b-GGUF/resolve/main/bigllama3.2-3b-to-9b.Q5_K_S.gguf) | Q5_K_S | 6.7 | |
| [GGUF](https://huggingface.co/mradermacher/bigllama3.2-3b-to-9b-GGUF/resolve/main/bigllama3.2-3b-to-9b.Q5_K_M.gguf) | Q5_K_M | 6.8 | |
| [GGUF](https://huggingface.co/mradermacher/bigllama3.2-3b-to-9b-GGUF/resolve/main/bigllama3.2-3b-to-9b.Q6_K.gguf) | Q6_K | 7.9 | very good quality |
| [GGUF](https://huggingface.co/mradermacher/bigllama3.2-3b-to-9b-GGUF/resolve/main/bigllama3.2-3b-to-9b.Q8_0.gguf) | Q8_0 | 10.2 | fast, best quality |
| [GGUF](https://huggingface.co/mradermacher/bigllama3.2-3b-to-9b-GGUF/resolve/main/bigllama3.2-3b-to-9b.f16.gguf) | f16 | 19.0 | 16 bpw, overkill |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
bigllama3.2-3b-to-9b.IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9ecbee73d07c291b85ac927f514543f3005fc54059340b3fe7816c7e0b851fb1
size 5189518720

3
bigllama3.2-3b-to-9b.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a2d7a967aa71528c27ad424fefbe5c525af2104116daf5ae5a70f83a4d71739c
size 3651061120

3
bigllama3.2-3b-to-9b.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c7d9d7d70c84e7a35d0bcbd52e58c25c7e9cf996ef2cf728c9701afdb2e462fb
size 5102028160

3
bigllama3.2-3b-to-9b.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5ade16d8a26f345a582ae26ed1c0e5f287fa502c1103565c60dc93a3672911f8
size 4693869952

3
bigllama3.2-3b-to-9b.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f3991ec4fe47cd699333fc278aad9fa540603054d336ad0149464a149e94e9d4
size 4226139520

3
bigllama3.2-3b-to-9b.Q4_0_4_4.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8664bc7f6f2d68cf9cd3383c6d5f72c0f928dd00998efcf59714338a0bca4380
size 5429380480

3
bigllama3.2-3b-to-9b.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3edc838e4e3d14f2c46e34e5e5fa2457459811bd447aa2d2f939bd73b87a5996
size 5757838720

3
bigllama3.2-3b-to-9b.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:69a67f9f421f4df0dc2110539f982e2380794173591ac516f1303edbd43c9a0d
size 5465556352

3
bigllama3.2-3b-to-9b.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5ca1d5c4550dfa99aae9a48d11d301ccaefa98e26ccf9a7f947944c200f5f610
size 6731048320

3
bigllama3.2-3b-to-9b.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aa2d95350db0334665f9a679695b4c8a2fce2541ae85ce181f8b60ee5766f6be
size 6561842560

3
bigllama3.2-3b-to-9b.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2c28bf28557d78c4488eaa4babe078644ea3bc94dacf2564f3de6b8ee889ffd5
size 7765083520

3
bigllama3.2-3b-to-9b.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3518adfe92c43e12cdb1f50dba0d0385b30191d2fca842dc94b309cb701044dd
size 10054651264

3
bigllama3.2-3b-to-9b.f16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cc3a4c2b540319546b3b68fca1b2610229a1a93b5a8082eae93b9385296705f2
size 18917494144