mradermacher/FineTome-Llama3.2-1B-0929-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/FineTome-Llama3.2-1B-0929-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-08-20 09:31:16 +08:00
commit adc2372236
17 changed files with 172 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

50
.gitattributes vendored Normal file
View File

@@ -0,0 +1,50 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
FineTome-Llama3.2-1B-0929.IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
FineTome-Llama3.2-1B-0929.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
FineTome-Llama3.2-1B-0929.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
FineTome-Llama3.2-1B-0929.f16.gguf filter=lfs diff=lfs merge=lfs -text
FineTome-Llama3.2-1B-0929.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
FineTome-Llama3.2-1B-0929.IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
FineTome-Llama3.2-1B-0929.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
FineTome-Llama3.2-1B-0929.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
FineTome-Llama3.2-1B-0929.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
FineTome-Llama3.2-1B-0929.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
FineTome-Llama3.2-1B-0929.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
FineTome-Llama3.2-1B-0929.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
FineTome-Llama3.2-1B-0929.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
FineTome-Llama3.2-1B-0929.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
FineTome-Llama3.2-1B-0929.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text

3
FineTome-Llama3.2-1B-0929.IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:412d1d7deae9614d692e4ea07d1797d221265317a5dc2defe50d02dc4a64b963
size 657295328

3
FineTome-Llama3.2-1B-0929.IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:542cf803c46e6bc294e4513761c29f19ae4784070c9877cea812a1c0acead7e7
size 643925984

3
FineTome-Llama3.2-1B-0929.IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a9afb4d5f84b965645c957b9d26975d2bb795c5378fbb26525898e383162c151
size 621119456

3
FineTome-Llama3.2-1B-0929.IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:823f07c3d4d2e299fcac811b528439e79469e5fec5d29ca41fd58ec93fb8e1dc
size 748390368

3
FineTome-Llama3.2-1B-0929.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1cd3aef126ee00bb3f1e6a26c17e706e42449a3a248459bcbce3339c245bbb3a
size 580880352

3
FineTome-Llama3.2-1B-0929.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fe8fe3b68f0fdfbb580d71363bd4dd0125a099403be46b04275ec8e9fa1787bc
size 732530656

3
FineTome-Llama3.2-1B-0929.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:25f26e9c2ad066bd4887bf9c95bb0e60b35c46928ab854810440af93c8fb9e30
size 690849760

3
FineTome-Llama3.2-1B-0929.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8857edd1c67539e5b803fe2e3999d3b1cabbec21b2edead389be89ebecf0cdd5
size 641697760

3
FineTome-Llama3.2-1B-0929.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d87477238490e8e4263b14058bd1a809b8a3b8f4f22b2956725fadf8ab29a8bc
size 807700448

3
FineTome-Llama3.2-1B-0929.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:422fe68ac54c1659531b862bf42067b1d80313fc067cb6a3d09aeccca4eb6348
size 775653344

3
FineTome-Llama3.2-1B-0929.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:34e2cb2958aab5dc85b1bf5c73071a1d54fc0ea94800c10fd16681bf21863e69
size 911509472

3
FineTome-Llama3.2-1B-0929.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:df7ca70d28dc846c7b00740183df9eca09ae6219c1b44498b7603e18b80bcb96
size 892569568

3
FineTome-Llama3.2-1B-0929.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:da2a24c6b3850bb90acbe8389c2fba6477d866cc464728b5db36bf6935d8b045
size 1021806560

3
FineTome-Llama3.2-1B-0929.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:318e3b57ef2b2ea7a27aadc6e6358515e8469bb05d417d09fe8e878116c1b86e
size 1321088992

3
FineTome-Llama3.2-1B-0929.f16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9eadf5634c5fd58c2142d4225f0521646f27f4e722e1d7d22bab535471f23529
size 2479601632

77
README.md Normal file
View File

@@ -0,0 +1,77 @@
---
base_model: NotASI/FineTome-Llama3.2-1B-0929
datasets:
- mlabonne/FineTome-100k
language:
- en
library_name: transformers
license: llama3.2
quantized_by: mradermacher
tags:
- text-generation-inference
- transformers
- unsloth
- llama
- llama-3
- trl
- sft
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: -->
static quants of https://huggingface.co/NotASI/FineTome-Llama3.2-1B-0929
<!-- provided-files -->
weighted/imatrix quants are available at https://huggingface.co/mradermacher/FineTome-Llama3.2-1B-0929-i1-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/FineTome-Llama3.2-1B-0929-GGUF/resolve/main/FineTome-Llama3.2-1B-0929.Q2_K.gguf) | Q2_K | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/FineTome-Llama3.2-1B-0929-GGUF/resolve/main/FineTome-Llama3.2-1B-0929.IQ3_XS.gguf) | IQ3_XS | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/FineTome-Llama3.2-1B-0929-GGUF/resolve/main/FineTome-Llama3.2-1B-0929.Q3_K_S.gguf) | Q3_K_S | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/FineTome-Llama3.2-1B-0929-GGUF/resolve/main/FineTome-Llama3.2-1B-0929.IQ3_S.gguf) | IQ3_S | 0.7 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/FineTome-Llama3.2-1B-0929-GGUF/resolve/main/FineTome-Llama3.2-1B-0929.IQ3_M.gguf) | IQ3_M | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/FineTome-Llama3.2-1B-0929-GGUF/resolve/main/FineTome-Llama3.2-1B-0929.Q3_K_M.gguf) | Q3_K_M | 0.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/FineTome-Llama3.2-1B-0929-GGUF/resolve/main/FineTome-Llama3.2-1B-0929.Q3_K_L.gguf) | Q3_K_L | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/FineTome-Llama3.2-1B-0929-GGUF/resolve/main/FineTome-Llama3.2-1B-0929.IQ4_XS.gguf) | IQ4_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/FineTome-Llama3.2-1B-0929-GGUF/resolve/main/FineTome-Llama3.2-1B-0929.Q4_K_S.gguf) | Q4_K_S | 0.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/FineTome-Llama3.2-1B-0929-GGUF/resolve/main/FineTome-Llama3.2-1B-0929.Q4_K_M.gguf) | Q4_K_M | 0.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/FineTome-Llama3.2-1B-0929-GGUF/resolve/main/FineTome-Llama3.2-1B-0929.Q5_K_S.gguf) | Q5_K_S | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/FineTome-Llama3.2-1B-0929-GGUF/resolve/main/FineTome-Llama3.2-1B-0929.Q5_K_M.gguf) | Q5_K_M | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/FineTome-Llama3.2-1B-0929-GGUF/resolve/main/FineTome-Llama3.2-1B-0929.Q6_K.gguf) | Q6_K | 1.1 | very good quality |
| [GGUF](https://huggingface.co/mradermacher/FineTome-Llama3.2-1B-0929-GGUF/resolve/main/FineTome-Llama3.2-1B-0929.Q8_0.gguf) | Q8_0 | 1.4 | fast, best quality |
| [GGUF](https://huggingface.co/mradermacher/FineTome-Llama3.2-1B-0929-GGUF/resolve/main/FineTome-Llama3.2-1B-0929.f16.gguf) | f16 | 2.6 | 16 bpw, overkill |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time.
<!-- end -->