mradermacher/TinyMistral-248M-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/TinyMistral-248M-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-08-19 13:09:16 +08:00
commit d4a3a0dcb4
15 changed files with 153 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

46
.gitattributes vendored Normal file
View File

@@ -0,0 +1,46 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
TinyMistral-248M.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
TinyMistral-248M.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
TinyMistral-248M.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
TinyMistral-248M.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
TinyMistral-248M.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
TinyMistral-248M.f16.gguf filter=lfs diff=lfs merge=lfs -text
TinyMistral-248M.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
TinyMistral-248M.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
TinyMistral-248M.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
TinyMistral-248M.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
TinyMistral-248M.Q4_0_4_4.gguf filter=lfs diff=lfs merge=lfs -text

68
README.md Normal file
View File

@@ -0,0 +1,68 @@
---
base_model: Locutusque/TinyMistral-248M
datasets:
- Skylion007/openwebtext
- JeanKaddour/minipile
language:
- en
library_name: transformers
license: apache-2.0
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: -->
static quants of https://huggingface.co/Locutusque/TinyMistral-248M
<!-- provided-files -->
weighted/imatrix quants are available at https://huggingface.co/mradermacher/TinyMistral-248M-i1-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/TinyMistral-248M-GGUF/resolve/main/TinyMistral-248M.Q2_K.gguf) | Q2_K | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/TinyMistral-248M-GGUF/resolve/main/TinyMistral-248M.Q3_K_S.gguf) | Q3_K_S | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/TinyMistral-248M-GGUF/resolve/main/TinyMistral-248M.Q3_K_M.gguf) | Q3_K_M | 0.2 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/TinyMistral-248M-GGUF/resolve/main/TinyMistral-248M.Q3_K_L.gguf) | Q3_K_L | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/TinyMistral-248M-GGUF/resolve/main/TinyMistral-248M.IQ4_XS.gguf) | IQ4_XS | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/TinyMistral-248M-GGUF/resolve/main/TinyMistral-248M.Q4_0_4_4.gguf) | Q4_0_4_4 | 0.2 | fast on arm, low quality |
| [GGUF](https://huggingface.co/mradermacher/TinyMistral-248M-GGUF/resolve/main/TinyMistral-248M.Q4_K_S.gguf) | Q4_K_S | 0.2 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/TinyMistral-248M-GGUF/resolve/main/TinyMistral-248M.Q4_K_M.gguf) | Q4_K_M | 0.3 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/TinyMistral-248M-GGUF/resolve/main/TinyMistral-248M.Q5_K_S.gguf) | Q5_K_S | 0.3 | |
| [GGUF](https://huggingface.co/mradermacher/TinyMistral-248M-GGUF/resolve/main/TinyMistral-248M.Q5_K_M.gguf) | Q5_K_M | 0.3 | |
| [GGUF](https://huggingface.co/mradermacher/TinyMistral-248M-GGUF/resolve/main/TinyMistral-248M.Q6_K.gguf) | Q6_K | 0.3 | very good quality |
| [GGUF](https://huggingface.co/mradermacher/TinyMistral-248M-GGUF/resolve/main/TinyMistral-248M.Q8_0.gguf) | Q8_0 | 0.4 | fast, best quality |
| [GGUF](https://huggingface.co/mradermacher/TinyMistral-248M-GGUF/resolve/main/TinyMistral-248M.f16.gguf) | f16 | 0.6 | 16 bpw, overkill |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time.
<!-- end -->

3
TinyMistral-248M.IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d116744dfcc84a771b405fc4c00152a5bbc53ae9759fdf0eb314fdd9eea7461a
size 143197472

3
TinyMistral-248M.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1ff5bd7f15b84c1ae23d8b2f2359a533e036bb622ca9a0c69b3be704ba76aebe
size 105460000

3
TinyMistral-248M.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b0441cc36ce250c66efc5e7e7aad991d76455d1c5521ec6015bbf0bbedbbb555
size 137222944

3
TinyMistral-248M.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fb4b7520435fa5140a159a489729e7271c51ca423a6afaa22e01052141b6274a
size 129030944

3
TinyMistral-248M.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:778ae5a0bdffa27e20b5ec738b8db0f539a8548a269b1a323a9e15ebdf01951c
size 120191776

3
TinyMistral-248M.Q4_0_4_4.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1845b5e52d6d1d12fa05d90fee653e8ebf261f17ff16fbe48498e7fbc6535880
size 148776384

3
TinyMistral-248M.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:965be1994a82a17fa725b5520ea44c475e9c804f5829457b2fad15c9890c9d9d
size 155669952

3
TinyMistral-248M.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ed6d8122803ce928d4e12ba1caa9194051875de7afe4fdf0fcffb5c69769906c
size 149431744

3
TinyMistral-248M.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3d749a6a5ce72e685a1440f63b70026854be136c6ab314bd13952ef382844fa1
size 179230784

3
TinyMistral-248M.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:28934a6b4026303ee18e6735ef10f8badb83ef43c83043b6ebc02d089ed56b01
size 175679552

3
TinyMistral-248M.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fc87d635bd1e5cc29e8fe32c2657cbfee22ac12fb589d8f1be6564117742222e
size 204264192

3
TinyMistral-248M.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:329ac9605a373fc899903349594d146fc3a76c1eb4e243bd002d90720b12f01a
size 264326272

3
TinyMistral-248M.f16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1784e2d3e435ab33b40d0d6f71befa3d98ee50cfd41b14cca7e71397112a0db5
size 496824832