mradermacher/mox-8b-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/mox-8b-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-10-03 11:51:18 +08:00
commit 21c4ed7e5f
27 changed files with 241 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

59
.gitattributes vendored Normal file
View File

@@ -0,0 +1,59 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
mox-8b.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
mox-8b.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
mox-8b.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
mox-8b.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
mox-8b.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
mox-8b.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
mox-8b.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
mox-8b.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
mox-8b.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
mox-8b.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
mox-8b.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
mox-8b.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
mox-8b.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
mox-8b.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
mox-8b.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
mox-8b.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
mox-8b.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
mox-8b.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
mox-8b.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
mox-8b.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
mox-8b.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
mox-8b.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
mox-8b.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
mox-8b.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

107
README.md Normal file
View File

@@ -0,0 +1,107 @@
---
base_model: vanta-research/mox-8b
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- vanta-research
- experimental-alignment
- persona
- chatbot
- collaborative-ai
- opinion
- intelligent-refusal
- friendly-ai
- conversational-ai
- conversational
- large-language-model
- llama
- llama-3.1
- meta-llama
- model-presence
- ai-research
- ai-alignment-research
- ai-alignment
- ai-behavior
- ai-behavior-research
- ai-persona-research
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/vanta-research/mox-8b
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#mox-8b-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/mox-8b-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/mox-8b-i1-GGUF/resolve/main/mox-8b.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/mox-8b-i1-GGUF/resolve/main/mox-8b.i1-IQ1_S.gguf) | i1-IQ1_S | 2.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/mox-8b-i1-GGUF/resolve/main/mox-8b.i1-IQ1_M.gguf) | i1-IQ1_M | 2.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/mox-8b-i1-GGUF/resolve/main/mox-8b.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.5 | |
| [GGUF](https://huggingface.co/mradermacher/mox-8b-i1-GGUF/resolve/main/mox-8b.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/mox-8b-i1-GGUF/resolve/main/mox-8b.i1-IQ2_S.gguf) | i1-IQ2_S | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/mox-8b-i1-GGUF/resolve/main/mox-8b.i1-IQ2_M.gguf) | i1-IQ2_M | 3.0 | |
| [GGUF](https://huggingface.co/mradermacher/mox-8b-i1-GGUF/resolve/main/mox-8b.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.1 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/mox-8b-i1-GGUF/resolve/main/mox-8b.i1-Q2_K.gguf) | i1-Q2_K | 3.3 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/mox-8b-i1-GGUF/resolve/main/mox-8b.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/mox-8b-i1-GGUF/resolve/main/mox-8b.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.6 | |
| [GGUF](https://huggingface.co/mradermacher/mox-8b-i1-GGUF/resolve/main/mox-8b.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/mox-8b-i1-GGUF/resolve/main/mox-8b.i1-IQ3_S.gguf) | i1-IQ3_S | 3.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/mox-8b-i1-GGUF/resolve/main/mox-8b.i1-IQ3_M.gguf) | i1-IQ3_M | 3.9 | |
| [GGUF](https://huggingface.co/mradermacher/mox-8b-i1-GGUF/resolve/main/mox-8b.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.1 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/mox-8b-i1-GGUF/resolve/main/mox-8b.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.4 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/mox-8b-i1-GGUF/resolve/main/mox-8b.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.5 | |
| [GGUF](https://huggingface.co/mradermacher/mox-8b-i1-GGUF/resolve/main/mox-8b.i1-Q4_0.gguf) | i1-Q4_0 | 4.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/mox-8b-i1-GGUF/resolve/main/mox-8b.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.8 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/mox-8b-i1-GGUF/resolve/main/mox-8b.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.8 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/mox-8b-i1-GGUF/resolve/main/mox-8b.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/mox-8b-i1-GGUF/resolve/main/mox-8b.i1-Q4_1.gguf) | i1-Q4_1 | 5.2 | |
| [GGUF](https://huggingface.co/mradermacher/mox-8b-i1-GGUF/resolve/main/mox-8b.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.7 | |
| [GGUF](https://huggingface.co/mradermacher/mox-8b-i1-GGUF/resolve/main/mox-8b.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/mox-8b-i1-GGUF/resolve/main/mox-8b.i1-Q6_K.gguf) | i1-Q6_K | 6.7 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
mox-8b.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d6280296a40f1f97fb498b4accb765a53630f2c84888f627af40f82ba175c464
size 2161977824

3
mox-8b.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d07e3bd77bf824eb356c54175c1502dfe9d079f4c071079a142c33fa26b6b7f1
size 2019633632

3
mox-8b.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5c48b7f5224f50c4c13bfc1860e26c39e735fc8d25c445ede7d18f7bb568d6eb
size 2948286944

3
mox-8b.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:31f71d7c63c40f09e1656c885ad2795c40b5ba14466f36b079ed1db479364f06
size 2758494688

3
mox-8b.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0a2e584daadcac33a0e1d7090b1b951d5db70342361c3d64a39d5f836ea55af8
size 2605787616

3
mox-8b.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:601e78d288cc55084bd12c00b12ad3c9ea3225fe213b76a35c2659512610bd1c
size 2399218144

3
mox-8b.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:92c060234a6d0b7402385feb86b84639912b3ff00d80a91ab512cf2b513ae2b1
size 3784829408

3
mox-8b.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2b57adea68cec56bde43c2221f74dc7eb5469062901a2159196d53f498ebe8ee
size 3682331104

3
mox-8b.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7ce62295795c80c064e6c4da9be0697ad9f255aed1584edb43154f9beeb55667
size 3518753248

3
mox-8b.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1cfa5c62a23a78f3c9f53841f7bde8e02c86c63c2823944ce752f0749736fa88
size 3274918368

3
mox-8b.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f7e5627753b44c91a126ffda3b1c93ced14b6c8fda4f164d0b7f6c3f860e9573
size 4677994976

3
mox-8b.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:998bedea90fd6529fcf5cce379dbd0d697b586678150d63cc34f390c865adcca
size 4447668704

3
mox-8b.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eeb088321dd4de4ac71890d0a4ed72d001eea452fdf46c34e3c4b4670969f110
size 3179137504

3
mox-8b.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:66a37e9f6dae4b2f2da10195130e508a1ece72bdc4338483c5c815f91e3dfeb5
size 2988820960

3
mox-8b.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f2079c916a2a46826f63f121aef03a770d8b2ba8755d1ca757472791b3c7664f
size 4321962464

3
mox-8b.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1a34b208a030ed29ec8e907e06178b46442a3dd161c9a3ac3e87443d31584b23
size 4018924000

3
mox-8b.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5fa70966bf747389f4359bb0b220cf30314587a878183fb410de12b7a5c99bf6
size 3664505312

3
mox-8b.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:230cdd54601bc65bac0a5c1b4c2aca7fa9de634da02d5d48d75e497e347fccc6
size 4675897824

3
mox-8b.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:98e8cd3cb1152951ddbe2c4fc61116d7c2062edb4621fede9f64eeb9d1c376f5
size 5130258912

3
mox-8b.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2e33e0be6914a5e3144f25f2c5445a55306ddef7a2b9fba3b0e5ed2907e16b1b
size 4920740320

3
mox-8b.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e8ecaeba767225bbfc247fc0e0579ef2aa7ab36ba1aa5f41f00e6418c3db436e
size 4692675040

3
mox-8b.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eb05a488c0be43aa4797b962310e5ade61b7f649d2abc18b013dd4b1136721d3
size 5732993504

3
mox-8b.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c8fccbbc5a6290bbc125e87b73e54326fba4e79173a1e2f4d99fe8067d043c3e
size 5599300064

3
mox-8b.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3b041562f11c93ee6bce50eff74999ff7a3b2e9565c766b1169dd28dd5953219
size 6596012512

3
mox-8b.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a44db3442929122266a6f95f88b034d284092ef05a06f6f00b0bc2bc6a76dfa9
size 5015200