mradermacher/mira-7b-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/mira-7b-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-18 19:46:18 +08:00
commit f434dd66a5
27 changed files with 219 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
mira-7b.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
mira-7b.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
mira-7b.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
mira-7b.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
mira-7b.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
mira-7b.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
mira-7b.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
mira-7b.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
mira-7b.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
mira-7b.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
mira-7b.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
mira-7b.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
mira-7b.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
mira-7b.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
mira-7b.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
mira-7b.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
mira-7b.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
mira-7b.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
mira-7b.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
mira-7b.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
mira-7b.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
mira-7b.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
mira-7b.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
mira-7b.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
mira-7b.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text

84
README.md Normal file
View File

@@ -0,0 +1,84 @@
---
base_model: emrahemrez/mira-7b
language:
- en
library_name: transformers
mradermacher:
readme_rev: 1
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/emrahemrez/mira-7b
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#mira-7b-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/mira-7b-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/mira-7b-i1-GGUF/resolve/main/mira-7b.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/mira-7b-i1-GGUF/resolve/main/mira-7b.i1-IQ1_S.gguf) | i1-IQ1_S | 2.0 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/mira-7b-i1-GGUF/resolve/main/mira-7b.i1-IQ1_M.gguf) | i1-IQ1_M | 2.1 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/mira-7b-i1-GGUF/resolve/main/mira-7b.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.4 | |
| [GGUF](https://huggingface.co/mradermacher/mira-7b-i1-GGUF/resolve/main/mira-7b.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.6 | |
| [GGUF](https://huggingface.co/mradermacher/mira-7b-i1-GGUF/resolve/main/mira-7b.i1-IQ2_S.gguf) | i1-IQ2_S | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/mira-7b-i1-GGUF/resolve/main/mira-7b.i1-IQ2_M.gguf) | i1-IQ2_M | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/mira-7b-i1-GGUF/resolve/main/mira-7b.i1-Q2_K_S.gguf) | i1-Q2_K_S | 2.9 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/mira-7b-i1-GGUF/resolve/main/mira-7b.i1-Q2_K.gguf) | i1-Q2_K | 3.1 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/mira-7b-i1-GGUF/resolve/main/mira-7b.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.2 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/mira-7b-i1-GGUF/resolve/main/mira-7b.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.4 | |
| [GGUF](https://huggingface.co/mradermacher/mira-7b-i1-GGUF/resolve/main/mira-7b.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/mira-7b-i1-GGUF/resolve/main/mira-7b.i1-IQ3_S.gguf) | i1-IQ3_S | 3.6 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/mira-7b-i1-GGUF/resolve/main/mira-7b.i1-IQ3_M.gguf) | i1-IQ3_M | 3.7 | |
| [GGUF](https://huggingface.co/mradermacher/mira-7b-i1-GGUF/resolve/main/mira-7b.i1-Q3_K_M.gguf) | i1-Q3_K_M | 3.9 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/mira-7b-i1-GGUF/resolve/main/mira-7b.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.2 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/mira-7b-i1-GGUF/resolve/main/mira-7b.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.3 | |
| [GGUF](https://huggingface.co/mradermacher/mira-7b-i1-GGUF/resolve/main/mira-7b.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.5 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/mira-7b-i1-GGUF/resolve/main/mira-7b.i1-Q4_0.gguf) | i1-Q4_0 | 4.5 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/mira-7b-i1-GGUF/resolve/main/mira-7b.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.6 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/mira-7b-i1-GGUF/resolve/main/mira-7b.i1-Q4_K_M.gguf) | i1-Q4_K_M | 4.8 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/mira-7b-i1-GGUF/resolve/main/mira-7b.i1-Q4_1.gguf) | i1-Q4_1 | 5.0 | |
| [GGUF](https://huggingface.co/mradermacher/mira-7b-i1-GGUF/resolve/main/mira-7b.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.4 | |
| [GGUF](https://huggingface.co/mradermacher/mira-7b-i1-GGUF/resolve/main/mira-7b.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.5 | |
| [GGUF](https://huggingface.co/mradermacher/mira-7b-i1-GGUF/resolve/main/mira-7b.i1-Q6_K.gguf) | i1-Q6_K | 6.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
mira-7b.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0940ac09abf6732e4bfc645c196897e1f2c6926c675e44155f1a2b6c5106f617
size 2042196544

3
mira-7b.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:71cdcb7eaf225dd398385b2a64bf21930a049c79017b93d50a267dc3e749f0e7
size 1903667776

3
mira-7b.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0eff5f30d0952b226823fd8c3ac330d633c9579919ac03cfa7ae36f46737400a
size 2780342848

3
mira-7b.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:432501f69c057eea936547c6c2a1abfb40de0da2d5500378561afc5ab77dfbff
size 2595637824

3
mira-7b.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9f47292de50cac4ac2f87fac85e6a6682ea5bc9359bb1ae688438edd8ce587b9
size 2469022272

3
mira-7b.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e901f3392f620c8c4db4fa36400c5b036f6dbe9e0560e561851192166fa0b4bd
size 2273077824

3
mira-7b.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8db6dd7bcdf56453637e2b434feb4588f8197ef94753c9eb1780050d89670744
size 3574012480

3
mira-7b.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:183d2d3e2a09bf2767ca4f5ead4c12e4345d4764cfe59a638342f91a7c27abb4
size 3499192896

3
mira-7b.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1941bfa180554e5615cdad4c570171e349bfaa55d818f561ccb2d7d0a72d14e3
size 3346256448

3
mira-7b.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4c859c344b928b2789c400e920dca28306cd46b442c51981ccf8b28355afb8e0
size 3114515008

3
mira-7b.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6301291371ad8efaa21b80b87c3063666dc5df0e6a9705072eb0b0e952ab2267
size 4437813824

3
mira-7b.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:974b23b9ff4588c0deeefaa09d30779a3bae3466c9e9e2211923e4da525a5936
size 4218473024

3
mira-7b.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a1e8be6d96f176b5897c7d3963621adc35174c1ed806d95cf8e6e5ad9f3dacf4
size 3015940672

3
mira-7b.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:da6280a6dd65992b680b438f3922820e04f8ea251bce612369de6c4e3a2ca826
size 2834074176

3
mira-7b.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5a3a139f700f68c8dd305433c8d7d4b7c9038f5745c7aa690c02a3c6104b9503
size 4088459840

3
mira-7b.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8da3f122829dc971f05e7ae33254b4f945b79693e961982af080e8c50addd0db
size 3808391744

3
mira-7b.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6393c235b7d8dd11e30f9fb22131c59af3d0b356ad62ef79f4795246b7d4c621
size 3492368960

3
mira-7b.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:73f9a312c73b518dd8f51112da551773763ecd3572be94d6d9bb51c880dc58ef
size 4444121664

3
mira-7b.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:03c1c40e779bc4acbc175fe3615d56123b7d916cd4bfb994a7a5f08b086052b4
size 4873284160

3
mira-7b.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:13c9bffbea4df296b9e37f26d6ae93851c3d5a8c4af90dfc6694057cce4c98b1
size 4683074112

3
mira-7b.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4e1e1b5fe698f2cdb9f1e8034f2a498de6ae45730b85d0308d2fe6652da45a4f
size 4457769536

3
mira-7b.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c31b6692c399b712fb18f381a3711f2a0aefae59aaf3d25f9e7cc1f47a596c21
size 5444831808

3
mira-7b.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:664444908d2b2c10a3cbd6e3c2ba07ad22f567fa9ec8c8746ee63593b987cd49
size 5315177024

3
mira-7b.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:18296347d0975e1e43175656f53aaee0dcb6253e759a1531945233832af775e2
size 6254199360

3
mira-7b.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bcbf6ffe08499283b1e89af9ebcffdc68800975b721163fe3b65fdd55c7448b4
size 4560352