mradermacher/Lune-Mamba-3B-v1-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Lune-Mamba-3B-v1-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-30 18:10:16 +08:00
commit c549a04082
27 changed files with 225 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Lune-Mamba-3B-v1.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Lune-Mamba-3B-v1.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Lune-Mamba-3B-v1.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Lune-Mamba-3B-v1.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Lune-Mamba-3B-v1.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Lune-Mamba-3B-v1.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Lune-Mamba-3B-v1.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Lune-Mamba-3B-v1.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Lune-Mamba-3B-v1.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Lune-Mamba-3B-v1.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Lune-Mamba-3B-v1.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Lune-Mamba-3B-v1.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Lune-Mamba-3B-v1.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Lune-Mamba-3B-v1.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Lune-Mamba-3B-v1.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Lune-Mamba-3B-v1.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Lune-Mamba-3B-v1.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Lune-Mamba-3B-v1.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Lune-Mamba-3B-v1.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Lune-Mamba-3B-v1.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Lune-Mamba-3B-v1.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Lune-Mamba-3B-v1.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Lune-Mamba-3B-v1.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Lune-Mamba-3B-v1.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Lune-Mamba-3B-v1.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
Lune-Mamba-3B-v1.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c81e58b11aaf0bbe9e750562950fd776a086412b5ed9b8baefe59b670ec9bf30
size 879926080

3
Lune-Mamba-3B-v1.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a9d195516f34c153eba00e3387342cf569c973d380d07a93ea8373c48d6746dd
size 812428096

3
Lune-Mamba-3B-v1.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f365ee569cbb60580892339a8b5715d1a195adce917bb3a3d1e7fabc49edd237
size 1205119808

3
Lune-Mamba-3B-v1.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9b5416ff24ae6bf1c14b7f68a73f575c5c6c84f605ce9a99adadd1ece5e4f931
size 1115122496

3
Lune-Mamba-3B-v1.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1de1d7500fcb982b075c15ee32f52d24979ad3aaa8df93d948e888f283367d2e
size 1082944320

3
Lune-Mamba-3B-v1.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:df584427e5aab7d1ecabc8b02691c29dec5052dfbea0d71306df07df12052ed4
size 992422720

3
Lune-Mamba-3B-v1.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:60bacbebf33c443899ae9b8e97442e8d21edabc820e297fc672dbe6b5f4108b7
size 1561332544

3
Lune-Mamba-3B-v1.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:73f86c3ffa3370951f940f3dbdf58143a6363d02ce22645bdb502ac01cbf2d32
size 1547406144

3
Lune-Mamba-3B-v1.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c0125357e6e1ec3e77d5895e843a9a846f136c4fefdd9a3ac507f0843fbf7ee6
size 1499237184

3
Lune-Mamba-3B-v1.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c489e492a1bc41f24ed7b25f152460435bda9efb2d48fb8206c383ea43023d43
size 1379674944

3
Lune-Mamba-3B-v1.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dc9ce1d63a7b19368b7d29a7bd010bae1e1bc661cdf4487f954b541283cb7788
size 1971116864

3
Lune-Mamba-3B-v1.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4a16fa263bc01a4fccf6a2db4f8e16d99ecd6c668ac51c2716b9409da0a7fed8
size 1871420224

3
Lune-Mamba-3B-v1.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e9ff25ab7c31fcf3b44c2c85a30a6d64fa6454d329b941fbd1da55da4f4bfed3
size 1293679424

3
Lune-Mamba-3B-v1.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:807037fa7e522b42f7389362ff39c108d73302a30a5132a6bc5c429ab1b1a9ad
size 1243052864

3
Lune-Mamba-3B-v1.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:020988074ba21daad7ee63d10482058436e91adcd62a0162e027dec1f1ba0084
size 1725827904

3
Lune-Mamba-3B-v1.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0a2bfa20ce0b1c9c0d9c298ca5605fd339f08d7d8b09672f7c2d35482b02c6bc
size 1643776832

3
Lune-Mamba-3B-v1.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:477600b9e4e7e614605ed16d8dac9ae36bff14dbd2116b28b12f3cccc3ddc61e
size 1547406144

3
Lune-Mamba-3B-v1.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:951ce070651f60359e3ef29664fd5ab784b5f11e32fe759bccaa79f0b9e8a81d
size 1976359744

3
Lune-Mamba-3B-v1.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7faf7043b68fcb679127d4310b9c8d0636a3f0698d58b6ba6a0afb76fad7033c
size 2170510144

3
Lune-Mamba-3B-v1.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b9fb68492981f0befd164ed1969e1e7f316057fa7797ecab022429e9d3f42cea
size 2058165056

3
Lune-Mamba-3B-v1.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3ba58d9a5939d5c45617a6c6b561ea49c62231388e3c77f8775ecbe1e43d8a78
size 1982126912

3
Lune-Mamba-3B-v1.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0ad0f3e8544a2ff8969ea5f9846ceb0c063cc31071eaddd358c3406c2caf2133
size 2414746432

3
Lune-Mamba-3B-v1.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2a4ddb81753aaa7080ddb5a4c29f248622df411328f6dbfb56080e0c1b61802e
size 2369903424

3
Lune-Mamba-3B-v1.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7ce8a1deb5f147aed3ccd8eaa9f280ca295af1366eb30df5ee7c9872c6496a66
size 2793614144

3
Lune-Mamba-3B-v1.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:49c7bbcaf6ef81011461047506356c0b331131f551a9927b1a8953d2bf1819f2
size 3013856

90
README.md Normal file
View File

@@ -0,0 +1,90 @@
---
base_model: allura-org/Lune-Mamba-3B-v1
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- conversational
- instruct
- mamba
- hybrid
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/allura-org/Lune-Mamba-3B-v1
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Lune-Mamba-3B-v1-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Lune-Mamba-3B-v1-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Lune-Mamba-3B-v1-i1-GGUF/resolve/main/Lune-Mamba-3B-v1.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Lune-Mamba-3B-v1-i1-GGUF/resolve/main/Lune-Mamba-3B-v1.i1-IQ1_S.gguf) | i1-IQ1_S | 0.9 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Lune-Mamba-3B-v1-i1-GGUF/resolve/main/Lune-Mamba-3B-v1.i1-IQ1_M.gguf) | i1-IQ1_M | 1.0 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Lune-Mamba-3B-v1-i1-GGUF/resolve/main/Lune-Mamba-3B-v1.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/Lune-Mamba-3B-v1-i1-GGUF/resolve/main/Lune-Mamba-3B-v1.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/Lune-Mamba-3B-v1-i1-GGUF/resolve/main/Lune-Mamba-3B-v1.i1-IQ2_S.gguf) | i1-IQ2_S | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/Lune-Mamba-3B-v1-i1-GGUF/resolve/main/Lune-Mamba-3B-v1.i1-IQ2_M.gguf) | i1-IQ2_M | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/Lune-Mamba-3B-v1-i1-GGUF/resolve/main/Lune-Mamba-3B-v1.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.3 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Lune-Mamba-3B-v1-i1-GGUF/resolve/main/Lune-Mamba-3B-v1.i1-Q2_K.gguf) | i1-Q2_K | 1.4 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Lune-Mamba-3B-v1-i1-GGUF/resolve/main/Lune-Mamba-3B-v1.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.5 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Lune-Mamba-3B-v1-i1-GGUF/resolve/main/Lune-Mamba-3B-v1.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.6 | |
| [GGUF](https://huggingface.co/mradermacher/Lune-Mamba-3B-v1-i1-GGUF/resolve/main/Lune-Mamba-3B-v1.i1-IQ3_S.gguf) | i1-IQ3_S | 1.6 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Lune-Mamba-3B-v1-i1-GGUF/resolve/main/Lune-Mamba-3B-v1.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Lune-Mamba-3B-v1-i1-GGUF/resolve/main/Lune-Mamba-3B-v1.i1-IQ3_M.gguf) | i1-IQ3_M | 1.7 | |
| [GGUF](https://huggingface.co/mradermacher/Lune-Mamba-3B-v1-i1-GGUF/resolve/main/Lune-Mamba-3B-v1.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.7 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Lune-Mamba-3B-v1-i1-GGUF/resolve/main/Lune-Mamba-3B-v1.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.8 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Lune-Mamba-3B-v1-i1-GGUF/resolve/main/Lune-Mamba-3B-v1.i1-IQ4_XS.gguf) | i1-IQ4_XS | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/Lune-Mamba-3B-v1-i1-GGUF/resolve/main/Lune-Mamba-3B-v1.i1-IQ4_NL.gguf) | i1-IQ4_NL | 2.1 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Lune-Mamba-3B-v1-i1-GGUF/resolve/main/Lune-Mamba-3B-v1.i1-Q4_0.gguf) | i1-Q4_0 | 2.1 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Lune-Mamba-3B-v1-i1-GGUF/resolve/main/Lune-Mamba-3B-v1.i1-Q4_K_S.gguf) | i1-Q4_K_S | 2.1 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Lune-Mamba-3B-v1-i1-GGUF/resolve/main/Lune-Mamba-3B-v1.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.2 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Lune-Mamba-3B-v1-i1-GGUF/resolve/main/Lune-Mamba-3B-v1.i1-Q4_1.gguf) | i1-Q4_1 | 2.3 | |
| [GGUF](https://huggingface.co/mradermacher/Lune-Mamba-3B-v1-i1-GGUF/resolve/main/Lune-Mamba-3B-v1.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.5 | |
| [GGUF](https://huggingface.co/mradermacher/Lune-Mamba-3B-v1-i1-GGUF/resolve/main/Lune-Mamba-3B-v1.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.5 | |
| [GGUF](https://huggingface.co/mradermacher/Lune-Mamba-3B-v1-i1-GGUF/resolve/main/Lune-Mamba-3B-v1.i1-Q6_K.gguf) | i1-Q6_K | 2.9 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->