mradermacher/Narisumashi-11B-v1.5-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Narisumashi-11B-v1.5-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-17 17:34:16 +08:00
commit b4638fa9f8
27 changed files with 220 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Narisumashi-11B-v1.5.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Narisumashi-11B-v1.5.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Narisumashi-11B-v1.5.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Narisumashi-11B-v1.5.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Narisumashi-11B-v1.5.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Narisumashi-11B-v1.5.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Narisumashi-11B-v1.5.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Narisumashi-11B-v1.5.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Narisumashi-11B-v1.5.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Narisumashi-11B-v1.5.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Narisumashi-11B-v1.5.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Narisumashi-11B-v1.5.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Narisumashi-11B-v1.5.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Narisumashi-11B-v1.5.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Narisumashi-11B-v1.5.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Narisumashi-11B-v1.5.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Narisumashi-11B-v1.5.i1-Q4_0_4_4.gguf filter=lfs diff=lfs merge=lfs -text
Narisumashi-11B-v1.5.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Narisumashi-11B-v1.5.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Narisumashi-11B-v1.5.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Narisumashi-11B-v1.5.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Narisumashi-11B-v1.5.i1-Q4_0_4_8.gguf filter=lfs diff=lfs merge=lfs -text
Narisumashi-11B-v1.5.i1-Q4_0_8_8.gguf filter=lfs diff=lfs merge=lfs -text
Narisumashi-11B-v1.5.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Narisumashi-11B-v1.5.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5d5c299791fd7218308f7a731b74461dca3cd6bf658f487f1b1860e2d77ba026
size 2564742848

3
Narisumashi-11B-v1.5.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:35734a9759df66ec52f52562442758d29281d3a8b5bcf96f2324278fe127146b
size 2351226560

3
Narisumashi-11B-v1.5.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:60468eda98f378c468c66e50c1ea4bf888e33af56cd4a58e645395293a1cc2ad
size 3677486784

3
Narisumashi-11B-v1.5.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:67009e17f5564fda2e17acf18b34f22dc55b5c33dd6198d5bd5fda3f4ad29520
size 3392798400

3
Narisumashi-11B-v1.5.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aeabdbc8e3466cf0f1d649a04f2f41a1853f3b007e4456a312d6d7501848f7d2
size 3230457536

3
Narisumashi-11B-v1.5.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:195d25791685a49bf0f8db814e9a8bfa661a6572fd2c571348962c74b7c76d4c
size 2920603328

3
Narisumashi-11B-v1.5.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0cc56d58c6baac38518026f18ab70589f4c3269c53cb5ca75a044056d6a2ce62
size 4845051584

3
Narisumashi-11B-v1.5.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c8f36f7721acc6000e399acc45a06b73bb065dc150a009d8c132334701a4bb20
size 4691304128

3
Narisumashi-11B-v1.5.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9bdfebb1fd338ff167b44f6150c5ffc438c49f179328e60c4d3ba54ab5f4db39
size 4445937344

3
Narisumashi-11B-v1.5.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cf682225f7d282de824bcf3a5910e3c2df272bb519197ddbb6a431b054d8b625
size 4167433920

3
Narisumashi-11B-v1.5.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:53f8a8b1529879daa5232b539e08098fab979578643b150acaec65132bc16e4a
size 5772590784

3
Narisumashi-11B-v1.5.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e2e5005b432d6f23241509af131bc3db81fa9b9e36a04449b5e4a6088e7bc859
size 4003233472

3
Narisumashi-11B-v1.5.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ff750e826dd3b64c1e7f1ad369f143023918ec3f03b50a221a56f07b483c83f7
size 5650751168

3
Narisumashi-11B-v1.5.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:db1acc3b9010667afebd1377fefe9fde4e08aa53b2a3a53481a9bbfdb25227ec
size 5195669184

3
Narisumashi-11B-v1.5.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8cba26a776b98f77071b54acaa30596cb745bf67f9769bfd7739d75801fde4a9
size 4664565440

3
Narisumashi-11B-v1.5.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3fea4832acc894ed9af0abdf661ad061187ba1f99b9203218fde9de12c0f927e
size 6094405312

3
Narisumashi-11B-v1.5.i1-Q4_0_4_4.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cee1bf01964c3d19b5bc43b20e7fdc448bc4272c5bdbf594797390955210c2e7
size 6072385216

3
Narisumashi-11B-v1.5.i1-Q4_0_4_8.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d52d613a13fd91af903798956e3b237efe62117f7ed7d2198d43dac740aef4cf
size 6072385216

3
Narisumashi-11B-v1.5.i1-Q4_0_8_8.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ce3e9a41ecbba9e9c5667d10b309f0ca6aaf48517a2822c679c8297793a74785
size 6072385216

3
Narisumashi-11B-v1.5.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ddfe9ff5bec69e0c0b362ad61074296dc1d502b8c9640da6d1a724952d6c1bf4
size 6461669056

3
Narisumashi-11B-v1.5.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d36665136845744826f5a8a2d9bed16266d7978201915c9615a2aec8f78b209e
size 6118522560

3
Narisumashi-11B-v1.5.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:50b28f8b512febdc811dd8bf52f6b10fb4e7865e54082b7e5e395de0edcd3d37
size 7597932224

3
Narisumashi-11B-v1.5.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ebd1db94ee23c4e6d85a7007734c373af39c71972a40c0097cb654513c73a7c9
size 7397392064

3
Narisumashi-11B-v1.5.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6bf37482aba0ee0cd74965c3e6779ede9cd8387e29e1f94b2d2c2b11b0f59e0d
size 8805211840

85
README.md Normal file
View File

@@ -0,0 +1,85 @@
---
base_model: Alsebay/Narisumashi-11B-v1.5
language:
- en
library_name: transformers
license: cc-by-nc-4.0
quantized_by: mradermacher
tags:
- text-generation-inference
- transformers
- unsloth
- llama
- trl
- sft
- Roleplay
- roleplay
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/Alsebay/Narisumashi-11B-v1.5
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/Narisumashi-11B-v1.5-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Narisumashi-11B-v1.5-i1-GGUF/resolve/main/Narisumashi-11B-v1.5.i1-IQ1_S.gguf) | i1-IQ1_S | 2.5 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Narisumashi-11B-v1.5-i1-GGUF/resolve/main/Narisumashi-11B-v1.5.i1-IQ1_M.gguf) | i1-IQ1_M | 2.7 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Narisumashi-11B-v1.5-i1-GGUF/resolve/main/Narisumashi-11B-v1.5.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.0 | |
| [GGUF](https://huggingface.co/mradermacher/Narisumashi-11B-v1.5-i1-GGUF/resolve/main/Narisumashi-11B-v1.5.i1-IQ2_XS.gguf) | i1-IQ2_XS | 3.3 | |
| [GGUF](https://huggingface.co/mradermacher/Narisumashi-11B-v1.5-i1-GGUF/resolve/main/Narisumashi-11B-v1.5.i1-IQ2_S.gguf) | i1-IQ2_S | 3.5 | |
| [GGUF](https://huggingface.co/mradermacher/Narisumashi-11B-v1.5-i1-GGUF/resolve/main/Narisumashi-11B-v1.5.i1-IQ2_M.gguf) | i1-IQ2_M | 3.8 | |
| [GGUF](https://huggingface.co/mradermacher/Narisumashi-11B-v1.5-i1-GGUF/resolve/main/Narisumashi-11B-v1.5.i1-Q2_K.gguf) | i1-Q2_K | 4.1 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Narisumashi-11B-v1.5-i1-GGUF/resolve/main/Narisumashi-11B-v1.5.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 4.3 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Narisumashi-11B-v1.5-i1-GGUF/resolve/main/Narisumashi-11B-v1.5.i1-IQ3_XS.gguf) | i1-IQ3_XS | 4.5 | |
| [GGUF](https://huggingface.co/mradermacher/Narisumashi-11B-v1.5-i1-GGUF/resolve/main/Narisumashi-11B-v1.5.i1-Q3_K_S.gguf) | i1-Q3_K_S | 4.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Narisumashi-11B-v1.5-i1-GGUF/resolve/main/Narisumashi-11B-v1.5.i1-IQ3_S.gguf) | i1-IQ3_S | 4.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Narisumashi-11B-v1.5-i1-GGUF/resolve/main/Narisumashi-11B-v1.5.i1-IQ3_M.gguf) | i1-IQ3_M | 4.9 | |
| [GGUF](https://huggingface.co/mradermacher/Narisumashi-11B-v1.5-i1-GGUF/resolve/main/Narisumashi-11B-v1.5.i1-Q3_K_M.gguf) | i1-Q3_K_M | 5.3 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Narisumashi-11B-v1.5-i1-GGUF/resolve/main/Narisumashi-11B-v1.5.i1-Q3_K_L.gguf) | i1-Q3_K_L | 5.8 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Narisumashi-11B-v1.5-i1-GGUF/resolve/main/Narisumashi-11B-v1.5.i1-IQ4_XS.gguf) | i1-IQ4_XS | 5.9 | |
| [GGUF](https://huggingface.co/mradermacher/Narisumashi-11B-v1.5-i1-GGUF/resolve/main/Narisumashi-11B-v1.5.i1-Q4_0_4_4.gguf) | i1-Q4_0_4_4 | 6.2 | fast on arm, low quality |
| [GGUF](https://huggingface.co/mradermacher/Narisumashi-11B-v1.5-i1-GGUF/resolve/main/Narisumashi-11B-v1.5.i1-Q4_0_4_8.gguf) | i1-Q4_0_4_8 | 6.2 | fast on arm+i8mm, low quality |
| [GGUF](https://huggingface.co/mradermacher/Narisumashi-11B-v1.5-i1-GGUF/resolve/main/Narisumashi-11B-v1.5.i1-Q4_0_8_8.gguf) | i1-Q4_0_8_8 | 6.2 | fast on arm+sve, low quality |
| [GGUF](https://huggingface.co/mradermacher/Narisumashi-11B-v1.5-i1-GGUF/resolve/main/Narisumashi-11B-v1.5.i1-Q4_0.gguf) | i1-Q4_0 | 6.2 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Narisumashi-11B-v1.5-i1-GGUF/resolve/main/Narisumashi-11B-v1.5.i1-Q4_K_S.gguf) | i1-Q4_K_S | 6.2 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Narisumashi-11B-v1.5-i1-GGUF/resolve/main/Narisumashi-11B-v1.5.i1-Q4_K_M.gguf) | i1-Q4_K_M | 6.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Narisumashi-11B-v1.5-i1-GGUF/resolve/main/Narisumashi-11B-v1.5.i1-Q5_K_S.gguf) | i1-Q5_K_S | 7.5 | |
| [GGUF](https://huggingface.co/mradermacher/Narisumashi-11B-v1.5-i1-GGUF/resolve/main/Narisumashi-11B-v1.5.i1-Q5_K_M.gguf) | i1-Q5_K_M | 7.7 | |
| [GGUF](https://huggingface.co/mradermacher/Narisumashi-11B-v1.5-i1-GGUF/resolve/main/Narisumashi-11B-v1.5.i1-Q6_K.gguf) | i1-Q6_K | 8.9 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:40fca0c9cffbb4c467f52efa8ad386e2c303a8ffd01b858550cb740e38522a3b
size 7482253