mradermacher/Intern-S1-mini-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Intern-S1-mini-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-06 13:43:49 +08:00
commit a779f218b0
27 changed files with 220 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Intern-S1-mini.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Intern-S1-mini.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Intern-S1-mini.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Intern-S1-mini.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Intern-S1-mini.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Intern-S1-mini.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Intern-S1-mini.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Intern-S1-mini.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Intern-S1-mini.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Intern-S1-mini.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Intern-S1-mini.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Intern-S1-mini.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Intern-S1-mini.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Intern-S1-mini.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Intern-S1-mini.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Intern-S1-mini.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Intern-S1-mini.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Intern-S1-mini.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Intern-S1-mini.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Intern-S1-mini.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Intern-S1-mini.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Intern-S1-mini.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Intern-S1-mini.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Intern-S1-mini.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Intern-S1-mini.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Intern-S1-mini.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f697da05d3902988891e53811acdb2757b4f2125fa70883ebeff4a8e37e243e6
size 2261502560

3
Intern-S1-mini.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:88c2c899c682ede14767032ecd10f05f61c6b8f49e3f8171c12475d72ab94b4a
size 2121124448

3
Intern-S1-mini.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c01ae4631a6cd2dcfaf4562ea15ad1c5a4f5dd702ed72173fa883251b36d5f1c
size 3057801824

3
Intern-S1-mini.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3af234fa0f8dc4a22bdb5882eefeea71356cb98a52ea4aee7fda62feb84c7d29
size 2870631008

3
Intern-S1-mini.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5ae6b2f54fe3a43284435e29281f598a310a426f7fb2fa015046559825345527
size 2701511264

3
Intern-S1-mini.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8d07548503da447100dfdcbb31c637905fb54ccc47ba628239a39ca5b9361da6
size 2495466080

3
Intern-S1-mini.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a6644ba16cca3239b29c443fbe2685c2df43b6b9ed672c8226fc236cd9520f3f
size 3903203936

3
Intern-S1-mini.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c50832e8bc3ef1bb2780266a3c5f20f75860cbc3ae99e9e872acedb816bad752
size 3796249184

3
Intern-S1-mini.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e1c7598f89bed9559aa0cfad5834dcbe25a34da21a5eaed8b6fbf6e42f102efb
size 3633457760

3
Intern-S1-mini.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:19d4016dfc38e62e9ad4c584b8b01790fc9761085e72ca34a7a3ab8229e0e3e8
size 3375520352

3
Intern-S1-mini.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c951daeceff42701a1436e43d34316b08bc643c179be8ee0f73d35122c63c2cc
size 4800903776

3
Intern-S1-mini.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:67653041cdb9f95d8fcf2404248b4fe2ab1d4065f2902e1aa4d669e5c947d2f5
size 4568955488

3
Intern-S1-mini.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:366f256dc4e190f4e79b88247712e932dce156be7bd20bfee4155f34ea95d6a4
size 3287784032

3
Intern-S1-mini.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9e1ac7a74b0d14de971408a2380f934869a00d02f64dfff995098419b655f262
size 3089603168

3
Intern-S1-mini.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5dc289ec7c21bd1a4b0e8e2a3f888a68c006f3c148e767270096ef8ba89af18b
size 4437977696

3
Intern-S1-mini.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c976b51f7ad825cb11fde61c31263ad85951abcde63e934d7fd93a9dedadc1a8
size 4130744928

3
Intern-S1-mini.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ecd15fb7400d31a2386a256d8a97919beeadf8042e07917490dfd31bd1da61ca
size 3776195168

3
Intern-S1-mini.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:77e0234b9145063030cfbd5c6485156647e8af1cd218d6f5b5a15f37d0f6b362
size 4794612320

3
Intern-S1-mini.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7434e1f8d9d7f86e99df3e3cb240f0f2ad1f01c5bd0d0fe3dec9920b8b3d5baa
size 5255363168

3
Intern-S1-mini.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:44c0ec65914512f70694b22e0c763f75d8e1ad45affd446180228d511c76e393
size 5035063904

3
Intern-S1-mini.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9f9ca74385b441b9c7b39355f2821d50fb1355fea220e183705a4b26ef7ddcfe
size 4809292384

3
Intern-S1-mini.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9242634e77c374bba8cda36985c689d09513da0a1b3b681fa6c8b996a079990b
size 5859048032

3
Intern-S1-mini.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:38cbc3bf49487ff709ccacaa85935cee4ccb4532cc6a852618047b375439af40
size 5728696928

3
Intern-S1-mini.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3895399f9775fb89268c9b650fe77f0d0b3ad306502f5db8d01476b35e57ae75
size 6734531168

3
Intern-S1-mini.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:96829d8eca75435c5f932fafee96713afccb3cce1ce3bf633af9941175c8f9bd
size 5347200

85
README.md Normal file
View File

@@ -0,0 +1,85 @@
---
base_model: internlm/Intern-S1-mini
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/internlm/Intern-S1-mini
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Intern-S1-mini-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Intern-S1-mini-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Intern-S1-mini-i1-GGUF/resolve/main/Intern-S1-mini.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Intern-S1-mini-i1-GGUF/resolve/main/Intern-S1-mini.i1-IQ1_S.gguf) | i1-IQ1_S | 2.2 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Intern-S1-mini-i1-GGUF/resolve/main/Intern-S1-mini.i1-IQ1_M.gguf) | i1-IQ1_M | 2.4 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Intern-S1-mini-i1-GGUF/resolve/main/Intern-S1-mini.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.6 | |
| [GGUF](https://huggingface.co/mradermacher/Intern-S1-mini-i1-GGUF/resolve/main/Intern-S1-mini.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.8 | |
| [GGUF](https://huggingface.co/mradermacher/Intern-S1-mini-i1-GGUF/resolve/main/Intern-S1-mini.i1-IQ2_S.gguf) | i1-IQ2_S | 3.0 | |
| [GGUF](https://huggingface.co/mradermacher/Intern-S1-mini-i1-GGUF/resolve/main/Intern-S1-mini.i1-IQ2_M.gguf) | i1-IQ2_M | 3.2 | |
| [GGUF](https://huggingface.co/mradermacher/Intern-S1-mini-i1-GGUF/resolve/main/Intern-S1-mini.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.2 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Intern-S1-mini-i1-GGUF/resolve/main/Intern-S1-mini.i1-Q2_K.gguf) | i1-Q2_K | 3.4 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Intern-S1-mini-i1-GGUF/resolve/main/Intern-S1-mini.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.5 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Intern-S1-mini-i1-GGUF/resolve/main/Intern-S1-mini.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.7 | |
| [GGUF](https://huggingface.co/mradermacher/Intern-S1-mini-i1-GGUF/resolve/main/Intern-S1-mini.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.9 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Intern-S1-mini-i1-GGUF/resolve/main/Intern-S1-mini.i1-IQ3_S.gguf) | i1-IQ3_S | 3.9 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Intern-S1-mini-i1-GGUF/resolve/main/Intern-S1-mini.i1-IQ3_M.gguf) | i1-IQ3_M | 4.0 | |
| [GGUF](https://huggingface.co/mradermacher/Intern-S1-mini-i1-GGUF/resolve/main/Intern-S1-mini.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Intern-S1-mini-i1-GGUF/resolve/main/Intern-S1-mini.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.5 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Intern-S1-mini-i1-GGUF/resolve/main/Intern-S1-mini.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.7 | |
| [GGUF](https://huggingface.co/mradermacher/Intern-S1-mini-i1-GGUF/resolve/main/Intern-S1-mini.i1-Q4_0.gguf) | i1-Q4_0 | 4.9 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Intern-S1-mini-i1-GGUF/resolve/main/Intern-S1-mini.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.9 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Intern-S1-mini-i1-GGUF/resolve/main/Intern-S1-mini.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.9 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Intern-S1-mini-i1-GGUF/resolve/main/Intern-S1-mini.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.1 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Intern-S1-mini-i1-GGUF/resolve/main/Intern-S1-mini.i1-Q4_1.gguf) | i1-Q4_1 | 5.4 | |
| [GGUF](https://huggingface.co/mradermacher/Intern-S1-mini-i1-GGUF/resolve/main/Intern-S1-mini.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/Intern-S1-mini-i1-GGUF/resolve/main/Intern-S1-mini.i1-Q5_K_M.gguf) | i1-Q5_K_M | 6.0 | |
| [GGUF](https://huggingface.co/mradermacher/Intern-S1-mini-i1-GGUF/resolve/main/Intern-S1-mini.i1-Q6_K.gguf) | i1-Q6_K | 6.8 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->