mradermacher/TinySolar-248m-4k-code-instruct-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/TinySolar-248m-4k-code-instruct-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-08 08:55:10 +08:00
commit 0eeb76baa4
27 changed files with 207 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

59
.gitattributes vendored Normal file
View File

@@ -0,0 +1,59 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
TinySolar-248m-4k-code-instruct.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
TinySolar-248m-4k-code-instruct.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
TinySolar-248m-4k-code-instruct.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
TinySolar-248m-4k-code-instruct.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
TinySolar-248m-4k-code-instruct.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
TinySolar-248m-4k-code-instruct.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
TinySolar-248m-4k-code-instruct.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
TinySolar-248m-4k-code-instruct.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
TinySolar-248m-4k-code-instruct.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
TinySolar-248m-4k-code-instruct.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
TinySolar-248m-4k-code-instruct.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
TinySolar-248m-4k-code-instruct.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
TinySolar-248m-4k-code-instruct.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
TinySolar-248m-4k-code-instruct.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
TinySolar-248m-4k-code-instruct.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
TinySolar-248m-4k-code-instruct.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
TinySolar-248m-4k-code-instruct.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
TinySolar-248m-4k-code-instruct.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
TinySolar-248m-4k-code-instruct.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
TinySolar-248m-4k-code-instruct.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
TinySolar-248m-4k-code-instruct.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
TinySolar-248m-4k-code-instruct.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
TinySolar-248m-4k-code-instruct.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
TinySolar-248m-4k-code-instruct.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

76
README.md Normal file
View File

@@ -0,0 +1,76 @@
---
base_model: upstage/TinySolar-248m-4k-code-instruct
language:
- en
library_name: transformers
license: apache-2.0
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/upstage/TinySolar-248m-4k-code-instruct
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/TinySolar-248m-4k-code-instruct-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/TinySolar-248m-4k-code-instruct-i1-GGUF/resolve/main/TinySolar-248m-4k-code-instruct.i1-IQ1_S.gguf) | i1-IQ1_S | 0.2 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/TinySolar-248m-4k-code-instruct-i1-GGUF/resolve/main/TinySolar-248m-4k-code-instruct.i1-IQ1_M.gguf) | i1-IQ1_M | 0.2 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/TinySolar-248m-4k-code-instruct-i1-GGUF/resolve/main/TinySolar-248m-4k-code-instruct.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/TinySolar-248m-4k-code-instruct-i1-GGUF/resolve/main/TinySolar-248m-4k-code-instruct.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/TinySolar-248m-4k-code-instruct-i1-GGUF/resolve/main/TinySolar-248m-4k-code-instruct.i1-IQ2_S.gguf) | i1-IQ2_S | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/TinySolar-248m-4k-code-instruct-i1-GGUF/resolve/main/TinySolar-248m-4k-code-instruct.i1-IQ2_M.gguf) | i1-IQ2_M | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/TinySolar-248m-4k-code-instruct-i1-GGUF/resolve/main/TinySolar-248m-4k-code-instruct.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.2 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/TinySolar-248m-4k-code-instruct-i1-GGUF/resolve/main/TinySolar-248m-4k-code-instruct.i1-Q2_K.gguf) | i1-Q2_K | 0.2 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/TinySolar-248m-4k-code-instruct-i1-GGUF/resolve/main/TinySolar-248m-4k-code-instruct.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.2 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/TinySolar-248m-4k-code-instruct-i1-GGUF/resolve/main/TinySolar-248m-4k-code-instruct.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/TinySolar-248m-4k-code-instruct-i1-GGUF/resolve/main/TinySolar-248m-4k-code-instruct.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.2 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/TinySolar-248m-4k-code-instruct-i1-GGUF/resolve/main/TinySolar-248m-4k-code-instruct.i1-IQ3_S.gguf) | i1-IQ3_S | 0.2 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/TinySolar-248m-4k-code-instruct-i1-GGUF/resolve/main/TinySolar-248m-4k-code-instruct.i1-IQ3_M.gguf) | i1-IQ3_M | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/TinySolar-248m-4k-code-instruct-i1-GGUF/resolve/main/TinySolar-248m-4k-code-instruct.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/TinySolar-248m-4k-code-instruct-i1-GGUF/resolve/main/TinySolar-248m-4k-code-instruct.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.2 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/TinySolar-248m-4k-code-instruct-i1-GGUF/resolve/main/TinySolar-248m-4k-code-instruct.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/TinySolar-248m-4k-code-instruct-i1-GGUF/resolve/main/TinySolar-248m-4k-code-instruct.i1-Q4_0.gguf) | i1-Q4_0 | 0.2 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/TinySolar-248m-4k-code-instruct-i1-GGUF/resolve/main/TinySolar-248m-4k-code-instruct.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.2 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/TinySolar-248m-4k-code-instruct-i1-GGUF/resolve/main/TinySolar-248m-4k-code-instruct.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.2 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/TinySolar-248m-4k-code-instruct-i1-GGUF/resolve/main/TinySolar-248m-4k-code-instruct.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.3 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/TinySolar-248m-4k-code-instruct-i1-GGUF/resolve/main/TinySolar-248m-4k-code-instruct.i1-Q4_1.gguf) | i1-Q4_1 | 0.3 | |
| [GGUF](https://huggingface.co/mradermacher/TinySolar-248m-4k-code-instruct-i1-GGUF/resolve/main/TinySolar-248m-4k-code-instruct.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.3 | |
| [GGUF](https://huggingface.co/mradermacher/TinySolar-248m-4k-code-instruct-i1-GGUF/resolve/main/TinySolar-248m-4k-code-instruct.i1-Q5_K_M.gguf) | i1-Q5_K_M | 0.3 | |
| [GGUF](https://huggingface.co/mradermacher/TinySolar-248m-4k-code-instruct-i1-GGUF/resolve/main/TinySolar-248m-4k-code-instruct.i1-Q6_K.gguf) | i1-Q6_K | 0.3 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
TinySolar-248m-4k-code-instruct.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5a183685dd8fd1060711ee110fd8e1a21c59b814f059c26f44ef91f8bef1809e
size 76050688

3
TinySolar-248m-4k-code-instruct.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7370899178327a85bffdac3ac3fbcc724d8156d22f5d53af6e0432879f9aaed5
size 72241408

3
TinySolar-248m-4k-code-instruct.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7a925846078b96d0f42a759fcd37c4adb66cf350adaef623ade801fc92d21a54
size 98474240

3
TinySolar-248m-4k-code-instruct.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fc00be9b366aa18155c869d2e811dc6480dbf0009c7c8930d106f5bfbb64e3b4
size 93395200

3
TinySolar-248m-4k-code-instruct.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b920dba5e29cf665710f08edfb86fbf8d01fc944bcacd4e660049d0a07929b51
size 87871744

3
TinySolar-248m-4k-code-instruct.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:10c4ceee5af7580773fe518bd6301e9985f91a43254293232ba863cefa60f565
size 82399488

3
TinySolar-248m-4k-code-instruct.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d12594bc420e149b6d1f583c694eab68ec14141fbdd52164564a8d0db685eb98
size 122831104

3
TinySolar-248m-4k-code-instruct.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2acb33c60ef0e96987d67ab964bb860ff3bec6fb88bfa1973f785c78d3918d7d
size 120602880

3
TinySolar-248m-4k-code-instruct.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1c2b230743655f13edcdad60d2822855b7f15824f0d6e92f410b132570da2c1b
size 116326656

3
TinySolar-248m-4k-code-instruct.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e73333a158cd277f72434d4c4827a30837ffdfeeb471f03cc5edb7f94e5255bf
size 107452672

3
TinySolar-248m-4k-code-instruct.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7012adf2e35b0f156b82776f2e5225660088b902d62bf0a8948331e3ad621174
size 149162240

3
TinySolar-248m-4k-code-instruct.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:522dd1f07f67e954db148731cfd1db069f7cc9c0b8a59d18655324bafa34b1a6
size 142534912

3
TinySolar-248m-4k-code-instruct.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4eab36237aeddc67d0999ef0a1d9b51dbcd577a0e7934ac5956a63e92ad6d73c
size 105453824

3
TinySolar-248m-4k-code-instruct.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c58ced3de04e55da7b8a78937c8adc7b218719b2fbea8a0ec3c7b32bdf43abd8
size 100047104

3
TinySolar-248m-4k-code-instruct.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1e4bd426482c28d74cb66e6c575d569bcc1ae7b0857acac1764e945412f76da0
size 137216256

3
TinySolar-248m-4k-code-instruct.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f0a74a4701faa49078acd3c8b03b1960091d8049827eb350f674ea894e7b448c
size 129024256

3
TinySolar-248m-4k-code-instruct.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3f7d372654b96f3640e15e8a10cc9145a794ff2df3059e6cae0c3913e8c3fe0d
size 120185088

3
TinySolar-248m-4k-code-instruct.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ef487ab0299627fa44f6456deee6565a9dcd843cbc7a6009872e9376e5a531f0
size 149031168

3
TinySolar-248m-4k-code-instruct.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e5ff661666404765bed02f1ac180ece3f40d168fbbc799107ff2010197f1b836
size 162220288

3
TinySolar-248m-4k-code-instruct.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:48d695bdb9b170200395d426602d394b68b46a362359143aab0eeff10b340777
size 155662592

3
TinySolar-248m-4k-code-instruct.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:33ea2d4e9ebbdcee093094fe52ea44ca7d583b097b74018ed81b498273aa1030
size 149424384

3
TinySolar-248m-4k-code-instruct.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6f577be12bc7c00bf12dd860d447afe60a68dcded6f4096d6ae5898d85106732
size 179222784

3
TinySolar-248m-4k-code-instruct.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:82b8b7cc33c93aac276f28f7fffae2f579903acccf3dbca64705be903b4df9a2
size 175671552

3
TinySolar-248m-4k-code-instruct.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a00aa9da88163c85f3373012d9e66c01d0fcfb43ec8bcdba01f67e4192f664be
size 204255488

BIN
imatrix.dat Normal file
View File

Binary file not shown.