mradermacher/IndustrialCoder-Thinking-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/IndustrialCoder-Thinking-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-20 15:47:41 +08:00
commit ea9659cb42
26 changed files with 225 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

59
.gitattributes vendored Normal file
View File

@@ -0,0 +1,59 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
IndustrialCoder-Thinking.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
IndustrialCoder-Thinking.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
IndustrialCoder-Thinking.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
IndustrialCoder-Thinking.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
IndustrialCoder-Thinking.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
IndustrialCoder-Thinking.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
IndustrialCoder-Thinking.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
IndustrialCoder-Thinking.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
IndustrialCoder-Thinking.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
IndustrialCoder-Thinking.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
IndustrialCoder-Thinking.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
IndustrialCoder-Thinking.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
IndustrialCoder-Thinking.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
IndustrialCoder-Thinking.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
IndustrialCoder-Thinking.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
IndustrialCoder-Thinking.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
IndustrialCoder-Thinking.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
IndustrialCoder-Thinking.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
IndustrialCoder-Thinking.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
IndustrialCoder-Thinking.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
IndustrialCoder-Thinking.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
IndustrialCoder-Thinking.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
IndustrialCoder-Thinking.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
IndustrialCoder-Thinking.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text

3
IndustrialCoder-Thinking.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fc4b95daa92f66c1505ef8c65e458d09ed4509cc2683422ebd0816719d4b235b
size 7534763456

3
IndustrialCoder-Thinking.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3c12ceb910d2a01c1dd359734191f874a5959800cf0f06317a1edbe20a74cc37
size 6877109696

3
IndustrialCoder-Thinking.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d302ff1e180b798af77c7be00e7a5ce1d68c77da942907452902e7cd8ca792bc
size 10827906496

3
IndustrialCoder-Thinking.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a733876494b1c68d830b129c054987901dc6e714b6d271b0ea805a3f7f3b5aee
size 9951034816

3
IndustrialCoder-Thinking.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9b1e55f37c964ab3483424b7a14627999f38e2675122ee49c46b04a1858c7060
size 9560153536

3
IndustrialCoder-Thinking.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6d51e7b71283fb22c0ba028c656d13fd1a9a2efd626a715cd099888655c8c96f
size 8630853056

3
IndustrialCoder-Thinking.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:88fcb133b751dc5d371454586c7dd1b162cd0653ddecfd632a4a88f2ae200762
size 14322408896

3
IndustrialCoder-Thinking.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1ea20b3bcef1272fb1a232f0b2ce6429727613cad59ee0720a36ebb030205f13
size 13949181376

3
IndustrialCoder-Thinking.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f8923b342b487491d3616a581ce4bc92470e6880e7cc60fa6a2b48efba3096f2
size 13217799616

3
IndustrialCoder-Thinking.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:60610f10c505fb3758a81c7c486530ebabf2106a558784eafd29ce4558356ddf
size 12402736576

3
IndustrialCoder-Thinking.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a24409e1b18334d4d8d748f2fc4d334563f358c7f9320e6b1211c49e0673ce68
size 17166302656

3
IndustrialCoder-Thinking.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a4eb7aca4a8b2bcbed7dcf0e996032b6e34ec83b78a69c4f084e068d27ec46eb
size 11864522176

3
IndustrialCoder-Thinking.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b7165ef11c0bb0002112d48c4e10c30e3ee0c82e6a83b16901ced4540f99a311
size 11039423936

3
IndustrialCoder-Thinking.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:74922d5395bdd8bb4d83d9c872626febab85fe0612ec23b85ba5bc19a87b2131
size 16759365056

3
IndustrialCoder-Thinking.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2f12f0488d26f12d9eb3f38afd12bd32d7cd058f583dc8821c83443466f4a374
size 15447334336

3
IndustrialCoder-Thinking.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d2faff835aa011d05fa0ec55402d632df8453d16639ed22b3446cfd96072f9b4
size 13904616896

3
IndustrialCoder-Thinking.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7fbf92b12a4fd997bd6d6b30415777a1a18d50c1623f386d8b9edc1dcf533611
size 18172116416

3
IndustrialCoder-Thinking.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f50a09fd3cd28d481711d49d88d615f4920d8e392f3081857201b13d55c65031
size 20076264896

3
IndustrialCoder-Thinking.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:65e5322bdc119560b4d7cc58af19f5f30ec14c26d36f2436d126d5790ee60d54
size 19312442816

3
IndustrialCoder-Thinking.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b7f183637e65497df754c007a4bf1f8bfd2a506b4cb105efb5a0bb47829a6ad4
size 18245516736

3
IndustrialCoder-Thinking.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a113320cff7bb86337734ed6493b23c1144ac76ef06f87e97857aa9f4f9ad968
size 22675094976

3
IndustrialCoder-Thinking.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4044e992eab03936b450f93563ac85e3380694f2342e5f3557d4bc9d806bc837
size 22051192256

3
IndustrialCoder-Thinking.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:edf55d83805124355da8ecf789cbd472a7507a89f136de541e56f7c5090f58a9
size 26247912896

3
IndustrialCoder-Thinking.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ef6a3fbac26198245f40b7fcd9a96c73b8069003cfb591cb1466033437797333
size 15011072

94
README.md Normal file
View File

@@ -0,0 +1,94 @@
---
base_model: Multilingual-Multimodal-NLP/IndustrialCoder-Thinking
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- code
- industrial-code
- reasoning
- thinking
- verilog
- cuda
- triton
- chip-design
- cad
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/Multilingual-Multimodal-NLP/IndustrialCoder-Thinking
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#IndustrialCoder-Thinking-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/IndustrialCoder-Thinking-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/IndustrialCoder-Thinking-i1-GGUF/resolve/main/IndustrialCoder-Thinking.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/IndustrialCoder-Thinking-i1-GGUF/resolve/main/IndustrialCoder-Thinking.i1-IQ1_S.gguf) | i1-IQ1_S | 7.0 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/IndustrialCoder-Thinking-i1-GGUF/resolve/main/IndustrialCoder-Thinking.i1-IQ1_M.gguf) | i1-IQ1_M | 7.6 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/IndustrialCoder-Thinking-i1-GGUF/resolve/main/IndustrialCoder-Thinking.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 8.7 | |
| [GGUF](https://huggingface.co/mradermacher/IndustrialCoder-Thinking-i1-GGUF/resolve/main/IndustrialCoder-Thinking.i1-IQ2_XS.gguf) | i1-IQ2_XS | 9.7 | |
| [GGUF](https://huggingface.co/mradermacher/IndustrialCoder-Thinking-i1-GGUF/resolve/main/IndustrialCoder-Thinking.i1-IQ2_S.gguf) | i1-IQ2_S | 10.1 | |
| [GGUF](https://huggingface.co/mradermacher/IndustrialCoder-Thinking-i1-GGUF/resolve/main/IndustrialCoder-Thinking.i1-IQ2_M.gguf) | i1-IQ2_M | 10.9 | |
| [GGUF](https://huggingface.co/mradermacher/IndustrialCoder-Thinking-i1-GGUF/resolve/main/IndustrialCoder-Thinking.i1-Q2_K_S.gguf) | i1-Q2_K_S | 11.1 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/IndustrialCoder-Thinking-i1-GGUF/resolve/main/IndustrialCoder-Thinking.i1-Q2_K.gguf) | i1-Q2_K | 12.0 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/IndustrialCoder-Thinking-i1-GGUF/resolve/main/IndustrialCoder-Thinking.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 12.5 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/IndustrialCoder-Thinking-i1-GGUF/resolve/main/IndustrialCoder-Thinking.i1-IQ3_XS.gguf) | i1-IQ3_XS | 13.3 | |
| [GGUF](https://huggingface.co/mradermacher/IndustrialCoder-Thinking-i1-GGUF/resolve/main/IndustrialCoder-Thinking.i1-Q3_K_S.gguf) | i1-Q3_K_S | 14.0 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/IndustrialCoder-Thinking-i1-GGUF/resolve/main/IndustrialCoder-Thinking.i1-IQ3_S.gguf) | i1-IQ3_S | 14.0 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/IndustrialCoder-Thinking-i1-GGUF/resolve/main/IndustrialCoder-Thinking.i1-IQ3_M.gguf) | i1-IQ3_M | 14.4 | |
| [GGUF](https://huggingface.co/mradermacher/IndustrialCoder-Thinking-i1-GGUF/resolve/main/IndustrialCoder-Thinking.i1-Q3_K_M.gguf) | i1-Q3_K_M | 15.5 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/IndustrialCoder-Thinking-i1-GGUF/resolve/main/IndustrialCoder-Thinking.i1-Q3_K_L.gguf) | i1-Q3_K_L | 16.9 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/IndustrialCoder-Thinking-i1-GGUF/resolve/main/IndustrialCoder-Thinking.i1-IQ4_XS.gguf) | i1-IQ4_XS | 17.3 | |
| [GGUF](https://huggingface.co/mradermacher/IndustrialCoder-Thinking-i1-GGUF/resolve/main/IndustrialCoder-Thinking.i1-Q4_0.gguf) | i1-Q4_0 | 18.3 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/IndustrialCoder-Thinking-i1-GGUF/resolve/main/IndustrialCoder-Thinking.i1-Q4_K_S.gguf) | i1-Q4_K_S | 18.3 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/IndustrialCoder-Thinking-i1-GGUF/resolve/main/IndustrialCoder-Thinking.i1-Q4_K_M.gguf) | i1-Q4_K_M | 19.4 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/IndustrialCoder-Thinking-i1-GGUF/resolve/main/IndustrialCoder-Thinking.i1-Q4_1.gguf) | i1-Q4_1 | 20.2 | |
| [GGUF](https://huggingface.co/mradermacher/IndustrialCoder-Thinking-i1-GGUF/resolve/main/IndustrialCoder-Thinking.i1-Q5_K_S.gguf) | i1-Q5_K_S | 22.2 | |
| [GGUF](https://huggingface.co/mradermacher/IndustrialCoder-Thinking-i1-GGUF/resolve/main/IndustrialCoder-Thinking.i1-Q5_K_M.gguf) | i1-Q5_K_M | 22.8 | |
| [GGUF](https://huggingface.co/mradermacher/IndustrialCoder-Thinking-i1-GGUF/resolve/main/IndustrialCoder-Thinking.i1-Q6_K.gguf) | i1-Q6_K | 26.3 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->