mradermacher/Neuron-V1-3B-Instruct-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Neuron-V1-3B-Instruct-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-10-03 19:53:18 +08:00
commit aced160bd7
27 changed files with 230 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Neuron-V1-3B-Instruct.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Neuron-V1-3B-Instruct.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Neuron-V1-3B-Instruct.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Neuron-V1-3B-Instruct.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Neuron-V1-3B-Instruct.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Neuron-V1-3B-Instruct.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Neuron-V1-3B-Instruct.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Neuron-V1-3B-Instruct.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Neuron-V1-3B-Instruct.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Neuron-V1-3B-Instruct.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Neuron-V1-3B-Instruct.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Neuron-V1-3B-Instruct.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Neuron-V1-3B-Instruct.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Neuron-V1-3B-Instruct.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Neuron-V1-3B-Instruct.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Neuron-V1-3B-Instruct.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Neuron-V1-3B-Instruct.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Neuron-V1-3B-Instruct.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Neuron-V1-3B-Instruct.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Neuron-V1-3B-Instruct.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Neuron-V1-3B-Instruct.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Neuron-V1-3B-Instruct.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Neuron-V1-3B-Instruct.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Neuron-V1-3B-Instruct.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Neuron-V1-3B-Instruct.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
Neuron-V1-3B-Instruct.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9de6770e39665946d85ef15a6c88e88641e6667edddd1bcaf9b5bf4ef7565d57
size 850028288

3
Neuron-V1-3B-Instruct.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:deefee0eeabe81fd7bca78b48e85a35115e40e113c3e09f057e5acf9614dda96
size 791095040

3
Neuron-V1-3B-Instruct.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5e8fcda4b0ff4fd6a03cd5bdbc7f5bffe53eaa5a0ac50f10239b84a24fbb042e
size 1140516608

3
Neuron-V1-3B-Instruct.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6d6a9448ba1c9027192dc2bed856c2431c137bea25fecd2bd0982afc0beb6344
size 1061938944

3
Neuron-V1-3B-Instruct.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:acdbd65d1b5a03f5a0ba3117fbbaa3601f05e4c71fd7d1107e10721b14418530
size 1031546624

3
Neuron-V1-3B-Instruct.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8dcfe8b83b7245bc718f7c027ad69dc661ee8203615f58be47e8ba1ae5125c5f
size 948250368

3
Neuron-V1-3B-Instruct.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f98f1df085b35d6b32b78d3858e1511ee90a6a5f5e8836c4fd22a8b31d68bc04
size 1488895744

3
Neuron-V1-3B-Instruct.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:47a6e0d553302d16ebad7bf220f7351161d3b6b17fb0dfd530fcedd66bb3739c
size 1456865024

3
Neuron-V1-3B-Instruct.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:948aa5f4ce97668adb3a632c648a008d4c77090db137f7431c267110cae533a7
size 1391836928

3
Neuron-V1-3B-Instruct.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fb7d83728e71a33bd92d68bf2e9ea6eb0519986d0ad6326927275aa2af40ac02
size 1282828032

3
Neuron-V1-3B-Instruct.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:01028e8d5fffb734fd8d2c140cf4aa68f7238e3f39146786ceddee5d44017ec7
size 1825210112

3
Neuron-V1-3B-Instruct.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:833be91d7f5bc6f3f6aa347e57a3012f73465b092e11d503e8785e379d5847ba
size 1739095808

3
Neuron-V1-3B-Instruct.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:49fab298db8610322b66ae3940e890047df1214ec8946a7fa5a12e51605869d4
size 1274756864

3
Neuron-V1-3B-Instruct.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c06b9e25bc77eb24eba0eecf7b16d3f3ef8be53b149404edbdbc5e8a092a0200
size 1198128896

3
Neuron-V1-3B-Instruct.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8eb3191f4c8bda39a228caf99a5c62059738204f08f7c3deb7d246461df8360b
size 1707392768

3
Neuron-V1-3B-Instruct.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8674f8140bb64d3480bfab296a82caedf0c47b8bf7ec6e7e0a52b7701d77497b
size 1590476544

3
Neuron-V1-3B-Instruct.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d3849c18c9964bc39a51421944cb43e746979fc0d64b177759137f5ea25f7e21
size 1454358272

3
Neuron-V1-3B-Instruct.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:67e7d3f088fbeda2fce365902b196ccad8ffcc725fbd8c27ecdeb2e8d894083d
size 1828486912

3
Neuron-V1-3B-Instruct.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c75f069f17a6e3ef39e672be930f6ba02e5fd8fd3a30f61f3729204b2c614924
size 1996259072

3
Neuron-V1-3B-Instruct.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:92c72f6da3595b17462ed1ef7471594d76d73e08363567f2f3964380d4bacd79
size 1929903872

3
Neuron-V1-3B-Instruct.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4fa06d36e323c789928d678173f8602aa8cee0dd10f749f6b21af623a2763cea
size 1834385152

3
Neuron-V1-3B-Instruct.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7dcd1b949cb76bd5520e6bf269ee943a8e6be58e141ca17ec0b217a035ebba48
size 2224815872

3
Neuron-V1-3B-Instruct.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ba6b499e9604ab9303f8159cffa5b07fb1b31199c2f2a48f14748c30ca000883
size 2169667328

3
Neuron-V1-3B-Instruct.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:52cc0a2df5c79fa42136bb99b6eb746be2f6f6b1406dbfbfc3e9705e17cdd42d
size 2538159872

3
Neuron-V1-3B-Instruct.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4d30915bf0c8a0876678fec953b20c5f35dc4fc22275480d9b0d327c1a41c38b
size 3393408

95
README.md Normal file
View File

@@ -0,0 +1,95 @@
---
base_model: Neura-Tech-AI/Neuron-V1-3B-Instruct
datasets:
- custom-neura-tech-data
language:
- en
- hi
library_name: transformers
license: apache-2.0
license_link: https://github.com/QwenLM/Qwen2.5/blob/main/LICENSE
license_name: qwen-research
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- neuron
- neura-tech-ai
- 3B
- text-generation
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/Neura-Tech-AI/Neuron-V1-3B-Instruct
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Neuron-V1-3B-Instruct-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Neuron-V1-3B-Instruct-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Neuron-V1-3B-Instruct-i1-GGUF/resolve/main/Neuron-V1-3B-Instruct.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Neuron-V1-3B-Instruct-i1-GGUF/resolve/main/Neuron-V1-3B-Instruct.i1-IQ1_S.gguf) | i1-IQ1_S | 0.9 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Neuron-V1-3B-Instruct-i1-GGUF/resolve/main/Neuron-V1-3B-Instruct.i1-IQ1_M.gguf) | i1-IQ1_M | 1.0 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Neuron-V1-3B-Instruct-i1-GGUF/resolve/main/Neuron-V1-3B-Instruct.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/Neuron-V1-3B-Instruct-i1-GGUF/resolve/main/Neuron-V1-3B-Instruct.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/Neuron-V1-3B-Instruct-i1-GGUF/resolve/main/Neuron-V1-3B-Instruct.i1-IQ2_S.gguf) | i1-IQ2_S | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/Neuron-V1-3B-Instruct-i1-GGUF/resolve/main/Neuron-V1-3B-Instruct.i1-IQ2_M.gguf) | i1-IQ2_M | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/Neuron-V1-3B-Instruct-i1-GGUF/resolve/main/Neuron-V1-3B-Instruct.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.3 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Neuron-V1-3B-Instruct-i1-GGUF/resolve/main/Neuron-V1-3B-Instruct.i1-Q2_K.gguf) | i1-Q2_K | 1.4 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Neuron-V1-3B-Instruct-i1-GGUF/resolve/main/Neuron-V1-3B-Instruct.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Neuron-V1-3B-Instruct-i1-GGUF/resolve/main/Neuron-V1-3B-Instruct.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/Neuron-V1-3B-Instruct-i1-GGUF/resolve/main/Neuron-V1-3B-Instruct.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Neuron-V1-3B-Instruct-i1-GGUF/resolve/main/Neuron-V1-3B-Instruct.i1-IQ3_S.gguf) | i1-IQ3_S | 1.6 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Neuron-V1-3B-Instruct-i1-GGUF/resolve/main/Neuron-V1-3B-Instruct.i1-IQ3_M.gguf) | i1-IQ3_M | 1.6 | |
| [GGUF](https://huggingface.co/mradermacher/Neuron-V1-3B-Instruct-i1-GGUF/resolve/main/Neuron-V1-3B-Instruct.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.7 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Neuron-V1-3B-Instruct-i1-GGUF/resolve/main/Neuron-V1-3B-Instruct.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.8 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Neuron-V1-3B-Instruct-i1-GGUF/resolve/main/Neuron-V1-3B-Instruct.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.8 | |
| [GGUF](https://huggingface.co/mradermacher/Neuron-V1-3B-Instruct-i1-GGUF/resolve/main/Neuron-V1-3B-Instruct.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.9 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Neuron-V1-3B-Instruct-i1-GGUF/resolve/main/Neuron-V1-3B-Instruct.i1-Q4_0.gguf) | i1-Q4_0 | 1.9 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Neuron-V1-3B-Instruct-i1-GGUF/resolve/main/Neuron-V1-3B-Instruct.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.9 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Neuron-V1-3B-Instruct-i1-GGUF/resolve/main/Neuron-V1-3B-Instruct.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Neuron-V1-3B-Instruct-i1-GGUF/resolve/main/Neuron-V1-3B-Instruct.i1-Q4_1.gguf) | i1-Q4_1 | 2.1 | |
| [GGUF](https://huggingface.co/mradermacher/Neuron-V1-3B-Instruct-i1-GGUF/resolve/main/Neuron-V1-3B-Instruct.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.3 | |
| [GGUF](https://huggingface.co/mradermacher/Neuron-V1-3B-Instruct-i1-GGUF/resolve/main/Neuron-V1-3B-Instruct.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.3 | |
| [GGUF](https://huggingface.co/mradermacher/Neuron-V1-3B-Instruct-i1-GGUF/resolve/main/Neuron-V1-3B-Instruct.i1-Q6_K.gguf) | i1-Q6_K | 2.6 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->