mradermacher/Astral-Noctra-12B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Astral-Noctra-12B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-10-07 13:11:18 +08:00
commit 179fb54053
27 changed files with 223 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Astral-Noctra-12B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Astral-Noctra-12B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Astral-Noctra-12B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Astral-Noctra-12B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Astral-Noctra-12B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Astral-Noctra-12B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Astral-Noctra-12B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Astral-Noctra-12B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Astral-Noctra-12B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Astral-Noctra-12B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Astral-Noctra-12B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Astral-Noctra-12B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Astral-Noctra-12B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Astral-Noctra-12B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Astral-Noctra-12B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Astral-Noctra-12B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Astral-Noctra-12B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Astral-Noctra-12B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Astral-Noctra-12B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Astral-Noctra-12B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Astral-Noctra-12B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Astral-Noctra-12B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Astral-Noctra-12B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Astral-Noctra-12B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Astral-Noctra-12B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Astral-Noctra-12B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f0d6781af219276c387408975bada495a3e2cb955b6449816816a33d06a72e38
size 3221640960

3
Astral-Noctra-12B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:050c3e237104036b2a027dba4df123008bcfeeee7817da52292fa8632c088eae
size 2999228160

3
Astral-Noctra-12B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c277ee3b87d8bf29d81242e0e6cca26caba47dd6697bfba19bc3a6147622bb0a
size 4435041568

3
Astral-Noctra-12B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:27ecca8d31823d0c2353aa355b4f4543d73f8006517606eda64067a6d59b44bf
size 4138491168

3
Astral-Noctra-12B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0ae7aedeaa5cff2687e2c2edb6751736ac63b50e5197fcebfada58fa3da492af
size 3915093760

3
Astral-Noctra-12B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b363b720847ea42350c325a0874e64b48843ef68d520ff2b6c4733496ab8b778
size 3592328960

3
Astral-Noctra-12B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c1226b5575f1ee832cccc57310d41fb5d47c42f559152db09018421e60d8f29b
size 5722252576

3
Astral-Noctra-12B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:15b6787d4af45e4188ff8e5a948894f74678c017492cea2dc12b88cb2408311e
size 5562098976

3
Astral-Noctra-12B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fc43b365650c12503ba98a2b7f16bf5a69261a0b8bc8cfdad973e349c3a33de9
size 5306508576

3
Astral-Noctra-12B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0aa19175e4320e0f2fc4e7747f769ea2a9059ec836d89c946c260069cdb6a537
size 4945403168

3
Astral-Noctra-12B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4cf39f6db4b9c2569d690866ff79a49a3e4835f5c6bc0427c18680bd2bd1d3df
size 7097937152

3
Astral-Noctra-12B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c066c6a87037d7c2996f2295e12723f1dc7dfd85d92c841554b9b57706420248
size 6742731552

3
Astral-Noctra-12B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d108b90d470df4e61290f8b03ee1d97a652d7b0570bccd44a8c88c586cbe9a10
size 4791066368

3
Astral-Noctra-12B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fba443879b2c18546de2e7a7503bba5099f065d155c71377da88d78d14ab6832
size 4493696768

3
Astral-Noctra-12B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5cfa57db3d20b8b40645a113ad7556f6739a2e076a183802860e8923b883d323
size 6561522976

3
Astral-Noctra-12B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ee7ec6e2be64b5ddc7e6f61cf3c4e40ee2411bce49a445f0a795b8c88e7fdbbb
size 6083110176

3
Astral-Noctra-12B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eb6a55a92032eec8256abc550cb99f35f2c04f04e52879b29c7502dfe49d7485
size 5534246176

3
Astral-Noctra-12B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bf569f65f921be5fe50491b345c98693cb036e2102d50751280fb50cf0d67d3b
size 7094660352

3
Astral-Noctra-12B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:32cb12333fba46012b0de2dfa9b6e74979faeae3b503ca4308def27093ce03cd
size 7795241152

3
Astral-Noctra-12B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b560eda4ebe996258a05d8db765e8026872e31ba29ce9728566adc3780663c31
size 7477226752

3
Astral-Noctra-12B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:da9fa8273ff7ecdcd22a1bb498a8415fe0f8c2b918337755b19359eecffdb063
size 7120219392

3
Astral-Noctra-12B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dc4a7e93b24823df01f971f7f46e6e99b853c796f51823fb74cde630a83bb699
size 8727655552

3
Astral-Noctra-12B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1cc1259c1a14cf36e950a0218265c0d91a390352ac90aaaff67698e93a419812
size 8518759552

3
Astral-Noctra-12B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c2f1fc04f717ae114326c273b2b0afdbfd0968d8cda5121d480821dfe47110e9
size 10056236160

3
Astral-Noctra-12B.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e64bd4062d2246ab9f8f7ef893b605bb7f40b176587fe74020bbe75c2bbd3580
size 7088192

88
README.md Normal file
View File

@@ -0,0 +1,88 @@
---
base_model: Vortex5/Astral-Noctra-12B
language:
- en
library_name: transformers
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- mergekit
- merge
- roleplay
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/Vortex5/Astral-Noctra-12B
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Astral-Noctra-12B-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Astral-Noctra-12B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Astral-Noctra-12B-i1-GGUF/resolve/main/Astral-Noctra-12B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Astral-Noctra-12B-i1-GGUF/resolve/main/Astral-Noctra-12B.i1-IQ1_S.gguf) | i1-IQ1_S | 3.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Astral-Noctra-12B-i1-GGUF/resolve/main/Astral-Noctra-12B.i1-IQ1_M.gguf) | i1-IQ1_M | 3.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Astral-Noctra-12B-i1-GGUF/resolve/main/Astral-Noctra-12B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.7 | |
| [GGUF](https://huggingface.co/mradermacher/Astral-Noctra-12B-i1-GGUF/resolve/main/Astral-Noctra-12B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.0 | |
| [GGUF](https://huggingface.co/mradermacher/Astral-Noctra-12B-i1-GGUF/resolve/main/Astral-Noctra-12B.i1-IQ2_S.gguf) | i1-IQ2_S | 4.2 | |
| [GGUF](https://huggingface.co/mradermacher/Astral-Noctra-12B-i1-GGUF/resolve/main/Astral-Noctra-12B.i1-IQ2_M.gguf) | i1-IQ2_M | 4.5 | |
| [GGUF](https://huggingface.co/mradermacher/Astral-Noctra-12B-i1-GGUF/resolve/main/Astral-Noctra-12B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 4.6 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Astral-Noctra-12B-i1-GGUF/resolve/main/Astral-Noctra-12B.i1-Q2_K.gguf) | i1-Q2_K | 4.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Astral-Noctra-12B-i1-GGUF/resolve/main/Astral-Noctra-12B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 5.0 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Astral-Noctra-12B-i1-GGUF/resolve/main/Astral-Noctra-12B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 5.4 | |
| [GGUF](https://huggingface.co/mradermacher/Astral-Noctra-12B-i1-GGUF/resolve/main/Astral-Noctra-12B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 5.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Astral-Noctra-12B-i1-GGUF/resolve/main/Astral-Noctra-12B.i1-IQ3_S.gguf) | i1-IQ3_S | 5.7 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Astral-Noctra-12B-i1-GGUF/resolve/main/Astral-Noctra-12B.i1-IQ3_M.gguf) | i1-IQ3_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/Astral-Noctra-12B-i1-GGUF/resolve/main/Astral-Noctra-12B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 6.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Astral-Noctra-12B-i1-GGUF/resolve/main/Astral-Noctra-12B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 6.7 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Astral-Noctra-12B-i1-GGUF/resolve/main/Astral-Noctra-12B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 6.8 | |
| [GGUF](https://huggingface.co/mradermacher/Astral-Noctra-12B-i1-GGUF/resolve/main/Astral-Noctra-12B.i1-Q4_0.gguf) | i1-Q4_0 | 7.2 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Astral-Noctra-12B-i1-GGUF/resolve/main/Astral-Noctra-12B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 7.2 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Astral-Noctra-12B-i1-GGUF/resolve/main/Astral-Noctra-12B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 7.2 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Astral-Noctra-12B-i1-GGUF/resolve/main/Astral-Noctra-12B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 7.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Astral-Noctra-12B-i1-GGUF/resolve/main/Astral-Noctra-12B.i1-Q4_1.gguf) | i1-Q4_1 | 7.9 | |
| [GGUF](https://huggingface.co/mradermacher/Astral-Noctra-12B-i1-GGUF/resolve/main/Astral-Noctra-12B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 8.6 | |
| [GGUF](https://huggingface.co/mradermacher/Astral-Noctra-12B-i1-GGUF/resolve/main/Astral-Noctra-12B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 8.8 | |
| [GGUF](https://huggingface.co/mradermacher/Astral-Noctra-12B-i1-GGUF/resolve/main/Astral-Noctra-12B.i1-Q6_K.gguf) | i1-Q6_K | 10.2 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->