mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-08 21:11:52 +08:00
commit e7c4ede301
27 changed files with 232 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c81fc9b271cb1de1c24f2b367deffbf11c203035b2d2b14d78318a694432368e
size 3728064704

3
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d0208f89586af11829c0ebd37c4d97c26221877e85696c267bec4cffeaeb8cf5
size 3461169344

3
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:177db0d0ffd550f6dce45ffc7069b39516724b9fc18f43e987c0d28eabac65ca
size 5170512064

3
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5a26bf3cff9d2abc00c353f8750bd19cc38ef5a932d67fa00fed106b48b7d2ee
size 4814651584

3
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bc66b2a24f92e124a0ef8c023c1750f5eccfad9de503b93c27974ed15924bffa
size 4560208064

3
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cfc9a2862bb606fab39de86d9c7f9ef8cb287957a85aa602e9ba7104dd258e0d
size 4172890304

3
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b94cb6cf4b3c6f32d147c983c0b266c7faffd34595cbec42a77f0cc40a653f29
size 6697337024

3
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a590e9e55317001b8f142189a925d44c9cfc34860b91bdc02757838195718721
size 6505152704

3
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bff324ac60508575d36df737df7c9c33c85c2278f1700daa8571ca81c7156683
size 6198444224

3
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7955205a3503f9f039d0c164995815ab449887d9a6023c0005eabf4c289acf37
size 5782945984

3
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7371074e93ad0730168a8f027a015cfeeb0d1a428e94408588c6a1d5a1f30543
size 8330330304

3
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a7ed497d40d10893da6b1788d677044226f61a4a3938a3f70d8481d6f4b1eb8c
size 7908278464

3
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f3bf0adf8ae40edf025d4d8eedb35b7a7e5117f4378957ca6d1dc1b8fe07afbd
size 5593546944

3
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aab3191373765c3c6c11af7f524a5df8b9d8591a9d02b25ceb466290a6adff63
size 5236703424

3
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:efb0780f4b0c84a5f0c241b563bb74a89e13d647ae845932a61146dc2a491259
size 7704461504

3
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:df9a26f057b80eebe835921de5dd70ba48af149dcf66f0222fa912f55b81b5ae
size 7135609024

3
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cc86f67d9e731c7cffade2cdf4741319cd3cb670cc531958d08ba3eb34432cb6
size 6471729344

3
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:30c1db876ac31d589dccd89e4983f13d0b9d687467362bf8393b427f7212fffa
size 8326398144

3
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9819f913f86ffaa9d5fe3aa7796ed7d022e709a647e153ba9ed74bec213a89a4
size 9158705344

3
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:148574906a889677b5f3277e10d3141a1f5965398f3e148de10eb118227b07df
size 8785477824

3
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:97a64e4be9a37c2688eaf2cc6cc11ef9ee0eb2c20376e20c800884966af48550
size 8356544704

3
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:970c2d95822e1a3f62683b394dd604590d701be5be9d5cd5f28eb4267edd5e77
size 10269212864

3
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3280da2631c3cb49e22792ae863ed7e013193f0a5c461a27ccdc9e9ea04f397d
size 10018537664

3
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9060c38ac8193230e8711b1b88be3a2d712827ef0b22240310cc0b80ae57e0f0
size 11845681344

3
Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:15c0f18c0ae8e8973b7e21e4a27c3f04c260d851a486e056c7570fb54dc5a832
size 8505824

97
README.md Normal file
View File

@@ -0,0 +1,97 @@
---
base_model: sainikhiljuluri2015/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED
datasets:
- NSL-KDD
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- cybersecurity
- network-security
- intrusion-detection
- raft
- dora
- vision-language-model
- llava
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/sainikhiljuluri2015/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-GGUF
**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-GGUF).**
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ1_S.gguf) | i1-IQ1_S | 3.6 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ1_M.gguf) | i1-IQ1_M | 3.8 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 4.3 | |
| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.7 | |
| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ2_S.gguf) | i1-IQ2_S | 4.9 | |
| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ2_M.gguf) | i1-IQ2_M | 5.3 | |
| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q2_K_S.gguf) | i1-Q2_K_S | 5.3 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q2_K.gguf) | i1-Q2_K | 5.7 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 5.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ3_XS.gguf) | i1-IQ3_XS | 6.3 | |
| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q3_K_S.gguf) | i1-Q3_K_S | 6.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ3_S.gguf) | i1-IQ3_S | 6.6 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ3_M.gguf) | i1-IQ3_M | 6.8 | |
| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q3_K_M.gguf) | i1-Q3_K_M | 7.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q3_K_L.gguf) | i1-Q3_K_L | 7.8 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ4_XS.gguf) | i1-IQ4_XS | 8.0 | |
| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q4_0.gguf) | i1-Q4_0 | 8.4 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ4_NL.gguf) | i1-IQ4_NL | 8.4 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q4_K_S.gguf) | i1-Q4_K_S | 8.5 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q4_K_M.gguf) | i1-Q4_K_M | 8.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q4_1.gguf) | i1-Q4_1 | 9.3 | |
| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q5_K_S.gguf) | i1-Q5_K_S | 10.1 | |
| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q5_K_M.gguf) | i1-Q5_K_M | 10.4 | |
| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q6_K.gguf) | i1-Q6_K | 11.9 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->