mradermacher/Psychosis-14B-v0-CHIRAL_QHE-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Psychosis-14B-v0-CHIRAL_QHE-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-06 13:30:18 +08:00
commit 760f4cc128
27 changed files with 219 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Psychosis-14B-v0-CHIRAL_QHE.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Psychosis-14B-v0-CHIRAL_QHE.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Psychosis-14B-v0-CHIRAL_QHE.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Psychosis-14B-v0-CHIRAL_QHE.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Psychosis-14B-v0-CHIRAL_QHE.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Psychosis-14B-v0-CHIRAL_QHE.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Psychosis-14B-v0-CHIRAL_QHE.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Psychosis-14B-v0-CHIRAL_QHE.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Psychosis-14B-v0-CHIRAL_QHE.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Psychosis-14B-v0-CHIRAL_QHE.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Psychosis-14B-v0-CHIRAL_QHE.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Psychosis-14B-v0-CHIRAL_QHE.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Psychosis-14B-v0-CHIRAL_QHE.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Psychosis-14B-v0-CHIRAL_QHE.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Psychosis-14B-v0-CHIRAL_QHE.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Psychosis-14B-v0-CHIRAL_QHE.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Psychosis-14B-v0-CHIRAL_QHE.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Psychosis-14B-v0-CHIRAL_QHE.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Psychosis-14B-v0-CHIRAL_QHE.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Psychosis-14B-v0-CHIRAL_QHE.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Psychosis-14B-v0-CHIRAL_QHE.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Psychosis-14B-v0-CHIRAL_QHE.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Psychosis-14B-v0-CHIRAL_QHE.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Psychosis-14B-v0-CHIRAL_QHE.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Psychosis-14B-v0-CHIRAL_QHE.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text

3
Psychosis-14B-v0-CHIRAL_QHE.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f86d0d91c76fffd6c0e0b4cb205e36cc120bb7270c0e899cd517140b53743a26
size 3592897056

3
Psychosis-14B-v0-CHIRAL_QHE.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:464c0ce0695015b9602516003d16aa49cc3e2681d11452ef351a3bf651641b4e
size 3334160928

3
Psychosis-14B-v0-CHIRAL_QHE.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6d39011c7add780658f23b7a2e27aff61d0c46a4821d671f69b7304479b47158
size 4968292896

3
Psychosis-14B-v0-CHIRAL_QHE.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:54f5a85102cfdef453935f547bcd2f3562fc5e32661717790ce9ed5d08d0391f
size 4623311392

3
Psychosis-14B-v0-CHIRAL_QHE.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5dda5dcb702231da76ba42da3fb8e74188cc6226ac0d55e3d890910d2859b5c9
size 4398924320

3
Psychosis-14B-v0-CHIRAL_QHE.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dde807e1eb09e12eaac22e8a26506afe9d389566f218ecd49094182b9aad6ea0
size 4024123936

3
Psychosis-14B-v0-CHIRAL_QHE.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1edc36bec1d29d4fe26de7837f512d4ddc2ab609069bf5a1a8098db554e277d0
size 6542271008

3
Psychosis-14B-v0-CHIRAL_QHE.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4e201aa76c61bee83ef2bf677d1e3c04bed76e8627c35225fc6a650b72438aba
size 6297584160

3
Psychosis-14B-v0-CHIRAL_QHE.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5616eb46c581a48f0055c78af75f1cac98bfba3e9296be2a43389d07406d9795
size 5999280672

3
Psychosis-14B-v0-CHIRAL_QHE.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b5b6efa3a975954bbe759b9f4d0750fc4cda18e0123278cfa8c4e71f07e809fc
size 5527167520

3
Psychosis-14B-v0-CHIRAL_QHE.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b3151233e0201c1fdc9bb55c694e046bb3190d882718b03c821743efafdf9731
size 8008442400

3
Psychosis-14B-v0-CHIRAL_QHE.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a43555e02d45a7495c1e8c99d21f49ead5f6a9e69e3589a76fc22c6705b34b3f
size 7605887520

3
Psychosis-14B-v0-CHIRAL_QHE.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a0d7f5bab1a3bc4b017d30baf7136f9845cd52ebfe5da92fb980e5b7a4dd7ebc
size 5473837600

3
Psychosis-14B-v0-CHIRAL_QHE.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:76d47b0cb42cf7e9b142cf4720691156206e2a1f3d5bd8b8ba2810709060bd73
size 5085618720

3
Psychosis-14B-v0-CHIRAL_QHE.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5f9426c1e5f083549776b4d70e941f9c5a4f13b21bacbe525a7da1739008cf7b
size 7527612960

3
Psychosis-14B-v0-CHIRAL_QHE.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0e6d4ab19cf6bfad2fbc8e284594accc7ecb4335873817d631a58dadd5ed3918
size 6958760480

3
Psychosis-14B-v0-CHIRAL_QHE.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b3e0c93d0101f8aaf4d5aad04a90982124b288d2a9af202aac2bdb8d48859853
size 6297584160

3
Psychosis-14B-v0-CHIRAL_QHE.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0d4c984219afcebc481acf6acd988b81f499a16e1d03429a130ec03c3e95c57c
size 8034132512

3
Psychosis-14B-v0-CHIRAL_QHE.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b227c4365c46f8e877048ae5eb01cd81f1234447fba92e5b9807988ef2492c62
size 8813552160

3
Psychosis-14B-v0-CHIRAL_QHE.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4706bf97037a2f7a76628346e95e6da78b2487d5a8b033a9ac3c477908405a9d
size 8508023328

3
Psychosis-14B-v0-CHIRAL_QHE.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f284a024019f98e2073223bc1cdd158885267a970ec1cfb0ff9ea48188fa1fe6
size 8063492640

3
Psychosis-14B-v0-CHIRAL_QHE.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ce4abd0b7d71d8b75ca0096eef99eb5cccd8580f730122b86c0bac4e87011079
size 9876021792

3
Psychosis-14B-v0-CHIRAL_QHE.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:26b87a9fb06f417d9b8a3151e60266fad718687060bce93f783e6c647e1da6ea
size 9618661920

3
Psychosis-14B-v0-CHIRAL_QHE.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1bfc6fc32925b40cb5c0ac0f2c9505005bc2badef6d9107f6d1091317c137804
size 11329520160

3
Psychosis-14B-v0-CHIRAL_QHE.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a555ab34af3f2bf8b96b82713d759316242f3d6f2f6453645fd3b62aa5bfc815
size 9521472

84
README.md Normal file
View File

@@ -0,0 +1,84 @@
---
base_model: Naphula/Psychosis-14B-v0-CHIRAL_QHE
language:
- en
library_name: transformers
mradermacher:
readme_rev: 1
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/Naphula/Psychosis-14B-v0-CHIRAL_QHE
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Psychosis-14B-v0-CHIRAL_QHE-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Psychosis-14B-v0-CHIRAL_QHE-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Psychosis-14B-v0-CHIRAL_QHE-i1-GGUF/resolve/main/Psychosis-14B-v0-CHIRAL_QHE.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Psychosis-14B-v0-CHIRAL_QHE-i1-GGUF/resolve/main/Psychosis-14B-v0-CHIRAL_QHE.i1-IQ1_S.gguf) | i1-IQ1_S | 3.4 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Psychosis-14B-v0-CHIRAL_QHE-i1-GGUF/resolve/main/Psychosis-14B-v0-CHIRAL_QHE.i1-IQ1_M.gguf) | i1-IQ1_M | 3.7 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Psychosis-14B-v0-CHIRAL_QHE-i1-GGUF/resolve/main/Psychosis-14B-v0-CHIRAL_QHE.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 4.1 | |
| [GGUF](https://huggingface.co/mradermacher/Psychosis-14B-v0-CHIRAL_QHE-i1-GGUF/resolve/main/Psychosis-14B-v0-CHIRAL_QHE.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.5 | |
| [GGUF](https://huggingface.co/mradermacher/Psychosis-14B-v0-CHIRAL_QHE-i1-GGUF/resolve/main/Psychosis-14B-v0-CHIRAL_QHE.i1-IQ2_S.gguf) | i1-IQ2_S | 4.7 | |
| [GGUF](https://huggingface.co/mradermacher/Psychosis-14B-v0-CHIRAL_QHE-i1-GGUF/resolve/main/Psychosis-14B-v0-CHIRAL_QHE.i1-IQ2_M.gguf) | i1-IQ2_M | 5.1 | |
| [GGUF](https://huggingface.co/mradermacher/Psychosis-14B-v0-CHIRAL_QHE-i1-GGUF/resolve/main/Psychosis-14B-v0-CHIRAL_QHE.i1-Q2_K_S.gguf) | i1-Q2_K_S | 5.2 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Psychosis-14B-v0-CHIRAL_QHE-i1-GGUF/resolve/main/Psychosis-14B-v0-CHIRAL_QHE.i1-Q2_K.gguf) | i1-Q2_K | 5.6 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Psychosis-14B-v0-CHIRAL_QHE-i1-GGUF/resolve/main/Psychosis-14B-v0-CHIRAL_QHE.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 5.6 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Psychosis-14B-v0-CHIRAL_QHE-i1-GGUF/resolve/main/Psychosis-14B-v0-CHIRAL_QHE.i1-IQ3_XS.gguf) | i1-IQ3_XS | 6.1 | |
| [GGUF](https://huggingface.co/mradermacher/Psychosis-14B-v0-CHIRAL_QHE-i1-GGUF/resolve/main/Psychosis-14B-v0-CHIRAL_QHE.i1-IQ3_S.gguf) | i1-IQ3_S | 6.4 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Psychosis-14B-v0-CHIRAL_QHE-i1-GGUF/resolve/main/Psychosis-14B-v0-CHIRAL_QHE.i1-Q3_K_S.gguf) | i1-Q3_K_S | 6.4 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Psychosis-14B-v0-CHIRAL_QHE-i1-GGUF/resolve/main/Psychosis-14B-v0-CHIRAL_QHE.i1-IQ3_M.gguf) | i1-IQ3_M | 6.6 | |
| [GGUF](https://huggingface.co/mradermacher/Psychosis-14B-v0-CHIRAL_QHE-i1-GGUF/resolve/main/Psychosis-14B-v0-CHIRAL_QHE.i1-Q3_K_M.gguf) | i1-Q3_K_M | 7.1 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Psychosis-14B-v0-CHIRAL_QHE-i1-GGUF/resolve/main/Psychosis-14B-v0-CHIRAL_QHE.i1-Q3_K_L.gguf) | i1-Q3_K_L | 7.6 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Psychosis-14B-v0-CHIRAL_QHE-i1-GGUF/resolve/main/Psychosis-14B-v0-CHIRAL_QHE.i1-IQ4_XS.gguf) | i1-IQ4_XS | 7.7 | |
| [GGUF](https://huggingface.co/mradermacher/Psychosis-14B-v0-CHIRAL_QHE-i1-GGUF/resolve/main/Psychosis-14B-v0-CHIRAL_QHE.i1-IQ4_NL.gguf) | i1-IQ4_NL | 8.1 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Psychosis-14B-v0-CHIRAL_QHE-i1-GGUF/resolve/main/Psychosis-14B-v0-CHIRAL_QHE.i1-Q4_0.gguf) | i1-Q4_0 | 8.1 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Psychosis-14B-v0-CHIRAL_QHE-i1-GGUF/resolve/main/Psychosis-14B-v0-CHIRAL_QHE.i1-Q4_K_S.gguf) | i1-Q4_K_S | 8.2 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Psychosis-14B-v0-CHIRAL_QHE-i1-GGUF/resolve/main/Psychosis-14B-v0-CHIRAL_QHE.i1-Q4_K_M.gguf) | i1-Q4_K_M | 8.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Psychosis-14B-v0-CHIRAL_QHE-i1-GGUF/resolve/main/Psychosis-14B-v0-CHIRAL_QHE.i1-Q4_1.gguf) | i1-Q4_1 | 8.9 | |
| [GGUF](https://huggingface.co/mradermacher/Psychosis-14B-v0-CHIRAL_QHE-i1-GGUF/resolve/main/Psychosis-14B-v0-CHIRAL_QHE.i1-Q5_K_S.gguf) | i1-Q5_K_S | 9.7 | |
| [GGUF](https://huggingface.co/mradermacher/Psychosis-14B-v0-CHIRAL_QHE-i1-GGUF/resolve/main/Psychosis-14B-v0-CHIRAL_QHE.i1-Q5_K_M.gguf) | i1-Q5_K_M | 10.0 | |
| [GGUF](https://huggingface.co/mradermacher/Psychosis-14B-v0-CHIRAL_QHE-i1-GGUF/resolve/main/Psychosis-14B-v0-CHIRAL_QHE.i1-Q6_K.gguf) | i1-Q6_K | 11.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->