初始化项目,由ModelHub XC社区提供模型

Model: mradermacher/FluentlyLM-Prinum-abliterated-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-18 07:26:30 +08:00
commit 2a40a0a9ff
25 changed files with 229 additions and 0 deletions

58
.gitattributes vendored Normal file
View File

@@ -0,0 +1,58 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
FluentlyLM-Prinum-abliterated.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
FluentlyLM-Prinum-abliterated.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
FluentlyLM-Prinum-abliterated.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
FluentlyLM-Prinum-abliterated.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
FluentlyLM-Prinum-abliterated.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
FluentlyLM-Prinum-abliterated.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
FluentlyLM-Prinum-abliterated.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
FluentlyLM-Prinum-abliterated.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
FluentlyLM-Prinum-abliterated.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
FluentlyLM-Prinum-abliterated.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
FluentlyLM-Prinum-abliterated.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
FluentlyLM-Prinum-abliterated.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
FluentlyLM-Prinum-abliterated.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
FluentlyLM-Prinum-abliterated.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
FluentlyLM-Prinum-abliterated.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
FluentlyLM-Prinum-abliterated.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
FluentlyLM-Prinum-abliterated.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
FluentlyLM-Prinum-abliterated.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
FluentlyLM-Prinum-abliterated.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
FluentlyLM-Prinum-abliterated.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
FluentlyLM-Prinum-abliterated.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
FluentlyLM-Prinum-abliterated.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
FluentlyLM-Prinum-abliterated.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:af7e9799e541aa9c9a8c5e0366fa6c73d33f2ee7f5b462004be84445c9aa5716
size 7932162336

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:50335c7363eb86fd17445ad86ccd3d11ffe316aea10e1bee6e32d84b7c795335
size 7274508576

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cdd8728fb3278be21db93a22872ff18538a9f994da0374dcf3a22f6058e68e42
size 11264442656

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b7b517c610d63cbe5fcf545277ea1707a54e92aa092539b3e0a0366e38f226b6
size 10387570976

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:82c4dc1098796239ce263511fa1fcde4f87059e5f7b1217eb51729bd23537438
size 9957552416

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:21520b92120f3ea1f52ac432a9a1b7a29bdf9683d92e74fadadad758332b1c0a
size 9028251936

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:60e8b51c5730911c3a30ed619c50b47daabc67606fc00231f03cd3ff9b88dd85
size 14810124576

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:71802e318f5deeeec3bc7880b5aa6027884cd74bd02b5fa9be6e9f0b981eda16
size 14436897056

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aa9b2b77bec62cb591476e2e316676910000eb9a47b212bb8b679d0302b8ccfe
size 13705515296

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:54d0f3a282b683186c7a80c4110a5b832cf51c19874cfed88653cd18cb8762ac
size 12839272736

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4eab873032afa37a54eeacb57a2791845ea2a2114d41f714f9aaa22b3223ec06
size 17693155616

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:943cf59e8e8e9a7afd735ed6f4ce114bcec8312252be6c4d89a25ac45b48ee03
size 12313100576

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ba6ef7611f9a76d33622e1ae022c953be11ef836f3925ed72b970c662b9498b6
size 11488002336

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e82852ed40ff3433d777f1fde68c044f0beaccbcb653bda0969777c74919af4b
size 17247080736

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:63a59335d2784b719c39dfae08715d4db5de7ab1a6ed005d687eea1b24c7bc04
size 15935050016

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2b4b18f380924b1e0c5d0c3d1baa23be7864cb3c51e53172b309692b0d6d9db9
size 14392332576

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ccf28c44fb6cb19514d43db0b3bca1b580376af37e2d58d7acaefb4006ac3e96
size 18711011616

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c79d0e8baf9c28c57e1d96bcee0790174b1b8b90e81c5cfff31fcb98c67abbf8
size 20639244576

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e0a59ab398480549e16635f36a12c5f69701a746584542c78d821321e0b6a509
size 19851338016

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:70c8fc1500868c3b62c0d8e14614aa728897096d0655af55c079eb4b01ff86f0
size 18784411936

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e68b446cf7249a4bcd55921bd8050ac76a007c68a42e801821aed4bb073143af
size 23262159136

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1dd1ba76ef247100f8d45c2b9e213777caa2ccb95ef7319c8a5b06aa14d71ccf
size 22638256416

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:37beb8f024c99222f60de371cd27c975ce1ff180a7f736f199f228bf3e04487c
size 26886156576

102
README.md Normal file
View File

@@ -0,0 +1,102 @@
---
base_model: huihui-ai/FluentlyLM-Prinum-abliterated
datasets:
- fluently-sets/ultraset
- fluently-sets/ultrathink
- fluently-sets/reasoning-1-1k
- fluently-sets/MATH-500-Overall
language:
- en
- fr
- es
- ru
- zh
- ja
- fa
- code
library_name: transformers
license: mit
quantized_by: mradermacher
tags:
- abliterated
- uncensored
- fluently-lm
- fluently
- prinum
- instruct
- trained
- math
- roleplay
- reasoning
- axolotl
- unsloth
- argilla
- qwen2
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/huihui-ai/FluentlyLM-Prinum-abliterated
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/FluentlyLM-Prinum-abliterated-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/FluentlyLM-Prinum-abliterated-i1-GGUF/resolve/main/FluentlyLM-Prinum-abliterated.i1-IQ1_S.gguf) | i1-IQ1_S | 7.4 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/FluentlyLM-Prinum-abliterated-i1-GGUF/resolve/main/FluentlyLM-Prinum-abliterated.i1-IQ1_M.gguf) | i1-IQ1_M | 8.0 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/FluentlyLM-Prinum-abliterated-i1-GGUF/resolve/main/FluentlyLM-Prinum-abliterated.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 9.1 | |
| [GGUF](https://huggingface.co/mradermacher/FluentlyLM-Prinum-abliterated-i1-GGUF/resolve/main/FluentlyLM-Prinum-abliterated.i1-IQ2_XS.gguf) | i1-IQ2_XS | 10.1 | |
| [GGUF](https://huggingface.co/mradermacher/FluentlyLM-Prinum-abliterated-i1-GGUF/resolve/main/FluentlyLM-Prinum-abliterated.i1-IQ2_S.gguf) | i1-IQ2_S | 10.5 | |
| [GGUF](https://huggingface.co/mradermacher/FluentlyLM-Prinum-abliterated-i1-GGUF/resolve/main/FluentlyLM-Prinum-abliterated.i1-IQ2_M.gguf) | i1-IQ2_M | 11.4 | |
| [GGUF](https://huggingface.co/mradermacher/FluentlyLM-Prinum-abliterated-i1-GGUF/resolve/main/FluentlyLM-Prinum-abliterated.i1-Q2_K_S.gguf) | i1-Q2_K_S | 11.6 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/FluentlyLM-Prinum-abliterated-i1-GGUF/resolve/main/FluentlyLM-Prinum-abliterated.i1-Q2_K.gguf) | i1-Q2_K | 12.4 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/FluentlyLM-Prinum-abliterated-i1-GGUF/resolve/main/FluentlyLM-Prinum-abliterated.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 12.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/FluentlyLM-Prinum-abliterated-i1-GGUF/resolve/main/FluentlyLM-Prinum-abliterated.i1-IQ3_XS.gguf) | i1-IQ3_XS | 13.8 | |
| [GGUF](https://huggingface.co/mradermacher/FluentlyLM-Prinum-abliterated-i1-GGUF/resolve/main/FluentlyLM-Prinum-abliterated.i1-Q3_K_S.gguf) | i1-Q3_K_S | 14.5 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/FluentlyLM-Prinum-abliterated-i1-GGUF/resolve/main/FluentlyLM-Prinum-abliterated.i1-IQ3_S.gguf) | i1-IQ3_S | 14.5 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/FluentlyLM-Prinum-abliterated-i1-GGUF/resolve/main/FluentlyLM-Prinum-abliterated.i1-IQ3_M.gguf) | i1-IQ3_M | 14.9 | |
| [GGUF](https://huggingface.co/mradermacher/FluentlyLM-Prinum-abliterated-i1-GGUF/resolve/main/FluentlyLM-Prinum-abliterated.i1-Q3_K_M.gguf) | i1-Q3_K_M | 16.0 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/FluentlyLM-Prinum-abliterated-i1-GGUF/resolve/main/FluentlyLM-Prinum-abliterated.i1-Q3_K_L.gguf) | i1-Q3_K_L | 17.3 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/FluentlyLM-Prinum-abliterated-i1-GGUF/resolve/main/FluentlyLM-Prinum-abliterated.i1-IQ4_XS.gguf) | i1-IQ4_XS | 17.8 | |
| [GGUF](https://huggingface.co/mradermacher/FluentlyLM-Prinum-abliterated-i1-GGUF/resolve/main/FluentlyLM-Prinum-abliterated.i1-Q4_0.gguf) | i1-Q4_0 | 18.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/FluentlyLM-Prinum-abliterated-i1-GGUF/resolve/main/FluentlyLM-Prinum-abliterated.i1-Q4_K_S.gguf) | i1-Q4_K_S | 18.9 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/FluentlyLM-Prinum-abliterated-i1-GGUF/resolve/main/FluentlyLM-Prinum-abliterated.i1-Q4_K_M.gguf) | i1-Q4_K_M | 20.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/FluentlyLM-Prinum-abliterated-i1-GGUF/resolve/main/FluentlyLM-Prinum-abliterated.i1-Q4_1.gguf) | i1-Q4_1 | 20.7 | |
| [GGUF](https://huggingface.co/mradermacher/FluentlyLM-Prinum-abliterated-i1-GGUF/resolve/main/FluentlyLM-Prinum-abliterated.i1-Q5_K_S.gguf) | i1-Q5_K_S | 22.7 | |
| [GGUF](https://huggingface.co/mradermacher/FluentlyLM-Prinum-abliterated-i1-GGUF/resolve/main/FluentlyLM-Prinum-abliterated.i1-Q5_K_M.gguf) | i1-Q5_K_M | 23.4 | |
| [GGUF](https://huggingface.co/mradermacher/FluentlyLM-Prinum-abliterated-i1-GGUF/resolve/main/FluentlyLM-Prinum-abliterated.i1-Q6_K.gguf) | i1-Q6_K | 27.0 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->