mradermacher/llama3.1-heretic-unsensored-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/llama3.1-heretic-unsensored-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-12 19:08:21 +08:00
commit 19ff3555ec
27 changed files with 240 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
llama3.1-heretic-unsensored.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-heretic-unsensored.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-heretic-unsensored.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-heretic-unsensored.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-heretic-unsensored.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-heretic-unsensored.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-heretic-unsensored.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-heretic-unsensored.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-heretic-unsensored.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-heretic-unsensored.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-heretic-unsensored.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-heretic-unsensored.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-heretic-unsensored.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-heretic-unsensored.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-heretic-unsensored.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-heretic-unsensored.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-heretic-unsensored.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-heretic-unsensored.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-heretic-unsensored.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-heretic-unsensored.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-heretic-unsensored.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-heretic-unsensored.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-heretic-unsensored.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-heretic-unsensored.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
llama3.1-heretic-unsensored.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

105
README.md Normal file
View File

@@ -0,0 +1,105 @@
---
base_model: anasali4151/llama3.1-heretic-unsensored
datasets:
- OpenCoder-LLM/opc-sft-stage1
- OpenCoder-LLM/opc-sft-stage2
- microsoft/orca-agentinstruct-1M-v1
- microsoft/orca-math-word-problems-200k
- NousResearch/hermes-function-calling-v1
- AI-MO/NuminaMath-CoT
- AI-MO/NuminaMath-TIR
- allenai/tulu-3-sft-mixture
- cognitivecomputations/dolphin-coder
- HuggingFaceTB/smoltalk
- cognitivecomputations/samantha-data
- m-a-p/CodeFeedback-Filtered-Instruction
- m-a-p/Code-Feedback
language:
- en
library_name: transformers
license: llama3.1
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- heretic
- uncensored
- decensored
- abliterated
- reproducible
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/anasali4151/llama3.1-heretic-unsensored
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#llama3.1-heretic-unsensored-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/llama3.1-heretic-unsensored-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/llama3.1-heretic-unsensored-i1-GGUF/resolve/main/llama3.1-heretic-unsensored.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-heretic-unsensored-i1-GGUF/resolve/main/llama3.1-heretic-unsensored.i1-IQ1_S.gguf) | i1-IQ1_S | 2.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-heretic-unsensored-i1-GGUF/resolve/main/llama3.1-heretic-unsensored.i1-IQ1_M.gguf) | i1-IQ1_M | 2.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-heretic-unsensored-i1-GGUF/resolve/main/llama3.1-heretic-unsensored.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.5 | |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-heretic-unsensored-i1-GGUF/resolve/main/llama3.1-heretic-unsensored.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-heretic-unsensored-i1-GGUF/resolve/main/llama3.1-heretic-unsensored.i1-IQ2_S.gguf) | i1-IQ2_S | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-heretic-unsensored-i1-GGUF/resolve/main/llama3.1-heretic-unsensored.i1-IQ2_M.gguf) | i1-IQ2_M | 3.0 | |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-heretic-unsensored-i1-GGUF/resolve/main/llama3.1-heretic-unsensored.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.1 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-heretic-unsensored-i1-GGUF/resolve/main/llama3.1-heretic-unsensored.i1-Q2_K.gguf) | i1-Q2_K | 3.3 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-heretic-unsensored-i1-GGUF/resolve/main/llama3.1-heretic-unsensored.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-heretic-unsensored-i1-GGUF/resolve/main/llama3.1-heretic-unsensored.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.6 | |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-heretic-unsensored-i1-GGUF/resolve/main/llama3.1-heretic-unsensored.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-heretic-unsensored-i1-GGUF/resolve/main/llama3.1-heretic-unsensored.i1-IQ3_S.gguf) | i1-IQ3_S | 3.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-heretic-unsensored-i1-GGUF/resolve/main/llama3.1-heretic-unsensored.i1-IQ3_M.gguf) | i1-IQ3_M | 3.9 | |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-heretic-unsensored-i1-GGUF/resolve/main/llama3.1-heretic-unsensored.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.1 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-heretic-unsensored-i1-GGUF/resolve/main/llama3.1-heretic-unsensored.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.4 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-heretic-unsensored-i1-GGUF/resolve/main/llama3.1-heretic-unsensored.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.5 | |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-heretic-unsensored-i1-GGUF/resolve/main/llama3.1-heretic-unsensored.i1-Q4_0.gguf) | i1-Q4_0 | 4.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-heretic-unsensored-i1-GGUF/resolve/main/llama3.1-heretic-unsensored.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.8 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-heretic-unsensored-i1-GGUF/resolve/main/llama3.1-heretic-unsensored.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.8 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-heretic-unsensored-i1-GGUF/resolve/main/llama3.1-heretic-unsensored.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-heretic-unsensored-i1-GGUF/resolve/main/llama3.1-heretic-unsensored.i1-Q4_1.gguf) | i1-Q4_1 | 5.2 | |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-heretic-unsensored-i1-GGUF/resolve/main/llama3.1-heretic-unsensored.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.7 | |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-heretic-unsensored-i1-GGUF/resolve/main/llama3.1-heretic-unsensored.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/llama3.1-heretic-unsensored-i1-GGUF/resolve/main/llama3.1-heretic-unsensored.i1-Q6_K.gguf) | i1-Q6_K | 6.7 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
llama3.1-heretic-unsensored.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2ffeecb71f97ee7a289ccb70821635992b6653d98d348a20f54a09542d5eeece
size 2161984608

3
llama3.1-heretic-unsensored.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7612bd3c2102e7407093fb66b91680abb95c9a32080f2e166a49f1117e27245a
size 2019640416

3
llama3.1-heretic-unsensored.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:858d3b4557bc7224a1a1915df49628942bf309db12e16cf1dff43372fa284dd1
size 2948294560

3
llama3.1-heretic-unsensored.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9e4cd8e57a34bf071a90fb14bfd56b29777a4b47ae406e3b864940780f85a791
size 2758502304

3
llama3.1-heretic-unsensored.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4224e2bd3c74ba3abe3e658c5fb2e1530d9787d0d0995c2034ffc2ebc449ab8a
size 2605794400

3
llama3.1-heretic-unsensored.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bf749466ce7e7e543d823e09b1e97d6af9c3c394ea1606a3f13403c8d27fe89f
size 2399224928

3
llama3.1-heretic-unsensored.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f11dd04594dbfe0092610ac8c5b7aefeb97d6ef7a46f3f55ba3007497949ca82
size 3784838112

3
llama3.1-heretic-unsensored.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c151890d4ecb72db2276abc3bea780067a530c8d31aa2206290d79cabb732735
size 3682339808

3
llama3.1-heretic-unsensored.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1e0a873e4ab8148126accba8da4ac5ddd92ea9ce41e28aaa3e8464f356285e55
size 3518761952

3
llama3.1-heretic-unsensored.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bdd7d0e4442da8b6f742b8dd79e34f3551f7b7984902ad84eb315d67ed546ad4
size 3274925984

3
llama3.1-heretic-unsensored.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:322d4b15e5408ae9e293ef66b82c2602b1bc40a26868e3dbce27b597ddfc5127
size 4678004768

3
llama3.1-heretic-unsensored.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3b858299e6f05dd25947ae50f10b6ce1b9289dfdb468e1d315936ee006de4b3b
size 4447678240

3
llama3.1-heretic-unsensored.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3a11946960d7c5eaec0025d6853aef820acb1894844e55631036ef65c9b2cc0e
size 3179145376

3
llama3.1-heretic-unsensored.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6fcce041d46d33f2b6b2bc874af79b4c216672965300690defc474338448e32c
size 2988828832

3
llama3.1-heretic-unsensored.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:236cdcc3ccfb27ccb4f05745778c5dcb30520c17d05f22069ceac2057e3e393a
size 4321971168

3
llama3.1-heretic-unsensored.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4f29cf00305bb54cca293dd56132ea87b79185ddf4ecb820f8063ac5d5721b16
size 4018932704

3
llama3.1-heretic-unsensored.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4dc134d547c83cb9cb0e01bef6fb4882f5467cae8bfee42761ab1af964b01044
size 3664514016

3
llama3.1-heretic-unsensored.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:df8b4fb7b877bc0e85370eb7483eb8ff7abfc0dfd22a0ce8be9836b878400e89
size 4675907616

3
llama3.1-heretic-unsensored.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8a4f9ab65ea10f5fe63f084a25fe1f81ad5138ba550aa43301d6fbf84fcb0ddb
size 5130269216

3
llama3.1-heretic-unsensored.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2e125a0cb4a303528bbf12cf0a0da56523713164364b88ec482ea926103ea4bd
size 4920750112

3
llama3.1-heretic-unsensored.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7c08c0f891732abd91ac1361ce0a69a0ae3bad4c9ddf2365a106a33d4dd82b13
size 4692684832

3
llama3.1-heretic-unsensored.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6db8109e559134a2ab0705145e745339b4c93c30c8ba7d29d27a6b969af7a83f
size 5733004320

3
llama3.1-heretic-unsensored.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fc0017297e3879c189d1c010cb1e664fb51abf8055ee8e94d3230c9019b46099
size 5599310880

3
llama3.1-heretic-unsensored.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9a0938ad051425ec2d19c0bbc0192b0f98929ec3abf59acdb1d7a9ea7b302e24
size 6596024416

3
llama3.1-heretic-unsensored.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:42104e34b33a1e1040a788c71790f2b3db795bddf7283bc3e5a769bd22134e98
size 5015200