mradermacher/airoboros-dpo-70b-3.3-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/airoboros-dpo-70b-3.3-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-17 21:01:29 +08:00
commit 08a0dc80bb
25 changed files with 225 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

58
.gitattributes vendored Normal file
View File

@@ -0,0 +1,58 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
airoboros-dpo-70b-3.3.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-dpo-70b-3.3.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-dpo-70b-3.3.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-dpo-70b-3.3.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-dpo-70b-3.3.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-dpo-70b-3.3.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-dpo-70b-3.3.i1-Q6_K.gguf.part1of2 filter=lfs diff=lfs merge=lfs -text
airoboros-dpo-70b-3.3.i1-Q6_K.gguf.part2of2 filter=lfs diff=lfs merge=lfs -text
airoboros-dpo-70b-3.3.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-dpo-70b-3.3.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-dpo-70b-3.3.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-dpo-70b-3.3.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-dpo-70b-3.3.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-dpo-70b-3.3.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-dpo-70b-3.3.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-dpo-70b-3.3.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-dpo-70b-3.3.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-dpo-70b-3.3.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-dpo-70b-3.3.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-dpo-70b-3.3.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-dpo-70b-3.3.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-dpo-70b-3.3.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text

98
README.md Normal file
View File

@@ -0,0 +1,98 @@
---
base_model: jondurbin/airoboros-dpo-70b-3.3
datasets:
- jondurbin/airoboros-3.2
- bluemoon-fandom-1-1-rp-cleaned
- boolq
- LDJnr/Capybara
- jondurbin/cinematika-v0.1
- glaiveai/glaive-function-calling-v2
- grimulkan/LimaRP-augmented
- piqa
- Vezora/Tested-22k-Python-Alpaca
- mattpscott/airoboros-summarization
- unalignment/toxic-dpo-v0.2
- allenai/ultrafeedback_binarized_cleaned
- argilla/distilabel-intel-orca-dpo-pairs
- jondurbin/airoboros-3.2
- jondurbin/contextual-dpo-v0.1
- jondurbin/gutenberg-dpo-v0.1
- jondurbin/py-dpo-v0.1
- jondurbin/truthy-dpo-v0.1
- jondurbin/gutenberg-dpo-v0.1
- lmsys/lmsys-chat-1m
language:
- en
library_name: transformers
license: other
license_link: https://huggingface.co/meta-llama/Meta-Llama-3-8B/blob/main/LICENSE
license_name: llama3
quantized_by: mradermacher
tags:
- llama-3
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/jondurbin/airoboros-dpo-70b-3.3
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/airoboros-dpo-70b-3.3-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/airoboros-dpo-70b-3.3-i1-GGUF/resolve/main/airoboros-dpo-70b-3.3.i1-IQ1_S.gguf) | i1-IQ1_S | 15.4 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/airoboros-dpo-70b-3.3-i1-GGUF/resolve/main/airoboros-dpo-70b-3.3.i1-IQ1_M.gguf) | i1-IQ1_M | 16.9 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/airoboros-dpo-70b-3.3-i1-GGUF/resolve/main/airoboros-dpo-70b-3.3.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 19.2 | |
| [GGUF](https://huggingface.co/mradermacher/airoboros-dpo-70b-3.3-i1-GGUF/resolve/main/airoboros-dpo-70b-3.3.i1-IQ2_XS.gguf) | i1-IQ2_XS | 21.2 | |
| [GGUF](https://huggingface.co/mradermacher/airoboros-dpo-70b-3.3-i1-GGUF/resolve/main/airoboros-dpo-70b-3.3.i1-IQ2_S.gguf) | i1-IQ2_S | 22.3 | |
| [GGUF](https://huggingface.co/mradermacher/airoboros-dpo-70b-3.3-i1-GGUF/resolve/main/airoboros-dpo-70b-3.3.i1-IQ2_M.gguf) | i1-IQ2_M | 24.2 | |
| [GGUF](https://huggingface.co/mradermacher/airoboros-dpo-70b-3.3-i1-GGUF/resolve/main/airoboros-dpo-70b-3.3.i1-Q2_K.gguf) | i1-Q2_K | 26.5 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/airoboros-dpo-70b-3.3-i1-GGUF/resolve/main/airoboros-dpo-70b-3.3.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 27.6 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/airoboros-dpo-70b-3.3-i1-GGUF/resolve/main/airoboros-dpo-70b-3.3.i1-IQ3_XS.gguf) | i1-IQ3_XS | 29.4 | |
| [GGUF](https://huggingface.co/mradermacher/airoboros-dpo-70b-3.3-i1-GGUF/resolve/main/airoboros-dpo-70b-3.3.i1-IQ3_S.gguf) | i1-IQ3_S | 31.0 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/airoboros-dpo-70b-3.3-i1-GGUF/resolve/main/airoboros-dpo-70b-3.3.i1-Q3_K_S.gguf) | i1-Q3_K_S | 31.0 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/airoboros-dpo-70b-3.3-i1-GGUF/resolve/main/airoboros-dpo-70b-3.3.i1-IQ3_M.gguf) | i1-IQ3_M | 32.0 | |
| [GGUF](https://huggingface.co/mradermacher/airoboros-dpo-70b-3.3-i1-GGUF/resolve/main/airoboros-dpo-70b-3.3.i1-Q3_K_M.gguf) | i1-Q3_K_M | 34.4 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/airoboros-dpo-70b-3.3-i1-GGUF/resolve/main/airoboros-dpo-70b-3.3.i1-Q3_K_L.gguf) | i1-Q3_K_L | 37.2 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/airoboros-dpo-70b-3.3-i1-GGUF/resolve/main/airoboros-dpo-70b-3.3.i1-IQ4_XS.gguf) | i1-IQ4_XS | 38.0 | |
| [GGUF](https://huggingface.co/mradermacher/airoboros-dpo-70b-3.3-i1-GGUF/resolve/main/airoboros-dpo-70b-3.3.i1-Q4_0.gguf) | i1-Q4_0 | 40.2 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/airoboros-dpo-70b-3.3-i1-GGUF/resolve/main/airoboros-dpo-70b-3.3.i1-Q4_K_S.gguf) | i1-Q4_K_S | 40.4 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/airoboros-dpo-70b-3.3-i1-GGUF/resolve/main/airoboros-dpo-70b-3.3.i1-Q4_K_M.gguf) | i1-Q4_K_M | 42.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/airoboros-dpo-70b-3.3-i1-GGUF/resolve/main/airoboros-dpo-70b-3.3.i1-Q5_K_S.gguf) | i1-Q5_K_S | 48.8 | |
| [GGUF](https://huggingface.co/mradermacher/airoboros-dpo-70b-3.3-i1-GGUF/resolve/main/airoboros-dpo-70b-3.3.i1-Q5_K_M.gguf) | i1-Q5_K_M | 50.0 | |
| [PART 1](https://huggingface.co/mradermacher/airoboros-dpo-70b-3.3-i1-GGUF/resolve/main/airoboros-dpo-70b-3.3.i1-Q6_K.gguf.part1of2) [PART 2](https://huggingface.co/mradermacher/airoboros-dpo-70b-3.3-i1-GGUF/resolve/main/airoboros-dpo-70b-3.3.i1-Q6_K.gguf.part2of2) | i1-Q6_K | 58.0 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
airoboros-dpo-70b-3.3.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2c0e997008ef3b3b995279bbc1a150f153cc196f3dd9f120810af043366057c6
size 16751196320

3
airoboros-dpo-70b-3.3.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:be92b3e3f55f7cb56954ada80c7b09a4e64008d5394f62eead3a815a531820b0
size 15343483040

3
airoboros-dpo-70b-3.3.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3130f76406ae6cfcf18bd83e83e83687a619b60b0b72ea87353f110e9a7cccd4
size 24119294112

3
airoboros-dpo-70b-3.3.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:100bda153f870c2c4e2d812a1569b15ea94cd5be7d7f589d8d3d3fc8e4bc1830
size 22242343072

3
airoboros-dpo-70b-3.3.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:caf73ff23394e58aafcacef9041a8c8c19d5c7c6994de5363099d4fc24e8d85d
size 21142108320

3
airoboros-dpo-70b-3.3.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6827979e08da05c77aad8c2642c9c71e8a9c32caf7f0dffc71545f3bd1ca380c
size 19097385120

3
airoboros-dpo-70b-3.3.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3ff588a85b25b13459f1903921d554ae1a8bf8bb9d31acfc64ce46a94b01fcd9
size 31937034400

3
airoboros-dpo-70b-3.3.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e2c6a1d379ac22a1c9cd3c956d046a358591671466effada383a18cc8a18e37f
size 30912051360

3
airoboros-dpo-70b-3.3.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:778465fb8a6488b6f63609c03abb7fbc1c8e966f36d4341289c9afdd05a00631
size 29307730080

3
airoboros-dpo-70b-3.3.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0712ac5f91245786063bc99114aa2b37ef4873ce018824d2eca7050927525914
size 27469494432

3
airoboros-dpo-70b-3.3.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:620188c3a4fa27353b20523d9fe41f3b0a3b9600f942970eae79bc10e3d1b168
size 37902661792

3
airoboros-dpo-70b-3.3.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3e09a511130a829e4320dee06d00f234703db052125d4d5a1a8aa6b3b1a7f757
size 26375108768

3
airoboros-dpo-70b-3.3.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7cea06e6559eb83d31bbef3e4dd3cef3568ec46ae93345f07752ad6ccc80eab9
size 37140592800

3
airoboros-dpo-70b-3.3.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:61a60938b45bb754e0449678cd337715e995906c45da6daf3694eb704be1e394
size 34267494560

3
airoboros-dpo-70b-3.3.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:11f0d87c4c655a22896a3713e3692070c0262f20a925195c1e7e062d453fba78
size 30912051360

3
airoboros-dpo-70b-3.3.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f905afd0674a9a5c68757667d8583ea005acd721ffef47533d35c82e34d14505
size 40116533408

3
airoboros-dpo-70b-3.3.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f595ff161481350e6e957ad1fd2be32c0e3187cecd8049e5e33ba0cea5865b73
size 42520393888

3
airoboros-dpo-70b-3.3.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e675e5530d8e26c5dbbd8df020961af67286b5fa423e766813ec5ae5a1ef83a9
size 40347220128

3
airoboros-dpo-70b-3.3.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1628aaff668d00a0e9eec97732c69c5013462283a5107e0d03f9f5ec38e377fb
size 49949816992

3
airoboros-dpo-70b-3.3.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:36f2c250d2425213c8bd647d42a94f959bf8476a7599db6e1af42a5c8f17065e
size 48657447072

3
airoboros-dpo-70b-3.3.i1-Q6_K.gguf.part1of2 Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8c5fd3d65d3a6bf5277ee7c654de9b56e6d539988549248eeadd8023c6a42eac
size 28991029248

3
airoboros-dpo-70b-3.3.i1-Q6_K.gguf.part2of2 Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:539962021aa5f40b70855efca1e4c1988463376f7b9d73553c257d72507c51b7
size 28897114272

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:37fff3a81e5dee8c372478f8042614136e94f561418464ec25d7160f40da9782
size 24922271