mradermacher/airoboros-13b-gpt4-1.2-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/airoboros-13b-gpt4-1.2-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-18 16:38:16 +08:00
commit f8efa69d30
27 changed files with 213 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
airoboros-13b-gpt4-1.2.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-13b-gpt4-1.2.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-13b-gpt4-1.2.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-13b-gpt4-1.2.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-13b-gpt4-1.2.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-13b-gpt4-1.2.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-13b-gpt4-1.2.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-13b-gpt4-1.2.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-13b-gpt4-1.2.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-13b-gpt4-1.2.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-13b-gpt4-1.2.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-13b-gpt4-1.2.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-13b-gpt4-1.2.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-13b-gpt4-1.2.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-13b-gpt4-1.2.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-13b-gpt4-1.2.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-13b-gpt4-1.2.i1-Q4_0_4_4.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-13b-gpt4-1.2.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-13b-gpt4-1.2.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-13b-gpt4-1.2.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-13b-gpt4-1.2.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-13b-gpt4-1.2.i1-Q4_0_4_8.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-13b-gpt4-1.2.i1-Q4_0_8_8.gguf filter=lfs diff=lfs merge=lfs -text
airoboros-13b-gpt4-1.2.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

78
README.md Normal file
View File

@@ -0,0 +1,78 @@
---
base_model: jondurbin/airoboros-13b-gpt4-1.2
datasets:
- jondurbin/airoboros-gpt4-1.2
language:
- en
library_name: transformers
license: cc-by-nc-4.0
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/jondurbin/airoboros-13b-gpt4-1.2
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/airoboros-13b-gpt4-1.2-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/airoboros-13b-gpt4-1.2-i1-GGUF/resolve/main/airoboros-13b-gpt4-1.2.i1-IQ1_S.gguf) | i1-IQ1_S | 3.0 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/airoboros-13b-gpt4-1.2-i1-GGUF/resolve/main/airoboros-13b-gpt4-1.2.i1-IQ1_M.gguf) | i1-IQ1_M | 3.2 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/airoboros-13b-gpt4-1.2-i1-GGUF/resolve/main/airoboros-13b-gpt4-1.2.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.6 | |
| [GGUF](https://huggingface.co/mradermacher/airoboros-13b-gpt4-1.2-i1-GGUF/resolve/main/airoboros-13b-gpt4-1.2.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.0 | |
| [GGUF](https://huggingface.co/mradermacher/airoboros-13b-gpt4-1.2-i1-GGUF/resolve/main/airoboros-13b-gpt4-1.2.i1-IQ2_S.gguf) | i1-IQ2_S | 4.3 | |
| [GGUF](https://huggingface.co/mradermacher/airoboros-13b-gpt4-1.2-i1-GGUF/resolve/main/airoboros-13b-gpt4-1.2.i1-IQ2_M.gguf) | i1-IQ2_M | 4.6 | |
| [GGUF](https://huggingface.co/mradermacher/airoboros-13b-gpt4-1.2-i1-GGUF/resolve/main/airoboros-13b-gpt4-1.2.i1-Q2_K.gguf) | i1-Q2_K | 5.0 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/airoboros-13b-gpt4-1.2-i1-GGUF/resolve/main/airoboros-13b-gpt4-1.2.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 5.1 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/airoboros-13b-gpt4-1.2-i1-GGUF/resolve/main/airoboros-13b-gpt4-1.2.i1-IQ3_XS.gguf) | i1-IQ3_XS | 5.5 | |
| [GGUF](https://huggingface.co/mradermacher/airoboros-13b-gpt4-1.2-i1-GGUF/resolve/main/airoboros-13b-gpt4-1.2.i1-IQ3_S.gguf) | i1-IQ3_S | 5.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/airoboros-13b-gpt4-1.2-i1-GGUF/resolve/main/airoboros-13b-gpt4-1.2.i1-Q3_K_S.gguf) | i1-Q3_K_S | 5.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/airoboros-13b-gpt4-1.2-i1-GGUF/resolve/main/airoboros-13b-gpt4-1.2.i1-IQ3_M.gguf) | i1-IQ3_M | 6.1 | |
| [GGUF](https://huggingface.co/mradermacher/airoboros-13b-gpt4-1.2-i1-GGUF/resolve/main/airoboros-13b-gpt4-1.2.i1-Q3_K_M.gguf) | i1-Q3_K_M | 6.4 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/airoboros-13b-gpt4-1.2-i1-GGUF/resolve/main/airoboros-13b-gpt4-1.2.i1-Q3_K_L.gguf) | i1-Q3_K_L | 7.0 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/airoboros-13b-gpt4-1.2-i1-GGUF/resolve/main/airoboros-13b-gpt4-1.2.i1-IQ4_XS.gguf) | i1-IQ4_XS | 7.1 | |
| [GGUF](https://huggingface.co/mradermacher/airoboros-13b-gpt4-1.2-i1-GGUF/resolve/main/airoboros-13b-gpt4-1.2.i1-Q4_0_4_4.gguf) | i1-Q4_0_4_4 | 7.5 | fast on arm, low quality |
| [GGUF](https://huggingface.co/mradermacher/airoboros-13b-gpt4-1.2-i1-GGUF/resolve/main/airoboros-13b-gpt4-1.2.i1-Q4_0_4_8.gguf) | i1-Q4_0_4_8 | 7.5 | fast on arm+i8mm, low quality |
| [GGUF](https://huggingface.co/mradermacher/airoboros-13b-gpt4-1.2-i1-GGUF/resolve/main/airoboros-13b-gpt4-1.2.i1-Q4_0_8_8.gguf) | i1-Q4_0_8_8 | 7.5 | fast on arm+sve, low quality |
| [GGUF](https://huggingface.co/mradermacher/airoboros-13b-gpt4-1.2-i1-GGUF/resolve/main/airoboros-13b-gpt4-1.2.i1-Q4_0.gguf) | i1-Q4_0 | 7.5 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/airoboros-13b-gpt4-1.2-i1-GGUF/resolve/main/airoboros-13b-gpt4-1.2.i1-Q4_K_S.gguf) | i1-Q4_K_S | 7.5 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/airoboros-13b-gpt4-1.2-i1-GGUF/resolve/main/airoboros-13b-gpt4-1.2.i1-Q4_K_M.gguf) | i1-Q4_K_M | 8.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/airoboros-13b-gpt4-1.2-i1-GGUF/resolve/main/airoboros-13b-gpt4-1.2.i1-Q5_K_S.gguf) | i1-Q5_K_S | 9.1 | |
| [GGUF](https://huggingface.co/mradermacher/airoboros-13b-gpt4-1.2-i1-GGUF/resolve/main/airoboros-13b-gpt4-1.2.i1-Q5_K_M.gguf) | i1-Q5_K_M | 9.3 | |
| [GGUF](https://huggingface.co/mradermacher/airoboros-13b-gpt4-1.2-i1-GGUF/resolve/main/airoboros-13b-gpt4-1.2.i1-Q6_K.gguf) | i1-Q6_K | 10.8 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
airoboros-13b-gpt4-1.2.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:996e003787794c84331a6aa7ca0a5a292137d8791994317470bd42fd7c78f0d2
size 3138610432

3
airoboros-13b-gpt4-1.2.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0bacd6774720ea3629baf80ee7b597ae5797161a2dd3236342346682c117f226
size 2898687232

3
airoboros-13b-gpt4-1.2.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6a1c0ec8e6c9f76cd7ab807c6aa5d742c1c467763a28f3cca4fc0b0d4593f030
size 4517580032

3
airoboros-13b-gpt4-1.2.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e10b4250265506e67c0cb8f3e4886b7c2b47be5f9fcd8c8f2ceb84e371203a38
size 4197682432

3
airoboros-13b-gpt4-1.2.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cff73f585d14f3fb41d7026375f1762243b6e29c6afd03a2f049ee1a17b28ae3
size 3891148032

3
airoboros-13b-gpt4-1.2.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:60f35f8259375956009052be60886150b115fa0e85ef47f39fd09dd4730ead52
size 3538482432

3
airoboros-13b-gpt4-1.2.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:53a75573111eeb3123bb8f67c7ed70c8e158239b409b66311b0168bf40c3bf12
size 5984511232

3
airoboros-13b-gpt4-1.2.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:11cec35d5efbef137be20f74151ff05c002034630d45d4633eb3508d69c0a914
size 5658981632

3
airoboros-13b-gpt4-1.2.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:66c81fdde669bdd59ba881648a1f2f2d2bf07ed77bf63f06fc75015aa6abd876
size 5361612032

3
airoboros-13b-gpt4-1.2.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c5daabf2baaa5f94f4b138ada780be9dafad2d674206b7c4f714e2fe5aea819e
size 4960562432

3
airoboros-13b-gpt4-1.2.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:efc4190bd40c61d8b8661aa767ad80af5ec3a70851652e104cd7060df4bbc63f
size 6964223232

3
airoboros-13b-gpt4-1.2.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:55d98277cca3602421d2d71400fe8ee2044f311fc302857283e751a47aba26c0
size 4854271232

3
airoboros-13b-gpt4-1.2.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dc5be8d0c3a8542a9b42ba54a7dc15015190609efe28bc7909d60d6ea281fe19
size 6929560832

3
airoboros-13b-gpt4-1.2.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6b0370893b2f5303fcc5b2e73a3b860b306b438a1535a8d66f0d86073b881d6e
size 6337770752

3
airoboros-13b-gpt4-1.2.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4b545a8a12f0399b7e6e8d925bbc4f2cdf9cadb1e8c9b7bc7909a576fb19d976
size 5658981632

3
airoboros-13b-gpt4-1.2.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:77bcd0b033241e0f75c19c46822789c35e5983eb4a1952da188af182a495f2cd
size 7387954432

3
airoboros-13b-gpt4-1.2.i1-Q4_0_4_4.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9fa6e6ceab931d2abb807ecd25c324b4586393ec849787ec2326799cecbe6803
size 7365836032

3
airoboros-13b-gpt4-1.2.i1-Q4_0_4_8.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:55557f9cc2b8559a685aefe47488e4ffd7009d7424e7475fa7f73cfe69414c24
size 7365836032

3
airoboros-13b-gpt4-1.2.i1-Q4_0_8_8.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2f2dfba2467aeb741984f4bdc7d6b36dccbff38bcb660a21ab9607f73e5c6514
size 7365836032

3
airoboros-13b-gpt4-1.2.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b7be2579f0cba8316787101760b5eecdc1ef41bcd39009c98307eb5939d4c393
size 7865957632

3
airoboros-13b-gpt4-1.2.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c4c6c719f6561239cab8752edb8845b0df08f69ac519c1a280fafef914390eec
size 7423180032

3
airoboros-13b-gpt4-1.2.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f39ef0a9c0133c58d1ada9aa2146727b4f87d0e226f56ae97f9c0387afbf160c
size 9229925632

3
airoboros-13b-gpt4-1.2.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cf47cd7502819031d64950701065d614fb92c3151dfc66f5727bf48f24f6b844
size 8972287232

3
airoboros-13b-gpt4-1.2.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1a5869f6a3f31e0745fdd25e3936eb6e8ed7b82b2a23299e5def05dbefb3167b
size 10679141632

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1e03ad827c43574ef5d1bd01235431d447d4dcbf3d66a4ce94165206cdd554cc
size 7136325