mradermacher/dulia-13b-8k-alpha-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/dulia-13b-8k-alpha-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-09-27 20:03:33 +08:00
commit d797717773
24 changed files with 204 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

57
.gitattributes vendored Normal file
View File

@@ -0,0 +1,57 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
dulia-13b-8k-alpha.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
dulia-13b-8k-alpha.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
dulia-13b-8k-alpha.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
dulia-13b-8k-alpha.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
dulia-13b-8k-alpha.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
dulia-13b-8k-alpha.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
dulia-13b-8k-alpha.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
dulia-13b-8k-alpha.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
dulia-13b-8k-alpha.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
dulia-13b-8k-alpha.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
dulia-13b-8k-alpha.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
dulia-13b-8k-alpha.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
dulia-13b-8k-alpha.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
dulia-13b-8k-alpha.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
dulia-13b-8k-alpha.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
dulia-13b-8k-alpha.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
dulia-13b-8k-alpha.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
dulia-13b-8k-alpha.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
dulia-13b-8k-alpha.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
dulia-13b-8k-alpha.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
dulia-13b-8k-alpha.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

81
README.md Normal file
View File

@@ -0,0 +1,81 @@
---
base_model: duliadotio/dulia-13b-8k-alpha
datasets:
- shahules786/orca-chat
- ehartford/dolphin
language:
- en
library_name: transformers
license: llama2
quantized_by: mradermacher
tags:
- dulia
- duliadotio
- llama-8k
- llama2
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/duliadotio/dulia-13b-8k-alpha
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/dulia-13b-8k-alpha-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/dulia-13b-8k-alpha-i1-GGUF/resolve/main/dulia-13b-8k-alpha.i1-IQ1_S.gguf) | i1-IQ1_S | 3.0 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/dulia-13b-8k-alpha-i1-GGUF/resolve/main/dulia-13b-8k-alpha.i1-IQ1_M.gguf) | i1-IQ1_M | 3.2 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/dulia-13b-8k-alpha-i1-GGUF/resolve/main/dulia-13b-8k-alpha.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.6 | |
| [GGUF](https://huggingface.co/mradermacher/dulia-13b-8k-alpha-i1-GGUF/resolve/main/dulia-13b-8k-alpha.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.0 | |
| [GGUF](https://huggingface.co/mradermacher/dulia-13b-8k-alpha-i1-GGUF/resolve/main/dulia-13b-8k-alpha.i1-IQ2_S.gguf) | i1-IQ2_S | 4.3 | |
| [GGUF](https://huggingface.co/mradermacher/dulia-13b-8k-alpha-i1-GGUF/resolve/main/dulia-13b-8k-alpha.i1-IQ2_M.gguf) | i1-IQ2_M | 4.6 | |
| [GGUF](https://huggingface.co/mradermacher/dulia-13b-8k-alpha-i1-GGUF/resolve/main/dulia-13b-8k-alpha.i1-Q2_K.gguf) | i1-Q2_K | 5.0 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/dulia-13b-8k-alpha-i1-GGUF/resolve/main/dulia-13b-8k-alpha.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 5.1 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/dulia-13b-8k-alpha-i1-GGUF/resolve/main/dulia-13b-8k-alpha.i1-IQ3_XS.gguf) | i1-IQ3_XS | 5.5 | |
| [GGUF](https://huggingface.co/mradermacher/dulia-13b-8k-alpha-i1-GGUF/resolve/main/dulia-13b-8k-alpha.i1-IQ3_S.gguf) | i1-IQ3_S | 5.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/dulia-13b-8k-alpha-i1-GGUF/resolve/main/dulia-13b-8k-alpha.i1-Q3_K_S.gguf) | i1-Q3_K_S | 5.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/dulia-13b-8k-alpha-i1-GGUF/resolve/main/dulia-13b-8k-alpha.i1-IQ3_M.gguf) | i1-IQ3_M | 6.1 | |
| [GGUF](https://huggingface.co/mradermacher/dulia-13b-8k-alpha-i1-GGUF/resolve/main/dulia-13b-8k-alpha.i1-Q3_K_M.gguf) | i1-Q3_K_M | 6.4 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/dulia-13b-8k-alpha-i1-GGUF/resolve/main/dulia-13b-8k-alpha.i1-Q3_K_L.gguf) | i1-Q3_K_L | 7.0 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/dulia-13b-8k-alpha-i1-GGUF/resolve/main/dulia-13b-8k-alpha.i1-IQ4_XS.gguf) | i1-IQ4_XS | 7.1 | |
| [GGUF](https://huggingface.co/mradermacher/dulia-13b-8k-alpha-i1-GGUF/resolve/main/dulia-13b-8k-alpha.i1-Q4_0.gguf) | i1-Q4_0 | 7.5 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/dulia-13b-8k-alpha-i1-GGUF/resolve/main/dulia-13b-8k-alpha.i1-Q4_K_S.gguf) | i1-Q4_K_S | 7.5 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/dulia-13b-8k-alpha-i1-GGUF/resolve/main/dulia-13b-8k-alpha.i1-Q4_K_M.gguf) | i1-Q4_K_M | 8.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/dulia-13b-8k-alpha-i1-GGUF/resolve/main/dulia-13b-8k-alpha.i1-Q5_K_S.gguf) | i1-Q5_K_S | 9.1 | |
| [GGUF](https://huggingface.co/mradermacher/dulia-13b-8k-alpha-i1-GGUF/resolve/main/dulia-13b-8k-alpha.i1-Q5_K_M.gguf) | i1-Q5_K_M | 9.3 | |
| [GGUF](https://huggingface.co/mradermacher/dulia-13b-8k-alpha-i1-GGUF/resolve/main/dulia-13b-8k-alpha.i1-Q6_K.gguf) | i1-Q6_K | 10.8 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
dulia-13b-8k-alpha.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2c8e2d3131a9f9521713ae765618b352474e8fa4cbee3d01e0bd5c53319c08c6
size 3138694240

3
dulia-13b-8k-alpha.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:72ab28d981dba1d0976705cf398ed3f01ab91d6660b1568b78e9805864331c53
size 2898771040

3
dulia-13b-8k-alpha.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b4eb5123078ef8a016a7f75088c4c1a110fac3a7da34cb0945bb2b57169740b0
size 4517672160

3
dulia-13b-8k-alpha.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:166a47310623dd8a23042855a5932c43adf58cc54a496c9db98b742e37f2c37a
size 4197774560

3
dulia-13b-8k-alpha.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:40cd60b0ae417b900e1ff91b34a27cbb5afe71828fe8fc2f6912ac1f9673a4b4
size 3891231840

3
dulia-13b-8k-alpha.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d1cc0f50d0b30e703dfd8ba8e3719de80201e96ea70e16e7e3ff0258e9d73ba4
size 3538566240

3
dulia-13b-8k-alpha.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5a7266f1ecbf0e00df5926a16953bcd5568d07dc7a41e64f723adb0df16f30fc
size 5984614240

3
dulia-13b-8k-alpha.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e387a43a3f8cfaf6d4b8f27887a892ebef43251e0935cc6d2cb0751d0502b738
size 5659084640

3
dulia-13b-8k-alpha.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c5cbbe264a5abc9b0d4b499fd80e524e99993da692c5cb46835b10e222ffaa17
size 5361715040

3
dulia-13b-8k-alpha.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6768514411eac04ddd9cd32734fe08602f218be477ac94512f33c88e6e8befdd
size 4960654560

3
dulia-13b-8k-alpha.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d35a5e826614d7f45bfd6d48d7eacdbe4a939383e87de3d864cd05501758ba32
size 6964334560

3
dulia-13b-8k-alpha.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b56a74313bea7359ec3341adff13c81bef19c7fa72ea3f917b0a23e05f65f835
size 4854365920

3
dulia-13b-8k-alpha.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:59c62047faaae4da93bae98aadd511b2fc9ea0390bbadbbd02fab7f2976a81ff
size 6929663840

3
dulia-13b-8k-alpha.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:99b0c158a0956a807a6e6fff12ec0e8ff6df5e5fcfddec854d6bb742b8383fc5
size 6337873760

3
dulia-13b-8k-alpha.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:390f454313d46d67a187fa7cecc2d4bfe4eeb1fced93093bf66ed302783758f4
size 5659084640

3
dulia-13b-8k-alpha.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2330505fa6296b3a364b738a92dbbf35e8a40bf00577697c9655ceee2d147bff
size 7388068320

3
dulia-13b-8k-alpha.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:af6c9d4f3ad045a3ac7491ee894d5df067da787d30ac24bc3c8e717669b176cb
size 7866071520

3
dulia-13b-8k-alpha.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f317811208ecb3e46c71c26105acb5e79f4882ccccded3c5481cba3a4800e58d
size 7423293920

3
dulia-13b-8k-alpha.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:30331424895c7e5106e435cb736f408222134e2a7a3f721efc2bb0657fee4904
size 9230049760

3
dulia-13b-8k-alpha.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4650fd21fb0ef29c2656f8d5027abaf0514fd5abb50e4ad9ba33a0128ad23339
size 8972411360

3
dulia-13b-8k-alpha.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e3e96daa3b5ec243920ba2ee2b9b8ed19079ccf4dca4b8b7907461e753a783a6
size 10679276640

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:184fb3b42fb3bf289e73df7da9b733f4170a0b8c1456453f8ef49dc9d2e5d96a
size 7136325