初始化项目，由ModelHub XC社区提供模型

Model: mradermacher/h2o-danube3-500m-chat-i1-GGUF
Source: Original Platform

.gitattributes

@@ -0,0 +1,59 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+h2o-danube3-500m-chat.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+h2o-danube3-500m-chat.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
+h2o-danube3-500m-chat.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+h2o-danube3-500m-chat.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
+h2o-danube3-500m-chat.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+h2o-danube3-500m-chat.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+h2o-danube3-500m-chat.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
+h2o-danube3-500m-chat.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+h2o-danube3-500m-chat.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
+h2o-danube3-500m-chat.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
+h2o-danube3-500m-chat.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+h2o-danube3-500m-chat.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
+h2o-danube3-500m-chat.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+h2o-danube3-500m-chat.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
+h2o-danube3-500m-chat.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+h2o-danube3-500m-chat.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
+h2o-danube3-500m-chat.i1-Q4_0_4_4.gguf filter=lfs diff=lfs merge=lfs -text
+h2o-danube3-500m-chat.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
+h2o-danube3-500m-chat.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+h2o-danube3-500m-chat.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+h2o-danube3-500m-chat.i1-Q4_0_4_8.gguf filter=lfs diff=lfs merge=lfs -text
+h2o-danube3-500m-chat.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
+h2o-danube3-500m-chat.i1-Q4_0_8_8.gguf filter=lfs diff=lfs merge=lfs -text
+h2o-danube3-500m-chat.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,81 @@
+---
+base_model: h2oai/h2o-danube3-500m-chat
+language:
+- en
+library_name: transformers
+license: apache-2.0
+quantized_by: mradermacher
+tags:
+- gpt
+- llm
+- large language model
+- h2o-llmstudio
+---
+## About
+
+<!-- ### quantize_version: 2 -->
+<!-- ### output_tensor_quantised: 1 -->
+<!-- ### convert_type: hf -->
+<!-- ### vocab_type:  -->
+<!-- ### tags: nicoboss -->
+weighted/imatrix quants of https://huggingface.co/h2oai/h2o-danube3-500m-chat
+
+<!-- provided-files -->
+static quants are available at https://huggingface.co/mradermacher/h2o-danube3-500m-chat-GGUF
+## Usage
+
+If you are unsure how to use GGUF files, refer to one of [TheBloke's
+READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
+more details, including on how to concatenate multi-part files.
+
+## Provided Quants
+
+(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
+
+| Link | Type | Size/GB | Notes |
+|:-----|:-----|--------:|:------|
+| [GGUF](https://huggingface.co/mradermacher/h2o-danube3-500m-chat-i1-GGUF/resolve/main/h2o-danube3-500m-chat.i1-IQ1_S.gguf) | i1-IQ1_S | 0.2 | for the desperate |
+| [GGUF](https://huggingface.co/mradermacher/h2o-danube3-500m-chat-i1-GGUF/resolve/main/h2o-danube3-500m-chat.i1-IQ1_M.gguf) | i1-IQ1_M | 0.2 | mostly desperate |
+| [GGUF](https://huggingface.co/mradermacher/h2o-danube3-500m-chat-i1-GGUF/resolve/main/h2o-danube3-500m-chat.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.3 |  |
+| [GGUF](https://huggingface.co/mradermacher/h2o-danube3-500m-chat-i1-GGUF/resolve/main/h2o-danube3-500m-chat.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.3 |  |
+| [GGUF](https://huggingface.co/mradermacher/h2o-danube3-500m-chat-i1-GGUF/resolve/main/h2o-danube3-500m-chat.i1-IQ2_S.gguf) | i1-IQ2_S | 0.3 |  |
+| [GGUF](https://huggingface.co/mradermacher/h2o-danube3-500m-chat-i1-GGUF/resolve/main/h2o-danube3-500m-chat.i1-IQ2_M.gguf) | i1-IQ2_M | 0.3 |  |
+| [GGUF](https://huggingface.co/mradermacher/h2o-danube3-500m-chat-i1-GGUF/resolve/main/h2o-danube3-500m-chat.i1-Q2_K.gguf) | i1-Q2_K | 0.3 | IQ3_XXS probably better |
+| [GGUF](https://huggingface.co/mradermacher/h2o-danube3-500m-chat-i1-GGUF/resolve/main/h2o-danube3-500m-chat.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.3 | lower quality |
+| [GGUF](https://huggingface.co/mradermacher/h2o-danube3-500m-chat-i1-GGUF/resolve/main/h2o-danube3-500m-chat.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.3 |  |
+| [GGUF](https://huggingface.co/mradermacher/h2o-danube3-500m-chat-i1-GGUF/resolve/main/h2o-danube3-500m-chat.i1-IQ3_S.gguf) | i1-IQ3_S | 0.3 | beats Q3_K* |
+| [GGUF](https://huggingface.co/mradermacher/h2o-danube3-500m-chat-i1-GGUF/resolve/main/h2o-danube3-500m-chat.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.3 | IQ3_XS probably better |
+| [GGUF](https://huggingface.co/mradermacher/h2o-danube3-500m-chat-i1-GGUF/resolve/main/h2o-danube3-500m-chat.i1-IQ3_M.gguf) | i1-IQ3_M | 0.3 |  |
+| [GGUF](https://huggingface.co/mradermacher/h2o-danube3-500m-chat-i1-GGUF/resolve/main/h2o-danube3-500m-chat.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.4 | IQ3_S probably better |
+| [GGUF](https://huggingface.co/mradermacher/h2o-danube3-500m-chat-i1-GGUF/resolve/main/h2o-danube3-500m-chat.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.4 | IQ3_M probably better |
+| [GGUF](https://huggingface.co/mradermacher/h2o-danube3-500m-chat-i1-GGUF/resolve/main/h2o-danube3-500m-chat.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.4 |  |
+| [GGUF](https://huggingface.co/mradermacher/h2o-danube3-500m-chat-i1-GGUF/resolve/main/h2o-danube3-500m-chat.i1-Q4_0_4_4.gguf) | i1-Q4_0_4_4 | 0.4 | fast on arm, low quality |
+| [GGUF](https://huggingface.co/mradermacher/h2o-danube3-500m-chat-i1-GGUF/resolve/main/h2o-danube3-500m-chat.i1-Q4_0_4_8.gguf) | i1-Q4_0_4_8 | 0.4 | fast on arm+i8mm, low quality |
+| [GGUF](https://huggingface.co/mradermacher/h2o-danube3-500m-chat-i1-GGUF/resolve/main/h2o-danube3-500m-chat.i1-Q4_0_8_8.gguf) | i1-Q4_0_8_8 | 0.4 | fast on arm+sve, low quality |
+| [GGUF](https://huggingface.co/mradermacher/h2o-danube3-500m-chat-i1-GGUF/resolve/main/h2o-danube3-500m-chat.i1-Q4_0.gguf) | i1-Q4_0 | 0.4 | fast, low quality |
+| [GGUF](https://huggingface.co/mradermacher/h2o-danube3-500m-chat-i1-GGUF/resolve/main/h2o-danube3-500m-chat.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.4 | optimal size/speed/quality |
+| [GGUF](https://huggingface.co/mradermacher/h2o-danube3-500m-chat-i1-GGUF/resolve/main/h2o-danube3-500m-chat.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.4 | fast, recommended |
+| [GGUF](https://huggingface.co/mradermacher/h2o-danube3-500m-chat-i1-GGUF/resolve/main/h2o-danube3-500m-chat.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.5 |  |
+| [GGUF](https://huggingface.co/mradermacher/h2o-danube3-500m-chat-i1-GGUF/resolve/main/h2o-danube3-500m-chat.i1-Q5_K_M.gguf) | i1-Q5_K_M | 0.5 |  |
+| [GGUF](https://huggingface.co/mradermacher/h2o-danube3-500m-chat-i1-GGUF/resolve/main/h2o-danube3-500m-chat.i1-Q6_K.gguf) | i1-Q6_K | 0.5 | practically like static Q6_K |
+
+Here is a handy graph by ikawrakow comparing some lower-quality quant
+types (lower is better):
+
+![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
+
+And here are Artefact2's thoughts on the matter:
+https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
+
+## FAQ / Model Request
+
+See https://huggingface.co/mradermacher/model_requests for some answers to
+questions you might have and/or if you want some other model quantized.
+
+## Thanks
+
+I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
+me use its servers and providing upgrades to my workstation to enable
+this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
+
+<!-- end -->

h2o-danube3-500m-chat.i1-IQ1_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:46e67e8c2994468c71eaae9a666eb9729c2547e9985275db396cc72714d2ba1a
+size 146599232

h2o-danube3-500m-chat.i1-IQ1_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4307ceda20e28b56f4f765f2b1f594d45a9c95942fc1c7fae5e70d78f4728278
+size 138489152

h2o-danube3-500m-chat.i1-IQ2_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:62eb1e588fcc1de8c0c98277dab33140c7b186ca61bb6961c80986ce36ee942d
+size 196417856

h2o-danube3-500m-chat.i1-IQ2_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:eed11b51910c85de508592cf689a8a260a4e78747e529881580d45838ea36f33
+size 185604416

h2o-danube3-500m-chat.i1-IQ2_XS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3e2675c70b8e88d820a357a3ac126d731b52003aca9154378bc5379423755284
+size 172109120

h2o-danube3-500m-chat.i1-IQ2_XXS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ed51d32f478e4bdd9cc757885c96e462243108b2b77fc1881ad733d5a3a0a721
+size 160116032

h2o-danube3-500m-chat.i1-IQ3_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fcae994d97193b8ca849574b2768cfe7ae59b8043011fb788828a5f8e6808b34
+size 249984320

h2o-danube3-500m-chat.i1-IQ3_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9d09b47cae6225fbd15c852d469ce44a804cc964afa74641e6198bb0eaf4e8e0
+size 240792896

h2o-danube3-500m-chat.i1-IQ3_XS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1d27544404413cec0f5890923e36a28d144f6e369aad1cae76275165644437aa
+size 231060800

h2o-danube3-500m-chat.i1-IQ3_XXS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:99ec7636aa8f83e3515ffc54dac8da9682b652398977e56e7840046b76e3ba00
+size 213031232

h2o-danube3-500m-chat.i1-IQ4_XS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:098b226b22222a7ac48a90d4227173c1f12d9036136bd94741077ee8b6d98013
+size 287957312

h2o-danube3-500m-chat.i1-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:af351f995a3bbed8cb44e06d6343a9db9cbb056c0fd1ced8dd7b6230473f67de
+size 209602880

h2o-danube3-500m-chat.i1-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f88795c4b26b9585dc8551a599987f04a07b2c61958409fa14cd78b52a9e8f8c
+size 281343296

h2o-danube3-500m-chat.i1-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bdc6650eeac86147e7946d13b26178dcc69cd4d6cca025989a07e5369e0e485c
+size 262763840

h2o-danube3-500m-chat.i1-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:18572c6fb591adfd59b24032c587d758c4cd95db746f9cd7830109d915ef576c
+size 240792896

h2o-danube3-500m-chat.i1-Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ae7badb5964020185800c5bdfceb7c5598e4aebf4e82c8fe7a18ac86f9ede231
+size 303255872

h2o-danube3-500m-chat.i1-Q4_0_4_4.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7af4c101d12844899a3cf94cb7ed83df1121ef88352acec649a107132f3177b8
+size 302469440

h2o-danube3-500m-chat.i1-Q4_0_4_8.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:918c2daefebea0cee1fbc658f0e8f01870a4b070accb45742e9a3d864a205049
+size 302469440

h2o-danube3-500m-chat.i1-Q4_0_8_8.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e0c744731a390cdfb7f104c82c76ef218b4950139cd6c31faa86ca2abde751ed
+size 302469440

h2o-danube3-500m-chat.i1-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d90d7ac6349cc6815c83cf0826fc51dae9da52f556c76d1072c6be986ca5eb43
+size 317878592

h2o-danube3-500m-chat.i1-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9397dca7b1d353ce2815c9e13b6d5dd1405c36aa4bdc7086eb973f50c32a8a9f
+size 304632128

h2o-danube3-500m-chat.i1-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:32c4f15dce298c6ea4d4c78eccce3376f9298a2e45ecccba4528180c34545c27
+size 368456000

h2o-danube3-500m-chat.i1-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:df5005d171371dd23561864a7f424b61ff4dc7e52efee5c652d4f999bc50c881
+size 360517952

h2o-danube3-500m-chat.i1-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:22a7a4b7e3c2150a69d9a2bc4f8ea088f3addc515af02ddaa2fee75a376a97af
+size 422194496