初始化项目，由ModelHub XC社区提供模型

Model: h2oai/h2o-danube3-500m-chat-GGUF
Source: Original Platform

.gitattributes

@@ -0,0 +1,40 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+h2o-danube3-500m-chat-F16.gguf filter=lfs diff=lfs merge=lfs -text
+h2o-danube3-500m-chat-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+h2o-danube3-500m-chat-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+h2o-danube3-500m-chat-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+h2o-danube3-500m-chat-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,48 @@
+---
+language:
+- en
+library_name: transformers
+license: apache-2.0
+tags:
+- gpt
+- llm
+- large language model
+- h2o-llmstudio
+thumbnail: >-
+  https://h2o.ai/etc.clientlibs/h2o/clientlibs/clientlib-site/resources/images/favicon.ico
+pipeline_tag: text-generation
+quantized_by: h2oai
+---
+
+# h2o-danube3-500m-chat-GGUF
+- Model creator: [H2O.ai](https://huggingface.co/h2oai)
+- Original model: [h2oai/h2o-danube3-500m-chat](https://huggingface.co/h2oai/h2o-danube3-500m-chat)
+
+## Description
+
+This repo contains GGUF format model files for [h2o-danube3-500m-chat](https://huggingface.co/h2oai/h2o-danube3-500m-chat) quantized using [llama.cpp](https://github.com/ggerganov/llama.cpp/) framework.
+
+Table below summarizes different quantized versions of [h2o-danube3-500m-chat](https://huggingface.co/h2oai/h2o-danube3-500m-chat). It shows the trade-off between size, speed and quality of the models.
+
+
+| Name                             | Quant method                      | Model size | MT-Bench AVG | Perplexity | Tokens per second |
+|:----------------------------------|:----------------------------------:|:----------:|:------------:|:------------:|:-------------------:|
+| [h2o-danube3-500m-chat-F16.gguf](https://huggingface.co/h2oai/h2o-danube3-500m-chat-GGUF/blob/main/h2o-danube3-500m-chat-F16.gguf)   | F16                              |    1.03 GB   |     3.34     |    9.46    |       1870        |
+| [h2o-danube3-500m-chat-Q8_0.gguf](https://huggingface.co/h2oai/h2o-danube3-500m-chat-GGUF/blob/main/h2o-danube3-500m-chat-Q8_0.gguf)   | Q8_0                              |    0.55 GB   |     3.76     |    9.46    |       2144        |
+| [h2o-danube3-500m-chat-Q6_K.gguf](https://huggingface.co/h2oai/h2o-danube3-500m-chat-GGUF/blob/main/h2o-danube3-500m-chat-Q6_K.gguf)   | Q6_K                              |  0.42 GB   |     3.77     |    9.46    |       2418        |
+| [h2o-danube3-500m-chat-Q5_K_M.gguf](https://huggingface.co/h2oai/h2o-danube3-500m-chat-GGUF/blob/main/h2o-danube3-500m-chat-Q5_K_M.gguf) | Q5_K_M                            |     0.37 GB   |     3.20     |    9.55    |       2430        |
+| [h2o-danube3-500m-chat-Q4_K_M.gguf](https://huggingface.co/h2oai/h2o-danube3-500m-chat-GGUF/blob/main/h2o-danube3-500m-chat-Q4_K_M.gguf) | Q4_K_M |  0.32 GB   |     3.16     |    9.96    |       2427        |
+
+Columns in the table are:
+* Name -- model name and link
+* Quant method -- quantization method
+* Model size -- size of the model in gigabytes
+* MT-Bench AVG -- [MT-Bench](https://arxiv.org/abs/2306.05685) benchmark score. The score is from 1 to 10, the higher, the better
+* Perplexity -- perplexity metric on WikiText-2 dataset. It's reported in a perplexity test from llama.cpp. The lower, the better
+* Tokens per second -- generation speed in tokens per second, as reported in a perplexity test from llama.cpp. The higher, the better. Speed tests are done on a single H100 GPU
+
+
+## Prompt template
+```
+<|prompt|>Why is drinking water so healthy?</s><|answer|>
+```

h2o-danube3-500m-chat-F16.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:374d7e67708ba8f193265124262917926dbfdde5c0fc9ecb6857e2dd2def4382
+size 1028010144

h2o-danube3-500m-chat-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:021f78849c5670ecb2aa4cd7c5972eee0a3c9e41e33e5902c408a2ab989f0b43
+size 317877408

h2o-danube3-500m-chat-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:32645ff099bb40bf1f9d5035b5cda887ed54d3760e0ab1b5ac2dc8cdd2f7ab42
+size 368454816

h2o-danube3-500m-chat-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1a2cb179fcfa53399d24dbfc2bd8aaf86e6627ece685216855505b14435c1be7
+size 422193312

h2o-danube3-500m-chat-Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:585cb770ecfb48c77dacfdd250e6dab9adc62ef10f094630ed39d383fe4372d9
+size 546566304