Update README.md

README.md

@@ -2,8 +2,13 @@
 frameworks:
 - other
 license: Apache License 2.0
-tasks:
+model-type:
-- text-generation
+- llama
+language:
+- zh
+- en
+tools:
+- llamacpp
 
 #model-type:
 ##如 gpt、phi、llama、chatglm、baichuan 等
@@ -29,23 +34,76 @@ tasks:
 ##如 vllm、fastchat、llamacpp、AdaSeq 等
 #- vllm
 ---
-### 当前模型的贡献者未提供更加详细的模型介绍。模型文件和权重，可浏览“模型文件”页面获取。
-#### 您可以通过如下git clone命令，或者ModelScope SDK来下载模型
 
-SDK下载
+---
-```bash
+license: apache-2.0
-#安装ModelScope
+language:
-pip install modelscope
+- zh
-```
+- en
-```python
+---
-#SDK模型下载
-from modelscope import snapshot_download
-model_dir = snapshot_download('ChineseAlpacaGroup/llama-3-chinese-8b-instruct-v3-gguf')
-```
-Git下载
-```
-#Git模型下载
-git clone https://www.modelscope.cn/ChineseAlpacaGroup/llama-3-chinese-8b-instruct-v3-gguf.git
-```
 
-<p style="color: lightgrey;">如果您是本模型的贡献者，我们邀请您根据<a href="https://modelscope.cn/docs/ModelScope%E6%A8%A1%E5%9E%8B%E6%8E%A5%E5%85%A5%E6%B5%81%E7%A8%8B%E6%A6%82%E8%A7%88" style="color: lightgrey; text-decoration: underline;">模型贡献文档</a>，及时完善模型卡片内容。</p>
+# Llama-3-Chinese-8B-Instruct-v3-GGUF
+
+<p align="center">
+    <a href="https://github.com/ymcui/Chinese-LLaMA-Alpaca-3"><img src="https://ymcui.com/images/chinese-llama-alpaca-3-banner.png" width="600"/></a>
+</p>
+
+这个仓库包含了**Llama-3-Chinese-8B-Instruct-v3-GGUF**（兼容llama.cpp/ollama等），是[Llama-3-Chinese-8B-Instruct-v3](https://modelscope.cn/models/ChineseAlpacaGroup/llama-3-chinese-8b-instruct-v3)模型的量化版本。
+
+**注意：这是一个指令模型，可以直接适用于对话、问答等任务。**
+
+更多细节（性能、使用方法等）请参考GitHub项目页面：https://github.com/ymcui/Chinese-LLaMA-Alpaca-3
+
+## 量化性能
+
+评测指标：PPL，**越低越好**
+
+| Quant |     Size |                 PPL |
+| :---: | -------: | ------------------: |
+| Q2_K  |  2.96 GB | 10.0534 +/- 0.13135 |
+| Q3_K  |  3.74 GB |  6.3295 +/- 0.07816 |
+| Q4_0  |  4.34 GB |  6.3200 +/- 0.07893 |
+| Q4_K  |  4.58 GB |  6.0042 +/- 0.07431 |
+| Q5_0  |  5.21 GB |  6.0437 +/- 0.07526 |
+| Q5_K  |  5.34 GB |  5.9484 +/- 0.07399 |
+| Q6_K  |  6.14 GB |  5.9469 +/- 0.07404 |
+| Q8_0  |  7.95 GB |  5.8933 +/- 0.07305 |
+|  F16  | 14.97 GB |  5.8902 +/- 0.07303 |
+
+
+## 其他
+
+- 完整模型：https://modelscope.cn/models/ChineseAlpacaGroup/llama-3-chinese-8b-instruct-v3
+
+- 关于本模型的提问，请通过 https://github.com/ymcui/Chinese-LLaMA-Alpaca-3 提交issue
+
+
+----
+
+This repository contains **Llama-3-Chinese-8B-Instruct-v3-GGUF** (llama.cpp/ollama/tgw, etc. compatible), which is the quantized version of [Llama-3-Chinese-8B-Instruct-v3](https://huggingface.co/hfl/llama-3-chinese-8b-instruct-v3).
+
+**Note: this is an instruction (chat) model, which can be used for conversation, QA, etc.** 
+
+Further details (performance, usage, etc.) should refer to GitHub project page: https://github.com/ymcui/Chinese-LLaMA-Alpaca-3
+
+## Performance
+
+Metric: PPL, lower is better
+
+| Quant |     Size |                 PPL |
+| :---: | -------: | ------------------: |
+| Q2_K  |  2.96 GB | 10.0534 +/- 0.13135 |
+| Q3_K  |  3.74 GB |  6.3295 +/- 0.07816 |
+| Q4_0  |  4.34 GB |  6.3200 +/- 0.07893 |
+| Q4_K  |  4.58 GB |  6.0042 +/- 0.07431 |
+| Q5_0  |  5.21 GB |  6.0437 +/- 0.07526 |
+| Q5_K  |  5.34 GB |  5.9484 +/- 0.07399 |
+| Q6_K  |  6.14 GB |  5.9469 +/- 0.07404 |
+| Q8_0  |  7.95 GB |  5.8933 +/- 0.07305 |
+|  F16  | 14.97 GB |  5.8902 +/- 0.07303 |
+
+## Others
+
+- For full model, please see: https://huggingface.co/hfl/llama-3-chinese-8b-instruct-v3
+
+- If you have questions/issues regarding this model, please submit an issue through https://github.com/ymcui/Chinese-LLaMA-Alpaca-3