初始化项目,由ModelHub XC社区提供模型
Model: umiyuki/Japanese-WizardLM2-ChatV-7B-GGUF Source: Original Platform
This commit is contained in:
42
.gitattributes
vendored
Normal file
42
.gitattributes
vendored
Normal file
@@ -0,0 +1,42 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
japanese-wizardlm2-chatv-7b.f16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
japanese-wizardlm2-chatv-7b.IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
japanese-wizardlm2-chatv-7b.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
japanese-wizardlm2-chatv-7b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
japanese-wizardlm2-chatv-7b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
japanese-wizardlm2-chatv-7b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
japanese-wizardlm2-chatv-7b.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
52
README.md
Normal file
52
README.md
Normal file
@@ -0,0 +1,52 @@
|
|||||||
|
---
|
||||||
|
license: apache-2.0
|
||||||
|
language:
|
||||||
|
- ja
|
||||||
|
pipeline_tag: text-generation
|
||||||
|
tags:
|
||||||
|
- Mistral
|
||||||
|
---
|
||||||
|
|
||||||
|
# Japanese-WizardLM2-ChatV-7B-GGUF
|
||||||
|
GGUF conversion of "Japanese-WizardLM2-ChatV-7B"
|
||||||
|
|
||||||
|
This model, Japanese-WizardLM2-ChatV-7B, is based on "chatntq-ja-7b-v1.0 ", and was created by subtracting "Mistral-7B-v0.1" from "WizardLM-2-7b" ChatVector was added by a factor of 1.0.
|
||||||
|
We aimed to add the high performance of WizardLM-2 to the Japanese language capability of ChatNTQ.
|
||||||
|
|
||||||
|
このモデル、Japanese-WizardLM2-ChatV-7Bは、”chatntq-ja-7b-v1.0”をベースに、"WizardLM-2-7b"から"Mistral-7B-v0.1"を差し引いて作ったChatVectorを1.0倍で足しました。
|
||||||
|
ChatNTQの日本語能力にWizardLM-2の性能の高さが加わる事を狙いました。
|
||||||
|
|
||||||
|
### Performance
|
||||||
|
|
||||||
|
<table>
|
||||||
|
<tr>
|
||||||
|
<th>Model</th>
|
||||||
|
<th><a href="https://huggingface.co/CohereForAI/c4ai-command-r-plus">c4ai-command-r-plus(Cohere API)</a></th>
|
||||||
|
<th><a href="https://huggingface.co/TFMC/Japanese-Starling-ChatV-7B-GGUF">JA-Starling-ChatV-7B-GGUF(fp16)</th>
|
||||||
|
<th>JA-WizardLM2-ChatV-7B-GGUF (This model)(fp16)</th>
|
||||||
|
<th><a href="https://huggingface.co/TFMC/ChatNTQ-JA-7b-v1.0-GGUF">ChatNTQ-JA-7b-v1.0-GGUF(Q8_0)</a></th>
|
||||||
|
</tr>
|
||||||
|
<tr>
|
||||||
|
<td>Parameters</td>
|
||||||
|
<td>104B</td>
|
||||||
|
<td>7B(Mistral)</td>
|
||||||
|
<td>7B(Mistral)</td>
|
||||||
|
<td>7B(Mistral)</td>
|
||||||
|
</tr>
|
||||||
|
<tr>
|
||||||
|
<td>ELYZAtasks100<br>average score</td>
|
||||||
|
<td>4.04</td>
|
||||||
|
<td>3.77</td>
|
||||||
|
<td>3.40</td>
|
||||||
|
<td>2.74</td>
|
||||||
|
</tr>
|
||||||
|
</table>
|
||||||
|
|
||||||
|
This score was evaluated by Cohere API command-r-plus using the "<a href="https://huggingface.co/datasets/elyza/ELYZA-tasks-100">ELYZA-tasks-100</a>", a Japanese model with instruction-tuning.
|
||||||
|
|
||||||
|
このスコアはinstruction-tuningを行った日本語モデルのベンチマーク「ELYZA-tasks-100」を使い、Cohere APIのcommand-r-plusにより評価させたものです。
|
||||||
|
|
||||||
|
### Prompt Template
|
||||||
|
|
||||||
|
- Llama-2-Chat
|
||||||
|
<pre><code>[INST] <<SYS>>\nあなたは役に立つアシスタントです。\n<</SYS>>\n\n{prompt} [/INST]</code></pre>
|
||||||
3
japanese-wizardlm2-chatv-7b.IQ3_XXS.gguf
Normal file
3
japanese-wizardlm2-chatv-7b.IQ3_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:1694551a37761088ccf77ae826529550c692f7e5ceecb6cbc82f4a60a0798ab9
|
||||||
|
size 2827343584
|
||||||
3
japanese-wizardlm2-chatv-7b.IQ4_XS.gguf
Normal file
3
japanese-wizardlm2-chatv-7b.IQ4_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:6e8b91909e2300360d05ad0b2ab107103b757bf920aea2ebe2809809f58771c4
|
||||||
|
size 3907688160
|
||||||
3
japanese-wizardlm2-chatv-7b.Q4_K_M.gguf
Normal file
3
japanese-wizardlm2-chatv-7b.Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:b32bfef6c51c559781b783ac9ed516a77c6bfa957e40f3d394c9e7f1e0ee09b7
|
||||||
|
size 4368439008
|
||||||
3
japanese-wizardlm2-chatv-7b.Q5_K_M.gguf
Normal file
3
japanese-wizardlm2-chatv-7b.Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:2304a177f245da1dd265bbe4927eb70d7d92c25468ad35afca7975b951322f15
|
||||||
|
size 5131409120
|
||||||
3
japanese-wizardlm2-chatv-7b.Q6_K.gguf
Normal file
3
japanese-wizardlm2-chatv-7b.Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:1e68cdf0a4ef51e446e7034e6794d122b3141b46a0d98e82fb796aff2f6479dc
|
||||||
|
size 5942064864
|
||||||
3
japanese-wizardlm2-chatv-7b.Q8_0.gguf
Normal file
3
japanese-wizardlm2-chatv-7b.Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:f7f24e7f9ca3022831092481a405973e03c77421f8fde539082445a4331a49f5
|
||||||
|
size 7695857344
|
||||||
3
japanese-wizardlm2-chatv-7b.f16.gguf
Normal file
3
japanese-wizardlm2-chatv-7b.f16.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:b30cefd91e87f1cffa9a3907b098ba093cc91a53ad70a357cbfcbe91c102c729
|
||||||
|
size 14484731584
|
||||||
Reference in New Issue
Block a user