初始化项目，由ModelHub XC社区提供模型

Model: umiyuki/Japanese-WizardLM2-ChatV-7B-GGUF Source: Original Platform
2026-08-16 12:43:16 +08:00
commit 82f2041979
9 changed files with 115 additions and 0 deletions
--- a/.gitattributes
+++ b/.gitattributes
@@ -0,0 +1,42 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+japanese-wizardlm2-chatv-7b.f16.gguf filter=lfs diff=lfs merge=lfs -text
+japanese-wizardlm2-chatv-7b.IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
+japanese-wizardlm2-chatv-7b.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
+japanese-wizardlm2-chatv-7b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+japanese-wizardlm2-chatv-7b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+japanese-wizardlm2-chatv-7b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+japanese-wizardlm2-chatv-7b.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
--- a/README.md
+++ b/README.md
@@ -0,0 +1,52 @@
+---
+license: apache-2.0
+language:
+- ja
+pipeline_tag: text-generation
+tags:
+- Mistral
+---
+
+# Japanese-WizardLM2-ChatV-7B-GGUF
+GGUF conversion of "Japanese-WizardLM2-ChatV-7B"
+
+This model, Japanese-WizardLM2-ChatV-7B, is based on "chatntq-ja-7b-v1.0 ", and was created by subtracting "Mistral-7B-v0.1" from "WizardLM-2-7b" ChatVector was added by a factor of 1.0.
+We aimed to add the high performance of WizardLM-2 to the Japanese language capability of ChatNTQ.
+
+このモデル、Japanese-WizardLM2-ChatV-7Bは、”chatntq-ja-7b-v1.0”をベースに、"WizardLM-2-7b"から"Mistral-7B-v0.1"を差し引いて作ったChatVectorを1.0倍で足しました。
+ChatNTQの日本語能力にWizardLM-2の性能の高さが加わる事を狙いました。
+
+### Performance
+
+<table>
+ <tr>
+   <th>Model</th>
+   <th><a href="https://huggingface.co/CohereForAI/c4ai-command-r-plus">c4ai-command-r-plus(Cohere API)</a></th>
+   <th><a href="https://huggingface.co/TFMC/Japanese-Starling-ChatV-7B-GGUF">JA-Starling-ChatV-7B-GGUF(fp16)</th>
+   <th>JA-WizardLM2-ChatV-7B-GGUF (This model)(fp16)</th>
+   <th><a href="https://huggingface.co/TFMC/ChatNTQ-JA-7b-v1.0-GGUF">ChatNTQ-JA-7b-v1.0-GGUF(Q8_0)</a></th>
+ </tr>
+ <tr>
+   <td>Parameters</td>
+   <td>104B</td>
+   <td>7B(Mistral)</td>
+   <td>7B(Mistral)</td>
+   <td>7B(Mistral)</td>
+ </tr>
+ <tr>
+   <td>ELYZAtasks100<br>average score</td>
+   <td>4.04</td>
+   <td>3.77</td>
+   <td>3.40</td>
+   <td>2.74</td>
+ </tr>
+</table>
+
+This score was evaluated by Cohere API command-r-plus using the "<a href="https://huggingface.co/datasets/elyza/ELYZA-tasks-100">ELYZA-tasks-100</a>", a Japanese model with instruction-tuning.
+
+このスコアはinstruction-tuningを行った日本語モデルのベンチマーク「ELYZA-tasks-100」を使い、Cohere APIのcommand-r-plusにより評価させたものです。
+
+### Prompt Template
+
+- Llama-2-Chat
+<pre><code>[INST] &lt;&lt;SYS&gt;&gt;\nあなたは役に立つアシスタントです。\n&lt;&lt;/SYS&gt;&gt;\n\n{prompt} [/INST]</code></pre>
--- a/japanese-wizardlm2-chatv-7b.IQ3_XXS.gguf
+++ b/japanese-wizardlm2-chatv-7b.IQ3_XXS.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1694551a37761088ccf77ae826529550c692f7e5ceecb6cbc82f4a60a0798ab9
+size 2827343584
--- a/japanese-wizardlm2-chatv-7b.IQ4_XS.gguf
+++ b/japanese-wizardlm2-chatv-7b.IQ4_XS.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6e8b91909e2300360d05ad0b2ab107103b757bf920aea2ebe2809809f58771c4
+size 3907688160
--- a/japanese-wizardlm2-chatv-7b.Q4_K_M.gguf
+++ b/japanese-wizardlm2-chatv-7b.Q4_K_M.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b32bfef6c51c559781b783ac9ed516a77c6bfa957e40f3d394c9e7f1e0ee09b7
+size 4368439008
--- a/japanese-wizardlm2-chatv-7b.Q5_K_M.gguf
+++ b/japanese-wizardlm2-chatv-7b.Q5_K_M.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2304a177f245da1dd265bbe4927eb70d7d92c25468ad35afca7975b951322f15
+size 5131409120
--- a/japanese-wizardlm2-chatv-7b.Q6_K.gguf
+++ b/japanese-wizardlm2-chatv-7b.Q6_K.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1e68cdf0a4ef51e446e7034e6794d122b3141b46a0d98e82fb796aff2f6479dc
+size 5942064864
--- a/japanese-wizardlm2-chatv-7b.Q8_0.gguf
+++ b/japanese-wizardlm2-chatv-7b.Q8_0.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f7f24e7f9ca3022831092481a405973e03c77421f8fde539082445a4331a49f5
+size 7695857344
--- a/japanese-wizardlm2-chatv-7b.f16.gguf
+++ b/japanese-wizardlm2-chatv-7b.f16.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b30cefd91e87f1cffa9a3907b098ba093cc91a53ad70a357cbfcbe91c102c729
+size 14484731584