commit 5b2f81ba69e98f48bbc3805123edb1b122d953c8 Author: ModelHub XC Date: Fri Jul 10 08:35:09 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: TFMC/Japanese-Starling-ChatV-7B-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..4e0e087 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,40 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +japanese-starling-chatv-7b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +japanese-starling-chatv-7b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +japanese-starling-chatv-7b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +japanese-starling-chatv-7b.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text +japanese-starling-chatv-7b.f16.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..9142350 --- /dev/null +++ b/README.md @@ -0,0 +1,53 @@ +--- +license: apache-2.0 +language: +- ja +pipeline_tag: text-generation +tags: +- Mistral +--- +# Japanese-Starling-ChatV-7B-GGUF + +GGUF conversion of "Japanese-Starling-ChatV-7B" + +"Japanese-Starling-ChatV-7B" is a Japanese chat model built on top of "chatntq-ja-7b-v1.0", originally based on Mistral-7B-v0.1. +I applied the chat vector acquired by subtracting the weights of Mistral-7B-v0.1 from the weights of "Starling-LM-7B-beta" to this model. + +このモデルはchatntq-ja-7b-v1.0をベースにした7Bパラメータの日本語チャットモデルです。高性能の英語モデルであるStarling-LM-7B-betaの重みからMistral-7B-v0.1の重みを差し引くことで得たchat vectorを適用しています（ブログ記事）。 + +### Performance + + + + + + + + + + + + + + + + + + + + + + + + + + +
Model
(Q8_0 quant)		c4ai-command-r-v01-GGUFJA-Starling-ChatV-7B-GGUF (This model)ChatNTQ-JA-7b-v1.0-GGUFRakutenAI-7B-chat-ggufELYZA-japanese-Llama-2-7b-instruct-gguf
Parameters35B7B(Mistral)7B(Mistral)7B(Mistral)7B(Llama-2)
ELYZAtasks100
average score		3.423.423.062.822.46
+ +Scores on "ELYZA-tasks-100" benchmark for the instruction-tuned Japanese models evaluated by GPT-4-0125-preview. Please note that this is a simplified evaluation using the Q8 quantized models. + +このスコアはinstruction-tuningを行った日本語モデルのベンチマーク「ELYZA-tasks-100」を使い、GPT-4-0125-previewにより評価させたものです。Q8量子化モデルを用いた簡易的な評価であることにご留意ください。 + +### Prompt Template + +
[INST] <<SYS>>\nあなたは役に立つアシスタントです。\n<</SYS>>\n\n{prompt} [/INST]
\ No newline at end of file diff --git a/japanese-starling-chatv-7b.Q4_K_M.gguf b/japanese-starling-chatv-7b.Q4_K_M.gguf new file mode 100644 index 0000000..5d03a00 --- /dev/null +++ b/japanese-starling-chatv-7b.Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2333faf37d3b771a472a0b2ba10c26667529661c897660c7cf07d614c817161d +size 4368438976 diff --git a/japanese-starling-chatv-7b.Q5_K_M.gguf b/japanese-starling-chatv-7b.Q5_K_M.gguf new file mode 100644 index 0000000..4682071 --- /dev/null +++ b/japanese-starling-chatv-7b.Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:79b5111f70a1ab11c72986b4204917bc011d6b46f914f5efc43ff2ae9206993d +size 5131409088 diff --git a/japanese-starling-chatv-7b.Q6_K.gguf b/japanese-starling-chatv-7b.Q6_K.gguf new file mode 100644 index 0000000..f3055ad --- /dev/null +++ b/japanese-starling-chatv-7b.Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7e5ac0bd148453b834b06db50e1cc3ed814d3fd4f1f08d22cb669cb25a6a2cf6 +size 5942064832 diff --git a/japanese-starling-chatv-7b.Q8_0.gguf b/japanese-starling-chatv-7b.Q8_0.gguf new file mode 100644 index 0000000..9f7110f --- /dev/null +++ b/japanese-starling-chatv-7b.Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0cc96b1e4db294c47a2fbe12dc0203d0cf8de6d64a1835c76c7e70b87223e253 +size 7695857344 diff --git a/japanese-starling-chatv-7b.f16.gguf b/japanese-starling-chatv-7b.f16.gguf new file mode 100644 index 0000000..62a3ce1 --- /dev/null +++ b/japanese-starling-chatv-7b.f16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bdd90834edeaee6a9f5b2359b00226bfdf17c8f932c252b7ca0f9f4cb90dcad0 +size 14484731552