From 4035bebdbee9dc7751abaead91530e3dab5b6f0b Mon Sep 17 00:00:00 2001 From: ModelHub XC Date: Mon, 27 Apr 2026 18:20:56 +0800 Subject: [PATCH] =?UTF-8?q?=E5=88=9D=E5=A7=8B=E5=8C=96=E9=A1=B9=E7=9B=AE?= =?UTF-8?q?=EF=BC=8C=E7=94=B1ModelHub=20XC=E7=A4=BE=E5=8C=BA=E6=8F=90?= =?UTF-8?q?=E4=BE=9B=E6=A8=A1=E5=9E=8B?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Model: robinsmits/Qwen1.5-7B-Dutch-Chat-GGUF Source: Original Platform --- .gitattributes | 43 ++++++++++++++++++++++++ Qwen1.5-7B-Dutch-Chat-Q2_K.gguf | 3 ++ Qwen1.5-7B-Dutch-Chat-Q3_K_M.gguf | 3 ++ Qwen1.5-7B-Dutch-Chat-Q4_0.gguf | 3 ++ Qwen1.5-7B-Dutch-Chat-Q4_K_M.gguf | 3 ++ Qwen1.5-7B-Dutch-Chat-Q5_0.gguf | 3 ++ Qwen1.5-7B-Dutch-Chat-Q5_K_M.gguf | 3 ++ Qwen1.5-7B-Dutch-Chat-Q6_K.gguf | 3 ++ Qwen1.5-7B-Dutch-Chat-Q8_0.gguf | 3 ++ README.md | 56 +++++++++++++++++++++++++++++++ dutch-chat.txt | 5 +++ 11 files changed, 128 insertions(+) create mode 100644 .gitattributes create mode 100644 Qwen1.5-7B-Dutch-Chat-Q2_K.gguf create mode 100644 Qwen1.5-7B-Dutch-Chat-Q3_K_M.gguf create mode 100644 Qwen1.5-7B-Dutch-Chat-Q4_0.gguf create mode 100644 Qwen1.5-7B-Dutch-Chat-Q4_K_M.gguf create mode 100644 Qwen1.5-7B-Dutch-Chat-Q5_0.gguf create mode 100644 Qwen1.5-7B-Dutch-Chat-Q5_K_M.gguf create mode 100644 Qwen1.5-7B-Dutch-Chat-Q6_K.gguf create mode 100644 Qwen1.5-7B-Dutch-Chat-Q8_0.gguf create mode 100644 README.md create mode 100644 dutch-chat.txt diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..08df1d1 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,43 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Qwen1.5-7B-Dutch-Chat-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen1.5-7B-Dutch-Chat-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Qwen1.5-7B-Dutch-Chat-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Qwen1.5-7B-Dutch-Chat-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen1.5-7B-Dutch-Chat-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text +Qwen1.5-7B-Dutch-Chat-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Qwen1.5-7B-Dutch-Chat-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen1.5-7B-Dutch-Chat-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Qwen1.5-7B-Dutch-Chat-Q2_K.gguf b/Qwen1.5-7B-Dutch-Chat-Q2_K.gguf new file mode 100644 index 0000000..826681c --- /dev/null +++ b/Qwen1.5-7B-Dutch-Chat-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:eefc713886ca84f2f77382b28d443431dfe44c91bffb8be31f01173716bc66b2 +size 3102454496 diff --git a/Qwen1.5-7B-Dutch-Chat-Q3_K_M.gguf b/Qwen1.5-7B-Dutch-Chat-Q3_K_M.gguf new file mode 100644 index 0000000..5e6a34e --- /dev/null +++ b/Qwen1.5-7B-Dutch-Chat-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:89148315552e40bad8cad7998c085dc6a3e37825f8e0c3d96e6c8d0b23b0b376 +size 3917368224 diff --git a/Qwen1.5-7B-Dutch-Chat-Q4_0.gguf b/Qwen1.5-7B-Dutch-Chat-Q4_0.gguf new file mode 100644 index 0000000..9a23016 --- /dev/null +++ b/Qwen1.5-7B-Dutch-Chat-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a8257697196a72e3755dc95fc5bd0795a290a6d1bb47e6cb657859fe7df40e52 +size 4510258016 diff --git a/Qwen1.5-7B-Dutch-Chat-Q4_K_M.gguf b/Qwen1.5-7B-Dutch-Chat-Q4_K_M.gguf new file mode 100644 index 0000000..071c9e8 --- /dev/null +++ b/Qwen1.5-7B-Dutch-Chat-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c94cd86a0ed8c3166d563f9090fbba0aacf238b9245cb82c0f1927417287606d +size 4765455200 diff --git a/Qwen1.5-7B-Dutch-Chat-Q5_0.gguf b/Qwen1.5-7B-Dutch-Chat-Q5_0.gguf new file mode 100644 index 0000000..1ba6cc6 --- /dev/null +++ b/Qwen1.5-7B-Dutch-Chat-Q5_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cf351c9753a8621ed38c278e640b4021b963e888b30f2359121e4a5470dc0811 +size 5397401440 diff --git a/Qwen1.5-7B-Dutch-Chat-Q5_K_M.gguf b/Qwen1.5-7B-Dutch-Chat-Q5_K_M.gguf new file mode 100644 index 0000000..9dff152 --- /dev/null +++ b/Qwen1.5-7B-Dutch-Chat-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fe5d36d817420c2c50c72ef3ab3c4fec3b283e1f9bd940564b14c85c3f2cd968 +size 5528866656 diff --git a/Qwen1.5-7B-Dutch-Chat-Q6_K.gguf b/Qwen1.5-7B-Dutch-Chat-Q6_K.gguf new file mode 100644 index 0000000..686e46f --- /dev/null +++ b/Qwen1.5-7B-Dutch-Chat-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:54d632f6389cff15491f9f833d943b8085ede7ed4da3c7bff5e200b8f2ab414c +size 6339991328 diff --git a/Qwen1.5-7B-Dutch-Chat-Q8_0.gguf b/Qwen1.5-7B-Dutch-Chat-Q8_0.gguf new file mode 100644 index 0000000..9e996b6 --- /dev/null +++ b/Qwen1.5-7B-Dutch-Chat-Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5b67fc9af32151e860bad459e369ed19132565af51b6a66484a9a1387f365a63 +size 8209264544 diff --git a/README.md b/README.md new file mode 100644 index 0000000..6ffb8f6 --- /dev/null +++ b/README.md @@ -0,0 +1,56 @@ +--- +license: cc-by-nc-4.0 +language: +- nl +pipeline_tag: text-generation +tags: +- qwen2 +- chat +--- + +# Qwen1.5-7B-Dutch-Chat-GGUF + + +## Introduction + +This is a collection of GGUF files created from [robinsmits/Qwen1.5-7B-Dutch-Chat](https://huggingface.co/robinsmits/Qwen1.5-7B-Dutch-Chat) + +It contains the files in the following quantization formats: + +`Q2_K`, `Q3_K_M`, `Q4_0`, `Q4_K_M`, `Q5_0`, `Q5_K_M`, `Q6_K`, `Q8_0` + +## Requirements +Before you can use the GGUF files you need to clone [llama.cpp repository](https://github.com/ggerganov/llama.cpp) and install it following the official guide. + +## How to use +Download the GGUF file you would like to try and test it with the following command: +```shell +./main -m Qwen1.5-7B-Dutch-Chat-Q5_K_M.gguf -n 512 --temp 0.1 --top-k 50 --color -f dutch-chat.txt +``` + +This gives the following output: +``` +system +Je bent een behulpzame AI assistent +user +Wat is een fiets? +assistant +Een fiets is een vervoermiddel met twee wielen en een zadel. Mensen gebruiken het om op te staan en te bewegen door het te draaien met de benen. Fietsen is goed voor je lichaam en goed voor het milieu omdat je geen benzine hoeft te gebruiken. Er zijn verschillende soorten fietsen, zoals een mountainbike, een BMX-fietser, een tandemfiets en een tandemfiets met kinderwiel. Fietsen is ook leuk omdat je op verschillende plekken kunt rijden, zoals in het park, op het strand of op het platteland. [end of text] +``` + +## Recommendation + +Experimenting with the llama.cpp parameters can have a big impact on the quality of the generated text. It is therefore recommended to do your own experimentation with different settings. In my own experiments it looks like quantization 'Q5_0' or better gives good quality. The smaller files are included anyway. + +## Citation + +Thanks to the creators of Qwen1.5 for there great work! + +``` +@article{qwen, + title={Qwen Technical Report}, + author={Jinze Bai and Shuai Bai and Yunfei Chu and Zeyu Cui and Kai Dang and Xiaodong Deng and Yang Fan and Wenbin Ge and Yu Han and Fei Huang and Binyuan Hui and Luo Ji and Mei Li and Junyang Lin and Runji Lin and Dayiheng Liu and Gao Liu and Chengqiang Lu and Keming Lu and Jianxin Ma and Rui Men and Xingzhang Ren and Xuancheng Ren and Chuanqi Tan and Sinan Tan and Jianhong Tu and Peng Wang and Shijie Wang and Wei Wang and Shengguang Wu and Benfeng Xu and Jin Xu and An Yang and Hao Yang and Jian Yang and Shusheng Yang and Yang Yao and Bowen Yu and Hongyi Yuan and Zheng Yuan and Jianwei Zhang and Xingxuan Zhang and Yichang Zhang and Zhenru Zhang and Chang Zhou and Jingren Zhou and Xiaohuan Zhou and Tianhang Zhu}, + journal={arXiv preprint arXiv:2309.16609}, + year={2023} +} +``` \ No newline at end of file diff --git a/dutch-chat.txt b/dutch-chat.txt new file mode 100644 index 0000000..0d35600 --- /dev/null +++ b/dutch-chat.txt @@ -0,0 +1,5 @@ +<|im_start|>system +Je bent een behulpzame AI assistent<|im_end|> +<|im_start|>user +Wat is een fiets?<|im_end|> +<|im_start|>assistant