初始化项目，由ModelHub XC社区提供模型
Model: robinsmits/Qwen1.5-7B-Dutch-Chat-GGUF Source: Original Platform
This commit is contained in:
ModelHub XC
43
.gitattributes
vendored
Normal file
43
.gitattributes
vendored
Normal file
@@ -0,0 +1,43 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen1.5-7B-Dutch-Chat-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen1.5-7B-Dutch-Chat-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen1.5-7B-Dutch-Chat-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen1.5-7B-Dutch-Chat-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen1.5-7B-Dutch-Chat-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen1.5-7B-Dutch-Chat-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen1.5-7B-Dutch-Chat-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen1.5-7B-Dutch-Chat-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
3
Qwen1.5-7B-Dutch-Chat-Q2_K.gguf
Normal file
3
Qwen1.5-7B-Dutch-Chat-Q2_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:eefc713886ca84f2f77382b28d443431dfe44c91bffb8be31f01173716bc66b2
|
||||
size 3102454496
|
||||
3
Qwen1.5-7B-Dutch-Chat-Q3_K_M.gguf
Normal file
3
Qwen1.5-7B-Dutch-Chat-Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:89148315552e40bad8cad7998c085dc6a3e37825f8e0c3d96e6c8d0b23b0b376
|
||||
size 3917368224
|
||||
3
Qwen1.5-7B-Dutch-Chat-Q4_0.gguf
Normal file
3
Qwen1.5-7B-Dutch-Chat-Q4_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:a8257697196a72e3755dc95fc5bd0795a290a6d1bb47e6cb657859fe7df40e52
|
||||
size 4510258016
|
||||
3
Qwen1.5-7B-Dutch-Chat-Q4_K_M.gguf
Normal file
3
Qwen1.5-7B-Dutch-Chat-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:c94cd86a0ed8c3166d563f9090fbba0aacf238b9245cb82c0f1927417287606d
|
||||
size 4765455200
|
||||
3
Qwen1.5-7B-Dutch-Chat-Q5_0.gguf
Normal file
3
Qwen1.5-7B-Dutch-Chat-Q5_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:cf351c9753a8621ed38c278e640b4021b963e888b30f2359121e4a5470dc0811
|
||||
size 5397401440
|
||||
3
Qwen1.5-7B-Dutch-Chat-Q5_K_M.gguf
Normal file
3
Qwen1.5-7B-Dutch-Chat-Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:fe5d36d817420c2c50c72ef3ab3c4fec3b283e1f9bd940564b14c85c3f2cd968
|
||||
size 5528866656
|
||||
3
Qwen1.5-7B-Dutch-Chat-Q6_K.gguf
Normal file
3
Qwen1.5-7B-Dutch-Chat-Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:54d632f6389cff15491f9f833d943b8085ede7ed4da3c7bff5e200b8f2ab414c
|
||||
size 6339991328
|
||||
3
Qwen1.5-7B-Dutch-Chat-Q8_0.gguf
Normal file
3
Qwen1.5-7B-Dutch-Chat-Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:5b67fc9af32151e860bad459e369ed19132565af51b6a66484a9a1387f365a63
|
||||
size 8209264544
|
||||
56
README.md
Normal file
56
README.md
Normal file
@@ -0,0 +1,56 @@
|
||||
---
|
||||
license: cc-by-nc-4.0
|
||||
language:
|
||||
- nl
|
||||
pipeline_tag: text-generation
|
||||
tags:
|
||||
- qwen2
|
||||
- chat
|
||||
---
|
||||
|
||||
# Qwen1.5-7B-Dutch-Chat-GGUF
|
||||
|
||||
|
||||
## Introduction
|
||||
|
||||
This is a collection of GGUF files created from [robinsmits/Qwen1.5-7B-Dutch-Chat](https://huggingface.co/robinsmits/Qwen1.5-7B-Dutch-Chat)
|
||||
|
||||
It contains the files in the following quantization formats:
|
||||
|
||||
`Q2_K`, `Q3_K_M`, `Q4_0`, `Q4_K_M`, `Q5_0`, `Q5_K_M`, `Q6_K`, `Q8_0`
|
||||
|
||||
## Requirements
|
||||
Before you can use the GGUF files you need to clone [llama.cpp repository](https://github.com/ggerganov/llama.cpp) and install it following the official guide.
|
||||
|
||||
## How to use
|
||||
Download the GGUF file you would like to try and test it with the following command:
|
||||
```shell
|
||||
./main -m Qwen1.5-7B-Dutch-Chat-Q5_K_M.gguf -n 512 --temp 0.1 --top-k 50 --color -f dutch-chat.txt
|
||||
```
|
||||
|
||||
This gives the following output:
|
||||
```
|
||||
system
|
||||
Je bent een behulpzame AI assistent
|
||||
user
|
||||
Wat is een fiets?
|
||||
assistant
|
||||
Een fiets is een vervoermiddel met twee wielen en een zadel. Mensen gebruiken het om op te staan en te bewegen door het te draaien met de benen. Fietsen is goed voor je lichaam en goed voor het milieu omdat je geen benzine hoeft te gebruiken. Er zijn verschillende soorten fietsen, zoals een mountainbike, een BMX-fietser, een tandemfiets en een tandemfiets met kinderwiel. Fietsen is ook leuk omdat je op verschillende plekken kunt rijden, zoals in het park, op het strand of op het platteland. [end of text]
|
||||
```
|
||||
|
||||
## Recommendation
|
||||
|
||||
Experimenting with the llama.cpp parameters can have a big impact on the quality of the generated text. It is therefore recommended to do your own experimentation with different settings. In my own experiments it looks like quantization 'Q5_0' or better gives good quality. The smaller files are included anyway.
|
||||
|
||||
## Citation
|
||||
|
||||
Thanks to the creators of Qwen1.5 for there great work!
|
||||
|
||||
```
|
||||
@article{qwen,
|
||||
title={Qwen Technical Report},
|
||||
author={Jinze Bai and Shuai Bai and Yunfei Chu and Zeyu Cui and Kai Dang and Xiaodong Deng and Yang Fan and Wenbin Ge and Yu Han and Fei Huang and Binyuan Hui and Luo Ji and Mei Li and Junyang Lin and Runji Lin and Dayiheng Liu and Gao Liu and Chengqiang Lu and Keming Lu and Jianxin Ma and Rui Men and Xingzhang Ren and Xuancheng Ren and Chuanqi Tan and Sinan Tan and Jianhong Tu and Peng Wang and Shijie Wang and Wei Wang and Shengguang Wu and Benfeng Xu and Jin Xu and An Yang and Hao Yang and Jian Yang and Shusheng Yang and Yang Yao and Bowen Yu and Hongyi Yuan and Zheng Yuan and Jianwei Zhang and Xingxuan Zhang and Yichang Zhang and Zhenru Zhang and Chang Zhou and Jingren Zhou and Xiaohuan Zhou and Tianhang Zhu},
|
||||
journal={arXiv preprint arXiv:2309.16609},
|
||||
year={2023}
|
||||
}
|
||||
```
|
||||
5
dutch-chat.txt
Normal file
5
dutch-chat.txt
Normal file
@@ -0,0 +1,5 @@
|
||||
<|im_start|>system
|
||||
Je bent een behulpzame AI assistent<|im_end|>
|
||||
<|im_start|>user
|
||||
Wat is een fiets?<|im_end|>
|
||||
<|im_start|>assistant
|
||||
Reference in New Issue
Block a user