初始化项目，由ModelHub XC社区提供模型
Model: okwinds/Rombos-LLM-V2.6-Qwen-14b Source: Original Platform
This commit is contained in:
ModelHub XC
38
.gitattributes
vendored
Normal file
38
.gitattributes
vendored
Normal file
@@ -0,0 +1,38 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zstandard filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.db* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ark* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
**/*ckpt*data* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
**/*ckpt*.meta filter=lfs diff=lfs merge=lfs -text
|
||||||
|
**/*ckpt*.index filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gguf* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ggml filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.llamafile* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt2 filter=lfs diff=lfs merge=lfs -text
|
||||||
BIN
HF-Leadboard-10-20B-2024-10-29.png
Normal file
BIN
HF-Leadboard-10-20B-2024-10-29.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 524 KiB |
BIN
HF-Leadboard-10-32B-2024-10-29.png
Normal file
BIN
HF-Leadboard-10-32B-2024-10-29.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 519 KiB |
BIN
HF-Leadboard-Total-2024-10-29.png
Normal file
BIN
HF-Leadboard-Total-2024-10-29.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 345 KiB |
82
README.md
Normal file
82
README.md
Normal file
@@ -0,0 +1,82 @@
|
|||||||
|
---
|
||||||
|
frameworks:
|
||||||
|
- Pytorch
|
||||||
|
license: Apache License 2.0
|
||||||
|
base_model:
|
||||||
|
- Qwen/Qwen2.5-14B-Instruct
|
||||||
|
tasks:
|
||||||
|
- text-generation
|
||||||
|
language:
|
||||||
|
- en
|
||||||
|
- cn
|
||||||
|
tags:
|
||||||
|
- Chat
|
||||||
|
- Instruct
|
||||||
|
- fine-tuned
|
||||||
|
---
|
||||||
|
|
||||||
|
# Rombos-LLM-V2.6-Qwen-14b High-performance finetuned
|
||||||
|
|
||||||
|
- ***同系合集 [Rombos-LLM-Qwen2.5](https://www.modelscope.cn/collections/Rombos-LLM-Qwen25-4dc8690ad7f541)***
|
||||||
|
|
||||||
|
## Download
|
||||||
|
|
||||||
|
SDK下载
|
||||||
|
```bash
|
||||||
|
#安装ModelScope
|
||||||
|
pip install modelscope
|
||||||
|
```
|
||||||
|
```python
|
||||||
|
#SDK模型下载
|
||||||
|
from modelscope import snapshot_download
|
||||||
|
model_dir = snapshot_download('okwinds/Rombos-LLM-V2.6-Qwen-14b')
|
||||||
|
```
|
||||||
|
Git下载
|
||||||
|
```
|
||||||
|
#Git模型下载
|
||||||
|
git clone https://www.modelscope.cn/okwinds/Rombos-LLM-V2.6-Qwen-14b.git
|
||||||
|
```
|
||||||
|
|
||||||
|
# 模型简介
|
||||||
|
|
||||||
|
本模型转载于 huggingface 上的 [rombodawg/Rombos-LLM-V2.6-Qwen-14b](https://huggingface.co/rombodawg/Rombos-LLM-V2.6-Qwen-14b)
|
||||||
|
|
||||||
|
作者介绍到：本模型是一个基于 [Qwen/Qwen2.5-14B](https://www.modelscope.cn/models/Qwen/Qwen2.5-14B) 的 Continuous Fine-tuning 版本，并通过 [TIES-Merging](https://ar5iv.labs.arxiv.org/html/2306.01708) 方法将合并了adapter的 [Qwen/Qwen2.5-14B-Instruct](https://www.modelscope.cn/models/qwen/qwen2.5-14b-instruct) 与 [Qwen/Qwen2.5-14B](https://www.modelscope.cn/models/Qwen/Qwen2.5-14B) 进行了 TIES Merge。这使得本模型的性能优于原始的 base 模型以及 pretrain 后 fine-tune 的 Instruct 模型。
|
||||||
|
|
||||||
|
Model tree for [okwinds/Rombos-LLM-V2.6-Qwen-14b](https://www.modelscope.cn/models/okwinds/Rombos-LLM-V2.6-Qwen-14b) </br>
|
||||||
|
Base model - [Qwen/Qwen2.5-14B](https://www.modelscope.cn/models/Qwen/Qwen2.5-14B) </br>
|
||||||
|
<span style="font-weight: bold;">╰</span>─ Finetuned - [Qwen/Qwen2.5-14B-Instruct](https://www.modelscope.cn/models/Qwen/Qwen2.5-14B-Instruct) </br>
|
||||||
|
<span style="font-weight: bold;">╰</span>─ Finetuned - [本模型 okwinds/Rombos-LLM-V2.6-Qwen-14b](https://www.modelscope.cn/models/okwinds/Rombos-LLM-V2.6-Qwen-14b) </br>
|
||||||
|
|
||||||
|
# Benchmark
|
||||||
|
|
||||||
|
以下摘自 2024-10-29 的 Huggingface 上 [Leadboard](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard) 排名数据
|
||||||
|
|
||||||
|
本模型以 14B 参数量在总榜排名第49。截图：
|
||||||
|
|
||||||
|
<img src="https://www.modelscope.cn/models/okwinds/Rombos-LLM-V2.6-Qwen-14b/resolve/master/HF-Leadboard-Total-2024-10-29.png" />
|
||||||
|
|
||||||
|
在 10-32B 参数量模型中排名第7。截图：
|
||||||
|
|
||||||
|
<img src="https://www.modelscope.cn/models/okwinds/Rombos-LLM-V2.6-Qwen-14b/resolve/master/HF-Leadboard-10-32B-2024-10-29.png" />
|
||||||
|
|
||||||
|
在 10-20B 参数量模型中排名第1。
|
||||||
|
|
||||||
|
<img src="https://www.modelscope.cn/models/okwinds/Rombos-LLM-V2.6-Qwen-14b/resolve/master/HF-Leadboard-10-20B-2024-10-29.png" />
|
||||||
|
|
||||||
|
截图中的数据：
|
||||||
|
|
||||||
|
| **Model** |**Average️**|**IFEval**|**BBH**|**MATH Lvl 5**|**GPQA**|**MUSR**|**MMLU-PRO**|
|
||||||
|
|-|-|-|-|-|-|-|-|
|
||||||
|
|<span style="color:#ff6600">rombodawg/Rombos-LLM-V2.6-Qwen-14b</span>|35.89|52.14|49.22|28.85|17|19.26|48.85|
|
||||||
|
|rombodawg/Rombos-LLM-V2.5-Qwen-14b|34.52|58.4|49.39|15.63|16.22|18.83|48.62|
|
||||||
|
|Tsunami-th/Tsunami-1.0-14B-Instruct |34.2|78.29|49.15|0|14.21|16.34|47.21|
|
||||||
|
|tanliboy/lambda-qwen2.5-14b-dpo-test |33.52|82.31|48.45|0|14.99|12.59|42.75|
|
||||||
|
|jpacifico/Chocolatine-14B-Instruct-DPO-v1.2 |33.3|68.52|49.85|17.98|10.07|12.35|41.07|
|
||||||
|
|TheTsar1209/qwen-carpmuscle-v0.2 |33.11|52.57|48.18|25|14.09|12.75|46.08|
|
||||||
|
|microsoft/Phi-3-medium-4k-instruct |32.67|64.23|49.38|16.99|11.52|13.05|40.84|
|
||||||
|
|TheTsar1209/qwen-carpmuscle-v0.1 |32.59|56.22|48.83|21.15|12.53|10.15|46.67|
|
||||||
|
|v000000/Qwen2.5-Lumen-14B |32.2|80.64|48.51|0|10.4|10.29|43.36|
|
||||||
|
|Qwen/Qwen2.5-14B-Instruct |32.18|81.58|48.36|0|9.62|10.16|43.38|
|
||||||
|
|v000000/Qwen2.5-14B-Gutenberg-1e-Delta |32.11|80.45|48.62|0|10.51|9.38|43.67|
|
||||||
|
|internlm/internlm2_5-20b-chat |32.08|70.1|62.83|0|9.51|16.74|33.31|
|
||||||
28
config.json
Normal file
28
config.json
Normal file
@@ -0,0 +1,28 @@
|
|||||||
|
{
|
||||||
|
"_name_or_path": "Rombos-LLM-V2.6-Qwen-14b",
|
||||||
|
"architectures": [
|
||||||
|
"Qwen2ForCausalLM"
|
||||||
|
],
|
||||||
|
"attention_dropout": 0.0,
|
||||||
|
"bos_token_id": 151643,
|
||||||
|
"eos_token_id": 151643,
|
||||||
|
"hidden_act": "silu",
|
||||||
|
"hidden_size": 5120,
|
||||||
|
"initializer_range": 0.02,
|
||||||
|
"intermediate_size": 13824,
|
||||||
|
"max_position_embeddings": 131072,
|
||||||
|
"max_window_layers": 48,
|
||||||
|
"model_type": "qwen2",
|
||||||
|
"num_attention_heads": 40,
|
||||||
|
"num_hidden_layers": 48,
|
||||||
|
"num_key_value_heads": 8,
|
||||||
|
"rms_norm_eps": 1e-05,
|
||||||
|
"rope_theta": 1000000.0,
|
||||||
|
"sliding_window": null,
|
||||||
|
"tie_word_embeddings": false,
|
||||||
|
"torch_dtype": "bfloat16",
|
||||||
|
"transformers_version": "4.43.3",
|
||||||
|
"use_cache": true,
|
||||||
|
"use_sliding_window": false,
|
||||||
|
"vocab_size": 152064
|
||||||
|
}
|
||||||
1
configuration.json
Normal file
1
configuration.json
Normal file
@@ -0,0 +1 @@
|
|||||||
|
{"framework":"Pytorch","task":"text-generation"}
|
||||||
14
generation_config.json
Normal file
14
generation_config.json
Normal file
@@ -0,0 +1,14 @@
|
|||||||
|
{
|
||||||
|
"bos_token_id": 151643,
|
||||||
|
"pad_token_id": 151643,
|
||||||
|
"do_sample": true,
|
||||||
|
"eos_token_id": [
|
||||||
|
151645,
|
||||||
|
151643
|
||||||
|
],
|
||||||
|
"repetition_penalty": 1.05,
|
||||||
|
"temperature": 0.7,
|
||||||
|
"top_p": 0.8,
|
||||||
|
"top_k": 20,
|
||||||
|
"transformers_version": "4.37.0"
|
||||||
|
}
|
||||||
6
hash.txt
Normal file
6
hash.txt
Normal file
@@ -0,0 +1,6 @@
|
|||||||
|
7920d3ea565bf0ad4fa3bfc075c282c96c1eb967435dd86ab83f50e151482416 model-00001-of-00006.safetensors
|
||||||
|
7b1360e8ccd406fb3c90bbc4005a82143ec80e41fdc5b5e3b81712740a1fc249 model-00002-of-00006.safetensors
|
||||||
|
0c509c228ccc99b150e2928b8b02b8425fb88009c80561644877fc794ea05035 model-00003-of-00006.safetensors
|
||||||
|
003c726678c365d283547f5db456c13180a2b4967d8a7f0187ba49b2905228ad model-00004-of-00006.safetensors
|
||||||
|
ea93ed288754cf422f0999978d9f9c0ac45ac4f6290664268c419bb89ac06ce6 model-00005-of-00006.safetensors
|
||||||
|
9f4f092dae3e4e1703532b1425bb0b7e9f9133ff37ee72c5a1722387fdf75b6d model-00006-of-00006.safetensors
|
||||||
3
model-00001-of-00006.safetensors
Normal file
3
model-00001-of-00006.safetensors
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:7920d3ea565bf0ad4fa3bfc075c282c96c1eb967435dd86ab83f50e151482416
|
||||||
|
size 4907454960
|
||||||
3
model-00002-of-00006.safetensors
Normal file
3
model-00002-of-00006.safetensors
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:7b1360e8ccd406fb3c90bbc4005a82143ec80e41fdc5b5e3b81712740a1fc249
|
||||||
|
size 4954847384
|
||||||
3
model-00003-of-00006.safetensors
Normal file
3
model-00003-of-00006.safetensors
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:0c509c228ccc99b150e2928b8b02b8425fb88009c80561644877fc794ea05035
|
||||||
|
size 4954847376
|
||||||
3
model-00004-of-00006.safetensors
Normal file
3
model-00004-of-00006.safetensors
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:003c726678c365d283547f5db456c13180a2b4967d8a7f0187ba49b2905228ad
|
||||||
|
size 4954847376
|
||||||
3
model-00005-of-00006.safetensors
Normal file
3
model-00005-of-00006.safetensors
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:ea93ed288754cf422f0999978d9f9c0ac45ac4f6290664268c419bb89ac06ce6
|
||||||
|
size 4954847376
|
||||||
3
model-00006-of-00006.safetensors
Normal file
3
model-00006-of-00006.safetensors
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:9f4f092dae3e4e1703532b1425bb0b7e9f9133ff37ee72c5a1722387fdf75b6d
|
||||||
|
size 4813289432
|
||||||
1
model.safetensors.index.json
Normal file
1
model.safetensors.index.json
Normal file
File diff suppressed because one or more lines are too long
303282
tokenizer.json
Normal file
303282
tokenizer.json
Normal file
File diff suppressed because it is too large
Load Diff
207
tokenizer_config.json
Normal file
207
tokenizer_config.json
Normal file
@@ -0,0 +1,207 @@
|
|||||||
|
{
|
||||||
|
"add_bos_token": false,
|
||||||
|
"add_prefix_space": false,
|
||||||
|
"added_tokens_decoder": {
|
||||||
|
"151643": {
|
||||||
|
"content": "<|endoftext|>",
|
||||||
|
"lstrip": false,
|
||||||
|
"normalized": false,
|
||||||
|
"rstrip": false,
|
||||||
|
"single_word": false,
|
||||||
|
"special": true
|
||||||
|
},
|
||||||
|
"151644": {
|
||||||
|
"content": "<|im_start|>",
|
||||||
|
"lstrip": false,
|
||||||
|
"normalized": false,
|
||||||
|
"rstrip": false,
|
||||||
|
"single_word": false,
|
||||||
|
"special": true
|
||||||
|
},
|
||||||
|
"151645": {
|
||||||
|
"content": "<|im_end|>",
|
||||||
|
"lstrip": false,
|
||||||
|
"normalized": false,
|
||||||
|
"rstrip": false,
|
||||||
|
"single_word": false,
|
||||||
|
"special": true
|
||||||
|
},
|
||||||
|
"151646": {
|
||||||
|
"content": "<|object_ref_start|>",
|
||||||
|
"lstrip": false,
|
||||||
|
"normalized": false,
|
||||||
|
"rstrip": false,
|
||||||
|
"single_word": false,
|
||||||
|
"special": true
|
||||||
|
},
|
||||||
|
"151647": {
|
||||||
|
"content": "<|object_ref_end|>",
|
||||||
|
"lstrip": false,
|
||||||
|
"normalized": false,
|
||||||
|
"rstrip": false,
|
||||||
|
"single_word": false,
|
||||||
|
"special": true
|
||||||
|
},
|
||||||
|
"151648": {
|
||||||
|
"content": "<|box_start|>",
|
||||||
|
"lstrip": false,
|
||||||
|
"normalized": false,
|
||||||
|
"rstrip": false,
|
||||||
|
"single_word": false,
|
||||||
|
"special": true
|
||||||
|
},
|
||||||
|
"151649": {
|
||||||
|
"content": "<|box_end|>",
|
||||||
|
"lstrip": false,
|
||||||
|
"normalized": false,
|
||||||
|
"rstrip": false,
|
||||||
|
"single_word": false,
|
||||||
|
"special": true
|
||||||
|
},
|
||||||
|
"151650": {
|
||||||
|
"content": "<|quad_start|>",
|
||||||
|
"lstrip": false,
|
||||||
|
"normalized": false,
|
||||||
|
"rstrip": false,
|
||||||
|
"single_word": false,
|
||||||
|
"special": true
|
||||||
|
},
|
||||||
|
"151651": {
|
||||||
|
"content": "<|quad_end|>",
|
||||||
|
"lstrip": false,
|
||||||
|
"normalized": false,
|
||||||
|
"rstrip": false,
|
||||||
|
"single_word": false,
|
||||||
|
"special": true
|
||||||
|
},
|
||||||
|
"151652": {
|
||||||
|
"content": "<|vision_start|>",
|
||||||
|
"lstrip": false,
|
||||||
|
"normalized": false,
|
||||||
|
"rstrip": false,
|
||||||
|
"single_word": false,
|
||||||
|
"special": true
|
||||||
|
},
|
||||||
|
"151653": {
|
||||||
|
"content": "<|vision_end|>",
|
||||||
|
"lstrip": false,
|
||||||
|
"normalized": false,
|
||||||
|
"rstrip": false,
|
||||||
|
"single_word": false,
|
||||||
|
"special": true
|
||||||
|
},
|
||||||
|
"151654": {
|
||||||
|
"content": "<|vision_pad|>",
|
||||||
|
"lstrip": false,
|
||||||
|
"normalized": false,
|
||||||
|
"rstrip": false,
|
||||||
|
"single_word": false,
|
||||||
|
"special": true
|
||||||
|
},
|
||||||
|
"151655": {
|
||||||
|
"content": "<|image_pad|>",
|
||||||
|
"lstrip": false,
|
||||||
|
"normalized": false,
|
||||||
|
"rstrip": false,
|
||||||
|
"single_word": false,
|
||||||
|
"special": true
|
||||||
|
},
|
||||||
|
"151656": {
|
||||||
|
"content": "<|video_pad|>",
|
||||||
|
"lstrip": false,
|
||||||
|
"normalized": false,
|
||||||
|
"rstrip": false,
|
||||||
|
"single_word": false,
|
||||||
|
"special": true
|
||||||
|
},
|
||||||
|
"151657": {
|
||||||
|
"content": "<tool_call>",
|
||||||
|
"lstrip": false,
|
||||||
|
"normalized": false,
|
||||||
|
"rstrip": false,
|
||||||
|
"single_word": false,
|
||||||
|
"special": false
|
||||||
|
},
|
||||||
|
"151658": {
|
||||||
|
"content": "</tool_call>",
|
||||||
|
"lstrip": false,
|
||||||
|
"normalized": false,
|
||||||
|
"rstrip": false,
|
||||||
|
"single_word": false,
|
||||||
|
"special": false
|
||||||
|
},
|
||||||
|
"151659": {
|
||||||
|
"content": "<|fim_prefix|>",
|
||||||
|
"lstrip": false,
|
||||||
|
"normalized": false,
|
||||||
|
"rstrip": false,
|
||||||
|
"single_word": false,
|
||||||
|
"special": false
|
||||||
|
},
|
||||||
|
"151660": {
|
||||||
|
"content": "<|fim_middle|>",
|
||||||
|
"lstrip": false,
|
||||||
|
"normalized": false,
|
||||||
|
"rstrip": false,
|
||||||
|
"single_word": false,
|
||||||
|
"special": false
|
||||||
|
},
|
||||||
|
"151661": {
|
||||||
|
"content": "<|fim_suffix|>",
|
||||||
|
"lstrip": false,
|
||||||
|
"normalized": false,
|
||||||
|
"rstrip": false,
|
||||||
|
"single_word": false,
|
||||||
|
"special": false
|
||||||
|
},
|
||||||
|
"151662": {
|
||||||
|
"content": "<|fim_pad|>",
|
||||||
|
"lstrip": false,
|
||||||
|
"normalized": false,
|
||||||
|
"rstrip": false,
|
||||||
|
"single_word": false,
|
||||||
|
"special": false
|
||||||
|
},
|
||||||
|
"151663": {
|
||||||
|
"content": "<|repo_name|>",
|
||||||
|
"lstrip": false,
|
||||||
|
"normalized": false,
|
||||||
|
"rstrip": false,
|
||||||
|
"single_word": false,
|
||||||
|
"special": false
|
||||||
|
},
|
||||||
|
"151664": {
|
||||||
|
"content": "<|file_sep|>",
|
||||||
|
"lstrip": false,
|
||||||
|
"normalized": false,
|
||||||
|
"rstrip": false,
|
||||||
|
"single_word": false,
|
||||||
|
"special": false
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"additional_special_tokens": [
|
||||||
|
"<|im_start|>",
|
||||||
|
"<|im_end|>",
|
||||||
|
"<|object_ref_start|>",
|
||||||
|
"<|object_ref_end|>",
|
||||||
|
"<|box_start|>",
|
||||||
|
"<|box_end|>",
|
||||||
|
"<|quad_start|>",
|
||||||
|
"<|quad_end|>",
|
||||||
|
"<|vision_start|>",
|
||||||
|
"<|vision_end|>",
|
||||||
|
"<|vision_pad|>",
|
||||||
|
"<|image_pad|>",
|
||||||
|
"<|video_pad|>"
|
||||||
|
],
|
||||||
|
"bos_token": null,
|
||||||
|
"chat_template": "{%- if tools %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0]['role'] == 'system' %}\n {{- messages[0]['content'] }}\n {%- else %}\n {{- 'You are Qwen, created by Alibaba Cloud. You are a helpful assistant.' }}\n {%- endif %}\n {{- \"\\n\\n# Tools\\n\\nYou may call one or more functions to assist with the user query.\\n\\nYou are provided with function signatures within <tools></tools> XML tags:\\n<tools>\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n</tools>\\n\\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\\n<tool_call>\\n{\\\"name\\\": <function-name>, \\\"arguments\\\": <args-json-object>}\\n</tool_call><|im_end|>\\n\" }}\n{%- else %}\n {%- if messages[0]['role'] == 'system' %}\n {{- '<|im_start|>system\\n' + messages[0]['content'] + '<|im_end|>\\n' }}\n {%- else %}\n {{- '<|im_start|>system\\nYou are Qwen, created by Alibaba Cloud. You are a helpful assistant.<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- for message in messages %}\n {%- if (message.role == \"user\") or (message.role == \"system\" and not loop.first) or (message.role == \"assistant\" and not message.tool_calls) %}\n {{- '<|im_start|>' + message.role + '\\n' + message.content + '<|im_end|>' + '\\n' }}\n {%- elif message.role == \"assistant\" %}\n {{- '<|im_start|>' + message.role }}\n {%- if message.content %}\n {{- '\\n' + message.content }}\n {%- endif %}\n {%- for tool_call in message.tool_calls %}\n {%- if tool_call.function is defined %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {{- '\\n<tool_call>\\n{\"name\": \"' }}\n {{- tool_call.name }}\n {{- '\", \"arguments\": ' }}\n {{- tool_call.arguments | tojson }}\n {{- '}\\n</tool_call>' }}\n {%- endfor %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if (loop.index0 == 0) or (messages[loop.index0 - 1].role != \"tool\") %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n<tool_response>\\n' }}\n {{- message.content }}\n {{- '\\n</tool_response>' }}\n {%- if loop.last or (messages[loop.index0 + 1].role != \"tool\") %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n{%- endif %}\n",
|
||||||
|
"clean_up_tokenization_spaces": false,
|
||||||
|
"eos_token": "<|im_end|>",
|
||||||
|
"errors": "replace",
|
||||||
|
"model_max_length": 131072,
|
||||||
|
"pad_token": "<|endoftext|>",
|
||||||
|
"split_special_tokens": false,
|
||||||
|
"tokenizer_class": "Qwen2Tokenizer",
|
||||||
|
"unk_token": null
|
||||||
|
}
|
||||||
1
vocab.json
Normal file
1
vocab.json
Normal file
File diff suppressed because one or more lines are too long
Reference in New Issue
Block a user