初始化项目,由ModelHub XC社区提供模型
Model: dnotitia/Smoothie-Qwen3-0.6B Source: Original Platform
This commit is contained in:
49
README.md
Normal file
49
README.md
Normal file
@@ -0,0 +1,49 @@
|
||||
---
|
||||
language:
|
||||
- en
|
||||
license: apache-2.0
|
||||
tags:
|
||||
- dnotitia
|
||||
- nlp
|
||||
- llm
|
||||
- conversation
|
||||
- chat
|
||||
- reasoning
|
||||
base_model:
|
||||
- Qwen/Qwen3-0.6B
|
||||
library_name: transformers
|
||||
pipeline_tag: text-generation
|
||||
---
|
||||
|
||||
# Smoothie Qwen
|
||||
|
||||
<img src="https://github.com/dnotitia/smoothie-qwen/raw/main/asset/smoothie-qwen-logo.png" width="400" style="max-width: 100%;">
|
||||
|
||||
**Smoothie Qwen** is a lightweight adjustment tool that smooths token probabilities in Qwen and similar models, enhancing balanced multilingual generation capabilities. For more details, please refer to <https://github.com/dnotitia/smoothie-qwen>.
|
||||
|
||||
|
||||
## Configuration
|
||||
- Base model: Qwen/Qwen3-0.6B
|
||||
- Minimum scale factor: 0.5
|
||||
- Smoothness: 10.0
|
||||
- Sample size: 1000
|
||||
- Window size: 4
|
||||
- N-gram weights: [0.5, 0.3, 0.2]
|
||||
|
||||
## Unicode Ranges
|
||||
- Range 1: 0x4e00 - 0x9fff
|
||||
- Range 2: 0x3400 - 0x4dbf
|
||||
- Range 3: 0x20000 - 0x2a6df
|
||||
- Range 4: 0xf900 - 0xfaff
|
||||
- Range 5: 0x2e80 - 0x2eff
|
||||
- Range 6: 0x2f00 - 0x2fdf
|
||||
- Range 7: 0x2ff0 - 0x2fff
|
||||
- Range 8: 0x3000 - 0x303f
|
||||
- Range 9: 0x31c0 - 0x31ef
|
||||
- Range 10: 0x3200 - 0x32ff
|
||||
- Range 11: 0x3300 - 0x33ff
|
||||
|
||||
## Statistics
|
||||
- Target tokens: 26,153
|
||||
- Broken tokens: 1,457
|
||||
- Modified tokens: 27,564
|
||||
Reference in New Issue
Block a user