初始化项目，由ModelHub XC社区提供模型
Model: Mungert/HY-MT1.5-1.8B-GGUF Source: Original Platform
This commit is contained in:
ModelHub XC
323
README.md
Normal file
323
README.md
Normal file
@@ -0,0 +1,323 @@
|
||||
---
|
||||
library_name: transformers
|
||||
tags:
|
||||
- translation
|
||||
language:
|
||||
- zh
|
||||
- en
|
||||
- fr
|
||||
- pt
|
||||
- es
|
||||
- ja
|
||||
- tr
|
||||
- ru
|
||||
- ar
|
||||
- ko
|
||||
- th
|
||||
- it
|
||||
- de
|
||||
- vi
|
||||
- ms
|
||||
- id
|
||||
- tl
|
||||
- hi
|
||||
- pl
|
||||
- cs
|
||||
- nl
|
||||
- km
|
||||
- my
|
||||
- fa
|
||||
- gu
|
||||
- ur
|
||||
- te
|
||||
- mr
|
||||
- he
|
||||
- bn
|
||||
- ta
|
||||
- uk
|
||||
- bo
|
||||
- kk
|
||||
- mn
|
||||
- ug
|
||||
---
|
||||
|
||||
# <span style="color: #7FFF7F;">HY-MT1.5-1.8B GGUF Models</span>
|
||||
|
||||
|
||||
## <span style="color: #7F7FFF;">Model Generation Details</span>
|
||||
|
||||
This model was generated using [llama.cpp](https://github.com/ggerganov/llama.cpp) at commit [`9a6369bb6`](https://github.com/ggerganov/llama.cpp/commit/9a6369bb603457f277b597f0ccee1c19cd25c4b2).
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
---
|
||||
|
||||
<a href="https://readyforquantum.com/huggingface_gguf_selection_guide.html" style="color: #7FFF7F;">
|
||||
Click here to get info on choosing the right GGUF model format
|
||||
</a>
|
||||
|
||||
---
|
||||
|
||||
|
||||
|
||||
<!--Begin Original Model Card-->
|
||||
|
||||
|
||||
|
||||
<p align="center">
|
||||
<img src="https://github.com/Tencent-Hunyuan/HY-MT/raw/main/imgs/hunyuanlogo.png" width="400"/> <br>
|
||||
</p><p></p>
|
||||
|
||||
|
||||
<p align="center">
|
||||
🤗 <a href="https://huggingface.co/collections/tencent/hy-mt15"><b>Hugging Face</b></a> |
|
||||
🕹️ <a href="https://hunyuan.tencent.com/chat/HunyuanDefault?from=modelSquare&modelId=hunyuan-mt-1.8b"><b>Demo</b></a>
|
||||
🤖 <a href="https://modelscope.cn/collections/Tencent-Hunyuan/HY-MT15"><b>ModelScope</b></a> |
|
||||
</p>
|
||||
|
||||
<p align="center">
|
||||
🖥️ <a href="https://hunyuan.tencent.com"><b>Official Website</b></a> |
|
||||
<a href="https://github.com/Tencent-Hunyuan/HY-MT"><b>Github</b></a>
|
||||
</p>
|
||||
|
||||
|
||||
## Model Introduction
|
||||
|
||||
Hunyuan Translation Model Version 1.5 includes a 1.8B translation model, HY-MT1.5-1.8B, and a 7B translation model, HY-MT1.5-7B. Both models focus on supporting mutual translation across 33 languages and incorporating 5 ethnic and dialect variations. Among them, HY-MT1.5-7B is an upgraded version of our WMT25 championship model, optimized for explanatory translation and mixed-language scenarios, with newly added support for terminology intervention, contextual translation, and formatted translation. Despite having less than one-third the parameters of HY-MT1.5-7B, HY-MT1.5-1.8B delivers translation performance comparable to its larger counterpart, achieving both high speed and high quality. After quantization, the 1.8B model can be deployed on edge devices and support real-time translation scenarios, making it widely applicable.
|
||||
|
||||
## Key Features and Advantages
|
||||
|
||||
- HY-MT1.5-1.8B achieves the industry-leading performance among models of the same size, surpassing most commercial translation APIs.
|
||||
- HY-MT1.5-1.8B supports deployment on edge devices and real-time translation scenarios, offering broad applicability.
|
||||
- HY-MT1.5-7B, compared to its September open-source version, has been optimized for annotated and mixed-language scenarios.
|
||||
- Both models support terminology intervention, contextual translation, and formatted translation.
|
||||
|
||||
## Related News
|
||||
* 2025.12.30, we have open-sourced **HY-MT1.5-1.8B** and **HY-MT1.5-7B** on Hugging Face.
|
||||
* 2025.9.1, we have open-sourced **Hunyuan-MT-7B** , **Hunyuan-MT-Chimera-7B** on Hugging Face.
|
||||
<br>
|
||||
|
||||
|
||||
## Performance
|
||||
|
||||
<div align='center'>
|
||||
<img src="https://github.com/Tencent-Hunyuan/HY-MT/raw/main/imgs/overall_performance.png" width = "100%" />
|
||||
</div>
|
||||
You can refer to our technical report for more experimental results and analysis.
|
||||
|
||||
<a href="https://github.com/Tencent-Hunyuan/HY-MT/raw/main/HY_MT1_5_Technical_Report.pdf"><b>Technical Report</b> </a>
|
||||
|
||||
|
||||
|
||||
## Model Links
|
||||
| Model Name | Description | Download |
|
||||
| ----------- | ----------- |-----------
|
||||
| HY-MT1.5-1.8B | Hunyuan 1.8B translation model |🤗 [Model](https://huggingface.co/tencent/HY-MT1.5-1.8B)|
|
||||
| HY-MT1.5-1.8B-FP8 | Hunyuan 1.8B translation model, fp8 quant | 🤗 [Model](https://huggingface.co/tencent/HY-MT1.5-1.8B-FP8)|
|
||||
| HY-MT1.5-1.8B-GPTQ-Int4 | Hunyuan 1.8B translation model, int4 quant | 🤗 [Model](https://huggingface.co/tencent/HY-MT1.5-1.8B-GPTQ-Int4)|
|
||||
| HY-MT1.5-7B | Hunyuan 7B translation model | 🤗 [Model](https://huggingface.co/tencent/HY-MT1.5-7B)|
|
||||
| HY-MT1.5-7B-FP8 | Hunyuan 7B translation model, fp8 quant | 🤗 [Model](https://huggingface.co/tencent/HY-MT1.5-7B-FP8)|
|
||||
| HY-MT1.5-7B-GPTQ-Int4 | Hunyuan 7B translation model, int4 quant | 🤗 [Model](https://huggingface.co/tencent/HY-MT1.5-7B-GPTQ-Int4)|
|
||||
|
||||
## Prompts
|
||||
|
||||
### Prompt Template for ZH<=>XX Translation.
|
||||
---
|
||||
```
|
||||
将以下文本翻译为{target_language}，注意只需要输出翻译后的结果，不要额外解释：
|
||||
|
||||
{source_text}
|
||||
```
|
||||
---
|
||||
|
||||
### Prompt Template for XX<=>XX Translation, excluding ZH<=>XX.
|
||||
---
|
||||
```
|
||||
Translate the following segment into {target_language}, without additional explanation.
|
||||
|
||||
{source_text}
|
||||
```
|
||||
---
|
||||
|
||||
### Prompt Template for terminology intervention.
|
||||
---
|
||||
```
|
||||
参考下面的翻译：
|
||||
{source_term} 翻译成 {target_term}
|
||||
|
||||
将以下文本翻译为{target_language}，注意只需要输出翻译后的结果，不要额外解释：
|
||||
{source_text}
|
||||
```
|
||||
---
|
||||
|
||||
### Prompt Template for contextual translation.
|
||||
---
|
||||
```
|
||||
{context}
|
||||
参考上面的信息，把下面的文本翻译成{target_language}，注意不需要翻译上文，也不要额外解释：
|
||||
{source_text}
|
||||
|
||||
```
|
||||
---
|
||||
|
||||
### Prompt Template for formatted translation.
|
||||
---
|
||||
```
|
||||
将以下<source></source>之间的文本翻译为中文，注意只需要输出翻译后的结果，不要额外解释，原文中的<sn></sn>标签表示标签内文本包含格式信息，需要在译文中相应的位置尽量保留该标签。输出格式为：<target>str</target>
|
||||
|
||||
<source>{src_text_with_format}</source>
|
||||
```
|
||||
---
|
||||
|
||||
|
||||
|
||||
### Use with transformers
|
||||
First, please install transformers, recommends v4.56.0
|
||||
```SHELL
|
||||
pip install transformers==4.56.0
|
||||
```
|
||||
|
||||
*!!! If you want to load fp8 model with transformers, you need to change the name"ignored_layers" in config.json to "ignore" and upgrade the compressed-tensors to compressed-tensors-0.11.0.*
|
||||
|
||||
The following code snippet shows how to use the transformers library to load and apply the model.
|
||||
|
||||
we use tencent/HY-MT1.5-1.8B for example
|
||||
|
||||
```python
|
||||
from transformers import AutoModelForCausalLM, AutoTokenizer
|
||||
import os
|
||||
|
||||
model_name_or_path = "tencent/HY-MT1.5-1.8B"
|
||||
|
||||
tokenizer = AutoTokenizer.from_pretrained(model_name_or_path)
|
||||
model = AutoModelForCausalLM.from_pretrained(model_name_or_path, device_map="auto") # You may want to use bfloat16 and/or move to GPU here
|
||||
messages = [
|
||||
{"role": "user", "content": "Translate the following segment into Chinese, without additional explanation.\n\nIt’s on the house."},
|
||||
]
|
||||
tokenized_chat = tokenizer.apply_chat_template(
|
||||
messages,
|
||||
tokenize=True,
|
||||
add_generation_prompt=False,
|
||||
return_tensors="pt"
|
||||
)
|
||||
|
||||
outputs = model.generate(tokenized_chat.to(model.device), max_new_tokens=2048)
|
||||
output_text = tokenizer.decode(outputs[0])
|
||||
```
|
||||
|
||||
We recommend using the following set of parameters for inference. Note that our model does not have the default system_prompt.
|
||||
|
||||
```json
|
||||
{
|
||||
"top_k": 20,
|
||||
"top_p": 0.6,
|
||||
"repetition_penalty": 1.05,
|
||||
"temperature": 0.7
|
||||
}
|
||||
```
|
||||
|
||||
|
||||
|
||||
Supported languages:
|
||||
| Languages | Abbr. | Chinese Names |
|
||||
|-------------------|---------|-----------------|
|
||||
| Chinese | zh | 中文 |
|
||||
| English | en | 英语 |
|
||||
| French | fr | 法语 |
|
||||
| Portuguese | pt | 葡萄牙语 |
|
||||
| Spanish | es | 西班牙语 |
|
||||
| Japanese | ja | 日语 |
|
||||
| Turkish | tr | 土耳其语 |
|
||||
| Russian | ru | 俄语 |
|
||||
| Arabic | ar | 阿拉伯语 |
|
||||
| Korean | ko | 韩语 |
|
||||
| Thai | th | 泰语 |
|
||||
| Italian | it | 意大利语 |
|
||||
| German | de | 德语 |
|
||||
| Vietnamese | vi | 越南语 |
|
||||
| Malay | ms | 马来语 |
|
||||
| Indonesian | id | 印尼语 |
|
||||
| Filipino | tl | 菲律宾语 |
|
||||
| Hindi | hi | 印地语 |
|
||||
| Traditional Chinese | zh-Hant| 繁体中文 |
|
||||
| Polish | pl | 波兰语 |
|
||||
| Czech | cs | 捷克语 |
|
||||
| Dutch | nl | 荷兰语 |
|
||||
| Khmer | km | 高棉语 |
|
||||
| Burmese | my | 缅甸语 |
|
||||
| Persian | fa | 波斯语 |
|
||||
| Gujarati | gu | 古吉拉特语 |
|
||||
| Urdu | ur | 乌尔都语 |
|
||||
| Telugu | te | 泰卢固语 |
|
||||
| Marathi | mr | 马拉地语 |
|
||||
| Hebrew | he | 希伯来语 |
|
||||
| Bengali | bn | 孟加拉语 |
|
||||
| Tamil | ta | 泰米尔语 |
|
||||
| Ukrainian | uk | 乌克兰语 |
|
||||
| Tibetan | bo | 藏语 |
|
||||
| Kazakh | kk | 哈萨克语 |
|
||||
| Mongolian | mn | 蒙古语 |
|
||||
| Uyghur | ug | 维吾尔语 |
|
||||
| Cantonese | yue | 粤语 |
|
||||
|
||||
<!--End Original Model Card-->
|
||||
|
||||
---
|
||||
|
||||
# <span id="testllm" style="color: #7F7FFF;">🚀 If you find these models useful</span>
|
||||
|
||||
Help me test my **AI-Powered Quantum Network Monitor Assistant** with **quantum-ready security checks**:
|
||||
|
||||
👉 [Quantum Network Monitor](https://readyforquantum.com/?assistant=open&utm_source=huggingface&utm_medium=referral&utm_campaign=huggingface_repo_readme)
|
||||
|
||||
|
||||
The full Open Source Code for the Quantum Network Monitor Service available at my github repos ( repos with NetworkMonitor in the name) : [Source Code Quantum Network Monitor](https://github.com/Mungert69). You will also find the code I use to quantize the models if you want to do it yourself [GGUFModelBuilder](https://github.com/Mungert69/GGUFModelBuilder)
|
||||
|
||||
💬 **How to test**:
|
||||
Choose an **AI assistant type**:
|
||||
- `TurboLLM` (GPT-4.1-mini)
|
||||
- `HugLLM` (Hugginface Open-source models)
|
||||
- `TestLLM` (Experimental CPU-only)
|
||||
|
||||
### **What I’m Testing**
|
||||
I’m pushing the limits of **small open-source models for AI network monitoring**, specifically:
|
||||
- **Function calling** against live network services
|
||||
- **How small can a model go** while still handling:
|
||||
- Automated **Nmap security scans**
|
||||
- **Quantum-readiness checks**
|
||||
- **Network Monitoring tasks**
|
||||
|
||||
🟡 **TestLLM** – Current experimental model (llama.cpp on 2 CPU threads on huggingface docker space):
|
||||
- ✅ **Zero-configuration setup**
|
||||
- ⏳ 30s load time (slow inference but **no API costs**) . No token limited as the cost is low.
|
||||
- 🔧 **Help wanted!** If you’re into **edge-device AI**, let’s collaborate!
|
||||
|
||||
### **Other Assistants**
|
||||
🟢 **TurboLLM** – Uses **gpt-4.1-mini** :
|
||||
- **It performs very well but unfortunatly OpenAI charges per token. For this reason tokens usage is limited.
|
||||
- **Create custom cmd processors to run .net code on Quantum Network Monitor Agents**
|
||||
- **Real-time network diagnostics and monitoring**
|
||||
- **Security Audits**
|
||||
- **Penetration testing** (Nmap/Metasploit)
|
||||
|
||||
🔵 **HugLLM** – Latest Open-source models:
|
||||
- 🌐 Runs on Hugging Face Inference API. Performs pretty well using the lastest models hosted on Novita.
|
||||
|
||||
### 💡 **Example commands you could test**:
|
||||
1. `"Give me info on my websites SSL certificate"`
|
||||
2. `"Check if my server is using quantum safe encyption for communication"`
|
||||
3. `"Run a comprehensive security audit on my server"`
|
||||
4. '"Create a cmd processor to .. (what ever you want)" Note you need to install a [Quantum Network Monitor Agent](https://readyforquantum.com/Download/?utm_source=huggingface&utm_medium=referral&utm_campaign=huggingface_repo_readme) to run the .net code on. This is a very flexible and powerful feature. Use with caution!
|
||||
|
||||
### Final Word
|
||||
|
||||
I fund the servers used to create these model files, run the Quantum Network Monitor service, and pay for inference from Novita and OpenAI—all out of my own pocket. All the code behind the model creation and the Quantum Network Monitor project is [open source](https://github.com/Mungert69). Feel free to use whatever you find helpful.
|
||||
|
||||
If you appreciate the work, please consider [buying me a coffee](https://www.buymeacoffee.com/mahadeva) ☕. Your support helps cover service costs and allows me to raise token limits for everyone.
|
||||
|
||||
I'm also open to job opportunities or sponsorship.
|
||||
|
||||
Thank you! 😊
|
||||
Reference in New Issue
Block a user