初始化项目，由ModelHub XC社区提供模型

Model: unsloth/Hy-MT2-7B-GGUF Source: Original Platform
2026-08-16 23:35:13 +08:00
commit b9901a3dcb
25 changed files with 508 additions and 0 deletions
--- a/.gitattributes
+++ b/.gitattributes
@@ -0,0 +1,81 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bin.* filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+ 
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zstandard filter=lfs diff=lfs merge=lfs -text
+*.tfevents* filter=lfs diff=lfs merge=lfs -text
+*.db* filter=lfs diff=lfs merge=lfs -text
+*.ark* filter=lfs diff=lfs merge=lfs -text
+**/*ckpt*data* filter=lfs diff=lfs merge=lfs -text
+**/*ckpt*.meta filter=lfs diff=lfs merge=lfs -text
+**/*ckpt*.index filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+ 
+*.ggml filter=lfs diff=lfs merge=lfs -text
+*.llamafile* filter=lfs diff=lfs merge=lfs -text
+*.pt2 filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+
+Hy-MT2-7B-BF16.gguf filter=lfs diff=lfs merge=lfs -text
+
+Hy-MT2-7B-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
+Hy-MT2-7B-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
+
+Hy-MT2-7B-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Hy-MT2-7B-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+
+Hy-MT2-7B-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
+Hy-MT2-7B-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+
+Hy-MT2-7B-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Hy-MT2-7B-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+
+Hy-MT2-7B-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Hy-MT2-7B-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+
+Hy-MT2-7B-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+Hy-MT2-7B-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
+
+Hy-MT2-7B-UD-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
+Hy-MT2-7B-UD-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
+
+Hy-MT2-7B-UD-Q2_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
+Hy-MT2-7B-UD-Q3_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
+
+Hy-MT2-7B-UD-Q5_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
+Hy-MT2-7B-UD-Q4_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
+
+Hy-MT2-7B-UD-Q8_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
+Hy-MT2-7B-UD-Q6_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
+
+imatrix_unsloth.gguf_file filter=lfs diff=lfs merge=lfs -text
--- a/Hy-MT2-7B-BF16.gguf
+++ b/Hy-MT2-7B-BF16.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:724e4e77a8b2e38e6abee4eeec3d566a42d01aa7c70d861c2c3487aa0778d334
+size 15017205312
--- a/Hy-MT2-7B-IQ4_NL.gguf
+++ b/Hy-MT2-7B-IQ4_NL.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:db5dee49dd279603a68c494a29f1a3a4db35bdb61004fc92b1d59a68e2f8626b
+size 4381904672
--- a/Hy-MT2-7B-IQ4_XS.gguf
+++ b/Hy-MT2-7B-IQ4_XS.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6d4ba36c9b09a1aa97bd334ba96131d88b1e0fac434bb50ebeba426adc61d2df
+size 4167995168
--- a/Hy-MT2-7B-Q3_K_M.gguf
+++ b/Hy-MT2-7B-Q3_K_M.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:390fcea06b82347968a1341780e486961d4792364a696cc2e4d834d2bccc3edc
+size 3792604960
--- a/Hy-MT2-7B-Q3_K_S.gguf
+++ b/Hy-MT2-7B-Q3_K_S.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:19fdd7803daa90661c6a6b34b92bc2350fbd8e187f343ef6b0fe35432c2609cc
+size 3438186272
--- a/Hy-MT2-7B-Q4_0.gguf
+++ b/Hy-MT2-7B-Q4_0.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c8fc46dd1a7c5b07ce1e1189e049c356771868c153a7aae40bdde8d4f8292851
+size 4379807520
--- a/Hy-MT2-7B-Q4_1.gguf
+++ b/Hy-MT2-7B-Q4_1.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f337ad29a5aa849e5a5e88713b92688a63b42dfd87202752bebb6211b3600c00
+size 4801335072
--- a/Hy-MT2-7B-Q4_K_M.gguf
+++ b/Hy-MT2-7B-Q4_K_M.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bf746b9d01f39ca39e49bca03984f3f7c5d65f6d6ea954f4bc8e46dd2aac1fe5
+size 4624650016
--- a/Hy-MT2-7B-Q4_K_S.gguf
+++ b/Hy-MT2-7B-Q4_K_S.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:715f7b2cfebb351c7e6171665df31a085a56facadbe6a0cb81aa742de22488f1
+size 4396584736
--- a/Hy-MT2-7B-Q5_K_M.gguf
+++ b/Hy-MT2-7B-Q5_K_M.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b37a1b004e82670aef7adb018bfadb297d0a897e6c74c0eb61db352fcd82d1e9
+size 5371236128
--- a/Hy-MT2-7B-Q5_K_S.gguf
+++ b/Hy-MT2-7B-Q5_K_S.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8d808681b9c907702e5fe3872d6c33d63abd830ee7dff5106442bde84e95f27f
+size 5237542688
--- a/Hy-MT2-7B-Q6_K.gguf
+++ b/Hy-MT2-7B-Q6_K.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:10d733c806226b49eafc254f5c9f57fab847c54db19cd92413db1e5dc982206b
+size 6164483872
--- a/Hy-MT2-7B-Q8_0.gguf
+++ b/Hy-MT2-7B-Q8_0.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:26453d2f89e70dc34dc30bc87eae04da956a50e25855a16554619de58555fee2
+size 7981930048
--- a/Hy-MT2-7B-UD-IQ2_M.gguf
+++ b/Hy-MT2-7B-UD-IQ2_M.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d87d294bb4a524f1fd927c1a7db6aa9cbaba29ed48eee8a5126f07f0150b0580
+size 2828577856
--- a/Hy-MT2-7B-UD-IQ3_XXS.gguf
+++ b/Hy-MT2-7B-UD-IQ3_XXS.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0146743e816210d5a9f12fa9f219bc3926134253f4c5205a6403c18b128feaae
+size 3127356480
--- a/Hy-MT2-7B-UD-Q2_K_XL.gguf
+++ b/Hy-MT2-7B-UD-Q2_K_XL.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cfff5dc2a62761a765692af12e56a596732938ffe33539ec1f8339b02bc7f078
+size 3123810080
--- a/Hy-MT2-7B-UD-Q3_K_XL.gguf
+++ b/Hy-MT2-7B-UD-Q3_K_XL.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:752a4862f3bce533bf552962e87ea75272fb34226e3a2496f7019439c7c854aa
+size 3964833568
--- a/Hy-MT2-7B-UD-Q4_K_XL.gguf
+++ b/Hy-MT2-7B-UD-Q4_K_XL.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:623ad21017d46b3920a65655abb385fea0ec267b0ef7857783b116469b1dab22
+size 4782001952
--- a/Hy-MT2-7B-UD-Q5_K_XL.gguf
+++ b/Hy-MT2-7B-UD-Q5_K_XL.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c1686c2803fa2b95faf84aef2df9eb1ee9306e04752a8089d552643aa689504d
+size 5395418912
--- a/Hy-MT2-7B-UD-Q6_K_XL.gguf
+++ b/Hy-MT2-7B-UD-Q6_K_XL.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4d343882998d73ba9f293eac669bed8c0ff31d1d8d649ecd4e0acaa7e2d8925c
+size 6771086912
--- a/Hy-MT2-7B-UD-Q8_K_XL.gguf
+++ b/Hy-MT2-7B-UD-Q8_K_XL.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5015eb845cc6bbb008a4be814da6c52f17669f8affa29df0f3acda2c52fffc11
+size 9630146368
--- a/README.md
+++ b/README.md
@@ -0,0 +1,360 @@
+---
+base_model:
+- tencent/Hy-MT2-7B
+library_name: transformers
+tags:
+- translation
+- unsloth
+language:
+- zh
+- en
+- fr
+- pt
+- es
+- ja
+- tr
+- ru
+- ar
+- ko
+- th
+- it
+- de
+- vi
+- ms
+- id
+- tl
+- hi
+- pl
+- cs
+- nl
+- km
+- my
+- fa
+- gu
+- ur
+- te
+- mr
+- he
+- bn
+- ta
+- uk
+- bo
+- kk
+- mn
+- ug
+license: apache-2.0
+---
+
+<div>
+<p style="margin-top: 0;margin-bottom: 0;">
+    <em><a href="https://docs.unsloth.ai/basics/unsloth-dynamic-v2.0-gguf">Unsloth Dynamic 2.0</a> achieves superior accuracy & outperforms other leading quants.</em>
+  </p>
+  <div style="display: flex; gap: 5px; align-items: center; ">
+    <a href="https://github.com/unslothai/unsloth/">
+      <img src="https://github.com/unslothai/unsloth/raw/main/images/unsloth%20new%20logo.png" width="133">
+    </a>
+    <a href="https://discord.gg/unsloth">
+      <img src="https://github.com/unslothai/unsloth/raw/main/images/Discord%20button.png" width="173">
+    </a>
+    <a href="https://docs.unsloth.ai/">
+      <img src="https://raw.githubusercontent.com/unslothai/unsloth/refs/heads/main/images/documentation%20green%20button.png" width="143">
+    </a>
+  </div>
+</div>
+
+
+
+<p align="left">
+   English&nbsp;｜&nbsp;<a href="README_CN.md">中文</a>
+</p>
+<br>
+
+<p align="center">
+ <img src="imgs/logo-en.png" width="400"/> <br> 
+</p>
+
+<div align="center" style="line-height: 1;">
+
+
+[![HuggingFace](https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Tencent%20Hy-ffc107?color=ffc107&logoColor=white)](https://huggingface.co/collections/tencent/hy-mt2)
+&nbsp;&nbsp;
+[![ModelScope](https://img.shields.io/badge/ModelScope-Tencent%20Hy-624aff)](https://modelscope.cn/collections/Tencent-Hunyuan/Hy-MT2)
+
+</div>
+
+<p align="center">
+    🖥️&nbsp;<a href="https://aistudio.tencent.com/llm/en?tabIndex=0"><b>Official Website</b></a>&nbsp;&nbsp;|&nbsp;&nbsp;
+    💬&nbsp;<a href="https://github.com/Tencent-Hunyuan/Hy-MT2"><b>GitHub</b></a>&nbsp;&nbsp;|&nbsp;&nbsp;
+    🪡&nbsp;<a href="https://github.com/Tencent/AngelSlim/tree/main"><b>AngelSlim</b></a>&nbsp;&nbsp;|&nbsp;&nbsp;
+    📚&nbsp;<a href="https://arxiv.org/pdf/2605.22064"><b>Hy-MT2 Report</b></a></p>
+
+## Model Introduction
+
+
+Hy-MT2 is a family of “fast-thinking” multilingual translation models designed for complex real-world scenarios. It includes three model sizes: 1.8B, 7B, and 30B-A3B (MoE), all of which support translation among 33 languages and effectively follow translation instructions in multiple languages.
+For on-device deployment, AngelSlim 1.25-bit extreme quantization reduces the storage requirement of the 1.8B model to only 440 MB and improves inference speed by 1.5x.
+Multi-dimensional evaluations show that Hy-MT2 delivers outstanding performance across general, real-world business, domain-specific, and instruction-following translation tasks. The 7B and 30B-A3B models outperform open-source models such as DeepSeek-V4-Pro and Kimi K2.6 in fast-thinking mode, while the lightweight 1.8B model also surpasses mainstream commercial APIs from providers such as Microsoft and Doubao overall.
+
+In this release, we also open-source [IFMTBench](./IFMTBench/README.md), a benchmark for evaluating translation instruction-following capabilities.
+
+We also welcome everyone to use our released Hy-MT2-Translator Skill, which makes it easy to integrate Hy-MT2 series models for translation tasks. Download links: [ClawHub](https://clawhub.ai/tencent-adm/hy-mt2-translator-skill) and [SkillHub](https://skillhub.cn/skills/hy-mt2-translator).
+
+Now, Tencent Hy is officially partnering with WMT26 for the "Video Subtitle Translation Task" (https://www2.statmt.org/wmt26/video-subtitle-translation.html). Participants who use the Hy-MT model series to compete in the "General Machine Translation Task" (https://www2.statmt.org/wmt26/translation-task.html) and the "Video Subtitle Translation Task" will have the chance to win special awards sponsored by Hunyuan. We sincerely invite everyone to participate and jointly push the boundaries of machine translation technology!
+
+## News
+
+* 2026.5.21  We open-sourced **Hy-MT2-1.8B**/**Hy-MT2-7B**/**Hy-MT2-30B-A3B**/**IFMTBench** on HuggingFace and ModelScope.
+* 2025.12.30 We open-sourced **HY-MT1.5-1.8B** and **HY-MT1.5-7B** on HuggingFace and ModelScope.
+* 2025.9.1 We open-sourced **Hunyuan-MT-7B** and **Hunyuan-MT-Chimera-7B** on HuggingFace and ModelScope.
+
+
+## Results
+<div align='center'>
+<img src="imgs/main_result.png" width = "100%" />
+</div>
+
+For more experimental results and analysis, please refer to our [report](https://arxiv.org/pdf/2605.22064).
+
+&nbsp;
+
+## Model Links
+| Model Name  | Description | Download Link |
+| ----------- | ----------- |-----------
+| Hy-MT2-1.8B  | Hy 1.8B translation model |🤗 [Model](https://huggingface.co/tencent/Hy-MT2-1.8B)|
+| Hy-MT2-1.8B-FP8 | Hy 1.8B translation model, FP8 quantization    | 🤗 [Model](https://huggingface.co/tencent/Hy-MT2-1.8B-FP8)|
+| Hy-MT2-1.8B-GGUF | Hy 1.8B translation model, llama.cpp    | 🤗 [Model](https://huggingface.co/tencent/Hy-MT2-1.8B-GGUF)|
+| Hy-MT2-1.8B-2bit-GGUF | Hy 1.8B translation model, llama.cpp, 2bit    | 🤗 [Model](https://huggingface.co/tencent/Hy-MT2-1.8B-2bit-GGUF)|
+| Hy-MT2-1.8B-1.25bit-GGUF | Hy 1.8B translation model, llama.cpp, 1.25bit    | 🤗 [Model](https://huggingface.co/tencent/Hy-MT2-1.8B-1.25bit-GGUF)|
+| Hy-MT2-7B | Hy 7B translation model    | 🤗 [Model](https://huggingface.co/tencent/Hy-MT2-7B)|
+| Hy-MT2-7B-FP8 | Hy 7B translation model, FP8 quantization     | 🤗 [Model](https://huggingface.co/tencent/Hy-MT2-7B-FP8)|
+| Hy-MT2-7B-GGUF | Hy 7B translation model, llama.cpp    | 🤗 [Model](https://huggingface.co/tencent/Hy-MT2-7B-GGUF)|
+| Hy-MT2-30B-A3B | Hy 30B-A3B translation model    | 🤗 [Model](https://huggingface.co/tencent/Hy-MT2-30B-A3B)|
+| Hy-MT2-30B-A3B-FP8 | Hy 30B-A3B translation model, FP8 quantization     | 🤗 [Model](https://huggingface.co/tencent/Hy-MT2-30B-A3B-FP8)|
+
+
+
+## Hy-MT2 Translation Task Instruction Examples (Chinese-English Comparison)
+
+*Note: In the following examples, both source_lang and target_lang should use the full language names. Chinese names should be used in Chinese prompts, and English names should be used in English prompts.*
+
+| Type | Chinese prompt | English prompt |
+|---|---|---|
+| **Default Translation** | 将以下文本翻译为 `{target_lang}`，注意**只需要输出翻译后的结果，不要额外解释**：<br><br>`{source_text}` | Translate the following text into `{target_lang}`. Note that you should **only output the translated result without any additional explanation**:<br><br>`{source_text}` |
+| **Terminology** | *参考下面的翻译：*<br>`{text}` 翻译成 `{text}`<br>`{text}` 翻译成 `{text}`<br>`{text}` 翻译成 `{text}`<br>将以下文本翻译为 `{target_lang}`，注意**只需要输出翻译后的结果，不要额外解释**：<br><br>`{source_text}` | *Reference the following translations:*<br>`{text}` translates to `{text}`<br>`{text}` translates to `{text}`<br>`{text}` translates to `{text}`<br><br>Translate the following text into `{target_lang}`. Note that you must **ONLY output the translated result without any additional explanation**:<br><br>`{source_text}` |
+| **Style** | 请将以下文本翻译为 `{target_lang}`。<br>注意翻译的风格要严格符合【**`{target_style}`**】<br><br>`{source_text}` | Please translate the following text into `{target_lang}`. Note that the translation style must strictly conform to [**`{target_style}`**]:<br><br>`{source_text}` |
+| **Personalization** | *【待翻译文本】*<br>`{source_text}`<br><br>*【翻译任务】*<br>1、**`{user_preferences}`**<br>2、**`{user_preferences}`**<br>3、……<br>4、将【待翻译文本】翻译为 `{target_lang}`。 | *[Source Text]*<br>`{source_text}`<br><br>*[Translation Tasks]*<br>1. **`{user_preferences}`**<br>2. **`{user_preferences}`**<br>3. ...<br>4. Translate the [Source Text] into `{target_lang}`. |
+| **Delimiters** | 请将以下文本准确翻译为 `{target_lang}`。<br>你必须在译文中**保留等量的分隔符，绝对不可遗漏、转义或翻译该符号，并注意分隔符的位置**。<br><br>`{source_text}` | Please accurately translate the following text into `{target_lang}`.<br>You must **retain the exact same number of delimiters in the translation. Strictly do not omit, escape, or translate these symbols, and pay close attention to their placement**.<br><br>`{source_text}` |
+| **Structured Data 1** | *# 任务目标*<br>将下方 `{source_text}` 中的 `{format_type}` 格式数据翻译为 `{target_lang}`。<br><br>*# 严格约束*<br>1. **结构锁定**：绝对保持原有的 `{format_type}` 数据结构、缩进和层级完全不变。<br>2. **选择性翻译**：仅翻译面向用户展示的可见文本内容。<br>3. **禁止修改**：**严禁**翻译或更改任何代码标签、键名 (Key)、变量占位符（如 `{{var}}`、`${var}`、`%s`、`%d` 等）或代码属性。<br><br>*# 数据输入*<br>`{source_text}` | *### Task*<br>Translate the user-facing text within the following `{format_type}` data into `{target_lang}`.<br><br>*### Strict Rules*<br>1. **Structure Preservation:** You MUST preserve the original `{format_type}` data structure, nesting, hierarchy, and indentation exactly as they are.<br>2. **Selective Translation:** Translate ONLY the visible, user-facing text content/values.<br>3. **Strict Non-Translation:** NEVER translate or alter code tags, keys, properties, object names, or variable placeholders. Leave them exactly in their original English/code form.<br><br>*### Source Data*<br>`{source_text}` |
+| **Structured Data 2** | *【背景信息】*<br>`{background_text}`<br><br>请结合背景信息将以下文本翻译为 `{target_lang}`。<br><br>*【待翻译文本】*<br>`{source_text}` | *[Background Information]*<br>`{background_text}`<br><br>Please translate the following text into `{target_lang}`, taking the provided background information into consideration.<br><br>*[Source Text]*<br>`{source_text}` |
+
+---
+
+## Inference and Deployment
+
+For 1.8B and 7B, we recommend using the following parameters for inference. Note that our models do not have a default system_prompt.
+
+```json
+
+{
+  "temperature": 0.7,
+  "top_p": 0.6,
+  "top_k": 20,
+  "repetition_penalty": 1.05,
+  "max_tokens": 4096
+}
+```
+
+For 30B-A3B, we recommend using the following parameters for inference. Note that our models do not have a default system_prompt.
+
+```json
+
+{
+  "temperature": 0.7,
+  "top_p": 1.0,
+  "top_k": -1,
+  "repetition_penalty": 1.0,
+  "max_tokens": 4096
+}
+```
+
+### transformers
+
+transformers>=5.6.0
+
+```python
+from transformers import AutoModelForCausalLM, AutoTokenizer
+import torch
+
+model_path = "tencent/Hy-MT2-7B"
+
+# Load tokenizer
+tokenizer = AutoTokenizer.from_pretrained(model_path, trust_remote_code=True)
+
+# Load model
+model = AutoModelForCausalLM.from_pretrained(
+    model_path,
+    dtype=torch.bfloat16,
+    device_map="auto",
+    trust_remote_code=True,
+)
+
+model.eval()
+
+# Example inference
+prompt = "将以下文本翻译成英语,注意只需要输出翻译后的结果,不要额外解释:\n\n今天天气真好。"
+messages = [{"role": "user", "content": prompt}]
+inputs = tokenizer.apply_chat_template(messages, add_generation_prompt=True, return_tensors="pt").to(model.device)
+
+with torch.no_grad():
+    outputs = model.generate(
+        **inputs,
+        max_new_tokens=4096,
+    )
+response = tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:], skip_special_tokens=True)
+print(response)
+```
+
+### vllm
+
+Build vLLM from source:
+```bash
+uv venv --python 3.12 --seed --managed-python
+source .venv/bin/activate
+git clone https://github.com/vllm-project/vllm.git
+cd vllm
+uv pip install --editable . --torch-backend=auto
+```
+
+Start the vLLM server:
+
+```bash
+vllm serve tencent/Hy-MT2-7B --tensor-parallel-size 1
+```
+
+### sglang
+
+Build SGLang from source:
+```bash
+git clone https://github.com/sgl-project/sglang
+cd sglang
+pip3 install pip --upgrade
+pip3 install "transformers>=5.6.0"
+pip3 install -e "python"
+```
+
+Launch SGLang server:
+
+```bash
+python3 -m sglang.launch_server --model tencent/Hy-MT2-7B --tp 1
+```
+
+### llama_cpp
+**❕❕ This gguf depends on our STQ kernel, which is released at [PR #22836](https://github.com/ggml-org/llama.cpp/pull/22836).**
+
+#### Clone llama.cpp
+
+```bash
+git clone https://github.com/ggml-org/llama.cpp.git
+```
+
+#### Enter the llama.cpp folder
+
+```bash
+cd llama.cpp
+```
+
+#### Build llama.cpp
+
+```bash
+cmake -B build
+cmake --build build --config Release
+```
+
+#### Run a completion example
+
+```bash
+./build/bin/llama-completion \
+  --model model.gguf  \
+  -p "Translate the following segment into Chinese, without additional explanation：Hello" \
+  --jinja \
+  -ngl 0 \
+  -n 64 -st 
+```
+
+#### Run the llama.cpp benchmark
+
+```bash
+./build/bin/llama-bench -m model_zoo/model.gguf  -ngl 0
+```
+
+
+## Model Training
+Hy-MT2 provides a complete model training pipeline, supporting both full-parameter fine-tuning and LoRA fine-tuning, as well as multiple DeepSpeed ZeRO configurations and LLaMA-Factory integration.
+
+For detailed training documentation, please refer to: [Model Training Guide](./train/README.md)
+
+## Quantization Tool
+
+We provide [AngelSlim](https://github.com/tencent/AngelSlim), an easy-to-use, comprehensive, and efficient large model compression toolkit covering common quantization algorithms, low-bit quantization, speculative sampling, and more.
+
+
+## Supported Languages
+| Languages         | Abbr.   | Chinese Names   |
+|-------------------|---------|-----------------|
+| Chinese           | zh      | 中文            |
+| English           | en      | 英语            |
+| French            | fr      | 法语            |
+| Portuguese        | pt      | 葡萄牙语        |
+| Spanish           | es      | 西班牙语        |
+| Japanese          | ja      | 日语            |
+| Turkish           | tr      | 土耳其语        |
+| Russian           | ru      | 俄语            |
+| Arabic            | ar      | 阿拉伯语        |
+| Korean            | ko      | 韩语            |
+| Thai              | th      | 泰语            |
+| Italian           | it      | 意大利语        |
+| German            | de      | 德语            |
+| Vietnamese        | vi      | 越南语          |
+| Malay             | ms      | 马来语          |
+| Indonesian        | id      | 印尼语          |
+| Filipino          | tl      | 菲律宾语        |
+| Hindi             | hi      | 印地语          |
+| Traditional Chinese | zh-Hant| 繁体中文        |
+| Polish            | pl      | 波兰语          |
+| Czech             | cs      | 捷克语          |
+| Dutch             | nl      | 荷兰语          |
+| Khmer             | km      | 高棉语          |
+| Burmese           | my      | 缅甸语          |
+| Persian           | fa      | 波斯语          |
+| Gujarati          | gu      | 古吉拉特语      |
+| Urdu              | ur      | 乌尔都语        |
+| Telugu            | te      | 泰卢固语        |
+| Marathi           | mr      | 马拉地语        |
+| Hebrew            | he      | 希伯来语        |
+| Bengali           | bn      | 孟加拉语        |
+| Tamil             | ta      | 泰米尔语        |
+| Ukrainian         | uk      | 乌克兰语        |
+| Tibetan           | bo      | 藏语            |
+| Kazakh            | kk      | 哈萨克语        |
+| Mongolian         | mn      | 蒙古语          |
+| Uyghur            | ug      | 维吾尔语        |
+| Cantonese         | yue     | 粤语            |
+
+
+
+## Citing Hy-MT2
+
+```bibtex
+@misc{zheng2026hymt2familyfastefficient,
+      title={Hy-MT2: A Family of Fast, Efficient and Powerful Multilingual Translation Models in the Wild}, 
+      author={Mao Zheng and Zheng Li and Tao Chen and Bo Lv and Mingrui Sun and Mingyang Song and Jinlong Song and Hong Huang and Decheng Wu and Hai Wang and Yifan Song and Yanfeng Chen and Guanwei Zhang},
+      year={2026},
+      eprint={2605.22064},
+      archivePrefix={arXiv},
+      primaryClass={cs.CL},
+      url={https://arxiv.org/abs/2605.22064}, 
+} 
+```
+
+## Contact Us
+If you would like to leave feedback for our R&D and product teams, you are welcome to contact the Tencent Hunyuan LLM team. You can reach us by email at hunyuan_opensource@tencent.com.
--- a/configuration.json
+++ b/configuration.json
@@ -0,0 +1 @@
+{"framework": "pytorch", "task": "translation", "allow_remote": true}
--- a/imatrix_unsloth.gguf_file
+++ b/imatrix_unsloth.gguf_file
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5f2f04d94e05426a3d252ce1a252f1383a5db337c6ab100387e5cb9ee2a559f1
+size 5015232
				`@@ -0,0 +1 @@`
				`{"framework": "pytorch", "task": "translation", "allow_remote": true}`