初始化项目，由ModelHub XC社区提供模型

Model: Eubiota/eubiota-planner-8b Source: Original Platform
2026-06-24 10:37:18 +08:00
commit c9f7434cb5
18 changed files with 152073 additions and 0 deletions
--- a/.gitattributes
+++ b/.gitattributes
@@ -0,0 +1,37 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text
+logo_transparent.png filter=lfs diff=lfs merge=lfs -text
--- a/README.md
+++ b/README.md
@@ -0,0 +1,167 @@
+---
+license: apache-2.0
+language:
+- en
+base_model:
+- Qwen/Qwen3-8B
+pipeline_tag: text-generation
+library_name: transformers
+tags:
+- microbiome
+- agentic-ai
+- scientific-reasoning
+- tool-use
+- multi-agent
+- reinforcement-learning
+- GRPO
+datasets:
+- Eubiota/microbio-bench
+- qiaojin/PubMedQA
+- GBaker/MedQA-USMLE-4-options
+- zwhe99/DeepMath-103K
+- RUC-NLPIR/FlashRAG_datasets
+---
+
+<div style="display: flex; align-items: center; justify-content: center; gap: 8px;">
+  <a href="https://eubiota.ai/">
+    <img src="https://huggingface.co/datasets/Eubiota/microbio-bench/resolve/main/logo_transparent.png" alt="Eubiota Logo" style="height: 84px; width: auto;">
+  </a>
+</div>
+
+<div align="center">
+  <a href="https://x.com/lupantech/status/2028873916966703343"><img src="https://img.shields.io/badge/Twitter-000000?style=for-the-badge&logo=X&logoColor=white" alt="X"></a>
+  <a href="https://discord.gg/GCEFSN2RWJ"><img src="https://img.shields.io/badge/Discord-5865F2?style=for-the-badge&logo=discord&logoColor=white" alt="Discord"></a>
+  <a href="https://eubiota.ai/"><img src="https://img.shields.io/badge/Website-50C878?style=for-the-badge&logo=google-chrome&logoColor=white" alt="Website"></a>
+  <a href="https://www.biorxiv.org/content/10.64898/2026.02.27.708412v1"><img src="https://img.shields.io/badge/bioRxiv-Paper-B31B1B?style=for-the-badge&logo=arxiv&logoColor=white" alt="Paper"></a>
+  <a href="https://app.eubiota.ai/"><img src="https://img.shields.io/badge/App-FF9500?style=for-the-badge&logo=react&logoColor=white" alt="App"></a>  <a href="https://github.com/lupantech/Eubiota"><img src="https://img.shields.io/badge/GitHub-181717?style=for-the-badge&logo=github&logoColor=white" alt="GitHub"></a>
+  <a href="https://huggingface.co/datasets/Eubiota/microbio-bench"><img src="https://img.shields.io/badge/Dataset-FFB7B2?style=for-the-badge&logo=huggingface&logoColor=white" alt="Dataset"></a>
+</div>
+
+<p align="center">
+  🤗 <a href="https://huggingface.co/Eubiota" target="_blank">HuggingFace</a> ｜
+  🌐 <a href="https://eubiota.ai/" target="_blank">Website</a> ｜
+  📄 <a href="https://www.biorxiv.org/content/10.64898/2026.02.27.708412v1" target="_blank">Paper</a> ｜
+  💻 <a href="https://github.com/lupantech/Eubiota" target="_blank">GitHub</a> ｜
+  🚀 <a href="https://app.eubiota.ai/" target="_blank">App</a>
+</p>
+
+---
+
+**Eubiota-Planner-8B** is a specialized 8-billion parameter language model fine-tuned for autonomous microbiome discovery. It serves as the core planner module in the [Eubiota](https://eubiota.ai/) agentic AI framework, orchestrating multi-agent reasoning and tool-grounded scientific exploration.
+
+
+## Model Description
+
+| Property | Details |
+|----------|---------|
+| **Model Type** | Causal language model fine-tuned for agentic planning |
+| **Base Model** | [Qwen3-8B](https://huggingface.co/Qwen/Qwen3-8B) |
+| **Training Method** | GRPO-MAS (Group Relative Policy Optimization for Multi-Agent Systems) |
+| **Language** | English |
+| **Developed By** | Stanford University |
+| **Affiliations** | Department of Biomedical Data Science, Department of Computer Science, Department of Microbiology and Immunology, Institute for Human-Centered AI (HAI) |
+
+## Intended Use
+
+### Primary Use Cases
+
+- **Microbiome Hypothesis Generation**: Formulating mechanistic hypotheses about host-microbe interactions
+- **Experimental Design**: Planning and orchestrating scientific workflows for microbiome research  
+- **Multi-Tool Coordination**: Selecting and sequencing domain-specific tools (PubMed, KEGG pathways, etc.) for complex scientific queries
+
+## Training
+
+### Training Data
+
+The model was trained on a mixture of four domain datasets:
+
+| Dataset | Purpose | Source |
+|---------|---------|--------|
+| **Microbio-Bench** | Curated microbiome reasoning | [Eubiota/microbio-bench](https://huggingface.co/datasets/Eubiota/microbio-bench) |
+| **PubMedQA** | Medical-biology reasoning | [qiaojin/PubMedQA](https://huggingface.co/datasets/qiaojin/PubMedQA) |
+| **MedQA-USMLE** | Medical-biology reasoning | [GBaker/MedQA-USMLE-4-options](https://huggingface.co/datasets/GBaker/MedQA-USMLE-4-options) |
+| **DeepMath-103K** | Mathematical reasoning | [zwhe99/DeepMath-103K](https://huggingface.co/datasets/zwhe99/DeepMath-103K) |
+| **Natural Questions** | Agentic search | [RUC-NLPIR/FlashRAG_datasets](https://huggingface.co/datasets/RUC-NLPIR/FlashRAG_datasets) |
+
+### Training Method
+
+The model is trained using **GRPO-MAS (Group Relative Policy Optimization for Multi-Agent Systems)**, a reinforcement learning approach designed for multi-agent coordination. This method enables the planner to learn effective tool selection and sequencing strategies through outcome-driven refinement.
+
+### Integrated Tools
+
+Eubiota-Planner-8B orchestrates **18 domain-specific tools** spanning web and literature search, biological databases, laboratory resources, and computation utilities.
+
+
+| Category | Tools | Description |
+|----------|-------|-------------|
+| **Web Search** | Google Search, Perplexity Search, Wikipedia Search, URL Page Retrieval | Grounded web search with citation support |
+| **Literature Search** | PubMed Search | Retrieves relevant papers from PubMed and produces citation-grounded summaries |
+| **KEGG Databases** | KEGG Gene, KEGG Drug, KEGG Disease, KEGG Organism | Query tools for genes, drugs, diseases, and organisms |
+| **MDIPID Databases** | MDIPID Gene View, MDIPID Disease View, MDIPID Microbe View | Microbiota-drug-disease association queries from multiple perspectives |
+| **Laboratory Tools** | Transposon Screen Database, Protocol Library | Access to pre-computed gene-phenotype rankings (1,836 genes) and 55 curated microbiome/immunology experimental protocols |
+| **Document Utilities** | Doc Context Search, Database Context Search | File and document context retrieval |
+| **Computation** | Python Execution, LLM Summarization | Code execution and text synthesis capabilities |
+
+## Benchmark Suite
+
+Eubiota-Planner-8B is evaluated on **six benchmarks** across two categories to assess both broad biomedical competence and microbiome-specific mechanistic reasoning.
+
+### General Biomedical Competence
+
+| Benchmark | Description | Source |
+|-----------|-------------|--------|
+| **MedMCQA (Medicine)** | Professional clinical knowledge and complex diagnostic reasoning from medical entrance examinations | [Pal et al., 2022](https://aclanthology.org/2022.chemnlp-1.6/) |
+| **WMDP-Bio** | Expert-level capabilities in hazardous biological knowledge and biosecurity-relevant domains | [Li et al., 2024](https://arxiv.org/abs/2403.03218) |
+
+### Microbiome-Specific Mechanistic Reasoning
+
+Four domain-specific benchmarks derived from [MDIPID](https://www.omic.tech/mdipid/) emphasizing mechanistic linking among microbes, drugs, host pathways, and genes:
+
+| Benchmark | Task | Description |
+|-----------|------|-------------|
+| **Drug-Microbe Impact (Drug-Imp)** | Drug → Microbe | Determining the directional effects of drugs on microbial growth |
+| **Microbe-Protein Mechanism (MB-Mec)** | Microbe → Protein | Linking microbial activity to host proteins |
+| **Protein Functional Comprehension (Prot-Func)** | Protein → Function | Identifying the biological function of a protein |
+| **Protein-Gene Mapping (Prot-Gen)** | Protein → Gene | Mapping expressed proteins to their encoding genes |
+
+
+## Acknowledgements
+
+<div style="display: flex; align-items: center; justify-content: center; gap: 8px;">
+  <a href="https://chanzuckerberg.com/" style="flex-shrink: 0;">
+    <img src="assets/logos/chan_zuckberg.svg" style="height: 75px; width: auto;" alt="Chan Zuckerberg Initiative">
+  </a>
+  
+  <a href="https://hai.stanford.edu/" style="flex-shrink: 0;">
+    <img src="assets/logos/stanford_hai.png" style="height: 76px; width: auto;" alt="Stanford HAI">
+  </a>
+  
+  <a href="https://www.renaissancephilanthropy.org/" style="flex-shrink: 0;">
+    <img src="assets/logos/Renaissance.png" style="height: 84px; width: auto;" alt="Renaissance Philanthropy">
+  </a>
+  
+  <a href="https://deepmind.google/technologies/gemini/" style="flex-shrink: 0;">
+    <img src="assets/logos/Gemini.png" style="height: 84px; width: auto;" alt="Google Gemini">
+  </a>
+</div>
+
+We also thank the following open-source projects:
+- [VeRL](https://github.com/volcengine/verl) for the excellent RL framework design.
+- [vLLM ](https://github.com/vllm-project/vllm) for fast LLM inference support.
+- [AgentFlow](https://github.com/lupantech/AgentFlow) and [Agent Lightning](https://github.com/microsoft/agent-lightning) for early-stage exploration in multi-agent RL training.
+
+## Citation
+```bibtex
+@article{lu2026eubiota,
+  title = {Eubiota: Modular Agentic AI for Autonomous Discovery in the Gut Microbiome},
+  author = {Lu, Pan and Gao, Yifan and Peng, William G. and Zhang, Haoxiang and Zhu, Kunlun and Robinson, Elektra K. and Xu, Qixin and Kotaka, Masakazu and Zhang, Harrison G. and Li, Bingxuan and Shiver, Anthony L. and Choi, Yejin and Huang, Kerwyn Casey and Sonnenburg, Justin and Zou, James},
+  journal = {bioRxiv},
+  year = {2026},
+  month = {feb},
+  day = {27},
+  doi = {10.64898/2026.02.27.708412},
+  url = {https://www.biorxiv.org/content/10.64898/2026.02.27.708412v1},
+  publisher = {Cold Spring Harbor Laboratory}
+}
+
+```
--- a/added_tokens.json
+++ b/added_tokens.json
@@ -0,0 +1,28 @@
+{
+  "</think>": 151668,
+  "</tool_call>": 151658,
+  "</tool_response>": 151666,
+  "<think>": 151667,
+  "<tool_call>": 151657,
+  "<tool_response>": 151665,
+  "<|box_end|>": 151649,
+  "<|box_start|>": 151648,
+  "<|endoftext|>": 151643,
+  "<|file_sep|>": 151664,
+  "<|fim_middle|>": 151660,
+  "<|fim_pad|>": 151662,
+  "<|fim_prefix|>": 151659,
+  "<|fim_suffix|>": 151661,
+  "<|im_end|>": 151645,
+  "<|im_start|>": 151644,
+  "<|image_pad|>": 151655,
+  "<|object_ref_end|>": 151647,
+  "<|object_ref_start|>": 151646,
+  "<|quad_end|>": 151651,
+  "<|quad_start|>": 151650,
+  "<|repo_name|>": 151663,
+  "<|video_pad|>": 151656,
+  "<|vision_end|>": 151653,
+  "<|vision_pad|>": 151654,
+  "<|vision_start|>": 151652
+}
--- a/assets/logos/Gemini.png
+++ b/assets/logos/Gemini.png
--- a/assets/logos/Renaissance.png
+++ b/assets/logos/Renaissance.png
--- a/assets/logos/chan_zuckberg.svg
+++ b/assets/logos/chan_zuckberg.svg
--- a/assets/logos/gemini_logo2.png
+++ b/assets/logos/gemini_logo2.png
--- a/assets/logos/stanford_hai.png
+++ b/assets/logos/stanford_hai.png
--- a/chat_template.jinja
+++ b/chat_template.jinja
@@ -0,0 +1,89 @@
+{%- if tools %}
+    {{- '<|im_start|>system\n' }}
+    {%- if messages[0].role == 'system' %}
+        {{- messages[0].content + '\n\n' }}
+    {%- endif %}
+    {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within <tools></tools> XML tags:\n<tools>" }}
+    {%- for tool in tools %}
+        {{- "\n" }}
+        {{- tool | tojson }}
+    {%- endfor %}
+    {{- "\n</tools>\n\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\n<tool_call>\n{\"name\": <function-name>, \"arguments\": <args-json-object>}\n</tool_call><|im_end|>\n" }}
+{%- else %}
+    {%- if messages[0].role == 'system' %}
+        {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
+    {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for message in messages[::-1] %}
+    {%- set index = (messages|length - 1) - loop.index0 %}
+    {%- if ns.multi_step_tool and message.role == "user" and message.content is string and not(message.content.startswith('<tool_response>') and message.content.endswith('</tool_response>')) %}
+        {%- set ns.multi_step_tool = false %}
+        {%- set ns.last_query_index = index %}
+    {%- endif %}
+{%- endfor %}
+{%- for message in messages %}
+    {%- if message.content is string %}
+        {%- set content = message.content %}
+    {%- else %}
+        {%- set content = '' %}
+    {%- endif %}
+    {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
+        {{- '<|im_start|>' + message.role + '\n' + content + '<|im_end|>' + '\n' }}
+    {%- elif message.role == "assistant" %}
+        {%- set reasoning_content = '' %}
+        {%- if message.reasoning_content is string %}
+            {%- set reasoning_content = message.reasoning_content %}
+        {%- else %}
+            {%- if '</think>' in content %}
+                {%- set reasoning_content = content.split('</think>')[0].rstrip('\n').split('<think>')[-1].lstrip('\n') %}
+                {%- set content = content.split('</think>')[-1].lstrip('\n') %}
+            {%- endif %}
+        {%- endif %}
+        {%- if loop.index0 > ns.last_query_index %}
+            {%- if loop.last or (not loop.last and reasoning_content) %}
+                {{- '<|im_start|>' + message.role + '\n<think>\n' + reasoning_content.strip('\n') + '\n</think>\n\n' + content.lstrip('\n') }}
+            {%- else %}
+                {{- '<|im_start|>' + message.role + '\n' + content }}
+            {%- endif %}
+        {%- else %}
+            {{- '<|im_start|>' + message.role + '\n' + content }}
+        {%- endif %}
+        {%- if message.tool_calls %}
+            {%- for tool_call in message.tool_calls %}
+                {%- if (loop.first and content) or (not loop.first) %}
+                    {{- '\n' }}
+                {%- endif %}
+                {%- if tool_call.function %}
+                    {%- set tool_call = tool_call.function %}
+                {%- endif %}
+                {{- '<tool_call>\n{"name": "' }}
+                {{- tool_call.name }}
+                {{- '", "arguments": ' }}
+                {%- if tool_call.arguments is string %}
+                    {{- tool_call.arguments }}
+                {%- else %}
+                    {{- tool_call.arguments | tojson }}
+                {%- endif %}
+                {{- '}\n</tool_call>' }}
+            {%- endfor %}
+        {%- endif %}
+        {{- '<|im_end|>\n' }}
+    {%- elif message.role == "tool" %}
+        {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+            {{- '<|im_start|>user' }}
+        {%- endif %}
+        {{- '\n<tool_response>\n' }}
+        {{- content }}
+        {{- '\n</tool_response>' }}
+        {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+            {{- '<|im_end|>\n' }}
+        {%- endif %}
+    {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+    {{- '<|im_start|>assistant\n' }}
+    {%- if enable_thinking is defined and enable_thinking is false %}
+        {{- '<think>\n\n</think>\n\n' }}
+    {%- endif %}
+{%- endif %}
--- a/config.json
+++ b/config.json
@@ -0,0 +1,68 @@
+{
+  "architectures": [
+    "Qwen3ForCausalLM"
+  ],
+  "attention_bias": false,
+  "attention_dropout": 0.0,
+  "eos_token_id": 151645,
+  "head_dim": 128,
+  "hidden_act": "silu",
+  "hidden_size": 4096,
+  "initializer_range": 0.02,
+  "intermediate_size": 12288,
+  "layer_types": [
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention"
+  ],
+  "max_position_embeddings": 40960,
+  "max_window_layers": 36,
+  "model_type": "qwen3",
+  "num_attention_heads": 32,
+  "num_hidden_layers": 36,
+  "num_key_value_heads": 8,
+  "pad_token_id": 151643,
+  "rms_norm_eps": 1e-06,
+  "rope_scaling": null,
+  "rope_theta": 1000000,
+  "sliding_window": null,
+  "tie_word_embeddings": false,
+  "torch_dtype": "float32",
+  "transformers_version": "4.53.3",
+  "use_cache": true,
+  "use_sliding_window": false,
+  "vocab_size": 151936
+}
--- a/generation_config.json
+++ b/generation_config.json
@@ -0,0 +1,13 @@
+{
+  "bos_token_id": 151643,
+  "do_sample": true,
+  "eos_token_id": [
+    151645,
+    151643
+  ],
+  "pad_token_id": 151643,
+  "temperature": 0.6,
+  "top_k": 20,
+  "top_p": 0.95,
+  "transformers_version": "4.53.3"
+}
--- a/logo_transparent.png
+++ b/logo_transparent.png
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a1c045836c25e00b7a817772fe6dd2bbf0df4bd7c62ba504006215abaee88d16
+size 130701
--- a/merges.txt
+++ b/merges.txt
--- a/pytorch_model.bin
+++ b/pytorch_model.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3095976f3cfb070d09a02674938005feb2e343f601d6721e57a2084349a27005
+size 16381603743
--- a/special_tokens_map.json
+++ b/special_tokens_map.json
@@ -0,0 +1,31 @@
+{
+  "additional_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>",
+    "<|object_ref_start|>",
+    "<|object_ref_end|>",
+    "<|box_start|>",
+    "<|box_end|>",
+    "<|quad_start|>",
+    "<|quad_end|>",
+    "<|vision_start|>",
+    "<|vision_end|>",
+    "<|vision_pad|>",
+    "<|image_pad|>",
+    "<|video_pad|>"
+  ],
+  "eos_token": {
+    "content": "<|im_end|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<|endoftext|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}
--- a/tokenizer.json
+++ b/tokenizer.json
--- a/tokenizer_config.json
+++ b/tokenizer_config.json
@@ -0,0 +1,239 @@
+{
+  "add_bos_token": false,
+  "add_prefix_space": false,
+  "added_tokens_decoder": {
+    "151643": {
+      "content": "<|endoftext|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151644": {
+      "content": "<|im_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151645": {
+      "content": "<|im_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151646": {
+      "content": "<|object_ref_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151647": {
+      "content": "<|object_ref_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151648": {
+      "content": "<|box_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151649": {
+      "content": "<|box_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151650": {
+      "content": "<|quad_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151651": {
+      "content": "<|quad_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151652": {
+      "content": "<|vision_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151653": {
+      "content": "<|vision_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151654": {
+      "content": "<|vision_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151655": {
+      "content": "<|image_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151656": {
+      "content": "<|video_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151657": {
+      "content": "<tool_call>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151658": {
+      "content": "</tool_call>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151659": {
+      "content": "<|fim_prefix|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151660": {
+      "content": "<|fim_middle|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151661": {
+      "content": "<|fim_suffix|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151662": {
+      "content": "<|fim_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151663": {
+      "content": "<|repo_name|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151664": {
+      "content": "<|file_sep|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151665": {
+      "content": "<tool_response>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151666": {
+      "content": "</tool_response>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151667": {
+      "content": "<think>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151668": {
+      "content": "</think>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    }
+  },
+  "additional_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>",
+    "<|object_ref_start|>",
+    "<|object_ref_end|>",
+    "<|box_start|>",
+    "<|box_end|>",
+    "<|quad_start|>",
+    "<|quad_end|>",
+    "<|vision_start|>",
+    "<|vision_end|>",
+    "<|vision_pad|>",
+    "<|image_pad|>",
+    "<|video_pad|>"
+  ],
+  "bos_token": null,
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|im_end|>",
+  "errors": "replace",
+  "extra_special_tokens": {},
+  "model_max_length": 131072,
+  "pad_token": "<|endoftext|>",
+  "split_special_tokens": false,
+  "tokenizer_class": "Qwen2Tokenizer",
+  "unk_token": null
+}
--- a/vocab.json
+++ b/vocab.json