初始化项目,由ModelHub XC社区提供模型

Model: AdaTooler-V/AdaTooler-V-SFT-model
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-09-07 07:20:18 +08:00
commit 0eba91fb66
19 changed files with 153449 additions and 0 deletions

17
README.md Normal file
View File

@@ -0,0 +1,17 @@
---
license: apache-2.0
---
# AdaTooler-V: Adaptive Tool-Use for Images and Videos
The model was presented in the paper [AdaTooler-V: Adaptive Tool-Use for Images and Videos](https://arxiv.org/abs/2512.16918).
# Paper abstract
The abstract of the paper is the following:
Recent advances have shown that multimodal large language models (MLLMs) benefit from multimodal interleaved chain-of-thought (CoT) with vision tool interactions. However, existing open-source models often exhibit blind tool-use reasoning patterns, invoking vision tools even when they are unnecessary, which significantly increases inference overhead and degrades model performance. To this end, we propose AdaTooler-V, an MLLM that performs adaptive tool-use by determining whether a visual problem truly requires tools. First, we introduce AT-GRPO, a reinforcement learning algorithm that adaptively adjusts reward scales based on the Tool Benefit Score of each sample, encouraging the model to invoke tools only when they provide genuine improvements. Moreover, we construct two datasets to support training: AdaTooler-V-CoT-100k for SFT cold start and AdaTooler-V-300k for RL with verifiable rewards across single-image, multi-image, and video data. Experiments across twelve benchmarks demonstrate the strong reasoning capability of AdaTooler-V, outperforming existing methods in diverse visual reasoning tasks. Notably, AdaTooler-V-7B achieves an accuracy of 89.8\% on the high-resolution benchmark V*, surpassing the commercial proprietary model GPT-4o and Gemini 1.5 Pro.
# Content
This is the repository for AdaTooler-V-SFT-model (https://arxiv.org/abs/2512.16918).
For training and evaluation, please refer to the Code: [AdaTooler-V](https://github.com/CYWang735/AdaTooler-V).