初始化项目,由ModelHub XC社区提供模型

Model: Rarakiyo/Qwen2.5-7B-Agent-AWQ-v1
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-08-01 19:59:19 +08:00
commit db86b31d4e
13 changed files with 152542 additions and 0 deletions

30
README.md Normal file
View File

@@ -0,0 +1,30 @@
---
base_model: Rarakiyo/Qwen2.5-7B-Agent-v1
language:
- en
license: apache-2.0
library_name: transformers
pipeline_tag: text-generation
tags:
- awq
- 4bit
- agent
- qwen2.5
---
# Qwen2.5-7B-Agent-AWQ-v1
AWQ 4-bit quantized model from **Rarakiyo/Qwen2.5-7B-Agent-v1**.
## Quantization Config
- **Method**: AWQ (Activation-aware Weight Quantization)
- **Bits**: 4
- **Group Size**: 128
- **Version**: GEMM
- **Zero Point**: True
## Usage (vLLM)
```python
from vllm import LLM
model = LLM(model="Rarakiyo/Qwen2.5-7B-Agent-AWQ-v1", quantization="awq")
```