初始化项目,由ModelHub XC社区提供模型
Model: varuneshv/VCoder Source: Original Platform
This commit is contained in:
167
README.md
Normal file
167
README.md
Normal file
@@ -0,0 +1,167 @@
|
||||
---
|
||||
license: apache-2.0
|
||||
base_model: Qwen/Qwen2.5-Coder-3B-Instruct
|
||||
pipeline_tag: text-generation
|
||||
library_name: transformers
|
||||
tags:
|
||||
- code-generation
|
||||
- python
|
||||
- qwen
|
||||
- unsloth
|
||||
- transformers
|
||||
- coding-assistant
|
||||
language:
|
||||
- en
|
||||
---
|
||||
|
||||
# VCoder
|
||||
|
||||
VCoder is a Python-focused coding assistant fine-tuned from Qwen2.5-Coder-3B-Instruct using LoRA and Unsloth.
|
||||
|
||||
The model was trained on 15,000 Python instruction-response examples from the Python Code Instructions 15K dataset and optimized for Python code generation, problem solving, debugging, and algorithm implementation.
|
||||
|
||||
## Model Details
|
||||
|
||||
| Attribute | Value |
|
||||
|------------|---------|
|
||||
| Base Model | Qwen2.5-Coder-3B-Instruct |
|
||||
| Fine-Tuning Method | LoRA |
|
||||
| Framework | Unsloth |
|
||||
| Dataset | Python Code Instructions 15K |
|
||||
| Training Samples | 15,000 |
|
||||
| GPU | NVIDIA Tesla T4 |
|
||||
| Quantized Format | GGUF Q8_0 |
|
||||
| Primary Language | Python |
|
||||
|
||||
---
|
||||
|
||||
## Training Pipeline
|
||||
|
||||
Training was performed incrementally:
|
||||
|
||||
| Stage | Samples |
|
||||
|---------|---------|
|
||||
| Stage 1 | 0 - 5,000 |
|
||||
| Stage 2 | 5,000 - 10,000 |
|
||||
| Stage 3 | 10,000 - 15,000 |
|
||||
|
||||
The model was trained using parameter-efficient fine-tuning (LoRA), allowing adaptation of the base model while keeping computational requirements low.
|
||||
|
||||
---
|
||||
|
||||
## Benchmark Results
|
||||
|
||||

|
||||
|
||||
### HumanEval Comparison
|
||||
|
||||
The model was evaluated against the original Qwen2.5-Coder-3B-Instruct on HumanEval coding tasks.
|
||||
|
||||
| Model | Pass@1 |
|
||||
|---------|---------|
|
||||
| Base Qwen2.5-Coder-3B | 61.0% |
|
||||
| VCoder | 68.0% |
|
||||
|
||||
### Improvement
|
||||
|
||||
```text
|
||||
+7.0% Pass@1 improvement
|
||||
```
|
||||
|
||||
This demonstrates that the fine-tuned model performs better on Python coding tasks than the original base model.
|
||||
|
||||
---
|
||||
|
||||
## Example Usage
|
||||
|
||||
### Python
|
||||
|
||||
```python
|
||||
prompt = """
|
||||
### Instruction:
|
||||
Write a Python function to reverse a string.
|
||||
|
||||
### Input:
|
||||
|
||||
### Response:
|
||||
"""
|
||||
```
|
||||
|
||||
### Example Output
|
||||
|
||||
```python
|
||||
def reverse_string(text):
|
||||
return text[::-1]
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## Supported Tasks
|
||||
|
||||
- Python Code Generation
|
||||
- Algorithm Design
|
||||
- Data Structures
|
||||
- Debugging
|
||||
- Code Refactoring
|
||||
- Coding Interview Questions
|
||||
- Competitive Programming
|
||||
- Function Completion
|
||||
|
||||
---
|
||||
|
||||
## GGUF Usage
|
||||
|
||||
Compatible with:
|
||||
|
||||
- Ollama
|
||||
- LM Studio
|
||||
- llama.cpp
|
||||
|
||||
---
|
||||
|
||||
## Training Dataset
|
||||
|
||||
Dataset used:
|
||||
|
||||
Python Code Instructions 15K
|
||||
|
||||
The dataset contains instruction-response pairs focused on Python programming tasks including:
|
||||
|
||||
- Function generation
|
||||
- Data manipulation
|
||||
- Algorithms
|
||||
- Debugging
|
||||
- Problem solving
|
||||
|
||||
---
|
||||
|
||||
## Limitations
|
||||
|
||||
- Primarily optimized for Python.
|
||||
- Benchmark performed on a subset of HumanEval tasks.
|
||||
- May generate incorrect code for highly specialized domains.
|
||||
- Should not be used as the sole source of production-critical code.
|
||||
|
||||
---
|
||||
|
||||
## Acknowledgements
|
||||
|
||||
- Qwen Team for Qwen2.5-Coder
|
||||
- Unsloth for efficient fine-tuning
|
||||
- Hugging Face
|
||||
- OpenAI HumanEval Benchmark
|
||||
|
||||
---
|
||||
|
||||
## Citation
|
||||
|
||||
```bibtex
|
||||
@misc{vcoder2026,
|
||||
title={VCoder: Python Code Generation Model},
|
||||
author={Varunesh V, Prawin R K, Sarguru N},
|
||||
year={2026},
|
||||
base_model={Qwen2.5-Coder-3B-Instruct}
|
||||
}
|
||||
```
|
||||
Github : https://github.com/varunesh-v
|
||||
Mail : varunesh.wrk@gmail.com
|
||||
Reference in New Issue
Block a user