32 lines
790 B
Markdown
32 lines
790 B
Markdown
---
|
|
tags:
|
|
- gguf
|
|
- llama.cpp
|
|
- unsloth
|
|
- code
|
|
- qwen
|
|
- qwen-coder
|
|
- conversational
|
|
base_model:
|
|
- unsloth/Qwen2.5-Coder-7B-Instruct-bnb-4bit
|
|
pipeline_tag: text-generation
|
|
license: apache-2.0
|
|
---
|
|
|
|
This model is a fine-tuned version of **Qwen2.5-Coder-7B-Instruct**, optimized for Godot Engine and GDScript-related coding tasks.
|
|
|
|
# godot-qwen2.5-coder-7b-instruct-bnb-4bit : GGUF
|
|
|
|
This model was finetuned and converted to GGUF format
|
|
|
|
**Example usage**:
|
|
- For text only LLMs: `llama-cli -hf bekoozkan/godot-qwen2.5-coder-7b-instruct-bnb-4bit --jinja`
|
|
- For multimodal models: `llama-mtmd-cli -hf bekoozkan/godot-qwen2.5-coder-7b-instruct-bnb-4bit --jinja`
|
|
|
|
## Available Model files:
|
|
- `qwen2.5-coder-7b-instruct.Q8_0.gguf`
|
|
|
|
## Ollama
|
|
An Ollama Modelfile is included for easy deployment.
|
|
|