34 lines
1.1 KiB
Markdown
34 lines
1.1 KiB
Markdown
|
---
|
||
|
|
base_model: unsloth/qwen2.5-7b-instruct-unsloth-bnb-4bit
|
||
|
|
tags:
|
||
|
|
- text-generation-inference
|
||
|
|
- transformers
|
||
|
|
- unsloth
|
||
|
|
- qwen2
|
||
|
|
- trl
|
||
|
|
- sft
|
||
|
|
license: apache-2.0
|
||
|
|
language:
|
||
|
|
- en
|
||
|
|
---
|
||
|
|
|
||
|
|
<img src="https://cdn-uploads.huggingface.co/production/uploads/647374aa7ff32a81ac6d35d4/Dzbdzn27KEc3K6zNNi070.png" style="display: block;margin-left: auto;margin-right: auto;width: 50%;">
|
||
|
|
|
||
|
|
|
||
|
|
## Description
|
||
|
|
|
||
|
|
A model tailored to be conversational and execute function calls with [LocalAI](https://github.com/mudler/LocalAI). This model is based on qwen2.5 (7B).
|
||
|
|
|
||
|
|
- llama3.2-1b version: https://huggingface.co/mudler/LocalAI-functioncall-llama3.2-1b-v0.4
|
||
|
|
- llama3.2-3b version: https://huggingface.co/mudler/LocalAI-functioncall-llama3.2-3b-v0.5
|
||
|
|
- phi-4 version: https://huggingface.co/mudler/LocalAI-functioncall-phi-4-v0.3
|
||
|
|
- qwen2.5 (7b) version: https://huggingface.co/mudler/LocalAI-functioncall-qwen2.5-7b-v0.5/
|
||
|
|
|
||
|
|
## Usage
|
||
|
|
|
||
|
|
```
|
||
|
|
local-ai run localai-functioncall-qwen2.5-7b-v0.5
|
||
|
|
```
|
||
|
|
|
||
|
|
[](https://localai.io)
|