speakleash/Bielik-11B-v3.0-Instruct-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
SB
2026-01-07 12:44:05 +00:00
committed by system
parent 682f803f44
commit 9cf5dc8a4a
1 changed files with 46 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

46
README.md
View File

@@ -60,6 +60,9 @@ This repo contains GGUF format model files for [SpeakLeash](https://speakleash.o
* **q8_0:** Almost indistinguishable from float16. High resource use and slow. Not recommended for most users. * **q8_0:** Almost indistinguishable from float16. High resource use and slow. Not recommended for most users.
* **16bit:** Converted to FP16 and BF16 GGUF format. * **16bit:** Converted to FP16 and BF16 GGUF format.
Bielik 11B v3.0 is on [Ollama](https://ollama.com/SpeakLeash/bielik-11b-v3.0-instruct)!
https://ollama.com/SpeakLeash/bielik-11b-v3.0-instruct
### Ollama Modfile ### Ollama Modfile
The GGUF file can be used with [Ollama](https://ollama.com/). To do this, you need to import the model using the configuration defined in the Modfile. For model eg. Bielik-11B-v3.0-Instruct.Q4_K_M.gguf (full path to model location) Modfile looks like: The GGUF file can be used with [Ollama](https://ollama.com/). To do this, you need to import the model using the configuration defined in the Modfile. For model eg. Bielik-11B-v3.0-Instruct.Q4_K_M.gguf (full path to model location) Modfile looks like:
@@ -83,6 +86,47 @@ PARAMETER temperature 0.1
``` ```
Ollama Modfile with tools (already on [Ollama](https://ollama.com/SpeakLeash/bielik-11b-v3.0-instruct)):
```
FROM ./Bielik-11B-v3.0-Instruct.Q8_0.gguf
TEMPLATE """{{- /* SYSTEM + TOOLS INJECTION */ -}}
{{- if or .System .Tools -}}
<|im_start|>system
{{- if .System }}
{{ .System }}
{{- end }}
{{- if .Tools }}
You are provided with tool signatures that you can use to assist with the user's query.
You do not have to use a tool if you can respond adequately without it.
Do not make assumptions about tool arguments. If required parameters are missing, ask a clarification question.
If you decide to invoke a tool, you MUST respond with ONLY valid JSON in the following format:
{"name":"<tool-name>","arguments":{...}}
Below is a list of tools you can invoke (JSON):
{{ .Tools }}
{{- end }}
<|im_end|>
{{- end }}
{{- /* MESSAGES */ -}}
{{- range $i, $_ := .Messages }}
<|im_start|>{{ .Role }}
{{ .Content }}<|im_end|>
{{- end }}
{{- /* GENERATION PROMPT */ -}}
<|im_start|>assistant"""
PARAMETER stop "<|start_header_id|>"
PARAMETER stop "<|end_header_id|>"
PARAMETER stop "<|eot_id|>"
PARAMETER temperature 0.1
```
### Model description: ### Model description:
@@ -111,8 +155,10 @@ Here is an incomplete list of clients and libraries that are known to support GG
### Responsible for model quantization ### Responsible for model quantization
* [Remigiusz Kinas](https://www.linkedin.com/in/remigiusz-kinas/)<sup>SpeakLeash</sup> - team leadership, conceptualizing, calibration data preparation, process creation and quantized model delivery. * [Remigiusz Kinas](https://www.linkedin.com/in/remigiusz-kinas/)<sup>SpeakLeash</sup> - team leadership, conceptualizing, calibration data preparation, process creation and quantized model delivery.
* [Kuba Sołtys](https://www.linkedin.com/in/qooba/)<sup>SpeakLeash</sup> - prepared a template with tools for Ollama
* [Szymon Baczyński](https://www.linkedin.com/in/szymon-baczynski/)<sup>SpeakLeash</sup> - team assistant * [Szymon Baczyński](https://www.linkedin.com/in/szymon-baczynski/)<sup>SpeakLeash</sup> - team assistant
## Contact Us ## Contact Us
If you have any questions or suggestions, please use the discussion tab. If you want to contact us directly, join our [Discord SpeakLeash](https://discord.gg/CPBxPce4). If you have any questions or suggestions, please use the discussion tab. If you want to contact us directly, join our [Discord SpeakLeash](https://discord.gg/CPBxPce4).