From 9cf5dc8a4a517ae493b8fa0ae7ccebf542606ca4 Mon Sep 17 00:00:00 2001 From: SB Date: Wed, 7 Jan 2026 12:44:05 +0000 Subject: [PATCH] Update README.md --- README.md | 46 ++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 46 insertions(+) diff --git a/README.md b/README.md index 701ff46..26d52f1 100644 --- a/README.md +++ b/README.md @@ -60,6 +60,9 @@ This repo contains GGUF format model files for [SpeakLeash](https://speakleash.o * **q8_0:** Almost indistinguishable from float16. High resource use and slow. Not recommended for most users. * **16bit:** Converted to FP16 and BF16 GGUF format. +Bielik 11B v3.0 is on [Ollama](https://ollama.com/SpeakLeash/bielik-11b-v3.0-instruct)! +https://ollama.com/SpeakLeash/bielik-11b-v3.0-instruct + ### Ollama Modfile The GGUF file can be used with [Ollama](https://ollama.com/). To do this, you need to import the model using the configuration defined in the Modfile. For model eg. Bielik-11B-v3.0-Instruct.Q4_K_M.gguf (full path to model location) Modfile looks like: @@ -83,6 +86,47 @@ PARAMETER temperature 0.1 ``` +Ollama Modfile with tools (already on [Ollama](https://ollama.com/SpeakLeash/bielik-11b-v3.0-instruct)): +``` +FROM ./Bielik-11B-v3.0-Instruct.Q8_0.gguf + +TEMPLATE """{{- /* SYSTEM + TOOLS INJECTION */ -}} +{{- if or .System .Tools -}} +<|im_start|>system +{{- if .System }} +{{ .System }} +{{- end }} + +{{- if .Tools }} +You are provided with tool signatures that you can use to assist with the user's query. +You do not have to use a tool if you can respond adequately without it. +Do not make assumptions about tool arguments. If required parameters are missing, ask a clarification question. + +If you decide to invoke a tool, you MUST respond with ONLY valid JSON in the following format: +{"name":"","arguments":{...}} + +Below is a list of tools you can invoke (JSON): +{{ .Tools }} +{{- end }} +<|im_end|> +{{- end }} + +{{- /* MESSAGES */ -}} +{{- range $i, $_ := .Messages }} +<|im_start|>{{ .Role }} +{{ .Content }}<|im_end|> +{{- end }} + +{{- /* GENERATION PROMPT */ -}} +<|im_start|>assistant""" + +PARAMETER stop "<|start_header_id|>" +PARAMETER stop "<|end_header_id|>" +PARAMETER stop "<|eot_id|>" + +PARAMETER temperature 0.1 +``` + ### Model description: @@ -111,8 +155,10 @@ Here is an incomplete list of clients and libraries that are known to support GG ### Responsible for model quantization * [Remigiusz Kinas](https://www.linkedin.com/in/remigiusz-kinas/)SpeakLeash - team leadership, conceptualizing, calibration data preparation, process creation and quantized model delivery. +* [Kuba Sołtys](https://www.linkedin.com/in/qooba/)SpeakLeash - prepared a template with tools for Ollama * [Szymon Baczyński](https://www.linkedin.com/in/szymon-baczynski/)SpeakLeash - team assistant + ## Contact Us If you have any questions or suggestions, please use the discussion tab. If you want to contact us directly, join our [Discord SpeakLeash](https://discord.gg/CPBxPce4).