NightForger/avibe-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: NightForger/avibe-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-08 02:46:09 +08:00
commit 75b6a2a0b2
17 changed files with 176 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

50
.gitattributes vendored Normal file
View File

@@ -0,0 +1,50 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
model_Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
model_Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
model_Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
model_Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
model_Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
model_Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
model_Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
model_Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
model_Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
model_Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
model_Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
model_Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
model_Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
model_Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
model-f16.gguf filter=lfs diff=lfs merge=lfs -text

81
README.md Normal file
View File

@@ -0,0 +1,81 @@
---
license: apache-2.0
language:
- ru
- en
base_model:
- AvitoTech/avibe
pipeline_tag: text-generation
tags:
- avibe
- qwen3
- GGUF
---
# AvitoTech/avibe, Russian SFT-tune of qwen3-8b-base model with custom tokenizer [GGUF edition]
It is just fast GGUF version of [this model](https://huggingface.co/AvitoTech/avibe).
# Code example:
```python
# Please, use vllm or exl2
# Установка необходимых библиотек
#!pip install llama-cpp-python huggingface_hub
# Импортируем необходимые модули
from llama_cpp import Llama
from huggingface_hub import hf_hub_download
# Указываем идентификатор репозитория и имя файла модели
MODEL_REPO = "NightForger/avibe-GGUF"
MODEL_FILENAME = "model_Q4_K_M.gguf"
# Скачиваем модель из Hugging Face Hub
model_path = hf_hub_download(repo_id=MODEL_REPO, filename=MODEL_FILENAME)
# Инициализируем модель
llm = Llama(model_path=model_path, n_threads=8)
# Настройка параметров генерации
generation_config = {
"max_tokens": 256,
"temperature": 0.7,
"top_p": 0.9,
"repeat_penalty": 1.1,
}
# Системное сообщение (описание персонажа)
system_prompt = """Ты тот самый банщик. Легендарный банщик со своими легендарными анекдотами в мужское бане. Шутки чёрные и смешные."""
# Вопрос пользователя
user_question = "Привет! Можешь рассказать мне короткий, но смешной анекдот?"
# Формирование сообщений в формате чата
messages = [
{"role": "system", "content": system_prompt},
{"role": "user", "content": user_question},
]
# Генерация ответа
response = llm.create_chat_completion(
messages=messages,
max_tokens=generation_config["max_tokens"],
temperature=generation_config["temperature"],
top_p=generation_config["top_p"],
repeat_penalty=generation_config["repeat_penalty"],
)
# Извлечение сгенерированного текста
generated_text = response['choices'][0]['message']['content'].strip()
# Выводим результат
print(f"Вопрос: {user_question}")
print(f"Ответ: {generated_text}")
```
# Output example
```
Вопрос: Привет! Можешь рассказать мне короткий, но смешной анекдот?
Ответ: — Доктор, я не могу жить без воды! — кричит пациент.
— Вы серьёзно? — отвечает врач. — А что вы будете делать с тем мужчиной в вашей жизни, который тоже не может жить без... водки?
(Классика жанра: вода vs водочка — классика мужского банного юмора!)
```

3
model-f16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7aa673b19618497869dba794ab115e6159223cca338b63336da3409dfaa53c79
size 15805286272

3
model_Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d20a5d1326bf8e0754c3de8ccb237ab3bd7e0272fdb9f7390cdf4f790c40d8af
size 3114105664

3
model_Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:702945223aa68c07b0265e704cb5b6c5c7de423b170ccd7aba8c3b48865dd3d7
size 4248981376

3
model_Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:54abbcb5c8c8d1b8d63ca56d91d88216ebca4b99d502bcf5df9a9b04cc755d5c
size 3941748608

3
model_Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:27cb910aa50ddf42353e040130923bbf3ae33c2c1914167512884550c2d6a4d6
size 3587198848

3
model_Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:052dce365818f4286fab7ca296b82fb1fcad902bd5f0f872bc2c90ce69792ade
size 4573001920

3
model_Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e677d5a51ee1eecb88258bb3c1f5d55a4190f47714e3f5cced32c4ba19a91d66
size 5036909248

3
model_Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0a493e9e40bcb6134c07e1af5258a4fb9d97cff695a2ae2d5ad4d6c963d53d1b
size 4826036416

3
model_Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9dcd9311562351b110f3cec61819f588dbd4672dcdc8dbe0e2b70491e5d5285f
size 4600264896

3
model_Q5_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:99371f36ea61ae15f3510b08d3aeab9f12bae04a1c1befdccf2d3c61858b38b2
size 5500816576

3
model_Q5_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:344003d42ec28ba201fe1e003dbe7b4ba05d0af51f353f67808d92005c6139a8
size 5964723904

3
model_Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7cdbfea5c4d7c2d48617a2bcce8b41fd4b466e68cee82d24debb277d97cd1db4
size 5631167680

3
model_Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4f19ace0aaf1e75b4e66e52ad70239194f56870969104798b0f91df57284f48a
size 5500816576

3
model_Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ae638961437ec45d0e726e054a0630888814fbde2b0611621714e5d6ef1a2aaf
size 6486619648

3
model_Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8f3f68d34ce1c87f5970de299cacfe5c0faa913eab26c465a9093be7cb515f8e
size 8399723392