duyntnet/TenyxChat-7B-v1-imatrix-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: duyntnet/TenyxChat-7B-v1-imatrix-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-17 16:21:16 +08:00
commit e505114f76
29 changed files with 211 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

62
.gitattributes vendored Normal file
View File

@@ -0,0 +1,62 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
TenyxChat-7B-v1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
TenyxChat-7B-v1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
TenyxChat-7B-v1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
TenyxChat-7B-v1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
TenyxChat-7B-v1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
TenyxChat-7B-v1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
TenyxChat-7B-v1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
TenyxChat-7B-v1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
TenyxChat-7B-v1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
TenyxChat-7B-v1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
TenyxChat-7B-v1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
TenyxChat-7B-v1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
TenyxChat-7B-v1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
TenyxChat-7B-v1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
TenyxChat-7B-v1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
TenyxChat-7B-v1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
TenyxChat-7B-v1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
TenyxChat-7B-v1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
TenyxChat-7B-v1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
TenyxChat-7B-v1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
TenyxChat-7B-v1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
TenyxChat-7B-v1-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
TenyxChat-7B-v1-Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
TenyxChat-7B-v1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
TenyxChat-7B-v1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
TenyxChat-7B-v1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
TenyxChat-7B-v1-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

68
README.md Normal file
View File

@@ -0,0 +1,68 @@
---
license: other
language:
- en
pipeline_tag: text-generation
inference: false
tags:
- transformers
- gguf
- imatrix
- TenyxChat-7B-v1
---
Quantizations of https://huggingface.co/tenyx/TenyxChat-7B-v1
# From original readme
## Usage
Our model uses a simple chat template based on OpenChat 3.5. The chat template usage with a Hugging face generation example is shown below.
### Chat Template (Jinja)
```rust
{{ bos_token }}
{% for message in messages %}
{% if message['role'] == 'user' %}
{{ 'User:' + message['content'] + eos_token }}
{% elif message['role'] == 'system' %}
{{ 'System:' + message['content'] + eos_token }}
{% elif message['role'] == 'assistant' %}
{{ 'Assistant:' + message['content'] + eos_token }}
{% endif %}
{% if loop.last and add_generation_prompt %}\n{{ 'Assistant:' }}{% endif %}\n{% endfor %}
```
### Hugging face Example
```python
import torch
from transformers import pipeline
pipe = pipeline("text-generation", model="tenyx/TenyxChat-7B-v1", torch_dtype=torch.bfloat16, device_map="auto")
messages = [
{"role": "system", "content": "You are a friendly chatbot who always responds in the style of a pirate."},
{"role": "user", "content": "Hi. I would like to make a hotel booking."},
]
prompt = pipe.tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
outputs = pipe(prompt, max_new_tokens=512, do_sample=False)
```
### Output
```
<s> System:You are a friendly chatbot who always responds in the style of a pirate.<|end_of_turn|>
User:Hi. I would like to make a hotel booking.<|end_of_turn|>
Assistant: Ahoy there me hearty! Arr, ye be lookin' fer a place to rest yer weary bones, eh?
Well then, let's set sail on this grand adventure and find ye a swell place to stay!
To begin, tell me the location ye be seekin' and the dates ye be lookin' to set sail.
And don't ye worry, me matey, I'll be sure to find ye a place that'll make ye feel like a king or queen on land!
```

3
TenyxChat-7B-v1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b322f8b4f7249ec036ed3215a45b50ac4370bb598745c3c84c8de7e518083a17
size 1754455040

3
TenyxChat-7B-v1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:49e6fef5d61e582dabc1a0b7fd1bb1ea02756e3183684a616d550fd73df9dd32
size 1612110848

3
TenyxChat-7B-v1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3e39e9b2c00a448aed37e9aab6718d32938c4bb3edca3bfea527a1b9a1de2601
size 2500722496

3
TenyxChat-7B-v1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b6820e6711dd36627b8f7b9e30d3fc9a08a90d89164e21accd3312a47220d00b
size 2310930240

3
TenyxChat-7B-v1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cc2dff2313cb9bd8fa5cb79e5c035349015441e1e115b0b2ce87f62ec91ffef2
size 2198264832

3
TenyxChat-7B-v1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8a1cf0d49d0c6ec156849abb29a95a7ccc35769b733f317494c758f861991351
size 1991695360

3
TenyxChat-7B-v1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3c44e7a95acb4c70b439bd9668933012fc2e85f301e26ce12116b277be390231
size 3284902784

3
TenyxChat-7B-v1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:85d9dab39b6ae0acef3a3ee490289138d3990c878dec61c46da6f63653cc6dbc
size 3182404480

3
TenyxChat-7B-v1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b122315117aeab0f143443ff7d7432ee7acd6e82c07e629ceb3d1630cc9e75ef
size 3018826624

3
TenyxChat-7B-v1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d947414ffbb67d262999a08e35a3cdf433f94915dc88a0a1c837293e05cab1a1
size 2827353920

3
TenyxChat-7B-v1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6101e18e392b974eeddfdc10f646d4e1d8d045a3475fe4460bcc795af9d11ef7
size 4125706176

3
TenyxChat-7B-v1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:21ba3ad2a8d7f6069e4188a0074e6a1fed9d69fca667912adeda31a9365a7a36
size 3907700416

3
TenyxChat-7B-v1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3344a7b3fa95520e074a3231116255fb45afca9159b7844dd50c1fa85de74b1a
size 2719252544

3
TenyxChat-7B-v1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3abdc6924acba2dc43594fa07ff471bf1fa5efbd69bb634015b8f5442f9ce353
size 2528936000

3
TenyxChat-7B-v1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d3fc2c6e88b20680d31f706fb94ea9a3f24284a9847e29829b1d5628de3b5a88
size 3822035840

3
TenyxChat-7B-v1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2ef19fe068d4e2f6d9289e60c94d3e68348a52e99ed275cc88a8af30a8361e59
size 3518997376

3
TenyxChat-7B-v1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d4105e1719f5ebd396ca8846863b8edd6e44ca0ccdde619ba659e43592dd3147
size 3164578688

3
TenyxChat-7B-v1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d41ac1d5164c8080c723ec3cc59753540293db068e1dc761dd18d0df139af1de
size 4123609024

3
TenyxChat-7B-v1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ef574ddb2f6a3f212265c903e672757412271e1c76ac4897df48f4d5583be94b
size 4553329088

3
TenyxChat-7B-v1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e483f07cd2fdc92776da2ed9b9b6dda26789351323d7118d8dcb9aaf9b4ff0bb
size 4368451520

3
TenyxChat-7B-v1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f9d9d3cdf2515af7252f968daa90df25c8d9dcbf641567f63b03ca99b347715d
size 4140386240

3
TenyxChat-7B-v1-Q5_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5fa988ebac4ba0df1ee6e184809756b5bf0b091d48428232d37be5715721f523
size 5012409280

3
TenyxChat-7B-v1-Q5_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:04dd9359dd4ea5d114815e8d376c4d5a5cff962c27be4a06649d41fb75da6d0b
size 5442129344

3
TenyxChat-7B-v1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c49caf295bfae64fdd03e05df7dbbbb27c613d893372754121e8887962fd0949
size 5131422656

3
TenyxChat-7B-v1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:620b8c4b92d01eb9d67937edcf8d456634c9f2abb7871ff93d8e2089aaf96df8
size 4997729216

3
TenyxChat-7B-v1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:71c68a96922a2fe2686881c292861d2985b3657dd7f729d0243988fc279f6cac
size 5942079488

3
TenyxChat-7B-v1-Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:727580a8fdd41d37bb300b53b5422f9fa096f86bae793c9f3121d222554b8384
size 7695875968