124 lines
3.7 KiB
Markdown
124 lines
3.7 KiB
Markdown
|
|
---
|
||
|
|
license: cc-by-sa-4.0
|
||
|
|
datasets:
|
||
|
|
- ConvLab/dailydialog
|
||
|
|
language:
|
||
|
|
- en
|
||
|
|
base_model: Flexan/HumanPet-X2.2-1.7B
|
||
|
|
pipeline_tag: text-generation
|
||
|
|
---
|
||
|
|
|
||
|
|
# GGUF Files for HumanPet-X2.2-1.7B
|
||
|
|
|
||
|
|
These are the GGUF files for [Flexan/HumanPet-X2.2-1.7B](https://huggingface.co/Flexan/HumanPet-X2.2-1.7B).
|
||
|
|
|
||
|
|
> [!NOTE]
|
||
|
|
> **Note:** this model has only been quantized to **Q2_K**, **Q4_K_M**, and **Q8_0**. Other quantizations may become available later.
|
||
|
|
|
||
|
|
## Downloads
|
||
|
|
|
||
|
|
| GGUF Link | Quantization | Description |
|
||
|
|
| ---- | ----- | ----------- |
|
||
|
|
| [Download](https://huggingface.co/Flexan/Flexan-HumanPet-X2.2-1.7B-GGUF/resolve/main/HumanPet-X2.2-1.7B.Q2_K.gguf) | Q2_K | Lowest quality |
|
||
|
|
| [Download](https://huggingface.co/Flexan/Flexan-HumanPet-X2.2-1.7B-GGUF/resolve/main/HumanPet-X2.2-1.7B.Q4_K_M.gguf) | Q4_K_M | **Recommended:** Perfect mix of speed and performance |
|
||
|
|
| [Download](https://huggingface.co/Flexan/Flexan-HumanPet-X2.2-1.7B-GGUF/resolve/main/HumanPet-X2.2-1.7B.Q8_0.gguf) | Q8_0 | Best quality |
|
||
|
|
| [Download](https://huggingface.co/Flexan/Flexan-HumanPet-X2.2-1.7B-GGUF/resolve/main/HumanPet-X2.2-1.7B.f16.gguf) | f16 | Full precision, don't bother; use a quant |
|
||
|
|
|
||
|
|
# HumanPet X2.2 1.7B
|
||
|
|
|
||
|
|
## Description
|
||
|
|
|
||
|
|
HumanPet X2.2 1.7B is an instruct LLM consisting of 1.7B parameters trained to talk in a human conversational manner. It does not support reasoning nor tool-calling (although the base model does).
|
||
|
|
The model was LoRA fine-tuned with [Qwen/Qwen3-1.7B](https://huggingface.co/Qwen/Qwen3-1.7B) as base model.
|
||
|
|
|
||
|
|
The HumanPet series is part of an experiment. Do not expect consistent releases.
|
||
|
|
|
||
|
|
[Explanation of the experiment](https://huggingface.co/Flexan/HumanPet)
|
||
|
|
[Progress on the experiment](https://huggingface.co/Flexan/HumanPet#progress)
|
||
|
|
[Findings for HumanPet X2.2 1.7B](https://huggingface.co/Flexan/HumanPet#humanpet-x22-17b)
|
||
|
|
|
||
|
|
> [!NOTE]
|
||
|
|
> **Note:** the model files are **not released yet.** [Read section 'Stages' in the experiment explanation.](https://huggingface.co/Flexan/HumanPet#stages)
|
||
|
|
|
||
|
|
> [!NOTE]
|
||
|
|
> **Note:** this model is a **re-train** of the previous model. Read why the model was re-trained here: [Findings for HumanPet X2.1 1.7B](https://huggingface.co/Flexan/HumanPet#humanpet-x21-17b)
|
||
|
|
|
||
|
|
## Chat Format
|
||
|
|
|
||
|
|
HumanPet X2.2 1.7B uses the ChatML format, e.g.:
|
||
|
|
```text
|
||
|
|
<|im_start|>system
|
||
|
|
System message<|im_end|>
|
||
|
|
<|im_start|>user
|
||
|
|
User prompt<|im_end|>
|
||
|
|
<|im_start|>assistant
|
||
|
|
Assistant response<|im_end|>
|
||
|
|
```
|
||
|
|
|
||
|
|
## Usage
|
||
|
|
|
||
|
|
This model is not trained on system prompts. Therefore, it is recommended to not send any system messages. This includes tools (which this model also was not trained on).
|
||
|
|
|
||
|
|
The assistant response has the following format:
|
||
|
|
```text
|
||
|
|
<|im_start|>assistant
|
||
|
|
<think>
|
||
|
|
|
||
|
|
</think>
|
||
|
|
|
||
|
|
What happened?
|
||
|
|
|
||
|
|
<emote>:^</emote><|im_end|>
|
||
|
|
```
|
||
|
|
|
||
|
|
Note that the `<think>...</think>` tags are always empty, as this model was not trained on reasoning data.
|
||
|
|
The `<emote>...</emote>` tags contain a text emoji that the model thinks fits most with the response. The emojis it may output are:
|
||
|
|
```txt
|
||
|
|
0^0
|
||
|
|
u~u
|
||
|
|
u.u
|
||
|
|
:^
|
||
|
|
:3
|
||
|
|
x3
|
||
|
|
0w0
|
||
|
|
u-u
|
||
|
|
:P
|
||
|
|
>.<
|
||
|
|
>-<
|
||
|
|
owo
|
||
|
|
U.U
|
||
|
|
:]
|
||
|
|
^-^
|
||
|
|
>:3
|
||
|
|
:0
|
||
|
|
:O
|
||
|
|
0~0
|
||
|
|
o^o
|
||
|
|
O^O
|
||
|
|
@~@
|
||
|
|
@.@
|
||
|
|
o~o
|
||
|
|
T^T
|
||
|
|
>~<
|
||
|
|
>.0
|
||
|
|
o.o
|
||
|
|
>^<
|
||
|
|
0.0
|
||
|
|
0-0
|
||
|
|
-w-
|
||
|
|
-.-
|
||
|
|
T-T
|
||
|
|
T.T
|
||
|
|
T~T
|
||
|
|
:<
|
||
|
|
u^u
|
||
|
|
```
|
||
|
|
|
||
|
|
Note that the emojis are escaped because of the XML tags (e.g. ">.<" is outputted by the model as "&gt;.&lt;"). If the model does not adhere to the list of emojis, please let us know in the community tab.
|
||
|
|
|
||
|
|
## Datasets
|
||
|
|
|
||
|
|
1. **[ConvLab/dailydialog](https://huggingface.co/datasets/ConvLab/dailydialog)** *4.3k chats*
|
||
|
|
Only the conversations from the "Relationship" domain have been used.
|
||
|
|
- **Private NLP processing**
|
||
|
|
NLP processing has been applied to the text to modify the dataset to be sillier.
|