初始化项目,由ModelHub XC社区提供模型
Model: Flexan/HumanPet-X2.2-1.7B-GGUF Source: Original Platform
This commit is contained in:
124
README.md
Normal file
124
README.md
Normal file
@@ -0,0 +1,124 @@
|
||||
---
|
||||
license: cc-by-sa-4.0
|
||||
datasets:
|
||||
- ConvLab/dailydialog
|
||||
language:
|
||||
- en
|
||||
base_model: Flexan/HumanPet-X2.2-1.7B
|
||||
pipeline_tag: text-generation
|
||||
---
|
||||
|
||||
# GGUF Files for HumanPet-X2.2-1.7B
|
||||
|
||||
These are the GGUF files for [Flexan/HumanPet-X2.2-1.7B](https://huggingface.co/Flexan/HumanPet-X2.2-1.7B).
|
||||
|
||||
> [!NOTE]
|
||||
> **Note:** this model has only been quantized to **Q2_K**, **Q4_K_M**, and **Q8_0**. Other quantizations may become available later.
|
||||
|
||||
## Downloads
|
||||
|
||||
| GGUF Link | Quantization | Description |
|
||||
| ---- | ----- | ----------- |
|
||||
| [Download](https://huggingface.co/Flexan/Flexan-HumanPet-X2.2-1.7B-GGUF/resolve/main/HumanPet-X2.2-1.7B.Q2_K.gguf) | Q2_K | Lowest quality |
|
||||
| [Download](https://huggingface.co/Flexan/Flexan-HumanPet-X2.2-1.7B-GGUF/resolve/main/HumanPet-X2.2-1.7B.Q4_K_M.gguf) | Q4_K_M | **Recommended:** Perfect mix of speed and performance |
|
||||
| [Download](https://huggingface.co/Flexan/Flexan-HumanPet-X2.2-1.7B-GGUF/resolve/main/HumanPet-X2.2-1.7B.Q8_0.gguf) | Q8_0 | Best quality |
|
||||
| [Download](https://huggingface.co/Flexan/Flexan-HumanPet-X2.2-1.7B-GGUF/resolve/main/HumanPet-X2.2-1.7B.f16.gguf) | f16 | Full precision, don't bother; use a quant |
|
||||
|
||||
# HumanPet X2.2 1.7B
|
||||
|
||||
## Description
|
||||
|
||||
HumanPet X2.2 1.7B is an instruct LLM consisting of 1.7B parameters trained to talk in a human conversational manner. It does not support reasoning nor tool-calling (although the base model does).
|
||||
The model was LoRA fine-tuned with [Qwen/Qwen3-1.7B](https://huggingface.co/Qwen/Qwen3-1.7B) as base model.
|
||||
|
||||
The HumanPet series is part of an experiment. Do not expect consistent releases.
|
||||
|
||||
[Explanation of the experiment](https://huggingface.co/Flexan/HumanPet)
|
||||
[Progress on the experiment](https://huggingface.co/Flexan/HumanPet#progress)
|
||||
[Findings for HumanPet X2.2 1.7B](https://huggingface.co/Flexan/HumanPet#humanpet-x22-17b)
|
||||
|
||||
> [!NOTE]
|
||||
> **Note:** the model files are **not released yet.** [Read section 'Stages' in the experiment explanation.](https://huggingface.co/Flexan/HumanPet#stages)
|
||||
|
||||
> [!NOTE]
|
||||
> **Note:** this model is a **re-train** of the previous model. Read why the model was re-trained here: [Findings for HumanPet X2.1 1.7B](https://huggingface.co/Flexan/HumanPet#humanpet-x21-17b)
|
||||
|
||||
## Chat Format
|
||||
|
||||
HumanPet X2.2 1.7B uses the ChatML format, e.g.:
|
||||
```text
|
||||
<|im_start|>system
|
||||
System message<|im_end|>
|
||||
<|im_start|>user
|
||||
User prompt<|im_end|>
|
||||
<|im_start|>assistant
|
||||
Assistant response<|im_end|>
|
||||
```
|
||||
|
||||
## Usage
|
||||
|
||||
This model is not trained on system prompts. Therefore, it is recommended to not send any system messages. This includes tools (which this model also was not trained on).
|
||||
|
||||
The assistant response has the following format:
|
||||
```text
|
||||
<|im_start|>assistant
|
||||
<think>
|
||||
|
||||
</think>
|
||||
|
||||
What happened?
|
||||
|
||||
<emote>:^</emote><|im_end|>
|
||||
```
|
||||
|
||||
Note that the `<think>...</think>` tags are always empty, as this model was not trained on reasoning data.
|
||||
The `<emote>...</emote>` tags contain a text emoji that the model thinks fits most with the response. The emojis it may output are:
|
||||
```txt
|
||||
0^0
|
||||
u~u
|
||||
u.u
|
||||
:^
|
||||
:3
|
||||
x3
|
||||
0w0
|
||||
u-u
|
||||
:P
|
||||
>.<
|
||||
>-<
|
||||
owo
|
||||
U.U
|
||||
:]
|
||||
^-^
|
||||
>:3
|
||||
:0
|
||||
:O
|
||||
0~0
|
||||
o^o
|
||||
O^O
|
||||
@~@
|
||||
@.@
|
||||
o~o
|
||||
T^T
|
||||
>~<
|
||||
>.0
|
||||
o.o
|
||||
>^<
|
||||
0.0
|
||||
0-0
|
||||
-w-
|
||||
-.-
|
||||
T-T
|
||||
T.T
|
||||
T~T
|
||||
:<
|
||||
u^u
|
||||
```
|
||||
|
||||
Note that the emojis are escaped because of the XML tags (e.g. ">.<" is outputted by the model as "&gt;.&lt;"). If the model does not adhere to the list of emojis, please let us know in the community tab.
|
||||
|
||||
## Datasets
|
||||
|
||||
1. **[ConvLab/dailydialog](https://huggingface.co/datasets/ConvLab/dailydialog)** *4.3k chats*
|
||||
Only the conversations from the "Relationship" domain have been used.
|
||||
- **Private NLP processing**
|
||||
NLP processing has been applied to the text to modify the dataset to be sillier.
|
||||
Reference in New Issue
Block a user