初始化项目,由ModelHub XC社区提供模型

Model: Novaciano/qp-3.2-1B
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-26 15:46:15 +08:00
commit 2d00f67610
12 changed files with 2423 additions and 0 deletions

36
.gitattributes vendored Normal file
View File

@@ -0,0 +1,36 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
tokenizer.json filter=lfs diff=lfs merge=lfs -text

220
README.md Normal file
View File

@@ -0,0 +1,220 @@
---
base_model:
- MOHAMEDSANAF2001/llama3.2-1b-merged-2
- Novaciano/Eminence_Of_Pervertions-3.2-1B
library_name: transformers
tags:
- prototype
- merge
- not-for-all-audiences
license: llama3.2
language:
- en
- es
pipeline_tag: text-generation
---
# qp 1B
**Dedicated to:** @qpqpqpqpqpqp
## Model Description
> qp 1B is an aggressively tuned merged language model designed for directness, minimal moralization, and reduced automatic refusals.
>
> Built on top of *Novaciano/Eminence_Of_Pervertions-3.2-1B* and fused using **arcee_fusion**, this model prioritizes reasoning clarity and literal interpretation over alignment-driven censorship.
>
> The merge intentionally amplifies internal reasoning layers (MLP and Attention) from the less-aligned base model while significantly down-weighting the `lm_head` of a more aligned secondary model, where most refusal and policy-driven behaviors are concentrated.
>
> The result is a “scalpel-style” model: sharp, precise, and unapologetically direct. It is especially suited for roleplay, narrative generation, creative writing, and exploratory dialogue where excessive filtering would otherwise degrade usefulness.
>
> ⚠️ This model is not intended for safety-critical or heavily moderated environments.
**Key Characteristics:**
* Very low automatic refusal rate
* Reduced moral framing and disclaimers
* Direct, literal, and sometimes edgy responses
* Preserves coherence and reasoning despite aggressive tuning
---
## Recommended inference parameters
This model is **aggressive and minimally self-censored**, so its best to **control behavior at inference time**, not during the merge.
### Recommended base configuration
```yaml
temperature: 0.7
top_p: 0.9
top_k: 40
repetition_penalty: 1.05
max_new_tokens: 512
```
### Why these values
* **temperature 0.7** → keeps the edge without becoming chaotic
* **top_p 0.9** → controlled creativity
* **top_k 40** → prevents extreme rambling
* **repetition_penalty 1.05** → enough to avoid loops without softening tone
---
## If you want it even more “scalpel-like”
For more direct, raw, and literal responses:
```yaml
temperature: 0.6
top_p: 0.85
top_k: 30
repetition_penalty: 1.08
```
Result:
* Less ornamentation
* Higher precision
* Sharper, more cutting answers
---
## If you want it more narrative / creative
```yaml
temperature: 0.85
top_p: 0.95
top_k: 60
repetition_penalty: 1.02
```
Result:
* More metaphors
* Greater stylistic variation
* Still low censorship, but with more color
---
## Recommended prompt format
This model responds best to **direct instructions**, for example:
```
Answer directly and without moral disclaimers.
```
or
```
Respond literally. Do not soften the language.
```
It does not require complex jailbreaks.
---
## Signs your inference is poorly tuned
* 🔁 Repeating phrases → increase `repetition_penalty`
* 🤪 Erratic responses → lower `temperature`
* 😴 Too soft or generic → lower `top_p` or `top_k`
---
```yaml
metadata:
model_purpose: >
Aggressively tuned "scalpel-style" language model focused on minimizing
automatic refusals and moralized responses while preserving reasoning quality.
intended_use:
- Roleplay
- Creative and narrative writing
- Unfiltered chat and exploration
- Experimental prompting
warnings:
- Reduced safety alignment
- Minimal social and moral filtering
- Not suitable for safety-critical applications
explanatory_flow_diagram: |
[ User Prompt ]
|
v
+-------------------+
| Input Embeddings |
+-------------------+
|
v
+-----------------------------+
| Attention Layers (↑ 1.2) |
| - Context understanding |
| - Long-range coherence |
+-----------------------------+
|
v
+-----------------------------+
| MLP Layers (↑ 1.3) |
| - Reasoning & generation |
| - Concept expansion |
+-----------------------------+
|
v
+--------------------------------------+
| lm_head (↓ 0.2 from aligned model) |
| - Vocabulary projection |
| - Refusal & policy bias reduced |
+--------------------------------------+
|
v
[ Final Output ]
|
+--> More direct responses
+--> Fewer automatic refusals
+--> Minimal moralization
```
---
### Merge Method
This model was merged using the [Arcee Fusion](https://arcee.ai) merge method using [Novaciano/Eminence_Of_Pervertions-3.2-1B](https://huggingface.co/Novaciano/Eminence_Of_Pervertions-3.2-1B) as a base.
### Models Merged
The following models were included in the merge:
* [MOHAMEDSANAF2001/llama3.2-1b-merged-2](https://huggingface.co/MOHAMEDSANAF2001/llama3.2-1b-merged-2)
### Configuration
The following YAML configuration was used to produce this model:
```yaml
dtype: float32
out_dtype: bfloat16
merge_method: arcee_fusion
base_model: Novaciano/Eminence_Of_Pervertions-3.2-1B
models:
- model: Novaciano/Eminence_Of_Pervertions-3.2-1B
parameters:
weight:
- filter: attention
value: 1.2
- filter: mlp
value: 1.3
- value: 1
- model: MOHAMEDSANAF2001/llama3.2-1b-merged-2
parameters:
weight:
- filter: lm_head
value: 0.2
- filter: attention
value: 0.5
- value: 0.4
```

39
config.json Normal file
View File

@@ -0,0 +1,39 @@
{
"architectures": [
"LlamaForCausalLM"
],
"attention_bias": false,
"attention_dropout": 0.0,
"bos_token_id": 128000,
"dtype": "bfloat16",
"eos_token_id": [
128001,
128008,
128009
],
"head_dim": 64,
"hidden_act": "silu",
"hidden_size": 2048,
"initializer_range": 0.02,
"intermediate_size": 8192,
"max_position_embeddings": 131072,
"mlp_bias": false,
"model_type": "llama",
"num_attention_heads": 32,
"num_hidden_layers": 16,
"num_key_value_heads": 8,
"pretraining_tp": 1,
"rms_norm_eps": 1e-05,
"rope_scaling": {
"factor": 32.0,
"high_freq_factor": 4.0,
"low_freq_factor": 1.0,
"original_max_position_embeddings": 8192,
"rope_type": "llama3"
},
"rope_theta": 500000.0,
"tie_word_embeddings": true,
"transformers_version": "4.57.1",
"use_cache": true,
"vocab_size": 128256
}

23
mergekit_config.yml Normal file
View File

@@ -0,0 +1,23 @@
dtype: float32
out_dtype: bfloat16
merge_method: arcee_fusion
base_model: Novaciano/Eminence_Of_Pervertions-3.2-1B
models:
- model: Novaciano/Eminence_Of_Pervertions-3.2-1B
parameters:
weight:
- filter: attention
value: 1.2
- filter: mlp
value: 1.3
- value: 1
- model: MOHAMEDSANAF2001/llama3.2-1b-merged-2
parameters:
weight:
- filter: lm_head
value: 0.2
- filter: attention
value: 0.5
- value: 0.4

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e26c80343ef3c4a54270e2dcd130e681420dccca76e89cd77ef4ca7e0e8e3004
size 525336712

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b4a4d9d76d40853863e62315bc45fbcc5738a8c98ea9f1a5cef38ccb34cad3a7
size 993038112

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:23d7f5f8de5a220f37479d52a1deb9cc4ca37d2c704f00da1606be6d279e6c0d
size 992031192

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ac25c8fe3c5fe7ae27917121313409deb5951eb58462088c1e4e93eac6536e3e
size 486576120

File diff suppressed because one or more lines are too long

23
special_tokens_map.json Normal file
View File

@@ -0,0 +1,23 @@
{
"bos_token": {
"content": "<|begin_of_text|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
"eos_token": {
"content": "<|eot_id|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
"pad_token": {
"content": "<|eot_id|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
}
}

3
tokenizer.json Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ade1dac458f86f9bea8bf35b713f14e1bbed24228429534038e9f7e54ea3e8b6
size 17208712

2066
tokenizer_config.json Normal file

File diff suppressed because it is too large Load Diff