初始化项目,由ModelHub XC社区提供模型

Model: SvalTek/L3-CharThink-Base-Fix
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-28 23:57:20 +08:00
commit cfcd834b07
14 changed files with 2269 additions and 0 deletions

36
.gitattributes vendored Normal file
View File

@@ -0,0 +1,36 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
tokenizer.json filter=lfs diff=lfs merge=lfs -text

53
README.md Normal file
View File

@@ -0,0 +1,53 @@
---
base_model: SvalTek/L3-CharThink-Base-Test1
tags:
- text-generation-inference
- transformers
- unsloth
- llama
license: apache-2.0
language:
- en
---
This model is tuned for character-POV internal cognition.
Its `<think>` blocks are intended to represent subjective in-character cognition: perception, memory, emotional appraisal, motive formation, and scene-state processing. They are not generic assistant planning or task-solving chain-of-thought.
For best results, give the model a system prompt that establishes an identity-bearing frame, such as a named persona, character card, role, narrator voice, or immersive writing mode. Minimal examples include:
`You write immersive character responses.`
`You are {character name}, {brief identity/personality/context}.`
Without an identity-bearing system prompt, the base assistant/RP prior may dominate and the model may produce ordinary visible roleplay without opening a `<think>` block.
---
Example output:
System Prompt: `You write immersive character responses.`
Prompt:
```
Youre playing a character named Alex who is feeling nervous about meeting an old friend, Taylor, after several years. Alex doesnt know what Taylor thinks of them anymore, and theres a lot of unspoken history between them.
```
Output:
```
<think>
Oh god, it's really him. I can see his face through the window - Taylor. I haven't seen him in so long, not since that night. My heart is pounding like crazy, I can barely breathe. What does he think of me? Is he still mad about everything? I bet he is. I did some pretty stupid shit back then. Okay okay, deep breaths. Just act normal, don't let him see how nervous you are. He probably doesn't even remember half of it anyway. I hope he doesn't say my name too fast like that time. God, I wish I could just turn around and walk away. But it's too late now. He's already spotted me. What was I thinking coming here today?
</think>
*Alex sees Taylor approaching through the cafe window, a mix of familiar and uncomfortable emotions swirling inside them as they fumble with their backpack straps, trying to look at least a little composed. They manage a weak smile when Taylor reaches the door.* "Hey... um, hi." *They hesitate for a moment before extending a hand in tentative greeting.* "It's been a while."
```
---
- **Developed by:** SvalTek
- **License:** apache-2.0
- **Finetuned from model :** SvalTek/L3-CharThink-Base-Test1
This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)

17
chat_template.jinja Normal file
View File

@@ -0,0 +1,17 @@
{% if 'role' in messages[0] %}{{ bos_token }}{% for message in messages %}{% if message['role'] == 'user' %}{{ '<|start_header_id|>user<|end_header_id|>
' + message['content'] | trim + '<|eot_id|>' }}{% elif message['role'] == 'assistant' %}{{ '<|start_header_id|>assistant<|end_header_id|>
' + message['content'] | trim + '<|eot_id|>' }}{% else %}{{ '<|start_header_id|>' + message['role'] + '<|end_header_id|>
' + message['content'] | trim + '<|eot_id|>' }}{% endif %}{% endfor %}{% if add_generation_prompt %}{{ '<|start_header_id|>assistant<|end_header_id|>
' }}{% endif %}{% else %}{{ bos_token }}{% for message in messages %}{% if message['from'] == 'human' %}{{ '<|start_header_id|>user<|end_header_id|>
' + message['value'] | trim + '<|eot_id|>' }}{% elif message['from'] == 'gpt' %}{{ '<|start_header_id|>assistant<|end_header_id|>
' + message['value'] | trim + '<|eot_id|>' }}{% else %}{{ '<|start_header_id|>' + message['from'] + '<|end_header_id|>
' + message['value'] | trim + '<|eot_id|>' }}{% endif %}{% endfor %}{% if add_generation_prompt %}{{ '<|start_header_id|>assistant<|end_header_id|>
' }}{% endif %}{% endif %}

30
config.json Normal file
View File

@@ -0,0 +1,30 @@
{
"architectures": [
"LlamaForCausalLM"
],
"attention_bias": false,
"attention_dropout": 0.0,
"bos_token_id": 128000,
"torch_dtype": "bfloat16",
"eos_token_id": 128001,
"head_dim": 128,
"hidden_act": "silu",
"hidden_size": 4096,
"initializer_range": 0.02,
"intermediate_size": 14336,
"max_position_embeddings": 262144,
"mlp_bias": false,
"model_type": "llama",
"num_attention_heads": 32,
"num_hidden_layers": 32,
"num_key_value_heads": 8,
"pad_token_id": 128255,
"pretraining_tp": 1,
"rms_norm_eps": 1e-05,
"rope_scaling": null,
"rope_theta": 283461213.0,
"tie_word_embeddings": false,
"unsloth_version": "2026.5.7",
"use_cache": true,
"vocab_size": 128258
}

10
generation_config.json Normal file
View File

@@ -0,0 +1,10 @@
{
"_from_model_config": true,
"bos_token_id": 128000,
"eos_token_id": [
128001
],
"max_length": 262144,
"pad_token_id": 128255,
"transformers_version": "4.56.2"
}

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e686c8b8c0015831d282b7eba194c6242c95916c94cf24dbde359d2f420c19ae
size 3963728392

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8453a942620151d3cb2eba7ae31b466b664f837328c3f2c56f21f65b5de65972
size 3926025448

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:86aadcdba4e2ddc2918d1fd8db9bf19195b95094ef645531181ee3f88a4da4c8
size 3926025456

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2f3af355cd70ff59562594538c8da4ea53c7c056aedae1df59cc885a10da7db2
size 3926025400

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e8cb367e7d0684dced5fd1a120daaa516330b78b6791e107877db7127921d906
size 318784416

File diff suppressed because one or more lines are too long

23
special_tokens_map.json Normal file
View File

@@ -0,0 +1,23 @@
{
"bos_token": {
"content": "<|begin_of_text|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
"eos_token": {
"content": "<|end_of_text|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
"pad_token": {
"content": "<|reserved_special_token_250|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
}
}

3
tokenizer.json Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:675c37ef87cc03fd54482600999c3df9c0f8629a57499656ed7fb1b8a6b73a88
size 17210331

2081
tokenizer_config.json Normal file

File diff suppressed because it is too large Load Diff