squ11z1/Mythos-nano
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: squ11z1/Mythos-nano
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-10 20:49:00 +08:00
commit a6d9ccde36
19 changed files with 322 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

47
.gitattributes vendored Normal file
View File

@@ -0,0 +1,47 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
tokenizer.json filter=lfs diff=lfs merge=lfs -text
mythos-nano-f16.gguf filter=lfs diff=lfs merge=lfs -text
mythos-nano-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
mythos-nano-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
mythos-nano-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
mythos-nano-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
mythos-nano-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
mythos-nano-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
mythos-nano-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
mythos-nano-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
mythos-nano-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
mythos-nano-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

89
README.md Normal file
View File

@@ -0,0 +1,89 @@
---
license: mit
language:
- en
pipeline_tag: text-generation
tags:
- reasoning
- math
- code
- qwen2
- mythos-nano
base_model:
- WeiboAI/VibeThinker-3B
base_model_relation: finetune
---
> Mythos-nano tool-calling is coming, but check out Merlin-Agent!
https://huggingface.co/Merlin-Research/Merlin-Agent
![Gemini_Generated_Image_jna8spjna8spjna8](https://cdn-uploads.huggingface.co/production/uploads/67329d3f69fded92d56ab41a/5CeYH1uT1Jkmx7LoBtoQF.png)
</a>
> **Disclaimer:** This is **not** an official release by Anthropic.
> Mythos-nano is an independent open model project.
# Mythos-nano
![Gemini_Generated_Image_1nl8n11nl8n11nl8](https://cdn-uploads.huggingface.co/production/uploads/67329d3f69fded92d56ab41a/Jbqo3kdC08nA4lt1Oli_z.png)
<blockquote style="border-left: 4px solid #ff6b6b; background-color: #fff5f5; padding: 10px 15px; margin: 10px 0; color: #cc3333;">
<span style="font-weight: bold;">🚨 </span> This model was not trained on tool-calling or agent-based programming data. We therefore do not recommend using it for tasks that involve function calling, API orchestration, or autonomous coding agents.
For programming tasks, we recommend using this model on competitive programming problems (e.g., LeetCode-style) - Weibo Lab.
</blockquote>
<blockquote style="border-left: 4px solid #ff6b6b; background-color: #fff5f5; padding: 10px 15px; margin: 10px 0; color: #cc3333;">
<span style="font-weight: bold;">⚠️ </span> Abliterated (uncensored): the refusal direction has been removed, so this model will not decline requests a safety-tuned model normally would. Safety guardrails are reduced — use responsibly and at your own risk; you are solely responsible for outputs and legal compliance.
</blockquote>
## 🏆 Benchmarks
![ChatGPT Image Jun 19, 2026 at 12_53_05 PM](https://cdn-uploads.huggingface.co/production/uploads/67329d3f69fded92d56ab41a/6i8nAQqTS1bZjwR9gSNIq.png)
### Full comparison (mathematics · coding · knowledge · instruction)
| Model | Params | AIME25 | AIME26 | HMMT25 | BruMO25 | IMO-Ans | LCBv6 | OJBench | GPQA-D | IFEval | IFBench |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Kimi K2.5 | 1T | 96.1 | 93.3 | 95.4 | 98.3 | 81.8 | 85.0 | 54.7 | 87.6 | 93.9 | 70.0 |
| GLM-5 | 744B | 96.7 | 95.8 | 97.9 | – | 82.5 | 85.5 | 55.0 | 86.0 | 92.6 | 76.5 |
| DeepSeek V3.2 | 671B | 93.1 | 94.2 | 90.2 | 96.7 | 78.3 | 80.8 | 48.4 | 82.4 | 92.6 | 60.7 |
| Gemini 3 Pro | N/A | 96.0 | 91.7 | 97.5 | 98.3 | 83.1 | 87.4 | 58.8 | 91.9 | – | 70.4 |
| Claude Opus 4.5 | N/A | 92.8 | 95.1 | 92.9 | – | 78.5 | 84.8 | – | 87.0 | – | 58.0 |
| GPT-5 (high) | N/A | 94.6 | – | 88.3 | 91.7 | 76.0 | 84.5 | – | 85.7 | – | 73.1 |
| **Mythos-nano** | **3B** | **91.4** | **94.3** | **89.3** | **93.8** | **76.4** | **80.2** | **38.6** | **70.2** | **93.4** | **74.5** |
| **Mythos-nano + CLR** | **3B** | **96.7** | **97.1** | **95.4** | **99.2** | **80.6** | – | – | **72.9** | – | – |
### LeetCode contests (Python, pass-rate)
| Model | Aggregate |
|---|---|
| GPT-5.3-Codex | 100.0% (128/128) |
| Gemini 3.1 Pro | 99.2% (127/128) |
| Gemini 3 Flash | 96.9% (124/128) |
| **Mythos-nano** | **96.1% (123/128)** |
| GPT-5.2 | 95.3% (122/128) |
| Qwen3-Max | 91.4% (117/128) |
| Kimi K2.5 | 90.6% (116/128) |
| Claude Opus 4.6 | 86.7% (111/128) |
A 3B model placing within ~4 points of trillion-parameter systems on competition math
and live code — the core thesis: with verifiable feedback, small models reach frontier
reasoning.
## Usage
```python
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch
tok = AutoTokenizer.from_pretrained("squ11z1/Mythos-nano")
model = AutoModelForCausalLM.from_pretrained("squ11z1/Mythos-nano", dtype=torch.bfloat16, device_map="cuda")
msgs = [{"role": "user", "content": "Find all integer solutions of x^2 - y^2 = 12."}]
ids = tok.apply_chat_template(msgs, add_generation_prompt=True, return_tensors="pt").to("cuda")
print(tok.decode(model.generate(ids, max_new_tokens=2048, temperature=0.6)[0], skip_special_tokens=True))
```
Recommended sampling: temperature **0.6–1.0**, up to **40960** output tokens for hard problems.
## GGUF
`mythos-nano-f16.gguf` and `mythos-nano-Q4_K_M.gguf` are provided for llama.cpp / Ollama.
## License
MIT.

54
chat_template.jinja Normal file
View File

@@ -0,0 +1,54 @@
{%- if tools %}
{{- '<|im_start|>system\n' }}
{%- if messages[0]['role'] == 'system' %}
{{- messages[0]['content'] }}
{%- else %}
{{- 'You are a helpful assistant.' }}
{%- endif %}
{{- "\n\n# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within <tools></tools> XML tags:\n<tools>" }}
{%- for tool in tools %}
{{- "\n" }}
{{- tool | tojson }}
{%- endfor %}
{{- "\n</tools>\n\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\n<tool_call>\n{\"name\": <function-name>, \"arguments\": <args-json-object>}\n</tool_call><|im_end|>\n" }}
{%- else %}
{%- if messages[0]['role'] == 'system' %}
{{- '<|im_start|>system\n' + messages[0]['content'] + '<|im_end|>\n' }}
{%- else %}
{{- '<|im_start|>system\nYou are a helpful assistant.<|im_end|>\n' }}
{%- endif %}
{%- endif %}
{%- for message in messages %}
{%- if (message.role == "user") or (message.role == "system" and not loop.first) or (message.role == "assistant" and not message.tool_calls) %}
{{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
{%- elif message.role == "assistant" %}
{{- '<|im_start|>' + message.role }}
{%- if message.content %}
{{- '\n' + message.content }}
{%- endif %}
{%- for tool_call in message.tool_calls %}
{%- if tool_call.function is defined %}
{%- set tool_call = tool_call.function %}
{%- endif %}
{{- '\n<tool_call>\n{"name": "' }}
{{- tool_call.name }}
{{- '", "arguments": ' }}
{{- tool_call.arguments | tojson }}
{{- '}\n</tool_call>' }}
{%- endfor %}
{{- '<|im_end|>\n' }}
{%- elif message.role == "tool" %}
{%- if (loop.index0 == 0) or (messages[loop.index0 - 1].role != "tool") %}
{{- '<|im_start|>user' }}
{%- endif %}
{{- '\n<tool_response>\n' }}
{{- message.content }}
{{- '\n</tool_response>' }}
{%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
{{- '<|im_end|>\n' }}
{%- endif %}
{%- endif %}
{%- endfor %}
{%- if add_generation_prompt %}
{{- '<|im_start|>assistant\n' }}
{%- endif %}

69
config.json Normal file
View File

@@ -0,0 +1,69 @@
{
"architectures": [
"Qwen2ForCausalLM"
],
"attention_dropout": 0.0,
"bos_token_id": null,
"dtype": "bfloat16",
"eos_token_id": 151643,
"hidden_act": "silu",
"hidden_size": 2048,
"initializer_range": 0.02,
"intermediate_size": 11008,
"layer_types": [
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention"
],
"max_position_embeddings": 131072,
"max_window_layers": 36,
"model_type": "qwen2",
"num_attention_heads": 16,
"num_hidden_layers": 36,
"num_key_value_heads": 2,
"pad_token_id": 151643,
"rms_norm_eps": 1e-06,
"rope_parameters": {
"rope_theta": 1000000.0,
"rope_type": "default"
},
"sliding_window": null,
"tie_word_embeddings": true,
"transformers_version": "5.12.1",
"use_cache": false,
"use_sliding_window": false,
"vocab_size": 151936
}

8
generation_config.json Normal file
View File

@@ -0,0 +1,8 @@
{
"eos_token_id": [
151643
],
"max_new_tokens": 2048,
"pad_token_id": 151643,
"transformers_version": "5.12.1"
}

3
model.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c2f3a8d61be430cc3cc90a80133cade286351e7637cf163ed3b6907be6cbe47d
size 6171927112

3
mythos-nano-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b750802883cfbcaf1a82b2e39c6f81aa2e8cc8e09aaf1c85a7073e75ae12f3d8
size 1274755168

3
mythos-nano-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:568d1de65a82d7fec7716b2e3d8e9c2600bd9acb07796e0769ed24f4f839da39
size 1707391072

3
mythos-nano-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fef8eb36c45e462f6177f25e9ae1012825f59b22dcc090fd1c98a36529021aaf
size 1590474848

3
mythos-nano-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7c8152b6ca5d82f36e4127e13d316d33136737bbf5fe7468007a21063bfe0936
size 1454356576

3
mythos-nano-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8eefaab7ef34b2e8ab046f65905cbf4d11fc6f8533df99d839a0734467b9b188
size 1929902176

3
mythos-nano-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1ebf8e3927309940115d18c3f258b85766ab2351882289bef3c78abe496704ab
size 1834383456

3
mythos-nano-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:905c57b9fd8a00c8b9dc8c3a280fae8aadb55364f11996957e8f09b492985504
size 2224814176

3
mythos-nano-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a53de1ac575cf87c7d0db45167e85df7b2864dd6d6afeb7f9158c9848213aaf0
size 2169665632

3
mythos-nano-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bea5fdad7cac53c757ea3b5e208844afbb64d9053e6be4ebbaeb4e96f1022cfe
size 2538158176

3
mythos-nano-Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9bd869ae78d94b13b8b0784b222adebf826e09ffc1081724fff7fabe9c2775f2
size 3285475424

3
mythos-nano-f16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a9393de1b6d2b409c8f1094f7f3bcb93b82dd7b2c1eab5b44c0d594fe7e63f56
size 6178316384

3
tokenizer.json Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b17e16899b7fab7e695509f84bac5f10ed12804f0a590e935941e5af7f092f7f
size 11422263

16
tokenizer_config.json Normal file
View File

@@ -0,0 +1,16 @@
{
"add_prefix_space": false,
"backend": "tokenizers",
"bos_token": null,
"clean_up_tokenization_spaces": false,
"eos_token": "<|endoftext|>",
"errors": "replace",
"is_local": true,
"local_files_only": false,
"model_max_length": 131072,
"pad_token": "<|endoftext|>",
"padding_side": "right",
"split_special_tokens": false,
"tokenizer_class": "Qwen2Tokenizer",
"unk_token": null
}