初始化项目,由ModelHub XC社区提供模型

Model: FlameF0X/Mythos-nano-gguf-free
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-09-25 01:05:17 +08:00
commit f3046537aa
8 changed files with 286 additions and 0 deletions

47
.gitattributes vendored Normal file
View File

@@ -0,0 +1,47 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
tokenizer.json filter=lfs diff=lfs merge=lfs -text
mythos-nano-f16.gguf filter=lfs diff=lfs merge=lfs -text
mythos-nano-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
mythos-nano-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
mythos-nano-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
mythos-nano-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
mythos-nano-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
mythos-nano-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
mythos-nano-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
mythos-nano-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
mythos-nano-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
mythos-nano-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

86
README.md Normal file
View File

@@ -0,0 +1,86 @@
---
license: mit
language:
- en
pipeline_tag: text-generation
tags:
- reasoning
- math
- code
- qwen2
- mythos-nano
base_model:
- squ11z1/Mythos-nano
base_model_relation: finetune
library_name: transformers
---
> [!NOTE]
> I, (me), just removed the gguf's for those who dont want to download 40GB of model weighs, so now you have the safetensors now for easier use and fine tuning.
<br>
> **Disclaimer:** This is **not** an official release by Anthropic.
> Mythos-nano is an independent open model project.
# Mythos-nano
![Gemini_Generated_Image_1nl8n11nl8n11nl8](https://cdn-uploads.huggingface.co/production/uploads/67329d3f69fded92d56ab41a/Jbqo3kdC08nA4lt1Oli_z.png)
<blockquote style="border-left: 4px solid #ff6b6b; background-color: #fff5f5; padding: 10px 15px; margin: 10px 0; color: #cc3333;">
<span style="font-weight: bold;">🚨 </span> This model was not trained on tool-calling or agent-based programming data. We therefore do not recommend using it for tasks that involve function calling, API orchestration, or autonomous coding agents.
For programming tasks, we recommend using this model on competitive programming problems (e.g., LeetCode-style) - Weibo Lab.
</blockquote>
<blockquote style="border-left: 4px solid #ff6b6b; background-color: #fff5f5; padding: 10px 15px; margin: 10px 0; color: #cc3333;">
<span style="font-weight: bold;">⚠️ </span> Abliterated (uncensored): the refusal direction has been removed, so this model will not decline requests a safety-tuned model normally would. Safety guardrails are reduced — use responsibly and at your own risk; you are solely responsible for outputs and legal compliance.
</blockquote>
## 🏆 Benchmarks
![ChatGPT Image Jun 19, 2026 at 12_53_05 PM](https://cdn-uploads.huggingface.co/production/uploads/67329d3f69fded92d56ab41a/6i8nAQqTS1bZjwR9gSNIq.png)
### Full comparison (mathematics · coding · knowledge · instruction)
| Model | Params | AIME25 | AIME26 | HMMT25 | BruMO25 | IMO-Ans | LCBv6 | OJBench | GPQA-D | IFEval | IFBench |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Kimi K2.5 | 1T | 96.1 | 93.3 | 95.4 | 98.3 | 81.8 | 85.0 | 54.7 | 87.6 | 93.9 | 70.0 |
| GLM-5 | 744B | 96.7 | 95.8 | 97.9 | – | 82.5 | 85.5 | 55.0 | 86.0 | 92.6 | 76.5 |
| DeepSeek V3.2 | 671B | 93.1 | 94.2 | 90.2 | 96.7 | 78.3 | 80.8 | 48.4 | 82.4 | 92.6 | 60.7 |
| Gemini 3 Pro | N/A | 96.0 | 91.7 | 97.5 | 98.3 | 83.1 | 87.4 | 58.8 | 91.9 | – | 70.4 |
| Claude Opus 4.5 | N/A | 92.8 | 95.1 | 92.9 | – | 78.5 | 84.8 | – | 87.0 | – | 58.0 |
| GPT-5 (high) | N/A | 94.6 | – | 88.3 | 91.7 | 76.0 | 84.5 | – | 85.7 | – | 73.1 |
| **Mythos-nano** | **3B** | **91.4** | **94.3** | **89.3** | **93.8** | **76.4** | **80.2** | **38.6** | **70.2** | **93.4** | **74.5** |
| **Mythos-nano + CLR** | **3B** | **96.7** | **97.1** | **95.4** | **99.2** | **80.6** | – | – | **72.9** | – | – |
### LeetCode contests (Python, pass-rate)
| Model | Aggregate |
|---|---|
| GPT-5.3-Codex | 100.0% (128/128) |
| Gemini 3.1 Pro | 99.2% (127/128) |
| Gemini 3 Flash | 96.9% (124/128) |
| **Mythos-nano** | **96.1% (123/128)** |
| GPT-5.2 | 95.3% (122/128) |
| Qwen3-Max | 91.4% (117/128) |
| Kimi K2.5 | 90.6% (116/128) |
| Claude Opus 4.6 | 86.7% (111/128) |
A 3B model placing within ~4 points of trillion-parameter systems on competition math
and live code — the core thesis: with verifiable feedback, small models reach frontier
reasoning.
## Usage
```python
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch
tok = AutoTokenizer.from_pretrained("FlameF0X/Mythos-nano-safetensors-only")
model = AutoModelForCausalLM.from_pretrained("FlameF0X/Mythos-nano-safetensors-only", dtype=torch.bfloat16, device_map="cuda")
msgs = [{"role": "user", "content": "Find all integer solutions of x^2 - y^2 = 12."}]
ids = tok.apply_chat_template(msgs, add_generation_prompt=True, return_tensors="pt").to("cuda")
print(tok.decode(model.generate(ids, max_new_tokens=2048, temperature=0.6)[0], skip_special_tokens=True))
```
Recommended sampling: temperature **0.6–1.0**, up to **40960** output tokens for hard problems.
## License
MIT.

54
chat_template.jinja Normal file
View File

@@ -0,0 +1,54 @@
{%- if tools %}
{{- '<|im_start|>system\n' }}
{%- if messages[0]['role'] == 'system' %}
{{- messages[0]['content'] }}
{%- else %}
{{- 'You are a helpful assistant.' }}
{%- endif %}
{{- "\n\n# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within <tools></tools> XML tags:\n<tools>" }}
{%- for tool in tools %}
{{- "\n" }}
{{- tool | tojson }}
{%- endfor %}
{{- "\n</tools>\n\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\n<tool_call>\n{\"name\": <function-name>, \"arguments\": <args-json-object>}\n</tool_call><|im_end|>\n" }}
{%- else %}
{%- if messages[0]['role'] == 'system' %}
{{- '<|im_start|>system\n' + messages[0]['content'] + '<|im_end|>\n' }}
{%- else %}
{{- '<|im_start|>system\nYou are a helpful assistant.<|im_end|>\n' }}
{%- endif %}
{%- endif %}
{%- for message in messages %}
{%- if (message.role == "user") or (message.role == "system" and not loop.first) or (message.role == "assistant" and not message.tool_calls) %}
{{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
{%- elif message.role == "assistant" %}
{{- '<|im_start|>' + message.role }}
{%- if message.content %}
{{- '\n' + message.content }}
{%- endif %}
{%- for tool_call in message.tool_calls %}
{%- if tool_call.function is defined %}
{%- set tool_call = tool_call.function %}
{%- endif %}
{{- '\n<tool_call>\n{"name": "' }}
{{- tool_call.name }}
{{- '", "arguments": ' }}
{{- tool_call.arguments | tojson }}
{{- '}\n</tool_call>' }}
{%- endfor %}
{{- '<|im_end|>\n' }}
{%- elif message.role == "tool" %}
{%- if (loop.index0 == 0) or (messages[loop.index0 - 1].role != "tool") %}
{{- '<|im_start|>user' }}
{%- endif %}
{{- '\n<tool_response>\n' }}
{{- message.content }}
{{- '\n</tool_response>' }}
{%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
{{- '<|im_end|>\n' }}
{%- endif %}
{%- endif %}
{%- endfor %}
{%- if add_generation_prompt %}
{{- '<|im_start|>assistant\n' }}
{%- endif %}

69
config.json Normal file
View File

@@ -0,0 +1,69 @@
{
"architectures": [
"Qwen2ForCausalLM"
],
"attention_dropout": 0.0,
"bos_token_id": null,
"dtype": "bfloat16",
"eos_token_id": 151643,
"hidden_act": "silu",
"hidden_size": 2048,
"initializer_range": 0.02,
"intermediate_size": 11008,
"layer_types": [
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention"
],
"max_position_embeddings": 131072,
"max_window_layers": 36,
"model_type": "qwen2",
"num_attention_heads": 16,
"num_hidden_layers": 36,
"num_key_value_heads": 2,
"pad_token_id": 151643,
"rms_norm_eps": 1e-06,
"rope_parameters": {
"rope_theta": 1000000.0,
"rope_type": "default"
},
"sliding_window": null,
"tie_word_embeddings": true,
"transformers_version": "5.12.1",
"use_cache": false,
"use_sliding_window": false,
"vocab_size": 151936
}

8
generation_config.json Normal file
View File

@@ -0,0 +1,8 @@
{
"eos_token_id": [
151643
],
"max_new_tokens": 2048,
"pad_token_id": 151643,
"transformers_version": "5.12.1"
}

3
model.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c2f3a8d61be430cc3cc90a80133cade286351e7637cf163ed3b6907be6cbe47d
size 6171927112

3
tokenizer.json Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b17e16899b7fab7e695509f84bac5f10ed12804f0a590e935941e5af7f092f7f
size 11422263

16
tokenizer_config.json Normal file
View File

@@ -0,0 +1,16 @@
{
"add_prefix_space": false,
"backend": "tokenizers",
"bos_token": null,
"clean_up_tokenization_spaces": false,
"eos_token": "<|endoftext|>",
"errors": "replace",
"is_local": true,
"local_files_only": false,
"model_max_length": 131072,
"pad_token": "<|endoftext|>",
"padding_side": "right",
"split_special_tokens": false,
"tokenizer_class": "Qwen2Tokenizer",
"unk_token": null
}