Mythos-nano-GGUF/README.md

license, base_model, base_model_relation, pipeline_tag, tags

license	base_model	base_model_relation	pipeline_tag	tags
mit	squ11z1/Mythos-nano	quantized	text-generation	gguf reasoning math code qwen2 mythos-nano

Mythos-nano — GGUF

GGUF quantizations of squ11z1/Mythos-nano (3B reasoning model, Qwen2-class) for llama.cpp / Ollama / LM Studio.

⚠️ Abliterated (uncensored): the refusal direction has been removed — this model will not decline requests a safety-tuned model normally would. Use responsibly, at your own risk. 🚨 Not trained for tool-calling / agentic coding — best on competition-style math & code.

Quants

File	Quant	Size	Notes
mythos-nano-Q2_K.gguf	Q2_K	1.27 GB	smallest, lowest quality
mythos-nano-Q3_K_S.gguf	Q3_K_S	1.45 GB
mythos-nano-Q3_K_M.gguf	Q3_K_M	1.59 GB
mythos-nano-Q3_K_L.gguf	Q3_K_L	1.71 GB
mythos-nano-Q4_K_S.gguf	Q4_K_S	1.83 GB
mythos-nano-Q4_K_M.gguf	Q4_K_M	1.93 GB	recommended balance
mythos-nano-Q5_K_S.gguf	Q5_K_S	2.17 GB
mythos-nano-Q5_K_M.gguf	Q5_K_M	2.22 GB	high quality
mythos-nano-Q6_K.gguf	Q6_K	2.54 GB	near-lossless
mythos-nano-Q8_0.gguf	Q8_0	3.29 GB	~lossless
mythos-nano-f16.gguf	F16	6.18 GB	full precision

Usage

# llama.cpp
llama-cli -hf squ11z1/Mythos-nano-GGUF:Q4_K_M -p "Find all integer solutions of x^2 - y^2 = 12."
# Ollama
ollama run hf.co/squ11z1/Mythos-nano-GGUF:Q4_K_M

Recommended sampling: temperature 0.6–1.0. This is a reasoning model — expect long chain-of-thought before the final answer.

License

MIT.