license, language, library_name, pipeline_tag, tags

license	language	library_name	pipeline_tag	tags
apache-2.0	en	transformers	text-generation	1.5b commands devops fableforge gguf imatrix llama.cpp lm-studio ollama shell sysadmin terminal text-generation uncensored

ShellWhisperer-1.5B

Natural language → precise bash commands. Tiny, fast, uncensored.

Base model: Qwen/Qwen2.5-1.5B-Instruct · Part of the FableForge ecosystem.

---

⚡ Quickest start — Ollama (these pulls credit the source, not a mirror)

ollama run hf.co/fableforge-ai/ShellWhisperer-1.5B:Q4_K_M

🦙 llama.cpp

llama-cli -hf fableforge-ai/ShellWhisperer-1.5B:Q4_K_M -p "Hello!"

💠 LM Studio

Search fableforge-ai/ShellWhisperer-1.5B and pick a quant below.

---

📦 Provided quants (download one file, not the whole repo)

File	Quant	Size	Notes
shellwhisperer-1.5b-f16.gguf	F16	3.09 GB	Full precision (unquantized). Reference / conversion.
shellwhisperer-1.5b-Q8_0.gguf	Q8_0	1.65 GB	Extremely high quality — usually overkill.
shellwhisperer-1.5b-Q6_K.gguf	Q6_K	1.27 GB	Very high quality, near-perfect. Recommended if you have the RAM.
shellwhisperer-1.5b-Q5_K_M.gguf	Q5_K_M	1.13 GB	High quality. Recommended.
shellwhisperer-1.5b-Q4_K_M.gguf	Q4_K_M	0.99 GB	⭐ Best size/quality balance — default pick for most users.
shellwhisperer-1.5b-IQ4_XS.gguf	IQ4_XS	0.90 GB	imatrix — great quality, smaller than Q4_K_S. Recommended for low RAM.
shellwhisperer-1.5b-Q4_0.gguf	Q4_0	0.93 GB	Legacy format — prefer Q4_K_M.
shellwhisperer-1.5b-Q3_K_M.gguf	Q3_K_M	0.82 GB	Lower quality; usable when RAM is tight.
shellwhisperer-1.5b-IQ3_XXS.gguf	IQ3_XXS	0.67 GB	imatrix very low quality.
shellwhisperer-1.5b-Q2_K.gguf	Q2_K	0.68 GB	Very low quality — surprisingly usable.
shellwhisperer-1.5b-IQ2_XXS.gguf	IQ2_XXS	0.51 GB	Tiny imatrix — last resort.

Not sure? Take Q4_K_M. Low RAM → IQ4_XS. Max quality → Q6_K.

🧠 Prompt format (ChatML)

<|im_start|>system
{system_prompt}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant

🌌 See it live — the FableForge demos

This family powers a galaxy of free, interactive HF Spaces:

• 🧭 FableForge Nexus
• 🍺 Infinite NPC
• 🎭 Dual-GM
• 💻 ShellWhisperer
• 👻 Ghost Writer

Citation

@misc{shellwhisperer1.5b2024,
  title={ShellWhisperer-1.5B: Agent Orchestration via Fine-Tuned Language Models},
  author={FableForge Team},
  year={2024},
  url={https://huggingface.co/fableforge-ai/ShellWhisperer-1.5B}
}

---

⭐ Like & share — it helps people find the source instead of a mirror.