69 lines
1.6 KiB
Markdown
69 lines
1.6 KiB
Markdown
|
---
|
||
|
|
license: apache-2.0
|
||
|
|
library_name: gguf
|
||
|
|
base_model: fableforge-ai/ShellWhisperer-1.5B
|
||
|
|
base_model_relation: quantized
|
||
|
|
tags:
|
||
|
|
- gguf
|
||
|
|
- fableforge
|
||
|
|
- shellwhisperer
|
||
|
|
- 1.5b
|
||
|
|
- llama.cpp
|
||
|
|
- lm-studio
|
||
|
|
- ollama
|
||
|
|
- text-generation
|
||
|
|
- uncensored
|
||
|
|
- agent
|
||
|
|
- tool-use
|
||
|
|
- en
|
||
|
|
pipeline_tag: text-generation
|
||
|
|
---
|
||
|
|
|
||
|
|
# ShellWhisperer-1.5B-GGUF
|
||
|
|
|
||
|
|
GGUF quantizations of [fableforge-ai/ShellWhisperer-1.5B](https://huggingface.co/fableforge-ai/ShellWhisperer-1.5B), a 1.5B parameter instruction-tuned model optimized for shell command generation, agentic tool use, and uncensored reasoning.
|
||
|
|
|
||
|
|
## Available Quants
|
||
|
|
|
||
|
|
| Quant | File |
|
||
|
|
|---|---|
|
||
|
|
| F16 | `shellwhisperer-1.5b-f16.gguf` |
|
||
|
|
| Q8_0 | `shellwhisperer-1.5b-Q8_0.gguf` |
|
||
|
|
| Q6_K | `shellwhisperer-1.5b-Q6_K.gguf` |
|
||
|
|
| Q5_K_M | `shellwhisperer-1.5b-Q5_K_M.gguf` |
|
||
|
|
| Q4_K_M | `shellwhisperer-1.5b-Q4_K_M.gguf` |
|
||
|
|
| Q4_0 | `shellwhisperer-1.5b-Q4_0.gguf` |
|
||
|
|
| Q3_K_M | `shellwhisperer-1.5b-Q3_K_M.gguf` |
|
||
|
|
| Q2_K | `shellwhisperer-1.5b-Q2_K.gguf` |
|
||
|
|
| IQ4_XS | `shellwhisperer-1.5b-IQ4_XS.gguf` |
|
||
|
|
| IQ3_XXS | `shellwhisperer-1.5b-IQ3_XXS.gguf` |
|
||
|
|
| IQ2_XXS | `shellwhisperer-1.5b-IQ2_XXS.gguf` |
|
||
|
|
| IQ1_S | `shellwhisperer-1.5b-IQ1_S.gguf` |
|
||
|
|
|
||
|
|
## Usage
|
||
|
|
|
||
|
|
### llama.cpp
|
||
|
|
|
||
|
|
```bash
|
||
|
|
git clone https://github.com/ggerganov/llama.cpp
|
||
|
|
cd llama.cpp
|
||
|
|
make -j
|
||
|
|
./main -m shellwhisperer-1.5b-Q4_K_M.gguf -p "Generate a bash script to..." -n 512
|
||
|
|
```
|
||
|
|
|
||
|
|
### Ollama
|
||
|
|
|
||
|
|
```bash
|
||
|
|
ollama run hf.co/fableforge-ai/ShellWhisperer-1.5B-GGUF:Q4_K_M
|
||
|
|
```
|
||
|
|
|
||
|
|
### LM Studio
|
||
|
|
|
||
|
|
Search for "ShellWhisperer" in the LM Studio search panel.
|
||
|
|
|
||
|
|
---
|
||
|
|
|
||
|
|
## 🔗 Related models
|
||
|
|
|
||
|
|
- 🧠 Base model (safetensors): [`ShellWhisperer-1.5B`](https://huggingface.co/fableforge-ai/ShellWhisperer-1.5B)
|