62 lines
1.8 KiB
Markdown
62 lines
1.8 KiB
Markdown
---
|
|
license: apache-2.0
|
|
language:
|
|
- en
|
|
base_model: Shinzmann/naija-petro-8b
|
|
pipeline_tag: text-generation
|
|
tags:
|
|
- petroleum-engineering
|
|
- oil-and-gas
|
|
- nigeria
|
|
- qwen3
|
|
- gguf
|
|
- llama-cpp
|
|
- ollama
|
|
- quantized
|
|
---
|
|
|
|
# Naija-Petro 8B — GGUF
|
|
|
|
GGUF quantizations of [`Shinzmann/naija-petro-8b`](https://huggingface.co/Shinzmann/naija-petro-8b) for CPU/edge inference with [llama.cpp](https://github.com/ggerganov/llama.cpp), [Ollama](https://ollama.com), LM Studio, and compatible runtimes.
|
|
|
|
See the full [model card](https://huggingface.co/Shinzmann/naija-petro-8b) for training details, intended use, and limitations. For Nigeria-specific accuracy, use these weights with the [Naija-Petro RAG system](https://github.com/Mystique1337/naija-petro).
|
|
|
|
## Available quantizations
|
|
|
|
| File suffix | Method | Notes |
|
|
|---|---|---|
|
|
| `Q4_K_M` | 4-bit (k-quant, medium) | Best size/quality trade-off — recommended default |
|
|
| `Q8_0` | 8-bit | Near-lossless; larger and slower |
|
|
|
|
## Usage
|
|
|
|
**Ollama**
|
|
```bash
|
|
ollama run hf.co/Shinzmann/naija-petro-8b-GGUF:Q4_K_M
|
|
```
|
|
|
|
**llama.cpp**
|
|
```bash
|
|
# download a specific quant, then:
|
|
./llama-cli -hf Shinzmann/naija-petro-8b-GGUF:Q4_K_M \
|
|
-p "Explain the material balance equation for an undersaturated reservoir." \
|
|
-c 4096
|
|
```
|
|
|
|
**Python (llama-cpp-python)**
|
|
```python
|
|
from llama_cpp import Llama
|
|
llm = Llama.from_pretrained(
|
|
repo_id="Shinzmann/naija-petro-8b-GGUF",
|
|
filename="*Q4_K_M.gguf",
|
|
n_ctx=4096,
|
|
)
|
|
print(llm.create_chat_completion(messages=[
|
|
{"role": "system", "content": "You are Naija-Petro, an expert petroleum-engineering AI assistant."},
|
|
{"role": "user", "content": "How do you interpret a Horner plot?"},
|
|
])["choices"][0]["message"]["content"])
|
|
```
|
|
|
|
## License
|
|
Apache-2.0 (inherited from Qwen3-8B). Validate outputs with qualified engineers before operational use.
|