license, language, base_model, pipeline_tag, tags
license language base_model pipeline_tag tags
apache-2.0
en
Shinzmann/naija-petro-8b text-generation
petroleum-engineering
oil-and-gas
nigeria
qwen3
gguf
llama-cpp
ollama
quantized

Naija-Petro 8B — GGUF

GGUF quantizations of Shinzmann/naija-petro-8b for CPU/edge inference with llama.cpp, Ollama, LM Studio, and compatible runtimes.

See the full model card for training details, intended use, and limitations. For Nigeria-specific accuracy, use these weights with the Naija-Petro RAG system.

Available quantizations

File suffix Method Notes
Q4_K_M 4-bit (k-quant, medium) Best size/quality trade-off — recommended default
Q8_0 8-bit Near-lossless; larger and slower

Usage

Ollama

ollama run hf.co/Shinzmann/naija-petro-8b-GGUF:Q4_K_M

llama.cpp

# download a specific quant, then:
./llama-cli -hf Shinzmann/naija-petro-8b-GGUF:Q4_K_M \
  -p "Explain the material balance equation for an undersaturated reservoir." \
  -c 4096

Python (llama-cpp-python)

from llama_cpp import Llama
llm = Llama.from_pretrained(
    repo_id="Shinzmann/naija-petro-8b-GGUF",
    filename="*Q4_K_M.gguf",
    n_ctx=4096,
)
print(llm.create_chat_completion(messages=[
    {"role": "system", "content": "You are Naija-Petro, an expert petroleum-engineering AI assistant."},
    {"role": "user", "content": "How do you interpret a Horner plot?"},
])["choices"][0]["message"]["content"])

License

Apache-2.0 (inherited from Qwen3-8B). Validate outputs with qualified engineers before operational use.

Description
Model synced from source: Shinzmann/naija-petro-8b-GGUF
Readme 26 KiB