---
license: other
license_name: nvidia-nemotron-open-model-license
license_link: >-
  https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-nemotron-open-model-license/
tags:
- text-generation
- finetuned
- nemotron
- llama-cpp
- GGUF
language:
- en
base_model: unsloth/NVIDIA-Nemotron-3-Nano-4B-GGUF
datasets:
- build-small-hackathon/1000-Rooms-DS
---

# Fine-tuned Nemotron-3 Nano 4B

This model is a fine-tuned version of **NVIDIA Nemotron-3 Nano 4B**, adapted for improved performance on a custom dataset for generating escape rooms. This fine-tune was realised for the build-small-hackathon using **Unsloth** and using compute credits provided by **Modal**.

---


## Model Details

- **Base model:** https://huggingface.co/nvidia/Nemotron-3-Nano-4B
- **Quantized model:** https://huggingface.co/unsloth/NVIDIA-Nemotron-3-Nano-4B-GGUF
- **Architecture:** Decoder-only Transformer
- **Parameters:** ~4B
- **Fine-tuning method:** LoRA
- **Framework:** Unsloth
- **Training environment:** Modal

---

## Intended Use

This model is intended for:

- Experimental / research use
- Generating room titles and descriptions / generating responses for trying to open doors/containers as json

It has not been optimized for production safety or alignment.

---

## Limitations

- May produce incorrect or hallucinated outputs
- Not guaranteed to follow instructions perfectly
- Sensitive to prompt formatting
- May inherit biases from base model and training data

---

## How to Use

### llama.cpp

```bat
llama-cli.exe -m nemotron-room-lora-q4-k-m.gguf ^
  -n 2048 --temp 0.7 --repeat-penalty 1.1 ^
  --grammar-file json.gbnf ^
  -sys "You are a creative dungeon-master AI that generates escape-room content. Always respond with a single valid JSON object and nothing else." ^
  -p "{\"task\":\"generate_room\"} Respond with room_name, room_story, room_prompt, door_description, door_prompt, door_key_name, door_key_prompt, containers array, and keys array."
```

### Output

```json
{
  "room_name": "The Crystal Lake of the Moon", "room_story": "A lake that reflects the moon so perfectly it seems like a second sky. The water is still and silver.", "room_prompt": "A serene lake under a full moon, reflecting the night sky perfectly, surrounded by misty mountains.", "door_description": "The entrance is carved into an ancient oak tree, with vines curling around the frame.", "door_prompt": "An old oak tree door with green vines and moss growing on the wood grain.", "door_key_name": "The Silver Moon Key", "door_key_prompt": "A small silver key shaped like a crescent moon, glowing softly.", "containers": [{"container_name": "The Hollow Oak Chest", "container_prompt": "An old wooden chest carved with animal faces, sitting on mossy ground."}, {"container_name": "The Stone Lantern", "container_prompt": "A large stone lantern containing a bundle of dried herbs and a small scroll."}, {"container_name": "The Leather Satchel", "container_prompt": "A worn leather satchel filled with various trinkets, including a compass and a coin."}, {"container_name": "The Glass Globe", "container_prompt": "A clear glass globe containing swirling blue and silver dust that catches the moonlight."}], "keys": [{"key_name": "The Rusty Key", "key_prompt": "A tarnished iron key with jagged teeth, rusted to a dull orange."}, {"key_name": "The Gold Coin", "key_prompt": "An ornate gold coin embedded with gemstones, resting on a piece of parchment."}]}
  ```