From e24219343c26722cdece3c43cfae58c111ce0096 Mon Sep 17 00:00:00 2001 From: ModelHub XC Date: Mon, 17 Aug 2026 16:47:18 +0800 Subject: [PATCH] =?UTF-8?q?=E5=88=9D=E5=A7=8B=E5=8C=96=E9=A1=B9=E7=9B=AE?= =?UTF-8?q?=EF=BC=8C=E7=94=B1ModelHub=20XC=E7=A4=BE=E5=8C=BA=E6=8F=90?= =?UTF-8?q?=E4=BE=9B=E6=A8=A1=E5=9E=8B?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Model: kth8/gemma-3-270m-it-homeowner-classifier-GGUF Source: Original Platform --- .gitattributes | 36 ++++++ README.md | 115 ++++++++++++++++++ ...a-3-270m-it-homeowner-classifier-bf16.gguf | 3 + 3 files changed, 154 insertions(+) create mode 100644 .gitattributes create mode 100644 README.md create mode 100644 gemma-3-270m-it-homeowner-classifier-bf16.gguf diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..e3a4cba --- /dev/null +++ b/.gitattributes @@ -0,0 +1,36 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +gemma-3-270m-it-homeowner-classifier-bf16.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..6b2c277 --- /dev/null +++ b/README.md @@ -0,0 +1,115 @@ +--- +license: gemma +language: +- en +base_model: kth8/gemma-3-270m-it-homeowner-classifier +datasets: +- kth8/homeowner-classification +pipeline_tag: text-generation +library_name: transformers +tags: +- sft +- trl +- unsloth +- gemma +- gemma3 +- gemma3_text +--- +![logo](https://storage.googleapis.com/gweb-developer-goog-blog-assets/images/gemma-3_2.original.png) +A supervised fine-tune of [unsloth/gemma-3-270m-it](https://huggingface.co/unsloth/gemma-3-270m-it) on the [kth8/homeowner-classification](https://huggingface.co/datasets/kth8/homeowner-classification) dataset. + +Inspired by https://www.teachmecoolstuff.com/viewarticle/fine-tuning-a-local-llm-to-categorize-questions + +Use `temperature=0.0` for optimal results. + +## Usage example + +**System prompt** +``` +Classify the homeowner question into a category from the list below. +The answer must be exactly one category name from the list in JSON format. +Choose the best category based on the meaning of the question. + +Valid categories: +- appliances +- brick work +- car +- cooking +- doorbell +- electric +- fence +- fountain +- garden lights +- gutters +- hvac +- irrigation +- mosquito +- painting +- pool +- tree service +- water heater +- window service +``` +**User prompt** +``` +What is the CYA level supposed to be in the pool water? +``` +**Assistant response** +``` +{"category": "pool"} +``` +## Model Details +- Base Model: `unsloth/gemma-3-270m-it` +- Parameter Count: 268,098,176 +- Precision: torch.bfloat16 + +## Training Settings + +### PEFT +- Rank: 32 +- LoRA alpha: 64 +- Modules: q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj +- Gradient checkpointing: unsloth + +### SFT +- Epoch: 1 +- Batch size: 8 +- Gradient Accumulation steps: 2 +- Learning rate: 0.0002 +- Optimizer: adamw_torch_fused +- Learning rate scheduler: cosine +- Warmup steps: 10 +- Weight decay: 0.01 + +## Training stats +- Date: 2026-06-17T01:06:10.026211 +- GPU: NVIDIA L4 +- Peak VRAM usage: 2.205 GB +- Global step: 126 +- Training runtime (seconds): 334.7612 +- Best validation loss: 0.013801434077322483 + +| Step | Training Loss | Validation Loss | +|------|---------------|-----------------| +| 0 | No log | 2.182445 | +| 12 | 1.131100 | 0.195152 | +| 24 | 0.122900 | 0.082139 | +| 36 | 0.076800 | 0.034620 | +| 48 | 0.075600 | 0.027673 | +| 60 | 0.039300 | 0.031881 | +| 72 | 0.038300 | 0.020789 | +| 84 | 0.031200 | 0.015834 | +| 96 | 0.018400 | 0.013921 | +| 108 | 0.030300 | 0.014498 | +| 120 | 0.023700 | 0.013801 | + +## Framework versions +- Unsloth: 2026.6.7 +- TRL: 0.22.2 +- Transformers: 4.56.2 +- Pytorch: 2.11.0+cu128 +- Datasets: 5.0.0 +- Tokenizers: 0.22.2 + +## License +This model is released under the Gemma license. See the [Gemma Terms of Use](https://ai.google.dev/gemma/terms) and [Prohibited Use Policy](https://policies.google.com/terms/generative-ai/use-policy) regarding the use of Gemma-generated content. \ No newline at end of file diff --git a/gemma-3-270m-it-homeowner-classifier-bf16.gguf b/gemma-3-270m-it-homeowner-classifier-bf16.gguf new file mode 100644 index 0000000..7f1ed34 --- /dev/null +++ b/gemma-3-270m-it-homeowner-classifier-bf16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fd60914e9990481ed3e88def7eedcd63463276c54f3db258c855dd3c7f7dc272 +size 542835712