初始化项目,由ModelHub XC社区提供模型

Model: kth8/gemma-3-270m-it-homeowner-classifier-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-08-17 16:47:18 +08:00
commit e24219343c
3 changed files with 154 additions and 0 deletions

36
.gitattributes vendored Normal file
View File

@@ -0,0 +1,36 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
gemma-3-270m-it-homeowner-classifier-bf16.gguf filter=lfs diff=lfs merge=lfs -text

115
README.md Normal file
View File

@@ -0,0 +1,115 @@
---
license: gemma
language:
- en
base_model: kth8/gemma-3-270m-it-homeowner-classifier
datasets:
- kth8/homeowner-classification
pipeline_tag: text-generation
library_name: transformers
tags:
- sft
- trl
- unsloth
- gemma
- gemma3
- gemma3_text
---
![logo](https://storage.googleapis.com/gweb-developer-goog-blog-assets/images/gemma-3_2.original.png)
A supervised fine-tune of [unsloth/gemma-3-270m-it](https://huggingface.co/unsloth/gemma-3-270m-it) on the [kth8/homeowner-classification](https://huggingface.co/datasets/kth8/homeowner-classification) dataset.
Inspired by https://www.teachmecoolstuff.com/viewarticle/fine-tuning-a-local-llm-to-categorize-questions
Use `temperature=0.0` for optimal results.
## Usage example
**System prompt**
```
Classify the homeowner question into a category from the list below.
The answer must be exactly one category name from the list in JSON format.
Choose the best category based on the meaning of the question.
Valid categories:
- appliances
- brick work
- car
- cooking
- doorbell
- electric
- fence
- fountain
- garden lights
- gutters
- hvac
- irrigation
- mosquito
- painting
- pool
- tree service
- water heater
- window service
```
**User prompt**
```
What is the CYA level supposed to be in the pool water?
```
**Assistant response**
```
{"category": "pool"}
```
## Model Details
- Base Model: `unsloth/gemma-3-270m-it`
- Parameter Count: 268,098,176
- Precision: torch.bfloat16
## Training Settings
### PEFT
- Rank: 32
- LoRA alpha: 64
- Modules: q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj
- Gradient checkpointing: unsloth
### SFT
- Epoch: 1
- Batch size: 8
- Gradient Accumulation steps: 2
- Learning rate: 0.0002
- Optimizer: adamw_torch_fused
- Learning rate scheduler: cosine
- Warmup steps: 10
- Weight decay: 0.01
## Training stats
- Date: 2026-06-17T01:06:10.026211
- GPU: NVIDIA L4
- Peak VRAM usage: 2.205 GB
- Global step: 126
- Training runtime (seconds): 334.7612
- Best validation loss: 0.013801434077322483
| Step | Training Loss | Validation Loss |
|------|---------------|-----------------|
| 0 | No log | 2.182445 |
| 12 | 1.131100 | 0.195152 |
| 24 | 0.122900 | 0.082139 |
| 36 | 0.076800 | 0.034620 |
| 48 | 0.075600 | 0.027673 |
| 60 | 0.039300 | 0.031881 |
| 72 | 0.038300 | 0.020789 |
| 84 | 0.031200 | 0.015834 |
| 96 | 0.018400 | 0.013921 |
| 108 | 0.030300 | 0.014498 |
| 120 | 0.023700 | 0.013801 |
## Framework versions
- Unsloth: 2026.6.7
- TRL: 0.22.2
- Transformers: 4.56.2
- Pytorch: 2.11.0+cu128
- Datasets: 5.0.0
- Tokenizers: 0.22.2
## License
This model is released under the Gemma license. See the [Gemma Terms of Use](https://ai.google.dev/gemma/terms) and [Prohibited Use Policy](https://policies.google.com/terms/generative-ai/use-policy) regarding the use of Gemma-generated content.

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fd60914e9990481ed3e88def7eedcd63463276c54f3db258c855dd3c7f7dc272
size 542835712