初始化项目,由ModelHub XC社区提供模型
Model: kth8/gemma-3-270m-it-homeowner-classifier-GGUF Source: Original Platform
This commit is contained in:
36
.gitattributes
vendored
Normal file
36
.gitattributes
vendored
Normal file
@@ -0,0 +1,36 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
gemma-3-270m-it-homeowner-classifier-bf16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
115
README.md
Normal file
115
README.md
Normal file
@@ -0,0 +1,115 @@
|
|||||||
|
---
|
||||||
|
license: gemma
|
||||||
|
language:
|
||||||
|
- en
|
||||||
|
base_model: kth8/gemma-3-270m-it-homeowner-classifier
|
||||||
|
datasets:
|
||||||
|
- kth8/homeowner-classification
|
||||||
|
pipeline_tag: text-generation
|
||||||
|
library_name: transformers
|
||||||
|
tags:
|
||||||
|
- sft
|
||||||
|
- trl
|
||||||
|
- unsloth
|
||||||
|
- gemma
|
||||||
|
- gemma3
|
||||||
|
- gemma3_text
|
||||||
|
---
|
||||||
|

|
||||||
|
A supervised fine-tune of [unsloth/gemma-3-270m-it](https://huggingface.co/unsloth/gemma-3-270m-it) on the [kth8/homeowner-classification](https://huggingface.co/datasets/kth8/homeowner-classification) dataset.
|
||||||
|
|
||||||
|
Inspired by https://www.teachmecoolstuff.com/viewarticle/fine-tuning-a-local-llm-to-categorize-questions
|
||||||
|
|
||||||
|
Use `temperature=0.0` for optimal results.
|
||||||
|
|
||||||
|
## Usage example
|
||||||
|
|
||||||
|
**System prompt**
|
||||||
|
```
|
||||||
|
Classify the homeowner question into a category from the list below.
|
||||||
|
The answer must be exactly one category name from the list in JSON format.
|
||||||
|
Choose the best category based on the meaning of the question.
|
||||||
|
|
||||||
|
Valid categories:
|
||||||
|
- appliances
|
||||||
|
- brick work
|
||||||
|
- car
|
||||||
|
- cooking
|
||||||
|
- doorbell
|
||||||
|
- electric
|
||||||
|
- fence
|
||||||
|
- fountain
|
||||||
|
- garden lights
|
||||||
|
- gutters
|
||||||
|
- hvac
|
||||||
|
- irrigation
|
||||||
|
- mosquito
|
||||||
|
- painting
|
||||||
|
- pool
|
||||||
|
- tree service
|
||||||
|
- water heater
|
||||||
|
- window service
|
||||||
|
```
|
||||||
|
**User prompt**
|
||||||
|
```
|
||||||
|
What is the CYA level supposed to be in the pool water?
|
||||||
|
```
|
||||||
|
**Assistant response**
|
||||||
|
```
|
||||||
|
{"category": "pool"}
|
||||||
|
```
|
||||||
|
## Model Details
|
||||||
|
- Base Model: `unsloth/gemma-3-270m-it`
|
||||||
|
- Parameter Count: 268,098,176
|
||||||
|
- Precision: torch.bfloat16
|
||||||
|
|
||||||
|
## Training Settings
|
||||||
|
|
||||||
|
### PEFT
|
||||||
|
- Rank: 32
|
||||||
|
- LoRA alpha: 64
|
||||||
|
- Modules: q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj
|
||||||
|
- Gradient checkpointing: unsloth
|
||||||
|
|
||||||
|
### SFT
|
||||||
|
- Epoch: 1
|
||||||
|
- Batch size: 8
|
||||||
|
- Gradient Accumulation steps: 2
|
||||||
|
- Learning rate: 0.0002
|
||||||
|
- Optimizer: adamw_torch_fused
|
||||||
|
- Learning rate scheduler: cosine
|
||||||
|
- Warmup steps: 10
|
||||||
|
- Weight decay: 0.01
|
||||||
|
|
||||||
|
## Training stats
|
||||||
|
- Date: 2026-06-17T01:06:10.026211
|
||||||
|
- GPU: NVIDIA L4
|
||||||
|
- Peak VRAM usage: 2.205 GB
|
||||||
|
- Global step: 126
|
||||||
|
- Training runtime (seconds): 334.7612
|
||||||
|
- Best validation loss: 0.013801434077322483
|
||||||
|
|
||||||
|
| Step | Training Loss | Validation Loss |
|
||||||
|
|------|---------------|-----------------|
|
||||||
|
| 0 | No log | 2.182445 |
|
||||||
|
| 12 | 1.131100 | 0.195152 |
|
||||||
|
| 24 | 0.122900 | 0.082139 |
|
||||||
|
| 36 | 0.076800 | 0.034620 |
|
||||||
|
| 48 | 0.075600 | 0.027673 |
|
||||||
|
| 60 | 0.039300 | 0.031881 |
|
||||||
|
| 72 | 0.038300 | 0.020789 |
|
||||||
|
| 84 | 0.031200 | 0.015834 |
|
||||||
|
| 96 | 0.018400 | 0.013921 |
|
||||||
|
| 108 | 0.030300 | 0.014498 |
|
||||||
|
| 120 | 0.023700 | 0.013801 |
|
||||||
|
|
||||||
|
## Framework versions
|
||||||
|
- Unsloth: 2026.6.7
|
||||||
|
- TRL: 0.22.2
|
||||||
|
- Transformers: 4.56.2
|
||||||
|
- Pytorch: 2.11.0+cu128
|
||||||
|
- Datasets: 5.0.0
|
||||||
|
- Tokenizers: 0.22.2
|
||||||
|
|
||||||
|
## License
|
||||||
|
This model is released under the Gemma license. See the [Gemma Terms of Use](https://ai.google.dev/gemma/terms) and [Prohibited Use Policy](https://policies.google.com/terms/generative-ai/use-policy) regarding the use of Gemma-generated content.
|
||||||
3
gemma-3-270m-it-homeowner-classifier-bf16.gguf
Normal file
3
gemma-3-270m-it-homeowner-classifier-bf16.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:fd60914e9990481ed3e88def7eedcd63463276c54f3db258c855dd3c7f7dc272
|
||||||
|
size 542835712
|
||||||
Reference in New Issue
Block a user