初始化项目，由ModelHub XC社区提供模型
Model: kth8/gemma-3-270m-it-homeowner-classifier-GGUF Source: Original Platform
This commit is contained in:
ModelHub XC
36
.gitattributes
vendored
Normal file
36
.gitattributes
vendored
Normal file
@@ -0,0 +1,36 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
gemma-3-270m-it-homeowner-classifier-bf16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
115
README.md
Normal file
115
README.md
Normal file
@@ -0,0 +1,115 @@
|
||||
---
|
||||
license: gemma
|
||||
language:
|
||||
- en
|
||||
base_model: kth8/gemma-3-270m-it-homeowner-classifier
|
||||
datasets:
|
||||
- kth8/homeowner-classification
|
||||
pipeline_tag: text-generation
|
||||
library_name: transformers
|
||||
tags:
|
||||
- sft
|
||||
- trl
|
||||
- unsloth
|
||||
- gemma
|
||||
- gemma3
|
||||
- gemma3_text
|
||||
---
|
||||
|
||||
A supervised fine-tune of [unsloth/gemma-3-270m-it](https://huggingface.co/unsloth/gemma-3-270m-it) on the [kth8/homeowner-classification](https://huggingface.co/datasets/kth8/homeowner-classification) dataset.
|
||||
|
||||
Inspired by https://www.teachmecoolstuff.com/viewarticle/fine-tuning-a-local-llm-to-categorize-questions
|
||||
|
||||
Use `temperature=0.0` for optimal results.
|
||||
|
||||
## Usage example
|
||||
|
||||
**System prompt**
|
||||
```
|
||||
Classify the homeowner question into a category from the list below.
|
||||
The answer must be exactly one category name from the list in JSON format.
|
||||
Choose the best category based on the meaning of the question.
|
||||
|
||||
Valid categories:
|
||||
- appliances
|
||||
- brick work
|
||||
- car
|
||||
- cooking
|
||||
- doorbell
|
||||
- electric
|
||||
- fence
|
||||
- fountain
|
||||
- garden lights
|
||||
- gutters
|
||||
- hvac
|
||||
- irrigation
|
||||
- mosquito
|
||||
- painting
|
||||
- pool
|
||||
- tree service
|
||||
- water heater
|
||||
- window service
|
||||
```
|
||||
**User prompt**
|
||||
```
|
||||
What is the CYA level supposed to be in the pool water?
|
||||
```
|
||||
**Assistant response**
|
||||
```
|
||||
{"category": "pool"}
|
||||
```
|
||||
## Model Details
|
||||
- Base Model: `unsloth/gemma-3-270m-it`
|
||||
- Parameter Count: 268,098,176
|
||||
- Precision: torch.bfloat16
|
||||
|
||||
## Training Settings
|
||||
|
||||
### PEFT
|
||||
- Rank: 32
|
||||
- LoRA alpha: 64
|
||||
- Modules: q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj
|
||||
- Gradient checkpointing: unsloth
|
||||
|
||||
### SFT
|
||||
- Epoch: 1
|
||||
- Batch size: 8
|
||||
- Gradient Accumulation steps: 2
|
||||
- Learning rate: 0.0002
|
||||
- Optimizer: adamw_torch_fused
|
||||
- Learning rate scheduler: cosine
|
||||
- Warmup steps: 10
|
||||
- Weight decay: 0.01
|
||||
|
||||
## Training stats
|
||||
- Date: 2026-06-17T01:06:10.026211
|
||||
- GPU: NVIDIA L4
|
||||
- Peak VRAM usage: 2.205 GB
|
||||
- Global step: 126
|
||||
- Training runtime (seconds): 334.7612
|
||||
- Best validation loss: 0.013801434077322483
|
||||
|
||||
| Step | Training Loss | Validation Loss |
|
||||
|------|---------------|-----------------|
|
||||
| 0 | No log | 2.182445 |
|
||||
| 12 | 1.131100 | 0.195152 |
|
||||
| 24 | 0.122900 | 0.082139 |
|
||||
| 36 | 0.076800 | 0.034620 |
|
||||
| 48 | 0.075600 | 0.027673 |
|
||||
| 60 | 0.039300 | 0.031881 |
|
||||
| 72 | 0.038300 | 0.020789 |
|
||||
| 84 | 0.031200 | 0.015834 |
|
||||
| 96 | 0.018400 | 0.013921 |
|
||||
| 108 | 0.030300 | 0.014498 |
|
||||
| 120 | 0.023700 | 0.013801 |
|
||||
|
||||
## Framework versions
|
||||
- Unsloth: 2026.6.7
|
||||
- TRL: 0.22.2
|
||||
- Transformers: 4.56.2
|
||||
- Pytorch: 2.11.0+cu128
|
||||
- Datasets: 5.0.0
|
||||
- Tokenizers: 0.22.2
|
||||
|
||||
## License
|
||||
This model is released under the Gemma license. See the [Gemma Terms of Use](https://ai.google.dev/gemma/terms) and [Prohibited Use Policy](https://policies.google.com/terms/generative-ai/use-policy) regarding the use of Gemma-generated content.
|
||||
3
gemma-3-270m-it-homeowner-classifier-bf16.gguf
Normal file
3
gemma-3-270m-it-homeowner-classifier-bf16.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:fd60914e9990481ed3e88def7eedcd63463276c54f3db258c855dd3c7f7dc272
|
||||
size 542835712
|
||||
Reference in New Issue
Block a user