Files
gemma-3-1b-it-IFeval/README.md
ModelHub XC 12f0f58b49 初始化项目,由ModelHub XC社区提供模型
Model: kth8/gemma-3-1b-it-IFeval
Source: Original Platform
2026-05-23 23:00:56 +08:00

4.1 KiB
Raw Blame History

license, language, base_model, datasets, pipeline_tag, library_name, tags
license language base_model datasets pipeline_tag library_name tags
gemma
en
unsloth/gemma-3-1b-it
HuggingFaceH4/ifeval-like-data
text-generation transformers
sft
trl
unsloth
google
gemma
gemma3
gemma3_text

logo A fine-tune of unsloth/gemma-3-1b-it on the HuggingFaceH4/ifeval-like-data dataset.

Usage example

System prompt

You are a helpful assistant.

User prompt

We want to teach our daughter the value of a clean home. Can you suggest chores that are appropriate for a child who is who 5 years old?

Assistant response

No Problem! Here are some great chores for a 5-year-old to do. 

     • Vacuuming: Most kids love the vacuum so this is a great starter chore for a five-year-old. Make sure to go through the dos and dont of vacuuming and remind your child not everything gets picked up by a 
       vacuum. 
     • Bedroom Cleanup: Teach your child to take care of their bedrooms. Start with picking up toys, this can be made into a game by color or items. Another good way of teaching children to fine-tune their bedrooms is 
       lining up their shoes, making their beds, and ensuring nothing is out of order. 
     • Separate Laundry: At 5 a children can easily distinguish between colors, whites, and towels. Have your children separate the laundry to make the task of washing clothes easier and more efficient. 
     • Folding Laundry: This is a great time to teach children how to fold laundry. At 5 they wont be perfect but little hands can handle washcloths, hand towels, and mating socks. 
     • Putting Away Groceries: This is a good way for children to learn everything has a place to go. With your guidance, a small task like putting away groceries will teach them later on how to put away and keep things 
       neat. 
     • Dusting: Grab a duster and teach your child how to carefully remove things to dust tables, handrails, or other kid-friendly dustable areas. 
     • Set and Clean The Table: Most households with small kids have kid-friendly items for the table. Allow your child to set the table before dinner.  After dinner teach your child to remove their items and take them to 
        the kitchen sink to be rinsed off. This chore will become a healthy habit. 
     • Make The Bed: At five this wont be perfect, but a child will be able to learn to set the pillow properly and adjust their bedding so it's more tidy. If they use extra blankets at night teach them to put them away or 
       fold them at the bottom of the bed. Dont forget to adjust the stuffed animals!

Model Details

  • Base Model: unsloth/gemma-3-1b-it
  • Parameter Count: 999,885,952
  • Precision: torch.bfloat16

Hardware

  • GPU: NVIDIA RTX PRO 6000 Blackwell Server Edition
  • Announced: Mar 17th, 2025
  • Release Date: Mar 18th, 2025
  • Memory Type: GDDR7
  • Bandwidth: 1.79 TB/s
  • Memory Size: 96 GB
  • Memory Bus: 512 bit
  • Shading Units: 24064
  • TDP: 600W

Training Settings

PEFT

  • Rank: 32
  • LoRA alpha: 64
  • Modules: q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj
  • Gradient checkpointing: unsloth

SFT

  • Epoch: 2
  • Batch size: 16
  • Gradient Accumulation steps: 1
  • Warmup ratio: 0.05
  • Learning rate: 0.0004
  • Optimizer: adamw_torch_fused
  • Learning rate scheduler: cosine

Training stats

  • Date: 2026-03-24T11:16:12.098497
  • Peak VRAM usage: 34.73 GB
  • Global step: 1850
  • Training runtime (seconds): 958.4314
  • Average training loss: 1.6259772120295344
  • Final validation loss: 1.7383391857147217

Framework versions

  • Unsloth: 2026.3.10
  • TRL: 0.22.2
  • Transformers: 4.56.2
  • Pytorch: 2.10.0+cu128
  • Datasets: 4.8.4
  • Tokenizers: 0.22.2

License

This model is released under the Gemma license. See the Gemma Terms of Use and Prohibited Use Policy regarding the use of Gemma-generated content.