commit 3d088c5d82722ee483289e2fd06b90890949f332 Author: ModelHub XC Date: Wed Jun 17 16:29:15 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: kth8/gemma-3-1b-it-OpenCode-Title-Generator-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..7e1cfd9 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,37 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +gemma-3-1b-it-OpenCode-Title-Generator-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text +gemma-3-1b-it-OpenCode-Title-Generator-bf16.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..b8147ce --- /dev/null +++ b/README.md @@ -0,0 +1,164 @@ +--- +license: gemma +language: +- en +base_model: kth8/gemma-3-1b-it-OpenCode-Title-Generator +datasets: +- kth8/title-generation-25000x +pipeline_tag: text-generation +library_name: transformers +tags: +- sft +- trl +- unsloth +- gemma +- gemma3 +- gemma3_text +--- +![logo](https://storage.googleapis.com/gweb-developer-goog-blog-assets/images/gemma-3_2.original.png) +A supervised fine-tune of [unsloth/gemma-3-1b-it](https://huggingface.co/unsloth/gemma-3-1b-it) on the [kth8/title-generation-25000x](https://huggingface.co/datasets/kth8/title-generation-25000x) dataset. +Trained with the exact system prompt OpenCode's [title agent uses](https://raw.githubusercontent.com/anomalyco/opencode/refs/heads/dev/packages/opencode/src/agent/prompt/title.txt). + +## Usage example + +Point to this model with `small_model` in `opencode.jsonc` file. + +```json +{ + "$schema": "https://opencode.ai/config.json", + "provider": { + "title": { + "npm": "@ai-sdk/openai-compatible", + "options": { + "baseURL": "http://127.0.0.1:8080/v1", + "apiKey": "not-needed" + }, + "models": { + "generator": {} + } + } + }, + "small_model": "title/generator" +} +``` + +**System prompt** +``` +You are a title generator. You output ONLY a thread title. Nothing else. + + +Generate a brief title that would help the user find this conversation later. + +Follow all rules in +Use the so you know what a good title looks like. +Your output must be: +- A single line +- ≤50 characters +- No explanations + + + +- you MUST use the same language as the user message you are summarizing +- Title must be grammatically correct and read naturally - no word salad +- Never include tool names in the title (e.g. "read tool", "bash tool", "edit tool") +- Focus on the main topic or question the user needs to retrieve +- Vary your phrasing - avoid repetitive patterns like always starting with "Analyzing" +- When a file is mentioned, focus on WHAT the user wants to do WITH the file, not just that they shared it +- Keep exact: technical terms, numbers, filenames, HTTP codes +- Remove: the, this, my, a, an +- Never assume tech stack +- Never use tools +- NEVER respond to questions, just generate a title for the conversation +- The title should NEVER include "summarizing" or "generating" when generating a title +- DO NOT SAY YOU CANNOT GENERATE A TITLE OR COMPLAIN ABOUT THE INPUT +- Always output something meaningful, even if the input is minimal. +- If the user message is short or conversational (e.g. "hello", "lol", "what's up", "hey"): + → create a title that reflects the user's tone or intent (such as Greeting, Quick check-in, Light chat, Intro message, etc.) + + + +"debug 500 errors in production" → Debugging production 500 errors +"refactor user service" → Refactoring user service +"why is app.js failing" → app.js failure investigation +"implement rate limiting" → Rate limiting implementation +"how do I connect postgres to my API" → Postgres API connection +"best practices for React hooks" → React hooks best practices +"@src/auth.ts can you add refresh token support" → Auth refresh token support +"@utils/parser.ts this is broken" → Parser bug fix +"look at @config.json" → Config review +"@App.tsx add dark mode toggle" → Dark mode toggle in App + +``` +**User prompt** +``` +If there were 200 students who passed an English course three years ago, and each subsequent year until the current one that number increased by 50% of the previous year's number, how many students will pass the course this year? +``` +**Assistant response** +``` +Student course passing growth calculation +``` +## Model Details +- Base Model: `unsloth/gemma-3-1b-it` +- Parameter Count: 999,885,952 +- Precision: torch.bfloat16 + +## Training Settings + +### PEFT +- Rank: 32 +- LoRA alpha: 64 +- Modules: q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj +- Gradient checkpointing: unsloth + +### SFT +- Epoch: 1 +- Batch size: 8 +- Gradient Accumulation steps: 2 +- Learning rate: 0.0002 +- Optimizer: adamw_torch_fused +- Learning rate scheduler: cosine +- Warmup steps: 100 +- Weight decay: 0.01 + +## Training stats +- Date: 2026-06-01T10:12:28.954526 +- GPU: NVIDIA A100-SXM4-40GB +- Peak VRAM usage: 13.854 GB +- Global step: 1607 +- Training runtime (seconds): 2534.2207 +- Best validation loss: 0.9999628067016602 + +| Step | Training Loss | Validation Loss | +|------|---------------|-----------------| +| 0 | No log | 4.586893 | +| 80 | 1.311900 | 1.303047 | +| 160 | 1.200600 | 1.274377 | +| 240 | 1.282300 | 1.222955 | +| 320 | 1.230500 | 1.195515 | +| 400 | 1.265500 | 1.195236 | +| 480 | 1.095300 | 1.177848 | +| 560 | 1.184700 | 1.157910 | +| 640 | 1.066800 | 1.122728 | +| 720 | 1.097000 | 1.117976 | +| 800 | 1.175000 | 1.068038 | +| 880 | 1.154500 | 1.077077 | +| 960 | 0.952900 | 1.044860 | +| 1040 | 1.078300 | 1.036307 | +| 1120 | 1.023300 | 1.031127 | +| 1200 | 1.091300 | 1.021288 | +| 1280 | 0.923400 | 1.013523 | +| 1360 | 0.981900 | 1.005518 | +| 1440 | 0.956300 | 1.001224 | +| 1520 | 0.968000 | 1.000348 | +| 1600 | 1.021000 | 0.999963 | + +## Framework versions +- Unsloth: 2026.5.9 +- TRL: 0.22.2 +- Transformers: 4.56.2 +- Pytorch: 2.11.0+cu128 +- Datasets: 4.8.5 +- Tokenizers: 0.22.2 + +## License +This model is released under the Gemma license. See the [Gemma Terms of Use](https://ai.google.dev/gemma/terms) and [Prohibited Use Policy](https://policies.google.com/terms/generative-ai/use-policy) regarding the use of Gemma-generated content. \ No newline at end of file diff --git a/gemma-3-1b-it-OpenCode-Title-Generator-Q8_0.gguf b/gemma-3-1b-it-OpenCode-Title-Generator-Q8_0.gguf new file mode 100644 index 0000000..7834f0f --- /dev/null +++ b/gemma-3-1b-it-OpenCode-Title-Generator-Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f43217794e3cd54c4853354ec609cfe4a567fb8fe80e4e29e9dc9fd23e12f2fd +size 1069306624 diff --git a/gemma-3-1b-it-OpenCode-Title-Generator-bf16.gguf b/gemma-3-1b-it-OpenCode-Title-Generator-bf16.gguf new file mode 100644 index 0000000..4f54c17 --- /dev/null +++ b/gemma-3-1b-it-OpenCode-Title-Generator-bf16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6c84a5f27ee64510badcd943e3cd531f20d6fd284a3c69acc759e9316992c664 +size 2006573824