初始化项目，由ModelHub XC社区提供模型
Model: hwihwalab/dama-kurong-solopreneur-ko Source: Original Platform
This commit is contained in:
ModelHub XC
38
.gitattributes
vendored
Normal file
38
.gitattributes
vendored
Normal file
@@ -0,0 +1,38 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
tokenizer.json filter=lfs diff=lfs merge=lfs -text
|
||||
dama-kurong-solopreneur-ko.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
gemma-2-2b-it.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
14
Modelfile
Normal file
14
Modelfile
Normal file
@@ -0,0 +1,14 @@
|
||||
|
||||
FROM gemma-2-2b-it.Q4_K_M.gguf
|
||||
TEMPLATE """<start_of_turn>user
|
||||
{{ if .System }}{{ .System }} {{ end }}{{ .Prompt }}<end_of_turn>
|
||||
<start_of_turn>model
|
||||
{{ .Response }}<end_of_turn>
|
||||
"""
|
||||
PARAMETER repeat_penalty 1
|
||||
PARAMETER stop "<start_of_turn>"
|
||||
PARAMETER stop "<end_of_turn>"
|
||||
PARAMETER penalize_newline false
|
||||
PARAMETER temperature 1.5
|
||||
PARAMETER min_p 0.1
|
||||
PARAMETER num_ctx 4096
|
||||
182
README.md
Normal file
182
README.md
Normal file
@@ -0,0 +1,182 @@
|
||||
---
|
||||
language:
|
||||
- ko
|
||||
- en
|
||||
license: gemma
|
||||
library_name: transformers
|
||||
tags:
|
||||
- unsloth
|
||||
- gemma
|
||||
- gemma-2
|
||||
- lora
|
||||
- gguf
|
||||
- on-device
|
||||
- solopreneur
|
||||
- assistant
|
||||
- tamagotchi
|
||||
- kurong
|
||||
- korean
|
||||
- text-generation
|
||||
base_model: google/gemma-2-2b-it
|
||||
pipeline_tag: text-generation
|
||||
---
|
||||
|
||||
# 🐾 dama-kurong-solopreneur-ko (Kurong)
|
||||
|
||||
<p align="left">
|
||||
<img src="https://img.shields.io/badge/Language-Korean%20(Primary)%20%7C%20English-blue?style=flat-square" alt="Language">
|
||||
<img src="https://img.shields.io/badge/Base%20Model-Google%20Gemma--2--2B--it-4285F4?style=flat-square&logo=google" alt="Base Model">
|
||||
<img src="https://img.shields.io/badge/Finetuned%20with-Unsloth-FF6F00?style=flat-square" alt="Unsloth">
|
||||
<img src="https://img.shields.io/badge/License-Gemma-lightgrey?style=flat-square" alt="License">
|
||||
<img src="https://img.shields.io/badge/Persona-Kurong%20%F0%9F%90%BE-FFB6C1?style=flat-square" alt="Persona">
|
||||
<img src="https://img.shields.io/badge/Version-v1.1%20Patched-green?style=flat-square" alt="Version">
|
||||
</p>
|
||||
|
||||
> 🔔 **Latest Update (v1.1)**
|
||||
> * 🛑 **EOS Token Fix**: Completely resolved the endless generation / repetition loop by reinforcing the `<end_of_turn>` stop token.
|
||||
> * 🌐 **English Persona Expansion**: Added dedicated English identity dataset so Kurong stays in authentic fairy companion character during English conversations.
|
||||
> * *(Existing users: Please re-download the latest GGUF for the best experience!)*
|
||||
|
||||
---
|
||||
|
||||
**`dama-kurong-solopreneur-ko`** is a lightweight, on-device AI companion and assistant model specifically tailored for **solopreneurs, indie hackers, and freelancers**.
|
||||
|
||||
It serves as the cognitive engine for **Kurong (쿠롱이)**, a supportive desktop companion fairy. Fine-tuned from Google's `gemma-2-2b-it` using Unsloth LoRA, the model incorporates over **50+ practical bilingual playbooks (40+ Korean, 10+ English)** covering customer support, outage response, MVP pruning, and deep-work routine resets delivered with a warm, caring persona.
|
||||
|
||||
---
|
||||
|
||||
### 🔍 Linguistic & Persona Capabilities
|
||||
* **Primary Language (Korean):** Deeply optimized for natural, polite Korean conversational tone and localized solopreneur business advice.
|
||||
* **Secondary Language (English):** Capable of general comprehension and basic responses inheriting Gemma-2 pre-trained knowledge with Kurong persona support.
|
||||
* **Format:** GGUF (`Q4_K_M`) optimized for ultra-fast on-device local execution using **LM Studio**, **Ollama**, and **llama.cpp**.
|
||||
|
||||
---
|
||||
|
||||
## 🎮 Try with Dama-AI Web Companion (Interactive Playground)
|
||||
|
||||
Experience **Kurong** on an interactive desktop Tamagotchi screen! Launch your local inference server (**LM Studio** or **Ollama**) and connect seamlessly via the web client:
|
||||
|
||||
<p align="left">
|
||||
<a href="https://wonseokjung.github.io/tamagochi-ai/" target="_blank">
|
||||
<img src="https://img.shields.io/badge/🎮_Launch_Dama--AI_Web-Free_Simulator-FF6F00?style=for-the-badge" alt="Dama-AI Web">
|
||||
</a>
|
||||
<a href="https://youtu.be/uqoOL4kCxXw?si=Bnq33IVrLmjXZnMI" target="_blank">
|
||||
<img src="https://img.shields.io/badge/📺_Watch_Setup_Guide-YouTube-FF0000?style=for-the-badge&logo=youtube" alt="YouTube Tutorial">
|
||||
</a>
|
||||
</p>
|
||||
|
||||
---
|
||||
|
||||
## ✨ Key Features
|
||||
|
||||
* **💼 Solopreneur Business Playbooks**: Pre-embedded guidelines for first-paid-user CS, outage apology notices, MVP scope definition, and mental burnout recovery.
|
||||
* **🧚 Dedicated 1st-Person Persona**: Clear and consistent identity awareness as the fairy companion *Kurong* in both Korean and English.
|
||||
* **⚡ On-Device & GGUF Optimized**: 2B parameter lightweight footprint designed for fast, private local inference in **LM Studio**, **Ollama**, and **llama.cpp** (`dama-kurong-solopreneur-ko.Q4_K_M.gguf`).
|
||||
* **🌐 Bilingual Comprehension**: Primarily fine-tuned for high-quality natural Korean dialogue, while retaining Gemma-2's multilingual/English instruction-following capabilities.
|
||||
|
||||
---
|
||||
|
||||
## 💡 Prompt Template (Gemma-2 Format)
|
||||
|
||||
This model follows the standard Gemma-2 chat turn structure:
|
||||
|
||||
```text
|
||||
<start_of_turn>user
|
||||
첫 유료 결제 고객 응대 팁 알려줘<end_of_turn>
|
||||
<start_of_turn>model
|
||||
```
|
||||
|
||||
> 💡 **Pro-Tip for English Conversations**:
|
||||
> Since the model is primarily trained on Korean datasets, if it occasionally responds in Korean to an English question, simply append **"Please reply in English"** or **"Answer in English"** to your prompt for the best English output!
|
||||
> *(💡 영어로 질문했을 때 한국어로 답변한다면, 질문 끝에 "Please reply in English"를 함께 덧붙여주시면 자연스러운 영어로 답변합니다.)*
|
||||
|
||||
---
|
||||
|
||||
## 🚀 Quickstart (Inference Examples)
|
||||
|
||||
### 1. Python (`transformers`)
|
||||
|
||||
```python
|
||||
import torch
|
||||
from transformers import AutoTokenizer, AutoModelForCausalLM
|
||||
|
||||
model_id = "hwihwalab/dama-kurong-solopreneur-ko"
|
||||
|
||||
tokenizer = AutoTokenizer.from_pretrained(model_id)
|
||||
model = AutoModelForCausalLM.from_pretrained(
|
||||
model_id,
|
||||
torch_dtype=torch.bfloat16,
|
||||
device_map="auto"
|
||||
)
|
||||
|
||||
messages = [
|
||||
{"role": "user", "content": "첫 유료 결제 고객 응대 알려줘"}
|
||||
]
|
||||
|
||||
prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
|
||||
inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
|
||||
|
||||
outputs = model.generate(
|
||||
**inputs,
|
||||
max_new_tokens=256,
|
||||
temperature=0.7,
|
||||
top_p=0.9,
|
||||
eos_token_id=tokenizer.convert_tokens_to_ids("<end_of_turn>")
|
||||
)
|
||||
|
||||
print(tokenizer.decode(outputs[0][inputs.input_ids.shape[1]:], skip_special_tokens=True))
|
||||
```
|
||||
|
||||
### 2. LM Studio (Local GUI)
|
||||
1. Open LM Studio and search for `hwihwalab/dama-kurong-solopreneur-ko` (or press `Ctrl + Shift + M`).
|
||||
2. Download `dama-kurong-solopreneur-ko.Q4_K_M.gguf`.
|
||||
3. Load the model in the **Chat** tab and start interacting locally.
|
||||
|
||||
### 3. Ollama (`Modelfile`)
|
||||
```dockerfile
|
||||
FROM ./dama-kurong-solopreneur-ko.Q4_K_M.gguf
|
||||
|
||||
TEMPLATE """<start_of_turn>user
|
||||
{{ .Prompt }}<end_of_turn>
|
||||
<start_of_turn>model
|
||||
"""
|
||||
|
||||
PARAMETER stop "<start_of_turn>"
|
||||
PARAMETER stop "<end_of_turn>"
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## 💬 Example Queries
|
||||
|
||||
| Category | Example Prompt (Korean / English) | Intent & Response Focus |
|
||||
| :--- | :--- | :--- |
|
||||
| **Persona (정체성)** | `너는 누구야?`<br>`Who are you?` | Authentic Tamagotchi fairy companion awareness |
|
||||
| **Customer Support (CS)** | `첫 유료 결제 고객 응대 알려줘`<br>`Tips for first paying customer CS` | Personal thank-you guide & superfan building |
|
||||
| **Incident Response (위기 대응)** | `서비스 장애 사고 대처 알려줘`<br>`How to handle server downtime` | Transparent apology & trust recovery playbook |
|
||||
| **Business Strategy (MVP)** | `첫 출시용 최소 기능 고르는 법 알려줘`<br>`How to prioritize core MVP features` | Core feature selection & launch scope pruning |
|
||||
| **Mental & Routine (루틴)** | `작업 중 뇌 피로 회복법 알려줘`<br>`How to recover from brain fatigue` | 5-minute cognitive reset & burnout prevention |
|
||||
|
||||
---
|
||||
|
||||
## 📄 License & Usage Terms
|
||||
|
||||
This model is fine-tuned from **Google Gemma-2-2B-it** and is governed by the [Gemma Terms of Use](https://ai.google.dev/gemma/terms). Users and commercial adopters are free to use, modify, and distribute this model in accordance with Google's Prohibited Use Policy.
|
||||
|
||||
---
|
||||
|
||||
<details>
|
||||
<summary>🇰🇷 한국어 소개 및 라이선스 안내 (Click to expand Korean summary)</summary>
|
||||
|
||||
### 📖 모델 개요
|
||||
`dama-kurong-solopreneur-ko`는 1인 창업가, 인디 해커, 프리랜서를 돕는 데스크톱 다마고치 비서 요정 **쿠롱이**의 온디바이스 AI 모델입니다.
|
||||
Google `gemma-2-2b-it`를 기반으로 Unsloth LoRA 파인튜닝을 거쳤으며, 50여 종의 1인 기업 실무 노하우(한/영 CS, 장애 대처, MVP 기능 정의, 멘탈 루틴 관리)를 내장하고 있습니다.
|
||||
|
||||
### 📜 라이선스 안내
|
||||
본 모델은 Google의 Gemma 라이선스를 준수합니다. 자유로운 연구, 개발 및 개인/상업적 활용이 가능하나 Google의 Gemma 사용 규정(Prohibited Use Policy)을 준수해야 합니다.
|
||||
|
||||
</details>
|
||||
|
||||
---
|
||||
|
||||
*Trained and fine-tuned for [Dama-AI] by **Hwihwa Lab** ([@hwihwalab](https://huggingface.co/hwihwalab))*
|
||||
5
chat_template.jinja
Normal file
5
chat_template.jinja
Normal file
@@ -0,0 +1,5 @@
|
||||
{{ bos_token }}{% for message in messages %}{% if message['role'] == 'user' %}{{ '<start_of_turn>user
|
||||
' + message['content'] + '<end_of_turn>
|
||||
<start_of_turn>model
|
||||
' }}{% elif message['role'] == 'assistant' %}{{ message['content'] + '<end_of_turn>
|
||||
' }}{% endif %}{% endfor %}
|
||||
68
config.json
Normal file
68
config.json
Normal file
@@ -0,0 +1,68 @@
|
||||
{
|
||||
"architectures": [
|
||||
"Gemma2ForCausalLM"
|
||||
],
|
||||
"attention_bias": false,
|
||||
"attention_dropout": 0.0,
|
||||
"attn_logit_softcapping": 50.0,
|
||||
"bos_token_id": 2,
|
||||
"cache_implementation": "hybrid",
|
||||
"torch_dtype": "bfloat16",
|
||||
"eos_token_id": [
|
||||
1,
|
||||
107
|
||||
],
|
||||
"final_logit_softcapping": 30.0,
|
||||
"head_dim": 256,
|
||||
"hidden_act": "gelu_pytorch_tanh",
|
||||
"hidden_activation": "gelu_pytorch_tanh",
|
||||
"hidden_size": 2304,
|
||||
"initializer_range": 0.02,
|
||||
"intermediate_size": 9216,
|
||||
"layer_types": [
|
||||
"sliding_attention",
|
||||
"full_attention",
|
||||
"sliding_attention",
|
||||
"full_attention",
|
||||
"sliding_attention",
|
||||
"full_attention",
|
||||
"sliding_attention",
|
||||
"full_attention",
|
||||
"sliding_attention",
|
||||
"full_attention",
|
||||
"sliding_attention",
|
||||
"full_attention",
|
||||
"sliding_attention",
|
||||
"full_attention",
|
||||
"sliding_attention",
|
||||
"full_attention",
|
||||
"sliding_attention",
|
||||
"full_attention",
|
||||
"sliding_attention",
|
||||
"full_attention",
|
||||
"sliding_attention",
|
||||
"full_attention",
|
||||
"sliding_attention",
|
||||
"full_attention",
|
||||
"sliding_attention",
|
||||
"full_attention"
|
||||
],
|
||||
"max_position_embeddings": 8192,
|
||||
"model_type": "gemma2",
|
||||
"num_attention_heads": 8,
|
||||
"num_hidden_layers": 26,
|
||||
"num_key_value_heads": 4,
|
||||
"pad_token_id": 0,
|
||||
"query_pre_attn_scalar": 256,
|
||||
"rms_norm_eps": 1e-06,
|
||||
"rope_parameters": {
|
||||
"rope_theta": 10000.0,
|
||||
"rope_type": "default"
|
||||
},
|
||||
"sliding_window": 4096,
|
||||
"tie_word_embeddings": true,
|
||||
"unsloth_version": "2024.9",
|
||||
"use_bidirectional_attention": null,
|
||||
"use_cache": true,
|
||||
"vocab_size": 256000
|
||||
}
|
||||
3
dama-kurong-solopreneur-ko.Q4_K_M.gguf
Normal file
3
dama-kurong-solopreneur-ko.Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:f4780761a56feadb991b9fb84e0e1a02dd4c1ea2b96de19e84cbb8283d6013ac
|
||||
size 1708583232
|
||||
3
gemma-2-2b-it.Q4_K_M.gguf
Normal file
3
gemma-2-2b-it.Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:d2ca1a3839f63d1193338daef6dfb0914efc0f0c9cca78ae424602af34da46b5
|
||||
size 1708582208
|
||||
12
generation_config.json
Normal file
12
generation_config.json
Normal file
@@ -0,0 +1,12 @@
|
||||
{
|
||||
"_from_model_config": true,
|
||||
"bos_token_id": 2,
|
||||
"cache_implementation": "hybrid",
|
||||
"eos_token_id": [
|
||||
1,
|
||||
1,
|
||||
107
|
||||
],
|
||||
"pad_token_id": 0,
|
||||
"transformers_version": "5.5.0"
|
||||
}
|
||||
3
model.safetensors
Normal file
3
model.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:068c29936ce94a6bf2c40cb1cd5f07bbae83d34eb9c4e26ef410490cbb12fa30
|
||||
size 5228717512
|
||||
3
tokenizer.json
Normal file
3
tokenizer.json
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:00636d529731efd619ee96a1c76d9b8d5bf73b0fd47c1646c15cce25cba37e27
|
||||
size 34362872
|
||||
3
tokenizer.model
Normal file
3
tokenizer.model
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:e1c884ece79afe1a936f5fc9335a5da9260a96aa65c383c09b8f0a8d9b552bd7
|
||||
size 4241003
|
||||
2006
tokenizer_config.json
Normal file
2006
tokenizer_config.json
Normal file
File diff suppressed because it is too large
Load Diff
Reference in New Issue
Block a user