122 lines
4.6 KiB
Markdown
122 lines
4.6 KiB
Markdown
|
|
---
|
||
|
|
license: mit
|
||
|
|
base_model: microsoft/phi-4
|
||
|
|
tags:
|
||
|
|
- fine-tuned
|
||
|
|
- full-fine-tune
|
||
|
|
- text-generation
|
||
|
|
- chat
|
||
|
|
- question-answering
|
||
|
|
- assistant
|
||
|
|
- pytorch
|
||
|
|
language:
|
||
|
|
- fa
|
||
|
|
- en
|
||
|
|
- multilingual
|
||
|
|
pipeline_tag: text-generation
|
||
|
|
---
|
||
|
|
|
||
|
|
# 🍵 Tea
|
||
|
|

|
||
|
|
|
||
|
|
**Tea** is a full fine-tune of [`microsoft/phi-4`](https://huggingface.co/microsoft/phi-4), built for **question answering and long, sustained assistant-style conversations**. It is multilingual, with fine-tuning focused on strong, natural **Farsi (Persian)** conversational ability, while retaining Phi-4's general English and multilingual competence.
|
||
|
|
|
||
|
|
## Model Details
|
||
|
|
|
||
|
|
- **Base model:** [microsoft/phi-4](https://huggingface.co/microsoft/phi-4) (14B parameters)
|
||
|
|
- **Fine-tuning method:** Full fine-tune — all parameters updated, no LoRA/PEFT adapters
|
||
|
|
- **Fine-tuned by:** [artindnr](https://huggingface.co/artindnr)
|
||
|
|
- **License:** MIT
|
||
|
|
- **Languages:** Farsi (primary conversational focus), English, and general multilingual support
|
||
|
|
- **Model type:** Causal decoder-only chat/assistant language model
|
||
|
|
|
||
|
|
## What's New
|
||
|
|
|
||
|
|
tea takes Phi-4's strong base reasoning and language capabilities and tunes them specifically for:
|
||
|
|
|
||
|
|
- **Question answering** — direct, accurate answers grounded in the conversation context
|
||
|
|
- **Long assistant conversations** — maintaining coherence, tone, and context over extended multi-turn sessions rather than short single-shot exchanges
|
||
|
|
- **Farsi fluency** — natural, idiomatic Persian conversation and assistance, alongside solid English and multilingual performance
|
||
|
|
|
||
|
|
Unlike adapter-based fine-tunes, every weight in the model was updated during training, which the author has found gives more consistent behavior for long-conversation use cases than LoRA-based approaches.
|
||
|
|
|
||
|
|
## How to Use
|
||
|
|
|
||
|
|
Tea uses the standard chat template shipped with the base model, so it works out of the box with 🤗 Transformers.
|
||
|
|
|
||
|
|
### Generation
|
||
|
|
|
||
|
|
```python
|
||
|
|
import torch
|
||
|
|
from transformers import AutoModelForCausalLM, AutoTokenizer
|
||
|
|
|
||
|
|
MODEL_ID = "artindnr/tea"
|
||
|
|
|
||
|
|
tokenizer = AutoTokenizer.from_pretrained(MODEL_ID)
|
||
|
|
model = AutoModelForCausalLM.from_pretrained(
|
||
|
|
MODEL_ID,
|
||
|
|
torch_dtype=torch.bfloat16,
|
||
|
|
device_map="auto",
|
||
|
|
)
|
||
|
|
|
||
|
|
USER_PROMPT = "تو کی هستی و اسمت چیه؟"
|
||
|
|
|
||
|
|
messages = [
|
||
|
|
{"role": "user", "content": USER_PROMPT},
|
||
|
|
]
|
||
|
|
|
||
|
|
inputs = tokenizer.apply_chat_template(
|
||
|
|
messages,
|
||
|
|
add_generation_prompt=True,
|
||
|
|
tokenize=True,
|
||
|
|
return_dict=True,
|
||
|
|
return_tensors="pt",
|
||
|
|
).to(model.device)
|
||
|
|
|
||
|
|
outputs = model.generate(
|
||
|
|
**inputs,
|
||
|
|
max_new_tokens=1024,
|
||
|
|
temperature=0.7,
|
||
|
|
do_sample=True,
|
||
|
|
)
|
||
|
|
|
||
|
|
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:], skip_special_tokens=True))
|
||
|
|
```
|
||
|
|
|
||
|
|
For multi-turn conversations, simply keep appending `{"role": "user", ...}` / `{"role": "assistant", ...}` turns to the `messages` list before re-applying the chat template — tea is tuned to stay coherent as this history grows.
|
||
|
|
|
||
|
|
## Intended Use
|
||
|
|
|
||
|
|
tea is intended for:
|
||
|
|
|
||
|
|
- Farsi-first conversational assistants that also need to handle English/multilingual input
|
||
|
|
- Question-answering applications requiring direct, grounded answers
|
||
|
|
- Long-running, multi-turn assistant deployments (support bots, tutoring, general-purpose chat) where conversational memory and coherence over many turns matters
|
||
|
|
- Research comparing full fine-tunes vs. adapter-based (LoRA) fine-tunes on the same base model
|
||
|
|
|
||
|
|
## Limitations
|
||
|
|
|
||
|
|
- As a full fine-tune, tea's Farsi-focused training may shift some of Phi-4's original English-centric behaviors; for English-only, general-purpose use cases the base `microsoft/phi-4` model may still be preferable.
|
||
|
|
- tea inherits the general capabilities and limitations of the `phi-4` base model, including the possibility of hallucinated facts, especially over very long contexts.
|
||
|
|
- No formal safety fine-tuning beyond what is inherited from the base model has been applied; use appropriate safeguards in production settings.
|
||
|
|
|
||
|
|
## License
|
||
|
|
|
||
|
|
This model is released under the [MIT License](https://opensource.org/licenses/MIT), consistent with the base `microsoft/phi-4` model.
|
||
|
|
|
||
|
|
## Citation
|
||
|
|
|
||
|
|
If you use tea in your work, please cite:
|
||
|
|
|
||
|
|
```bibtex
|
||
|
|
@misc{tea,
|
||
|
|
title = {tea: A Farsi-Focused, Full Fine-tune of Phi-4 for QA and Long-form Assistance},
|
||
|
|
author = {artindnr},
|
||
|
|
year = {2026},
|
||
|
|
url = {https://huggingface.co/artindnr/tea}
|
||
|
|
}
|
||
|
|
```
|
||
|
|
|
||
|
|
## Acknowledgements
|
||
|
|
|
||
|
|
Built on top of [`microsoft/phi-4`](https://huggingface.co/microsoft/phi-4).
|