初始化项目,由ModelHub XC社区提供模型
Model: ViorikaAI-org/CalmaCatLM-2.1-mini Source: Original Platform
This commit is contained in:
42
README.md
Normal file
42
README.md
Normal file
@@ -0,0 +1,42 @@
|
||||
---
|
||||
license: mit
|
||||
language:
|
||||
- ru
|
||||
tags:
|
||||
- llama
|
||||
- russian
|
||||
- conversational
|
||||
model-index:
|
||||
- name: CalmaCatLM-2
|
||||
results: []
|
||||
library_name: transformers
|
||||
model_creator: ViorikaAI
|
||||
pipeline_tag: text-generation
|
||||
datasets:
|
||||
- IlyaGusev/saiga_scored
|
||||
- IlyaGusev/ru_turbo_alpaca
|
||||
- OpenAssistant/oasst1
|
||||
- OpenAssistant/oasst2
|
||||
---
|
||||
|
||||
# 🐈⬛ CalmaCatLM-2-MINI
|
||||
|
||||
# Подробнее:
|
||||
|
||||
## ⚙️ Детали модели
|
||||
- **Архитектура: LLama**
|
||||
- **Параметры: 134M**
|
||||
- **Язык: Русский**
|
||||
- **Лицения: MIT**
|
||||
|
||||
## 🏋️ Детали Тренировки
|
||||
- **Датасет:** saiga_scored, ru_turbo_alpaca, oasst 1 и 2 (RU часть)
|
||||
- **Железо:** **ОДНА** NVIDIA **GEFORCE RTX 5060 TI** (16GB VRAM)
|
||||
- **Эпохи:** 3
|
||||
- **СРЕДНИЙ LOSS:** 2.3000
|
||||
- **LR:** 5e-4
|
||||
- **Контекст:** 4046 токенов
|
||||
|
||||
## 🛜 Наши Соц. Сети
|
||||
- **Discord:** https://discord.gg/8JwTv8zj8d , https://discord.gg/7JE7maH6cf
|
||||
- **Telegram:** https://t.me/viorika_official
|
||||
Reference in New Issue
Block a user