初始化项目,由ModelHub XC社区提供模型
Model: alamios/Mistral-Small-3.1-DRAFT-0.5B Source: Original Platform
This commit is contained in:
30
README.md
Normal file
30
README.md
Normal file
@@ -0,0 +1,30 @@
|
||||
---
|
||||
license: apache-2.0
|
||||
language:
|
||||
- en
|
||||
- fr
|
||||
- de
|
||||
- es
|
||||
- it
|
||||
- pt
|
||||
base_model:
|
||||
- alamios/Qwenstral-Small-3.1-0.5B
|
||||
datasets:
|
||||
- alamios/Mistral-Small-24B-Instruct-2501-Conversations
|
||||
pipeline_tag: text-generation
|
||||
library_name: transformers
|
||||
tags:
|
||||
- qwen
|
||||
- qwen2.5
|
||||
- mistral
|
||||
- mistral-small
|
||||
- mistral-small-3.1
|
||||
---
|
||||
|
||||
# Mistral-Small-3.1-DRAFT-0.5B
|
||||
|
||||
This model is meant to be used as draft model for speculative decoding with [mistralai/Mistral-Small-3.1-24B-Instruct-2503](https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503) or [mistralai/Mistral-Small-24B-Instruct-2501](https://huggingface.co/mistralai/Mistral-Small-24B-Instruct-2501)
|
||||
|
||||
# Data info
|
||||
|
||||
The data are Mistral's outputs and includes all kind of tasks from various datasets in English, French, German, Spanish, Italian and Portuguese. It has been trained for 2 epochs on 20k unique examples, for a total of 12 million tokens per epoch.
|
||||
Reference in New Issue
Block a user