78 lines
2.1 KiB
Markdown
78 lines
2.1 KiB
Markdown
|
---
|
||
|
|
license: apache-2.0
|
||
|
|
datasets:
|
||
|
|
- 0-hero/Matter-0.2
|
||
|
|
language:
|
||
|
|
- en
|
||
|
|
---
|
||
|
|
|
||
|
|
## Matter 7B - 0.2 (Mistral 7B 0.2 Finetune)
|
||
|
|
|
||
|
|
Matter 7B 0.2 is full-finetune on the **Matter 0.2 dataset** (not yet released), which is curated from over 35 datsets analyzing >6B tokens
|
||
|
|
|
||
|
|
### Recommended Usage for best results
|
||
|
|
System Prompt - `You are a helpful assistant`
|
||
|
|
|
||
|
|
### Training
|
||
|
|
|
||
|
|
Prompt format: This model uses ChatML prompt format.
|
||
|
|
```
|
||
|
|
<|im_start|>system
|
||
|
|
You are a helpful AI assistant.<|im_end|>
|
||
|
|
<|im_start|>user
|
||
|
|
{prompt}<|im_end|>
|
||
|
|
<|im_start|>assistant
|
||
|
|
```
|
||
|
|
### Function Calling
|
||
|
|
|
||
|
|
Model also supports function calling. Additional tokens for function calling
|
||
|
|
|
||
|
|
Model function call tokens
|
||
|
|
- `<tool_call>` - Function call start token
|
||
|
|
- `</tool_call>` - Function call end token
|
||
|
|
|
||
|
|
Function call response tokens
|
||
|
|
- `<tool_response>` - Function response start token
|
||
|
|
- `</tool_response>` - Function response end token
|
||
|
|
|
||
|
|
Example
|
||
|
|
```
|
||
|
|
<|im_start|>system
|
||
|
|
You are a helpful assistant with access to the following functions. Use them if required -
|
||
|
|
{ "name": "get_news_headlines",
|
||
|
|
"description": "Get the latest news headlines",
|
||
|
|
"parameters":
|
||
|
|
{ "type": "object",
|
||
|
|
"properties":
|
||
|
|
{ "country":
|
||
|
|
{ "type": "string",
|
||
|
|
"description": "The country for which to fetch news"
|
||
|
|
}
|
||
|
|
},
|
||
|
|
"required": [ "country" ]
|
||
|
|
}
|
||
|
|
}
|
||
|
|
<|im_end|>
|
||
|
|
<|im_start|>user
|
||
|
|
Can you tell me the latest news headlines for the United States?<|im_end|>
|
||
|
|
<|im_start|>assistant
|
||
|
|
<tool_call>{"name": "get_news_headlines", "arguments": '{"country": "United States"}'}</tool_call><|im_end|>
|
||
|
|
<|im_start|>user
|
||
|
|
<tool_response>{
|
||
|
|
"headlines":
|
||
|
|
[
|
||
|
|
"Biden announces new vaccine mandates",
|
||
|
|
"Hurricane Ida devastates Louisiana",
|
||
|
|
"Apple unveils new iPhone",
|
||
|
|
"NASA's Perseverance rover collects first Mars rock sample"
|
||
|
|
]
|
||
|
|
}</tool_response>
|
||
|
|
<|im_end|>
|
||
|
|
<|im_start|>assistant
|
||
|
|
Here are the latest news headlines for the United States:
|
||
|
|
1. Biden announces new vaccine mandates
|
||
|
|
2. Hurricane Ida devastates Louisiana
|
||
|
|
3. Apple unveils new iPhone
|
||
|
|
4. NASA's Perseverance rover collects first Mars rock sample
|
||
|
|
<|im_end|>
|
||
|
|
```
|