初始化项目,由ModelHub XC社区提供模型
Model: minpeter/Llama-3.2-1B-chatml-tool-v4 Source: Original Platform
This commit is contained in:
28
README.md
Normal file
28
README.md
Normal file
@@ -0,0 +1,28 @@
|
||||
---
|
||||
license: llama3.2
|
||||
datasets:
|
||||
- teknium/OpenHermes-2.5
|
||||
- NousResearch/hermes-function-calling-v1
|
||||
base_model:
|
||||
- minpeter/QLoRA-Llama-3.2-1B-chatml-tool-v4
|
||||
- meta-llama/Llama-3.2-1B
|
||||
language:
|
||||
- en
|
||||
pipeline_tag: text-generation
|
||||
library_name: transformers
|
||||
tags:
|
||||
- axolotl
|
||||
- merge
|
||||
---
|
||||
|
||||
|
||||
## Model Performance Comparison (BFCL)
|
||||
|
||||
| task name | minpeter/Llama-3.2-1B-chatml-tool-v4 | meta-llama/Llama-3.2-1B-Instruct (measure) | meta-llama/Llama-3.2-1B-Instruct (Reported) |
|
||||
|-----------------|-----------------------------------|-----------------------------------|---------------------------------------|
|
||||
| parallel_multiple | 0.000 | 0.025 | **0.15** |
|
||||
| parallel | 0.000 | 0.035 | **0.36** |
|
||||
| simple | **0.7725** | 0.215 | 0.2925 |
|
||||
| multiple | **0.765** | 0.17 | 0.335 |
|
||||
|
||||
*Parallel calls are not taken into account. 0 points are expected. We plan to fix this in next version.*
|
||||
Reference in New Issue
Block a user