QuantFactory/llama3.1-airoboros3.2-QDT-8B-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: QuantFactory/llama3.1-airoboros3.2-QDT-8B-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-09 05:52:06 +08:00
commit cf757dc0f9
17 changed files with 123 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

31
README.md Normal file
View File

@@ -0,0 +1,31 @@
---
library_name: transformers
base_model:
- meta-llama/Meta-Llama-3.1-8B-Instruct
datasets:
- jondurbin/airoboros-3.2
license: llama3
---
![](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeiuCm7c8lEwEJuRey9kiVZsRn2W-b4pWlu3-X534V3YmVuVc2ZL-NXg2RkzSOOS2JXGHutDuyyNAUtdJI65jGTo8jT9Y99tMi4H4MqL44Uc5QKG77B0d6-JfIkZHFaUA71-RtjyYZWVIhqsNZcx8-OMaA?key=xt3VSDoCbmTY7o-cwwOFwQ)
# QuantFactory/llama3.1-airoboros3.2-QDT-8B-GGUF
This is quantized version of [nbeerbower/llama3.1-airoboros3.2-QDT-8B](https://huggingface.co/nbeerbower/llama3.1-airoboros3.2-QDT-8B) created using llama.cpp
# Original Model Card
# llama3.1-airoboros3.2-QDT-8B
[meta-llama/Meta-Llama-3.1-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct) finetuned on [jondurbin/airoboros-3.2](https://huggingface.co/datasets/jondurbin/airoboros-3.2).
Llama 3 Instruct was used as the chat template.
### Method
Finetuned using a Google Colab A100 for 1 epoch. Only 25% of the data was used for training due to limited resources, hence QDT (Quarter Data Test).
[Based on mlabonne's SFT notebook.](https://colab.research.google.com/drive/1o_w0KastmEJNVwT5GoqMCciH-18ca5WS?usp=sharing)