Josephgflowers/Qllama-5B-Base-Wiki-Chat-RAG
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: Josephgflowers/Qllama-5B-Base-Wiki-Chat-RAG
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-09-03 14:25:13 +08:00
commit cdb46e0ed4
17 changed files with 2288 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

11
README.md Normal file
View File

@@ -0,0 +1,11 @@
---
license: apache-2.0
---
Llamafyd version of Qwen .5B further fine tuned on wiki, math, science, and chat datasets. Based on Cinder data.
This model should be fine tuned on further rag, function calling, programing, or assistant datasets for best performance.
Next model will have a focus on rag.
This model is ok at rag. It is very verbose from being trained on wikipedia Q and A with a whole article as the answer. Tiny-textbooks and Cosmopedia 100k, all very long responses.
It was also trained with normal RAG datasets, as well as a medical rag dataset I put together. Most of the common math chat datasets. Conversation datasets like hermes 1, fastchat, synthia, capybara, cinder, puffin, ect.
I will work on putting together the full list and posting.