TeeZee/Bielik-SOLAR-LIKE-10.7B-Instruct-v0.1
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity
1 Commit 1 Branch 0 Tags
main
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE

README.md

license
license
cc-by-nc-4.0

TeeZee/Bielik-SOLAR-LIKE-10.7B-Instruct-v0.1

Precise recipe used by Upstage to create SOLAR was applied to https://huggingface.co/speakleash/Bielik-7B-Instruct-v0.1 *(just merge, no finetuning)

Results

  • model is still coherent in Polish language, even without finetuning after merge

  • instruct mode works in ooba without issues

  • model is censored and aligned

  • seems that this model scores highest amongst all versions of original Bielik models, further finetunig should improve results even more.

    imgage/png

  • on dedicated to Polish speaking LLM leaderboards, its 2nd, just behind instruct version used for this merge, and thats to be expected when applying DUS merge - very small quality loss.

Polish LLMs leaderboards

  • overall it seems like a good base for further finetunig in Polish language.
Description
Model synced from source: TeeZee/Bielik-SOLAR-LIKE-10.7B-Instruct-v0.1
Readme 1.1 MiB