anthracite-org/magnum-v4-27b-gguf
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
lucy
2024-10-20 03:25:53 +00:00
committed by system
parent 4f65ba9aea
commit 6c6bdf28e7
1 changed files with 0 additions and 9 deletions
Download Patch File Download Diff File Expand all files Collapse all files

9
README.md
View File

@@ -8,15 +8,6 @@ pipeline_tag: text-generation
library_name: transformers
---
## This repo contains EXL2 quants of the model. If you need the original weights, please find them [here](https://huggingface.co/anthracite-org/magnum-v4-27b).
## Base repo only contains the measurement file, see revisions for your quant of choice.
- [measurement.json](https://huggingface.co/anthracite-org/magnum-v4-27b-exl2/tree/main)
- [3.0bpw](https://huggingface.co/anthracite-org/magnum-v4-27b-exl2/tree/3.0bpw)
- [4.0bpw](https://huggingface.co/anthracite-org/magnum-v4-27b-exl2/tree/4.0bpw)
- [5.0bpw](https://huggingface.co/anthracite-org/magnum-v4-27b-exl2/tree/5.0bpw)
- [6.0bpw](https://huggingface.co/anthracite-org/magnum-v4-27b-exl2/tree/6.0bpw)
- [8.0bpw](https://huggingface.co/anthracite-org/magnum-v4-27b-exl2/tree/8.0bpw)
![image/png](https://cdn-uploads.huggingface.co/production/uploads/658a46cbfb9c2bdfae75b3a6/EAyOLldRzMpRwdsUZ5PLl.png)
## This repo contains GGUF quants of the model. If you need the original weights, please find them [here](https://huggingface.co/anthracite-org/magnum-v4-27b).