初始化项目,由ModelHub XC社区提供模型
Model: Melvin56/UIGEN-T2-7B-GGUF Source: Original Platform
This commit is contained in:
39
README.md
Normal file
39
README.md
Normal file
@@ -0,0 +1,39 @@
|
||||
---
|
||||
base_model:
|
||||
- Tesslate/UIGEN-T2-7B
|
||||
tags:
|
||||
- qwen2
|
||||
- ui-generation
|
||||
- tailwind-css
|
||||
- html
|
||||
license: apache-2.0
|
||||
language:
|
||||
- en
|
||||
pipeline_tag: text-generation
|
||||
---
|
||||
# Melvin56/UIGEN-T2-7B-GGUF
|
||||
|
||||
Original Model : [Tesslate/UIGEN-T2-7B](https://huggingface.co/Tesslate/UIGEN-T2-7B)
|
||||
|
||||
Llama.cpp build: 5219 (7d3af70b)
|
||||
|
||||
I used imatrix to create all these quants using this [Dataset](https://gist.github.com/bartowski1182/eb213dccb3571f863da82e99418f81e8).
|
||||
|
||||
---
|
||||
|
||||
| | CPU (AVX2) | CPU (ARM NEON) | Metal | cuBLAS | rocBLAS | SYCL | CLBlast | Vulkan | Kompute |
|
||||
| :------------ | :---------: | :------------: | :---: | :----: | :-----: | :---: | :------: | :----: | :------: |
|
||||
| K-quants | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ 🐢5 | ✅ 🐢5 | ❌ |
|
||||
| I-quants | ✅ 🐢4 | ✅ 🐢4 | ✅ 🐢4 | ✅ | ✅ | Partial¹ | ❌ | ❌ | ❌ |
|
||||
```
|
||||
✅: feature works
|
||||
🚫: feature does not work
|
||||
❓: unknown, please contribute if you can test it youself
|
||||
🐢: feature is slow
|
||||
¹: IQ3_S and IQ1_S, see #5886
|
||||
²: Only with -ngl 0
|
||||
³: Inference is 50% slower
|
||||
⁴: Slower than K-quants of comparable size
|
||||
⁵: Slower than cuBLAS/rocBLAS on similar cards
|
||||
⁶: Only q8_0 and iq4_nl
|
||||
```
|
||||
Reference in New Issue
Block a user