base_model, tags, license, language, pipeline_tag
base_model tags license language pipeline_tag
Tesslate/UIGEN-T2-7B
qwen2
ui-generation
tailwind-css
html
apache-2.0
en
text-generation

Melvin56/UIGEN-T2-7B-GGUF

Original Model : Tesslate/UIGEN-T2-7B

Llama.cpp build: 5219 (7d3af70b)

I used imatrix to create all these quants using this Dataset.


CPU (AVX2) CPU (ARM NEON) Metal cuBLAS rocBLAS SYCL CLBlast Vulkan Kompute
K-quants ✅ ✅ ✅ ✅ ✅ ✅ ✅ 🐢5 ✅ 🐢5 ❌
I-quants ✅ 🐢4 ✅ 🐢4 ✅ 🐢4 ✅ ✅ Partial¹ ❌ ❌ ❌
✅: feature works
🚫: feature does not work
❓: unknown, please contribute if you can test it youself
🐢: feature is slow
¹: IQ3_S and IQ1_S, see #5886
²: Only with -ngl 0
³: Inference is 50% slower
⁴: Slower than K-quants of comparable size
⁵: Slower than cuBLAS/rocBLAS on similar cards
⁶: Only q8_0 and iq4_nl
Description
Model synced from source: Melvin56/UIGEN-T2-7B-GGUF
Readme 26 KiB