27 lines
517 B
Markdown
27 lines
517 B
Markdown
---
|
|
tags:
|
|
- quantized
|
|
- 2-bit
|
|
- 3-bit
|
|
- 4-bit
|
|
- 5-bit
|
|
- 6-bit
|
|
- 8-bit
|
|
- GGUF
|
|
- transformers
|
|
- pytorch
|
|
- qwen2
|
|
- text-generation
|
|
- conversational
|
|
- autotrain_compatible
|
|
- endpoints_compatible
|
|
- text-generation-inference
|
|
- text-generation
|
|
license: other
|
|
license_name: tongyi-qianwen
|
|
license_link: https://huggingface.co/Qwen/Qwen1.5-72B-Chat/blob/main/LICENSE
|
|
library_name: transformers
|
|
inference: false
|
|
pipeline_tag: text-generation
|
|
---
|
|
I got broken models when use the k quantize so there's no k quantized models(sad) |