Files
PLLuM-12B-instruct-FP8-Dynamic/README.md

13 lines
481 B
Markdown
Raw Normal View History

---
license: apache-2.0
language:
- pl
tags:
- fp8
base_model: CYFRAGOVPL/PLLuM-12B-instruct
---
# cmsptcp/PLLuM-12B-instruct-FP8-Dynamic
The Model [cmsptcp/PLLuM-12B-instruct-FP8-Dynamic](https://huggingface.co/cmsptcp/PLLuM-12B-instruct-FP8-Dynamic) was converted to FP8 format from [CYFRAGOVPL/PLLuM-12B-instruct](https://huggingface.co/CYFRAGOVPL/PLLuM-12B-instruct) using [vllm-project/llm-compressor](https://github.com/vllm-project/llm-compressor.git) version **v0.6.0**.