初始化项目,由ModelHub XC社区提供模型
Model: cmsptcp/PLLuM-12B-instruct-FP8-Dynamic Source: Original Platform
This commit is contained in:
12
README.md
Normal file
12
README.md
Normal file
@@ -0,0 +1,12 @@
|
||||
---
|
||||
license: apache-2.0
|
||||
language:
|
||||
- pl
|
||||
tags:
|
||||
- fp8
|
||||
base_model: CYFRAGOVPL/PLLuM-12B-instruct
|
||||
---
|
||||
|
||||
# cmsptcp/PLLuM-12B-instruct-FP8-Dynamic
|
||||
|
||||
The Model [cmsptcp/PLLuM-12B-instruct-FP8-Dynamic](https://huggingface.co/cmsptcp/PLLuM-12B-instruct-FP8-Dynamic) was converted to FP8 format from [CYFRAGOVPL/PLLuM-12B-instruct](https://huggingface.co/CYFRAGOVPL/PLLuM-12B-instruct) using [vllm-project/llm-compressor](https://github.com/vllm-project/llm-compressor.git) version **v0.6.0**.
|
||||
Reference in New Issue
Block a user