60 lines
1.5 KiB
Markdown
60 lines
1.5 KiB
Markdown
|
---
|
||
|
|
library_name: gguf
|
||
|
|
license: other
|
||
|
|
license_name: lfm1.0
|
||
|
|
license_link: LICENSE
|
||
|
|
language:
|
||
|
|
- ar
|
||
|
|
- zh
|
||
|
|
- en
|
||
|
|
- fr
|
||
|
|
- de
|
||
|
|
- hi
|
||
|
|
- id
|
||
|
|
- it
|
||
|
|
- ja
|
||
|
|
- ko
|
||
|
|
- pl
|
||
|
|
- pt
|
||
|
|
- ru
|
||
|
|
- es
|
||
|
|
- th
|
||
|
|
- vi
|
||
|
|
pipeline_tag: text-generation
|
||
|
|
base_model: LiquidAI/LFM2.5-2.6B
|
||
|
|
tags:
|
||
|
|
- liquid
|
||
|
|
- lfm2.5
|
||
|
|
- gguf
|
||
|
|
- llama.cpp
|
||
|
|
---
|
||
|
|
|
||
|
|
<div align="center">
|
||
|
|
<img
|
||
|
|
src="https://cdn-uploads.huggingface.co/production/uploads/61b8e2ba285851687028d395/2b08LKpev0DNEk6DlnWkY.png"
|
||
|
|
alt="Liquid AI"
|
||
|
|
style="width: 100%; max-width: 100%; height: auto; display: inline-block; margin-bottom: 0.5em; margin-top: 0.5em;"
|
||
|
|
/>
|
||
|
|
<div style="display: flex; justify-content: center; gap: 0.5em; margin-bottom: 1em;">
|
||
|
|
<a href="https://playground.liquid.ai/"><strong>Try LFM</strong></a> •
|
||
|
|
<a href="https://docs.liquid.ai/lfm/getting-started/welcome"><strong>Docs</strong></a> •
|
||
|
|
<a href="https://leap.liquid.ai/"><strong>LEAP</strong></a> •
|
||
|
|
<a href="https://discord.com/invite/liquid-ai"><strong>Discord</strong></a>
|
||
|
|
</div>
|
||
|
|
</div>
|
||
|
|
|
||
|
|
# LFM2.5-2.6B-GGUF
|
||
|
|
|
||
|
|
LFM2.5 is a new family of hybrid models designed for **on-device deployment**. It builds on the LFM2 architecture with extended pre-training and reinforcement learning.
|
||
|
|
|
||
|
|
Find more details in the original model card: https://huggingface.co/LiquidAI/LFM2.5-2.6B
|
||
|
|
|
||
|
|
## 🏃 How to run LFM2
|
||
|
|
|
||
|
|
Example usage with [llama.cpp](https://github.com/ggml-org/llama.cpp):
|
||
|
|
|
||
|
|
```
|
||
|
|
llama-cli -hf LiquidAI/LFM2.5-2.6B-GGUF -c 4096 --color -i \
|
||
|
|
--temp 0.1 --top-k 50 --repeat-penalty 1.1
|
||
|
|
```
|