LFM2-8B-A1B-GGUF/README.md

library_name, license, license_name, license_link, language, pipeline_tag, tags, base_model

library_name	license	license_name	license_link	language	pipeline_tag	tags	base_model
transformers	other	lfm1.0	LICENSE	en ar zh fr de ja ko es	text-generation	liquid lfm2 edge moe llama.cpp gguf	LiquidAI/LFM2-8B-A1B

Try LFM • Documentation • LEAP

LFM2-8B-A1B-GGUF

LFM2 is a new generation of hybrid models developed by Liquid AI, specifically designed for edge AI and on-device deployment. It sets a new standard in terms of quality, speed, and memory efficiency.

We're releasing the weights of our first MoE based on LFM2, with 8.3B total parameters and 1.5B active parameters.

• LFM2-8B-A1B is the best on-device MoE in terms of both quality (comparable to 3-4B dense models) and speed (faster than Qwen3-1.7B).
• Code and knowledge capabilities are significantly improved compared to LFM2-2.6B.
• Quantized variants fit comfortably on high-end phones, tablets, and laptops.

Find more information about LFM2-8B-A1B in our blog post.

🏃 How to run LFM2

Example usage with llama.cpp:

llama-cli -hf LiquidAI/LFM2-8B-A1B-GGUF