Qwen3-0.6B-GGUF/README.md

base_model, license, license_link, model_creator, model_name, quantized_by, language, pipeline_tag, tags

base_model	license	license_link	model_creator	model_name	quantized_by	language	pipeline_tag	tags
Qwen/Qwen3-0.6B	apache-2.0	https://huggingface.co/Qwen/Qwen3-0.6B/blob/main/LICENSE	Qwen	Qwen3-0.6B	Second State Inc.	en	text-generation	chat

Qwen3-0.6B-GGUF

Original Model

Qwen/Qwen3-0.6B

Run with Gaianet

Prompt template

prompt template:

• chatml (for thinking)
• qwen3-no-think (for no thinking)

Context size

chat_ctx_size: 128000

Run with GaiaNet

• Quick start: https://docs.gaianet.ai/node-guide/quick-start

• Customize your node: https://docs.gaianet.ai/node-guide/customize

Quantized with llama.cpp b5097