model_name, base_model, model_creator, quantized_by, library_name
| model_name | base_model | model_creator | quantized_by | library_name |
|---|---|---|---|---|
| DeepSeek-R1-Distill-Llama-8B | deepseek-ai/DeepSeek-R1-Distill-Llama-8B | deepseek-ai | Second State Inc. | transformers |
DeepSeek-R1-Distill-Llama-8B-GGUF
Original Model
deepseek-ai/DeepSeek-R1-Distill-Llama-8B
Run with Gaianet
Prompt template:
prompt template: llama-3-chat
Context size:
chat_ctx_size: 128000
Run with GaiaNet:
-
Quick start: https://docs.gaianet.ai/node-guide/quick-start
-
Customize your node: https://docs.gaianet.ai/node-guide/customize
Quantized with llama.cpp b4519