base_model, license, library_name, model_creator, model_name, quantized_by, language
| base_model | license | library_name | model_creator | model_name | quantized_by | language | |
|---|---|---|---|---|---|---|---|
| HuggingFaceTB/SmolLM2-1.7B-Instruct | apache-2.0 | transformers | HuggingFaceTB | SmolLM2-1.7B-Instruct | Second State Inc. |
|
SmolLM2-1.7B-Instruct-GGUF
Original Model
HuggingFaceTB/SmolLM2-1.7B-Instruct
Run with Gaianet
Prompt template:
prompt template: chatml
Context size:
chat_ctx_size: 2048
Run with GaiaNet:
-
Quick start: https://docs.gaianet.ai/node-guide/quick-start
-
Customize your node: https://docs.gaianet.ai/node-guide/customize
Quantized with llama.cpp b4120