ModelHub XC efde24b551 初始化项目,由ModelHub XC社区提供模型
Model: NovelAI/novelai-lm-3b-508k
Source: Original Platform
2026-11-15 10:46:13 +08:00

license, language, library_name, pipeline_tag, tags
license language library_name pipeline_tag tags
gpl-2.0
en
transformers text-generation
model
novelai
legacy

NovelAI-LM-3B-508k (Clio's base model)

This is the model that Clio is based on. It was trained on our Nerdstash dataset with a context size of 2048 tokens. It is not finetuned specifically for story telling, so it might serve as a useful basis for other tasks. At the time of Clio's release, this base model was SOTA for its size according to our evaluation metrics. Comparing it to more recent completion models is more difficult, because the common set of evaluation metrics has changed.

NovelAI-LM-3B-508k metrics

We managed to find an existing model class inside Huggingface Transformers which fits the shape of our architecture, at least once an additional config flag is set, so no custom code is needed to run the model. Model files in GGUF format are provided as well.

S
Description
Model synced from source: NovelAI/novelai-lm-3b-508k
Readme
29 KiB
0 Stars 1 Watchers 0 Forks
Languages
Markdown 100%