base_model, base_model_relation, license, pipeline_tag, quantized_by, tags, language
base_model base_model_relation license pipeline_tag quantized_by tags language
Vikhrmodels/Vikhr-Nemo-12B-Instruct-R-21-09-24 quantized apache-2.0 text-generation qilowoq
gptq
en
ru

Vikhrmodels/Vikhr-Nemo-12B-Instruct-R-21-09-24-4Bit-GPTQ

Quantization

  • This model was quantized with the Auto-GPTQ library and dataset containing english and russian wikipedia articles. It has lower perplexity on russian data then other GPTQ models.
Description
Model synced from source: qilowoq/Vikhr-Nemo-12B-Instruct-R-21-09-24-4Bit-GPTQ
Readme 5.5 MiB