granite-4.0-1b-GGUF/README.md

license, library_name, tags, base_model

license	library_name	tags	base_model
apache-2.0	transformers	language granite-4.0 gguf	ibm-granite/granite-4.0-1b

Granite 4.0 1b (GGUF)

Note

This repository contains models that have been converted to the GGUF format with various quantizations from an IBM Granite base model.

Please reference the base model's full model card here: https://huggingface.co/ibm-granite/granite-4.0-1b

Known Issues

This model often uses the full numerical range of a 32-bit float (f32), so variants with smaller numerical ranges may run into precision errors at inference. The F16 variant is known to fail on many hardware combinations.

The recommended full-precision variant is bf16.