N.B.

This is not a pretrained llama model.

It is simply the last two layers of llama model and it will not give meaningful predictions without further pretraining!