HiTOP-Llama-3B_4bit/README.md

base_model, tags, license, language

base_model	tags	license	language
unsloth/llama-3.2-3b-bnb-4bit	text-generation-inference transformers unsloth llama	apache-2.0	en

!pip install git+https://github.com/Fede-stack/TONYpy.git

from TONY.HiTOP import HiTOP_Predictor
text = 'Some days I keep living, even though I feel completely alone in the world'
hitop = HiTOP_Predictor(model_name='FritzStack/HiTOP-Llama-3B_4bit')
hitop.predict_HiTOP(text)