Phi-3-medium-128k-instruct-bf16/README.md

language, license, license_link, pipeline_tag, tags, inference, widget

language	license	license_link	pipeline_tag	tags	inference	widget
multilingual	mit	https://huggingface.co/microsoft/Phi-3-medium-128k-instruct/resolve/main/LICENSE	text-generation	nlp code mlx	parameters temperature 0.7	messages role content user Can you provide ways to eat combinations of bananas and dragonfruits?

mlx-community/Phi-3-medium-128k-instruct-bf16

The Model mlx-community/Phi-3-medium-128k-instruct-bf16 was converted to MLX format from microsoft/Phi-3-medium-128k-instruct using mlx-lm version 0.18.1.

Use with mlx

pip install mlx-lm

from mlx_lm import load, generate

model, tokenizer = load("mlx-community/Phi-3-medium-128k-instruct-bf16")
response = generate(model, tokenizer, prompt="hello", verbose=True)