2024-12-20 12:26:24 +00:00
---
2024-12-20 20:36:00 +08:00
language:
- multilingual
license: mit
license_link: https://huggingface.co/microsoft/Phi-3-medium-128k-instruct/resolve/main/LICENSE
pipeline_tag: text-generation
tags:
- nlp
- code
- mlx
inference:
parameters:
temperature: 0.7
widget:
- messages:
- role: user
content: Can you provide ways to eat combinations of bananas and dragonfruits?
---
2024-12-20 12:26:24 +00:00
2024-12-20 20:36:00 +08:00
# mlx-community/Phi-3-medium-128k-instruct-bf16
2024-12-20 12:26:24 +00:00
2024-12-20 20:36:00 +08:00
The Model [mlx-community/Phi-3-medium-128k-instruct-bf16 ](https://huggingface.co/mlx-community/Phi-3-medium-128k-instruct-bf16 ) was converted to MLX format from [microsoft/Phi-3-medium-128k-instruct ](https://huggingface.co/microsoft/Phi-3-medium-128k-instruct ) using mlx-lm version **0.18.1** .
2024-12-20 12:26:24 +00:00
2024-12-20 20:36:00 +08:00
## Use with mlx
2024-12-20 12:26:24 +00:00
```bash
2024-12-20 20:36:00 +08:00
pip install mlx-lm
2024-12-20 12:26:24 +00:00
```
2024-12-20 20:36:00 +08:00
2024-12-20 12:26:24 +00:00
```python
2024-12-20 20:36:00 +08:00
from mlx_lm import load, generate
2024-12-20 12:26:24 +00:00
2024-12-20 20:36:00 +08:00
model, tokenizer = load("mlx-community/Phi-3-medium-128k-instruct-bf16")
response = generate(model, tokenizer, prompt="hello", verbose=True)
```