Files

36 lines
944 B
Markdown
Raw Permalink Normal View History

2024-12-20 12:26:24 +00:00
---
language:
- multilingual
license: mit
license_link: https://huggingface.co/microsoft/Phi-3-medium-128k-instruct/resolve/main/LICENSE
pipeline_tag: text-generation
tags:
- nlp
- code
- mlx
inference:
parameters:
temperature: 0.7
widget:
- messages:
- role: user
content: Can you provide ways to eat combinations of bananas and dragonfruits?
---
2024-12-20 12:26:24 +00:00
# mlx-community/Phi-3-medium-128k-instruct-bf16
2024-12-20 12:26:24 +00:00
The Model [mlx-community/Phi-3-medium-128k-instruct-bf16](https://huggingface.co/mlx-community/Phi-3-medium-128k-instruct-bf16) was converted to MLX format from [microsoft/Phi-3-medium-128k-instruct](https://huggingface.co/microsoft/Phi-3-medium-128k-instruct) using mlx-lm version **0.18.1**.
2024-12-20 12:26:24 +00:00
## Use with mlx
2024-12-20 12:26:24 +00:00
```bash
pip install mlx-lm
2024-12-20 12:26:24 +00:00
```
2024-12-20 12:26:24 +00:00
```python
from mlx_lm import load, generate
2024-12-20 12:26:24 +00:00
model, tokenizer = load("mlx-community/Phi-3-medium-128k-instruct-bf16")
response = generate(model, tokenizer, prompt="hello", verbose=True)
```