9466301768
- 3629499b7f0f5d9b7290ee866e480597430e728b5a87749e3f081628331fb108 (ef3eecf8ddfb0162c2a193dc2994c07dfd606c3e) - 3778ffe34626936b804e0b940cb8fb912db8599efedfbb248f87cd6511e2731b (97a423976d2218d6fe6c5a7bd6009b48cccdfbe0) - 52784d9778992d091d82d05e28031cb2405e52939b9ce4f9fac3d4c721f8ef32 (7dc0b68baaa8870615ec6ed99c53eef0fa481012) - 664bb4b330c67987c5d81579c56c62758979c0d4ab99315f6e241d2c89ff0388 (6b2044e4809bd11cc1319dfc7f7d809395fe8913) - e84d036c237c60c75bd8c1d5f1972443c9515980f827b396e18468b5eb1aaf3c (684ae7cab7c31853a134b0e25780a1fe52853325) - f1945ae592e762ecefdd284d8970a510817a9fc5d444ba694757faa3f220e791 (a4a4294e8f50f8f32f2ad62181bce43f7b616dbc)
36 lines
944 B
Markdown
36 lines
944 B
Markdown
---
|
|
language:
|
|
- multilingual
|
|
license: mit
|
|
license_link: https://huggingface.co/microsoft/Phi-3-medium-128k-instruct/resolve/main/LICENSE
|
|
pipeline_tag: text-generation
|
|
tags:
|
|
- nlp
|
|
- code
|
|
- mlx
|
|
inference:
|
|
parameters:
|
|
temperature: 0.7
|
|
widget:
|
|
- messages:
|
|
- role: user
|
|
content: Can you provide ways to eat combinations of bananas and dragonfruits?
|
|
---
|
|
|
|
# mlx-community/Phi-3-medium-128k-instruct-bf16
|
|
|
|
The Model [mlx-community/Phi-3-medium-128k-instruct-bf16](https://huggingface.co/mlx-community/Phi-3-medium-128k-instruct-bf16) was converted to MLX format from [microsoft/Phi-3-medium-128k-instruct](https://huggingface.co/microsoft/Phi-3-medium-128k-instruct) using mlx-lm version **0.18.1**.
|
|
|
|
## Use with mlx
|
|
|
|
```bash
|
|
pip install mlx-lm
|
|
```
|
|
|
|
```python
|
|
from mlx_lm import load, generate
|
|
|
|
model, tokenizer = load("mlx-community/Phi-3-medium-128k-instruct-bf16")
|
|
response = generate(model, tokenizer, prompt="hello", verbose=True)
|
|
```
|