Files
phi-3-mini-4k-instruct.Q4_0…/README.md

8 lines
351 B
Markdown
Raw Normal View History

---
license: mit
---
4 bits quantized GGUF weight of phi-3-mini-4k-instruct. Mlx compatible.
Official model: https://huggingface.co/microsoft/Phi-3-mini-4k-instruct-gguf (not supported by mlx)
Please note that the official phi-3-mini-4k-instruct.gguf model is of llama-2 architecture as stated in the paper (https://huggingface.co/papers/2404.14219)