33 lines
996 B
Markdown
33 lines
996 B
Markdown
---
|
|
license: mit
|
|
base_model:
|
|
- ServiceNow-AI/Apriel-5B-Instruct
|
|
pipeline_tag: text-generation
|
|
library_name: transformers
|
|
---
|
|
|
|
* **Apriel 5B Instruct (Llamafied)**
|
|
* [Apriel 5B Base (Llamafied)](https://huggingface.co/mrfakename/Apriel-5B-Base-llamafied)
|
|
|
|
# Apriel 5B Instruct (Llamafied)
|
|
|
|
An approximate conversion of [Apriel 5B Instruct](https://huggingface.co/ServiceNow-AI/Apriel-5B-Instruct) to the Llama format.
|
|
|
|
* No `trust_remote_code` required
|
|
* Compatible w/ popular fine-tuning frameworks
|
|
* Easier to run
|
|
|
|
Usage:
|
|
|
|
```python
|
|
from transformers import pipeline
|
|
import torch
|
|
|
|
device = 'cuda' if torch.cuda.is_available() else 'mps' if torch.backends.mps.is_available() else 'cpu'
|
|
|
|
pipe = pipeline('text-generation', model='mrfakename/Apriel-5B-Instruct-llamafied', device=device)
|
|
|
|
print(pipe(pipe.tokenizer.apply_chat_template([{'role': 'user', 'content': 'Hello'}], tokenize=False, add_generation_prompt=True))[0]['generated_text'])
|
|
```
|
|
|
|
License: MIT (same as the original Apriel 5B model) |