40 lines
1.1 KiB
Markdown
40 lines
1.1 KiB
Markdown
---
|
|
license: apache-2.0
|
|
pipeline_tag: text-generation
|
|
tags:
|
|
- cortex.cpp
|
|
---
|
|
|
|
## Overview
|
|
|
|
The [TinyLlama](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0) project aims to pretrain a 1.1B Llama model on 3 trillion tokens. This is the chat model finetuned on a diverse range of synthetic dialogues generated by ChatGPT.
|
|
|
|
## Variants
|
|
|
|
| No | Variant | Cortex CLI command |
|
|
| --- | --- | --- |
|
|
| 1 | [TinyLLama-1b](https://huggingface.co/cortexso/tinyllama/tree/1b) | `cortex run tinyllama:1b` |
|
|
|
|
|
|
## Use it with Jan (UI)
|
|
|
|
1. Install **Jan** using [Quickstart](https://jan.ai/docs/quickstart)
|
|
2. Use in Jan model Hub:
|
|
```bash
|
|
cortexhub/tinyllama
|
|
```
|
|
|
|
## Use it with Cortex (CLI)
|
|
|
|
1. Install **Cortex** using [Quickstart](https://cortex.jan.ai/docs/quickstart)
|
|
2. Run the model with command:
|
|
```bash
|
|
cortex run tinyllama
|
|
```
|
|
|
|
## Credits
|
|
|
|
- **Author:** Microsoft
|
|
- **Converter:** [Homebrew](https://www.homebrew.ltd/)
|
|
- **Original License:** [License](https://choosealicense.com/licenses/apache-2.0/)
|
|
- **Papers:** [Tinyllama Paper](https://arxiv.org/abs/2401.02385) |