初始化项目,由ModelHub XC社区提供模型
Model: cortexso/tinyllama Source: Original Platform
This commit is contained in:
40
README.md
Normal file
40
README.md
Normal file
@@ -0,0 +1,40 @@
|
||||
---
|
||||
license: apache-2.0
|
||||
pipeline_tag: text-generation
|
||||
tags:
|
||||
- cortex.cpp
|
||||
---
|
||||
|
||||
## Overview
|
||||
|
||||
The [TinyLlama](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0) project aims to pretrain a 1.1B Llama model on 3 trillion tokens. This is the chat model finetuned on a diverse range of synthetic dialogues generated by ChatGPT.
|
||||
|
||||
## Variants
|
||||
|
||||
| No | Variant | Cortex CLI command |
|
||||
| --- | --- | --- |
|
||||
| 1 | [TinyLLama-1b](https://huggingface.co/cortexso/tinyllama/tree/1b) | `cortex run tinyllama:1b` |
|
||||
|
||||
|
||||
## Use it with Jan (UI)
|
||||
|
||||
1. Install **Jan** using [Quickstart](https://jan.ai/docs/quickstart)
|
||||
2. Use in Jan model Hub:
|
||||
```bash
|
||||
cortexhub/tinyllama
|
||||
```
|
||||
|
||||
## Use it with Cortex (CLI)
|
||||
|
||||
1. Install **Cortex** using [Quickstart](https://cortex.jan.ai/docs/quickstart)
|
||||
2. Run the model with command:
|
||||
```bash
|
||||
cortex run tinyllama
|
||||
```
|
||||
|
||||
## Credits
|
||||
|
||||
- **Author:** Microsoft
|
||||
- **Converter:** [Homebrew](https://www.homebrew.ltd/)
|
||||
- **Original License:** [License](https://choosealicense.com/licenses/apache-2.0/)
|
||||
- **Papers:** [Tinyllama Paper](https://arxiv.org/abs/2401.02385)
|
||||
Reference in New Issue
Block a user