74 lines
2.4 KiB
Markdown
74 lines
2.4 KiB
Markdown
|
---
|
|||
|
|
base_model: minchyeom/Starlette-1-3B
|
|||
|
|
pipeline_tag: text-generation
|
|||
|
|
inference: true
|
|||
|
|
language:
|
|||
|
|
- en
|
|||
|
|
license: llama3.2
|
|||
|
|
model_creator: minchyeom
|
|||
|
|
model_name: Starlette-1-3B
|
|||
|
|
model_type: llama
|
|||
|
|
quantized_by: brittlewis12
|
|||
|
|
tags:
|
|||
|
|
- reasoning
|
|||
|
|
- llama
|
|||
|
|
- llama3.2
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
# Starlette 1 3B GGUF
|
|||
|
|
|
|||
|
|
**Original model**: [Starlette-1-3B](https://huggingface.co/minchyeom/Starlette-1-3B)
|
|||
|
|
|
|||
|
|
**Model creator**: [minchyeom](https://huggingface.co/minchyeom)
|
|||
|
|
|
|||
|
|
> Shows excellent reasoning capabilities across a wide range of domains.
|
|||
|
|
|
|||
|
|
> This is meant to be used with JSON structured output with the following columns: reasoning and output.
|
|||
|
|
|
|||
|
|
This repo contains GGUF format model files for minchyeom’s Starlette 1 3B.
|
|||
|
|
|
|||
|
|
### What is GGUF?
|
|||
|
|
|
|||
|
|
GGUF is a file format for representing AI models. It is the third version of the format,
|
|||
|
|
introduced by the llama.cpp team on August 21st 2023.
|
|||
|
|
|
|||
|
|
Converted with llama.cpp build 4730 (revision [fe163d5](https://github.com/ggerganov/llama.cpp/commits/fe163d5bf3fb8e99c96ff6d21775fa3d1daee3cf)),
|
|||
|
|
using [autogguf-rs](https://github.com/brittlewis12/autogguf-rs).
|
|||
|
|
|
|||
|
|
### Prompt template: Llama 3 Chat
|
|||
|
|
|
|||
|
|
```
|
|||
|
|
<|start_header_id|>system<|end_header_id|>
|
|||
|
|
|
|||
|
|
{{system_prompt}}<|eot_id|><|start_header_id|>user<|end_header_id|>
|
|||
|
|
|
|||
|
|
{{prompt}}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
|
|||
|
|
|
|||
|
|
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
#### Recommended System Prompt
|
|||
|
|
|
|||
|
|
```
|
|||
|
|
You are Starlette, a curious human being.
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
## Download & run with [cnvrs](https://twitter.com/cnvrsai) on iPhone, iPad, and Mac!
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
[cnvrs](https://testflight.apple.com/join/sFWReS7K) is the best app for private, local AI on your device:
|
|||
|
|
- create & save **Characters** with custom system prompts & temperature settings
|
|||
|
|
- download and experiment with any **GGUF model** you can [find on HuggingFace](https://huggingface.co/models?library=gguf)!
|
|||
|
|
* or, use an API key with the chat completions-compatible model provider of your choice -- ChatGPT, Claude, Gemini, DeepSeek, & more!
|
|||
|
|
- make it your own with custom **Theme colors**
|
|||
|
|
- powered by Metal ⚡️ & [Llama.cpp](https://github.com/ggerganov/llama.cpp), with **haptics** during response streaming!
|
|||
|
|
- **try it out** yourself today, on [Testflight](https://testflight.apple.com/join/sFWReS7K)!
|
|||
|
|
* if you **already have the app**, download Starlette now!
|
|||
|
|
* <cnvrsai:///models/search/hf?id=brittlewis12/Starlette-1-3B-GGUF>
|
|||
|
|
- follow [cnvrs on twitter](https://twitter.com/cnvrsai) to stay up to date
|
|||
|
|
|