74 lines
2.4 KiB
Markdown
74 lines
2.4 KiB
Markdown
---
|
||
base_model: minchyeom/Starlette-1-3B
|
||
pipeline_tag: text-generation
|
||
inference: true
|
||
language:
|
||
- en
|
||
license: llama3.2
|
||
model_creator: minchyeom
|
||
model_name: Starlette-1-3B
|
||
model_type: llama
|
||
quantized_by: brittlewis12
|
||
tags:
|
||
- reasoning
|
||
- llama
|
||
- llama3.2
|
||
|
||
---
|
||
|
||
# Starlette 1 3B GGUF
|
||
|
||
**Original model**: [Starlette-1-3B](https://huggingface.co/minchyeom/Starlette-1-3B)
|
||
|
||
**Model creator**: [minchyeom](https://huggingface.co/minchyeom)
|
||
|
||
> Shows excellent reasoning capabilities across a wide range of domains.
|
||
|
||
> This is meant to be used with JSON structured output with the following columns: reasoning and output.
|
||
|
||
This repo contains GGUF format model files for minchyeom’s Starlette 1 3B.
|
||
|
||
### What is GGUF?
|
||
|
||
GGUF is a file format for representing AI models. It is the third version of the format,
|
||
introduced by the llama.cpp team on August 21st 2023.
|
||
|
||
Converted with llama.cpp build 4730 (revision [fe163d5](https://github.com/ggerganov/llama.cpp/commits/fe163d5bf3fb8e99c96ff6d21775fa3d1daee3cf)),
|
||
using [autogguf-rs](https://github.com/brittlewis12/autogguf-rs).
|
||
|
||
### Prompt template: Llama 3 Chat
|
||
|
||
```
|
||
<|start_header_id|>system<|end_header_id|>
|
||
|
||
{{system_prompt}}<|eot_id|><|start_header_id|>user<|end_header_id|>
|
||
|
||
{{prompt}}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
|
||
|
||
|
||
```
|
||
|
||
#### Recommended System Prompt
|
||
|
||
```
|
||
You are Starlette, a curious human being.
|
||
```
|
||
|
||
---
|
||
|
||
## Download & run with [cnvrs](https://twitter.com/cnvrsai) on iPhone, iPad, and Mac!
|
||
|
||
|
||
|
||
[cnvrs](https://testflight.apple.com/join/sFWReS7K) is the best app for private, local AI on your device:
|
||
- create & save **Characters** with custom system prompts & temperature settings
|
||
- download and experiment with any **GGUF model** you can [find on HuggingFace](https://huggingface.co/models?library=gguf)!
|
||
* or, use an API key with the chat completions-compatible model provider of your choice -- ChatGPT, Claude, Gemini, DeepSeek, & more!
|
||
- make it your own with custom **Theme colors**
|
||
- powered by Metal ⚡️ & [Llama.cpp](https://github.com/ggerganov/llama.cpp), with **haptics** during response streaming!
|
||
- **try it out** yourself today, on [Testflight](https://testflight.apple.com/join/sFWReS7K)!
|
||
* if you **already have the app**, download Starlette now!
|
||
* <cnvrsai:///models/search/hf?id=brittlewis12/Starlette-1-3B-GGUF>
|
||
- follow [cnvrs on twitter](https://twitter.com/cnvrsai) to stay up to date
|
||
|