初始化项目,由ModelHub XC社区提供模型
Model: brittlewis12/Starlette-1-3B-GGUF Source: Original Platform
This commit is contained in:
73
README.md
Normal file
73
README.md
Normal file
@@ -0,0 +1,73 @@
|
||||
---
|
||||
base_model: minchyeom/Starlette-1-3B
|
||||
pipeline_tag: text-generation
|
||||
inference: true
|
||||
language:
|
||||
- en
|
||||
license: llama3.2
|
||||
model_creator: minchyeom
|
||||
model_name: Starlette-1-3B
|
||||
model_type: llama
|
||||
quantized_by: brittlewis12
|
||||
tags:
|
||||
- reasoning
|
||||
- llama
|
||||
- llama3.2
|
||||
|
||||
---
|
||||
|
||||
# Starlette 1 3B GGUF
|
||||
|
||||
**Original model**: [Starlette-1-3B](https://huggingface.co/minchyeom/Starlette-1-3B)
|
||||
|
||||
**Model creator**: [minchyeom](https://huggingface.co/minchyeom)
|
||||
|
||||
> Shows excellent reasoning capabilities across a wide range of domains.
|
||||
|
||||
> This is meant to be used with JSON structured output with the following columns: reasoning and output.
|
||||
|
||||
This repo contains GGUF format model files for minchyeom’s Starlette 1 3B.
|
||||
|
||||
### What is GGUF?
|
||||
|
||||
GGUF is a file format for representing AI models. It is the third version of the format,
|
||||
introduced by the llama.cpp team on August 21st 2023.
|
||||
|
||||
Converted with llama.cpp build 4730 (revision [fe163d5](https://github.com/ggerganov/llama.cpp/commits/fe163d5bf3fb8e99c96ff6d21775fa3d1daee3cf)),
|
||||
using [autogguf-rs](https://github.com/brittlewis12/autogguf-rs).
|
||||
|
||||
### Prompt template: Llama 3 Chat
|
||||
|
||||
```
|
||||
<|start_header_id|>system<|end_header_id|>
|
||||
|
||||
{{system_prompt}}<|eot_id|><|start_header_id|>user<|end_header_id|>
|
||||
|
||||
{{prompt}}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
|
||||
|
||||
|
||||
```
|
||||
|
||||
#### Recommended System Prompt
|
||||
|
||||
```
|
||||
You are Starlette, a curious human being.
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## Download & run with [cnvrs](https://twitter.com/cnvrsai) on iPhone, iPad, and Mac!
|
||||
|
||||

|
||||
|
||||
[cnvrs](https://testflight.apple.com/join/sFWReS7K) is the best app for private, local AI on your device:
|
||||
- create & save **Characters** with custom system prompts & temperature settings
|
||||
- download and experiment with any **GGUF model** you can [find on HuggingFace](https://huggingface.co/models?library=gguf)!
|
||||
* or, use an API key with the chat completions-compatible model provider of your choice -- ChatGPT, Claude, Gemini, DeepSeek, & more!
|
||||
- make it your own with custom **Theme colors**
|
||||
- powered by Metal ⚡️ & [Llama.cpp](https://github.com/ggerganov/llama.cpp), with **haptics** during response streaming!
|
||||
- **try it out** yourself today, on [Testflight](https://testflight.apple.com/join/sFWReS7K)!
|
||||
* if you **already have the app**, download Starlette now!
|
||||
* <cnvrsai:///models/search/hf?id=brittlewis12/Starlette-1-3B-GGUF>
|
||||
- follow [cnvrs on twitter](https://twitter.com/cnvrsai) to stay up to date
|
||||
|
||||
Reference in New Issue
Block a user