brittlewis12/Starlette-1-3B-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: brittlewis12/Starlette-1-3B-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-10-24 04:47:16 +08:00
commit 1cb437f15e
31 changed files with 224 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

64
.gitattributes vendored Normal file
View File

@@ -0,0 +1,64 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
starlette-1-3b.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
starlette-1-3b.f16.gguf filter=lfs diff=lfs merge=lfs -text
starlette-1-3b.imatrix filter=lfs diff=lfs merge=lfs -text
starlette-1-3b.IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
starlette-1-3b.IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
starlette-1-3b.IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
starlette-1-3b.IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
starlette-1-3b.IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
starlette-1-3b.IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
starlette-1-3b.IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
starlette-1-3b.Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
starlette-1-3b.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
starlette-1-3b.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
starlette-1-3b.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
starlette-1-3b.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
starlette-1-3b.Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
starlette-1-3b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
starlette-1-3b.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
starlette-1-3b.Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
starlette-1-3b.Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
starlette-1-3b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
starlette-1-3b.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
starlette-1-3b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
starlette-1-3b.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
starlette-1-3b.IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
starlette-1-3b.IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
starlette-1-3b.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
starlette-1-3b.IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
starlette-1-3b.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text

73
README.md Normal file
View File

@@ -0,0 +1,73 @@
---
base_model: minchyeom/Starlette-1-3B
pipeline_tag: text-generation
inference: true
language:
- en
license: llama3.2
model_creator: minchyeom
model_name: Starlette-1-3B
model_type: llama
quantized_by: brittlewis12
tags:
- reasoning
- llama
- llama3.2
---
# Starlette 1 3B GGUF
**Original model**: [Starlette-1-3B](https://huggingface.co/minchyeom/Starlette-1-3B)
**Model creator**: [minchyeom](https://huggingface.co/minchyeom)
> Shows excellent reasoning capabilities across a wide range of domains.
> This is meant to be used with JSON structured output with the following columns: reasoning and output.
This repo contains GGUF format model files for minchyeom’s Starlette 1 3B.
### What is GGUF?
GGUF is a file format for representing AI models. It is the third version of the format,
introduced by the llama.cpp team on August 21st 2023.
Converted with llama.cpp build 4730 (revision [fe163d5](https://github.com/ggerganov/llama.cpp/commits/fe163d5bf3fb8e99c96ff6d21775fa3d1daee3cf)),
using [autogguf-rs](https://github.com/brittlewis12/autogguf-rs).
### Prompt template: Llama 3 Chat
```
<|start_header_id|>system<|end_header_id|>
{{system_prompt}}<|eot_id|><|start_header_id|>user<|end_header_id|>
{{prompt}}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
```
#### Recommended System Prompt
```
You are Starlette, a curious human being.
```
---
## Download & run with [cnvrs](https://twitter.com/cnvrsai) on iPhone, iPad, and Mac!
![cnvrs.ai](https://pbs.twimg.com/profile_images/1744049151241797632/0mIP-P9e_400x400.jpg)
[cnvrs](https://testflight.apple.com/join/sFWReS7K) is the best app for private, local AI on your device:
- create & save **Characters** with custom system prompts & temperature settings
- download and experiment with any **GGUF model** you can [find on HuggingFace](https://huggingface.co/models?library=gguf)!
* or, use an API key with the chat completions-compatible model provider of your choice -- ChatGPT, Claude, Gemini, DeepSeek, & more!
- make it your own with custom **Theme colors**
- powered by Metal ⚡️ & [Llama.cpp](https://github.com/ggerganov/llama.cpp), with **haptics** during response streaming!
- **try it out** yourself today, on [Testflight](https://testflight.apple.com/join/sFWReS7K)!
* if you **already have the app**, download Starlette now!
* <cnvrsai:///models/search/hf?id=brittlewis12/Starlette-1-3B-GGUF>
- follow [cnvrs on twitter](https://twitter.com/cnvrsai) to stay up to date

3
starlette-1-3b.IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ceca37ad4bcfec3cabd8ce38a1049ac246b84ab6d9e91bade859a1cb727e0ae2
size 924191648

3
starlette-1-3b.IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6ca11177d5de91d036167e29b0d71c46e37601d12e9c44492b2d2af12fe8bd6d
size 868158368

3
starlette-1-3b.IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e6db8080451495d4fbf78bc2c0e09c6c0594d21f84fe121a64457f8fceb844ae
size 1229032352

3
starlette-1-3b.IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:215caa704b290e6ad9b767b424fae2509bdfc8e5c37a2c434f30cebf5a62b2a0
size 1154321312

3
starlette-1-3b.IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f799b1ee1b2bdaaf485b156f21d64b5ea5ee508b41f23840153df220ca81db92
size 1100549024

3
starlette-1-3b.IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:34e0b3d39a994640f1a96153ad2afd0b541449d0b43509767892be6a28c82b04
size 1017580448

3
starlette-1-3b.IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6ce57755a5fe95314d5d1d76dbf3e284f0c7f46b5a367de0e12e90b673c80c14
size 1599669152

3
starlette-1-3b.IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6441b745621d6ed3393849966c82f628206db8f67e57b8d0a3fae06c2a3f1fea
size 1542849440

3
starlette-1-3b.IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e92fdb146b47b763928364190414be01da42c08e107eaaa06012c6c343de6f7a
size 1476789152

3
starlette-1-3b.IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bdaa3ecd23fa0902c36fce23de886b15efdad3660601b2ba6a7417c4f6819637
size 1348766624

3
starlette-1-3b.IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1d39f7e706cd9f48f438d1eb5a598885c58dc3d13cb832628efd76c54124d4c6
size 1917191072

3
starlette-1-3b.IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8ff3f245e036d5463fb1a7d92bfb61f4b9f5c20dc69c9df721b5db693329dbc6
size 1829110688

3
starlette-1-3b.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c1fa93a40e1fda3736b631aff9d31565e19a364c719868d7f676eb145154fd3b
size 1363935904

3
starlette-1-3b.Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e6fc0c5a8c6abf77e48b41646c384f6e0dfb39c2be030e5abc5eeaaf32b74b9b
size 1274282912

3
starlette-1-3b.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:92f9e48bd1b2ec685937e55c294369f976f8a2a79f7407c56ab7367a831c8936
size 1815347872

3
starlette-1-3b.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2174365329bac2247ee0e1748de45ab74e8b1b080f7a288130e324fcb9704890
size 1687159456

3
starlette-1-3b.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0f5cf5155dfc94baac10a5a5bc4f546887b8fa666ab1c508e6300fc55493c802
size 1542849184

3
starlette-1-3b.Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d7673047065184eecb87cb1a7d12ea950a4059581b6fe15e2397a14a1ee042ee
size 1917190816

3
starlette-1-3b.Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8ee58be7df1fe5c2e3be842459bb1a27ef98d63896fdc61a9c293df785cc9ca1
size 2093351584

3
starlette-1-3b.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:faa97af718e58e00da2a4eb7901a248ae48da8df4ec740fbc65bb2ddc3917f6b
size 2019377824

3
starlette-1-3b.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:057faa85565cbd438b4fc1faa8e5b0cce83b9d1ea860e52fc2ae5b494adf61be
size 1928200864

3
starlette-1-3b.Q5_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f662b9a95b082383e784b66edc9bc4555542079e7c7fd1dfcaec7692ab105a2b
size 2269512352

3
starlette-1-3b.Q5_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1ace8c0af166a07f1cc71f176a8c711d80d3606addf6b9c6f6d4a07fff7764e8
size 2445673120

3
starlette-1-3b.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c3eb36e22670eb6d6e597f9bae2e59141df8a3c4e19d548b94c7cc677ba467fa
size 2322154144

3
starlette-1-3b.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0d069a813c32377d1889a10240eb03e5fa1f46a8c505b644a3845317b45fe85e
size 2269512352

3
starlette-1-3b.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:914051b6dfebc84b9a30e62dd298c8c6f4ce7befd3e449aac86974c83a246eda
size 2643853984

3
starlette-1-3b.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:98ea922edffd4193c5930e836348cfb196e3dd6df1d65fe9e269015286c098ef
size 3421899424

3
starlette-1-3b.f16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:893eed802746c8f4ecaece852ddc1066357dfb3aa748333f8445a20bbc59a7b5
size 6433688224

3
starlette-1-3b.imatrix Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:76ecc3cb8eb95f055cef1de2aa2f6f7631cfa3de18c96798acd223518f331366
size 2988374