初始化项目,由ModelHub XC社区提供模型
Model: brittlewis12/Starlette-1-3B-GGUF Source: Original Platform
This commit is contained in:
64
.gitattributes
vendored
Normal file
64
.gitattributes
vendored
Normal file
@@ -0,0 +1,64 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
starlette-1-3b.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
starlette-1-3b.f16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
starlette-1-3b.imatrix filter=lfs diff=lfs merge=lfs -text
|
||||||
|
starlette-1-3b.IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
starlette-1-3b.IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
starlette-1-3b.IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
starlette-1-3b.IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
starlette-1-3b.IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
starlette-1-3b.IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
starlette-1-3b.IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
starlette-1-3b.Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
starlette-1-3b.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
starlette-1-3b.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
starlette-1-3b.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
starlette-1-3b.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
starlette-1-3b.Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
starlette-1-3b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
starlette-1-3b.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
starlette-1-3b.Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
starlette-1-3b.Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
starlette-1-3b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
starlette-1-3b.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
starlette-1-3b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
starlette-1-3b.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
starlette-1-3b.IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
starlette-1-3b.IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
starlette-1-3b.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
starlette-1-3b.IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
starlette-1-3b.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
73
README.md
Normal file
73
README.md
Normal file
@@ -0,0 +1,73 @@
|
|||||||
|
---
|
||||||
|
base_model: minchyeom/Starlette-1-3B
|
||||||
|
pipeline_tag: text-generation
|
||||||
|
inference: true
|
||||||
|
language:
|
||||||
|
- en
|
||||||
|
license: llama3.2
|
||||||
|
model_creator: minchyeom
|
||||||
|
model_name: Starlette-1-3B
|
||||||
|
model_type: llama
|
||||||
|
quantized_by: brittlewis12
|
||||||
|
tags:
|
||||||
|
- reasoning
|
||||||
|
- llama
|
||||||
|
- llama3.2
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
# Starlette 1 3B GGUF
|
||||||
|
|
||||||
|
**Original model**: [Starlette-1-3B](https://huggingface.co/minchyeom/Starlette-1-3B)
|
||||||
|
|
||||||
|
**Model creator**: [minchyeom](https://huggingface.co/minchyeom)
|
||||||
|
|
||||||
|
> Shows excellent reasoning capabilities across a wide range of domains.
|
||||||
|
|
||||||
|
> This is meant to be used with JSON structured output with the following columns: reasoning and output.
|
||||||
|
|
||||||
|
This repo contains GGUF format model files for minchyeom’s Starlette 1 3B.
|
||||||
|
|
||||||
|
### What is GGUF?
|
||||||
|
|
||||||
|
GGUF is a file format for representing AI models. It is the third version of the format,
|
||||||
|
introduced by the llama.cpp team on August 21st 2023.
|
||||||
|
|
||||||
|
Converted with llama.cpp build 4730 (revision [fe163d5](https://github.com/ggerganov/llama.cpp/commits/fe163d5bf3fb8e99c96ff6d21775fa3d1daee3cf)),
|
||||||
|
using [autogguf-rs](https://github.com/brittlewis12/autogguf-rs).
|
||||||
|
|
||||||
|
### Prompt template: Llama 3 Chat
|
||||||
|
|
||||||
|
```
|
||||||
|
<|start_header_id|>system<|end_header_id|>
|
||||||
|
|
||||||
|
{{system_prompt}}<|eot_id|><|start_header_id|>user<|end_header_id|>
|
||||||
|
|
||||||
|
{{prompt}}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
|
||||||
|
|
||||||
|
|
||||||
|
```
|
||||||
|
|
||||||
|
#### Recommended System Prompt
|
||||||
|
|
||||||
|
```
|
||||||
|
You are Starlette, a curious human being.
|
||||||
|
```
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Download & run with [cnvrs](https://twitter.com/cnvrsai) on iPhone, iPad, and Mac!
|
||||||
|
|
||||||
|

|
||||||
|
|
||||||
|
[cnvrs](https://testflight.apple.com/join/sFWReS7K) is the best app for private, local AI on your device:
|
||||||
|
- create & save **Characters** with custom system prompts & temperature settings
|
||||||
|
- download and experiment with any **GGUF model** you can [find on HuggingFace](https://huggingface.co/models?library=gguf)!
|
||||||
|
* or, use an API key with the chat completions-compatible model provider of your choice -- ChatGPT, Claude, Gemini, DeepSeek, & more!
|
||||||
|
- make it your own with custom **Theme colors**
|
||||||
|
- powered by Metal ⚡️ & [Llama.cpp](https://github.com/ggerganov/llama.cpp), with **haptics** during response streaming!
|
||||||
|
- **try it out** yourself today, on [Testflight](https://testflight.apple.com/join/sFWReS7K)!
|
||||||
|
* if you **already have the app**, download Starlette now!
|
||||||
|
* <cnvrsai:///models/search/hf?id=brittlewis12/Starlette-1-3B-GGUF>
|
||||||
|
- follow [cnvrs on twitter](https://twitter.com/cnvrsai) to stay up to date
|
||||||
|
|
||||||
3
starlette-1-3b.IQ1_M.gguf
Normal file
3
starlette-1-3b.IQ1_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:ceca37ad4bcfec3cabd8ce38a1049ac246b84ab6d9e91bade859a1cb727e0ae2
|
||||||
|
size 924191648
|
||||||
3
starlette-1-3b.IQ1_S.gguf
Normal file
3
starlette-1-3b.IQ1_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:6ca11177d5de91d036167e29b0d71c46e37601d12e9c44492b2d2af12fe8bd6d
|
||||||
|
size 868158368
|
||||||
3
starlette-1-3b.IQ2_M.gguf
Normal file
3
starlette-1-3b.IQ2_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:e6db8080451495d4fbf78bc2c0e09c6c0594d21f84fe121a64457f8fceb844ae
|
||||||
|
size 1229032352
|
||||||
3
starlette-1-3b.IQ2_S.gguf
Normal file
3
starlette-1-3b.IQ2_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:215caa704b290e6ad9b767b424fae2509bdfc8e5c37a2c434f30cebf5a62b2a0
|
||||||
|
size 1154321312
|
||||||
3
starlette-1-3b.IQ2_XS.gguf
Normal file
3
starlette-1-3b.IQ2_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:f799b1ee1b2bdaaf485b156f21d64b5ea5ee508b41f23840153df220ca81db92
|
||||||
|
size 1100549024
|
||||||
3
starlette-1-3b.IQ2_XXS.gguf
Normal file
3
starlette-1-3b.IQ2_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:34e0b3d39a994640f1a96153ad2afd0b541449d0b43509767892be6a28c82b04
|
||||||
|
size 1017580448
|
||||||
3
starlette-1-3b.IQ3_M.gguf
Normal file
3
starlette-1-3b.IQ3_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:6ce57755a5fe95314d5d1d76dbf3e284f0c7f46b5a367de0e12e90b673c80c14
|
||||||
|
size 1599669152
|
||||||
3
starlette-1-3b.IQ3_S.gguf
Normal file
3
starlette-1-3b.IQ3_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:6441b745621d6ed3393849966c82f628206db8f67e57b8d0a3fae06c2a3f1fea
|
||||||
|
size 1542849440
|
||||||
3
starlette-1-3b.IQ3_XS.gguf
Normal file
3
starlette-1-3b.IQ3_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:e92fdb146b47b763928364190414be01da42c08e107eaaa06012c6c343de6f7a
|
||||||
|
size 1476789152
|
||||||
3
starlette-1-3b.IQ3_XXS.gguf
Normal file
3
starlette-1-3b.IQ3_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:bdaa3ecd23fa0902c36fce23de886b15efdad3660601b2ba6a7417c4f6819637
|
||||||
|
size 1348766624
|
||||||
3
starlette-1-3b.IQ4_NL.gguf
Normal file
3
starlette-1-3b.IQ4_NL.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:1d39f7e706cd9f48f438d1eb5a598885c58dc3d13cb832628efd76c54124d4c6
|
||||||
|
size 1917191072
|
||||||
3
starlette-1-3b.IQ4_XS.gguf
Normal file
3
starlette-1-3b.IQ4_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:8ff3f245e036d5463fb1a7d92bfb61f4b9f5c20dc69c9df721b5db693329dbc6
|
||||||
|
size 1829110688
|
||||||
3
starlette-1-3b.Q2_K.gguf
Normal file
3
starlette-1-3b.Q2_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:c1fa93a40e1fda3736b631aff9d31565e19a364c719868d7f676eb145154fd3b
|
||||||
|
size 1363935904
|
||||||
3
starlette-1-3b.Q2_K_S.gguf
Normal file
3
starlette-1-3b.Q2_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:e6fc0c5a8c6abf77e48b41646c384f6e0dfb39c2be030e5abc5eeaaf32b74b9b
|
||||||
|
size 1274282912
|
||||||
3
starlette-1-3b.Q3_K_L.gguf
Normal file
3
starlette-1-3b.Q3_K_L.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:92f9e48bd1b2ec685937e55c294369f976f8a2a79f7407c56ab7367a831c8936
|
||||||
|
size 1815347872
|
||||||
3
starlette-1-3b.Q3_K_M.gguf
Normal file
3
starlette-1-3b.Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:2174365329bac2247ee0e1748de45ab74e8b1b080f7a288130e324fcb9704890
|
||||||
|
size 1687159456
|
||||||
3
starlette-1-3b.Q3_K_S.gguf
Normal file
3
starlette-1-3b.Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:0f5cf5155dfc94baac10a5a5bc4f546887b8fa666ab1c508e6300fc55493c802
|
||||||
|
size 1542849184
|
||||||
3
starlette-1-3b.Q4_0.gguf
Normal file
3
starlette-1-3b.Q4_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:d7673047065184eecb87cb1a7d12ea950a4059581b6fe15e2397a14a1ee042ee
|
||||||
|
size 1917190816
|
||||||
3
starlette-1-3b.Q4_1.gguf
Normal file
3
starlette-1-3b.Q4_1.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:8ee58be7df1fe5c2e3be842459bb1a27ef98d63896fdc61a9c293df785cc9ca1
|
||||||
|
size 2093351584
|
||||||
3
starlette-1-3b.Q4_K_M.gguf
Normal file
3
starlette-1-3b.Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:faa97af718e58e00da2a4eb7901a248ae48da8df4ec740fbc65bb2ddc3917f6b
|
||||||
|
size 2019377824
|
||||||
3
starlette-1-3b.Q4_K_S.gguf
Normal file
3
starlette-1-3b.Q4_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:057faa85565cbd438b4fc1faa8e5b0cce83b9d1ea860e52fc2ae5b494adf61be
|
||||||
|
size 1928200864
|
||||||
3
starlette-1-3b.Q5_0.gguf
Normal file
3
starlette-1-3b.Q5_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:f662b9a95b082383e784b66edc9bc4555542079e7c7fd1dfcaec7692ab105a2b
|
||||||
|
size 2269512352
|
||||||
3
starlette-1-3b.Q5_1.gguf
Normal file
3
starlette-1-3b.Q5_1.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:1ace8c0af166a07f1cc71f176a8c711d80d3606addf6b9c6f6d4a07fff7764e8
|
||||||
|
size 2445673120
|
||||||
3
starlette-1-3b.Q5_K_M.gguf
Normal file
3
starlette-1-3b.Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:c3eb36e22670eb6d6e597f9bae2e59141df8a3c4e19d548b94c7cc677ba467fa
|
||||||
|
size 2322154144
|
||||||
3
starlette-1-3b.Q5_K_S.gguf
Normal file
3
starlette-1-3b.Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:0d069a813c32377d1889a10240eb03e5fa1f46a8c505b644a3845317b45fe85e
|
||||||
|
size 2269512352
|
||||||
3
starlette-1-3b.Q6_K.gguf
Normal file
3
starlette-1-3b.Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:914051b6dfebc84b9a30e62dd298c8c6f4ce7befd3e449aac86974c83a246eda
|
||||||
|
size 2643853984
|
||||||
3
starlette-1-3b.Q8_0.gguf
Normal file
3
starlette-1-3b.Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:98ea922edffd4193c5930e836348cfb196e3dd6df1d65fe9e269015286c098ef
|
||||||
|
size 3421899424
|
||||||
3
starlette-1-3b.f16.gguf
Normal file
3
starlette-1-3b.f16.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:893eed802746c8f4ecaece852ddc1066357dfb3aa748333f8445a20bbc59a7b5
|
||||||
|
size 6433688224
|
||||||
3
starlette-1-3b.imatrix
Normal file
3
starlette-1-3b.imatrix
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:76ecc3cb8eb95f055cef1de2aa2f6f7631cfa3de18c96798acd223518f331366
|
||||||
|
size 2988374
|
||||||
Reference in New Issue
Block a user