mradermacher/GPT-Morty-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/GPT-Morty-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-10 04:55:01 +08:00
commit 47fb83a490
14 changed files with 154 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

47
.gitattributes vendored Normal file
View File

@@ -0,0 +1,47 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
GPT-Morty.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
GPT-Morty.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
GPT-Morty.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
GPT-Morty.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
GPT-Morty.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
GPT-Morty.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
GPT-Morty.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
GPT-Morty.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
GPT-Morty.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
GPT-Morty.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
GPT-Morty.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
GPT-Morty.f16.gguf filter=lfs diff=lfs merge=lfs -text

3
GPT-Morty.IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:725489d1adfcf7ed0b8e23026dd159ee433f4dee768213f1730a31d4b85c0ece
size 82558944

3
GPT-Morty.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:48d62d5032a202676714aea34ee1c260fdec1a022cd99dd978330bfdb5cfde50
size 68532192

3
GPT-Morty.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:88d119c848c52011fe854f5868517df6522a44451e6b8baa72598e0baffbd90a
size 85508064

3
GPT-Morty.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:207df863529c3779aead4db4bcb86fc4e5c73171059becf62ae7d8b3bddd495e
size 81084384

3
GPT-Morty.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:61e5ec7ebbce83b716e421ff3cd5980812937c8ed6f7e40c8a25591a092c30ea
size 73564128

3
GPT-Morty.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f7b1e5396c0c565198501b95d5818b30978febfc8101b1ce36bb20e3e9243a0a
size 91148256

3
GPT-Morty.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2b2b1b682444032f32a6af8693aaaea7ab15037108f10d991866bca51b8eca0a
size 85139424

3
GPT-Morty.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1eafa5c5714d8e045401b6c0e563ee467a367b40de07b41112440f7535df1634
size 100161504

3
GPT-Morty.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:614f279de375b8c43fa2c41721beff9fd18221f6fc2741afe4003d23b4eb0ded
size 95461344

3
GPT-Morty.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6ade3accd5c229e764e3b3a0f6a3aad0e54015f75dfab106c97fb00257c52741
size 106741728

3
GPT-Morty.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2da0258fb1117635a5b6c98e56e67a04c3f6eb34884e4e838799434324db5f2e
size 136659648

3
GPT-Morty.f16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:85b72c40af0f893e0a5d2431bf77159e556568386051cfa5b09d484f527dfa47
size 252470912

71
README.md Normal file
View File

@@ -0,0 +1,71 @@
---
base_model: Givinghawk/GPT-Morty
language:
- en
library_name: transformers
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- conversational
- Morty
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: -->
static quants of https://huggingface.co/Givinghawk/GPT-Morty
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#GPT-Morty-GGUF).***
weighted/imatrix quants are available at https://huggingface.co/mradermacher/GPT-Morty-i1-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/GPT-Morty-GGUF/resolve/main/GPT-Morty.Q2_K.gguf) | Q2_K | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/GPT-Morty-GGUF/resolve/main/GPT-Morty.Q3_K_S.gguf) | Q3_K_S | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/GPT-Morty-GGUF/resolve/main/GPT-Morty.Q3_K_M.gguf) | Q3_K_M | 0.2 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/GPT-Morty-GGUF/resolve/main/GPT-Morty.IQ4_XS.gguf) | IQ4_XS | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/GPT-Morty-GGUF/resolve/main/GPT-Morty.Q4_K_S.gguf) | Q4_K_S | 0.2 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/GPT-Morty-GGUF/resolve/main/GPT-Morty.Q3_K_L.gguf) | Q3_K_L | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/GPT-Morty-GGUF/resolve/main/GPT-Morty.Q4_K_M.gguf) | Q4_K_M | 0.2 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/GPT-Morty-GGUF/resolve/main/GPT-Morty.Q5_K_S.gguf) | Q5_K_S | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/GPT-Morty-GGUF/resolve/main/GPT-Morty.Q5_K_M.gguf) | Q5_K_M | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/GPT-Morty-GGUF/resolve/main/GPT-Morty.Q6_K.gguf) | Q6_K | 0.2 | very good quality |
| [GGUF](https://huggingface.co/mradermacher/GPT-Morty-GGUF/resolve/main/GPT-Morty.Q8_0.gguf) | Q8_0 | 0.2 | fast, best quality |
| [GGUF](https://huggingface.co/mradermacher/GPT-Morty-GGUF/resolve/main/GPT-Morty.f16.gguf) | f16 | 0.4 | 16 bpw, overkill |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time.
<!-- end -->