mradermacher/gpt-human-assistant-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/gpt-human-assistant-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-11 09:14:03 +08:00
commit 87396bbd66
27 changed files with 219 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
gpt-human-assistant.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
gpt-human-assistant.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
gpt-human-assistant.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
gpt-human-assistant.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
gpt-human-assistant.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
gpt-human-assistant.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gpt-human-assistant.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
gpt-human-assistant.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
gpt-human-assistant.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
gpt-human-assistant.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gpt-human-assistant.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
gpt-human-assistant.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
gpt-human-assistant.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
gpt-human-assistant.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gpt-human-assistant.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
gpt-human-assistant.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gpt-human-assistant.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gpt-human-assistant.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
gpt-human-assistant.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
gpt-human-assistant.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gpt-human-assistant.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gpt-human-assistant.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gpt-human-assistant.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gpt-human-assistant.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

84
README.md Normal file
View File

@@ -0,0 +1,84 @@
---
base_model: Isotonic/gpt-human-assistant
datasets: Isotonic/human_assistant_conversation
language:
- en
library_name: transformers
license: mit
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- generated_from_trainer
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/Isotonic/gpt-human-assistant
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#gpt-human-assistant-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/gpt-human-assistant-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/gpt-human-assistant-i1-GGUF/resolve/main/gpt-human-assistant.i1-IQ1_S.gguf) | i1-IQ1_S | 0.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/gpt-human-assistant-i1-GGUF/resolve/main/gpt-human-assistant.i1-IQ1_M.gguf) | i1-IQ1_M | 0.2 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/gpt-human-assistant-i1-GGUF/resolve/main/gpt-human-assistant.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/gpt-human-assistant-i1-GGUF/resolve/main/gpt-human-assistant.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/gpt-human-assistant-i1-GGUF/resolve/main/gpt-human-assistant.i1-IQ2_S.gguf) | i1-IQ2_S | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/gpt-human-assistant-i1-GGUF/resolve/main/gpt-human-assistant.i1-IQ2_M.gguf) | i1-IQ2_M | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/gpt-human-assistant-i1-GGUF/resolve/main/gpt-human-assistant.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.2 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/gpt-human-assistant-i1-GGUF/resolve/main/gpt-human-assistant.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.2 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/gpt-human-assistant-i1-GGUF/resolve/main/gpt-human-assistant.i1-Q2_K.gguf) | i1-Q2_K | 0.2 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/gpt-human-assistant-i1-GGUF/resolve/main/gpt-human-assistant.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/gpt-human-assistant-i1-GGUF/resolve/main/gpt-human-assistant.i1-IQ3_S.gguf) | i1-IQ3_S | 0.2 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/gpt-human-assistant-i1-GGUF/resolve/main/gpt-human-assistant.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.2 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/gpt-human-assistant-i1-GGUF/resolve/main/gpt-human-assistant.i1-IQ3_M.gguf) | i1-IQ3_M | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/gpt-human-assistant-i1-GGUF/resolve/main/gpt-human-assistant.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/gpt-human-assistant-i1-GGUF/resolve/main/gpt-human-assistant.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/gpt-human-assistant-i1-GGUF/resolve/main/gpt-human-assistant.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.2 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/gpt-human-assistant-i1-GGUF/resolve/main/gpt-human-assistant.i1-Q4_0.gguf) | i1-Q4_0 | 0.2 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/gpt-human-assistant-i1-GGUF/resolve/main/gpt-human-assistant.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.2 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/gpt-human-assistant-i1-GGUF/resolve/main/gpt-human-assistant.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.2 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/gpt-human-assistant-i1-GGUF/resolve/main/gpt-human-assistant.i1-Q4_1.gguf) | i1-Q4_1 | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/gpt-human-assistant-i1-GGUF/resolve/main/gpt-human-assistant.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.2 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/gpt-human-assistant-i1-GGUF/resolve/main/gpt-human-assistant.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/gpt-human-assistant-i1-GGUF/resolve/main/gpt-human-assistant.i1-Q5_K_M.gguf) | i1-Q5_K_M | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/gpt-human-assistant-i1-GGUF/resolve/main/gpt-human-assistant.i1-Q6_K.gguf) | i1-Q6_K | 0.2 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
gpt-human-assistant.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:48834d1751a5863475f4e576a8cbcd70bfd81d795f329cc8be471aebd8f12a3f
size 51057024

3
gpt-human-assistant.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f5bde664cca3d7bd860aecf779e5efbdc017d282589d6fd51dc6652921189b6d
size 49287552

3
gpt-human-assistant.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5f6ad17255fe1c4d9304eb6d5870701e52589b6679a03bafc41d3120900d5aae
size 60180864

3
gpt-human-assistant.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8c22206f54353d6fff0171b8cfe4db1df540a6b2af5b9cec13f3bf1f28038cc0
size 57821568

3
gpt-human-assistant.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:03e1cc291595ca3f09e21af99578d3f15b5d372cc0ca13a2def0caee68451937
size 56586624

3
gpt-human-assistant.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2ab9a92019f4a0cdf594b55a5624dfab425b785b94492f400a66a4ab07a4c2ba
size 54006144

3
gpt-human-assistant.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0439be1e329dbe107976afebd3098b68ed2c1c84cb02c2ad0e6a58ac25b600ac
size 77638080

3
gpt-human-assistant.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0793d6ea40ff25c8baeacb7954c656bc05a1795628d591a32d859502627ad194
size 73564608

3
gpt-human-assistant.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:de828535bfe727396d1b271bc6814ceea8f8bd1d829679efd5f9a3d547abde62
size 72569280

3
gpt-human-assistant.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b4a1224f81850858ea102fabecc3e2df686862c33479b61e15bda029823360ad
size 64788864

3
gpt-human-assistant.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1b552a313d3256d0fc1b965e782d4ff5a10286aa4615a9d23172144557f6bc10
size 84844992

3
gpt-human-assistant.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:32207e914c948d908d9fb2ff20e8de17466f684be0ae74f3f7b136f3a2468a5c
size 82190784

3
gpt-human-assistant.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3f0e87be763cc72c596d9dc4f8610b16d6bc5c4840371172ccb75a0b3e5b34f0
size 68532672

3
gpt-human-assistant.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7231685954098839f19d8ed3a2c07eb9e128be88c383be985c248129ec38d3cf
size 65491392

3
gpt-human-assistant.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6e4e0cbf21eacae7ef067b3def61474eb967319fa136e8a3e97c777ec9885cb8
size 85508544

3
gpt-human-assistant.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3e58ef8e367e06d906047064f6fb5fa738580ac7847ede92f9552c154e60a5c7
size 81084864

3
gpt-human-assistant.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0c5ce5dbd6cc6d8e87971010c26595298309ec3f33d2f0952d87887fa1b9a726
size 73564608

3
gpt-human-assistant.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:116fe9d53fd8198071c3542833aa562d5e49bc7a7b14b77fc670765332c6dc92
size 84992448

3
gpt-human-assistant.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5b845a1e9887f53d54c95009b6414bd51caf7f63e348168ed6722155bd9079bf
size 90153408

3
gpt-human-assistant.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e38dc5abb9c0da8acf6bc3f63880532d551b255fbde6df0a2895f5ffe98033cb
size 91148736

3
gpt-human-assistant.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e3dd7515f2e261860b8c9e9e4ba57a28794700627e887e926f69248e78a70992
size 85139904

3
gpt-human-assistant.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3c3f9224c82204f6f9f3f0afce73cdc0658513c55e53ec31acf2f411c855c405
size 100161984

3
gpt-human-assistant.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:526e41360e04a0dcb49433532b531ff5e78601de8a777948fb9e9db0280ac13f
size 95461824

3
gpt-human-assistant.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f5a3e7f78922c3908cce3031e7cb3131fdb74dd7d1b839cbf79931f8d2bb6f96
size 106742208

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:51c5dd7e3df45b136f1368e3cdc7843413435c46b087cfbaf6c5bc3334f8f66a
size 259687