mradermacher/OceanGPT-14B-v0.1-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/OceanGPT-14B-v0.1-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-05 07:08:16 +08:00
commit 5ea7d7fe8c
24 changed files with 203 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

57
.gitattributes vendored Normal file
View File

@@ -0,0 +1,57 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
OceanGPT-14B-v0.1.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
OceanGPT-14B-v0.1.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
OceanGPT-14B-v0.1.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
OceanGPT-14B-v0.1.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
OceanGPT-14B-v0.1.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
OceanGPT-14B-v0.1.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
OceanGPT-14B-v0.1.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
OceanGPT-14B-v0.1.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
OceanGPT-14B-v0.1.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
OceanGPT-14B-v0.1.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
OceanGPT-14B-v0.1.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
OceanGPT-14B-v0.1.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
OceanGPT-14B-v0.1.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
OceanGPT-14B-v0.1.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
OceanGPT-14B-v0.1.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
OceanGPT-14B-v0.1.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
OceanGPT-14B-v0.1.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
OceanGPT-14B-v0.1.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
OceanGPT-14B-v0.1.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
OceanGPT-14B-v0.1.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
OceanGPT-14B-v0.1.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text

3
OceanGPT-14B-v0.1.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f997a026bb76617cd7f35930d01d450e3d93a4bc5b1b75845d947ed796304812
size 4678902016

3
OceanGPT-14B-v0.1.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:85ae96638c301eee9597c549a60eb37129e7049150e49d4908d2a60680a51f95
size 4498268416

3
OceanGPT-14B-v0.1.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:236ccf11bcbc3711d8695996e7df880dfa1b672be7d94c2b74f0935215d522ad
size 5827440896

3
OceanGPT-14B-v0.1.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1ef2fe80bd532ef6039b6c6357d0ec2930a1a22daa8ba8fc91552dad2381a9b1
size 5586596096

3
OceanGPT-14B-v0.1.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f76ab9a44202a83020c04547ef2727677ea2efb2e406e7f9cabf07d06ae7f5e2
size 5253570816

3
OceanGPT-14B-v0.1.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f08773e9bb56c9e473a77e8f706d98dcb18ff89f0a7eeaf37498fb477d7b8cfd
size 4979958016

3
OceanGPT-14B-v0.1.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cbfaf3c990faf7053a67fb1a9bdf678269d873259739df827d1745e575e170d7
size 7096156416

3
OceanGPT-14B-v0.1.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0124c9654dd6be3ea024faa5d17308b8a75a0ae4b7b6291c471906c6378c2255
size 6773801216

3
OceanGPT-14B-v0.1.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fa7141e217bab02620b08f5ec0fb0a2f617ef75abf03615d602e2591085955a8
size 6478274816

3
OceanGPT-14B-v0.1.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5d29b0037fd99b22b008bafdcb4e468fcb09a76d42f926f067c57c3ad9f7ffab
size 6128906496

3
OceanGPT-14B-v0.1.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1bcc71491e71f8d716c49c8c81c3b582efa543d82cf794420a77f632e537c425
size 7848612096

3
OceanGPT-14B-v0.1.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a4ab3f5fcf34335c0f5064d0d2f503f21224263ba2a66e75cc237c59ca4a2327
size 5911982336

3
OceanGPT-14B-v0.1.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:17e6f1e0fabb25a432075c426866b23a67370b81934264df9447f2c025152c70
size 7840399616

3
OceanGPT-14B-v0.1.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cd6611ab546866404d2786ee2da7cc928b7c0b54d12189b765dbf8b114a44b8a
size 7418265856

3
OceanGPT-14B-v0.1.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dec6d76e954b541f06d82964df439f3bd7123fa0132077853d3594cddc4c86cf
size 6773801216

3
OceanGPT-14B-v0.1.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:44a01381941fd209d36650658a8cbdc3e19d90d7bf2b05041425401947485148
size 8201236736

3
OceanGPT-14B-v0.1.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:db1904073fdc72343b5e916b9fe765dd467997d48c528c0db14ef38536207279
size 9191035136

3
OceanGPT-14B-v0.1.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1c3f6ecc63d963bd4f168829ee553bf51ec07281fec370bf6c86bfd42b659fc4
size 8564961536

3
OceanGPT-14B-v0.1.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d866a4d01e86c00b003a11c651ced40749bee56388565e85a5f3a1bdf7bbe3f3
size 10535997696

3
OceanGPT-14B-v0.1.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:baf122e73d5a46e0692dc33b23ea6f71e10e7b7e5860d2047dd1fe0b4bcf6c1e
size 10028093696

3
OceanGPT-14B-v0.1.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0b00ad62472dea75f3bcbb582246bb7da0bea43e51942967cf61bc5f064bd02b
size 12310159616

80
README.md Normal file
View File

@@ -0,0 +1,80 @@
---
base_model: zjunlp/OceanGPT-basic-14B-v0.1
datasets:
- zjunlp/OceanInstruct
language:
- en
- zh
library_name: transformers
license: mit
quantized_by: mradermacher
tags:
- ocean
- text-generation-inference
- oceangpt
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/zjunlp/OceanGPT-basic-14B-v0.1
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/OceanGPT-14B-v0.1-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/OceanGPT-14B-v0.1-i1-GGUF/resolve/main/OceanGPT-14B-v0.1.i1-IQ1_S.gguf) | i1-IQ1_S | 4.6 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/OceanGPT-14B-v0.1-i1-GGUF/resolve/main/OceanGPT-14B-v0.1.i1-IQ1_M.gguf) | i1-IQ1_M | 4.8 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/OceanGPT-14B-v0.1-i1-GGUF/resolve/main/OceanGPT-14B-v0.1.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 5.1 | |
| [GGUF](https://huggingface.co/mradermacher/OceanGPT-14B-v0.1-i1-GGUF/resolve/main/OceanGPT-14B-v0.1.i1-IQ2_XS.gguf) | i1-IQ2_XS | 5.4 | |
| [GGUF](https://huggingface.co/mradermacher/OceanGPT-14B-v0.1-i1-GGUF/resolve/main/OceanGPT-14B-v0.1.i1-IQ2_S.gguf) | i1-IQ2_S | 5.7 | |
| [GGUF](https://huggingface.co/mradermacher/OceanGPT-14B-v0.1-i1-GGUF/resolve/main/OceanGPT-14B-v0.1.i1-IQ2_M.gguf) | i1-IQ2_M | 5.9 | |
| [GGUF](https://huggingface.co/mradermacher/OceanGPT-14B-v0.1-i1-GGUF/resolve/main/OceanGPT-14B-v0.1.i1-Q2_K.gguf) | i1-Q2_K | 6.0 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/OceanGPT-14B-v0.1-i1-GGUF/resolve/main/OceanGPT-14B-v0.1.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 6.2 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/OceanGPT-14B-v0.1-i1-GGUF/resolve/main/OceanGPT-14B-v0.1.i1-IQ3_XS.gguf) | i1-IQ3_XS | 6.6 | |
| [GGUF](https://huggingface.co/mradermacher/OceanGPT-14B-v0.1-i1-GGUF/resolve/main/OceanGPT-14B-v0.1.i1-IQ3_S.gguf) | i1-IQ3_S | 6.9 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/OceanGPT-14B-v0.1-i1-GGUF/resolve/main/OceanGPT-14B-v0.1.i1-Q3_K_S.gguf) | i1-Q3_K_S | 6.9 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/OceanGPT-14B-v0.1-i1-GGUF/resolve/main/OceanGPT-14B-v0.1.i1-IQ3_M.gguf) | i1-IQ3_M | 7.2 | |
| [GGUF](https://huggingface.co/mradermacher/OceanGPT-14B-v0.1-i1-GGUF/resolve/main/OceanGPT-14B-v0.1.i1-Q3_K_M.gguf) | i1-Q3_K_M | 7.5 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/OceanGPT-14B-v0.1-i1-GGUF/resolve/main/OceanGPT-14B-v0.1.i1-Q3_K_L.gguf) | i1-Q3_K_L | 7.9 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/OceanGPT-14B-v0.1-i1-GGUF/resolve/main/OceanGPT-14B-v0.1.i1-IQ4_XS.gguf) | i1-IQ4_XS | 7.9 | |
| [GGUF](https://huggingface.co/mradermacher/OceanGPT-14B-v0.1-i1-GGUF/resolve/main/OceanGPT-14B-v0.1.i1-Q4_0.gguf) | i1-Q4_0 | 8.3 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/OceanGPT-14B-v0.1-i1-GGUF/resolve/main/OceanGPT-14B-v0.1.i1-Q4_K_S.gguf) | i1-Q4_K_S | 8.7 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/OceanGPT-14B-v0.1-i1-GGUF/resolve/main/OceanGPT-14B-v0.1.i1-Q4_K_M.gguf) | i1-Q4_K_M | 9.3 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/OceanGPT-14B-v0.1-i1-GGUF/resolve/main/OceanGPT-14B-v0.1.i1-Q5_K_S.gguf) | i1-Q5_K_S | 10.1 | |
| [GGUF](https://huggingface.co/mradermacher/OceanGPT-14B-v0.1-i1-GGUF/resolve/main/OceanGPT-14B-v0.1.i1-Q5_K_M.gguf) | i1-Q5_K_M | 10.6 | |
| [GGUF](https://huggingface.co/mradermacher/OceanGPT-14B-v0.1-i1-GGUF/resolve/main/OceanGPT-14B-v0.1.i1-Q6_K.gguf) | i1-Q6_K | 12.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8df4830654d3527ca2f0d842d7f0acce573ff889098d16cdb1e054925837e4c1
size 7115849