初始化项目,由ModelHub XC社区提供模型

Model: RichardErkhov/ishmanish_-_gpt2-autotrain-text-HrPolicy-aug-v2-gguf
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-26 23:36:21 +08:00
commit 9542215901
24 changed files with 211 additions and 0 deletions

57
.gitattributes vendored Normal file
View File

@@ -0,0 +1,57 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
gpt2-autotrain-text-HrPolicy-aug-v2.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
gpt2-autotrain-text-HrPolicy-aug-v2.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
gpt2-autotrain-text-HrPolicy-aug-v2.IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
gpt2-autotrain-text-HrPolicy-aug-v2.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gpt2-autotrain-text-HrPolicy-aug-v2.IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
gpt2-autotrain-text-HrPolicy-aug-v2.Q3_K.gguf filter=lfs diff=lfs merge=lfs -text
gpt2-autotrain-text-HrPolicy-aug-v2.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gpt2-autotrain-text-HrPolicy-aug-v2.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
gpt2-autotrain-text-HrPolicy-aug-v2.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
gpt2-autotrain-text-HrPolicy-aug-v2.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
gpt2-autotrain-text-HrPolicy-aug-v2.IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
gpt2-autotrain-text-HrPolicy-aug-v2.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gpt2-autotrain-text-HrPolicy-aug-v2.Q4_K.gguf filter=lfs diff=lfs merge=lfs -text
gpt2-autotrain-text-HrPolicy-aug-v2.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gpt2-autotrain-text-HrPolicy-aug-v2.Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
gpt2-autotrain-text-HrPolicy-aug-v2.Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
gpt2-autotrain-text-HrPolicy-aug-v2.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gpt2-autotrain-text-HrPolicy-aug-v2.Q5_K.gguf filter=lfs diff=lfs merge=lfs -text
gpt2-autotrain-text-HrPolicy-aug-v2.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gpt2-autotrain-text-HrPolicy-aug-v2.Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
gpt2-autotrain-text-HrPolicy-aug-v2.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
gpt2-autotrain-text-HrPolicy-aug-v2.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

88
README.md Normal file
View File

@@ -0,0 +1,88 @@
Quantization made by Richard Erkhov.
[Github](https://github.com/RichardErkhov)
[Discord](https://discord.gg/pvy7H8DZMG)
[Request more models](https://github.com/RichardErkhov/quant_request)
gpt2-autotrain-text-HrPolicy-aug-v2 - GGUF
- Model creator: https://huggingface.co/ishmanish/
- Original model: https://huggingface.co/ishmanish/gpt2-autotrain-text-HrPolicy-aug-v2/
| Name | Quant method | Size |
| ---- | ---- | ---- |
| [gpt2-autotrain-text-HrPolicy-aug-v2.Q2_K.gguf](https://huggingface.co/RichardErkhov/ishmanish_-_gpt2-autotrain-text-HrPolicy-aug-v2-gguf/blob/main/gpt2-autotrain-text-HrPolicy-aug-v2.Q2_K.gguf) | Q2_K | 0.08GB |
| [gpt2-autotrain-text-HrPolicy-aug-v2.IQ3_XS.gguf](https://huggingface.co/RichardErkhov/ishmanish_-_gpt2-autotrain-text-HrPolicy-aug-v2-gguf/blob/main/gpt2-autotrain-text-HrPolicy-aug-v2.IQ3_XS.gguf) | IQ3_XS | 0.08GB |
| [gpt2-autotrain-text-HrPolicy-aug-v2.IQ3_S.gguf](https://huggingface.co/RichardErkhov/ishmanish_-_gpt2-autotrain-text-HrPolicy-aug-v2-gguf/blob/main/gpt2-autotrain-text-HrPolicy-aug-v2.IQ3_S.gguf) | IQ3_S | 0.08GB |
| [gpt2-autotrain-text-HrPolicy-aug-v2.Q3_K_S.gguf](https://huggingface.co/RichardErkhov/ishmanish_-_gpt2-autotrain-text-HrPolicy-aug-v2-gguf/blob/main/gpt2-autotrain-text-HrPolicy-aug-v2.Q3_K_S.gguf) | Q3_K_S | 0.08GB |
| [gpt2-autotrain-text-HrPolicy-aug-v2.IQ3_M.gguf](https://huggingface.co/RichardErkhov/ishmanish_-_gpt2-autotrain-text-HrPolicy-aug-v2-gguf/blob/main/gpt2-autotrain-text-HrPolicy-aug-v2.IQ3_M.gguf) | IQ3_M | 0.09GB |
| [gpt2-autotrain-text-HrPolicy-aug-v2.Q3_K.gguf](https://huggingface.co/RichardErkhov/ishmanish_-_gpt2-autotrain-text-HrPolicy-aug-v2-gguf/blob/main/gpt2-autotrain-text-HrPolicy-aug-v2.Q3_K.gguf) | Q3_K | 0.09GB |
| [gpt2-autotrain-text-HrPolicy-aug-v2.Q3_K_M.gguf](https://huggingface.co/RichardErkhov/ishmanish_-_gpt2-autotrain-text-HrPolicy-aug-v2-gguf/blob/main/gpt2-autotrain-text-HrPolicy-aug-v2.Q3_K_M.gguf) | Q3_K_M | 0.09GB |
| [gpt2-autotrain-text-HrPolicy-aug-v2.Q3_K_L.gguf](https://huggingface.co/RichardErkhov/ishmanish_-_gpt2-autotrain-text-HrPolicy-aug-v2-gguf/blob/main/gpt2-autotrain-text-HrPolicy-aug-v2.Q3_K_L.gguf) | Q3_K_L | 0.1GB |
| [gpt2-autotrain-text-HrPolicy-aug-v2.IQ4_XS.gguf](https://huggingface.co/RichardErkhov/ishmanish_-_gpt2-autotrain-text-HrPolicy-aug-v2-gguf/blob/main/gpt2-autotrain-text-HrPolicy-aug-v2.IQ4_XS.gguf) | IQ4_XS | 0.1GB |
| [gpt2-autotrain-text-HrPolicy-aug-v2.Q4_0.gguf](https://huggingface.co/RichardErkhov/ishmanish_-_gpt2-autotrain-text-HrPolicy-aug-v2-gguf/blob/main/gpt2-autotrain-text-HrPolicy-aug-v2.Q4_0.gguf) | Q4_0 | 0.1GB |
| [gpt2-autotrain-text-HrPolicy-aug-v2.IQ4_NL.gguf](https://huggingface.co/RichardErkhov/ishmanish_-_gpt2-autotrain-text-HrPolicy-aug-v2-gguf/blob/main/gpt2-autotrain-text-HrPolicy-aug-v2.IQ4_NL.gguf) | IQ4_NL | 0.1GB |
| [gpt2-autotrain-text-HrPolicy-aug-v2.Q4_K_S.gguf](https://huggingface.co/RichardErkhov/ishmanish_-_gpt2-autotrain-text-HrPolicy-aug-v2-gguf/blob/main/gpt2-autotrain-text-HrPolicy-aug-v2.Q4_K_S.gguf) | Q4_K_S | 0.1GB |
| [gpt2-autotrain-text-HrPolicy-aug-v2.Q4_K.gguf](https://huggingface.co/RichardErkhov/ishmanish_-_gpt2-autotrain-text-HrPolicy-aug-v2-gguf/blob/main/gpt2-autotrain-text-HrPolicy-aug-v2.Q4_K.gguf) | Q4_K | 0.11GB |
| [gpt2-autotrain-text-HrPolicy-aug-v2.Q4_K_M.gguf](https://huggingface.co/RichardErkhov/ishmanish_-_gpt2-autotrain-text-HrPolicy-aug-v2-gguf/blob/main/gpt2-autotrain-text-HrPolicy-aug-v2.Q4_K_M.gguf) | Q4_K_M | 0.11GB |
| [gpt2-autotrain-text-HrPolicy-aug-v2.Q4_1.gguf](https://huggingface.co/RichardErkhov/ishmanish_-_gpt2-autotrain-text-HrPolicy-aug-v2-gguf/blob/main/gpt2-autotrain-text-HrPolicy-aug-v2.Q4_1.gguf) | Q4_1 | 0.11GB |
| [gpt2-autotrain-text-HrPolicy-aug-v2.Q5_0.gguf](https://huggingface.co/RichardErkhov/ishmanish_-_gpt2-autotrain-text-HrPolicy-aug-v2-gguf/blob/main/gpt2-autotrain-text-HrPolicy-aug-v2.Q5_0.gguf) | Q5_0 | 0.11GB |
| [gpt2-autotrain-text-HrPolicy-aug-v2.Q5_K_S.gguf](https://huggingface.co/RichardErkhov/ishmanish_-_gpt2-autotrain-text-HrPolicy-aug-v2-gguf/blob/main/gpt2-autotrain-text-HrPolicy-aug-v2.Q5_K_S.gguf) | Q5_K_S | 0.11GB |
| [gpt2-autotrain-text-HrPolicy-aug-v2.Q5_K.gguf](https://huggingface.co/RichardErkhov/ishmanish_-_gpt2-autotrain-text-HrPolicy-aug-v2-gguf/blob/main/gpt2-autotrain-text-HrPolicy-aug-v2.Q5_K.gguf) | Q5_K | 0.12GB |
| [gpt2-autotrain-text-HrPolicy-aug-v2.Q5_K_M.gguf](https://huggingface.co/RichardErkhov/ishmanish_-_gpt2-autotrain-text-HrPolicy-aug-v2-gguf/blob/main/gpt2-autotrain-text-HrPolicy-aug-v2.Q5_K_M.gguf) | Q5_K_M | 0.12GB |
| [gpt2-autotrain-text-HrPolicy-aug-v2.Q5_1.gguf](https://huggingface.co/RichardErkhov/ishmanish_-_gpt2-autotrain-text-HrPolicy-aug-v2-gguf/blob/main/gpt2-autotrain-text-HrPolicy-aug-v2.Q5_1.gguf) | Q5_1 | 0.12GB |
| [gpt2-autotrain-text-HrPolicy-aug-v2.Q6_K.gguf](https://huggingface.co/RichardErkhov/ishmanish_-_gpt2-autotrain-text-HrPolicy-aug-v2-gguf/blob/main/gpt2-autotrain-text-HrPolicy-aug-v2.Q6_K.gguf) | Q6_K | 0.13GB |
| [gpt2-autotrain-text-HrPolicy-aug-v2.Q8_0.gguf](https://huggingface.co/RichardErkhov/ishmanish_-_gpt2-autotrain-text-HrPolicy-aug-v2-gguf/blob/main/gpt2-autotrain-text-HrPolicy-aug-v2.Q8_0.gguf) | Q8_0 | 0.17GB |
Original model description:
---
tags:
- autotrain
- text-generation-inference
- text-generation
library_name: transformers
widget:
- messages:
- role: user
content: What is your favorite condiment?
license: other
---
# Model Trained Using AutoTrain
This model was trained using AutoTrain. For more information, please visit [AutoTrain](https://hf.co/docs/autotrain).
# Usage
```python
from transformers import AutoModelForCausalLM, AutoTokenizer
model_path = "PATH_TO_THIS_REPO"
tokenizer = AutoTokenizer.from_pretrained(model_path)
model = AutoModelForCausalLM.from_pretrained(
model_path,
device_map="auto",
torch_dtype='auto'
).eval()
# Prompt content: "hi"
messages = [
{"role": "user", "content": "hi"}
]
input_ids = tokenizer.apply_chat_template(conversation=messages, tokenize=True, add_generation_prompt=True, return_tensors='pt')
output_ids = model.generate(input_ids.to('cuda'))
response = tokenizer.decode(output_ids[0][input_ids.shape[1]:], skip_special_tokens=True)
# Model response: "Hello! How can I assist you today?"
print(response)
```

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:23851f05e6af26ed6b848d2e1b89606d8c40ae5fd0bb1ee0baa340e772cc3983
size 94222528

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9c21a4096a8ca1e280227e0bdc5d0913d8bced345ae6eff71a1e13a4c1e3bdf6
size 90149056

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3a35ffdc65c55395532eb8f90e904f4d01825135ab9bf8e70158fca8f4bc29fb
size 89153728

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2020bc8c719bb6a21c95bb280f09bf467866cdf711c2a9c13340dab86773d00c
size 106850560

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3dd2864bff7da363c6deb8e0cd3aea04d44d584b6bc5e0b2757df0586cd85c14
size 103063904

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0d107788fcc6976a93e95ea78781b7db00864e23310f79907aebed3bdb8c2537
size 81197056

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d04c5a6ba1296ede3a4e894c76b01c591c24f33e1fc229b7377d3aff7739d26e
size 97669312

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4b3bfa56c6d70caaeb70681befc01f99257e49f2a35b3165787f245c61400508
size 102092992

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d04c5a6ba1296ede3a4e894c76b01c591c24f33e1fc229b7377d3aff7739d26e
size 97669312

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:162d642ee7dbd18e4a0d4d87834827f009ad9603a65c2d0b396c11f165b102d5
size 90149056

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5dfbcf735e967b4a916eff73c57ed0ced55dcc2f1c5269c5508fc537f84f8c22
size 106555648

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:710d7216d2fb1991ca9270177a9cd0ba5fe94247c634c3747b544c7ec4f2de14
size 114276384

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:46b30a74a43e2749b6e1555f230419bda3f649a516a24e2bf0da06bf580deac2
size 112859392

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:46b30a74a43e2749b6e1555f230419bda3f649a516a24e2bf0da06bf580deac2
size 112859392

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f46944791e057745554dacf506c3545d2b142413f07365b38be58ce622aafee1
size 106850560

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6731934ae3e886c59bc18a73cdcfe557644b8672b3eb8f609091b5f71051be00
size 121997152

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5cbeeb62c3c88e7341acb0183bd85232aab88746747d1dd6b819d60334140bc0
size 129717888

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:17a94c9eca3739af0b6f06a5bb7671c44d297b0e83b9102d842b818e84a1d97a
size 126697312

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:17a94c9eca3739af0b6f06a5bb7671c44d297b0e83b9102d842b818e84a1d97a
size 126697312

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:84e069e7793be9b43e9dafd6e10f6a088cff9544aecb7d1a53a1c44cd8e264cd
size 121997152

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e319adb10a12bca032fc03b92e42dfc3fc5e53853274bdc5d9afe283175df373
size 138403744

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:be97d0d7c9610ae2ba1637f70d2235976c53fdbc0487ebe64d94950350ba83de
size 177669472