初始化项目，由ModelHub XC社区提供模型

Model: mradermacher/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-i1-GGUF
Source: Original Platform

.gitattributes

@@ -0,0 +1,57 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+imatrix.dat filter=lfs diff=lfs merge=lfs -text
+Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
+Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
+Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
+Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
+Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
+Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
+Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
+Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
+Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
+Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
+Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text

Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-IQ1_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5d0bab9c8d3f504eb29a34940a5db39cd9429deaee1c2daa62c2148e17de9a05
+size 2161973248

Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-IQ1_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b10d2bbac52515417c6811456a41fa2d7f582eac3aca86da473ff90d84cd61bf
+size 2019629056

Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-IQ2_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:726fa31fda9e35fe27fc7fffae178a535c771b38333dcb0b609a6d233b07774e
+size 2948282368

Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-IQ2_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4ea2afc9a6d1b7a19f54852ef8d95644d8c9afdb29b640646c24844796fa355f
+size 2758490112

Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-IQ2_XS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:46d30d0f194618746eb789bdc9dcc7488ee08bf836c63c6b021bac6b3ad9af9f
+size 2605783040

Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-IQ2_XXS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:49dc9e122781806ed9d2f134606e5f618d0549a8416dff59e58450526e82980a
+size 2399213568

Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-IQ3_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7c7bcec640d6364bd09d88ff77d1b36907fd0beedc03b9641212e2ea9f22ee94
+size 3784824832

Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-IQ3_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9fbff3c21d60a84786437f584adca2748142b2fbf5761bc76f177ebbe2537436
+size 3682326528

Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-IQ3_XS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:659bf5d7757301fe79110301c3518f422f7b1e4c18d9f3b19c8bdb7a24e99163
+size 3518748672

Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-IQ3_XXS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:391d4ede8e8bc8abe6d8e5bab539811aa88ee5a9777a9954a4556664bd1e051d
+size 3274913792

Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-IQ4_XS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c90090b9e8e17eb660e959dfc2221d5daa1097f4ac98e10efe5cac51bee854ed
+size 4447664128

Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:92d7b56ae631f13b20fb099387ce1394fa0bdff94314869f907ec8eb501376b9
+size 3179132928

Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:994e910ba7a5a31d2d270ab99e2a1f755f6aa49496c1b01ecc2217d3fe35e770
+size 4321957888

Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b3e5b8c55e8fdf464f500af53ec2d4ac3ff9610411be9e52d9140475ff87d7d5
+size 4018919424

Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:41f1f7dc18871a5e0d3a13d3670dfd97af5f47f41e02f4175b9474b50ce1f74c
+size 3664500736

Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3f7611a82d233cc3299e52fc1ec7adb9ec279b33ac604980463f07b43436d571
+size 4675893248

Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cad10301fef33e8e71f950539211d44881a8d0320e123835980426e048721f0e
+size 4920735744

Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0e4abb7c6f007a6ab96466d85f2bcc4fed7a9a19415267cca2961675b483fb66
+size 4692670464

Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8711fde763d99f833ef6e9aabff3fe4d2e1489d01486dbe3724bbb39a7d832cb
+size 5732988928

Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4485e150a723c7b750dc830dc4b1f63bb90717e53c03f89568d8e6bcdece01d9
+size 5599295488

Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0c6a8833f3454d64a1a476a110cff9fb5a4107e01120e3cc19d754d332e9ca30
+size 6596007936

README.md

@@ -0,0 +1,101 @@
+---
+base_model: aifeifei799/Llama-3.1-8B-Instruct-Fei-v1-Uncensored
+extra_gated_fields:
+  Affiliation: text
+  Country: country
+  Date of birth: date_picker
+  First Name: text
+  Job title:
+    options:
+    - Student
+    - Research Graduate
+    - AI researcher
+    - AI developer/engineer
+    - Reporter
+    - Other
+    type: select
+  Last Name: text
+language:
+- en
+- de
+- fr
+- it
+- pt
+- hi
+- es
+- th
+library_name: transformers
+license: llama3.1
+quantized_by: mradermacher
+tags:
+- facebook
+- meta
+- pytorch
+- llama
+- llama-3
+---
+## About
+
+<!-- ### quantize_version: 2 -->
+<!-- ### output_tensor_quantised: 1 -->
+<!-- ### convert_type: hf -->
+<!-- ### vocab_type:  -->
+<!-- ### tags: nicoboss -->
+weighted/imatrix quants of https://huggingface.co/aifeifei799/Llama-3.1-8B-Instruct-Fei-v1-Uncensored
+
+<!-- provided-files -->
+static quants are available at https://huggingface.co/mradermacher/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-GGUF
+## Usage
+
+If you are unsure how to use GGUF files, refer to one of [TheBloke's
+READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
+more details, including on how to concatenate multi-part files.
+
+## Provided Quants
+
+(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
+
+| Link | Type | Size/GB | Notes |
+|:-----|:-----|--------:|:------|
+| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-i1-GGUF/resolve/main/Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-IQ1_S.gguf) | i1-IQ1_S | 2.1 | for the desperate |
+| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-i1-GGUF/resolve/main/Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-IQ1_M.gguf) | i1-IQ1_M | 2.3 | mostly desperate |
+| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-i1-GGUF/resolve/main/Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.5 |  |
+| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-i1-GGUF/resolve/main/Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.7 |  |
+| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-i1-GGUF/resolve/main/Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-IQ2_S.gguf) | i1-IQ2_S | 2.9 |  |
+| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-i1-GGUF/resolve/main/Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-IQ2_M.gguf) | i1-IQ2_M | 3.0 |  |
+| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-i1-GGUF/resolve/main/Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-Q2_K.gguf) | i1-Q2_K | 3.3 | IQ3_XXS probably better |
+| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-i1-GGUF/resolve/main/Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.4 | lower quality |
+| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-i1-GGUF/resolve/main/Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.6 |  |
+| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-i1-GGUF/resolve/main/Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.8 | IQ3_XS probably better |
+| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-i1-GGUF/resolve/main/Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-IQ3_S.gguf) | i1-IQ3_S | 3.8 | beats Q3_K* |
+| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-i1-GGUF/resolve/main/Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-IQ3_M.gguf) | i1-IQ3_M | 3.9 |  |
+| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-i1-GGUF/resolve/main/Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.1 | IQ3_S probably better |
+| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-i1-GGUF/resolve/main/Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.4 | IQ3_M probably better |
+| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-i1-GGUF/resolve/main/Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.5 |  |
+| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-i1-GGUF/resolve/main/Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-Q4_0.gguf) | i1-Q4_0 | 4.8 | fast, low quality |
+| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-i1-GGUF/resolve/main/Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.8 | optimal size/speed/quality |
+| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-i1-GGUF/resolve/main/Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.0 | fast, recommended |
+| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-i1-GGUF/resolve/main/Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.7 |  |
+| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-i1-GGUF/resolve/main/Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.8 |  |
+| [GGUF](https://huggingface.co/mradermacher/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-i1-GGUF/resolve/main/Llama-3.1-8B-Instruct-Fei-v1-Uncensored.i1-Q6_K.gguf) | i1-Q6_K | 6.7 | practically like static Q6_K |
+
+Here is a handy graph by ikawrakow comparing some lower-quality quant
+types (lower is better):
+
+![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
+
+And here are Artefact2's thoughts on the matter:
+https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
+
+## FAQ / Model Request
+
+See https://huggingface.co/mradermacher/model_requests for some answers to
+questions you might have and/or if you want some other model quantized.
+
+## Thanks
+
+I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
+me use its servers and providing upgrades to my workstation to enable
+this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
+
+<!-- end -->

imatrix.dat

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d78182413e866921fc5573002802e2774d2d4bd630393491b28f7845f302bd57
+size 4988157