初始化项目，由ModelHub XC社区提供模型

Model: Lewdiculous/Erosumika-7B-v3-0.2-GGUF-IQ-Imatrix
Source: Original Platform

README.md

@@ -0,0 +1,71 @@
+---
+language:
+- en
+pipeline_tag: text-generation
+tags:
+- text-generation-inference
+- instruct
+- conversational
+- roleplay
+- mistral
+- merge
+- sillytavern
+license: cc-by-4.0
+---
+
+This repo contains GGUF-IQ-Imatrix quantized model files for [Erosumika-7B-v3-0.2](https://huggingface.co/localfultonextractor/Erosumika-7B-v3-0.2).
+
+**Recommended starting [SillyTavern presets here](https://huggingface.co/Lewdiculous/Model-Requests/tree/main/data/presets/lewdicu-3.0.2-mistral-0.2).**
+
+Quants:
+
+         "Q4_K_M", "Q4_K_S", "IQ4_XS", "Q5_K_M", "Q5_K_S",
+         "Q6_K", "Q8_0", "IQ3_M", "IQ3_S", "IQ3_XXS"
+
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/L2l7DXKyLTD6MuL16JPn1.png)
+
+**What does "Imatrix" mean?**
+
+It stands for **Importance Matrix**, a technique used to improve the quality of quantized models.
+The **Imatrix** is calculated based on calibration data, and it helps determine the importance of different model activations during the quantization process.
+The idea is to preserve the most important information during quantization, which can help reduce the loss of model performance, especially when the calibration data is diverse.
+[[1]](https://github.com/ggerganov/llama.cpp/discussions/5006) [[2]](https://github.com/ggerganov/llama.cpp/discussions/5263#discussioncomment-8395384)
+
+For imatrix data generation, kalomaze's `groups_merged.txt` with added roleplay chats was used, you can find it [here](https://huggingface.co/Lewdiculous/Datura_7B-GGUF-Imatrix/blob/main/imatrix-with-rp-format-data.txt). This was just to add a bit more diversity to the data.
+
+**Steps:**
+
+```
+Base⇢ GGUF(F16)⇢ Imatrix-Data(F16)⇢ GGUF(Imatrix-Quants)
+```
+*Using the latest llama.cpp at the time.*
+
+# Original model information:
+
+<h1 style="text-align: center">Erosumika-7B-v3-0.2</h1>
+<h2 style="text-align: center">~Mistral 0.2 Edition~</h1>
+
+<div style="display: flex; justify-content: center;">
+    <img src="https://cdn-uploads.huggingface.co/production/uploads/6512681f4151fb1fa719e033/8YBKfcegQZliRlQNm0oir.gif" alt="Header GIF">
+</div>
+
+## Model Details
+The Mistral 0.2 version of Erosumika-7B-v3, a DARE TIES merge between Nitral's [Kunocchini-7b](https://huggingface.co/Nitral-AI/Kunocchini-7b), Endevor's [InfinityRP-v1-7B](https://huggingface.co/Endevor/InfinityRP-v1-7B) and my [FlatErosAlpha](https://huggingface.co/localfultonextractor/FlatErosAlpha), a flattened(in order to keep the vocab size 32000) version of tavtav's [eros-7B-ALPHA](https://huggingface.co/tavtav/eros-7B-ALPHA). Alpaca and ChatML work best. Slightly smarter and better prompt comprehension than Mistral 0.1 Erosumika-7B-v3. 32k context should work.
+
+[GGUF quants](https://huggingface.co/localfultonextractor/Erosumika-7B-v3-0.2-GGUF)
+
+
+## Limitations and biases
+The intended use-case for this model is fictional writing for entertainment purposes. Any other sort of usage is out of scope. 
+It may produce socially unacceptable or undesirable text, even if the prompt itself does not include anything explicitly offensive. Outputs might often be factually wrong or misleading.
+
+
+```yaml
+merge_method: task_arithmetic
+base_model: alpindale/Mistral-7B-v0.2-hf
+models:
+  - model: localfultonextractor/Erosumika-7B-v3
+    parameters:
+      weight: 1.0
+dtype: float16
+```