初始化项目，由ModelHub XC社区提供模型

Model: RichardErkhov/saransh03sharma_-_mintrec-llama-2-7b-Folder-5-gguf
Source: Original Platform

.gitattributes

@@ -0,0 +1,57 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+mintrec-llama-2-7b-Folder-5.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+mintrec-llama-2-7b-Folder-5.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
+mintrec-llama-2-7b-Folder-5.IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
+mintrec-llama-2-7b-Folder-5.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+mintrec-llama-2-7b-Folder-5.IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
+mintrec-llama-2-7b-Folder-5.Q3_K.gguf filter=lfs diff=lfs merge=lfs -text
+mintrec-llama-2-7b-Folder-5.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+mintrec-llama-2-7b-Folder-5.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+mintrec-llama-2-7b-Folder-5.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
+mintrec-llama-2-7b-Folder-5.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+mintrec-llama-2-7b-Folder-5.IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
+mintrec-llama-2-7b-Folder-5.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+mintrec-llama-2-7b-Folder-5.Q4_K.gguf filter=lfs diff=lfs merge=lfs -text
+mintrec-llama-2-7b-Folder-5.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+mintrec-llama-2-7b-Folder-5.Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
+mintrec-llama-2-7b-Folder-5.Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
+mintrec-llama-2-7b-Folder-5.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+mintrec-llama-2-7b-Folder-5.Q5_K.gguf filter=lfs diff=lfs merge=lfs -text
+mintrec-llama-2-7b-Folder-5.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+mintrec-llama-2-7b-Folder-5.Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
+mintrec-llama-2-7b-Folder-5.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+mintrec-llama-2-7b-Folder-5.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,243 @@
+Quantization made by Richard Erkhov.
+
+[Github](https://github.com/RichardErkhov)
+
+[Discord](https://discord.gg/pvy7H8DZMG)
+
+[Request more models](https://github.com/RichardErkhov/quant_request)
+
+
+mintrec-llama-2-7b-Folder-5 - GGUF
+- Model creator: https://huggingface.co/saransh03sharma/
+- Original model: https://huggingface.co/saransh03sharma/mintrec-llama-2-7b-Folder-5/
+
+
+| Name | Quant method | Size |
+| ---- | ---- | ---- |
+| [mintrec-llama-2-7b-Folder-5.Q2_K.gguf](https://huggingface.co/RichardErkhov/saransh03sharma_-_mintrec-llama-2-7b-Folder-5-gguf/blob/main/mintrec-llama-2-7b-Folder-5.Q2_K.gguf) | Q2_K | 2.36GB |
+| [mintrec-llama-2-7b-Folder-5.IQ3_XS.gguf](https://huggingface.co/RichardErkhov/saransh03sharma_-_mintrec-llama-2-7b-Folder-5-gguf/blob/main/mintrec-llama-2-7b-Folder-5.IQ3_XS.gguf) | IQ3_XS | 2.6GB |
+| [mintrec-llama-2-7b-Folder-5.IQ3_S.gguf](https://huggingface.co/RichardErkhov/saransh03sharma_-_mintrec-llama-2-7b-Folder-5-gguf/blob/main/mintrec-llama-2-7b-Folder-5.IQ3_S.gguf) | IQ3_S | 2.75GB |
+| [mintrec-llama-2-7b-Folder-5.Q3_K_S.gguf](https://huggingface.co/RichardErkhov/saransh03sharma_-_mintrec-llama-2-7b-Folder-5-gguf/blob/main/mintrec-llama-2-7b-Folder-5.Q3_K_S.gguf) | Q3_K_S | 2.75GB |
+| [mintrec-llama-2-7b-Folder-5.IQ3_M.gguf](https://huggingface.co/RichardErkhov/saransh03sharma_-_mintrec-llama-2-7b-Folder-5-gguf/blob/main/mintrec-llama-2-7b-Folder-5.IQ3_M.gguf) | IQ3_M | 2.9GB |
+| [mintrec-llama-2-7b-Folder-5.Q3_K.gguf](https://huggingface.co/RichardErkhov/saransh03sharma_-_mintrec-llama-2-7b-Folder-5-gguf/blob/main/mintrec-llama-2-7b-Folder-5.Q3_K.gguf) | Q3_K | 3.07GB |
+| [mintrec-llama-2-7b-Folder-5.Q3_K_M.gguf](https://huggingface.co/RichardErkhov/saransh03sharma_-_mintrec-llama-2-7b-Folder-5-gguf/blob/main/mintrec-llama-2-7b-Folder-5.Q3_K_M.gguf) | Q3_K_M | 3.07GB |
+| [mintrec-llama-2-7b-Folder-5.Q3_K_L.gguf](https://huggingface.co/RichardErkhov/saransh03sharma_-_mintrec-llama-2-7b-Folder-5-gguf/blob/main/mintrec-llama-2-7b-Folder-5.Q3_K_L.gguf) | Q3_K_L | 3.35GB |
+| [mintrec-llama-2-7b-Folder-5.IQ4_XS.gguf](https://huggingface.co/RichardErkhov/saransh03sharma_-_mintrec-llama-2-7b-Folder-5-gguf/blob/main/mintrec-llama-2-7b-Folder-5.IQ4_XS.gguf) | IQ4_XS | 3.4GB |
+| [mintrec-llama-2-7b-Folder-5.Q4_0.gguf](https://huggingface.co/RichardErkhov/saransh03sharma_-_mintrec-llama-2-7b-Folder-5-gguf/blob/main/mintrec-llama-2-7b-Folder-5.Q4_0.gguf) | Q4_0 | 3.56GB |
+| [mintrec-llama-2-7b-Folder-5.IQ4_NL.gguf](https://huggingface.co/RichardErkhov/saransh03sharma_-_mintrec-llama-2-7b-Folder-5-gguf/blob/main/mintrec-llama-2-7b-Folder-5.IQ4_NL.gguf) | IQ4_NL | 3.58GB |
+| [mintrec-llama-2-7b-Folder-5.Q4_K_S.gguf](https://huggingface.co/RichardErkhov/saransh03sharma_-_mintrec-llama-2-7b-Folder-5-gguf/blob/main/mintrec-llama-2-7b-Folder-5.Q4_K_S.gguf) | Q4_K_S | 3.59GB |
+| [mintrec-llama-2-7b-Folder-5.Q4_K.gguf](https://huggingface.co/RichardErkhov/saransh03sharma_-_mintrec-llama-2-7b-Folder-5-gguf/blob/main/mintrec-llama-2-7b-Folder-5.Q4_K.gguf) | Q4_K | 3.8GB |
+| [mintrec-llama-2-7b-Folder-5.Q4_K_M.gguf](https://huggingface.co/RichardErkhov/saransh03sharma_-_mintrec-llama-2-7b-Folder-5-gguf/blob/main/mintrec-llama-2-7b-Folder-5.Q4_K_M.gguf) | Q4_K_M | 3.8GB |
+| [mintrec-llama-2-7b-Folder-5.Q4_1.gguf](https://huggingface.co/RichardErkhov/saransh03sharma_-_mintrec-llama-2-7b-Folder-5-gguf/blob/main/mintrec-llama-2-7b-Folder-5.Q4_1.gguf) | Q4_1 | 3.95GB |
+| [mintrec-llama-2-7b-Folder-5.Q5_0.gguf](https://huggingface.co/RichardErkhov/saransh03sharma_-_mintrec-llama-2-7b-Folder-5-gguf/blob/main/mintrec-llama-2-7b-Folder-5.Q5_0.gguf) | Q5_0 | 4.33GB |
+| [mintrec-llama-2-7b-Folder-5.Q5_K_S.gguf](https://huggingface.co/RichardErkhov/saransh03sharma_-_mintrec-llama-2-7b-Folder-5-gguf/blob/main/mintrec-llama-2-7b-Folder-5.Q5_K_S.gguf) | Q5_K_S | 4.33GB |
+| [mintrec-llama-2-7b-Folder-5.Q5_K.gguf](https://huggingface.co/RichardErkhov/saransh03sharma_-_mintrec-llama-2-7b-Folder-5-gguf/blob/main/mintrec-llama-2-7b-Folder-5.Q5_K.gguf) | Q5_K | 4.45GB |
+| [mintrec-llama-2-7b-Folder-5.Q5_K_M.gguf](https://huggingface.co/RichardErkhov/saransh03sharma_-_mintrec-llama-2-7b-Folder-5-gguf/blob/main/mintrec-llama-2-7b-Folder-5.Q5_K_M.gguf) | Q5_K_M | 4.45GB |
+| [mintrec-llama-2-7b-Folder-5.Q5_1.gguf](https://huggingface.co/RichardErkhov/saransh03sharma_-_mintrec-llama-2-7b-Folder-5-gguf/blob/main/mintrec-llama-2-7b-Folder-5.Q5_1.gguf) | Q5_1 | 4.72GB |
+| [mintrec-llama-2-7b-Folder-5.Q6_K.gguf](https://huggingface.co/RichardErkhov/saransh03sharma_-_mintrec-llama-2-7b-Folder-5-gguf/blob/main/mintrec-llama-2-7b-Folder-5.Q6_K.gguf) | Q6_K | 5.15GB |
+| [mintrec-llama-2-7b-Folder-5.Q8_0.gguf](https://huggingface.co/RichardErkhov/saransh03sharma_-_mintrec-llama-2-7b-Folder-5-gguf/blob/main/mintrec-llama-2-7b-Folder-5.Q8_0.gguf) | Q8_0 | 6.67GB |
+
+
+
+
+Original model description:
+---
+library_name: transformers
+tags: []
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+

mintrec-llama-2-7b-Folder-5.IQ3_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:af3efb293e95aa71479fedc7ff44ececfcfda426b624e2300c022952cd6df1c1
+size 3114864768

mintrec-llama-2-7b-Folder-5.IQ3_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:644bedf3d1353cefcc70e0e9d7b2a542efda53c8ff009e52bfab74bc8f927683
+size 2948305024

mintrec-llama-2-7b-Folder-5.IQ3_XS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:81bc234b47fa1cc68d5ca46dc3178d7966a19a9d7b0d9fa4249b87bcc5ba286e
+size 2796523648

mintrec-llama-2-7b-Folder-5.IQ4_NL.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c1522f684fa8ec9a86cfcb18e9658ad1a363dbe7a957f11dbe2353a3e5fbe3e4
+size 3848351872

mintrec-llama-2-7b-Folder-5.IQ4_XS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0881e711a6ac328130b52c767b2254865b1f17706a7d4d77584993c7104bb36d
+size 3647516800

mintrec-llama-2-7b-Folder-5.Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dbc97e1c610256f0607fe53c901ee7531f1ad6e708225b3568ff26402bb6b46f
+size 2532864128

mintrec-llama-2-7b-Folder-5.Q3_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:840c465120fa480da09910f03be039702a96079e1f212d6f0e11e6d770a2b865
+size 3298005120

mintrec-llama-2-7b-Folder-5.Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:96080bc2f9bd801a4251f2f1c27fa9f54c909e17fe13e214e556f7c8bea2658d
+size 3597111424

mintrec-llama-2-7b-Folder-5.Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:840c465120fa480da09910f03be039702a96079e1f212d6f0e11e6d770a2b865
+size 3298005120

mintrec-llama-2-7b-Folder-5.Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bee4fd88c55d28269fe68802f04914a6404891913901c403a0dbdeeef5fcdc35
+size 2948305024

mintrec-llama-2-7b-Folder-5.Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1d3b62b13e83c8776fae66ac532d224ac03f0487c8ddb4b252a6fdb9f2b20f4c
+size 3825807488

mintrec-llama-2-7b-Folder-5.Q4_1.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cbfa112a3dbb6d5226904fec65564ca91369f81a70c6ca459e1c31fbc1f8bab2
+size 4238749824

mintrec-llama-2-7b-Folder-5.Q4_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:db8998a0cab08891a8593f572c3c70c54f699283315f2493b9207437ffd4d426
+size 4081004672

mintrec-llama-2-7b-Folder-5.Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:db8998a0cab08891a8593f572c3c70c54f699283315f2493b9207437ffd4d426
+size 4081004672

mintrec-llama-2-7b-Folder-5.Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0c9e2944af1be4a9e38ee0c6c37eca04f1d37db738a5b16bdd06e1965dd99588
+size 3856740480

mintrec-llama-2-7b-Folder-5.Q5_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e2670e6f8672020da9c25631df96fdaa43fe6245bde848e246ab3dbff3badca5
+size 4651692160

mintrec-llama-2-7b-Folder-5.Q5_1.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:29a633febab30c7ce8dc0f371dcecb574c2059a432b7d4f38e8aa4715e8b0494
+size 5064634496

mintrec-llama-2-7b-Folder-5.Q5_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0cc299e294d9a3c9847299359b4fd1b2bee56b6563ecc91fe9ae1cd4dce4e26f
+size 4783157376

mintrec-llama-2-7b-Folder-5.Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0cc299e294d9a3c9847299359b4fd1b2bee56b6563ecc91fe9ae1cd4dce4e26f
+size 4783157376

mintrec-llama-2-7b-Folder-5.Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f377160eb9c65c9547e45beedfa3be8d2808914ce133f1b343607b6614b1ae2e
+size 4651692160

mintrec-llama-2-7b-Folder-5.Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c149b214deae308a00ffa3bb7e5e7655863795ed06f3db93758d63643d8b7c5c
+size 5529194624

mintrec-llama-2-7b-Folder-5.Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5bd18caf33e4574f9126c8a7b9dd3e4d9c3f583e68e0d64149503f6c03ef2069
+size 7161090176